Full Text Indexing: Search UI

Blog post by GeneralMaximus on Fri, 2009-07-31 15:34

So far, I have been working on the indexing part of Beacon, which is nearly complete. In the coming weeks, I will be running beacond (now index_server) as a service in the background so that I can find and squash whatever bugs remain in the code. For now, index_server is blazing fast, but that might be because the indexes I test against are just a few megabytes in size. From what I hear, though, CLucene can easily handle indexes which are several gigabytes in size without blinking an eye, so speed might not be an issue as the indexes grow. Anyway, any potential performance bottlenecks will only show themselves once people start using index_server regularly.

And now for the good part: I have a basic search UI for Beacon up and running. For now, it can only perform simple keyword searches. In the future, I would love to integrate full text search into the Tracker "Find" UI, but for now I'm concentrating on improving this simple search tool.

Here is a screenshot:

screenshot3

/Files/pg/ is the directory where I'm keeping about 600MB of Project Gutenberg texts for stressing out index_server.

The next step is, of course, writing DataTranslators for a few file formats (as I've said before, PDF is top priority) and writing a simple preferences UI. I hope to post here soon with more good news :)

PS: Anybody interested in learning the CLucene query syntax can take a look at this page (although, in the future, Beacon will take a BeOS query and convert it into a CLucene query transparently).

Comments

Re: Full Text Indexing: Search UI

Great progress!

Thanks for the update :)

Re: Full Text Indexing: Search UI

Full text indexing combined with PDF DataTranslators must be very exciting!
Thanks for your hard work!

Dock in the bottom left

How did you get the dock? is it an addon?

and beacon looks very nice

Re: Dock in the bottom left

Fuddyman wrote:

How did you get the dock? is it an addon?

and beacon looks very nice

The "Dock" is called LaunchBox. You can find it in DeskBar menu -> Desktop Applets (IIRC).

Anyway, the integration of Beacon is really a good progress for Haiku.
Keep up the good work. :3

Re: Full Text Indexing: Search UI

Hi,

could you explain how do you get noticed when a file on the disk has changed / removed / added? Are live queries working?

thanks
Clemens

Re: Full Text Indexing: Search UI

ZzLeCzZ wrote:

Hi,
could you explain how do you get noticed when a file on the disk has changed / removed / added? Are live queries working?

Yes, I'm using live queries.

Re: Full Text Indexing: Search UI

I mean how do you detect that a file has been changed? E.g. do you use a query on the last modification time? or monitor all files? ...

And when a new file match the clucene query did your search window get updated automatically?

Re: Full Text Indexing: Search UI

ZzLeCzZ wrote:

I mean how do you detect that a file has been changed? E.g. do you use a query on the last modification time?

Precisely, it basically runs a live query for entries whose last modification time is greater than the last time the index was updated and works from that.

Re: Full Text Indexing: Search UI

Woot - My name suggestion seems to be chosen!
Great progress on the tool. I think the chrome around the search field can be reduced, but obviously that's a work in progress.

Re: Full Text Indexing: Search UI

Excellent work man! Keep it up!