Twitter Embraces Lucene
November 9, 2010
We referenced Twitter’s use of Lucene. We wanted to document the popular tweet machine’s search system. The article “New Twitter Gets New Search Engine” reveals about a major alteration in the Twitter Search architecture to Lucene. learned:
Twitter’s Twitter search should now scale better, index more tweets per second and use less of Twitter’s system resources. All this newfound scalability and headroom will give Twitter’s developers the ability to build cool new search features in the near future.
This is due to the efforts of Michael Busch and his team, who have demonstrated Lucene/Solr scaling in a compelling way. Discarding the earlier acquired Summize’s technology, Twitter’s real-time search now uses the custom modified Lucene that is tweaked to Twitter’s unique needs. We hope Twitter’s heart settles with Lucene as a solution for its database scalability issues. The data flow from Twitter is interesting—more than 8,000 tweets per second and growing.
Harleena Singh, November 9, 2010
Freebie
Comments
-
- Subscribe to Beyond Search
Feature archive
News archive
-
