Distributed Lucene for Hadoop

19th August 2008 in London at Sekforde Street

There are 13 other SkillsCasts available from Hadoop User Group Meeting

Skillscast coming soon.

This talk describes a parallel, distributed free text index written at HP Labs Bristol called Distributed Lucene. Distributed Lucene is based on two Apache open source projects, Hadoop and Lucene, and follows a design originally proposed by Doug Cutting. It was written to gain a better understanding of the Apache Hadoop architecture, and to investigate approaches to creating large, scalable free text indexes. For more information see the accompanying HP Labs technical report.


Distributed Lucene for Hadoop

Mark Butler

Mark Butler has a varied background in computer science research, having worked on distributed systems, computational biology, software for formulating consumer products, the mobile web and the semantic web. He has a PhD in Computer Science and is