Saturday, January 17, 2009

Hadoop & Use Cases

I spent a little time in digging out various use cases for Hadoop. Here are some of the use cases, listed by business use:
  • Search: Yahoo, Zvents, Amazon A9,
  • Log processing: Facebook, ContextWeb, Yahoo, Joost
  • Recommendation Systems: Facebook, Amazon (eg, ad placements or site suggestions)
  • Data Warehouse: Facebook, AOL
  • Video and Image Analysis: Eyealike, New York Times
Note that even the search use cases of Yahoo or A9 do not use Hadoop when a user clicks "Search" button, but merely parses the web data and generates the index files on the back-end. Hadoop takes care of the node failures during the processing and provides massive scalability & load balancing.