Book Image

Scaling Big Data with Hadoop and Solr

By : Hrishikesh Vijay Karambelkar
Book Image

Scaling Big Data with Hadoop and Solr

By: Hrishikesh Vijay Karambelkar

Overview of this book

<p>As data grows exponentially day-by-day, extracting information becomes a tedious activity in itself. Technologies like Hadoop are trying to address some of the concerns, while Solr provides high-speed faceted search. Bringing these two technologies together is helping organizations resolve the problem of information extraction from Big Data by providing excellent distributed faceted search capabilities.</p> <p>Scaling Big Data with Hadoop and Solr is a step-by-step guide that helps you build high performance enterprise search engines while scaling data. Starting with the basics of Apache Hadoop and Solr, this book then dives into advanced topics of optimizing search with some interesting real-world use cases and sample Java code.</p> <p>Scaling Big Data with Hadoop and Solr starts by teaching you the basics of Big Data technologies including Hadoop and its ecosystem and Apache Solr. It explains the different approaches of scaling Big Data with Hadoop and Solr, with discussion regarding the applicability, benefits, and drawbacks of each approach. It then walks readers through how sharding and indexing can be performed on Big Data followed by the performance optimization of Big Data search. Finally, it covers some real-world use cases for Big Data scaling.</p> <p>With this book, you will learn everything you need to know to build a distributed enterprise search platform as well as how to optimize this search to a greater extent resulting in maximum utilization of available resources.</p>
Table of Contents (15 chapters)
Scaling Big Data with Hadoop and Solr
Credits
About the Author
About the Reviewer
www.PacktPub.com
Preface
Index

E-commerce websites


E-commerce websites are meant to work for different types of users. These users visit the websites for multiple reasons:

  • Visitors are looking for something specific, but they can't really describe what it is

  • Visitors are looking for a specific product price/features

  • Visitors come looking for good discounts, what's new, and so on

  • Visitors wish to compare multiple products on cost/features/reviews

Most e-commerce websites are used to be built on custom developed pages running on a SQL database. Although a database provides excellent capabilities to manage your data structurally, it does not provide high speed searching and faceting like Solr. In addition to that, it becomes difficult to keep up with the queries for high performance. As the size of data grows, it hampers the overall speed and user experience.

Apache Solr in a distributed scenario provides excellent offerings in terms of browsing and searching experience. Solr can work easily, integrate with the database, and it can provide high speed search with real-time indexing. Advanced in-built features of Solr such as suggestions, a more like this search, and spelling checker can effectively help customer reach the merchandise he/she was looking for. The instance can easily be integrated with the current sites; faceting can provide interesting filters based on highest discount items, price range, type of merchandise, products from different companies, and so on, enabling a unique shopping experience for the end users. Many of the e-commerce based companies such as buy.com, dollardays.com, and macys.com have acquired distributed Solr-based solution over the traditional approach for providing customers with better browsing experience.