Book Image

Scaling Big Data with Hadoop and Solr, Second Edition

By : Hrishikesh Vijay Karambelkar
Book Image

Scaling Big Data with Hadoop and Solr, Second Edition

By: Hrishikesh Vijay Karambelkar

Overview of this book

Related Content you might be interested in

Current Title:

Small book image
Scaling Big Data with Hadoop and Solr, Second Edition
Hrishikesh Vijay Karambelkar
Apr, 2015 | 166 pages
No titles found
Table of Contents (13 chapters)
Scaling Big Data with Hadoop and Solr Second Edition
Scaling Big Data with Hadoop and Solr Second Edition
Credits
Credits
About the Author
About the Author
About the Reviewers
About the Reviewers
www.PacktPub.com
www.PacktPub.com
Preface
Preface
Free Chapter
1
Processing Big Data Using Hadoop and MapReduce
Processing Big Data Using Hadoop and MapReduce
Apache Hadoop's ecosystem
Configuring Apache Hadoop
Running Hadoop
Setting up a Hadoop cluster
Common problems and their solutions
Summary
2
Understanding Apache Solr
Understanding Apache Solr
Setting up Apache Solr
The Apache Solr architecture
Configuring Solr
Loading data in Apache Solr
Querying for information in Solr
Summary
3
Enabling Distributed Search using Apache Solr
Enabling Distributed Search using Apache Solr
Understanding a distributed search
Working with SolrCloud
Sharding algorithm and fault tolerance
Apache Solr and Big Data – integration with MongoDB
Summary
4
Big Data Search Using Hadoop and Its Ecosystem
Big Data Search Using Hadoop and Its Ecosystem
Understanding NoSQL
Working with the Solr HDFS connector
Big data search using Katta
Using Solr 1045 Patch – map-side indexing
Using Solr 1301 Patch – reduce-side indexing
Distributed search using Apache Blur
Apache Solr and Cassandra
Scaling Solr through Storm
Advanced analytics with Solr
Summary
5
Scaling Search Performance
Scaling Search Performance
Understanding the limits
Optimizing search schema
Index optimization
Optimizing search runtime
Monitoring Solr instance
Summary
Use Cases for Big Data Search
Use Cases for Big Data Search
E-Commerce websites
Log management for banking
Index
Index

Configuring Solr

Apache Solr allows extensive configuration to meet the needs of the consumer. Configuring the instance revolves around the following:

  • Defining a schema

  • Configuring Solr parameters

First, let's try and understand the Apache Solr structure, and then, look at all these steps to understand the configuration of Apache Solr.

Understanding the Solr structure

The Apache Solr home folder mainly contains the configuration and index-related data. These are the following major folders in the Solr collection:

Directory

Purpose

conf/

This folder contains all the configuration files of Apache Solr and is mandatory. Among them, solrconfig.xml, and schema.xml are important configuration files.

data/

This folder stores the data related to indexes generated by Solr. This is a default location for Solr to store this information. This location can be overridden by modifying conf/solrconfig.xml.

lib/

This folder is optional. If it exists, Solr will load any Jars found in this folder and...

Previous Section
End of Section 4
Next Section