Solr Cookbook - Third Edition

Solr Cookbook - Third Edition - Third Edition

By : Rafal Kuc

Buy this Book

Solr Cookbook - Third Edition - Third Edition

By: Rafal Kuc

Buy this Book

Overview of this book

This book is for intermediate Solr Developers who are willing to learn and implement Pro-level practices, techniques, and solutions. This edition will specifically appeal to developers who wish to quickly get to grips with the changes and new features of Apache Solr 5.

Solr Cookbook Third Edition

Credits

About the Author

Acknowledgments

About the Reviewers

www.PacktPub.com

Preface

Free Chapter

Apache Solr Configuration

Introduction

Running Solr on a standalone Jetty

Installing ZooKeeper for SolrCloud

Migrating configuration from master-slave to SolrCloud

Choosing the proper directory configuration

Configuring the Solr spellchecker

Using Solr in a schemaless mode

Limiting I/O usage

Using core discovery

Configuring SolrCloud for NRT use cases

Configuring SolrCloud for high-indexing use cases

Configuring SolrCloud for high-querying use cases

Configuring the Solr heartbeat mechanism

Changing similarity

Indexing Your Data

Introduction

Indexing PDF files

Counting the number of fields

Using parsing update processors to parse data

Using scripting update processors to modify documents

Indexing data from a database using Data Import Handler

Incremental imports with DIH

Transforming data when using DIH

Indexing multiple geographical points

Updating document fields

Detecting the document language during indexation

Optimizing the primary key indexation

Handling multiple currencies

Analyzing Your Text Data

Introduction

Using the enumeration type

Removing HTML tags during indexing

Storing data outside of Solr index

Using synonyms

Stemming different languages

Using nonaggressive stemmers

Using the n-gram approach to do performant trailing wildcard searches

Using position increment to divide sentences

Using patterns to replace tokens

Querying Solr

Introduction

Understanding and using the Lucene query language

Using position aware queries

Using boosting with autocomplete

Phrase queries with shingles

Handling user queries without errors

Handling hierarchies with nested documents

Sorting data on the basis of a function value

Controlling the number of terms needed to match

Affecting document score using function queries

Using simple nested queries

Using the Solr document query join functionality

Handling typos with n-grams

Rescoring query results

Faceting

Introduction

Getting the number of documents with the same field value

Getting the number of documents with the same value range

Getting the number of documents matching the query and subquery

Removing filters from faceting results

Using decision tree faceting

Calculating faceting for relevant documents in groups

Improving faceting performance for low cardinality fields

Improving Solr Performance

Introduction

Handling deep paging efficiently

Configuring the document cache

Configuring the query result cache

Configuring the filter cache

Improving Solr query performance after the start and commit operations

Lowering the memory consumption of faceting and sorting

Speeding up indexing with Solr segment merge tuning

Avoiding caching of rare filters to improve the performance

Controlling the filter execution to improve expensive filter performance

Configuring numerical fields for high-performance sorting and range queries

In the Cloud

Introduction

Creating a new SolrCloud cluster

Setting up multiple collections on a single cluster

Splitting shards

Having more than a single shard from a collection on a node

Creating a collection on defined nodes

Adding replicas after collection creation

Removing replicas

Moving shards between nodes

Using aliasing

Using routing

Using Additional Functionalities

Introduction

Finding similar documents

Highlighting fragments found in documents

Efficient highlighting

Using versioning

Retrieving information about the index structure

Altering the index structure on a live collection

Grouping documents by the field value

Grouping documents by the query value

Grouping documents by the function value

Efficient documents grouping using the post filter

Dealing with Problems

Introduction

Dealing with the too many opened files exception

Diagnosing and dealing with memory problems

Configuring sorting for non-English languages

Migrating data to another collection

SolrCloud read-side fault tolerance

Using the check index functionality

Adjusting the Jetty configuration to avoid deadlocks

Tuning segment merging

Avoiding swapping

Real-life Situations

Introduction

Implementing the autocomplete functionality for products

Implementing the autocomplete functionality for categories

Handling time-sliced data using aliases

Boosting words closer to each other

Using the Solr spellchecking functionality

Using the Solr administration panel for monitoring

Automatically expiring Solr documents

Exporting whole query results

Index

Customer Reviews

5 star

4 star

3 star

2 star

1 star

Efficient highlighting

In certain situations, the standard highlighting mechanism might not be performing as you would like it to be. For example, you might have long text fields and want the highlighting mechanism to work with them. In such cases, there is a need of another, more efficient highlighter. Thankfully, there is a highlighter that is very efficient, and this recipe will show you how to use it.

How to do it...

We begin with the index structure configuration, which looks as follows (just add the following section to your schema.xml file):

<field name="id" type="string" indexed="true" stored="true" required="true" />
<field name="name" type="text_general" indexed="true" stored="true"  termVectors="true" termPositions="true" termOffsets="true" />

The next step is to index the data. We will use the following test data for the purpose of this recipe:
```
<add>
 <doc>
  <field name="id">1</field>
  <field name="name">Solr Cookbook first edition</field...
```

Solr Cookbook - Third Edition - Third Edition

By : Rafal Kuc

Solr Cookbook - Third Edition - Third Edition

By: Rafal Kuc

Overview of this book

Related Content you might be interested in

Current Title:

Solr Cookbook - Third Edition - Third Edition

Efficient highlighting

How to do it...