Book Image

Elasticsearch for Hadoop

By : Vishal Shukla
Book Image

Elasticsearch for Hadoop

By: Vishal Shukla

Overview of this book

Table of Contents (15 chapters)
Elasticsearch for Hadoop
Credits
About the Author
About the Reviewers
www.PacktPub.com
Preface
Index

Basic configurations


Here are some of the basic configurations:

es.resource

This defaults to none.

Specifies the Elasticsearch resource and type where the data is read from or written to. It must be specified in the <index>/<type> format, for example, es.resource=eshadoop/wordcount.

es.resource.read

This defaults to es.resource.

Specifies the Elasticsearch resource and type where the data is read. It is useful when the same job needs to read and write data to different Elasticsearch indices/types, for example, es.resource.read=eshadoop/wordcount

es.resource.write

This defaults to es.resource.

Specifies the Elasticsearch resource and type where the data is written. It is useful when the same job needs to read and write data to different Elasticsearch indices/types, for example, es.resource.write=eshadoop/wordcount.

es.nodes

This defaults to localhost.

Specifies the Elasticsearch nodes that it needs to connect to. By default, it doesn't have to list all the nodes; ES-Hadoop discovers other nodes that are connected to the cluster. However, you can list more nodes to ensure that ES-Hadoop can connect to the cluster if some nodes are down, for example, es.nodes=localhost or es.nodes=localhost:9200.

es.port

This defaults to 9200. This setting only applies to the nodes that don't contain a port in the es.nodes configuration, for example, es.port=9200.