Index
A
- Apache Kafka
- integrating, with other tools / Integration with other tools
- contributions / Integration with other tools
- Apache Software Foundation
- URL / Introducing Hadoop
- asynchronous replication
- about / Replication in Kafka
- auto.commit.interval.ms property / The Kafka consumer property list
- auto.create.topics.enable property / The Kafka broker property list
- auto.offset.reset property / The Kafka consumer property list
B
- blocks / Introducing Hadoop
- bolt / Introducing Storm
- broker.id property / The Kafka broker property list
- ByteBufferMessageSet class / Message compression in Kafka
C
- Camus
- client.id property / The Kafka consumer property list
- Complex Event Processing (CEP) / Welcome to the world of Apache Kafka
- compressed.topics property / Message compression in Kafka
- compression.codec property / Message compression in Kafka
- consumer.id property / The Kafka consumer property list
- consumer.timeout.ms property / The Kafka consumer property list
- consumer groups / Kafka design fundamentals
- custom partitioning
- used, for creating Java producer / Creating a Java producer with custom partitioning
D
- DataSift
- URL / Kafka use cases
- default.replication.factor property / The Kafka broker property list
- design fundamentals, Kafka
- about / Kafka design fundamentals
E
- Extract Transformation Load (ETL) / Introducing Storm
F
- Foursquare
- URL / Kafka use cases
G
- Gradle tool / Installing prerequisites
- group.id property / The Kafka consumer property list
- GZIP / Message compression in Kafka
H
- Hadoop
- Kafka integration / Kafka integration with Hadoop
- about / Introducing Hadoop
- components / Introducing Hadoop
- pseudo distributed mode cluster, creating / Introducing Hadoop
- integrating / Integrating Hadoop
- Hadoop cluster
- local mode / Introducing Hadoop
- pseudo distributed mode / Introducing Hadoop
- fully distributed mode / Introducing Hadoop
- Hadoop components
- name node / Introducing Hadoop
- secondary name node / Introducing Hadoop
- data node / Introducing Hadoop
- job tracker / Introducing Hadoop
- task tracker / Introducing Hadoop
- Hadoop consumer
- about / Hadoop consumers
- Hadoop Distributed File System (HDFS) / Introducing Hadoop
- Hadoop producer
- about / Hadoop producers
- approaches, for obtaining data / Hadoop producers
- high-level consumer API, Kafka consumer
- about / The high-level consumer API
- ConsumerConnector class / The high-level consumer API
- KafkaStream class / The high-level consumer API
- ConsumerConfig class / The high-level consumer API
- high watermark (HW) / Replication in Kafka
- host.name property / The Kafka broker property list
I
- in-sync replicas (ISR) / Kafka design fundamentals, Replication in Kafka
J
- Java 1.7
- installing / Installing Java 1.7 or higher
- URL / Installing Java 1.7 or higher
- Java generic
- URL / The Java producer API
- Java Messaging Service (JMS) / Kafka integration with Storm
- Java producer
- creating, with custom partitioning / Creating a Java producer with custom partitioning
- Java producer, creating with custom partitioning
- about / Creating a Java producer with custom partitioning
- classes, importing / Defining properties
- Partitioner class, implementing / Implementing the Partitioner class
- message, building / Building the message and sending it
- message, sending / Building the message and sending it
- Java producer API
- about / The Java producer API
- Producer class / The Java producer API
- KeyedMessage class / The Java producer API
- ProducerConfig class / The Java producer API
K
- Kafka
- about / Welcome to the world of Apache Kafka
- data / Welcome to the world of Apache Kafka
- producers / Welcome to the world of Apache Kafka
- consumers / Welcome to the world of Apache Kafka
- need for / Why do we need Kafka?
- use cases / Kafka use cases
- URL / Kafka use cases, Downloading Kafka, Building Kafka
- installing / Installing Kafka
- downloading / Downloading Kafka
- building / Building Kafka
- broker property list / The Kafka broker property list
- design fundamentals / Kafka design fundamentals
- message delivery semantic / Kafka design fundamentals
- log compaction / Log compaction
- design facts / Log compaction
- message compression / Message compression in Kafka
- replication / Replication in Kafka
- integration, with Storm / Kafka integration with Storm
- integration, with Hadoop / Kafka integration with Hadoop, Introducing Hadoop, Integrating Hadoop, Hadoop producers, Hadoop consumers
- administration tools / Kafka administration tools
- cluster mirroring / Kafka cluster mirroring
- Kafka, characteristics
- persistent messaging / Welcome to the world of Apache Kafka
- high throughput / Welcome to the world of Apache Kafka
- distributed / Welcome to the world of Apache Kafka
- multiple client support / Welcome to the world of Apache Kafka
- real time / Welcome to the world of Apache Kafka
- Kafka, users
- LinkedIn / Kafka use cases
- DataSift / Kafka use cases
- Twitter / Kafka use cases
- Foursquare / Kafka use cases
- Square / Kafka use cases
- kafka-reassign-partitions.sh tool / Adding servers
- Kafka 0.7 / Message compression in Kafka
- Kafka administration tools
- cluster tools / Kafka cluster tools
- servers, adding / Adding servers
- topic tools / Kafka topic tools
- Kafka broker property
- broker.id / The Kafka broker property list
- log.dirs / The Kafka broker property list
- zookeeper.connect / The Kafka broker property list
- host.name / The Kafka broker property list
- num.partitions / The Kafka broker property list
- auto.create.topics.enable / The Kafka broker property list
- default.replication.factor / The Kafka broker property list
- Kafka cluster
- servers, adding / Adding servers
- Kafka cluster mirroring / Kafka cluster mirroring
- Kafka cluster tools / Kafka cluster tools
- Kafka consumer
- property list / The Kafka consumer property list
- Kafka consumer API
- types / Kafka consumer APIs
- high-level consumer API / The high-level consumer API
- low-level API / The low-level consumer API
- Kafka consumer property
- URL / The Kafka consumer property list
- group.id / The Kafka consumer property list
- consumer.id / The Kafka consumer property list
- zookeeper.connect / The Kafka consumer property list
- client.id / The Kafka consumer property list
- zookeeper.session.timeout.ms / The Kafka consumer property list
- zookeeper.connection.timeout.ms / The Kafka consumer property list
- zookeeper.sync.time.ms / The Kafka consumer property list
- auto.commit.enable / The Kafka consumer property list
- auto.commit.interval.ms / The Kafka consumer property list
- auto.offset.reset / The Kafka consumer property list
- consumer.timeout.ms / The Kafka consumer property list
- Kafka ecosystem tools
- Kafka installation
- prerequisites / Installing prerequisites
- Kafka producer
- property / The Kafka producer property list
- URL / The Kafka producer property list
- Kafka producer property
- metadata.broker.list / The Kafka producer property list
- serializer.class / The Kafka producer property list
- producer.type / The Kafka producer property list
- request.required.acks / The Kafka producer property list
- key.serializer.class / The Kafka producer property list
- partitioner.class / The Kafka producer property list
- compression.codec / The Kafka producer property list
- batch.num.messages / The Kafka producer property list
- Kafka replication
- about / Replication in Kafka
- URL / Replication in Kafka
- Kafka spout
- URL / Integrating Storm
- Kafka topic tools / Kafka topic tools
L
- LinkedIn
- URL / Kafka use cases
- log.dirs property / The Kafka broker property list
- log compaction / Log compaction
- log end offset (LEO) / Replication in Kafka
- low-level consumer API, Kafka consumer
- about / The low-level consumer API
- URL / The low-level consumer API
M
- message compression, Kafka / Message compression in Kafka
- multiple node-multiple broker cluster / Multiple nodes – multiple broker clusters
- multithreaded Java consumer
- about / Multithreaded Java consumers
- classes, importing / Importing classes
- properties, defining / Defining properties
- messages, reading from threads / Reading the message from threads and printing it
N
- num.partitions property / The Kafka broker property list
O
- Online Transaction Processing (OLTP) / Log compaction
P
- Partitioner class
- implementing / Implementing the Partitioner class
- partition reassignment tool
- --generate mode / Adding servers
- --execute mode / Adding servers
- --verify mode / Adding servers
- properties, simple Java-based producer
- defining / Defining properties
- metadata.broker.list / Defining properties
- serializer.class / Defining properties
- request.required.acks / Defining properties
- properties, simple Java consumer
- zookeeper.connect / Defining properties
- group.id / Defining properties
- zookeeper.session.timeout.ms / Defining properties
- zookeeper.sync.time.ms / Defining properties
- auto.commit.interval.ms / Defining properties
R
- replication modes, Kafka
- synchronous replication / Replication in Kafka
- asynchronous replication / Replication in Kafka
S
- simple Java-based producer
- about / Simple Java producers
- classes, importing / Importing classes
- properties, defining / Defining properties
- message, building / Building the message and sending it
- message, sending / Building the message and sending it
- simple Java consumer
- about / Simple Java consumers
- classes, importing / Importing classes
- properties, defining / Defining properties
- messages, reading from topic / Reading messages from a topic and printing them
- single node-multiple broker cluster
- about / A single node – multiple broker clusters
- ZooKeeper, starting / Starting ZooKeeper
- Kafka broker, starting / Starting the Kafka broker
- Kafka topic, creating / Creating a Kafka topic using the command line
- producer, starting to send messages / Starting a producer to send messages
- consumer, starting to consume messages / Starting a consumer to consume messages
- single node-single broker cluster
- about / A single node – a single broker cluster
- ZooKeeper server, starting / Starting the ZooKeeper server
- Kafka broker, starting / Starting the Kafka broker
- Kafka topic, creating / Creating a Kafka topic
- producer, starting to send messages / Starting a producer to send messages
- consumer, starting to consume messages / Starting a consumer to consume messages
- slf4j-1.7.7.tar.gz file
- Snappy / Message compression in Kafka
- spout / Introducing Storm
- Square
- URL / Kafka use cases
- Storm
- Kafka integration / Kafka integration with Storm
- about / Introducing Storm
- URL / Introducing Storm
- integrating / Integrating Storm
- storm-kafka spout
- URL / Integrating Storm
- Storm architecture
- spout / Introducing Storm
- bolt / Introducing Storm
- tuple / Introducing Storm
- workers / Introducing Storm
- executors / Introducing Storm
- synchronous replication / Replication in Kafka
T
- topicsMetadata() method / The low-level consumer API
- topologies / Introducing Storm
- Trident
- about / Integrating Storm
- URL / Integrating Storm
- Twitter
- URL / Kafka use cases
U
- use cases, Kafka
- log aggregation / Kafka use cases
- stream processing / Kafka use cases
- commit logs / Kafka use cases
- click streams tracking / Kafka use cases
- messaging / Kafka use cases
Z
- ZooKeeper
- zookeeper.connection.timeout.ms property / The Kafka consumer property list
- zookeeper.connect property / The Kafka broker property list, The Kafka consumer property list
- zookeeper.session.timeout.ms property / The Kafka consumer property list
- zookeeper.sync.time.ms property / The Kafka consumer property list