Index
A
- ActiveMQ
- URL / JMS source
- agent / Sources, channels, and sinks
- agent command / Starting up with "Hello, World!"
- agent identifier (name) / An overview of the Flume configuration file
- agent process
- monitoring / Monitoring the agent process
- agent process, monitoring
- AOP Spring Framework / Interceptors, channel selectors, and sink processors
- Apache Avro
- about / Apache Avro
- URL / Apache Avro
- Apache benchmark
- Apache BigTop project
- Apache Flume
- URL / The memory channel
- Apache Kafka
- Avro source/sink
- used, for tiering data flows / The Avro source/sink, The Thrift source/sink
- compressed Avro / Compressing Avro
- avro_event serializer / Apache Avro
B
- basenameHeaderKey property / Spooling Directory Source
- batchDurationMillis property / Sink configuration
- batchSize property / Sink configuration
- batchTimeout property / The Exec source
- Best effort (BE) / Flume 0.9
- byteCapacity
- URL / The memory channel
- byteCapacityBufferPercentage
- URL / The memory channel
C
- capacity planning / Capacity planning
- CDH3 distribution / Flume 0.9
- CDH 5
- URL / Archiving to HDFS
- centralized master (masters) / Flume 0.9
- cf-engine tool / Flume 1.X (Flume-NG)
- ChannelProcessor function / The memory channel
- channels / Sources, channels, and sinks
- channel selector
- about / Channel selectors
- replicating / Replicating
- multiplexing / Multiplexing
- channel selectors / Interceptors, channel selectors, and sink processors
- checkpointInterval property / The file channel
- Chef tool / Flume 1.X (Flume-NG)
- Cloudera
- Cloudera distribution
- issue solution, URL / An overview of the Flume configuration file
- codecs
- about / Compression codecs
- command-line Avro
- about / Using command-line Avro
- compliance / Compliance and data expiry
- CompressedStream / CompressedStream
- consumeOrder property / Spooling Directory Source
- cron daemon
- custom interceptors
- about / Custom interceptors
- plugins directory / The plugins directory
- custom monitoring reporting mechanism
- developing / Custom monitoring hooks
D
- -Dflume.root.logger property / Starting up with "Hello, World!"
- data/logs
- streaming / The problem with HDFS and streaming data/logs
- data expiry / Compliance and data expiry
- data flows
- tiering / Tiering flows
- data flows, tiering
- Avro source/sink, using / The Avro source/sink
- SSL Avro / SSL Avro flows
- Thrift source/sink, using / The Thrift source/sink
- command-line Avro / Using command-line Avro
- Log4J appender / The Log4J appender
- Log4J load-balancing appender / The Log4J load-balancing appender
- DataStream / DataStream
- destinationName property / JMS source
- Disk Failover (DFO) / Flume 0.9
E
- Elastic Compute Cluster (EC2) / Web logs to searchable UI
- ElasticSearch
- about / ElasticSearchSink
- URL / ElasticSearchSink, Setting up the target – Elasticsearch, Setting up a better user interface – Kibana
- versus Apache Solr / Dynamic Serializer
- setting up / Setting up the target – Elasticsearch
- ElasticSearchDynamicSerializer serializer / Dynamic Serializer
- ElasticSearchLogStashEventSerializer / LogStash Serializer
- ElasticSearchSink
- about / ElasticSearchSink
- settings / ElasticSearchSink
- ElasticSearchLogStashEventSerializer / LogStash Serializer
- ElasticSearchDynamicSerializer serializer / Dynamic Serializer
- Embedded Agent
- about / The embedded agent
- configuration / Configuration and startup
- startup / Configuration and startup
- alternative formats, URL / Configuration and startup
- data, sending / Sending data
- shutdown / Shutdown
- End-to-End (E2E) / Flume 0.9
- Event Serializer
- about / Event Serializers
- text output / Text output
- text_with_headers serializer / Text with headers
- Apache Avro / Apache Avro
- user-provided Avro schema / User-provided Avro schema
- file type / File type
- timeouts / Timeouts and workers
- workers / Timeouts and workers
- Exec source
- about / The Exec source
- properties / The Exec source
F
- file channel
- about / The file channel
- configuration parameters / The file channel
- file type
- about / File type
- SequenceFile / SequenceFile
- DataStream / DataStream
- CompressedStream / CompressedStream
- Flume
- about / Flume 0.9
- events / Flume events
- URL / Downloading Flume
- downloading / Downloading Flume
- in Hadoop distributions / Flume in Hadoop distributions
- configuration file / An overview of the Flume configuration file
- setting up, on collector/relay / Setting up Flume on collector/relay
- setting up, on client / Setting up Flume on the client
- agent process, monitoring / Monitoring the agent process
- Flume-NG (Flume the Next Generation) / Flume 0.9
- flume-ng-kafka-source
- Flume 0.9 / Flume 0.9
- Flume 1.X (Flume-NG) / Flume 1.X (Flume-NG)
- URL / Flume 1.X (Flume-NG)
- Flume configuration file
- overview / An overview of the Flume configuration file
- Flume events
- about / Flume events
- interceptors / Interceptors, channel selectors, and sink processors
- channel selectors / Interceptors, channel selectors, and sink processors
- sink processors / Interceptors, channel selectors, and sink processors
- Flume JVM
- Flume User Guide
- URL / The file channel, HDFS sink
G
- Ganglia
- grok command
- URL / The Kite SDK
H
- Hadoop distributions
- Flume / Flume in Hadoop distributions
- benefits / Flume in Hadoop distributions
- limitations / Flume in Hadoop distributions
- HDFS
- issue / The problem with HDFS and streaming data/logs
- archiving to / Archiving to HDFS
- hdfs.batchSize parameter / File rotation
- hdfs.maxOpenFiles property / Path and filename
- hdfs.timeZone property / Path and filename
- hdfs.useLocalTimeStamp boolean property / Path and filename
- HDFS sink
- about / HDFS sink
- configuration parameters / HDFS sink
- path / Path and filename
- filename / Path and filename
- file rotation / File rotation
- compression codecs / Compression codecs
- Hello, World! example
- file configuration / Starting up with "Hello, World!"
- help command / Starting up with "Hello, World!"
- Hortonworks
- Host interceptor
- Human Optimized Configuration Object Notation (HOCON)
I
- indexName property / ElasticSearchSink
- interceptor / Interceptors, channel selectors, and sink processors
- used, for creating search fields / Creating more search fields with an interceptor
- interceptors
- about / Interceptors
- adding / Interceptors
- Timestamp / Timestamp
- Host / Host
- Static / Static
- regular expression filtering / Regular expression filtering
- regular expression / Regular expression extractor
- Morphline / Morphline interceptor
- custom / Custom interceptors
- internal HTTP server
- using / Internal HTTP server
- ISO 8601
- URL / Time zones are evil
J
- Java Key Store (JKS) / SSL Avro flows
- Java properties
- JMS message selectors
- URL / JMS source
- JMS source
- about / JMS source
- configuring / JMS source
- settings / JMS source
K
- keep-alive parameter / The file channel
- keepFields property / The syslog UDP source, The syslog TCP source
- Kibana
- Kite SDK
- about / The Kite SDK
- URL / The Kite SDK
L
- Log4J appender
- about / The Log4J appender
- URL / The Log4J appender
- Log4J load-balancing appender
- logrotate utility
- Logstash
- URL / ElasticSearchSink
- log time
- versus transport time / Transport time versus log time
M
- MapR
- memoryCapacity property / Spillable Memory Channel
- memory channel
- about / The memory channel
- configuration parameters / The memory channel
- metrics
- URL / Internal HTTP server
- Mini Me counterpart / Time zones are evil
- minimumRequiredSpace property / The file channel
- Monit
- Morphline
- configuration file / Morphline configuration files
- URL / Morphline configuration files, Typical SolrSink configuration, Morphline interceptor
- Morphline commands
- URL / The Kite SDK
- morphlineId property / Sink configuration
- Morphline interceptor
- about / Morphline interceptor
- MorphlineSolrSink
- about / MorphlineSolrSink
- Morphline configuration file / Morphline configuration files
- SolrSink configuration / Typical SolrSink configuration
- sink configuration / Sink configuration
- Sink configuration / Sink configuration
- multiple data centers
- considerations / Considerations for multiple data centers
- Multiport Syslog TCP source
- about / The multiport syslog TCP source
- properties / The multiport syslog TCP source
- Flume headers / The multiport syslog TCP source
N
- Nagios
- Nagios JMX plugin
- nc command / Starting up with "Hello, World!"
- Nginx web server
O
- overflowCapacity property / Spillable Memory Channel
- overflowDeactivationThreshold property / Spillable Memory Channel
- overflowTimeout property / Spillable Memory Channel
P
- Payment Card Industry Data Security Standard (PCI DSS)
- performance metrics
- monitoring / Monitoring performance metrics
- performance metrics, monitoring
- Ganglia / Ganglia
- internal HTTP server / Internal HTTP server
- custom monitoring hooks / Custom monitoring hooks
- Personally identifiable information (PII)
- plugins directory
- about / The plugins directory
- $FLUME_HOME/plugins.d directory / The plugins directory
- lib directory / The plugins directory
- native directory / The plugins directory
- pollTimeout property / JMS source
- pom.xml file
- URL / Dynamic Serializer
- POSIX-style filesystem / The problem with HDFS and streaming data/logs
- processor.backoff property / Load balancing
- Puppet tool / Flume 1.X (Flume-NG)
R
- Red Hat Enterprise Linux (RHEL) / Flume in Hadoop distributions
- regular expression extractor interceptor
- about / Regular expression extractor
- properties / Regular expression extractor
- regular expression filtering interceptor
- about / Regular expression filtering
- URL / Regular expression filtering
- routing / Routing
- Runners / Flume 1.X (Flume-NG)
S
- Sarbanes Oxley (SOX)
- SequenceFile file type / SequenceFile
- serializer.syncIntervalBytes property / Apache Avro
- serializers / Regular expression extractor
- sink group
- about / Sink groups
- load balancing / Load balancing
- failover / Failover
- Sink Processor
- about / Sink groups
- sink processors / Interceptors, channel selectors, and sink processors
- sinks / Sources, channels, and sinks
- Solr / MorphlineSolrSink
- SolrCloud / MorphlineSolrSink
- SolrSink
- configuration / Typical SolrSink configuration
- sources / Sources, channels, and sinks
- Spillable Memory Channel
- about / Spillable Memory Channel
- configuration parameters / Spillable Memory Channel
- spool directory
- log rotation, configuring / Configuring log rotation to the spool directory
- Spooling Directory Source
- about / Spooling Directory Source
- creating / Spooling Directory Source
- properties / Spooling Directory Source
- Spring
- start() method / Custom monitoring hooks
- Statements on Standards for Attestation Engagements (SSAE-16)
- Static interceptor
- syslog sources
- about / Syslog sources
- URL / Syslog sources
- UDP source / The syslog UDP source
- TCP source / The syslog TCP source
- Multiport Syslog TCP source / The multiport syslog TCP source
- Syslog TCP source
- about / The syslog TCP source
- creating / The syslog TCP source
- Flume headers / The syslog TCP source
- syslog termsURL / Syslog sources
- Syslog UDP source
- about / The syslog UDP source
- properties / The syslog UDP source
- Flume headers / The syslog UDP source
T
- tail
- URL / The problem with using tail
- about / The problem with using tail
- issues / The problem with using tail
- tail -F command / The Exec source
- take / The memory channel
- text_with_headers serializer / Text with headers
- Thrift
- URL / The Thrift source/sink
- Thrift source/sink
- used, for tiering data flows / The Thrift source/sink
- tiered data collection / Tiered data collection (multiple flows and/or agents)
- Timestamp interceptor
- timestamp key / Regular expression extractor
- time zones / Time zones are evil
- transactionCapacity property / The file channel, Spillable Memory Channel
- transport time
- versus log time / Transport time versus log time
U
- Universally Unique Identifier (UUID)
- user-provided Avro schema / User-provided Avro schema
V
- VeriSign / SSL Avro flows
W
- web application
- simulating / Web logs to searchable UI
- web server
- setting up / Setting up the web server
- log rotation, configuring to spool directory / Configuring log rotation to the spool directory
- worker daemons (agents) / Flume 0.9
- Write Ahead Log (WAL) / The file channel
- wrk
Z
- Zookeeper / Flume 0.9