Book Image

Apache Kafka Series - Kafka Streams for Data Processing [Video]

By : Stéphane Maarek
Book Image

Apache Kafka Series - Kafka Streams for Data Processing [Video]

By: Stéphane Maarek

Overview of this book

The new volume in the Apache Kafka Series! Learn the Kafka Streams data-processing library, for Apache Kafka. Join hundreds of knowledge savvy students in learning one of the most promising data-processing libraries on Apache Kafka. This course is based on Java 8, and will include one example in Scala. Kafka Streams is Java-based and therefore is not suited for any other programming language. This course is the first and only available Kafka Streams course on the web. Get it now to become a Kafka expert!

Related Content you might be interested in

Current Title:

Small book image
Apache Kafka Series - Kafka Streams for Data Processing [Video]
Stéphane Maarek
May, 2018 | 4 hours 46 minutes
No titles found
Table of Contents (10 chapters)
Free Chapter
1
Kafka Streams - First Look
What is Kafka Streams?
Course Objective / Prerequisites / Target Students
About your Instructor: Stephane Maarek
Running your first Kafka Streams Application: WordCount
Kafka Streams vs other stream processing libraries (Spark Streaming, NiFi, Flink
Code Download for this Class
2
End to End Kafka Streams Application - Word Count
Section Objective
Kafka Streams Core Concepts
Environment and IDE Setup: Java 8, Maven, IntelliJ IDEA
Starter Project Setup
Kafka Streams Application Properties
Java 8 Lambda Functions - quick overview
Word Count Application Topology
Printing the Kafka Streams Topology
Kafka Streams Graceful Shutdown
Running Application from IntelliJ IDEA
Debugging Application from IntelliJ IDEA
Internal Topics for our Kafka Streams Application
Packaging the application as Fat Jar & Running the Fat Jar
Scaling our Application
Section Wrap-Up
3
KStreams and KTables Simple Operations (Stateless)
Section Objectives
KStream & KTables
Stateless vs Stateful Operations
MapValues / Map
Filter / FilterNot
FlatMapValues / FlatMap
Branch
SelectKey
Reading from Kafka
Writing to Kafka
Streams Marked for Re-Partition
Refresher on Log Compaction
KStream and KTables Duality
Transforming a KTable to a KStream
Transforming a KStream to a KTable
Section Summary
4
Practice Exercise – FavouriteColour
FavouriteColour - Practice Exercise Description & Guidance
Stuck? Here are some Hints!
Java Solution
Running the application
Scala Solution
5
KStreams and KTables Advanced Operations (Stateful)
Section Objective
KTable groupBy
KGroupedStream / KGroupedTable Count
KGroupedStream / KGroupedTable Aggregate
KGroupedStream / KGroupedTable Reduce
KStream peek
KStream Transform / TransformValues
What if I want to write to an external System?
Summary Diagram
6
Exactly Once Semantics – Theory
What's Exactly Once?
Exactly Once in Kafka 0.11
What's the problem with at least once anyway?
How to do exactly once in Kafka Streams
7
Exactly Once Semantics - Practice Exercise – BankBalance
BankBalance - Exercise Overview
Kafka Producer Guidance
Kafka Producer Solution
Kafka Streams Guidance & Hints
Kafka Streams Solution
Running the BankBalance Application
Section Summary
8
Joins - KStream to GlobalKTable example
What are joins in Kafka Streams?
Join Constraints and GlobalKTables
The different types of joins: Inner Join, Left Join, Outer Join
Creating a join with UserEnrich Kafka Streams App
Running the Kafka Streams Join application
9
Testing your Kafka Streams Application
Testing in Kafka Streams
Setup your Kafka Streams project
Hands-On: Test your WordCount application
10
Next Steps
Congratulations and next steps
Chapter 1
Kafka Streams - First Look
Content Locked
Section 4
Running your first Kafka Streams Application: WordCount
This video gives a full end to end run of your first Kafka streams application, right from downloading Kafka, starting your own cluster, running producers, consumers and your first Kafka streams application.
Previous Section
End of Section 4
Next Section