IIRF Online > Development > Database Design & Development > Apache Kafka > Apache Kafka Series - Kafka Streams for Data Processing
Apache Kafka Series - Kafka Streams for Data Processing by Udemy
Learn the Kafka Streams API with Hands-On Examples, Learn Exactly Once, Build and Deploy Apps with Java 8
Course Highlights
- Write four Kafka Streams application in Java 8
- Configure Kafka Streams to use Exactly Once Semantics
- Scale Kafka Streams applications
- Program with the High Level DSL of Kafka Streams
- Build and package your application
- Write tests for your Kafka Streams Topology
- And so much more!
Skills you will learn!
Curriculum
5 Topics
What is Kafka Streams?
Course Objective / Prerequisites / Target Students
About your Instructor: Stephane Maarek
Running your first Kafka Streams Application: WordCount
Kafka Streams vs other stream processing libraries (Spark Streaming NiFI Flink
1 Topic
Code Download
15 Topics
Section Objective
Kafka Streams Core Concepts
Environment and IDE Setup: Java 8 Maven IntelliJ IDEA
Starter Project Setup
Kafka Streams Application Properties
Java 8 Lambda Functions - quick overview
Word Count Application Topology
Printing the Kafka Streams Topology
Kafka Streams Graceful Shutdown
Running Application from IntelliJ IDEA
Debugging Application from IntelliJ IDEA
Internal Topics for our Kafka Streams Application
Packaging the application as Fat Jar & Running the Fat Jar
Scaling our Application
Section Wrap-Up
16 Topics
Section Objectives
KStream & KTables
Stateless vs Stateful Operations
MapValues / Map
Filter / FilterNot
FlatMapValues / FlatMap
Branch
SelectKey
Reading from Kafka
Writing to Kafka
Streams Marked for Re-Partition
Refresher on Log Compaction
KStream and KTables Duality
Transforming a KTable to a KStream
Transforming a KStream to a KTable
Section Summary
5 Topics
FavouriteColour - Practice Exercise Description & Guidance
Stuck? Here are some Hints!
Java Solution
Running the application
Scala Solution
9 Topics
Section Objective
KTable groupBy
KGroupedStream / KGroupedTable Count
KGroupedStream / KGroupedTable Aggregate
KGroupedStream / KGroupedTable Reduce
KStream peek
KStream Transform / TransformValues
What if I want to write to an external System?
Summary Diagram
4 Topics
What's Exactly Once?
Exactly Once in Kafka 0.11
What's the problem with at least once anyway?
How to do exactly once in Kafka Streams
7 Topics
BankBalance - Exercise Overview
Kafka Producer Guidance
Kafka Producer Solution
Kafka Streams Guidance & Hints
Kafka Streams Solution
Running the BankBalance Application
Section Summary
6 Topics
What are joins in Kafka Streams?
Join Constraints and GlobalKTables
The different types of joins: Inner Join Left Join Outer Join
Creating a join with UserEnrich Kafka Streams App
All the joins explained - Blog Post
Running the Kafka Streams Join application
5 Topics
Disclaimer: Advanced Lectures
Testing in Kafka Streams
Setup your Kafka Streams project
Hands-On: Test your WordCount application
Self-Guided Practice Exercises
3 Topics
Congratulations and next steps
THANK YOU!
Bonus Lecture
Apache Kafka Series - Kafka Streams for Data Processing
Related Apache Kafka Courses
Thank You!
Your review has been submitted successfully.