Course Highlights
  • Apache Kafka Ecosystem, Components and Big Picture
  • Kafka Architecture and Core Concepts
  • Multi-node Confluent Community Kafka
  • Kafka Storage Architecture in depth
  • Kafka Cluster Architecture in depth
  • Kafka Producer API Programming in Java
  • Kafka Consumer API Programming in Java
  • Idempotence and Transactions in Kafka
  • JSON and AVRO Serialization
  • Exactly Once Processing in Kafka
Curriculum

7 Topics
What is Apache Kafka
Apache Kafka Core Concepts
Kafka Connect Core Concepts
Kafka Streams Core Concepts
Kafka SQL Core Concepts
When to use What?
Source Code and Other Resources

6 Topics
Kafka Quick Start
Installing Single Node Kafka Cluster
Using Command-Line Producer and Consumer
Installing a Multi-Node Kafka Cluster
Using Consumer Groups
Configuring your development IDE

7 Topics
Understanding Kafka Storage Architecture
Kafka Topics and Partitions
Kafka Topic Replication
Partition Leaders and Followers
Kafka Log Segments
Kafka Message Offsets
Kafka Message Index

8 Topics
Understanding Kafka Cluster
Zookeeper in Kafka
Kafka Cluster Controller
Partition Allocation and Fault Tolerance
Partition Leader Vs Partition Follower
The ISR List - In Sync Replica
Committed Vs Un-Committed Records
Minimum ISR List

9 Topics
Introducing Kafka Producers
Creating your first Kafka Producer
Producer Record
Producer Serializer
Producer Partitioner
Message Timestamp
Producer Message Buffer
Producer IO Thread and Retires
Summarizing Producer Internals

6 Topics
Horizontal Vs. Vertical Scalability
Producer Multi-Threading Scenario
Creating Multi-Threaded Kafka Producer
At Least Once Vs. At Most Once
Exactly Once - Producer Idempotence
Transactions in Kafka Producer

3 Topics
Working with Types and Serialization
Using JSON Schema
Using AVRO Schema

2 Topics
POS Simulator using JSON Serialized Invoices
POS Simulator using AVRO Serialized Invoices

4 Topics
Introducing Kafka Consumers
Creating Kafka Consume - Transform - Produce Pipeline
Consumer Group and Scalability
Consumer Positions - Current Offset Vs. Committed Offset

3 Topics
Challenges with Kafka Consumers?
Where to go Next?
Bonus Lecture : Get Extra

  Write a Review

Apache Kafka for absolute beginners

Go to Paid Course