IIRF Online > Development > Database Design & Development > Apache Kafka > Apache Kafka Series - Learn Apache Kafka for Beginners v3
Apache Kafka Series - Learn Apache Kafka for Beginners v3 by Udemy
START HERE: Learn Apache Kafka 3.0 Ecosystem, Core Concepts, Real World Java Producers/Consumers & Big Data Architecture
Course Highlights
- Understand Apache Kafka Ecosystem, Architecture, Core Concepts and Operations
- Master Concepts such as Topics, Partitions, Brokers, Producers, Consumers
- Start a personal Kafka development environment
- Learn major CLIs: kafka-topics, kafka-console-producer, kafka-console-consumer, kafka-consumer-groups, kafka-configs
- Create your Producers and Consumers in Java to interact with Kafka
- Program a Real World Twitter Producer & ElasticSearch Consumer
- Extended APIs Overview (Kafka Connect, Kafka Streams), Case Studies and Big Data Architecture
- Practice and Understand Log Compaction
Skills you will learn!
Curriculum
4 Topics
Course Introduction
Apache Kafka in 5 minutes
Course Objectives
Welcome! - About your instructor
1 Topic
Code Download
1 Topic
Kafka Fundamentals
11 Topics
Topics Partitions and Offsets
Producers and Message Keys
Consumers & Deserialization
Consumer Groups & Consumer Offsets
Brokers and Topics
Topic Replication
Producer Acknowledgements & Topic Durability
Zookeeper
Kafka KRaft - Removing Zookeeper
Theory Roundup
Quiz on Theory
13 Topics
Important: Starting Kafka & Lectures Order
FAQ for Setup Problems
Starting Kafka with Conduktor - Multi Platform
Mac OS X - Download and Setup Kafka in PATH
Mac OS X - Start Zookeeper and Kafka
Mac OS X - Using brew
Linux - Download and Setup Kafka in PATH
Linux - Start Zookeeper and Kafka
Windows WSL2 - Download Kafka and PATH Setup
Windows WSL2 - Start Zookeeper & Kafka
Windows WSL2 - How to Fix Problems
Windows WSL2 - Extra Instructions
Windows non-WSL2 - Start Zookeeper and Kafka
4 Topics
Note: try out Kafka KRaft
Mac OS X - Start Kafka in KRaft mode
Linux - Start Kafka in KRaft mode
Windows WSL2 - Start Kafka in KRaft mode
9 Topics
CLI Introduction
WINDOWS WARNING: PLEASE READ
Kafka Topics CLI
Kafka Console Producer CLI
Kafka Console Consumer CLI
Kafka Consumers in Group
Kafka Consumer Groups CLI
Resetting Offsets
Quiz on CLI
1 Topic
Conduktor - Demo
13 Topics
Kafka SDK List
Creating Kafka Project
Java Producer
Java Producer Callbacks
Java Producer with Keys
Java Consumer
Java Consumer - Graceful Shutdown
Java Consumer inside Consumer Group
Java Consumer Incremental Cooperative Rebalance & Static Group Membership
Java Consumer Incremental Cooperative Rebalance - Practice
Java Consumer Auto Offset Commit Behavior
Programming - Advanced Tutorials
Quiz on Java Programming 101
2 Topics
Real World Project Overview
Real World Exercise - Solution
16 Topics
IMPORTANT: Start Local Kafka with Conduktor using Docker
Wikimedia Producer Project Setup
Wikimedia Producer Implementation
Wikimedia Producer Run
Wikimedia Producer - Producer Config Intros
Producer Acknowledgements Deep Dive
Producer Retries
Idempotent Producer
Safe Kafka Producer Settings
Wikimedia Producer Safe Producer Implementation
Kafka Message Compression
linger.ms and batch.size Producer settings
Wikimedia Producer High Throughput Implementation
Producer Default Partitioner & Sticky Partitioner
[Advanced] max.block.ms and buffer.memory
Quiz on Producer Configurations
17 Topics
OpenSearch Consumer - Project Overview
OpenSearch Consumer - Project Setup
Setting up OpenSearch on Docker
Setting up OpenSearch on the Cloud
OpenSearch 101
OpenSearch Consumer Implementation - Part 1
OpenSearch Consumer Implementation Part 2
Consumer Delivery Semantics
OpenSearch Consumer Implementation Part 3 - Idempotence
Consumer Offsets Commit Strategies
OpenSearch Consumer Implementation Part 4 - Delivery Semantics
OpenSearch Consumer Implementation Part 5 - Batching Data
Consumer Offset Reset Behavior
OpenSearch Consumer Implementation Part 6 - Replaying Data
Consumer Internal Threads
Consumer Replica Fetching - Rack Awareness
Quiz on Consumer Configurations
10 Topics
Kafka Extended APIs - Overview
Kafka Connect Introduction
Kafka Connect Hands On: Warning
Kafka Connect Wikimedia & ElasticSearch Hands On
Kafka Streams Introduction
Kafka Streams Hands-On
Kafka Schema Registry Introduction
Kafka Schema Registry Hands On
Which Kafka API should I use?
Quiz on Kafka Extended APIs
8 Topics
Choosing Partition Count & Replication Factor
Kafka Topics Naming Convention
Case Study - MovieFlix
Case Study - GetTaxi
Case Study - MySocialMedia
Case Study - MyBank
Case Study - Big Data Ingestion
Case Study - Logging and Metrics Aggregation
5 Topics
Kafka Cluster Setup High Level Architecture Overview
Kafka Monitoring & Operations
Kafka Security
Kafka Multi Cluster & MirrorMaker
Advertised Listeners: Kafka Client & Server Communication Protocol
1 Topic
Advanced Kafka
8 Topics
Changing a Topic Configuration
Segment and Indexes
Log Cleanup Policies
Log Cleanup Delete
Log Compaction Theory
Log Compaction Practice
Unclean Leader Election
Large Messages in Kafka
3 Topics
What's Next?
THANK YOU!
Bonus Lecture
Apache Kafka Series - Learn Apache Kafka for Beginners v3
Related Apache Kafka Courses
Thank You!
Your review has been submitted successfully.