IIRF Online > Development > Database Design & Development > Apache Kafka > Apache Kafka Series - Kafka Connect Hands-on Learning
Apache Kafka Series - Kafka Connect Hands-on Learning by Udemy
Kafka Connect - Learn How to Source Twitter Data, Store in Apache Kafka Topics & Sink in ElasticSearch and PostgreSQL
Course Highlights
- Configure and run Apache Kafka Source and Sink Connectors
- Learn concepts behind Kafka Connect & the Kafka Connect architecture
- Launch a Kafka Connect Cluster using Docker Compose
- Deploy Kafka Connectors in Standalone and Distributed Mode
- Write your own Kafka Connector
Skills you will learn!
Curriculum
4 Topics
Important Pre-Requisites
Course Objectives
Course Structure
About Your Instructor
1 Topic
Code Download
5 Topics
What is Kafka Connect?
Kafka Connect Architecture Design
Connectors Configuration Tasks Workers
Standalone vs Distributed Mode
Distributed Architecture in Details
8 Topics
Important information about installation
Docker on Mac (recent versions)
Docker Toolbox on Mac (older versions)
Docker on Linux (Ubuntu as an example)
Docker on Windows 10 64bit
Docker Toolbox on Windows (older versions)
Important note for Docker Toolbox users
Starting Kafka Connect Cluster using Docker Compose
3 Topics
It's not working! What to do?
Where to view logs?
Asking a question in the Q&A
8 Topics
Kafka Connect Source Architecture Design
FileStream Source Connector - Standalone Mode - Part 1
FileStream Source Connector - Standalone Mode - Part 2
FileStream Source Connector - Distributed Mode
List of Available Connectors
Twitter Source Connector - Distributed Mode - Part 1
Twitter Source Connector - Distributed Mode - Part 2
Section Summary
5 Topics
Kafka Connect Sink Architecture Design
ElasticSearch Sink Connector - Distributed Mode - Part 1
ElasticSearch Sink Connector - Distributed Mode - Part 2
Kafka Connect REST API
JDBC Sink Connector - Distributed Mode
15 Topics
Goal of the section: GitHubSourceConnector
Finding the code and installing required software
Description of the GitHub Issues API
Using the Maven Archetype to get started
Config Definitions
Connector Class
Writing a schema
Data Model for our Objects
Writing our GitHub API HTTP Client
Source Partition & Source Offsets
Source Task
Building and running a Connector in Standalone Mode
Command for next lecture
Deploying our Connector on the Landoop cluster
More Resources for Developers
6 Topics
Setting up Kafka Connect in Production (1/2)
Setting up Kafka Connect in Production (2/2)
What's next?
Congratulations and Thank you!
THANK YOU!
Bonus Lecture
Apache Kafka Series - Kafka Connect Hands-on Learning
Related Apache Kafka Courses
Thank You!
Your review has been submitted successfully.