Kafka Tutorial for beginners

 These are the most relevant contents I collected through books and courses. I organized and made some edits to help deliver the concepts about Apache Kafka in the most comprehensible way. Anyone who wants to learn Apache Kafka can reference these notes without going through too many resources on the Internet. Below might be the only material you need to grasp a pretty basic understanding of Kafka and how to configure your applications to use Kafka properly in production.

If you want to get a deeper understanding of Kafka or how to use Kafka Stream for big data processing. I highly recommend you check out the material, including some books and courses that I linked in the reference section.

Table of contents:-

Kafka introduction

The data problem

Why use Kafka?

Why is Kafka fast?

Compared to other message queue systems

Use Cases

Kafka architecture

Log

Topics

Partitions

What is the difference between Partition and Log?

Partitions group data by key

Important characteristics of Kafka

Producers and Consumers

Producer

Consumer

ü  Consumer group

ü  Flow of sending a message

Broker and Clusters

Broker

Cluster membership management with Zookeeper

Cluster controller

Replica

ü  Leader replica

ü  Follower replica