Apache Kafka: from a produced record to a committed offset

Scroll or pinch to zoom, drag to move, double-click to zoom in 100% SVG PNG Back to the post

Apache Kafka flow in six steps: a producer sends a record to the partition leader; the leader appends it to the partition log; followers fetch and copy it; when the in-sync replicas have it the high watermark advances and the producer is acknowledged; the consumer group fetches committed data; and the consumer commits its offset to the offsets topic.