Fluentd architecture: collect, enrich, buffer, route

Scroll or pinch to zoom, drag to move, double-click to zoom in 100% SVG PNG Back to the post

Fluentd architecture: application pods write logs to stdout; a Fluentd DaemonSet pod on each node reads the log files with in_tail and tags the records; filters parse them and add pod metadata; a file buffer holds them in chunks with retry and backoff; and output plugins flush the chunks to OpenSearch and copy them to Kafka.