Fluentd flow: from a log line to the index, with a fallback

Scroll or pinch to zoom, drag to move, double-click to zoom in 100% SVG PNG Back to the post

Fluentd flow in five steps: an application pod writes a log line, in_tail reads it and saves its file position, the filter chain parses and enriches the record, the buffer appends it to a chunk on disk, the output flushes the chunk to OpenSearch and retries on failure, and after retries fail the chunk goes to a secondary output such as object storage.