Vector: a source, two transforms and sinks with buffers

Scroll or pinch to zoom, drag to move, double-click to zoom in 100% SVG PNG Back to the post

Vector architecture: producers publish raw telemetry to a Kafka topic; inside a Vector aggregator a kafka source reads it, a remap transform normalises events with VRL, a filter transform drops invalid events and an InfluxDB line protocol sink with a disk buffer and acknowledgements writes batches to a time-series database; events that fail remap go to a Kafka sink that writes to a dead-letter topic.