Components

ArkFlow ships 41 registered components across six kinds. Every page in this section is machine-checked against the live component registry: the type names, configuration schemas, and examples you see here cannot silently drift from the binary.

Inputs

Consume from Kafka, HTTP, MQTT, NATS, Pulsar, Redis, SQL, files, WebSockets, Modbus, and more.

Buffers

Tumbling, sliding, and session windows — event-time aware and columnar.

Processors

Transform with SQL, Python UDFs, VRL, Protobuf conversion, and batching.

Outputs

Deliver to SQL databases, Kafka (with exactly-once), HTTP, Redis, InfluxDB, MongoDB, and more.

Codecs

Decode wire formats: JSON, Protobuf, Debezium CDC events, and Schema Registry payloads.

Temporary

Lookup tables for enrichment inside pipelines, backed by Redis.

Discovering components from the CLI

The registry is also queryable from the binary — see the CLI reference:

arkflow components list             # everything, grouped by kind
arkflow components list --kind codec --format json
arkflow components show input kafka # one component's schema + example

The generated component inventory is the same export, rendered as a table.