SQL reference
ArkFlow's SQL processor is powered by Apache DataFusion. Use it to filter, project, aggregate, and reshape columnar batches inside a pipeline — with window functions for event-time analytics and user-defined functions when the built-ins are not enough.
| Section | Contents |
|---|---|
| Data types | Supported SQL types and their Arrow equivalents. |
| Operators and literals | Arithmetic, comparison, and logical operators. |
| SELECT | Query syntax, WHERE, GROUP BY, HAVING, ORDER BY, LIMIT. |
| Subqueries | Scalar, IN, and EXISTS subqueries. |
| Aggregate functions | count, sum, avg, and friends. |
| Window functions | OVER clauses, ranking, and analytic functions. |
| Scalar functions | The full built-in function catalog. |
| Special functions | Encoding, time, and utility functions. |
| UDFs | Registering and calling user-defined functions. |
A FROM batch clause refers to the current Arrow batch flowing through the
pipeline — see the SQL processor for
configuration and semantics, and the
recipes for end-to-end usage.