Skip to main content
Version: 0.15

Pipeline

A pipeline is a dataflow definition in SpringQL.

Source reader
Pump
Pump
Sink writer
Foreign source
(not a part of SpringQL)
Source stream
Stream
Sink stream
Foreign sink
(not a part of SpringQL)

A pipeline is represented as a DAG (Directed Acyclic Graph), whose nodes are either of foreign source, foreign sink, or stream, and edges are either of source reader, sink writer, or pump.

In this section, you will learn what conceptually they are and detailed variations of them.