Articles
All vignettes
- Get started with pipeflow
Start here if this is your first time using pipeflow.
- Modifying existing pipelines
Shows how to insert, replace, and remove steps in a pipeline.
- Combining pipelines
Shows how to combine different pipelines to a single pipeline.
- Collecting and filtering output
Shows how to tag, filter, and collect pipeline output.
- Split, map, and reduce
Shows how to split data, apply the pipeline to each subset, and then reduce the results back into a combined output.
- Recursive self-modification
Shows how you can setup pipelines to modify themselves at runtime, which, for example, allows for changing pipeline parameters based on intermediate results or even dynamically modify the pipeline’s own structure during a pipeline run.
- pipeflow vs targets
A detailed comparison and benchmark between pipeflow and targets.