Articles • pipeflow

Get started with pipeflow: Start here if this is your first time using pipeflow.
Modify existing pipelines: How to insert, replace, and remove steps in a pipeline.
Combine pipelines: How to combine different pipelines to a single pipeline.
Pipeline views: How to filter pipelines with pip_view() and the [ operator, compose views, and run only a subset of steps.
Collect and group output: How to collect and group pipeline output.
Split, map, and reduce: Shows how to split data, apply the pipeline to each subset, and then reduce the results back into a combined output.
Nested pipelines: Shows how to embed pipelines within pipeline steps and how to mark their parameters so that changing them re-executes the outer step.
Self-modifying pipelines: Shows how you can setup pipelines to modify themselves at runtime, which, for example, allows for changing pipeline parameters based on intermediate results or even dynamically modify the pipeline’s own structure during a pipeline run.
pipeflow vs targets: Comparing general properties and performance of {pipeflow} vs {targets} in a scoped latency comparison.