Build fast interactive data analysis pipelines that scale.
{pipeflow} simply lets you add R functions one by one, wiring them into a pipeline that stays consistent as you go. Modify, remove, or insert steps at any stage, and manage all parameters in one place.
Thanks to its intuitive interface, {pipeflow} pays off quickly and, in the long run, helps you keep a clear and structured overview of your project.
Why use {pipeflow}
- Lightweight and intuitive API
- All parameters managed in one place
- Pipeline verified at definition time
- Filter pipeline steps via views (supports data.table-style
[filters)
- Branch and merge pipeline steps
- Fast dependency resolution (C++-powered DAG)
- Embed reusable workflows (nested pipelines)
Installation
# Install release version from CRAN
install.packages("pipeflow")
# Install development version from GitHub
devtools::install_github("rpahl/pipeflow")Usage
library(pipeflow)
p <- pip_new("demo") |>
pip_add("numbers", \(n = 5) seq_len(n)) |>
pip_add("squared", \(x = ~numbers) x^2) |>
pip_add("total", \(x = ~squared) sum(x))
p
# <pipeflow> demo (3 steps)
# -------------------------
# step params depends state
# 1: numbers n new
# 2: squared x numbers new
# 3: total x squared new
# -------------------------
# <ready> last run: never
pip_run(p)
# info [2026-10-12 13:47:16.268 UTC]: Starting run of pipeflow 'demo'
# info [2026-10-12 13:47:16.269 UTC]: Step 1/3 numbers
# info [2026-10-12 13:47:16.276 UTC]: Step 2/3 squared
# info [2026-10-12 13:47:16.285 UTC]: Step 3/3 total
# info [2026-10-12 13:47:16.287 UTC]: Finished run of pipeflow 'demo'
pip_collect(p)
# $numbers
# [1] 1 2 3 4 5
#
# $squared
# [1] 1 4 9 16 25
#
# $total
# [1] 55