Data-driven computational pipelines
Nextflow is a fluent DSL modelled around the UNIX pipe concept, that simplifies writing parallel and scalable pipelines in a portable manner.
You can use your favourite programming language
and tools, exploiting your current skills.
Just download and play with it. No installation is required.
Are you a Python geek or a Perl hacker?
You can start fast with it.
Lightweight processes with message passing, no shared memory
Develop on your laptop, run in the grid or scale-out in the cloud with no changes.
Nextflow is built around the idea that Linux is the lingua franca of data science.
Nextflow allows you to write a computational pipeline by making it simpler to put together many different tasks.
You may reuse your existing scripts and tools and you don't need to learn a new language or API to start using it.
Nextflow provides an abstraction layer between your pipeline's logic and the execution layer, so that it can be executed on multiple platforms without it changing.
Nextflow is based on the dataflow programming model which greatly simplifies writing complex distributed pipelines.
Parallelisation is implicitly defined by the processes input and output declarations. The resulting applications are inherently parallel and can scale-up or scale-out, transparently, without having to adapt to a specific platform architecture.
All the intermediate results produced during the pipeline execution are automatically tracked.
This allows you to resume its execution, from the last successfully executed step, no matter what the reason was for it stopping.
Nextflow extends the Unix pipes model with a fluent DSL, allowing you to handle complex stream interactions easily.
It promotes a programming approach, based on functional composition, that results in resilient and easily reproducible pipelines.
It can be used on any POSIX compatible system (Linux, Solaris, OS X, etc).
Simply follow these three steps.
Java 7 or greater is required
Dead easy to install
curl -fsSL get.nextflow.io | bash
nextflowin the current dir)
Try a simple demo
./nextflow run hello