Nextflow Summit 2022 - Matt Vaughn

Options for leveling up your Nextflow workflows on AWS Batch.
Matt Vaughn, Principal Developer Advocate for HPC and Scientific Computing at Amazon Web Services.
From the #NextflowSummit 2022 - summit.nextflo...
---
NextFlow workflows can run on many systems. One of these, AWS Batch, helps scientists easily run large numbers of jobs in the cloud without needing to manage virtual machines or storage resources. However, Batch by default only leverages a subset of AWS resource types. In this talk, we will describe ways to take advantage of new kinds of processors and GPUs, larger memory, and faster storage in NextFlow pipelines on Batch. We will discuss how these options can help reduce costs and improve job turnaround time using real-world benchmarks and examples.