Efficient & Scalable Builds with AWS Parallel Cluster + Spack

Combining:

1. Spack
2. AWS Parallel Cluster
3. Slurm
4. Lustre / AWS FSx for Linux

Benefits:

• Accurate, reproducible builds of a wide range of community and custom C++ and Python packages applications
• Builds against multiple compilers / compiler versions / CPU ABIs
• Full rebuild from sources right through to the base packages (CPython, numpy, etc)
• 1000s of packages built < 1h, 1000s of cores deployed on single compilation job
• Scale down to low cost / fast scale up