Conveners
Shifter and Docker SLURM Integration
- Ricardo Silva (EPFL)
Description
The goal of this project is to deploy computing environments on Docker images in SLURM schedulers. When running HPC clusters, user codes often rely on several libraries and dependencies. However, each HPC cluster/system has its own environment, which makes performance portability as well as result reproducibility and repeatability almost impossible.
For SLURM, this integration is done using Shifter; a prototype implementation that NERSC is developing and experimenting with as a scalable way of deploying containers in an HPC environment.