Containerization on Petascale HPC Clusters

Ruhela, Amit
Vaughn, Matt
Harrell, Stephen Lien
Zynda, Gregory J
Fonner, John
Evans, Richard Todd
Minyard, Tommy
Journal Title
Journal ISSN
Volume Title
State of Practice talk in International Conference for High Performance Computing, Networking, Storage and Analysis (SC’20)

Containerization technologies provide a mechanism to encapsulate applications and many of their dependencies, facilitating software portability and reproducibility on HPC systems. However, in order to access many of the architectural features that enable HPC system performance, compatibility between certain components of the container and host are required, resulting in a trade-off between portability and performance. In this work, we discuss our early experiences running three state-of-the-art containerization technologies on the petascale Frontera system. We present how we build the containers to ensure performance and security and their performance at scale.We ran microbenchmarks at a scale of 4,096 nodes and demonstrate the near-native performance and minimal memory overheads by the containerized environments at 70,000 processes on 1,296 nodes with a scientific application MILC - a quantum chromodynamics code.

Amit Ruhela, Matt Vaughn, Stephen Lien Harrell, Gregory J. Zynda, John Fonner, Richard Todd Evans, Tommy Minyard. Containerization on Petascale HPC Clusters. In Texas ScholarWorks. November 2020. doi=10.26153/tsw/12168

@InProceedings{ruhela-TexasScholarWorks, author = {Ruhela, Amit and Vaughn, Matt and Harrell, Stephen Lien and Zynda, Gregory J. and Fonner, John and Evans, Richard Tode and Minyard, Tommy}, title = {{Containerization on Petascale HPC Clusters}}, year = 2020, month = {November}, doi = {10.26153/tsw/12168}, publisher= {Texas ScholarWorks}, }