Containerization on Petascale HPC Clusters
Access full-text files
Date
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
Containerization technologies provide a mechanism to encapsulate applications and many of their dependencies, facilitating software portability and reproducibility on HPC systems. However, in order to access many of the architectural features that enable HPC system performance, compatibility between certain components of the container and host are required, resulting in a trade-off between portability and performance. In this work, we discuss our early experiences running three state-of-the-art containerization technologies on the petascale Frontera system. We present how we build the containers to ensure performance and security and their performance at scale.We ran microbenchmarks at a scale of 4,096 nodes and demonstrate the near-native performance and minimal memory overheads by the containerized environments at 70,000 processes on 1,296 nodes with a scientific application MILC - a quantum chromodynamics code.
Department
Description
Keywords
LCSH Subject Headings
Citation
@InProceedings{ruhela-TexasScholarWorks, author = {Ruhela, Amit and Vaughn, Matt and Harrell, Stephen Lien and Zynda, Gregory J. and Fonner, John and Evans, Richard Tode and Minyard, Tommy}, title = {{Containerization on Petascale HPC Clusters}}, year = 2020, month = {November}, doi = {10.26153/tsw/12168}, publisher= {Texas ScholarWorks}, }