{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T22:53:55Z","timestamp":1777676035643,"version":"3.51.4"},"reference-count":49,"publisher":"SAGE Publications","issue":"3-4","license":[{"start":{"date-parts":[[2023,4,11]],"date-time":"2023-04-11T00:00:00Z","timestamp":1681171200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of High Performance Computing Applications"],"published-print":{"date-parts":[[2023,7]]},"abstract":"<jats:p>Supercomputers have been driving innovations for performance and scaling benefiting several scientific applications for the past few decades. Yet their ecosystems remain virtually unchanged when it comes to integrating distributed data-driven workflows, primarily due to rather rigid access methods and restricted configuration management options. X-as-a-Service model of cloud has introduced, among other features, a developer-centric DevOps approach empowering developers of infrastructure, platform to software artefacts, which, unfortunately contemporary supercomputers still lack. We introduce vClusters (versatile software-defined clusters), which is based on Infrastructure-as-code (IaC) technology. vClusters approach is a unique fusion of HPC and cloud technologies resulting in a software-defined, multi-tenant cluster on a supercomputing ecosystem, that, together with software-defined storage, enable DevOps for complex, data-driven workflows like grid middleware, alongside a classic HPC platform. IaC has been a commonplace in cloud computing, however, it lacked adoption within multi-Petascale ecosystems due to concerns related to performance and interoperability with classic HPC data centres\u2019 ecosystems. We present an overview of the Swiss National Supercomputing Centre\u2019s flagship Alps ecosystem as an implementation target for vClusters for HPC and data-driven workflows. Alps is based on the Cray-HPE Shasta EX supercomputing platform that includes an IaC compliant, microservices architecture (MSA) management system, which we leverage for demonstrating vClusters usage for our diverse operational workflows. We provide implementation details of two operational vClusters platforms: a classic HPC platform that is used predominantly by hundreds of users running thousands of large-scale numerical simulations batch jobs; and a widely used, data-intensive, Grid computing middleware platform used for CERN Worldwide LHC Computing Grid (WLCG) operations. The resulting solution showcases reuse and reduction of common configuration recipes across vCluster implementations, minimising operational change management overheads while introducing flexibility for managing artefacts for DevOps required by diverse workflows.<\/jats:p>","DOI":"10.1177\/10943420231167811","type":"journal-article","created":{"date-parts":[[2023,4,11]],"date-time":"2023-04-11T10:43:55Z","timestamp":1681209835000},"page":"288-305","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":16,"title":["Versatile software-defined HPC and cloud clusters on Alps supercomputer for diverse workflows"],"prefix":"10.1177","volume":"37","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2534-5078","authenticated-orcid":false,"given":"Sadaf R","family":"Alam","sequence":"first","affiliation":[{"name":"University of Bristol, Bristol, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Miguel","family":"Gila","sequence":"additional","affiliation":[{"name":"Swiss National Supercomputing Centre, Lugano, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mark","family":"Klein","sequence":"additional","affiliation":[{"name":"Swiss National Supercomputing Centre, Lugano, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1849-1621","authenticated-orcid":false,"given":"Maxime","family":"Martinasso","sequence":"additional","affiliation":[{"name":"Swiss National Supercomputing Centre, Lugano, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas C","family":"Schulthess","sequence":"additional","affiliation":[{"name":"Swiss National Supercomputing Centre, Lugano, Switzerland"},{"name":"ETH Zurich, Swiss National Supercomputing Centre, Lugano, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2023,4,11]]},"reference":[{"key":"bibr1-10943420231167811","unstructured":"ARC middleware. Available at: https:\/\/github.com\/nordugrid\/arc (accessed 13 March 2023)."},{"key":"bibr2-10943420231167811","unstructured":"CSCS Alps. CSCS introduction to Alps. Available at: https:\/\/www.cscs.ch\/computers\/alps (accessed 13 March 2023)."},{"key":"bibr3-10943420231167811","unstructured":"Artifactory. Artifactory - universal artifact repository manager. Available at: https:\/\/jfrog.com (accessed 13 March 2023)."},{"key":"bibr4-10943420231167811","unstructured":"AWS ParallelCluster. AWS ParallelCluster. Available at: https:\/\/aws.amazon.com\/hpc\/parallelcluster\/(accessed 13 March 2023)."},{"key":"bibr5-10943420231167811","unstructured":"Azure CycleCloud. Azure CycleCloud. Available at: https:\/\/learn.microsoft.com\/en-us\/azure\/cyclecloud (accessed 13 March 2023)."},{"key":"bibr6-10943420231167811","unstructured":"Cluster-in-the-Cloud. Create a cluster in the cloud. Available at: https:\/\/cluster-in-the-cloud.readthedocs.io (accessed 13 March 2023)."},{"key":"bibr7-10943420231167811","unstructured":"Ceph. Ceph documentation. Available at: https:\/\/docs.ceph.com\/en\/quincy\/(accessed 13 March 2023)."},{"key":"bibr9-10943420231167811","unstructured":"CERN Tape Archive. CERN Tape Archive. Available at: https:\/\/cta.web.cern.ch\/cta\/(accessed 13 March 2023)."},{"key":"bibr10-10943420231167811","unstructured":"Cray-HPE Shasta EX. Cray exascale supercomputer. Available at: https:\/\/www.hpe.com\/us\/en\/compute\/hpc\/supercomputing\/cray-exascale-supercomputer.html (accessed 13 March 2023)."},{"key":"bibr11-10943420231167811","unstructured":"Cray System Management Cray HPE Shasta Software Stack. Available at: https:\/\/cug.org\/proceedings\/cug2019proceedings\/includes\/files\/inv113s1-file1.pdf (accessed 13 March 2023)."},{"key":"bibr12-10943420231167811","unstructured":"Dcache. dCache virtual file system. Available at: https:\/\/github.com\/dCache\/dcache (accessed 13 March 2023)."},{"key":"bibr13-10943420231167811","unstructured":"Docker. Accelerated, containerized application development. Available at: https:\/\/www.docker.com (accessed 13 March 2023)."},{"key":"bibr15-10943420231167811","unstructured":"Frontier Supercomputer. Frontier - OLCF - Oak Ridge National Laboratory. Available at: https:\/\/www.olcf.ornl.gov\/frontier (accessed 13 March 2023)."},{"key":"bibr16-10943420231167811","unstructured":"GitHub. Available at: https:\/\/github.com (accessed 13 March 2023)."},{"key":"bibr17-10943420231167811","unstructured":"GCP Slurm Cluster. Deploying a slurm cluster on compute engine. Available at: https:\/\/cloud.google.com\/architecture\/deploying-slurm-cluster-compute-engine (accessed 13 March 2023)."},{"key":"bibr18-10943420231167811","unstructured":"CSCS Eiger Cluster CSCS running on alps. Available at: https:\/\/user.cscs.ch\/access\/running\/alps (accessed 13 March 2023)."},{"key":"bibr21-10943420231167811","unstructured":"LUMI Supercomputer. About LUMI - LUMI supercomputer. Available at: https:\/\/www.lumi-supercomputer.eu\/about-lumi (accessed 13 March 2023)."},{"key":"bibr22-10943420231167811","unstructured":"Open Container Initiative. Open Container Initiative. Available at: https:\/\/opencontainers.org (accessed 13 March 2023)."},{"key":"bibr23-10943420231167811","unstructured":"OSU MPI benchmarks. OSU MPI micro-benchmarks. Available at: https:\/\/mvapich.cse.ohio-state.edu\/benchmarks\/ (accessed 13 March 2023)."},{"key":"bibr24-10943420231167811","unstructured":"IOR Benchmarks. IOR benchmark. Available at: https:\/\/wiki.lustre.org\/IOR (accessed 13 March 2023)."},{"key":"bibr25-10943420231167811","unstructured":"HPE IaC Infrastructure-as-Code approach. Available at: https:\/\/www.hpe.com\/sa\/en\/what-is\/infrastructure-as-code.html (accessed 13 March 2023)."},{"key":"bibr26-10943420231167811","unstructured":"IaC Cattle Pet Analogy Cattle or Pet \u2013 what IaC means and why you shouldn\u2019t use admin-UI\u2019s. Available at: https:\/\/www.thesoftwareblog.com\/2019\/cattle-versus-pet-what-iac-means\/ (accessed 13 March 2023)."},{"key":"bibr27-10943420231167811","unstructured":"Sarus The container engine for combining container portability with native HPC performance. Available at: https:\/\/products.cscs.ch\/sarus\/ (accessed 13 March 2023)."},{"key":"bibr28-10943420231167811","unstructured":"Singularity Singularity container platform. Available at: https:\/\/sylabs.io\/singularity (accessed 13 March 2023)."},{"key":"bibr29-10943420231167811","unstructured":"ORNl Slate. ORNL slate service. Available at: https:\/\/docs.olcf.ornl.gov\/services and applications\/slate\/index.html (accessed 13 March 2023)."},{"key":"bibr30-10943420231167811","unstructured":"TerraForm. Open source IaC: Terraform by HashiCorp. Available at: https:\/\/www.terraform.io (accessed 13 March 2023)."},{"key":"bibr31-10943420231167811","unstructured":"Top500. Top 500 list of fastest supercomputers. Available at: https:\/\/www.top500.org (accessed 13 March 2023)."},{"key":"bibr32-10943420231167811","unstructured":"WLCG. Worldwide LHC computing grid. Available at: https:\/\/wlcg.web.cern.ch\/(accessed 13 March 2023)."},{"key":"bibr33-10943420231167811","doi-asserted-by":"publisher","DOI":"10.1109\/ICPPW.2014.15"},{"key":"bibr34-10943420231167811","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-63393-6_20"},{"key":"bibr35-10943420231167811","unstructured":"Allen BS, Ezell M, Peltz P, et al. (2020) Modernizing the HPC system software stack. Available at: https:\/\/arxiv.org\/pdf\/2007.10290.pdf (accessed 13 March 2023)."},{"key":"bibr36-10943420231167811","unstructured":"Beyer B, Murphy NR, Fong-Jones L, et al. (2018) How SRE relates to DevOps. Available at: https:\/\/www.safaribooksonline.com\/library\/view\/how-sre-relates\/9781492030645\/(accessed 13 March 2023)."},{"key":"bibr37-10943420231167811","doi-asserted-by":"publisher","DOI":"10.1007\/s41781-020-00052-w"},{"key":"bibr38-10943420231167811","doi-asserted-by":"publisher","DOI":"10.1088\/1742-6596\/898\/8\/082030"},{"key":"bibr39-10943420231167811","doi-asserted-by":"crossref","unstructured":"De K, et al. (2021) BigPanDA workflow management on titan for energy and nuclear physics and for future extreme scale scientific applications. Available at: https:\/\/www.osti.gov\/servlets\/purl\/1765084.","DOI":"10.2172\/1765084"},{"key":"bibr40-10943420231167811","unstructured":"Fartoukh S, Kostoglou S, Solfaroli M, et al. (2021) LHC configuration and operational scenario for run 3. Available at: http:\/\/cds.cern.ch\/record\/2790409\/files\/CERN-ACC-2021-0007.pdf."},{"key":"bibr41-10943420231167811","author":"Gila M","year":"2023","journal-title":"To appear in the Cray User Group Proceedings"},{"key":"bibr42-10943420231167811","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4842-1659-0"},{"key":"bibr43-10943420231167811","volume-title":"Kubernetes: up and running dive into the future of infrastructure","author":"Hightower K","year":"2017","edition":"1"},{"key":"bibr44-10943420231167811","first-page":"22","volume":"11","author":"Hindman B","year":"2011","journal-title":"NSDI"},{"key":"bibr45-10943420231167811","volume-title":"Lecture notes in computer science: proceedings of job scheduling strategies for parallel processing (JSSPP)","author":"Jette MA","year":"2003"},{"key":"bibr46-10943420231167811","doi-asserted-by":"publisher","DOI":"10.1145\/3491418.3530773"},{"key":"bibr47-10943420231167811","author":"Lundin C","year":"2019","journal-title":"Cray User Group Meeting"},{"key":"bibr48-10943420231167811","volume-title":"Driving scientific and engineering discoveries through the integration of experiment, big data, and modeling and simulation","author":"Misale C","year":"2021"},{"key":"bibr49-10943420231167811","volume-title":"Infrastructure as code: managing servers in the cloud","author":"Morris K","year":"2016","edition":"1"},{"key":"bibr51-10943420231167811","doi-asserted-by":"publisher","DOI":"10.1088\/1742-6596\/1525\/1\/012066"},{"key":"bibr52-10943420231167811","unstructured":"Scheerman M, Zarrabi N, Kruiten M, et al. (2021). Secure platform for processing sensitive data on shared HPC systems. arXiv.2103.14679"},{"key":"bibr53-10943420231167811","volume-title":"The crossroads of cloud and HPC: openstack for scientific research: exploring openstack cloud computing for scientific workloads","author":"Telfer S","year":"2017","edition":"1"},{"key":"bibr54-10943420231167811","volume":"10","author":"Zhou N","year":"2021","journal-title":"Journal of Cloud Computing"}],"container-title":["The International Journal of High Performance Computing Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10943420231167811","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/10943420231167811","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10943420231167811","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T08:17:28Z","timestamp":1777450648000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/10943420231167811"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,11]]},"references-count":49,"journal-issue":{"issue":"3-4","published-print":{"date-parts":[[2023,7]]}},"alternative-id":["10.1177\/10943420231167811"],"URL":"https:\/\/doi.org\/10.1177\/10943420231167811","relation":{},"ISSN":["1094-3420","1741-2846"],"issn-type":[{"value":"1094-3420","type":"print"},{"value":"1741-2846","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,11]]}}}