{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T16:34:56Z","timestamp":1781109296362,"version":"3.54.1"},"reference-count":63,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,2,22]],"date-time":"2021-02-22T00:00:00Z","timestamp":1613952000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,2,22]],"date-time":"2021-02-22T00:00:00Z","timestamp":1613952000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"European Union?s Horizon 2020"},{"name":"Universit\\\"{a}t Stuttgart"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Cloud Comp"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Containerisation demonstrates its efficiency in application deployment in Cloud Computing. Containers can encapsulate complex programs with their dependencies in isolated environments making applications more portable, hence are being adopted in High Performance Computing (HPC) clusters.<jats:italic>Singularity<\/jats:italic>, initially designed for HPC systems, has become their<jats:italic>de facto<\/jats:italic>standard container runtime. Nevertheless, conventional HPC workload managers lack micro-service support and deeply-integrated container management, as opposed to container orchestrators. We introduce a Torque-Operator which serves as a bridge between HPC workload manager (TORQUE) and container orchestrator (Kubernetes). We propose a hybrid architecture that integrates HPC and Cloud clusters seamlessly with little interference to HPC systems where container orchestration is performed on two levels.<\/jats:p>","DOI":"10.1186\/s13677-021-00231-z","type":"journal-article","created":{"date-parts":[[2021,2,22]],"date-time":"2021-02-22T12:04:16Z","timestamp":1613995456000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":54,"title":["Container orchestration on HPC systems through Kubernetes"],"prefix":"10.1186","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9329-4500","authenticated-orcid":false,"given":"Naweiluo","family":"Zhou","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yiannis","family":"Georgiou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marcin","family":"Pospieszny","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Li","family":"Zhong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Huan","family":"Zhou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christoph","family":"Niethammer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Branislav","family":"Pejak","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Oskar","family":"Marko","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dennis","family":"Hoppe","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,2,22]]},"reference":[{"key":"231_CR1","doi-asserted-by":"publisher","first-page":"392","DOI":"10.1109\/IC2E.2018.00074","volume-title":"2018 IEEE International Conference on Cloud Engineering (IC2E)","author":"M Khan","year":"2018","unstructured":"Khan M, Becker T, Kuppuudaiyar P, Elster AC (2018) Container-Based Virtualization for Heterogeneous HPC Clouds: Insights from the EU H2020 CloudLightning Project In: 2018 IEEE International Conference on Cloud Engineering (IC2E), 392\u2013397.. IEEE, Piscataway."},{"issue":"5","key":"231_CR2","doi-asserted-by":"publisher","first-page":"698","DOI":"10.1002\/spe.2660","volume":"49","author":"MA Rodriguez","year":"2019","unstructured":"Rodriguez MA, Buyya R (2019) Container-based cluster orchestration systems: A taxonomy and future directions. Softw Pract Experience 49(5):698\u2013719. https:\/\/doi.org\/10.1002\/spe.2660.","journal-title":"Softw Pract Experience"},{"key":"231_CR3","doi-asserted-by":"publisher","first-page":"970","DOI":"10.1109\/CLOUD.2018.00148","volume-title":"2018 IEEE 11th International Conference on Cloud Computing (CLOUD)","author":"L Abdollahi Vayghan","year":"2018","unstructured":"Abdollahi Vayghan L, Saied MA, Toeroe M, Khendek F (2018) Deploying Microservice Based Applications with Kubernetes: Experiments and Lessons Learned In: 2018 IEEE 11th International Conference on Cloud Computing (CLOUD), 970\u2013973.. IEEE, Piscataway."},{"key":"231_CR4","doi-asserted-by":"publisher","first-page":"287","DOI":"10.4108\/eai.25-10-2016.2266649","volume-title":"Proceedings of the 10th EAI International Conference on Performance Evaluation Methodologies and Tools on 10th EAI International Conference on Performance Evaluation Methodologies and Tools. VALUETOOLS16","author":"E Casalicchio","year":"2017","unstructured":"Casalicchio E (2017) Autonomic Orchestration of Containers: Problem Definition and Research Challenges In: Proceedings of the 10th EAI International Conference on Performance Evaluation Methodologies and Tools on 10th EAI International Conference on Performance Evaluation Methodologies and Tools. VALUETOOLS16, 287\u2013290.. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), Brussels, BEL. https:\/\/doi.org\/10.4108\/eai.25-10-2016.2266649."},{"key":"231_CR5","first-page":"1","volume-title":"Job Scheduling Strategies for Parallel Processing","author":"M Hovestadt","year":"2003","unstructured":"Hovestadt M, Kao O, Keller A, Streit A (2003) Scheduling in HPC Resource Management Systems: Queuing vs. Planning. In: Feitelson D, Rudolph L, Schwiegelshohn U (eds)Job Scheduling Strategies for Parallel Processing, 1\u201320.. Springer Berlin Heidelberg, Berlin."},{"key":"231_CR6","doi-asserted-by":"publisher","DOI":"10.1145\/2749246.2749266","volume-title":"Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing","author":"D Klus\u00e1\u010dek","year":"2015","unstructured":"Klus\u00e1\u010dek D, Chlumsk\u00fd V, Rudov\u00e1 H (2015) Planning and Optimization in TORQUE Resource Manager In: Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing.. Association for Computing Machinery, New York. https:\/\/doi.org\/10.1145\/2749246.2749266."},{"key":"231_CR7","first-page":"44","volume-title":"In Lecture Notes in Computer Science: Proceedings of Job Scheduling Strategies for Parallel Processing (JSSPP) 2003","author":"MA Jette","year":"2002","unstructured":"Jette MA, Yoo AB, Grondona M (2002) SLURM: Simple Linux Utility for Resource Management In: In Lecture Notes in Computer Science: Proceedings of Job Scheduling Strategies for Parallel Processing (JSSPP) 2003, 44\u201360.. Springer-Verlag, Berlin."},{"key":"231_CR8","doi-asserted-by":"publisher","DOI":"10.1145\/1188455.1188464","volume-title":"Proceedings of the 2006 ACM\/IEEE Conference on Supercomputing","author":"G Staples","year":"2006","unstructured":"Staples G (2006) TORQUE Resource Manager In: Proceedings of the 2006 ACM\/IEEE Conference on Supercomputing.. Association for Computing Machinery, New York. https:\/\/doi.org\/10.1145\/1188455.1188464."},{"key":"231_CR9","unstructured":"Moab HPC Suite. https:\/\/support.adaptivecomputing.com\/wp-content\/uploads\/2019\/06\/Moab-HPC-Suite_datasheet_20190611.pdf. Accessed 08 July 2020."},{"issue":"5","key":"231_CR10","doi-asserted-by":"publisher","first-page":"440","DOI":"10.1016\/j.future.2010.11.003","volume":"27","author":"G Mateescu","year":"2011","unstructured":"Mateescu G, Gentzsch W, Ribbens CJ (2011) Hybrid Computing-Where HPC Meets Grid and Cloud Computing. Future Gener Comput Syst 27(5):440\u2013453. https:\/\/doi.org\/10.1016\/j.future.2010.11.003.","journal-title":"Future Gener Comput Syst"},{"key":"231_CR11","doi-asserted-by":"publisher","unstructured":"Mayer R, Jacobsen HA (2020) Scalable Deep Learning on Distributed Infrastructures: Challenges, Techniques, and Tools. ACM Comput Surv 53(1). https:\/\/doi.org\/10.1145\/3363554.","DOI":"10.1145\/3363554"},{"key":"231_CR12","first-page":"265","volume-title":"Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation. OSDI\u201916","author":"M Abadi","year":"2016","unstructured":"Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, et al. (2016) TensorFlow: A System for Large-scale Machine Learning In: Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation. OSDI\u201916, 265\u2013283.. USENIX Association, Berkeley. http:\/\/dl.acm.org\/citation.cfm?id=3026877.3026899."},{"key":"231_CR13","unstructured":"Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G, et al. (2019) PyTorch: An Imperative Style, High-Performance Deep Learning Library. In: Wallach HM, Larochelle H, Beygelzimer A, d\u2019Alch\u00e9-Buc F, Fox EB, Garnett R (eds)Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, 8-14 December 2019, 8024\u20138035, Vancouver. https:\/\/proceedings.neurips.cc\/paper\/2019\/hash\/bdbca288fee7f92f2bfa9f7012727740-Abstract.html."},{"key":"231_CR14","first-page":"1","volume-title":"2019 IEEE High Performance Extreme Computing Conference (HPEC)","author":"D Brayford","year":"2019","unstructured":"Brayford D, Vallecorsa S, Atanasov A, Baruffa F, Riviera W (2019) Deploying AI Frameworks on Secure HPC Systems with Containers In: 2019 IEEE High Performance Extreme Computing Conference (HPEC), 1\u20136.. IEEE, Piscataway."},{"issue":"6","key":"231_CR15","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1109\/MCSE.2017.2421459","volume":"19","author":"JS Hale","year":"2017","unstructured":"Hale JS, Li L, Richardson CN, Wells GN (2017) Containers for Portable, Productive, and Performant Scientific Computing. Comput Sci Eng 19(6):40\u201350.","journal-title":"Comput Sci Eng"},{"key":"231_CR16","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1109\/ISPASS.2015.7095802","volume-title":"2015 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS)","author":"W Felter","year":"2015","unstructured":"Felter W, Ferreira A, Rajamony R, Rubio J (2015) An updated performance comparison of virtual machines and Linux containers In: 2015 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), 171\u2013172.. IEEE, Piscataway."},{"issue":"3","key":"231_CR17","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1109\/MCC.2014.51","volume":"1","author":"D Bernstein","year":"2014","unstructured":"Bernstein D (2014) Containers and Cloud: From LXC to Docker to Kubernetes. IEEE Cloud Comput 1(3):81\u201384.","journal-title":"IEEE Cloud Comput"},{"key":"231_CR18","doi-asserted-by":"publisher","unstructured":"Martin JP, Kandasamy A, Chandrasekaran K (2018) Exploring the Support for High Performance Applications in the Container Runtime Environment. Hum-Centric Comput Inf Sci 8(1). https:\/\/doi.org\/10.1186\/s13673-017-0124-3.","DOI":"10.1186\/s13673-017-0124-3"},{"key":"231_CR19","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1007\/978-3-319-67262-5_3","volume-title":"Service-Oriented and Cloud Computing","author":"M Plauth","year":"2017","unstructured":"Plauth M, Feinbube L, Polze A (2017) A Performance Survey of Lightweight Virtualization Techniques. In: De Paoli F, Schulte S, Broch Johnsen E (eds)Service-Oriented and Cloud Computing, 34\u201348.. Springer International Publishing, Cham."},{"key":"231_CR20","doi-asserted-by":"publisher","DOI":"10.1145\/3147213.3147231","volume-title":"Proceedings of The10th International Conference on Utility and Cloud Computing. UCC 17","author":"J Zhang","year":"2017","unstructured":"Zhang J, Lu X, Panda DK (2017) Is Singularity-Based Container Technology Ready for Running MPI Applications on HPC Clouds? In: Proceedings of The10th International Conference on Utility and Cloud Computing. UCC 17.. Association for Computing Machinery, New York. https:\/\/doi.org\/10.1145\/3147213.3147231."},{"key":"231_CR21","doi-asserted-by":"publisher","first-page":"2587","DOI":"10.1109\/HPCC\/SmartCity\/DSS.2019.00362","volume-title":"2019 IEEE 21st International Conference on High Performance Computing and Communications; IEEE 17th International Conference on Smart City; IEEE 5th International Conference on Data Science and Systems (HPCC\/SmartCity\/DSS)","author":"G Hu","year":"2019","unstructured":"Hu G, Zhang Y, Chen W (2019) Exploring the Performance of Singularity for High Performance Computing Scenarios In: 2019 IEEE 21st International Conference on High Performance Computing and Communications; IEEE 17th International Conference on Smart City; IEEE 5th International Conference on Data Science and Systems (HPCC\/SmartCity\/DSS), 2587\u20132593.. IEEE, Piscataway."},{"key":"231_CR22","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1109\/CloudCom.2017.40","volume-title":"2017 IEEE International Conference on Cloud Computing Technology and Science (CloudCom)","author":"AJ Younge","year":"2017","unstructured":"Younge AJ, Pedretti K, Grant RE, Brightwell R (2017) A Tale of Two Systems: Using Containers to Deploy HPC Applications on Supercomputers and Clouds In: 2017 IEEE International Conference on Cloud Computing Technology and Science (CloudCom), 74\u201381.. IEEE, Piscataway."},{"key":"231_CR23","volume-title":"Containers on Virtual Machines or Bare Metals?","author":"VMWare","year":"2018","unstructured":"VMWare (2018) Containers on Virtual Machines or Bare Metals?. VMware, Inc., Palo Alto. https:\/\/assets.contentstack.io\/v3\/assets\/blt58b49a8a0e43b5ff\/blta366cfae83d85681\/5c742ba62617ffd7604a143c\/vmwwp-containers-on-vms.pdf."},{"issue":"239","key":"231_CR24","first-page":"76","volume":"2014","author":"D Merkel","year":"2014","unstructured":"Merkel D (2014) Docker: Lightweight Linux Containers for Consistent Development and Deployment. Linux J 2014(239):76\u201390.","journal-title":"Linux J"},{"key":"231_CR25","volume-title":"PloS one","author":"GM Kurtzer","year":"2017","unstructured":"Kurtzer GM, Sochat VV, Bauer M (2017) Singularity: Scientific containers for mobility of compute In: PloS one.. PLOS, San Francisco."},{"key":"231_CR26","doi-asserted-by":"publisher","first-page":"082021","DOI":"10.1088\/1742-6596\/898\/8\/082021","volume":"898","author":"L Gerhardt","year":"2017","unstructured":"Gerhardt L, Bhimji W, Canon S, Fasel M, Jacobsen D, Mustafa M, et al. (2017) Shifter: Containers for HPC. J Phys Conf Ser 898:082021. https:\/\/doi.org\/10.1088%2F1742-6596%2F898%2F8%2F082021.","journal-title":"J Phys Conf Ser"},{"key":"231_CR27","doi-asserted-by":"publisher","DOI":"10.1145\/3126908.3126925","volume-title":"Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis. SC 17","author":"R Priedhorsky","year":"2017","unstructured":"Priedhorsky R, Randles T (2017) Charliecloud: Unprivileged Containers for User-Defined Software Stacks in HPC In: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis. SC 17.. Association for Computing Machinery, New York. https:\/\/doi.org\/10.1145\/3126908.3126925."},{"key":"231_CR28","volume-title":"Practical LXC and LXD: Linux Containers for Virtualization and Orchestration. 1st ed","author":"SK S","year":"2017","unstructured":"S SK (2017) Practical LXC and LXD: Linux Containers for Virtualization and Orchestration. 1st ed. Apress, USA."},{"key":"231_CR29","unstructured":"Gropp W, Lusk E, Skjellum A (1994) Using MPI: Portable Parallel Programming with the Message-passing Interface.. MIT Press, Cambridge."},{"key":"231_CR30","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1109\/PDP.2013.41","volume-title":"2013 21st Euromicro International Conference on Parallel, Distributed, and Network-Based Processing","author":"MG Xavier","year":"2013","unstructured":"Xavier MG, Neves MV, Rossi FD, Ferreto TC, Lange T, De Rose CAF (2013) Performance Evaluation of Container-Based Virtualization for High Performance Computing Environments In: 2013 21st Euromicro International Conference on Parallel, Distributed, and Network-Based Processing, 233\u2013240.. IEEE, Piscataway."},{"key":"231_CR31","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1007\/978-3-319-92378-9_14","volume-title":"Systems Modeling: Methodologies and Tools","author":"E Casalicchio","year":"2019","unstructured":"Casalicchio E (2019) Container Orchestration: A Survey. In: Puliafito A (ed)Systems Modeling: Methodologies and Tools, 221\u2013235.. Springer International Publishing, Cham. https:\/\/doi.org\/10.1007\/978-3-319-92378-9_14."},{"key":"231_CR32","unstructured":"Hightower K, Burns B, Beda J (2017) Kubernetes: Up and Running Dive into the Future of Infrastructure. 1st ed.. OReilly Media, Inc., Sebastopol."},{"issue":"17","key":"231_CR33","doi-asserted-by":"crossref","first-page":"e5668","DOI":"10.1002\/cpe.5668","volume":"32","author":"E Casalicchio","year":"2019","unstructured":"Casalicchio E, Iannucci S (2019) The state-of-the-art in container technologies: Application, orchestration and security. Concurrency Comput Pract Experience 32(17):e5668. https:\/\/onlinelibrary.wiley.com\/doi\/abs\/10.1002\/cpe.5668.","journal-title":"Concurrency Comput Pract Experience"},{"key":"231_CR34","doi-asserted-by":"publisher","first-page":"555","DOI":"10.1109\/CSNT.2014.117","volume-title":"2014 Fourth International Conference on Communication Systems and Network Technologies","author":"S Pandey","year":"2014","unstructured":"Pandey S, Tokekar V (2014) Prominence of MapReduce in Big Data Processing In: 2014 Fourth International Conference on Communication Systems and Network Technologies, 555\u2013560.. IEEE, Piscataway."},{"issue":"11","key":"231_CR35","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1145\/2934664","volume":"59","author":"M Zaharia","year":"2016","unstructured":"Zaharia M, Xin RS, Wendell P, Das T, Armbrust M, Dave A, et al. (2016) Apache Spark: A Unified Engine for Big Data Processing. Commun ACM 59(11):56\u201365. http:\/\/doi.acm.org\/10.1145\/2934664.","journal-title":"Commun ACM"},{"key":"231_CR36","volume-title":"Kafka: The Definitive Guide Real-Time Data and Stream Processing at Scale. 1st ed","author":"N Narkhede","year":"2017","unstructured":"Narkhede N, Shapira G, Palino T (2017) Kafka: The Definitive Guide Real-Time Data and Stream Processing at Scale. 1st ed. O\u2019Reilly Media, Inc., Sebastopol."},{"key":"231_CR37","volume-title":"Exploring Ansible 2: Fast and Easy Guide","author":"G Sammons","year":"2016","unstructured":"Sammons G (2016) Exploring Ansible 2: Fast and Easy Guide. CreateSpace Independent Publishing Platform, North Charleston."},{"key":"231_CR38","first-page":"249","volume-title":"Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation. OSDI|16","author":"PX Gao","year":"2016","unstructured":"Gao PX, Narayan A, Karandikar S, Carreira J, Han S, Agarwal R, et al. (2016) Network Requirements for Resource Disaggregation In: Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation. OSDI|16, 249\u2013264.. USENIX Association, USA."},{"key":"231_CR39","volume-title":"2020 IEEE International Conference on Cloud Computing (CLOUD)","author":"N Zhou","year":"2020","unstructured":"Zhou N, Georgiou Y, Zhong L, Zhou H, Pospieszny M (2020) Container Orchestration on HPC Systems In: 2020 IEEE International Conference on Cloud Computing (CLOUD).. IEEE, Piscataway."},{"key":"231_CR40","doi-asserted-by":"publisher","DOI":"10.1145\/2949550.2949562","volume-title":"Proceedings of the XSEDE16 Conference on Diversity, Big Data, and Science at Scale. XSEDE16","author":"S Julian","year":"2016","unstructured":"Julian S, Shuey M, Cook S (2016) Containers in Research: Initial Experiences with Lightweight Infrastructure In: Proceedings of the XSEDE16 Conference on Diversity, Big Data, and Science at Scale. XSEDE16.. Association for Computing Machinery, New York. https:\/\/doi.org\/10.1145\/2949550.2949562."},{"key":"231_CR41","doi-asserted-by":"publisher","first-page":"506","DOI":"10.1007\/978-3-319-20119-1_36","volume-title":"High Performance Computing","author":"J Higgins","year":"2015","unstructured":"Higgins J, Holmes V, Venters C (2015) Orchestrating Docker Containers in the HPC Environment. In: Kunkel JM Ludwig T (eds)High Performance Computing, 506\u2013513.. Springer International Publishing, Cham."},{"key":"231_CR42","volume-title":"Proceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis. SC 18","author":"F Liu","year":"2018","unstructured":"Liu F, Keahey K, Riteau P, Weissman J (2018) Dynamically Negotiating Capacity between On-Demand and Batch Clusters In: Proceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis. SC 18.. IEEE Press, Piscataway."},{"key":"231_CR43","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1007\/978-3-030-34356-9_3","volume-title":"High Performance Computing","author":"ME Piras","year":"2019","unstructured":"Piras ME, Pireddu L, Moro M, Zanetti G (2019) Container Orchestration on HPC Clusters. In: Weiland M, Juckeland G, Alam S, Jagode H (eds)High Performance Computing, 25\u201335.. Springer International Publishing, Cham."},{"key":"231_CR44","doi-asserted-by":"publisher","first-page":"138","DOI":"10.1145\/3297280.3297296","volume-title":"Proceedings of the 34th ACM\/SIGAPP Symposium on Applied Computing. SAC 19","author":"GP Fernandez","year":"2019","unstructured":"Fernandez GP, Brito A (2019) Secure Container Orchestration in the Cloud: Policies and Implementation In: Proceedings of the 34th ACM\/SIGAPP Symposium on Applied Computing. SAC 19, 138\u2013145.. Association for Computing Machinery, New York. https:\/\/doi.org\/10.1145\/3297280.3297296."},{"key":"231_CR45","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1007\/s10922-019-09504-0","volume":"28","author":"PJ Maenhaut","year":"2019","unstructured":"Maenhaut PJ, Volckaert B, Ongenae V, De Turck F (2019) Resource Management in a Containerized Cloud: Status and Challenges. J Netw Syst Manag 28:197\u2013246.","journal-title":"J Netw Syst Manag"},{"key":"231_CR46","unstructured":"Buyya R, Srirama SN (2019) A Lightweight Container Middleware for Edge Cloud Architectures. Wiley Telecom. https:\/\/ieeexplore.ieee.org\/document\/8654087."},{"key":"231_CR47","first-page":"295","volume-title":"Proceedings of the 8th USENIX Conference on Networked Systems Design and Implementation. NSDI 11","author":"B Hindman","year":"2011","unstructured":"Hindman B, Konwinski A, Zaharia M, Ghodsi A, Joseph AD, Katz R, et al. (2011) Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center In: Proceedings of the 8th USENIX Conference on Networked Systems Design and Implementation. NSDI 11, 295\u2013308.. USENIX Association, USA."},{"key":"231_CR48","doi-asserted-by":"publisher","first-page":"1593","DOI":"10.1145\/3019612.3019894","volume-title":"Proceedings of the Symposium on Applied Computing. SAC 17","author":"F Wrede","year":"2017","unstructured":"Wrede F, von Hof V (2017) Enabling Efficient Use of Algorithmic Skeletons in Cloud Environments: Container-Based Virtualization for Hybrid CPU-GPU Execution of Data-Parallel Skeletons In: Proceedings of the Symposium on Applied Computing. SAC 17, 1593\u20131596.. Association for Computing Machinery, New York. https:\/\/doi.org\/10.1145\/3019612.3019894."},{"key":"231_CR49","unstructured":"Ciechanowicz P, Poldner M, Kuchen H (2009) The M\u00fcnster Skeleton Library Muesli: A comprehensive overview. University of M\u00fcnster, European Research Center for Information Systems (ERCIS). Available from: https:\/\/www.ercis.org\/sites\/www.ercis.org\/files\/pages\/research\/ercis-working-papers\/ercis_wp_07.pdf."},{"key":"231_CR50","unstructured":"Pisaruk V, Yakovtseva SWLM-operator. Gitlab. https:\/\/github.com\/sylabs\/wlm-operator. Accessed 13 Feb 2020."},{"key":"231_CR51","volume-title":"15th Workshop on Virtualization in High-Performance Cloud Computing (VHPC\u201920)","author":"Y Georgiou","year":"2020","unstructured":"Georgiou Y, Zhou N, Zhong L, Hoppe D, Pospieszny M, Papadopoulou N, et al. (2020) Converging HPC, Big Data and Cloud technologies for precision agriculture data analytics on supercomputers In: 15th Workshop on Virtualization in High-Performance Cloud Computing (VHPC\u201920).. Springer International Publishing, Cham."},{"issue":"2","key":"231_CR52","doi-asserted-by":"publisher","first-page":"108","DOI":"10.3390\/info11020108","volume":"11","author":"J Howard","year":"2020","unstructured":"Howard J, Gugger S (2020) Fastai: A Layered API for Deep Learning. Information 11(2):108. https:\/\/doi.org\/10.3390\/info11020108.","journal-title":"Information"},{"issue":"1","key":"231_CR53","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman L (2001) Random forests. Mach Learn 45(1):5\u201332.","journal-title":"Mach Learn"},{"key":"231_CR54","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, et al. (2011) Scikit-Learn: Machine Learning in Python. J Mach Learn Res 12:2825\u20132830.","journal-title":"J Mach Learn Res"},{"key":"231_CR55","doi-asserted-by":"crossref","unstructured":"Drusch M, Bello UD, Carlier S, Colin O, Fernandez V, Gascon F, et al. (2012) Sentinel-2: ESA\u2019s Optical High-Resolution Mission for GMES Operational Services. Remote Sens Environ 120:25\u201336. The Sentinel Missions - New Opportunities for Science. http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0034425712000636.","DOI":"10.1016\/j.rse.2011.11.026"},{"key":"231_CR56","volume-title":"Proceedings of the International Conference on Machine Learning. vol. 25","author":"R Salakhutdinov","year":"2008","unstructured":"Salakhutdinov R, Mnih A (2008) Bayesian probabilistic matrix factorization using Markov chain Monte Carlo In: Proceedings of the International Conference on Machine Learning. vol. 25.. Association for Computing Machinery, New York."},{"key":"231_CR57","first-page":"346","volume-title":"CLUSTER","author":"TV Aa","year":"2016","unstructured":"Aa TV, Chakroun I, Haber T (2016) Distributed Bayesian probabilistic matrix factorization In: CLUSTER, 346\u2013349.. IEEE Computer Society, Piscataway."},{"key":"231_CR58","unstructured":"MPI: A Message-Passing Interface Standard. https:\/\/www.mpi-forum.org\/docs\/mpi-3.1\/mpi31-report.pdf. Accessed 26 Jan 2021."},{"key":"231_CR59","doi-asserted-by":"publisher","first-page":"228","DOI":"10.1007\/11752578_29","volume-title":"Proceedings of the 6th International Conference on Parallel Processing and Applied Mathematics. PPAM 05","author":"RL Graham","year":"2005","unstructured":"Graham RL, Woodall TS, Squyres JM (2005) Open MPI: A Flexible High Performance MPI In: Proceedings of the 6th International Conference on Parallel Processing and Applied Mathematics. PPAM 05, 228\u2013239.. Springer-Verlag, Berlin. https:\/\/doi.org\/10.1007\/11752578_29."},{"key":"231_CR60","unstructured":"SylabsSingularity-CRI. https:\/\/sylabs.io\/guides\/cri\/1.0\/user-guide\/k8s.html. Accessed 03 Mar 2020."},{"key":"231_CR61","unstructured":"Romana. https:\/\/romana.io\/. Accessed 21 May 2020."},{"key":"231_CR62","unstructured":"Sergeev A, Balso MD (2018) Horovod: fast and easy distributed deep learning in TensorFlow. CoRR. abs\/1802.05799. Available from: https:\/\/arxiv.org\/abs\/1802.05799."},{"key":"231_CR63","doi-asserted-by":"publisher","DOI":"10.1145\/2523616.2523633","volume-title":"Proceedings of the 4th Annual Symposium on Cloud Computing. SOCC \u201913","author":"VK Vavilapalli","year":"2013","unstructured":"Vavilapalli VK, Murthy AC, Douglas C, Agarwal S, Konar M, Evans R, et al. (2013) Apache Hadoop YARN: Yet Another Resource Negotiator In: Proceedings of the 4th Annual Symposium on Cloud Computing. SOCC \u201913.. Association for Computing Machinery, New York. https:\/\/doi.org\/10.1145\/2523616.2523633."}],"container-title":["Journal of Cloud Computing"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13677-021-00231-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s13677-021-00231-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13677-021-00231-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,21]],"date-time":"2023-10-21T18:30:28Z","timestamp":1697913028000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofcloudcomputing.springeropen.com\/articles\/10.1186\/s13677-021-00231-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,22]]},"references-count":63,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["231"],"URL":"https:\/\/doi.org\/10.1186\/s13677-021-00231-z","relation":{},"ISSN":["2192-113X"],"issn-type":[{"value":"2192-113X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,22]]},"assertion":[{"value":"16 October 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 January 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 February 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"16"}}