{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,14]],"date-time":"2026-05-14T00:05:39Z","timestamp":1778717139762,"version":"3.51.4"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,2,8]],"date-time":"2021-02-08T00:00:00Z","timestamp":1612742400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,2,8]],"date-time":"2021-02-08T00:00:00Z","timestamp":1612742400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003006","name":"ETH Zurich","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100003006","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Comput Softw Big Sci"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The prompt reconstruction of the data recorded from the Large Hadron Collider (LHC) detectors has always been addressed by dedicated resources at the CERN Tier-0. Such workloads come in spikes due to the nature of the operation of the accelerator and in special high load occasions experiments have commissioned methods to distribute (spill-over) a fraction of the load to sites outside CERN. The present work demonstrates a new way of supporting the Tier-0 environment by provisioning resources elastically for such spilled-over workflows onto the Piz Daint Supercomputer at CSCS. This is implemented using containers, tuning the existing batch scheduler and reinforcing the scratch file system, while still using standard Grid middleware. ATLAS, CMS and CSCS have jointly run selected prompt data reconstruction on up to several thousand cores on Piz Daint into a shared environment, thereby probing the viability of the CSCS high performance computer site as on demand extension of the CERN Tier-0, which could play a role in addressing the future LHC computing challenges for the high luminosity LHC.<\/jats:p>","DOI":"10.1007\/s41781-020-00052-w","type":"journal-article","created":{"date-parts":[[2021,2,9]],"date-time":"2021-02-09T22:52:05Z","timestamp":1612911125000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Dynamic Distribution of High-Rate Data Processing from CERN to Remote HPC Data Centers"],"prefix":"10.1007","volume":"5","author":[{"given":"T.","family":"Boccali","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"D.","family":"Cameron","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"N.","family":"Cardo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"D.","family":"Conciatore","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"A.","family":"Di Girolamo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"G.","family":"Dissertori","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7018-5504","authenticated-orcid":false,"given":"P.","family":"Fernandez","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"A.","family":"Filipcic","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"M.","family":"Gila","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"C.","family":"Grab","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"J.","family":"Elmsheuser","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"V.","family":"Jankauskas","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"A.","family":"Klimentov","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"D.","family":"Kovalskyi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"S.","family":"Lammel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"D.","family":"Petrusic","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"T. C.","family":"Shulthess","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"F. G.","family":"Sciacca","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"C.","family":"Serfon","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"R.","family":"Walker","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"C.","family":"Wissing","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,2,8]]},"reference":[{"key":"52_CR1","doi-asserted-by":"crossref","unstructured":"Evans L, Bryant P (eds) (2008) LHC machine JINST 3:S08001","DOI":"10.1088\/1748-0221\/3\/08\/S08001"},{"key":"52_CR2","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1146\/annurev-nucl-102010-130059","volume":"61","author":"I Bird","year":"2011","unstructured":"Bird I (2011) Computing for the Large Hadron Collider. Annu Rev Nucl Part Sci 61:99\u2013118","journal-title":"Annu Rev Nucl Part Sci"},{"key":"52_CR3","first-page":"022002","volume":"706","author":"B Schmidt","year":"2016","unstructured":"Schmidt B (2016) The high-luminosity upgrade of the LHC: physics and technology challenges for the accelerator and the experiments. JPCS 706:022002","journal-title":"JPCS"},{"key":"52_CR4","unstructured":"Zurich ETH (2019) CSCS Piz Daint supercomputer specifications and upgrade history. https:\/\/www.cscs.ch\/computers\/piz_daint\/. Accessed 1 Jul 2019"},{"key":"52_CR5","unstructured":"ATLAS Collaboration, Aad G et al (2008) The ATLAS experiment at the CERN LHC JINST 3:S08003"},{"key":"52_CR6","doi-asserted-by":"crossref","unstructured":"CMS Collaboration, Chatrchyan et al (2008) The CMS experiment at the CERN LHC. JINST 3:S08004","DOI":"10.1088\/1748-0221\/3\/08\/S08004"},{"key":"52_CR7","doi-asserted-by":"crossref","unstructured":"LHCb Collaboration, Alves A et al (2008) The LHCb detector at the LHC. JINST 3:S08005","DOI":"10.1088\/1748-0221\/3\/08\/S08005"},{"key":"52_CR8","doi-asserted-by":"publisher","unstructured":"Cerati G (2015) CMS Collaboration (2014) Vertexing and tracking algoritms at high pile-up. PoS Vertex. https:\/\/doi.org\/10.22323\/1.227.0037","DOI":"10.22323\/1.227.0037"},{"key":"52_CR9","doi-asserted-by":"publisher","first-page":"032118","DOI":"10.1088\/1742-6596\/396\/3\/032118","volume":"396","author":"A Sanchez-Hernandez","year":"2012","unstructured":"Sanchez-Hernandez A, Egeland R, Huang C-H, Ratnikova N (2012) Magini N and Wildish T From toolkit to framework\u2014the past and future evolution of PhEDEx. J Phys Conf Ser 396:032118","journal-title":"J Phys Conf Ser"},{"key":"52_CR10","unstructured":"CHIPP Collaboration, Fernandez P et al (2019) CSCS LCGTier2 web. https:\/\/wiki.chipp.ch\/twiki\/bin\/view\/LCGTier2. Accessed 1 Jul 2019"},{"key":"52_CR11","doi-asserted-by":"crossref","unstructured":"Sciacca FG, Haug S, ATLAS Collaboration (2017) ATLAS and LHC computing on CRAY. J Phys Conf Ser 898:082004","DOI":"10.1088\/1742-6596\/898\/8\/082004"},{"key":"52_CR12","doi-asserted-by":"crossref","unstructured":"Sciacca FG, Weber M, ATLAS Collaboration (2019) Production experience and performance for ATLAS data processing on a Cray XC-50 at CSCS. EPJ Web Conf 214:03023","DOI":"10.1051\/epjconf\/201921403023"},{"key":"52_CR13","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1016\/j.future.2006.05.008","volume":"23","author":"M Ellert","year":"2007","unstructured":"Ellert M et al (2007) Advanced resource connector middleware for lightweight computational grids. Future Gener Comput Syst 23:219\u2013240","journal-title":"Future Gener Comput Syst"},{"key":"52_CR14","unstructured":"Hostettler M (2015) Enabling the ATLAS Experiment at the LHC for High Performance Computing, Masterarbeit an der philosophisch-naturwissenschaftlichen Fakultaet der Universitaet Bern"},{"key":"52_CR15","unstructured":"Benedicic L, Gila M, Alam S, Schulthess TC (2016) (CSCS) Opportunities for container environments on Cray XC30 with GPU devices. In: Published in CUG conference Proceedings. https:\/\/cug.org\/proceedings\/cug2016_proceedings\/includes\/files\/pap175s2-file1.pdf. Accessed 1 Jul 2019"},{"key":"52_CR16","unstructured":"Schmuck F, Haskin R (2002) GPFS: a shared-disk file system for large computing clusters. In: Proceedings of the FAST\u201902 conference on file and storage technologies, USENIX, pp 231\u2013244"},{"key":"52_CR17","doi-asserted-by":"crossref","unstructured":"Yoo AB, Jette MA, Grondona M (2003) SLURM: simple Linux utility for resource management JSSPP. Lecture notes in computer science, vol 2862","DOI":"10.1007\/10968987_3"},{"key":"52_CR18","unstructured":"Deutsches Elektronen Synchrotron, DESY. The dCache Project. http:\/\/www.dcache.org. Accessed 1 Jul 2019"},{"key":"52_CR19","unstructured":"Duane Wessels Squid and ICP: past, present and future. Proceedings of the Australian Unix Users Group (1997)"},{"key":"52_CR20","doi-asserted-by":"crossref","unstructured":"Blomer J, Fuhrmann T (2010) A fully decentralized file system cache for the CernVM-FS computer communications and networks (ICCCN), pp 1\u20136","DOI":"10.1109\/ICCCN.2010.5560054"},{"key":"52_CR21","unstructured":"Sugiyama S, Wallace D (2008) Cray DVS: data virtualization service in cray user group conference (CUG)"},{"key":"52_CR22","unstructured":"CRAY Inc (2019) CRAY DataWarp applucations I\/O accelerator. https:\/\/www.cray.com\/datawarp. Accessed 1 Jul 2019"},{"key":"52_CR23","doi-asserted-by":"publisher","first-page":"032008","DOI":"10.1088\/1742-6596\/396\/3\/032008","volume":"396","author":"P Andrade","year":"2012","unstructured":"Andrade P et al (2012) Service availability monitoring framework based on commodity software. J Phys Conf Ser 396:032008. https:\/\/doi.org\/10.1088\/1742-6596\/396\/3\/032008","journal-title":"J Phys Conf Ser"},{"key":"52_CR24","unstructured":"ETH Z\u00fcrich, Gila M et al (2019) Cscs\/wlcg\\_wn Docker Hub. https:\/\/hub.docker.com\/r\/cscs\/wlcg_wn. Accessed 1 Jul 2019"},{"key":"52_CR25","unstructured":"Shifter, NERSC. https:\/\/github.com\/NERSC\/shifter. Accessed 1 Jul 2019"},{"key":"52_CR26","unstructured":"SWITCH Foundation (2019) https:\/\/www.switch.ch. Accessed 1 Jul 2019"},{"key":"52_CR27","unstructured":"US ATLAS (2019) http:\/\/news.pandawms.org\/atlas.html. Accessed 1 Jul 2019"},{"key":"52_CR28","unstructured":"CERN FTS service (2019) http:\/\/information-technology.web.cern.ch\/services\/file-transfer. Accessed 1 Jul 2019"},{"key":"52_CR29","doi-asserted-by":"publisher","DOI":"10.1088\/1742-6596\/898\/5\/052031","author":"J Balcas","year":"2017","unstructured":"Balcas J et al (2017) Stability and scalability of the CMS global pool: pushing HTCondor and GlideinWMS to new limits. J Phys Conf Ser. https:\/\/doi.org\/10.1088\/1742-6596\/898\/5\/052031","journal-title":"J Phys Conf Ser"},{"key":"52_CR30","doi-asserted-by":"publisher","unstructured":"Bloom K et al (2015) Any data, anytime, anywhere: global data access for science, 2015 IEEE\/ACM 2nd international symposium on big data computing (BDC). Limassol 85. https:\/\/doi.org\/10.1109\/BDC.2015.33","DOI":"10.1109\/BDC.2015.33"},{"key":"52_CR31","doi-asserted-by":"crossref","unstructured":"Schovancova J, Di Girolamo A, Fkiaras A, Valentina M. Evolution of HammerCloud to commission CERN compute resources. https:\/\/cds.cern.ch\/record\/2646247. Accessed 1 Jul 2019","DOI":"10.1051\/epjconf\/201921403033"}],"container-title":["Computing and Software for Big Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41781-020-00052-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s41781-020-00052-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41781-020-00052-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,12,26]],"date-time":"2021-12-26T11:04:05Z","timestamp":1640516645000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s41781-020-00052-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,8]]},"references-count":31,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["52"],"URL":"https:\/\/doi.org\/10.1007\/s41781-020-00052-w","relation":{},"ISSN":["2510-2036","2510-2044"],"issn-type":[{"value":"2510-2036","type":"print"},{"value":"2510-2044","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,8]]},"assertion":[{"value":"31 March 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 December 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 February 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}},{"value":"On behalf of all authors, the corresponding author states that there is no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"7"}}