{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T18:35:34Z","timestamp":1781721334414,"version":"3.54.5"},"reference-count":16,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,3,20]],"date-time":"2023-03-20T00:00:00Z","timestamp":1679270400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,3,20]],"date-time":"2023-03-20T00:00:00Z","timestamp":1679270400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100007210","name":"RWTH Aachen University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100007210","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Comput Softw Big Sci"],"published-print":{"date-parts":[[2023,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The development of an LHC physics analysis involves numerous investigations that require the repeated processing of terabytes of data. Thus, a rapid completion of each of these analysis cycles is central to mastering the science project. We present a solution to efficiently handle and accelerate physics analyses on small-size institute clusters. Our solution uses three key concepts: vectorized processing of collision events, the \u201cMapReduce\u201d paradigm for scaling out on computing clusters, and efficiently utilized SSD caching to reduce latencies in IO operations. This work focuses on the latter key concept, its underlying mechanism, and its implementation. Using simulations from a Higgs pair production physics analysis as an example, we achieve an improvement factor of 6.3 in the runtime for reading all input data after one cycle and even an overall speedup of a factor of 14.9 after 10 cycles, reducing the runtime from hours to minutes.<\/jats:p>","DOI":"10.1007\/s41781-023-00095-9","type":"journal-article","created":{"date-parts":[[2023,3,27]],"date-time":"2023-03-27T02:13:57Z","timestamp":1679883237000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Fast Columnar Physics Analyses of Terabyte-Scale LHC Data on a Cache-Aware Dask Cluster"],"prefix":"10.1007","volume":"7","author":[{"given":"Niclas","family":"Eich","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Martin","family":"Erdmann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4932-7162","authenticated-orcid":false,"given":"Peter","family":"Fackeldey","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benjamin","family":"Fischer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dennis","family":"Noll","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yannik","family":"Rath","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,3,20]]},"reference":[{"key":"95_CR1","unstructured":"Marcel R et al (2017) Design and execution of make-like, distributed Analyses based on Spotify\u2019s Pipelining Package Luigi. arXiv:1706.00955 [physics.data-an]"},{"key":"95_CR2","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-020-2649-2","author":"R Harris Charles","year":"2020","unstructured":"Harris Charles R et al (2020) Array programming with NumPy. Nature. https:\/\/doi.org\/10.1038\/s41586-020-2649-2","journal-title":"Nature"},{"key":"95_CR3","unstructured":"Jeffrey D, Sanjay G (2004) \u201cMapReduce: Simplified Data Processing on Large Clusters\u201d. In: OSDI\u201904: Sixth Symposium on Operating System Design and Implementation. San Francisco, CA, pp. 137\u2013150"},{"key":"95_CR4","unstructured":"Dask Development Team (2016) Dask: Library for dynamic task scheduling.\u00a0https:\/\/dask.org. Accessed 26 May 2022"},{"key":"95_CR5","doi-asserted-by":"publisher","unstructured":"Lindsey G et al (2021) CoffeaTeam\/coffea: Release v0.7.11. Version v0.7.11. https:\/\/doi.org\/10.5281\/zenodo.5762406","DOI":"10.5281\/zenodo.5762406"},{"key":"95_CR6","doi-asserted-by":"publisher","unstructured":"Martin E et al (2019) \u201cEvolution of the VISPA-project\u201d. In: Forti A et al (eds) EPJ Web Conf. 214. p. 05021. https:\/\/doi.org\/10.1051\/epjconf\/201921405021","DOI":"10.1051\/epjconf\/201921405021"},{"key":"95_CR7","unstructured":"Intel. Advanced Vector Extensions (2022) https:\/\/www.intel.de\/content\/www\/de\/de\/architecture-and-technology\/avx-512-overview.html.\u00a0Accessed 26 May 2022"},{"key":"95_CR8","doi-asserted-by":"publisher","unstructured":"Haynes Thomas (2016) Network File System (NFS) Version 4 Minor Version 2 Protocol. RFC 7862. https:\/\/doi.org\/10.17487\/RFC7862.https:\/\/www.rfc-editor.org\/info\/rfc7862","DOI":"10.17487\/RFC7862"},{"key":"95_CR9","unstructured":"Red Hat (2022) Ansible. https:\/\/www.ansible.com.\u00a0Accessed 26 May 2022"},{"key":"95_CR10","unstructured":"Anaconda Software Distribution. Version 2.4.0. (2020) https:\/\/docs.anaconda.com\/.\u00a0Accessed 26 May 2022"},{"key":"95_CR11","doi-asserted-by":"publisher","unstructured":"HTCondor Team. HTCondor. Version 9.4.0. (Dec. 2021) https:\/\/doi.org\/10.5281\/zenodo.5750673","DOI":"10.5281\/zenodo.5750673"},{"key":"95_CR12","unstructured":"dask-jobqueue source code. https:\/\/github.com\/dask\/dask-jobqueue.\u00a0Accessed 26 May 2022"},{"key":"95_CR13","unstructured":"dask-jobqueue blog entry. https:\/\/blog.dask.org\/2018\/10\/08\/Dask-Jobqueue.\u00a0Accessed 26 May 2022"},{"key":"95_CR14","unstructured":"Kernel Linux (2022) General Filesystem Caching. https:\/\/www.kernel.org\/doc\/html\/latest\/filesystems\/caching\/fscache.html.\u00a0Accessed 26 May 2022"},{"key":"95_CR15","doi-asserted-by":"publisher","unstructured":"Karl Ehat\u00e4ht (2020) \u201cNANOAOD: a new compact event data format in CMS\u201d. In: EPJ Web Conf. 245, p. 06002. https:\/\/doi.org\/10.1051\/epjconf\/202024506002","DOI":"10.1051\/epjconf\/202024506002"},{"key":"95_CR16","doi-asserted-by":"publisher","unstructured":"Yann C, Murray K (2021) Zstandard Compression and the \u2019application\/zstd\u2019 Media Type. RFC 8878. https:\/\/doi.org\/10.17487\/RFC8878.https:\/\/www.rfceditor.org\/info\/rfc8878","DOI":"10.17487\/RFC8878"}],"container-title":["Computing and Software for Big Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41781-023-00095-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s41781-023-00095-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41781-023-00095-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,27]],"date-time":"2023-03-27T02:28:44Z","timestamp":1679884124000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s41781-023-00095-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,20]]},"references-count":16,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,12]]}},"alternative-id":["95"],"URL":"https:\/\/doi.org\/10.1007\/s41781-023-00095-9","relation":{},"ISSN":["2510-2036","2510-2044"],"issn-type":[{"value":"2510-2036","type":"print"},{"value":"2510-2044","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,20]]},"assertion":[{"value":"19 July 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 February 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 March 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"3"}}