{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T15:35:44Z","timestamp":1772120144692,"version":"3.50.1"},"reference-count":36,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,8,4]],"date-time":"2025-08-04T00:00:00Z","timestamp":1754265600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,8,4]],"date-time":"2025-08-04T00:00:00Z","timestamp":1754265600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["PHY-2411665"],"award-info":[{"award-number":["PHY-2411665"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100014013","name":"UK Research and Innovation","doi-asserted-by":"publisher","award":["MR\/Y01166X\/1"],"award-info":[{"award-number":["MR\/Y01166X\/1"]}],"id":[{"id":"10.13039\/100014013","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Comput Softw Big Sci"],"published-print":{"date-parts":[[2025,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    The LHCb detector underwent a comprehensive upgrade in preparation for the third data-taking run of the Large Hadron Collider (LHC), known as LHCb Upgrade I. With its increased data rate, Run\u00a03 introduced considerable challenges in both data acquisition (online) and data processing and analysis (offline). The offline processing and analysis model was upgraded to handle the factor 30 increase in data volume and the associated demands of ever-growing datasets for analysis, led by the LHCb Data Processing and Analysis (DPA) project. This paper documents the LHCb \u201cSprucing\" \u2014 the centralised offline data processing and selections \u2014 and \u201cAnalysis Productions\" \u2014 the centralised and highly automated declarative nTuple production system. The\n                    <jats:sc>DaVinci<\/jats:sc>\n                    application used by analysis productions for tupling spruced data is described as well as the  and  tools for data retrieval and analysis environment configuration. These tools allow for greatly improved analyst workflows and analysis preservation. Finally, the approach to data processing and analysis in the High-Luminosity Large Hadron Collider (HL-LHC) era \u2014 LHCb Upgrade II \u2014 is discussed.\n                  <\/jats:p>","DOI":"10.1007\/s41781-025-00144-5","type":"journal-article","created":{"date-parts":[[2025,8,4]],"date-time":"2025-08-04T16:44:34Z","timestamp":1754325874000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["The LHCb Sprucing and Analysis Productions"],"prefix":"10.1007","volume":"9","author":[{"given":"Ahmed","family":"Abdelmotteleb","sequence":"first","affiliation":[]},{"given":"Alessandro","family":"Bertolin","sequence":"additional","affiliation":[]},{"given":"Chris","family":"Burr","sequence":"additional","affiliation":[]},{"given":"Ben","family":"Couturier","sequence":"additional","affiliation":[]},{"given":"Ellinor","family":"Eckstein","sequence":"additional","affiliation":[]},{"given":"Davide","family":"Fazzini","sequence":"additional","affiliation":[]},{"given":"Nathan","family":"Grieser","sequence":"additional","affiliation":[]},{"given":"Christophe","family":"Haen","sequence":"additional","affiliation":[]},{"given":"Ryunosuke","family":"O\u2019Neil","sequence":"additional","affiliation":[]},{"given":"Eduardo","family":"Rodrigues","sequence":"additional","affiliation":[]},{"given":"Nicole","family":"Skidmore","sequence":"additional","affiliation":[]},{"given":"Mark","family":"Smith","sequence":"additional","affiliation":[]},{"given":"Aidan R.","family":"Wiederhold","sequence":"additional","affiliation":[]},{"given":"Shunan","family":"Zhang","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,8,4]]},"reference":[{"key":"144_CR1","doi-asserted-by":"publisher","unstructured":"Alves\u00a0Jr, AA, et al. ( 2008) The LHCb detector at the LHC. JINST 3, 08005 https:\/\/doi.org\/10.1088\/1748-0221\/3\/08\/S08005","DOI":"10.1088\/1748-0221\/3\/08\/S08005"},{"issue":"05","key":"144_CR2","doi-asserted-by":"publisher","first-page":"05065","DOI":"10.1088\/1748-0221\/19\/05\/P05065","volume":"19","author":"R Aaij","year":"2024","unstructured":"Aaij R et al (2024) The LHCb Upgrade. I JINST 19(05):05065. https:\/\/doi.org\/10.1088\/1748-0221\/19\/05\/P05065","journal-title":"I JINST"},{"key":"144_CR3","unstructured":"LHCb Collaboration: Computing Model of the Upgrade LHCb experiment. Technical Report CERN-LHCC-2018-014, LHCb-TDR-018, CERN, Geneva (2018). https:\/\/cds.cern.ch\/record\/2319756"},{"key":"144_CR4","doi-asserted-by":"publisher","DOI":"10.1088\/1742-6596\/219\/6\/062029","volume":"219","author":"A Tsaregorodtsev","year":"2010","unstructured":"Tsaregorodtsev A, Brook N, Casajus Ramo A, Charpentier P, Closier J et al (2010) DIRAC3: The new generation of the LHCb grid software. J Phys: Conf Ser 219:062029. https:\/\/doi.org\/10.1088\/1742-6596\/219\/6\/062029","journal-title":"J Phys: Conf Ser"},{"key":"144_CR5","unstructured":"(2020) LHCb Collaboration: RTA and DPA dataflow diagrams for Run 1, Run 2, and the upgraded LHCb detector. Technical Report LHCb-FIGURE-2020-016 . https:\/\/cds.cern.ch\/record\/2730181"},{"key":"144_CR6","unstructured":"Frank M (2022) Online RAW Data Format. https:\/\/edms.cern.ch\/ui\/file\/784588\/1\/Online_Raw_Data_Format.pdf, Geneva"},{"key":"144_CR7","doi-asserted-by":"publisher","unstructured":"Collet Y, Kucherawy M (2021) Zstandard Compression and the application\/zstd Media Type. RFC Editor . https:\/\/doi.org\/10.17487\/RFC8878 . https:\/\/www.rfc-editor.org\/info\/rfc8878","DOI":"10.17487\/RFC8878"},{"key":"144_CR8","doi-asserted-by":"publisher","unstructured":"Bird I ( 2011) Computing for the Large Hadron Collider. Annual Review of Nuclear and Particle Science 61, 99\u2013 118 https:\/\/doi.org\/10.1146\/annurev-nucl-102010-130059","DOI":"10.1146\/annurev-nucl-102010-130059"},{"key":"144_CR9","unstructured":"LHCb Collaboration: Moore application GitLab repository. https:\/\/gitlab.cern.ch\/lhcb\/Moore"},{"key":"144_CR10","unstructured":"LHCb Collaboration: DaVinci application GitLab repository. https:\/\/gitlab.cern.ch\/lhcb\/DaVinci\/"},{"key":"144_CR11","unstructured":"LHCb Collaboration: ThOr functors. https:\/\/lhcbdoc.web.cern.ch\/lhcbdoc\/moore\/master\/selection\/thor_functors.html"},{"key":"144_CR12","doi-asserted-by":"crossref","unstructured":"Aaij R et. al. (2016) Tesla : an application for real-time data analysis in High Energy Physics. Comput. Phys. Commun. 208 arXiv:1604.05596","DOI":"10.1016\/j.cpc.2016.07.022"},{"key":"144_CR13","unstructured":"Torvalds L, Hamano J (2010) Git Distributed Version Control System. http:\/\/git-scm.com. Accessed: 04-06-2024"},{"key":"144_CR14","unstructured":"GitLab Inc.: GitLab. https:\/\/about.gitlab.com. Accessed: 04-06-2024 (2011)"},{"key":"144_CR15","unstructured":"Grazette L, Hunter R, Noomen E, N, S, Stahl S, Vesterinen M, Zhang S (2025) A Comprehensive Bandwidth Testing Framework for the LHCb Upgrade Trigger System arXiv:2503.19582"},{"key":"144_CR16","unstructured":"LHCb collaboration: LHCb computing: Technical Design Report. Technical Report CERN-LHCC-2005-019, CERN, Geneva (2005)"},{"key":"144_CR17","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1016\/S0168-9002(97)00048-X","volume":"389","author":"R Brun","year":"1997","unstructured":"Brun R, Rademakers F (1997) ROOT - an object oriented data analysis framework. Nucl Instrum Meth A 389:81\u201386. https:\/\/doi.org\/10.1016\/S0168-9002(97)00048-X","journal-title":"Nucl Instrum Meth A"},{"key":"144_CR18","unstructured":"ROOT: JavaScript ROOT. https:\/\/github.com\/root-project\/jsroot"},{"key":"144_CR19","unstructured":"LHCb Collaboration: End of successful proton-proton collision data taking period. https:\/\/lhcb-outreach.web.cern.ch\/2024\/10\/18\/end-of-successful-proton-proton-collision-data-taking-period\/"},{"key":"144_CR20","unstructured":"Mathe Z (2012) Feicim: A browser and analysis tool for distributed data in particle physics. Technical Report CERN-THESIS-2012-156 http:\/\/cds.cern.ch\/record\/1491175"},{"key":"144_CR21","doi-asserted-by":"publisher","DOI":"10.5281\/ZENODO.11400398","author":"GA Stewart","year":"2024","unstructured":"Stewart GA, Mete AS (2024) prmon: process monitor. Zenodo. https:\/\/doi.org\/10.5281\/ZENODO.11400398","journal-title":"Zenodo"},{"key":"144_CR22","doi-asserted-by":"publisher","first-page":"08008","DOI":"10.1051\/epjconf\/202429508008","volume":"295","author":"C Burr","year":"2024","unstructured":"Burr C, Couturier B, ONeil R, (2024) Facilitating the preservation of LHCb Analyses with APD. EPJ Web of Conf 295:08008. https:\/\/doi.org\/10.1051\/epjconf\/202429508008","journal-title":"EPJ Web of Conf"},{"key":"144_CR23","unstructured":"Python community: Python Package Index PyPI. https:\/\/pypi.org\/"},{"key":"144_CR24","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.4774216","author":"Conda-forge community,","year":"2015","unstructured":"Conda-forge community, (2015) The conda-forge Project: community-based software distribution. Zenodo. https:\/\/doi.org\/10.5281\/zenodo.4774216","journal-title":"Zenodo"},{"issue":"19","key":"144_CR25","doi-asserted-by":"publisher","first-page":"2520","DOI":"10.1093\/bioinformatics\/bts480","volume":"28","author":"J K\u00f6ster","year":"2012","unstructured":"K\u00f6ster J, Rahmann S (2012) Snakemake\u2013a scalable bioinformatics workflow engine. Bioinformatics 28(19):2520\u20132522. https:\/\/doi.org\/10.1093\/bioinformatics\/bts480","journal-title":"Bioinformatics"},{"key":"144_CR26","unstructured":"LHCb Collaboration: LbCondaWrappers GitLab repository. https:\/\/gitlab.cern.ch\/lhcb-core\/lbcondawrappers"},{"issue":"4","key":"144_CR27","doi-asserted-by":"publisher","first-page":"042003","DOI":"10.1088\/1742-6596\/331\/4\/042003","volume":"331","author":"J Blomer","year":"2011","unstructured":"Blomer J, Sanchez CA, Buncic P, Charalampidis I, Berzano D (2011) CernVM File System. J Phys: Conf Ser 331(4):042003. https:\/\/doi.org\/10.1088\/1742-6596\/331\/4\/042003","journal-title":"J Phys: Conf Ser"},{"key":"144_CR28","doi-asserted-by":"crossref","unstructured":"Allen C, Dierks T (1999) The TLS Protocol Version 1.0. RFC 2246 . Online; Accessed 23-06-2025","DOI":"10.17487\/rfc2246"},{"issue":"5","key":"144_CR29","doi-asserted-by":"publisher","first-page":"052015","DOI":"10.1088\/1742-6596\/331\/5\/052015","volume":"331","author":"AJ Peters","year":"2011","unstructured":"Peters AJ, Janyst L (2011) Exabyte scale storage at cern. J Phys: Conf Ser 331(5):052015. https:\/\/doi.org\/10.1088\/1742-6596\/331\/5\/052015","journal-title":"J Phys: Conf Ser"},{"key":"144_CR30","doi-asserted-by":"crossref","unstructured":"Fielding R, Gettys J, Mogul J, Frystyk H, Masinter L, Berners-Lee T, Leach P (1999) Hypertext Transfer Protocol - HTTP\/1.1. RFC 2616, Internet Engineering Task Force (IETF). https:\/\/doi.org\/10.17487\/RFC2616","DOI":"10.17487\/rfc2616"},{"key":"144_CR31","unstructured":"XRootD: XRootD project. http:\/\/www.xrootd.org\/"},{"issue":"1","key":"144_CR32","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1016\/S0010-4655(01)00254-5","volume":"140","author":"G Barrand","year":"2001","unstructured":"Barrand G, Belyaev I, Binko P, Cattaneo M, Chytracek R, Corti G, Frank M, Gracia G, Harvey J, Herwijnen E, Maley P, Mato P, Probst S, Ranjard F (2001) Gaudi \u2013 a software architecture and framework for building hep data processing applications. Comput Phys Commun 140(1):45\u201355. https:\/\/doi.org\/10.1016\/S0010-4655(01)00254-5. (CHEP2000)","journal-title":"Comput Phys Commun"},{"issue":"1","key":"144_CR33","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1007\/s41781-024-00116-1","volume":"8","author":"A Mathad","year":"2024","unstructured":"Mathad A, Ferrillo M, Barr\u00e9 S, Koppenburg P, Owen P, Raven G, Rodrigues E, Serra N (2024) FunTuple: a new n-tuple component for offline data processing at the LHCb experiment. Comput Softw Big Sci 8(1):6. https:\/\/doi.org\/10.1007\/s41781-024-00116-1. arXiv:2310.02433 [physics.data-an]","journal-title":"Comput Softw Big Sci"},{"key":"144_CR34","doi-asserted-by":"publisher","first-page":"566","DOI":"10.1016\/j.nima.2005.06.078","volume":"A552","author":"WD Hulsbergen","year":"2005","unstructured":"Hulsbergen WD (2005) Decay chain fitting with a Kalman filter. Nucl Instrum Meth A552:566\u2013575. https:\/\/doi.org\/10.1016\/j.nima.2005.06.078","journal-title":"Nucl Instrum Meth"},{"key":"144_CR35","doi-asserted-by":"crossref","unstructured":"Prouve C, Nolte N, Hasse C (2024) Fast Inclusive Flavour Tagging at LHCb arXiv:2404.14145 [hep-ex]","DOI":"10.1051\/epjconf\/202429509018"},{"key":"144_CR36","doi-asserted-by":"publisher","first-page":"06020","DOI":"10.1051\/epjconf\/202429506020","volume":"295","author":"J Blomer","year":"2024","unstructured":"Blomer J et al (2024) ROOT\u2019s RNTuple I\/O Subsystem: The Path to Production. EPJ Web of Conf 295:06020. https:\/\/doi.org\/10.1051\/epjconf\/202429506020","journal-title":"EPJ Web of Conf"}],"container-title":["Computing and Software for Big Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41781-025-00144-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s41781-025-00144-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41781-025-00144-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,4]],"date-time":"2025-08-04T16:44:41Z","timestamp":1754325881000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s41781-025-00144-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,4]]},"references-count":36,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,12]]}},"alternative-id":["144"],"URL":"https:\/\/doi.org\/10.1007\/s41781-025-00144-5","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-6967234\/v1","asserted-by":"object"}]},"ISSN":["2510-2036","2510-2044"],"issn-type":[{"value":"2510-2036","type":"print"},{"value":"2510-2044","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,8,4]]},"assertion":[{"value":"24 June 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 July 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 August 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing Interests"}}],"article-number":"15"}}