{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,20]],"date-time":"2025-12-20T11:44:16Z","timestamp":1766231056322,"version":"3.48.0"},"publisher-location":"New York, NY, USA","reference-count":44,"publisher":"ACM","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,9,8]]},"DOI":"10.1145\/3750720.3757295","type":"proceedings-article","created":{"date-parts":[[2025,12,20]],"date-time":"2025-12-20T11:42:38Z","timestamp":1766230958000},"page":"167-174","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Provenance Tracking in Large-Scale Machine Learning Systems"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-3711-7643","authenticated-orcid":false,"given":"Gabriele","family":"Padovani","sequence":"first","affiliation":[{"name":"DISI, University of Trento, Trento, Trentino, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9356-1311","authenticated-orcid":false,"given":"Valentine","family":"Anantharaj","sequence":"additional","affiliation":[{"name":"Oak Ridge National Laboratory, Oak Ridge, Tennessee, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8430-6087","authenticated-orcid":false,"given":"Sandro","family":"Fiore","sequence":"additional","affiliation":[{"name":"DISI, University of Trento, Trento, Trentino, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,12,20]]},"reference":[{"key":"e_1_3_3_2_2_2","unstructured":"[n. d.]. Zarr Developers. https:\/\/zarr.readthedocs https:\/\/zarr.dev\/."},{"key":"e_1_3_3_2_3_2","unstructured":"Dosovitskiy Alexey. 2020. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/ 2010.11929 (2020)."},{"key":"e_1_3_3_2_4_2","unstructured":"Khalid Belhajjame Reza B\u2019Far James Cheney Sam Coppens Stephen Cresswell Yolanda Gil Paul Groth Graham Klyne Timothy Lebo Jim McCusker et\u00a0al. 2013. Prov-dm: The prov data model. W3C Recommendation 14 (2013) 15\u201316."},{"key":"e_1_3_3_2_5_2","unstructured":"Lukas Biewald. 2020. Experiment Tracking with Weights and Biases. https:\/\/www.wandb.com\/ Software available from wandb.com."},{"key":"e_1_3_3_2_6_2","unstructured":"Annalisa Bracco Julien Brajard Henk\u00a0A Dijkstra Pedram Hassanzadeh Christian Lessig and Claire Monteleoni. 2024. Machine learning for the physics of climate. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2408.09627 (2024)."},{"key":"e_1_3_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/1639950.1640064"},{"key":"e_1_3_3_2_8_2","unstructured":"Veronika Eyring William\u00a0D Collins Pierre Gentine Elizabeth\u00a0A Barnes Marcelo Barreiro Tom Beucler Marc Bocquet Christopher\u00a0S Bretherton Hannah\u00a0M Christensen Katherine Dagon et\u00a0al. 2024. Pushing the frontiers in climate modelling and analysis with machine learning. Nature Climate Change (2024) 1\u201313."},{"key":"e_1_3_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigData59044.2023.10386983"},{"key":"e_1_3_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01553"},{"key":"e_1_3_3_2_11_2","unstructured":"Jordan Hoffmann Sebastian Borgeaud Arthur Mensch Elena Buchatskaya Trevor Cai Eliza Rutherford Diego de Las\u00a0Casas Lisa\u00a0Anne Hendricks Johannes Welbl Aidan Clark Tom Hennigan Eric Noland Katie Millican George van\u00a0den Driessche Bogdan Damoc Aurelia Guy Simon Osindero Karen Simonyan Erich Elsen Jack\u00a0W. Rae Oriol Vinyals and Laurent Sifre. 2022. Training Compute-Optimal Large Language Models. arxiv:https:\/\/arXiv.org\/abs\/2203.15556\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2203.15556"},{"key":"e_1_3_3_2_12_2","unstructured":"Trung\u00a0Dong Huynh Michael\u00a0O Jewell Amir Sezavar\u00a0Keshavarz Danius\u00a0T Michaelides Huanjia Yang and Luc Moreau. 2013. The prov-json serialization. (2013)."},{"key":"e_1_3_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/CIC50333.2020.00030"},{"key":"e_1_3_3_2_14_2","doi-asserted-by":"publisher","unstructured":"Amruta Kale Tin Nguyen Jr. Harris Frederick\u00a0C. Chenhao Li Jiyin Zhang and Xiaogang Ma. 2023. Provenance documentation to enable explainable and trustworthy AI: A literature review. Data Intelligence 5 1 (03 2023) 139\u2013162. 10.1162\/dinta00119 arXiv:https:\/\/direct.mit.edu\/dint\/article-pdf\/5\/1\/139\/2074289\/dint_a_00119.pdf","DOI":"10.1162\/dinta00119"},{"key":"e_1_3_3_2_15_2","unstructured":"Jared Kaplan Sam McCandlish Tom Henighan Tom\u00a0B. Brown Benjamin Chess Rewon Child Scott Gray Alec Radford Jeffrey Wu and Dario Amodei. 2020. Scaling Laws for Neural Language Models. arxiv:https:\/\/arXiv.org\/abs\/2001.08361\u00a0[cs.LG] https:\/\/arxiv.org\/abs\/2001.08361"},{"key":"e_1_3_3_2_16_2","unstructured":"Sayash Kapoor and Arvind Narayanan. 2022. Leakage and the reproducibility crisis in ML-based science. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2207.07048 (2022)."},{"key":"e_1_3_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-41418-4_19"},{"key":"e_1_3_3_2_18_2","doi-asserted-by":"crossref","unstructured":"Simone Leo Michael\u00a0R Crusoe Laura Rodr\u00edguez-Navas Ra\u00fcl Sirvent Alexander Kanitz Paul De\u00a0Geest Rudolf Wittner Luca Pireddu Daniel Garijo Jos\u00e9\u00a0M Fern\u00e1ndez et\u00a0al. 2024. Recording provenance of workflow runs with RO-Crate. PLoS one 19 9 (2024) e0309210.","DOI":"10.1371\/journal.pone.0309210"},{"key":"e_1_3_3_2_19_2","unstructured":"Shen Li Yanli Zhao Rohan Varma Omkar Salpekar Pieter Noordhuis Teng Li Adam Paszke Jeff Smith Brian Vaughan Pritam Damania et\u00a0al. 2020. Pytorch distributed: Experiences on accelerating data parallel training. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2006.15704 (2020)."},{"key":"e_1_3_3_2_20_2","doi-asserted-by":"crossref","unstructured":"Weixin Liang Girmaw\u00a0Abebe Tadesse Daniel Ho Li Fei-Fei Matei Zaharia Ce Zhang and James Zou. 2022. Advances challenges and opportunities in creating data for trustworthy AI. Nature Machine Intelligence 4 8 (2022) 669\u2013677.","DOI":"10.1038\/s42256-022-00516-1"},{"key":"e_1_3_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01170"},{"key":"e_1_3_3_2_22_2","unstructured":"Nicola\u00a0Giuseppe Marchioro Yannis Velegrakis Valentine Anantharaj Ian Foster and Sandro\u00a0Luigi Fiore. 2025. Trustworthy Provenance for Big Data Science: a Modular Architecture Leveraging Blockchain in Federated Settings. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2505.24675 (2025)."},{"key":"e_1_3_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/2452376.2452478"},{"key":"e_1_3_3_2_24_2","unstructured":"Luc Moreau Paolo Missier James Cheney and Stian Soiland-Reyes. 2013. PROV-N: The provenance notation. (2013)."},{"key":"e_1_3_3_2_25_2","unstructured":"Niklas Muennighoff Alexander\u00a0M. Rush Boaz Barak Teven\u00a0Le Scao Aleksandra Piktus Nouamane Tazi Sampo Pyysalo Thomas Wolf and Colin Raffel. 2023. Scaling Data-Constrained Language Models. arxiv:https:\/\/arXiv.org\/abs\/2305.16264\u00a0[cs.CL] https:\/\/arxiv.org\/abs\/2305.16264"},{"key":"e_1_3_3_2_26_2","volume-title":"7th USENIX Workshop on the Theory and Practice of Provenance (TaPP 15)","author":"Niu Xing","year":"2015","unstructured":"Xing Niu, Boris Glavic, Dieter Gawlick, Zhen\u00a0Hua Liu, Vasudha Krishnaswamy, and Venkatesh Radhakrishnan. 2015. Interoperability for Provenance-aware Databases using { PROV} and { JSON}. In 7th USENIX Workshop on the Theory and Practice of Provenance (TaPP 15)."},{"key":"e_1_3_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/SCW63240.2024.00253"},{"key":"e_1_3_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/3448016.3452788"},{"key":"e_1_3_3_2_29_2","first-page":"20","volume-title":"International Provenance and Annotation Workshop","author":"Pina D\u00e9bora","year":"2020","unstructured":"D\u00e9bora Pina, Liliane Kunstmann, Daniel de Oliveira, Patrick Valduriez, and Marta Mattoso. 2020. Provenance supporting hyperparameter analysis in deep neural networks. In International Provenance and Annotation Workshop. Springer, 20\u201338."},{"key":"e_1_3_3_2_30_2","doi-asserted-by":"crossref","unstructured":"Steven Platnick Kerry\u00a0G Meyer Michael\u00a0D King Galina Wind Nandana Amarasinghe Benjamin Marchant G\u00a0Thomas Arnold Zhibo Zhang Paul\u00a0A Hubanks Robert\u00a0E Holz et\u00a0al. 2016. The MODIS cloud optical and microphysical products: Collection 6 updates and examples from Terra and Aqua. IEEE Transactions on Geoscience and Remote Sensing 55 1 (2016) 502\u2013525.","DOI":"10.1109\/TGRS.2016.2610522"},{"key":"e_1_3_3_2_31_2","unstructured":"Gustavo\u00a0Correa Publio Diego Esteves Agnieszka \u0141awrynowicz Pan\u010de Panov Larisa Soldatova Tommaso Soru Joaquin Vanschoren and Hamid Zafar. 2018. ML-schema: exposing the semantics of machine learning with schemas and ontologies. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/1807.05351 (2018)."},{"key":"e_1_3_3_2_32_2","unstructured":"Russ Rew Glenn Davis Steve Emmerson Harvey Davies and Ed Hartnett. 1993. NetCDF user\u2019s Guide."},{"key":"e_1_3_3_2_33_2","doi-asserted-by":"crossref","unstructured":"David Rolnick Priya\u00a0L Donti Lynn\u00a0H Kaack Kelly Kochanski Alexandre Lacoste Kris Sankaran Andrew\u00a0Slavin Ross Nikola Milojevic-Dupont Natasha Jaques Anna Waldman-Brown et\u00a0al. 2022. Tackling climate change with machine learning. ACM Computing Surveys (CSUR) 55 2 (2022) 1\u201396.","DOI":"10.1145\/3485128"},{"key":"e_1_3_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigData62323.2024.10825405"},{"key":"e_1_3_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3595360.3595859"},{"key":"e_1_3_3_2_36_2","doi-asserted-by":"crossref","unstructured":"Stian Soiland-Reyes Peter Sefton Merc\u00e8 Crosas Leyla\u00a0Jael Castro Frederik Coppens Jos\u00e9\u00a0M Fern\u00e1ndez Daniel Garijo Bj\u00f6rn Gr\u00fcning Marco La\u00a0Rosa Simone Leo et\u00a0al. 2022. Packaging research artefacts with RO-Crate. Data Science 5 2 (2022) 97\u2013138.","DOI":"10.3233\/DS-210053"},{"key":"e_1_3_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/WORKS49585.2019.00006"},{"key":"e_1_3_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/eScience.2019.00047"},{"key":"e_1_3_3_2_39_2","doi-asserted-by":"crossref","unstructured":"Renan Souza Leonardo\u00a0G Azevedo V\u00edtor Louren\u00e7o Elton Soares Raphael Thiago Rafael Brand\u00e3o Daniel Civitarese Emilio Vital\u00a0Brazil Marcio Moreno Patrick Valduriez et\u00a0al. 2022. Workflow provenance in the lifecycle of scientific machine learning. Concurrency and Computation: Practice and Experience 34 14 (2022) e6544.","DOI":"10.1002\/cpe.6544"},{"key":"e_1_3_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/e-Science62913.2024.10678731"},{"key":"e_1_3_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/e-Science58273.2023.10254822"},{"key":"e_1_3_3_2_42_2","doi-asserted-by":"crossref","unstructured":"Isuru Suriarachchi Quan Zhou and Beth Plale. 2015. Komadu: A capture and visualization system for scientific data provenance. Journal of Open Research Software 3 1 (2015) e4\u2013e4.","DOI":"10.5334\/jors.bq"},{"key":"e_1_3_3_2_43_2","unstructured":"Laura Waltersdorfer Fajar\u00a0J Ekaputra Tomasz Miksa and Marta Sabou. 2024. AuditMAI: Towards an infrastructure for continuous AI auditing. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2406.14243 (2024)."},{"key":"e_1_3_3_2_44_2","doi-asserted-by":"crossref","unstructured":"Junqi Yin Sajal Dash John Gounley Feiyi Wang and Georgia Tourassi. 2023. Evaluation of pre-training large language models on leadership-class supercomputers. The Journal of Supercomputing 79 18 (2023) 20747\u201320768.","DOI":"10.1007\/s11227-023-05479-7"},{"key":"e_1_3_3_2_45_2","unstructured":"Matei Zaharia Andrew Chen Aaron Davidson Ali Ghodsi Sue\u00a0Ann Hong Andy Konwinski Siddharth Murching Tomas Nykodym Paul Ogilvie Mani Parkhe et\u00a0al. 2018. Accelerating the machine learning lifecycle with MLflow. IEEE Data Eng. Bull. 41 4 (2018) 39\u201345."}],"event":{"name":"ICPP Workshops '25: The 54th International Conference on Parallel Processing Workshops","location":"San Diego CA USA","acronym":"ICPP Workshops '25"},"container-title":["Workshop Proceedings of the 54th International Conference on Parallel Processing"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3750720.3757295","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,20]],"date-time":"2025-12-20T11:43:41Z","timestamp":1766231021000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3750720.3757295"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,8]]},"references-count":44,"alternative-id":["10.1145\/3750720.3757295","10.1145\/3750720"],"URL":"https:\/\/doi.org\/10.1145\/3750720.3757295","relation":{},"subject":[],"published":{"date-parts":[[2025,9,8]]},"assertion":[{"value":"2025-12-20","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}