{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T08:50:21Z","timestamp":1780044621816,"version":"3.53.1"},"reference-count":131,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2019,6,18]],"date-time":"2019-06-18T00:00:00Z","timestamp":1560816000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100004347","name":"AT&T","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100004347","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100000185","name":"DARPA","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100000185","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Moore-Sloan Data Science Environment at NYU"},{"DOI":"10.13039\/501100003593","name":"Conselho Nacional de Desenvolvimento Cient\u00edfico e Tecnol\u00f3gico","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003593","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002322","name":"Coordena\u00e7\u00e3o de Aperfei\u00e7oamento de Pessoal de N\u00edvel Superior","doi-asserted-by":"publisher","award":["88881.131563\/2016-01"],"award-info":[{"award-number":["88881.131563\/2016-01"]}],"id":[{"id":"10.13039\/501100002322","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["CNS-1229185, CNS-1405927, and CCF-1533564"],"award-info":[{"award-number":["CNS-1229185, CNS-1405927, and CCF-1533564"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004586","name":"Funda\u00e7\u00e3o Carlos Chagas Filho de Amparo \u00e0 Pesquisa do Estado do Rio de Janeiro","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100004586","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2020,5,31]]},"abstract":"<jats:p>Scripts are widely used to design and run scientific experiments. Scripting languages are easy to learn and use, and they allow complex tasks to be specified and executed in fewer steps than with traditional programming languages. However, they also have important limitations for reproducibility and data management. As experiments are iteratively refined, it is challenging to reason about each experiment run (or trial), to keep track of the association between trials and experiment instances as well as the differences across trials, and to connect results to specific input data and parameters. Approaches have been proposed that address these limitations by collecting, managing, and analyzing the provenance of scripts. In this article, we survey the state of the art in provenance for scripts. We have identified the approaches by following an exhaustive protocol of forward and backward literature snowballing. Based on a detailed study, we propose a taxonomy and classify the approaches using this taxonomy.<\/jats:p>","DOI":"10.1145\/3311955","type":"journal-article","created":{"date-parts":[[2019,6,19]],"date-time":"2019-06-19T12:05:38Z","timestamp":1560945938000},"page":"1-38","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":38,"title":["A Survey on Collecting, Managing, and Analyzing Provenance from Scripts"],"prefix":"10.1145","volume":"52","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6680-7470","authenticated-orcid":false,"given":"Jo\u00e3o Felipe","family":"Pimentel","sequence":"first","affiliation":[{"name":"Universidade Federal Fluminense, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3915-7075","authenticated-orcid":false,"given":"Juliana","family":"Freire","sequence":"additional","affiliation":[{"name":"New York University, Brooklyn, New York, NY, United States of America"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5173-1247","authenticated-orcid":false,"given":"Leonardo","family":"Murta","sequence":"additional","affiliation":[{"name":"Universidade Federal Fluminense"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1184-8192","authenticated-orcid":false,"given":"Vanessa","family":"Braganholo","sequence":"additional","affiliation":[{"name":"Universidade Federal Fluminense"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,6,18]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Understanding Legacy Workflows through Runtime Trace Analysis. Master\u2019s thesis","author":"Acu\u00f1a Ruben"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1515\/jib-2015-277"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSC.2016.102"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/CLOUD.2015.25"},{"key":"e_1_2_1_5_1","first-page":"1","article-title":"RDFa in XHTML: Syntax and processing. W3C Prop","volume":"7","author":"Adida Ben","year":"2008","journal-title":"Recommend."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2010.5447741"},{"key":"e_1_2_1_7_1","volume-title":"Margo","author":"Angelino Elaine","year":"2011"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-17819-1_27"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1214\/09-AOAS291"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.14778\/1687553.1687612"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1137\/0909049"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-89965-5_24"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/11890850_18"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDEW.2006.75"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10619-009-7058-3"},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the TaPP. USENIX, 1--6.","author":"Chavan Amit","year":"2015"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/SERVICES.2013.32"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.datak.2010.03.005"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0960129511000211"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1561\/1900000006"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the TaPP. USENIX, 977-- 980","author":"Chirigati Fernando","year":"2013"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2593822.2593826"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1190\/1.1822162"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/1350745.1350762"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2457317.2457365"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-40593-3_24"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2012.41"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the HotSec","volume":"9","author":"Demsky Brian","year":"2009"},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the TaPP. USENIX, 1--7.","author":"Dey Saumen","year":"2015"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723872.2723880"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2009.15"},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the ICML. International Machine Learning Society, 1--4.","author":"Drummond Chris","year":"2009"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCISE.1999.743610"},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the eSoN. IEEE, 1--8.","author":"Eichinski Philip","year":"2016"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/336512.336576"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/DISCS.2014.12"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2008.79"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/11890850_2"},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the ESTC. NASA, 1--5.","author":"Frew James","year":"2004"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.5555\/882498.884550"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-17819-1_4"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.5555\/2032397.2032415"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.5555\/1350745.1350759"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-89965-5_21"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2011.04.067"},{"key":"e_1_2_1_46_1","volume-title":"Proceedings of the TaPP. USENIX Association, 26--33","author":"Gehani Ashish","year":"2016"},{"key":"e_1_2_1_47_1","volume-title":"SPADE: Support for provenance auditing in distributed environments. In Proceedings of the useR!","author":"Gehani Ashish","year":"2012"},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of the TaPP. USENIX, 1--8.","author":"Gehani Ashish","year":"2014"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/POLICY.2011.12"},{"key":"e_1_2_1_50_1","volume-title":"Dittrich","author":"Glavic Boris","year":"2007"},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the AutoML. International Machine Learning Society, 1--6.","author":"Greff Klaus","year":"2015"},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of the AHM","volume":"2005","author":"Groth Paul","year":"2005"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2001420.2001455"},{"key":"e_1_2_1_55_1","volume-title":"Engler","author":"Guo Philip J.","year":"2010"},{"key":"e_1_2_1_56_1","volume-title":"Engler","author":"Guo Philip J.","year":"2011"},{"key":"e_1_2_1_57_1","volume-title":"Guo and Margo Seltzer","author":"Philip","year":"2012"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1203354"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-16462-5_18"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/TGRS.2013.2247769"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/2452376.2452475"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.0020124"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.683"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/2372251.2372257"},{"key":"e_1_2_1_66_1","volume-title":"Proceedings of the IPAW","volume":"9672","author":"Jones Matthew B.","year":"2016"},{"key":"e_1_2_1_67_1","volume-title":"Proceedings of the VL\/HCC. IEEE, 321--322","author":"Kery Mary Beth","year":"2017"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025626"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1093\/comjnl\/27.2.97"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-40593-3_6"},{"key":"e_1_2_1_71_1","volume-title":"Silva","author":"Koop David","year":"2010"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/bts480"},{"key":"e_1_2_1_73_1","volume-title":"Python Scripting for Computational Science","author":"Langtangen Hans Petter","edition":"3"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-16462-5_36"},{"key":"e_1_2_1_75_1","volume-title":"Proceedings of the TaPP. USENIX, 1--4.","author":"Lerner Barbara","year":"2014"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.3390\/informatics5010012"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1109\/SCC.2010.18"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.datak.2013.08.008"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSC.2009.4"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10723-015-9329-8"},{"key":"e_1_2_1_81_1","first-page":"1","article-title":"Authenticity and integrity in the digital environment: An exploratory analysis of the central role of trust. Council Library Info","volume":"32","author":"Lynch Clifford","year":"2000","journal-title":"Res."},{"key":"e_1_2_1_82_1","volume-title":"Proceedings of the TaPP. USENIX, 1--6.","author":"Macko Peter","year":"2012"},{"key":"e_1_2_1_83_1","unstructured":"Anderson Marinho Marta Mattoso Claudia Werner Vanessa Braganholo and Leonardo Murta. 2011. Challenges in managing implicit and abstract provenance data: Experiences with ProvManager. In TaPP. USENIX Heraklion Crete Greece 1--6.  Anderson Marinho Marta Mattoso Claudia Werner Vanessa Braganholo and Leonardo Murta. 2011. Challenges in managing implicit and abstract provenance data: Experiences with ProvManager. In TaPP. USENIX Heraklion Crete Greece 1--6."},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2014.11.017"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1504\/IJBPIM.2010.033176"},{"key":"e_1_2_1_86_1","volume-title":"Proceedings of the TaPP. USENIX, 1--7.","author":"McPhillips Timothy","year":"2015"},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.2218\/ijdc.v10i1.370"},{"key":"e_1_2_1_88_1","first-page":"P184","article-title":"pypet: A Python toolkit for simulations and numerical experiments","volume":"16","author":"Meyer Robert","year":"2015","journal-title":"Neuroscience"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.3389\/fninf.2016.00038"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-40593-3_7"},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1145\/2000791.2000792"},{"key":"e_1_2_1_92_1","volume-title":"Proceedings of the TaPP. USENIX, 1--7.","author":"Missier Paolo","year":"2013"},{"key":"e_1_2_1_93_1","volume-title":"Proceedings of the TaPP. USENIX, 1--8.","author":"Moore Scott","year":"2013"},{"key":"e_1_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2010.07.005"},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.5555\/1350745.1350753"},{"key":"e_1_2_1_96_1","unstructured":"Luc Moreau and Paolo Missier. 2012. PROV-DM: The PROV Data Model. W3C Proposed Recommendation. Retrieved from http:\/\/www.w3.org\/TR\/prov-dm.  Luc Moreau and Paolo Missier. 2012. PROV-DM: The PROV Data Model. W3C Proposed Recommendation. Retrieved from http:\/\/www.w3.org\/TR\/prov-dm."},{"key":"e_1_2_1_97_1","volume-title":"Seltzer","author":"Muniswamy-Reddy Kiran-Kumar","year":"2006"},{"key":"e_1_2_1_98_1","volume-title":"Proceedings of the IPAW. Springer, 71--83","author":"Murta Leonardo","year":"2014"},{"key":"e_1_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.1109\/NBiS.2009.48"},{"key":"e_1_2_1_100_1","doi-asserted-by":"publisher","DOI":"10.1109\/eScience.2011.44"},{"key":"e_1_2_1_101_1","doi-asserted-by":"publisher","DOI":"10.1145\/3184900"},{"key":"e_1_2_1_102_1","doi-asserted-by":"publisher","DOI":"10.1109\/2.660187"},{"key":"e_1_2_1_103_1","doi-asserted-by":"publisher","DOI":"10.25080\/Majora-629e541a-006"},{"key":"e_1_2_1_104_1","doi-asserted-by":"publisher","DOI":"10.5555\/2227115.2227123"},{"key":"e_1_2_1_105_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-40593-3_13"},{"key":"e_1_2_1_106_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-40593-3_2"},{"key":"e_1_2_1_107_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-40593-3_21"},{"key":"e_1_2_1_108_1","first-page":"1841","article-title":"noWorkflow: A tool for collecting, analyzing, and managing provenance from Python scripts","volume":"10","author":"Pimentel Joao Felipe","year":"2017","journal-title":"Very Large Data Bases"},{"key":"e_1_2_1_109_1","volume-title":"Proceedings of the TaPP. USENIX, 1--6.","author":"Nicolaci Pimentel Jo\u00e3o Felipe","year":"2015"},{"key":"e_1_2_1_110_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-98379-0_7"},{"key":"e_1_2_1_111_1","doi-asserted-by":"publisher","DOI":"10.1016\/0743-1066(94)00039-9"},{"key":"e_1_2_1_112_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-34222-6_25"},{"key":"e_1_2_1_113_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00180-010-0218-0"},{"key":"e_1_2_1_114_1","volume-title":"Silles","author":"Runnalls Andrew R.","year":"2011"},{"key":"e_1_2_1_115_1","doi-asserted-by":"crossref","unstructured":"Helen Shen et al. 2014. Interactive notebooks: Sharing the code. Nature 515 7525 (2014) 151--152.  Helen Shen et al. 2014. Interactive notebooks: Sharing the code. Nature 515 7525 (2014) 151--152.","DOI":"10.1038\/515151a"},{"key":"e_1_2_1_116_1","unstructured":"Christopher Anthony Silles. 2014. Provenance-aware CXXR. Ph.D. Dissertation. University of Kent.  Christopher Anthony Silles. 2014. Provenance-aware CXXR. Ph.D. Dissertation. University of Kent."},{"key":"e_1_2_1_117_1","volume-title":"Runnalls","author":"Silles Chris A.","year":"2010"},{"key":"e_1_2_1_118_1","doi-asserted-by":"publisher","DOI":"10.1145\/1084805.1084812"},{"key":"e_1_2_1_119_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-31988-7_16"},{"key":"e_1_2_1_120_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-16462-5_12"},{"key":"e_1_2_1_121_1","first-page":"44","article-title":"An automated and reproducible workflow for running and analyzing neural simulations using Lancet and IPython Notebook","volume":"7","author":"Richard Stevens Jean-Luc","year":"2013","journal-title":"Front. Neuroinform."},{"key":"e_1_2_1_122_1","doi-asserted-by":"publisher","DOI":"10.1145\/320473.320476"},{"key":"e_1_2_1_123_1","first-page":"3","article-title":"Provenance in databases: Past, current, and future","volume":"30","author":"Tan Wang Chiew","year":"2007","journal-title":"IEEE Data Engineer. Bull."},{"key":"e_1_2_1_124_1","volume-title":"Proceedings of the TaPP. USENIX, 1--5.","author":"Tariq Dawood","year":"2012"},{"key":"e_1_2_1_126_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.scico.2003.04.003"},{"key":"e_1_2_1_127_1","doi-asserted-by":"publisher","DOI":"10.1109\/BigData.2015.7364047"},{"key":"e_1_2_1_128_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601248.2601268"},{"key":"e_1_2_1_129_1","volume-title":"Paul Fisher et al","author":"Wolstencroft Katherine","year":"2013"},{"key":"e_1_2_1_130_1","doi-asserted-by":"publisher","DOI":"10.1109\/QSIC.2013.50"},{"key":"e_1_2_1_131_1","doi-asserted-by":"publisher","DOI":"10.1145\/971695.582226"},{"key":"e_1_2_1_132_1","doi-asserted-by":"publisher","DOI":"10.1109\/SERVICES.2007.63"},{"key":"e_1_2_1_133_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-89965-5_5"},{"key":"e_1_2_1_134_1","doi-asserted-by":"publisher","DOI":"10.1007\/11890850_16"}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3311955","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3311955","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3311955","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:53:12Z","timestamp":1750204392000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3311955"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,6,18]]},"references-count":131,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,5,31]]}},"alternative-id":["10.1145\/3311955"],"URL":"https:\/\/doi.org\/10.1145\/3311955","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,6,18]]},"assertion":[{"value":"2017-09-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-02-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-06-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}