{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,11]],"date-time":"2026-06-11T14:15:31Z","timestamp":1781187331005,"version":"3.54.1"},"reference-count":88,"publisher":"Association for Computing Machinery (ACM)","issue":"FSE","license":[{"start":{"date-parts":[[2024,7,12]],"date-time":"2024-07-12T00:00:00Z","timestamp":1720742400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Softw. Eng."],"published-print":{"date-parts":[[2024,7,12]]},"abstract":"<jats:p>Sharing research artifacts (e.g., software, data, protocols) is an immensely important topic for improving transparency, replicability, and reusability in research, and has recently gained more and more traction in software engineering. For instance, recent studies have focused on artifact reviewing, the impact of open science, and specific legal or ethical issues of sharing artifacts.Most of such studies are concerned with artifacts created by the researchers themselves (e.g., scripts, algorithms, tools) and processes for quality assuring these artifacts (e.g., through artifact-evaluation committees). In contrast, the practices and challenges of sharing software-evolution datasets (i.e., republished version-control data with person-related information) have only been scratched in such works. To tackle this gap, we conducted a meta study of software-evolution datasets published at the International Conference on Mining Software Repositories from 2017 until 2021 and snowballed a set of papers that build upon these datasets. Investigating 200 papers, we elicited what types of software-evolution datasets have been shared following what practices and what challenges researchers experienced with sharing or using the datasets. We discussed our findings with an authority on research-data management and ethics reviews through a semi-structured interview to put the practices and challenges into context. Through our meta study, we provide an overview of the sharing practices for software-evolution datasets and the corresponding challenges. The expert interview enriched this analysis by discussing how to solve the challenges and by defining recommendations for sharing software-evolution datasets in the future. Our results extend and complement current research, and we are confident that they can help researchers share software-evolution datasets (as well as datasets involving the same types of data) in a reliable, ethical, and trustworthy way.<\/jats:p>","DOI":"10.1145\/3660798","type":"journal-article","created":{"date-parts":[[2024,7,12]],"date-time":"2024-07-12T10:22:09Z","timestamp":1720779729000},"page":"2051-2074","source":"Crossref","is-referenced-by-count":5,"title":["Sharing Software-Evolution Datasets: Practices, Challenges, and Recommendations"],"prefix":"10.1145","volume":"1","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9580-740X","authenticated-orcid":false,"given":"David","family":"Broneske","sequence":"first","affiliation":[{"name":"German Centre for Higher Education Research and Science Studies, Hannover, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2990-5535","authenticated-orcid":false,"given":"Sebastian","family":"Kittan","sequence":"additional","affiliation":[{"name":"Otto-von-Guericke University Magdeburg, Magdeburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0283-248X","authenticated-orcid":false,"given":"Jacob","family":"Kr\u00fcger","sequence":"additional","affiliation":[{"name":"Eindhoven University of Technology, Eindhoven, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,7,12]]},"reference":[{"key":"e_1_3_1_2_1","volume-title":"MSR","author":"Ashraf Usman","year":"2020","unstructured":"Usman Ashraf, Christoph Mayr-Dorn, Alexander Egyed, and Sebastiano Panichella. 2020. A Mixed Graph-Relational Dataset of Socio-technical Interactions in Open Source Systems. In MSR. ACM."},{"key":"e_1_3_1_3_1","doi-asserted-by":"publisher","DOI":"10.1038\/533452a"},{"issue":"2","key":"e_1_3_1_4_1","article-title":"(Re)Use of Research Results (Is Rampant)","volume":"66","author":"Baldassarre Maria Teresa","year":"2023","unstructured":"Maria Teresa Baldassarre, Neil Ernst, Ben Hermann, Tim Menzies, and Sebastiano Yedida. 2023. (Re)Use of Research Results (Is Rampant). Communications of the ACM 66, 2 (2023).","journal-title":"Communications of the ACM"},{"issue":"6","key":"e_1_3_1_5_1","article-title":"Free and Open Source Software Licenses Explained","volume":"52","author":"Ballhausen Miriam","year":"2019","unstructured":"Miriam Ballhausen. 2019. Free and Open Source Software Licenses Explained. Computer 52, 6 (2019).","journal-title":"Computer"},{"key":"e_1_3_1_6_1","volume-title":"ESEM","author":"Baltes Sebastian","year":"2016","unstructured":"Sebastian Baltes and Stephan Diehl. 2016. Worse Than Spam: Issues In Sampling Software Developers. In ESEM. ACM."},{"key":"e_1_3_1_7_1","article-title":"SOTorrent: Studying the Origin, Evolution, and Usage of Stack Overflow Code Snippets","author":"Baltes Sebastian","year":"2019","unstructured":"Sebastian Baltes, Christoph Treude, and Sebastiano Diehl. 2019. SOTorrent: Studying the Origin, Evolution, and Usage of Stack Overflow Code Snippets. In MSR. IEEE.","journal-title":"MSR"},{"key":"e_1_3_1_8_1","volume-title":"MSR","author":"Beller Moritz","year":"2017","unstructured":"Moritz Beller, Georgios Gousios, and Sebastiano Zaidman. 2017. TravisTorrent: synthesizing Travis CI and GitHub for full-stack research on continuous integration. In MSR. IEEE Computer Society."},{"key":"e_1_3_1_9_1","volume-title":"MSR","author":"Bird Christian","year":"2009","unstructured":"Christian Bird, Peter C. Rigby, Earl T. Barr, David J. Hamilton, Daniel M. German, and Prem Devanbu Sebastiano Devanbu. 2009. The Promises and Perils of Mining Git. In MSR. IEEE."},{"key":"e_1_3_1_10_1","volume-title":"MSR","author":"Brandt Carolin E.","year":"2020","unstructured":"Carolin E. Brandt, Annibale Panichella, Andy Zaidman, and Sebastiano Beller. 2020. LogChunks: A Data Set for Build Log Analysis. In MSR. ACM."},{"key":"e_1_3_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2006.07.009"},{"key":"e_1_3_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3524842.3528032"},{"key":"e_1_3_1_13_1","article-title":"Artifact Evaluation: Is It a Real Incentive?","author":"Childers Bruce R.","year":"2017","unstructured":"Bruce R. Childers and Panos K. Chrysanthis. 2017. Artifact Evaluation: Is It a Real Incentive?. In 2017 IEEE 13th International Conference on e-Science (e-Science).","journal-title":"2017 IEEE 13th International Conference on e-Science (e-Science)"},{"key":"e_1_3_1_14_1","volume-title":"MSR","author":"Claes Ma\u00eblick","year":"2020","unstructured":"Ma\u00eblick Claes and Mika V. M\u00e4ntyl\u00e4. 2020. 20-MAD: 20 Years ofIssues and Commits of Mozilla and Apache Development. In MSR. ACM."},{"key":"e_1_3_1_15_1","volume-title":"MSR","author":"Cor\u00f2 Federico","year":"2020","unstructured":"Federico Cor\u00f2, Roberto Verdecchia, Emilio Cruciani, Breno Miranda, and Sebastiano Bertolino. 2020. JTeC: A Large Collection of Java Test Classes for Test Code Analysis and Processing. In MSR. ACM."},{"key":"e_1_3_1_16_1","article-title":"Sampling Projects in GitHub for MSR Studies","author":"Dabic Ozren","year":"2021","unstructured":"Ozren Dabic, Emad Aghajani, and Sebastiano Bavota. 2021. Sampling Projects in GitHub for MSR Studies. In MSR. IEEE, IEEE.","journal-title":"MSR"},{"key":"e_1_3_1_17_1","first-page":"285","article-title":"Quality Guidelines for Research Artifacts in Model-Driven Engineering","author":"Diego Carlos","year":"2021","unstructured":"Carlos Diego Nascimento Damasceno and Daniel Str\u00fcber. 2021. Quality Guidelines for Research Artifacts in Model-Driven Engineering. In 2021 ACM\/IEEE 24th International Conference on Model Driven Engineering Languages and Systems (MODELS). 285\u2013296.","journal-title":"2021 ACM\/IEEE 24th International Conference on Model Driven Engineering Languages and Systems (MODELS)."},{"key":"e_1_3_1_18_1","volume-title":"ASE","author":"Cosmo Roberto Di","year":"2018","unstructured":"Roberto Di Cosmo. 2018. Software Heritage: Collecting, Preserving, and Sharing All Our Source Code. In ASE. ACM."},{"key":"e_1_3_1_19_1","volume-title":"MSR","author":"Diamantopoulos Themistoklis","year":"2020","unstructured":"Themistoklis Diamantopoulos, Michail D. Papamichail, Thomas Karanikiotis, Kyriakos C. Chatzidimitriou, and Sebastiano L. Symeonidis. 2020. Employing Contribution and Quality Metrics for Quantifying the Software Development Process. In MSR. ACM."},{"key":"e_1_3_1_20_1","article-title":"Duets:A Dataset ofReproducible Pairs ofJava Library-Clients","author":"Durieux Thomas","year":"2021","unstructured":"Thomas Durieux, C\u00e9sar Soto-Valero, and Benoit Baudry. 2021. Duets:A Dataset ofReproducible Pairs ofJava Library-Clients. In MSR. IEEE, IEEE.","journal-title":"MSR"},{"key":"e_1_3_1_21_1","volume-title":"MSR","author":"Eskandani Nafise","year":"2021","unstructured":"Nafise Eskandani and Guido Salvaneschi. 2021. The Wonderless Dataset for Serverless Computing. In MSR. IEEE."},{"key":"e_1_3_1_22_1","volume-title":"MSR","author":"Fan Jiahao","year":"2020","unstructured":"Jiahao Fan, Yi Li, Shaohua Wang, and Sebastiano N. Nguyen. 2020. A C\/C++ Code Vulnerability Dataset with Code Changes and CVE Summaries. In MSR. ACM."},{"key":"e_1_3_1_23_1","article-title":"Research artifacts and citations in computer systems papers","volume":"8","author":"Frachtenberg Eitan","year":"2022","unstructured":"Eitan Frachtenberg. 2022. Research artifacts and citations in computer systems papers. PeerJ Computer Science 8 (2022).","journal-title":"PeerJ Computer Science"},{"key":"e_1_3_1_24_1","volume-title":"MSR","author":"Fry Tanner","year":"2020","unstructured":"Tanner Fry, Tapajit Dey, Andrey Karnauch, and Sebastiano Mockus. 2020. A Dataset and an Approach for Identity Resolution of 38 Million Author IDs extracted from 2B Git Commits. In MSR. ACM."},{"key":"e_1_3_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196398.3196460"},{"key":"e_1_3_1_26_1","volume-title":"MSR","author":"Gkortzis Antonios","year":"2018","unstructured":"Antonios Gkortzis, Dimitris Mitropoulos, and Sebastiano Spinellis. 2018. VulinOSS: a dataset of security vulnerabilities in open-source systems. In MSR. ACM."},{"key":"e_1_3_1_27_1","first-page":"265","volume-title":"MSR(MSR \u201920)","author":"Gold Nicolas E.","year":"2020","unstructured":"Nicolas E. Gold and Jens Krinke. 2020. Ethical Mining: A Case Study on MSR Mining Challenges. In MSR (Seoul, Republic of Korea) (MSR \u201920). Association for Computing Machinery, New York, NY, US, 265\u2013276."},{"issue":"1","key":"e_1_3_1_28_1","article-title":"Ethics in the mining of software repositories","volume":"27","author":"Gold Nicolas E","year":"2022","unstructured":"Nicolas E Gold and Jens Krinke. 2022. Ethics in the mining of software repositories. Empirical Software Engineering 27, 1 (2022).","journal-title":"Empirical Software Engineering"},{"key":"e_1_3_1_29_1","doi-asserted-by":"publisher","DOI":"10.5555\/2487085.2487132"},{"key":"e_1_3_1_30_1","article-title":"GH Torrent: Github\u2019s data from a firehose","author":"Gousios Georgios","year":"2012","unstructured":"Georgios Gousios and Diomidis Spinellis. 2012. GH Torrent: Github\u2019s data from a firehose. In MSR. IEEE Computer Society.","journal-title":"MSR"},{"key":"e_1_3_1_31_1","volume-title":"SANER","author":"Hayashi Shinpei","year":"2015","unstructured":"Shinpei Hayashi, Daiki Hoshino, Jumpei Matsuda, Motoshi Saeki, Takayuki Omori, and Sebastiano Maruyama. 2015. Historef: A tool for edit history refactoring. In SANER. IEEE."},{"key":"e_1_3_1_32_1","volume-title":"MSR","author":"Henkel Jordan","year":"2020","unstructured":"Jordan Henkel, Christian Bird, Shuvendu K. Lahiri, and Sebastiano W. Reps. 2020. A Dataset of Dockerfiles. In MSR. ACM."},{"issue":"5","key":"e_1_3_1_33_1","article-title":"What Has Artifact Evaluation Ever Done for Us?","volume":"20","author":"Hermann Ben","year":"2022","unstructured":"Ben Hermann. 2022. What Has Artifact Evaluation Ever Done for Us? IEEE Security & Privacy 20, 5 (2022).","journal-title":"IEEE Security & Privacy"},{"key":"e_1_3_1_34_1","volume-title":"ESEC\/FSE","author":"Hermann Ben","year":"2020","unstructured":"Ben Hermann, Stefan Winter, and Sebastiano Siegmund. 2020. Community Expectations for Research Artifacts and Evaluation Processes. In ESEC\/FSE. ACM."},{"key":"e_1_3_1_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-020-09851-6"},{"key":"e_1_3_1_36_1","volume-title":"ESEM","author":"Jalali Samireh","year":"2012","unstructured":"Samireh Jalali and Claes Wohlin. 2012. Systematic Literature Studies: Database Searches vs. Backward Snowballing. In ESEM. ACM."},{"key":"e_1_3_1_37_1","volume-title":"MSR","author":"Kalliamvakou Eirini","year":"2014","unstructured":"Eirini Kalliamvakou, Georgios Gousios, Kelly Blincoe, Leif Singer, Daniel M. German, and Sebastiano Damian. 2014. The Promises and Perils of Mining GitHub. In MSR. ACM."},{"issue":"5","key":"e_1_3_1_38_1","article-title":"An In-Depth Study of the Promises and Perils of Mining GitHub","volume":"21","author":"Kalliamvakou Eirini","year":"2016","unstructured":"Eirini Kalliamvakou, Georgios Gousios, Kelly Blincoe, Leif Singer, Daniel M. German, and Sebastiano Damian. 2016. An In-Depth Study of the Promises and Perils of Mining GitHub. Empirical Software Engineering 21, 5 (2016).","journal-title":"Empirical Software Engineering"},{"key":"e_1_3_1_39_1","volume-title":"MSR","author":"Karampatsis Rafael-Michael","year":"2020","unstructured":"Rafael-Michael Karampatsis and Charles Sutton. 2020. How Often Do Single-Statement Bugs Occur?: The ManySStuBs4J Dataset. In MSR. ACM."},{"key":"e_1_3_1_40_1","article-title":"Denchmark: A Bug Benchmark of Deep Learning-related Software","author":"Kim Misoo","year":"2021","unstructured":"Misoo Kim, Youngkyoung Kim, and Sebastiano Lee. 2021. Denchmark: A Bug Benchmark of Deep Learning-related Software. In MSR. IEEE, IEEE.","journal-title":"MSR"},{"key":"e_1_3_1_41_1","doi-asserted-by":"crossref","unstructured":"Barbara A. Kitchenham David Budgen and O. Pearl Brereton. 2015. Evidence-Based Software Engineering and Systematic Reviews. CRC Press.","DOI":"10.1201\/b19467"},{"key":"e_1_3_1_42_1","volume-title":"Guidelines for Performing Systematic Literature Reviews in Software Engineering","author":"Kitchenham Barbara A.","year":"2007","unstructured":"Barbara A. Kitchenham and Stuart Charters. 2007. Guidelines for Performing Systematic Literature Reviews in Software Engineering. Technical Report EBSE-2007-01. Keele University."},{"issue":"5","key":"e_1_3_1_43_1","article-title":"Standing on shoulders or feet? An extended study on the usage of the MSR data papers","volume":"25","author":"Kotti Zoe","year":"2020","unstructured":"Zoe Kotti, Konstantinos Kravvaritis, Konstantina Dritsa, and Sebastiano Spinellis. 2020. Standing on shoulders or feet? An extended study on the usage of the MSR data papers. Empirical Software Engineering 25, 5 (2020).","journal-title":"Empirical Software Engineering"},{"key":"e_1_3_1_44_1","volume-title":"MSR","author":"Kotti Zoe","year":"2019","unstructured":"Zoe Kotti and Diomidis Spinellis. 2019. Standing on shoulders or feet? The usage of the MSR data papers. In MSR. IEEE."},{"issue":"3","key":"e_1_3_1_45_1","article-title":"Artifact Evaluation for Software Conferences","volume":"38","author":"Krishnamurthi Shriram","year":"2013","unstructured":"Shriram Krishnamurthi. 2013. Artifact Evaluation for Software Conferences. SIGSOFT Softw. Eng. Notes 38, 3 (may 2013).","journal-title":"SIGSOFT Softw. Eng. Notes"},{"issue":"3","key":"e_1_3_1_46_1","article-title":"The Real Software Crisis: Repeatability as a Core Value","volume":"58","author":"Krishnamurthi Shriram","year":"2015","unstructured":"Shriram Krishnamurthi and Jan Vitek. 2015. The Real Software Crisis: Repeatability as a Core Value. Commun. ACM 58, 3 (feb 2015).","journal-title":"Commun. ACM"},{"issue":"1","key":"e_1_3_1_47_1","article-title":"Search. Review. Repeat? An Empirical Study of Threats to Replicating SLR Searches","volume":"25","author":"Kr\u00fcger Jacob","year":"2020","unstructured":"Jacob Kr\u00fcger, Christian Lausberger, Ivonne von Nostitz-Wallwitz, Gunter Saake, and Sebastiano Leich. 2020. Search. Review. Repeat? An Empirical Study of Threats to Replicating SLR Searches. Empirical Software Engineering 25, 1 (2020).","journal-title":"Empirical Software Engineering"},{"key":"e_1_3_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3379597.3387503"},{"key":"e_1_3_1_49_1","volume-title":"MSR","author":"Ma Yuxing","year":"2019","unstructured":"Yuxing Ma, Chris Bogart, Sadika Amreen, Russell Zaretzki, and Sebastiano Mockus. 2019. World of code: an infrastructure for mining the universe of open source VCS data. In MSR. IEEE \/ ACM."},{"key":"e_1_3_1_50_1","volume-title":"MSR","author":"Markovtsev Vadim","year":"2018","unstructured":"Vadim Markovtsev and Waren Long. 2018. Public git archive: a big code dataset for all. In MSR. ACM."},{"key":"e_1_3_1_51_1","volume-title":"MSR","author":"Martins Pedro","year":"2018","unstructured":"Pedro Martins, Rohan Achar, and Sebastiano V. Lopes. 2018. 50K-C: a dataset of compilable, and compiled, Java projects. In MSR. ACM."},{"key":"e_1_3_1_52_1","volume-title":"Contemporary Empirical Methods in Software Engineering","author":"Mendez Daniel","year":"2020","unstructured":"Daniel Mendez, Daniel Graziotin, Stefan Wagner, and Sebastiano Seibold. 2020. Open Science in Software Engineering. In Contemporary Empirical Methods in Software Engineering. Springer."},{"key":"e_1_3_1_53_1","article-title":"The open science initiative of the Empirical Software Engineering journal","volume":"24","author":"Fern\u00e1ndez Daniel M\u00e9ndez","year":"2019","unstructured":"Daniel M\u00e9ndez Fern\u00e1ndez, Martin Monperrus, Robert Feldt, and Sebastiano Zimmermann. 2019. The open science initiative of the Empirical Software Engineering journal. Empirical Software Engineering 24 (2019).","journal-title":"Empirical Software Engineering"},{"key":"e_1_3_1_54_1","volume-title":"MSR","author":"Mir Amir M.","year":"2021","unstructured":"Amir M. Mir, Evaldas Latoskinas, and Sebastiano Gousios. 2021. ManyTypes4Py: A Benchmark Python Dataset for Machine Learning-based Type Inference. In MSR. IEEE."},{"key":"e_1_3_1_55_1","volume-title":"MSR","author":"Mockus Audris","year":"2020","unstructured":"Audris Mockus, Diomidis Spinellis, Zoe Kotti, and Gabriel John Dusing. 2020. A Complete Set of Related Git Repositories Identified via Community Detection Approaches Based on Shared Commits. In MSR. ACM."},{"key":"e_1_3_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSR52588.2021.00069"},{"key":"e_1_3_1_57_1","volume-title":"MSR","author":"Noten Jeroen","year":"2017","unstructured":"Jeroen Noten, Josh Mengerink, and Sebastiano Serebrenik. 2017. A data set of OCL expressions on GitHub. In MSR. IEEE Computer Society."},{"key":"e_1_3_1_58_1","volume-title":"MSR","author":"Opdebeeck Ruben","year":"2021","unstructured":"Ruben Opdebeeck, Ahmed Zerouali, and Coen De Roover. 2021. Andromeda: A Dataset of Ansible Galaxy Roles and Their Evolution. In MSR. IEEE."},{"key":"e_1_3_1_59_1","volume-title":"MSR","author":"Paix\u00e3o Matheus","year":"2018","unstructured":"Matheus Paix\u00e3o, Jens Krinke, DongGyun Han, and Sebastiano Harman. 2018. CROP: linking code reviews to source code changes. In MSR. ACM."},{"key":"e_1_3_1_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSR.2019.00030"},{"key":"e_1_3_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3379597.3387510"},{"key":"e_1_3_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3379597.3387510"},{"key":"e_1_3_1_63_1","doi-asserted-by":"crossref","DOI":"10.1145\/3196398.3196400","article-title":"Enriched Event Streams: A General Dataset for Empirical Studies on In-IDE Activities of Software Developers","author":"Proksch Sebastian","year":"2018","unstructured":"Sebastian Proksch, Sven Amann, and Sebastiano Nadi. 2018. Enriched Event Streams: A General Dataset for Empirical Studies on In-IDE Activities of Software Developers. In MSR.","journal-title":"MSR"},{"key":"e_1_3_1_64_1","volume-title":"Towards Engineering Free\/Libre Open Source Software (FLOSS) Ecosystems for Impact and Sustainability","author":"Riehle Dirk","year":"2019","unstructured":"Dirk Riehle and Nikolay Harutyunyan. 2019. Open-Source License Compliance in Software Supply Chains. In Towards Engineering Free\/Libre Open Source Software (FLOSS) Ecosystems for Impact and Sustainability. Springer."},{"key":"e_1_3_1_65_1","volume-title":"MSR","author":"Robles Gregorio","year":"2017","unstructured":"Gregorio Robles, Truong Ho-Quang, Regina Hebig, Michel R. V. Chaudron, and Miguel Angel Fern\u00e1ndez. 2017. An extensive dataset of UML models in GitHub. In MSR. IEEE Computer Society."},{"key":"e_1_3_1_66_1","volume-title":"MSR","author":"Saha Ripon K.","year":"2018","unstructured":"Ripon K. Saha, Yingjun Lyu, Wing Lam, Hiroaki Yoshida, and Sebastiano R. Prasad. 2018. Bugs.jar: a large-scale, diverse dataset of real-world Java bugs. In MSR. ACM."},{"issue":"1","key":"e_1_3_1_67_1","article-title":"Thoughts and Recommendations from the ACM SIGCOMM 2017 Reproducibility Workshop","volume":"48","author":"Saucez Damien","year":"2018","unstructured":"Damien Saucez and Luigi Iannone. 2018. Thoughts and Recommendations from the ACM SIGCOMM 2017 Reproducibility Workshop. SIGCOMM Comput. Commun. Rev. 48, 1 (apr 2018).","journal-title":"SIGCOMM Comput. Commun. Rev."},{"issue":"2","key":"e_1_3_1_68_1","article-title":"Evaluating the Artifacts of SIGCOMM Papers","volume":"49","author":"Saucez Damien","year":"2019","unstructured":"Damien Saucez, Luigi Iannone, and Sebastiano Bonaventure. 2019. Evaluating the Artifacts of SIGCOMM Papers. SIGCOMM Comput. Commun. Rev. 49, 2 (may 2019).","journal-title":"SIGCOMM Comput. Commun. Rev."},{"key":"e_1_3_1_69_1","volume-title":"MSR","author":"Schermann Gerald","year":"2018","unstructured":"Gerald Schermann, Sali Zumberi, and J\u00fcrgen Cito. 2018. Structured information on state and evolution of dockerfiles on github. In MSR. ACM."},{"issue":"9","key":"e_1_3_1_70_1","article-title":"Science Without Publication Paywalls: cOAlition S for the Realisation of Full and Immediate Open Access","volume":"15","author":"Schiltz Marc","year":"2018","unstructured":"Marc Schiltz. 2018. Science Without Publication Paywalls: cOAlition S for the Realisation of Full and Immediate Open Access. PLOS Medicine 15, 9 (09 2018).","journal-title":"PLOS Medicine"},{"key":"e_1_3_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/3194747.3194748"},{"key":"e_1_3_1_72_1","volume-title":"MSR","author":"Sharma Tushar","year":"2021","unstructured":"Tushar Sharma and Marouane Kessentini. 2021. QScored: A Large Dataset of Code Smells and Quality Metrics. In MSR. IEEE."},{"key":"e_1_3_1_73_1","volume-title":"MSR","author":"Spinellis Diomidis","year":"2020","unstructured":"Diomidis Spinellis, Zoe Kotti, Konstantinos Kravvaritis, Georgios Theodorou, and Sebastiano Louridas. 2020b. A Dataset of Enterprise-Driven Open Source Software. In MSR. ACM."},{"key":"e_1_3_1_74_1","volume-title":"MSR","author":"Spinellis Diomidis","year":"2020","unstructured":"Diomidis Spinellis, Zoe Kotti, and Sebastiano Mockus. 2020a. A Dataset for GitHub Repository Deduplication. In MSR. ACM."},{"issue":"67","key":"e_1_3_1_75_1","article-title":"Understanding and Improving Artifact Sharing in Software Engineering Research","volume":"26","author":"Timperley Christopher S.","year":"2021","unstructured":"Christopher S. Timperley, Lauren Herckis, Claire Le Goues, and Sebastiano Hilton. 2021. Understanding and Improving Artifact Sharing in Software Engineering Research. Empirical Software Engineering 26, 67 (2021).","journal-title":"Empirical Software Engineering"},{"key":"e_1_3_1_76_1","volume-title":"MSR","author":"Tiwari Nitin M.","year":"2017","unstructured":"Nitin M. Tiwari, Ganesha Upadhyaya, Hoan A. Nguyen, and Sebastiano Rajan. 2017. Candoia: A Platform for Building and Sharing Mining Software Repositories Tools as Apps. In MSR. IEEE."},{"key":"e_1_3_1_77_1","article-title":"The smartshark ecosystem for software repository mining","author":"Trautsch Alexander","year":"2020","unstructured":"Alexander Trautsch, Fabian Trautsch, Steffen Herbold, Benjamin Ledel, and Sebastiano Grabowski. 2020. The smartshark ecosystem for software repository mining. In Proceedings of the ACM\/IEEE 42nd International Conference on Software Engineering: Companion Proceedings.","journal-title":"Proceedings of the ACM\/IEEE 42nd International Conference on Software Engineering: Companion Proceedings"},{"key":"e_1_3_1_78_1","volume-title":"MSR","author":"Vagavolu Dheeraj","year":"2021","unstructured":"Dheeraj Vagavolu, Vartika Agrahari, Sridhar Chimalakonda, and Akhila Sri Manasa Venigalla. 2021. GE526: A Dataset of Open-Source Game Engines. In MSR. IEEE."},{"key":"e_1_3_1_79_1","volume-title":"MSR","author":"Wendland Tyler","year":"2021","unstructured":"Tyler Wendland, Jingyang Sun, Junayed Mahmud, S. M. Hasan Mansur, Steven Huang, Kevin Moran, Julia Rubin, and Sebastiano Fazzini. 2021. Andror2: A Dataset of Manually-Reproduced Bug Reports for Android apps. In MSR. IEEE."},{"issue":"1","key":"e_1_3_1_80_1","article-title":"The FAIR Guiding Principles for Sientific Data Management and Stewardship","volume":"3","author":"Wilkinson Mark D.","year":"2016","unstructured":"Mark D. Wilkinson, Michel Dumontier, IJsbrand Jan Aalbersberg, Gabrielle Appleton, Myles Axton, Arie Baak, Niklas Blomberg, Jan-Willem Boiten, Luiz Bonino da Silva Santos, Philip E. Bourne, Jildau Bouwman, Anthony J. Brookes, Tim Clark, Merc\u00e8 Crosas, Ingrid Dillo, Olivier Dumon, Scott Edmunds, Chris T. Evelo, Richard Finkers, Alejandra Gonzalez-Beltran, Alasdair J. G. Gray, Paul Groth, Carole Goble, Jeffrey S. Grethe, Jaap Heringa, Peter A. C. \u2019t Hoen, Rob Hooft, Tobias Kuhn, Ruben Kok, Joost Kok, Scott J. Lusher, Maryann E. Martone, Albert Mons, Abel L. Packer, Bengt Persson, Philippe Rocca-Serra, Marco Roos, Rene van Schaik, Susanna-Assunta Sansone, Erik Schultes, Thierry Sengstag, Ted Slater, George Strawn, Morris A. Swertz, Mark Thompson, Johan van der Lei, Erik van Mulligen, Jan Velterop, Andra Waagmeester, Peter Wittenburg, Katherine Wolstencroft, Jun Zhao, and Sebastiano Mons. 2016. The FAIR Guiding Principles for Sientific Data Management and Stewardship. Scientific Data 3, 1 (2016).","journal-title":"Scientific Data"},{"key":"e_1_3_1_81_1","volume-title":"ESEC\/FSE (Singapore, Singapore) (ESEC\/FSE 2022)","author":"Winter Stefan","year":"2022","unstructured":"Stefan Winter, Christopher S. Timperley, Ben Hermann, J\u00fcrgen Cito, Jonathan Bell, Michael Hilton, and Sebastiano Beyer. 2022. A Retrospective Study of One Decade of Artifact Evaluations. In ESEC\/FSE (Singapore, Singapore) (ESEC\/FSE 2022). ACM, New York, NY, USA."},{"key":"e_1_3_1_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601248.2601268"},{"key":"e_1_3_1_83_1","volume-title":"MSR","author":"Xu Yulin","year":"2018","unstructured":"Yulin Xu and Minghui Zhou. 2018. A multi-level dataset of linux kernel patchwork. In MSR. ACM."},{"key":"e_1_3_1_84_1","volume-title":"MSR","author":"Yamashita Aiko","year":"2017","unstructured":"Aiko Yamashita, S. Amirhossein Abtahizadeh, Foutse Khomh, and Yann-Gael Gu\u00e9h\u00e9neuc. 2017. Software evolution and quality data from controlled, multiple, industrial case studies. In MSR. IEEE Computer Society."},{"key":"e_1_3_1_85_1","volume-title":"MSR","author":"Yu Yue","year":"2018","unstructured":"Yue Yu, Zhixing Li, Gang Yin, Tao Wang, and Sebastiano Wang. 2018. A dataset of duplicate pull-requests in github. In MSR. ACM."},{"key":"e_1_3_1_86_1","volume-title":"MSR","author":"Zhang Xunhui","year":"2020","unstructured":"Xunhui Zhang, Ayushi Rastogi, and Sebastiano Yu. 2020. On the Shoulders of Giants: A New Dataset for Pull-based Development Research. In MSR. ACM."},{"key":"e_1_3_1_87_1","volume-title":"MSR","author":"Zhu Chenguang","year":"2017","unstructured":"Chenguang Zhu, Yi Li, Julia Rubin, and Sebastiano Chechik. 2017. A dataset for dynamic discovery ofsemantic changes in version controlled software histories. In MSR. IEEE Computer Society."},{"issue":"2","key":"e_1_3_1_88_1","article-title":"Thoughts about Artifact Badging","volume":"50","author":"Zilberman Noa","year":"2020","unstructured":"Noa Zilberman and Andrew W. Moore. 2020. Thoughts about Artifact Badging. SIGCOMM Comput. Commun. Rev. 50, 2 (may 2020).","journal-title":"SIGCOMM Comput. Commun. Rev."},{"key":"e_1_3_1_89_1","volume-title":"Perspectives on Data Science for Software Engineering","author":"Zimmermann Thomas","year":"2016","unstructured":"Thomas Zimmermann. 2016. Card-Sorting: From Text to Themes. In Perspectives on Data Science for Software Engineering. Elsevier."}],"container-title":["Proceedings of the ACM on Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3660798","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3660798","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,4]],"date-time":"2026-02-04T07:54:52Z","timestamp":1770191692000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3660798"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,12]]},"references-count":88,"journal-issue":{"issue":"FSE","published-print":{"date-parts":[[2024,7,12]]}},"alternative-id":["10.1145\/3660798"],"URL":"https:\/\/doi.org\/10.1145\/3660798","relation":{},"ISSN":["2994-970X"],"issn-type":[{"value":"2994-970X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,12]]}}}