{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T15:31:20Z","timestamp":1761060680933,"version":"3.41.0"},"reference-count":13,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2018,9,30]],"date-time":"2018-09-30T00:00:00Z","timestamp":1538265600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Data and Information Quality"],"published-print":{"date-parts":[[2018,9,30]]},"DOI":"10.1145\/3268408","type":"journal-article","created":{"date-parts":[[2018,10,11]],"date-time":"2018-10-11T13:19:14Z","timestamp":1539263954000},"page":"1-4","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Introduction to the Special Issue on Reproducibility in Information Retrieval"],"prefix":"10.1145","volume":"10","author":[{"given":"Nicola","family":"Ferro","sequence":"first","affiliation":[{"name":"University of Padua, Padova, Italy"}]},{"given":"Norbert","family":"Fuhr","sequence":"additional","affiliation":[{"name":"University of Duisburg-Essen, Duisburg, Germany"}]},{"given":"Andreas","family":"Rauber","sequence":"additional","affiliation":[{"name":"Technical University of Wien, Vienna, Austria"}]}],"member":"320","published-online":{"date-parts":[[2018,10,11]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2888422.2888439"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1571941.1572081"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1645953.1646031"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3020206"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2964797.2964808"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274784.3274786"},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the 9th International Conference of the CLEF Association Experimental IR Meets Multilinguality, Multimodality, and Interaction (CLEF\u201918)","volume":"11018","author":"Ferro N.","unstructured":"N. Ferro , M. Maistro , T. Sakai , and I. Soboroff . 2018. Overview of CENTRE@CLEF 2018: A first tale in the systematic reproducibility realm . In Proceedings of the 9th International Conference of the CLEF Association Experimental IR Meets Multilinguality, Multimodality, and Interaction (CLEF\u201918) , P. Bellot, C. Trabelsi, J. Mothe, F. Murtagh, J.-Y. Nie, L. Soulier, E. SanJuan, L. Cappellato, and N. Ferro (Eds.). Lecture Notes in Computer Science , Vol. 11018 , Springer, Heidelberg, 239--246. N. Ferro, M. Maistro, T. Sakai, and I. Soboroff. 2018. Overview of CENTRE@CLEF 2018: A first tale in the systematic reproducibility realm. In Proceedings of the 9th International Conference of the CLEF Association Experimental IR Meets Multilinguality, Multimodality, and Interaction (CLEF\u201918), P. Bellot, C. Trabelsi, J. Mothe, F. Murtagh, J.-Y. Nie, L. Soulier, E. SanJuan, L. Cappellato, and N. Ferro (Eds.). Lecture Notes in Computer Science, Vol. 11018, Springer, Heidelberg, 239--246."},{"key":"e_1_2_1_8_1","unstructured":"J. Freire N. Fuhr and A. Rauber (Eds.). 2016. Report from Dagstuhl Seminar 16041: Reproducibility of Data-Oriented Experiments in e-Science. Schloss Dagstuhl--Leibniz-Zentrum f\u00fcr Informatik Germany.  J. Freire N. Fuhr and A. Rauber (Eds.). 2016. Report from Dagstuhl Seminar 16041: Reproducibility of Data-Oriented Experiments in e-Science. Schloss Dagstuhl--Leibniz-Zentrum f\u00fcr Informatik Germany."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3190580.3190586"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882782"},{"volume-title":"Proceedings of the 38th European Conference on IR Research: Advances in Information Retrieval (ECIR\u201916)","author":"Lin J.","key":"e_1_2_1_11_1","unstructured":"J. Lin , M. Crane , A. Trotman , J. Callan , I. Chattopadhyaya , J. Foley , G. Ingersoll , C. Macdonald , and S. Vigna . 2016. Toward reproducible baselines: The open-source IR reproducibility challenge . In Proceedings of the 38th European Conference on IR Research: Advances in Information Retrieval (ECIR\u201916) , N. Ferro, F. Crestani, M.-F. Moens, J. Mothe, F. Silvestri, G. M. Di Nunzio, C. Hauff, and G. Silvello (Eds.). Lecture Notes in Computer Science, Vol., 9626, Springer, Heidelberg, 357--368. J. Lin, M. Crane, A. Trotman, J. Callan, I. Chattopadhyaya, J. Foley, G. Ingersoll, C. Macdonald, and S. Vigna. 2016. Toward reproducible baselines: The open-source IR reproducibility challenge. In Proceedings of the 38th European Conference on IR Research: Advances in Information Retrieval (ECIR\u201916), N. Ferro, F. Crestani, M.-F. Moens, J. Mothe, F. Silvestri, G. M. Di Nunzio, C. Hauff, and G. Silvello (Eds.). Lecture Notes in Computer Science, Vol., 9626, Springer, Heidelberg, 357--368."},{"key":"e_1_2_1_12_1","volume-title":"A manifesto for reproducible science. Nat. Hum. Behav. 1 (Jan","author":"Munaf\u00f2 M. R.","year":"2017","unstructured":"M. R. Munaf\u00f2 , B. B. A. Nosek , D. V. M. Bishop , K. S. Button , C. D. Chambers , N. Percie du Sert , U. Simonsohn , E.-J. Wagenmakers , J. J. Ware , and J. P. A. Ioannidis . 2017. A manifesto for reproducible science. Nat. Hum. Behav. 1 (Jan . 2017 ), 0021:1--0021:9. M. R. Munaf\u00f2, B. B. A. Nosek, D. V. M. Bishop, K. S. Button, C. D. Chambers, N. Percie du Sert, U. Simonsohn, E.-J. Wagenmakers, J. J. Ware, and J. P. A. Ioannidis. 2017. A manifesto for reproducible science. Nat. Hum. Behav. 1 (Jan. 2017), 0021:1--0021:9."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2064227.2064247"}],"container-title":["Journal of Data and Information Quality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3268408","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3268408","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:07:18Z","timestamp":1750212438000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3268408"}},"subtitle":["Evaluation Campaigns, Collections, and Analyses"],"short-title":[],"issued":{"date-parts":[[2018,9,30]]},"references-count":13,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2018,9,30]]}},"alternative-id":["10.1145\/3268408"],"URL":"https:\/\/doi.org\/10.1145\/3268408","relation":{},"ISSN":["1936-1955","1936-1963"],"issn-type":[{"type":"print","value":"1936-1955"},{"type":"electronic","value":"1936-1963"}],"subject":[],"published":{"date-parts":[[2018,9,30]]},"assertion":[{"value":"2018-10-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}