{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,8]],"date-time":"2026-07-08T20:12:53Z","timestamp":1783541573156,"version":"3.55.0"},"reference-count":6,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2016,1,29]],"date-time":"2016-01-29T00:00:00Z","timestamp":1454025600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGIR Forum"],"published-print":{"date-parts":[[2016,1,29]]},"abstract":"<jats:p>The SIGIR 2015 Workshop on Reproducibility, Inexplicability, and Generalizability of Results (RIGOR) took place on Thursday, August 13, 2015 in Santiago, Chile. The goal of the workshop was two fold. The first to provide a venue for the publication and presentation of negative results. The second was to provide a venue through which the authors of open source search engines could compare performance of indexing and searching on the same collections and on the same machines - encouraging the sharing of ideas and discoveries in a like-to-like environment. In total three papers were presented and seven systems participated.<\/jats:p>","DOI":"10.1145\/2888422.2888439","type":"journal-article","created":{"date-parts":[[2016,2,1]],"date-time":"2016-02-01T20:37:54Z","timestamp":1454359074000},"page":"107-116","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":39,"title":["Report on the SIGIR 2015 Workshop on Reproducibility, Inexplicability, and Generalizability of Results (RIGOR)"],"prefix":"10.1145","volume":"49","author":[{"given":"Jaime","family":"Arguello","sequence":"first","affiliation":[{"name":"University of North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matt","family":"Crane","sequence":"additional","affiliation":[{"name":"University of Otago"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fernando","family":"Diaz","sequence":"additional","affiliation":[{"name":"Microsoft Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jimmy","family":"Lin","sequence":"additional","affiliation":[{"name":"University of Waterloo"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew","family":"Trotman","sequence":"additional","affiliation":[{"name":"eBay Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2016,1,29]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1645953.1646031"},{"key":"e_1_2_1_2_1","first-page":"2015","author":"Di Buccio E.","year":"2015","unstructured":"E. Di Buccio , G.M. Di Nunzio , N. Ferro , D. Harman , M. Maistro , and G. Silvello . Unfolding off-the-shelf IR systems for reproducibility. In RIGOR 2015 , 2015 . E. Di Buccio, G.M. Di Nunzio, N. Ferro, D. Harman, M. Maistro, and G. Silvello. Unfolding off-the-shelf IR systems for reproducibility. In RIGOR 2015, 2015.","journal-title":"Unfolding off-the-shelf IR systems for reproducibility. In RIGOR"},{"key":"e_1_2_1_3_1","volume-title":"RIGOR 2015","author":"Carterette B.","year":"2015","unstructured":"B. Carterette and K. Sabhnani . Using simulation to analyze the potential for reproducibility . In RIGOR 2015 , 2015 . B. Carterette and K. Sabhnani. Using simulation to analyze the potential for reproducibility. In RIGOR 2015, 2015."},{"key":"e_1_2_1_4_1","first-page":"2015","author":"Lu X.","year":"2015","unstructured":"X. Lu , A. Moffat , and S. Culpepper . Observed volatility in effectiveness metrics. In RIGOR 2015 , 2015 . X. Lu, A. Moffat, and S. Culpepper. Observed volatility in effectiveness metrics. In RIGOR 2015, 2015.","journal-title":"Observed volatility in effectiveness metrics. In RIGOR"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2600428.2609460"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2682862.2682863"}],"container-title":["ACM SIGIR Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2888422.2888439","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2888422.2888439","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T19:05:25Z","timestamp":1750273525000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2888422.2888439"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,1,29]]},"references-count":6,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2016,1,29]]}},"alternative-id":["10.1145\/2888422.2888439"],"URL":"https:\/\/doi.org\/10.1145\/2888422.2888439","relation":{},"ISSN":["0163-5840"],"issn-type":[{"value":"0163-5840","type":"print"}],"subject":[],"published":{"date-parts":[[2016,1,29]]},"assertion":[{"value":"2016-01-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}