{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,10]],"date-time":"2026-01-10T02:54:06Z","timestamp":1768013646409,"version":"3.49.0"},"reference-count":3,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2011,9,15]],"date-time":"2011-09-15T00:00:00Z","timestamp":1316044800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGMOD Rec."],"published-print":{"date-parts":[[2011,9,15]]},"abstract":"<jats:p>SIGMOD has offered, since 2008, to verify the experiments published in the papers accepted at the conference. This year, we have been in charge of reproducing the experiments provided by the authors (repeatability), and exploring changes to experiment parameters (workability). In this paper, we assess the SIGMOD repeatability process in terms of participation, review process and results. While the participation is stable in terms of number of submissions, we find this year a sharp contrast between the high participation from Asian authors and the low participation from American authors. We also find that most experiments are distributed as Linux packages accompanied by instructions on how to setup and run the experiments. We are still far from the vision of executable papers.<\/jats:p>","DOI":"10.1145\/2034863.2034873","type":"journal-article","created":{"date-parts":[[2011,9,20]],"date-time":"2011-09-20T13:48:54Z","timestamp":1316526534000},"page":"45-48","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":21,"title":["Repeatability and workability evaluation of SIGMOD 2011"],"prefix":"10.1145","volume":"40","author":[{"given":"Philippe","family":"Bonnet","sequence":"first","affiliation":[{"name":"ITU, Denmark"}]},{"given":"Stefan","family":"Manegold","sequence":"additional","affiliation":[{"name":"CWI, Netherlands"}]},{"given":"Matias","family":"Bj\u00f8rling","sequence":"additional","affiliation":[{"name":"ITU, Denmark"}]},{"given":"Wei","family":"Cao","sequence":"additional","affiliation":[{"name":"Remnin University, China"}]},{"given":"Javier","family":"Gonzalez","sequence":"additional","affiliation":[{"name":"ITU, Denmark"}]},{"given":"Joel","family":"Granados","sequence":"additional","affiliation":[{"name":"ITU, Denmark"}]},{"given":"Nancy","family":"Hall","sequence":"additional","affiliation":[{"name":"University of Wisconsin, USA"}]},{"given":"Stratos","family":"Idreos","sequence":"additional","affiliation":[{"name":"CWI, Netherlands"}]},{"given":"Milena","family":"Ivanova","sequence":"additional","affiliation":[{"name":"CWI, Netherlands"}]},{"given":"Ryan","family":"Johnson","sequence":"additional","affiliation":[{"name":"University of Toronto, Canada"}]},{"given":"David","family":"Koop","sequence":"additional","affiliation":[{"name":"University of Utah, USA"}]},{"given":"Tim","family":"Kraska","sequence":"additional","affiliation":[{"name":"UC Berkeley, USA"}]},{"given":"Ren\u00e9","family":"M\u00fcller","sequence":"additional","affiliation":[{"name":"IBM Almaden, USA"}]},{"given":"Dan","family":"Olteanu","sequence":"additional","affiliation":[{"name":"Oxford University, UK"}]},{"given":"Paolo","family":"Papotti","sequence":"additional","affiliation":[{"name":"Universit\u00e0 Roma Tre, Italy"}]},{"given":"Christine","family":"Reilly","sequence":"additional","affiliation":[{"name":"University of Texas Pan Am, USA"}]},{"given":"Dimitris","family":"Tsirogiannis","sequence":"additional","affiliation":[{"name":"Microsoft, USA"}]},{"given":"Cong","family":"Yu","sequence":"additional","affiliation":[{"name":"Google, USA"}]},{"given":"Juliana","family":"Freire","sequence":"additional","affiliation":[{"name":"University of Utah, USA"}]},{"given":"Dennis","family":"Shasha","sequence":"additional","affiliation":[{"name":"New York University, USA"}]}],"member":"320","published-online":{"date-parts":[[2011,9,15]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2011.04.068"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1815933.1815944"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1374780.1374791"}],"container-title":["ACM SIGMOD Record"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2034863.2034873","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2034863.2034873","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T09:48:39Z","timestamp":1750240119000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2034863.2034873"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,9,15]]},"references-count":3,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2011,9,15]]}},"alternative-id":["10.1145\/2034863.2034873"],"URL":"https:\/\/doi.org\/10.1145\/2034863.2034873","relation":{},"ISSN":["0163-5808"],"issn-type":[{"value":"0163-5808","type":"print"}],"subject":[],"published":{"date-parts":[[2011,9,15]]},"assertion":[{"value":"2011-09-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}