{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:28:44Z","timestamp":1750307324007,"version":"3.41.0"},"reference-count":20,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2012,9,2]],"date-time":"2012-09-02T00:00:00Z","timestamp":1346544000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGSOFT Softw. Eng. Notes"],"published-print":{"date-parts":[[2012,9,7]]},"abstract":"<jats:p>As any empirical science, Software Engineering research should strive towards better research practices. Replication is regrettably not a priority for Software Engineering researchers and, moreover, not afforded by many published studies. Here we report our experience from our encounter with a recent paper in a agship Software Engineering conference. Our experience shows that current publication requirements do not guarantee replicability.<\/jats:p>","DOI":"10.1145\/2347696.2347706","type":"journal-article","created":{"date-parts":[[2012,9,11]],"date-time":"2012-09-11T22:21:06Z","timestamp":1347402066000},"page":"1-4","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["A note on rigour and replicability"],"prefix":"10.1145","volume":"37","author":[{"given":"Panos","family":"Louridas","sequence":"first","affiliation":[{"name":"Greek Research and Technology Network S.A. and Athens University of Economics and Business, Athens, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Georgios","family":"Gousios","sequence":"additional","affiliation":[{"name":"Technical University of Delft, Delft, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2012,9,2]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"10","article-title":"Replication's role in software engineering. In Forrest Shull, Janice Singer, and Dag I. K. Sj\u00f8berg, editors, Guide to Advanced Empirical Software Engineering, pages 365--379","author":"Brooks A.","year":"2008","journal-title":"Springer London"},{"volume-title":"Free Press","year":"1988","author":"Dreyfus H.L.","key":"e_1_2_1_2_1"},{"key":"e_1_2_1_3_1","unstructured":"Marius Eriksen. Effective Sscala. http:\/\/twitter.github.com\/effectivescala 2012.  Marius Eriksen. Effective Sscala. http:\/\/twitter.github.com\/effectivescala 2012."},{"key":"e_1_2_1_4_1","unstructured":"Myles Hollander and Douglas A. Wolfe. Nonparametric Statistical Methods. John Wiley & Sons Inc. 2nd edition 1999.  Myles Hollander and Douglas A. Wolfe. Nonparametric Statistical Methods. John Wiley & Sons Inc. 2nd edition 1999."},{"volume-title":"Addison-Wesley","year":"2012","author":"Horstmann Cay S.","key":"e_1_2_1_5_1"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature10836"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.334.6060.1225"},{"key":"e_1_2_1_8_1","unstructured":"Peter Norvig. Teach yourself programming in ten years. http:\/\/norvig.com\/21-days.html 2001.  Peter Norvig. Teach yourself programming in ten years. http:\/\/norvig.com\/21-days.html 2001."},{"key":"e_1_2_1_9_1","unstructured":"Martin Odersky. Scala levels: beginner to expert application programmer to library designer. http:\/\/www.scala-lang.org\/node\/8610 2011.  Martin Odersky. Scala levels: beginner to expert application programmer to library designer. http:\/\/www.scala-lang.org\/node\/8610 2011."},{"volume-title":"EPFL","year":"2011","author":"Odersky Martin","key":"e_1_2_1_10_1"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/2337223.2337238"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1213847"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.799939"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/776816.776925"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-008-9060-1"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2005.97"},{"key":"e_1_2_1_17_1","unstructured":"Bjarne Stroustrup. Posting to comp.lang.c++. http:\/\/www2.research.att.com\/~bs\/blast.html December 1994.  Bjarne Stroustrup. Posting to comp.lang.c++. http:\/\/www2.research.att.com\/~bs\/blast.html December 1994."},{"key":"e_1_2_1_18_1","unstructured":"Dean Wampler and Alex Payne. Programming Scala. O'Reilly 2009.  Dean Wampler and Alex Payne. Programming Scala. O'Reilly 2009."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/234867.234872"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1134285.1134333"}],"container-title":["ACM SIGSOFT Software Engineering Notes"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2347696.2347706","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2347696.2347706","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T11:05:58Z","timestamp":1750244758000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2347696.2347706"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,9,2]]},"references-count":20,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2012,9,7]]}},"alternative-id":["10.1145\/2347696.2347706"],"URL":"https:\/\/doi.org\/10.1145\/2347696.2347706","relation":{},"ISSN":["0163-5948"],"issn-type":[{"type":"print","value":"0163-5948"}],"subject":[],"published":{"date-parts":[[2012,9,2]]},"assertion":[{"value":"2012-09-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}