{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T07:13:37Z","timestamp":1781334817967,"version":"3.54.1"},"reference-count":5,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2020,4,28]],"date-time":"2020-04-28T00:00:00Z","timestamp":1588032000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGSOFT Softw. Eng. Notes"],"published-print":{"date-parts":[[2020,4,28]]},"abstract":"<jats:p>Scholarly peer review is crucial to science: it not only determines what is published where, but also, indirectly, who is hired, funded and promoted. Yet, virtually every academic has peer review horror stories. Empirical evidence suggests that \"peer review is prejudiced, capricious, inefficient, ineffective, and generally unscientific\" [1]. An experiment at a major machine learning conference found that peer review was unreliable highlighted that the outcome of peer review can be very noisy [2, 3].<\/jats:p>\n          <jats:p>In May 2019, ACM SIGSOFT launched an initiative to improve the quality of research papers and peer reviews at software engineering venues. It has two main components: empirical standards and recommendations for improving review processes.<\/jats:p>","DOI":"10.1145\/3385678.3385681","type":"journal-article","created":{"date-parts":[[2020,5,4]],"date-time":"2020-05-04T19:28:36Z","timestamp":1588620516000},"page":"17-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["The ACM SIGSOFT Paper and Peer Review Quality Initiative"],"prefix":"10.1145","volume":"45","author":[{"given":"Paul","family":"Ralph","sequence":"first","affiliation":[{"name":"Dalhousie University, Halifax, NS, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Romain","family":"Robbes","sequence":"additional","affiliation":[{"name":"Free University of Bozen-Bolzano, Bolzano, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,5,3]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"crossref","unstructured":"P. Ralph. 2015. Practical Suggestions for Improving Scholarly Peer Review Quality and Reducing Cycle Times. Communications of the Association for Information Systems 38. DOI: https:\/\/doi.org\/10.17705\/1CAIS.03813  P. Ralph. 2015. Practical Suggestions for Improving Scholarly Peer Review Quality and Reducing Cycle Times. Communications of the Association for Information Systems 38. DOI: https:\/\/doi.org\/10.17705\/1CAIS.03813","DOI":"10.17705\/1CAIS.03813"},{"key":"e_1_2_1_2_1","unstructured":"N. Lawrence and C. Cortes. 2014. The NIPS Experiment. http:\/\/inverseprobability.com\/2014\/12\/16\/the-nips-experiment.  N. Lawrence and C. Cortes. 2014. The NIPS Experiment. http:\/\/inverseprobability.com\/2014\/12\/16\/the-nips-experiment."},{"key":"e_1_2_1_3_1","unstructured":"E. Price. 2014. The NIPS experiment. http:\/\/blog.mrtz.org\/2014\/12\/15\/the-nips-experiment.html.  E. Price. 2014. The NIPS experiment. http:\/\/blog.mrtz.org\/2014\/12\/15\/the-nips-experiment.html."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1111\/bph.12956"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2983574"}],"container-title":["ACM SIGSOFT Software Engineering Notes"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3385678.3385681","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3385678.3385681","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:32:49Z","timestamp":1750199569000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3385678.3385681"}},"subtitle":["Status Report"],"short-title":[],"issued":{"date-parts":[[2020,4,28]]},"references-count":5,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,4,28]]}},"alternative-id":["10.1145\/3385678.3385681"],"URL":"https:\/\/doi.org\/10.1145\/3385678.3385681","relation":{},"ISSN":["0163-5948"],"issn-type":[{"value":"0163-5948","type":"print"}],"subject":[],"published":{"date-parts":[[2020,4,28]]},"assertion":[{"value":"2020-05-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}