{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,15]],"date-time":"2026-03-15T04:14:20Z","timestamp":1773548060596,"version":"3.50.1"},"reference-count":14,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2015,6,1]],"date-time":"2015-06-01T00:00:00Z","timestamp":1433116800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Math. Softw."],"published-print":{"date-parts":[[2015,6]]},"abstract":"\n The scientific community relies on the peer review process for assuring the quality of published material, the goal of which is to build a body of work we can trust. Computational journals such as the\n ACM Transactions on Mathematical Software<\/jats:italic>\n (TOMS) use this process for rigorously promoting the clarity and completeness of content, and citation of prior work. At the same time, it is unusual to independently confirm computational results.\n <\/jats:p>\n \n ACM TOMS has established a\n Replicated Computational Results<\/jats:italic>\n (RCR) review process as part of the manuscript peer review process. The purpose is to provide independent confirmation that results contained in a manuscript are replicable. Successful completion of the RCR process awards a manuscript with the Replicated Computational Results Designation.\n <\/jats:p>\n This issue of ACM TOMS contains the first [Van Zee and van de Geijn 2015] of what we anticipate to be a growing number of articles to receive the RCR designation, and the related RCR reviewer report [Willenbring 2015]. We hope that the TOMS RCR process will serve as a model for other publications and increase the confidence in and value of computational results in TOMS articles.<\/jats:p>","DOI":"10.1145\/2743015","type":"journal-article","created":{"date-parts":[[2015,6,2]],"date-time":"2015-06-02T15:13:25Z","timestamp":1433258005000},"page":"1-5","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":25,"title":["Editorial"],"prefix":"10.1145","volume":"41","author":[{"given":"Michael A.","family":"Heroux","sequence":"first","affiliation":[{"name":"Sandia National Laboratories, Albuquerque, NM"}]}],"member":"320","published-online":{"date-parts":[[2015,6]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1038\/nrd3439"},{"key":"e_1_2_1_2_1","unstructured":"David H. Bailey. 2014. Fooling the masses: Reproducibility in high-performance computing. https:\/\/www.xsede.org\/documents\/659353\/703287\/xsede14_bailey.pdf."},{"key":"e_1_2_1_3_1","volume-title":"Borwein","author":"Bailey David H.","year":"2014","unstructured":"David H. Bailey and Jonathan M. Borwein. 2014. Set the default to \u201cOpen\u201d: Reproducible science in the computer age\u2014David H. Bailey. http:\/\/www.huffingtonpost.com\/david-h-bailey\/set-the-default-to-open-r_b_2635850.html."},{"key":"e_1_2_1_4_1","unstructured":"C. Glenn Begley George Robertson Ken Kaitin Khusru Asadullah Lee Ellis Phil Sharp and Sharon Begley. 2014. In cancer science many discoveries don't hold up\u2014Reuters. http:\/\/www.reuters.com\/article\/2012\/03\/28\/us-science-cancer-idUSBRE82R12P20120328."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2012.41"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2012.84"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2012.76"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2012.65"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2012.62"},{"key":"e_1_2_1_10_1","unstructured":"Brian Owens. 2011. Reliability of new drug target claims called into question: Nature News Blog. DOI:http:\/\/blogs.nature.com\/news\/2011\/09\/reliability_of_new_drug_target.html."},{"key":"e_1_2_1_11_1","unstructured":"V. Stodden D. H. Bailey J. Borwein R. J. LeVeque W. Rider and W. Stein. 2013. Setting the default to reproducible: Reproducibility in computational and experimental mathematics. http:\/\/icerm.brown.edu\/html\/programs\/topical\/tw12_5_rcem\/icerm_report.pdf."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2764454"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2012.63"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2738033"}],"container-title":["ACM Transactions on Mathematical Software"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2743015","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2743015","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T06:16:34Z","timestamp":1750227394000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2743015"}},"subtitle":["ACM TOMS Replicated Computational Results Initiative"],"short-title":[],"issued":{"date-parts":[[2015,6]]},"references-count":14,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2015,6]]}},"alternative-id":["10.1145\/2743015"],"URL":"https:\/\/doi.org\/10.1145\/2743015","relation":{},"ISSN":["0098-3500","1557-7295"],"issn-type":[{"value":"0098-3500","type":"print"},{"value":"1557-7295","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,6]]},"assertion":[{"value":"2014-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-03-01","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-06-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}