{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T06:32:49Z","timestamp":1775025169634,"version":"3.50.1"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"7386","license":[{"start":{"date-parts":[[2012,2,1]],"date-time":"2012-02-01T00:00:00Z","timestamp":1328054400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Nature"],"published-print":{"date-parts":[[2012,2]]},"DOI":"10.1038\/nature10836","type":"journal-article","created":{"date-parts":[[2012,2,21]],"date-time":"2012-02-21T12:53:38Z","timestamp":1329828818000},"page":"485-488","source":"Crossref","is-referenced-by-count":381,"title":["The case for open computer programs"],"prefix":"10.1038","volume":"482","author":[{"given":"Darrel C.","family":"Ince","sequence":"first","affiliation":[]},{"given":"Leslie","family":"Hatton","sequence":"additional","affiliation":[]},{"given":"John","family":"Graham-Cumming","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2012,2,22]]},"reference":[{"key":"BFnature10836_CR1","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1109\/5992.881708","volume":"2","author":"M Schwab","year":"2000","unstructured":"Schwab, M., Karrenbach, M. & Claerbout, J. Making scientific computations reproducible. Comput. Sci. Eng. 2, 61\u201367 (2000)","journal-title":"Comput. Sci. Eng."},{"key":"BFnature10836_CR2","doi-asserted-by":"publisher","first-page":"753","DOI":"10.1038\/467753a","volume":"467","author":"N Barnes","year":"2010","unstructured":"Barnes, N. Publish your computer code: it is good enough. Nature 467, 753 (2010)","journal-title":"Nature"},{"key":"BFnature10836_CR3","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1145\/1831407.1831415","volume":"53","author":"D McCafferty","year":"2010","unstructured":"McCafferty, D. Should code be released? Commun. ACM 53, 16\u201317 (2010)","journal-title":"Commun. ACM"},{"key":"BFnature10836_CR4","doi-asserted-by":"publisher","first-page":"775","DOI":"10.1038\/467775a","volume":"467","author":"Z Merali","year":"2010","unstructured":"Merali, Z. \u2026Error. Nature 467, 775\u2013777 (2010)","journal-title":"Nature"},{"key":"BFnature10836_CR5","doi-asserted-by":"publisher","first-page":"649","DOI":"10.1126\/science.1203354","volume":"331","author":"B Hanson","year":"2011","unstructured":"Hanson, B., Sugden, A. & Alberts, B. Making data maximally available. Science 331, 649 (2011)","journal-title":"Science"},{"key":"BFnature10836_CR6","doi-asserted-by":"publisher","first-page":"405","DOI":"10.1093\/biostatistics\/kxp014","volume":"10","author":"RD Peng","year":"2009","unstructured":"Peng, R. D. Reproducible research and biostatistics. Biostatistics 10, 405\u2013408 (2009)This work provides a succinct and convincing argument for reproducibility\u2014 Biostatistics  is at the forefront of ensuring that code and data are provided for other researchers.","journal-title":"Biostatistics"},{"key":"BFnature10836_CR7","doi-asserted-by":"crossref","unstructured":"Devil in the details. Nature 470, 305\u2013306 (2011)","DOI":"10.1038\/470305b"},{"key":"BFnature10836_CR8","doi-asserted-by":"publisher","first-page":"465","DOI":"10.1162\/coli.2008.34.3.465","volume":"34","author":"T Pedersen","year":"2008","unstructured":"Pedersen, T. Empiricism is not a matter of faith. Comput. Linguist. 34, 465\u2013470 (2008)","journal-title":"Comput. Linguist."},{"key":"BFnature10836_CR9","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1093\/biostatistics\/kxq028","volume":"11","author":"DL Donoho","year":"2010","unstructured":"Donoho, D. L. An invitation to reproducible computational research. Biostatistics 11, 385\u2013388 (2010)","journal-title":"Biostatistics"},{"key":"BFnature10836_CR10","volume-title":"The Cathedral and the Bazaar","author":"ES Raymond","year":"2001","unstructured":"Raymond, E. S. The Cathedral and the Bazaar (O\u2019Reilly, 2001)"},{"key":"BFnature10836_CR11","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1023\/A:1008153532043","volume":"18","author":"Y He","year":"2001","unstructured":"He, Y. & Ding, C. H. Q. Using accurate arithmetics to improve numerical reproducibility and stability in parallel applications. J. Supercomput. 18, 259\u2013277 (2001)","journal-title":"J. Supercomput."},{"key":"BFnature10836_CR12","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1002\/spe.4380180403","volume":"18","author":"L Hatton","year":"1988","unstructured":"Hatton, L. et al. The seismic kernel system\u2014a large scale exercise in Fortran 77 portability. Softw. Pract. Exper. 18, 301\u2013329 (1988)","journal-title":"Softw. Pract. Exper."},{"key":"BFnature10836_CR13","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1109\/99.609829","volume":"4","author":"L Hatton","year":"1997","unstructured":"Hatton, L. The T experiments: errors in scientific software. IEEE Comput. Sci. Eng. 4, 27\u201338 (1997)","journal-title":"IEEE Comput. Sci. Eng."},{"key":"BFnature10836_CR14","unstructured":"Hey, T. Tansley, S. Tolle, K., eds. The Fourth Paradigm: Data-Intensive Scientific Discovery (Microsoft Press, 2009)"},{"key":"BFnature10836_CR15","doi-asserted-by":"publisher","first-page":"248","DOI":"10.1007\/978-3-642-14192-8_22","volume-title":"Requirements Engineering: Foundation for Software Quality","author":"V Gervasi","year":"2010","unstructured":"Gervasi, V. & Zowghi, D. On the role of ambiguity in RE. In Requirements Engineering: Foundation for Software Quality (eds Wieringa, R. & Persson, A ) 248\u2013254 (Springer, 2010)"},{"key":"BFnature10836_CR16","volume-title":"Not Exactly: In Praise of Vagueness","author":"K van Deemter","year":"2010","unstructured":"van Deemter, K. Not Exactly: In Praise of Vagueness (Oxford University Press, 2010)"},{"key":"BFnature10836_CR17","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1145\/1858996.1859007","volume-title":"Proc. IEEE\/ACM Intl Conf. on Automated Software Engineering","author":"H Yang","year":"2010","unstructured":"Yang, H., Willis, A., De Roeck, A. & Nuseibeh, B. Automatic detection of nocuous coordination ambiguities in natural language requirements. In Proc. IEEE\/ACM Intl Conf. on Automated Software Engineering 53\u201362 (ACM, 2010)"},{"key":"BFnature10836_CR18","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1007\/978-3-642-14192-8_21","volume-title":"Requirements Engineering: Foundation for Software Quality","author":"F de Bruijn","year":"2010","unstructured":"de Bruijn, F. & Dekkers, H. L. Ambiguity in natural language software requirements: a case study. In Requirements Engineering: Foundation for Software Quality (eds Wieringa, R, & Persson, A., ) 233\u2013247 (Springer, 2010)"},{"key":"BFnature10836_CR19","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1109\/2.566148","volume":"30","author":"SL Pfleeger","year":"1997","unstructured":"Pfleeger, S. L. & Hatton, L. Investigating the influence of formal methods. IEEE Computer 30, 33\u201343 (1997)","journal-title":"IEEE Computer"},{"key":"BFnature10836_CR20","doi-asserted-by":"publisher","first-page":"753","DOI":"10.1109\/TSE.2008.70","volume":"34","author":"MJP van der Meulen","year":"2008","unstructured":"van der Meulen, M. J. P. & Revilla, M. A. The effectiveness of software diversity in a large population of programs. IEEE Trans. Softw. Eng. 34, 753\u2013764 (2008)","journal-title":"IEEE Trans. Softw. Eng."},{"key":"BFnature10836_CR21","doi-asserted-by":"crossref","unstructured":"Boehm, B., Rombach, H. D., Zelkowitz, M. V., eds. Foundations of Empirical Software Engineering: the Legacy of Victor R. Basili (Springer, 2005)","DOI":"10.1007\/3-540-27662-9"},{"key":"BFnature10836_CR22","doi-asserted-by":"crossref","unstructured":"Monniaux, D. The pitfalls of verifying floating-point computations. ACM Trans.  Programming Languages Systems 30 (3). 1\u201341 (2008)","DOI":"10.1145\/1353445.1353446"},{"key":"BFnature10836_CR23","doi-asserted-by":"publisher","first-page":"898","DOI":"10.1175\/1520-0434(2002)017<0898:AEAOFE>2.0.CO;2","volume":"17","author":"SJ Thomas","year":"2002","unstructured":"Thomas, S. J., Hacker, J. P., Desagne, M. & Stull, R. B. An ensemble analysis of forecast errors related to floating point performance. Weather Forecast. 17, 898\u2013906 (2002)","journal-title":"Weather Forecast."},{"key":"BFnature10836_CR24","doi-asserted-by":"crossref","unstructured":"Revol, N. Standardized interval arithmetic and interval arithmetic used in libraries. Proc.  3rd Intl Congr.  Mathematical Software 337\u2013341. (2010)","DOI":"10.1007\/978-3-642-15582-6_54"},{"key":"BFnature10836_CR25","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1137\/050645671","volume":"31","author":"SM Rump","year":"2009","unstructured":"Rump, S. M., Ogita, T. & Oishi, S. Accurate floating point summation. Part 1: Faithful rounding. SIAM J. Sci. Comput. 31, 189\u2013224 (2009)","journal-title":"SIAM J. Sci. Comput."},{"key":"BFnature10836_CR26","doi-asserted-by":"crossref","unstructured":"Rump, S. M. Accurate and reliable computing in floating-point arithmetic. Proc.  3rd Intl Congr.  Mathematical Software 105\u2013108. (2010)","DOI":"10.1007\/978-3-642-15582-6_22"},{"key":"BFnature10836_CR27","first-page":"3","volume":"19","author":"M Badin","year":"2011","unstructured":"Badin, M., Bic, L. & Dillencourt, M. &. Nicolau, A. Improving accuracy for matrix multiplications on GPUs. Sci. Prog. 19, 3\u201311 (2011)","journal-title":"Sci. Prog."},{"key":"BFnature10836_CR28","doi-asserted-by":"publisher","first-page":"560","DOI":"10.1016\/j.camwa.2008.09.051","volume":"57","author":"VY Pan","year":"2009","unstructured":"Pan, V. Y., Murphy, B., Qian, G. & Rosholt, R. E. A new error-free floating-point summation algorithm. Comput. Math. Appl. 57, 560\u2013564 (2009)","journal-title":"Comput. Math. Appl."},{"key":"BFnature10836_CR29","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1109\/TC.2010.139","volume":"60","author":"S Boldo","year":"2011","unstructured":"Boldo, S. & Muller, J.-M. Exact and approximated error of the FMA. IEEE Trans. Comput. 60, 157\u2013164 (2011)","journal-title":"IEEE Trans. Comput."},{"key":"BFnature10836_CR30","unstructured":"Kahan, W. Desperately needed remedies for the undebuggability of large floating-point computations in science and engineering. IFIP\/SIAM\/NIST Working Conf.  Uncertainty Quantification in Scientific Computing (Springer, in the press)."},{"key":"BFnature10836_CR31","doi-asserted-by":"publisher","first-page":"415","DOI":"10.1126\/science.1179653","volume":"327","author":"JP Mesirov","year":"2010","unstructured":"Mesirov, J. P. Accessible reproducible research. Science 327, 415\u2013416 (2010)","journal-title":"Science"},{"key":"BFnature10836_CR32","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1109\/MCSE.2009.15","volume":"11","author":"DL Donoho","year":"2009","unstructured":"Donoho, D. L., Maleki, A., Rahman, I. U., Shahram, M. & Stodden, V. Reproducible research in computational harmonic analysis. Comput. Sci. Eng. 11, 8\u201318 (2009)Donoho and fellow researchers have been at the forefront of reproducibility for many years; this article reviews their work, including facilities for code presentation.","journal-title":"Comput. Sci. Eng."},{"key":"BFnature10836_CR33","doi-asserted-by":"publisher","first-page":"381","DOI":"10.5194\/gmd-4-381-2011","volume":"4","author":"A Yool","year":"2011","unstructured":"Yool, A., Popova, E. E. & Anderson, T. R. Medusa-1.0: a new intermediate complexity plankton ecosystem model for the global domain. Geosci. Model Develop. 4, 381\u2013417 (2011)An example of an article from a journal that asks for code release for model description papers and encourages code release for other categories of paper.","journal-title":"Geosci. Model Develop."},{"key":"BFnature10836_CR34","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1109\/MCSE.2009.193","volume":"11","author":"SM Easterbrook","year":"2009","unstructured":"Easterbrook, S. M. & Johns, T. C. Engineering the software for understanding climate change. Comput. Sci. Eng. 11, 65\u201374 (2009)","journal-title":"Comput. Sci. Eng."},{"key":"BFnature10836_CR35","doi-asserted-by":"publisher","first-page":"D12106","DOI":"10.1029\/2005JD006548","volume":"111","author":"P Brohan","year":"2006","unstructured":"Brohan, P., Kennedy, J. J., Harris, I., Tett, S. F. B. & Jones, P. D. Uncertainty estimates in regional and global observed temperature changes: a new dataset from 1850. J. Geophys. Res. 111, D12106 (2006)","journal-title":"J. Geophys. Res."},{"key":"BFnature10836_CR36","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1147\/rd.281.0002","volume":"28","author":"EN Adams","year":"1984","unstructured":"Adams, E. N. Optimizing preventive service of software products. IBM J. Res. Develop. 28, 2\u201314 (1984)","journal-title":"IBM J. Res. Develop."},{"key":"BFnature10836_CR37","doi-asserted-by":"publisher","first-page":"785","DOI":"10.1109\/32.328993","volume":"20","author":"L Hatton","year":"1994","unstructured":"Hatton, L. & Roberts, A. How accurate is scientific software? IEEE Trans. Softw. Eng. 20, 785\u2013797 (1994)","journal-title":"IEEE Trans. Softw. Eng."}],"container-title":["Nature"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.nature.com\/articles\/nature10836.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/www.nature.com\/articles\/nature10836","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/www.nature.com\/articles\/nature10836.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,18]],"date-time":"2023-05-18T17:58:28Z","timestamp":1684432708000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/nature10836"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,2]]},"references-count":37,"journal-issue":{"issue":"7386","published-print":{"date-parts":[[2012,2]]}},"alternative-id":["BFnature10836"],"URL":"https:\/\/doi.org\/10.1038\/nature10836","relation":{},"ISSN":["0028-0836","1476-4687"],"issn-type":[{"value":"0028-0836","type":"print"},{"value":"1476-4687","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,2]]}}}