{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T10:35:45Z","timestamp":1772793345475,"version":"3.50.1"},"reference-count":22,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,5,22]],"date-time":"2019-05-22T00:00:00Z","timestamp":1558483200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,5,22]],"date-time":"2019-05-22T00:00:00Z","timestamp":1558483200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100006108","name":"U.S. Department of Health & Human Services | NIH | National Center for Advancing Translational Sciences","doi-asserted-by":"publisher","award":["UL1TR002377"],"award-info":[{"award-number":["UL1TR002377"]}],"id":[{"id":"10.13039\/100006108","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Artificial intelligence and deep learning methods hold great promise in the medical sciences in areas such as enhanced tumor identification from radiographic images, and natural language processing to extract complex information from electronic health records. Scientific review of AI algorithms has involved reproducibility, in which investigators share protocols, raw data, and programming codes. Within the realm of medicine, reproducibility introduces important challenges, including risk to patient privacy, challenges in reproducing results, and questions regarding ownership and financial value of large medical datasets. Scientific review, however, mandates some form of resolution of these inherent conflicts. We propose several approaches to permit scientific review while maintaining patient privacy and data confidentiality.<\/jats:p>","DOI":"10.1038\/s41746-019-0120-2","type":"journal-article","created":{"date-parts":[[2019,5,22]],"date-time":"2019-05-22T10:04:48Z","timestamp":1558519488000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":33,"title":["Pragmatic considerations for fostering reproducible research in artificial intelligence"],"prefix":"10.1038","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0818-273X","authenticated-orcid":false,"given":"Rickey E.","family":"Carter","sequence":"first","affiliation":[]},{"given":"Zachi I.","family":"Attia","sequence":"additional","affiliation":[]},{"given":"Francisco","family":"Lopez-Jimenez","sequence":"additional","affiliation":[]},{"given":"Paul A.","family":"Friedman","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2019,5,22]]},"reference":[{"key":"120_CR1","doi-asserted-by":"publisher","first-page":"2668","DOI":"10.1016\/j.jacc.2018.03.521","volume":"71","author":"KW Johnson","year":"2018","unstructured":"Johnson, K. W. et al. Artificial intelligence in cardiology. J. Am. Coll. Cardiol. 71, 2668\u20132679 (2018).","journal-title":"J. Am. Coll. Cardiol."},{"key":"120_CR2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0201059","volume":"13","author":"ZI Attia","year":"2018","unstructured":"Attia, Z. I. et al. Noninvasive assessment of dofetilide plasma concentration using a deep learning (neural network) analysis of the surface electrocardiogram: A proof of concept study. PLoS ONE 13, e0201059 (2018).","journal-title":"PLoS ONE"},{"key":"120_CR3","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1038\/s41591-018-0240-2","volume":"25","author":"ZI Attia","year":"2019","unstructured":"Attia, Z. I. et al. Screening for cardiac contractile dysfunction using an artificial intelligence\u2013enabled electrocardiogram. Nat. Med. 25, 70\u201374 (2019).","journal-title":"Nat. Med."},{"key":"120_CR4","doi-asserted-by":"publisher","first-page":"2292","DOI":"10.1016\/j.jaci.2017.12.1003","volume":"141","author":"S Sohn","year":"2018","unstructured":"Sohn, S. et al. Ascertainment of asthma prognosis using natural language processing from electronic medical records. J. Allergy Clin. Immunol. 141, 2292\u20132294 e2293 (2018).","journal-title":"J. Allergy Clin. Immunol."},{"key":"120_CR5","doi-asserted-by":"publisher","first-page":"2402","DOI":"10.1001\/jama.2016.17216","volume":"316","author":"V Gulshan","year":"2016","unstructured":"Gulshan, V. et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 316, 2402\u20132410 (2016).","journal-title":"JAMA"},{"key":"120_CR6","doi-asserted-by":"publisher","first-page":"2657","DOI":"10.1016\/j.jacc.2017.03.571","volume":"69","author":"C Krittanawong","year":"2017","unstructured":"Krittanawong, C., Zhang, H., Wang, Z., Aydar, M. & Kitai, T. Artificial intelligence in precision cardiovascular medicine. J. Am. Coll. Cardiol. 69, 2657\u20132664 (2017).","journal-title":"J. Am. Coll. Cardiol."},{"key":"120_CR7","doi-asserted-by":"publisher","first-page":"318","DOI":"10.1148\/radiol.2018171820","volume":"2","author":"G Choy","year":"2018","unstructured":"Choy, G. Current applications and future impact of machine learning in radiology. Radiology 2, 318\u2013328 (2018).","journal-title":"Radiology"},{"key":"120_CR8","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1302\/2046-3758.73.BJR-2017-0147.R1","volume":"7","author":"LD Jones","year":"2018","unstructured":"Jones, L. D., Golan, D., Hanna, S. A. & Ramachandran, M. Artificial intelligence, machine learning and the evolution of healthcare: A bright future or cause for concern? Bone Joint Res. 7, 223\u2013225 (2018).","journal-title":"Bone Joint Res."},{"key":"120_CR9","doi-asserted-by":"publisher","unstructured":"Hutson, M. Missing data hinder replication of artificial intelligence studies. Science https:\/\/doi.org\/10.1126\/science.aat3298 (2018).","DOI":"10.1126\/science.aat3298"},{"key":"120_CR10","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1038\/s41746-019-0079-z","volume":"2","author":"A Stupple","year":"2019","unstructured":"Stupple, A., Singerman, D. & Celi, L. A. The reproducibility crisis in the age of digital medicine. npj Digital Medicine 2, 2 (2019).","journal-title":"npj Digital Medicine"},{"key":"120_CR11","doi-asserted-by":"publisher","first-page":"621","DOI":"10.3389\/fpsyg.2015.00621","volume":"6","author":"BD Earp","year":"2015","unstructured":"Earp, B. D. & Trafimow, D. Replication, falsification, and the crisis of confidence in social psychology. Front Psychol. 6, 621 (2015).","journal-title":"Front Psychol."},{"key":"120_CR12","doi-asserted-by":"publisher","first-page":"1226","DOI":"10.1126\/science.1213847","volume":"334","author":"RD Peng","year":"2011","unstructured":"Peng, R. D. Reproducible research in computational science. Science 334, 1226\u20131227 (2011).","journal-title":"Science"},{"key":"120_CR13","doi-asserted-by":"publisher","first-page":"613","DOI":"10.1038\/d41586-018-05256-0","volume":"557","author":"PB Stark","year":"2018","unstructured":"Stark, P. B. Before reproducibility must come preproducibility. Nature 557, 613 (2018).","journal-title":"Nature"},{"key":"120_CR14","doi-asserted-by":"publisher","first-page":"94","DOI":"10.1016\/j.ebiom.2017.12.015","volume":"27","author":"X Kong","year":"2018","unstructured":"Kong, X., Gong, S., Su, L., Howard, N. & Kong, Y. Automatic detection of acromegaly from facial photographs using machine learning methods. EBioMedicine 27, 94\u2013102 (2018).","journal-title":"EBioMedicine"},{"key":"120_CR15","unstructured":"Kermi, A., Marniche-Kermi, S. & Laskri, M. T. in 2010 International Conference on Machine and Web Intelligence 276\u2013282 (2010)."},{"key":"120_CR16","volume":"7","author":"JM Kwon","year":"2018","unstructured":"Kwon, J. M., Lee, Y., Lee, Y., Lee, S. & Park, J. An algorithm based on deep learning for predicting in-hospital cardiac arrest. J. Am. Heart Assoc. 7, e008678 (2018).","journal-title":"J. Am. Heart Assoc."},{"key":"120_CR17","unstructured":"Harris, R. When scientists develop products from personal medical data, who gets to profit?, https:\/\/www.npr.org\/sections\/health-shots\/2018\/05\/31\/615501659\/when-scientists-develop-products-from-personal-medical-data-who-gets-to-profit (2018)."},{"key":"120_CR18","unstructured":"Minnesota. Disclosure of health records for external research, Vol. 144. (ed The office of the revisor of statutes) 295."},{"key":"120_CR19","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1016\/j.therap.2018.12.004","volume":"74","author":"J Demotes-Mainard","year":"2019","unstructured":"Demotes-Mainard, J., Cornu, C. & Guerin, A., participants of Giens, X.R.T.C.r. How the new European data protection regulation affects clinical research and recommendations? Therapie 74, 31\u201342 (2019).","journal-title":"Therapie"},{"key":"120_CR20","doi-asserted-by":"publisher","first-page":"595","DOI":"10.1007\/s00439-018-1905-0","volume":"137","author":"A Thorogood","year":"2018","unstructured":"Thorogood, A. Canada: will privacy rules continue to favour open science? Hum. Genet. 137, 595\u2013602 (2018).","journal-title":"Hum. Genet"},{"key":"120_CR21","doi-asserted-by":"publisher","DOI":"10.1186\/s12910-019-0359-9","volume":"20","author":"S Kalkman","year":"2019","unstructured":"Kalkman, S., Mostert, M., Gerlinger, C., van Delden, J. J. M. & van Thiel, G. Responsible data sharing in international health research: a systematic review of principles and norms. BMC Med. Ethics 20, 21 (2019).","journal-title":"BMC Med. Ethics"},{"key":"120_CR22","doi-asserted-by":"publisher","first-page":"783","DOI":"10.1093\/aje\/kwj093","volume":"163","author":"RD Peng","year":"2006","unstructured":"Peng, R. D., Dominici, F. & Zeger, S. L. Reproducible epidemiologic research. Am. J. Epidemiol. 163, 783\u2013789 (2006).","journal-title":"Am. J. Epidemiol."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0120-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0120-2","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0120-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,17]],"date-time":"2022-12-17T18:28:08Z","timestamp":1671301688000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0120-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,5,22]]},"references-count":22,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2019,12]]}},"alternative-id":["120"],"URL":"https:\/\/doi.org\/10.1038\/s41746-019-0120-2","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,5,22]]},"assertion":[{"value":"18 February 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 May 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 May 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"42"}}