{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T20:53:00Z","timestamp":1780692780224,"version":"3.54.1"},"reference-count":89,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2018,5,8]],"date-time":"2018-05-08T00:00:00Z","timestamp":1525737600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2018,5,8]],"date-time":"2018-05-08T00:00:00Z","timestamp":1525737600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digital Med"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Predictive modeling with electronic health record (EHR) data is anticipated to drive personalized medicine and improve healthcare quality. Constructing predictive statistical models typically requires extraction of curated predictor variables from normalized EHR data, a labor-intensive process that discards the vast majority of information in each patient\u2019s record. We propose a representation of patients\u2019 entire raw EHR records based on the Fast Healthcare Interoperability Resources (FHIR) format. We demonstrate that deep learning methods using this representation are capable of accurately predicting multiple medical events from multiple centers without site-specific data harmonization. We validated our approach using de-identified EHR data from two US academic medical centers with 216,221 adult patients hospitalized for at least 24\u2009h. In the sequential format we propose, this volume of EHR data unrolled into a total of 46,864,534,945 data points, including clinical notes. Deep learning models achieved high accuracy for tasks such as predicting: in-hospital mortality (area under the receiver operator curve [AUROC] across sites 0.93\u20130.94), 30-day unplanned readmission (AUROC 0.75\u20130.76), prolonged length of stay (AUROC 0.85\u20130.86), and all of a patient\u2019s final discharge diagnoses (frequency-weighted AUROC 0.90). These models outperformed traditional, clinically-used predictive models in all cases. We believe that this approach can be used to create accurate and scalable predictions for a variety of clinical scenarios. In a case study of a particular prediction, we demonstrate that neural networks can be used to identify relevant information from the patient\u2019s chart.<\/jats:p>","DOI":"10.1038\/s41746-018-0029-1","type":"journal-article","created":{"date-parts":[[2018,5,4]],"date-time":"2018-05-04T09:43:25Z","timestamp":1525427005000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2335,"title":["Scalable and accurate deep learning with electronic health records"],"prefix":"10.1038","volume":"1","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5750-5016","authenticated-orcid":false,"given":"Alvin","family":"Rajkomar","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eyal","family":"Oren","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kai","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew M.","family":"Dai","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nissan","family":"Hajaj","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michaela","family":"Hardt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter J.","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaobing","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jake","family":"Marcus","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mimi","family":"Sun","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Patrik","family":"Sundberg","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hector","family":"Yee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kun","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yi","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gerardo","family":"Flores","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gavin E.","family":"Duggan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jamie","family":"Irvine","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Quoc","family":"Le","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kurt","family":"Litsch","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Mossin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Justin","family":"Tansuwan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"De","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James","family":"Wexler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jimbo","family":"Wilson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dana","family":"Ludwig","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Samuel L.","family":"Volchenboum","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Katherine","family":"Chou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Pearson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Srinivasan","family":"Madabushi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nigam H.","family":"Shah","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Atul J.","family":"Butte","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael D.","family":"Howell","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Claire","family":"Cui","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Greg S.","family":"Corrado","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeffrey","family":"Dean","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2018,5,8]]},"reference":[{"key":"29_CR1","unstructured":"The Digital Universe: Driving Data Growth in Healthcare. Available at: https:\/\/www.emc.com\/analyst-report\/digital-universe-healthcare-vertical-report-ar.pdf (Accessed 23 Feb 2017)."},{"key":"29_CR2","doi-asserted-by":"publisher","first-page":"1609","DOI":"10.1056\/NEJMp1613224","volume":"376","author":"RB Parikh","year":"2017","unstructured":"Parikh, R. B., Schwartz, J. S. & Navathe, A. S. Beyond genes and molecules - a precision delivery initiative for precision medicine. N. Engl. J. Med. 376, 1609\u20131612 (2017).","journal-title":"N. Engl. J. Med."},{"key":"29_CR3","doi-asserted-by":"publisher","first-page":"651","DOI":"10.1001\/jama.2015.19417","volume":"315","author":"RB Parikh","year":"2016","unstructured":"Parikh, R. B., Kakad, M. & Bates, D. W. Integrating predictive analytics into high-value care: the dawn of precision delivery. JAMA 315, 651\u2013652 (2016).","journal-title":"JAMA"},{"key":"29_CR4","doi-asserted-by":"publisher","first-page":"1123","DOI":"10.1377\/hlthaff.2014.0041","volume":"33","author":"DW Bates","year":"2014","unstructured":"Bates, D. W., Saria, S., Ohno-Machado, L., Shah, A. & Escobar, G. Big data in health care: using analytics to identify and manage high-risk and high-cost patients. Health Aff. 33, 1123\u20131131 (2014).","journal-title":"Health Aff."},{"key":"29_CR5","doi-asserted-by":"publisher","first-page":"1163","DOI":"10.1377\/hlthaff.2014.0053","volume":"33","author":"HM Krumholz","year":"2014","unstructured":"Krumholz, H. M. Big data and new knowledge in medicine: the thinking, training, and tools needed for a learning health system. Health Aff. 33, 1163\u20131170 (2014).","journal-title":"Health Aff."},{"key":"29_CR6","doi-asserted-by":"publisher","first-page":"2229","DOI":"10.1056\/NEJMsb1503104","volume":"372","author":"JL Jameson","year":"2015","unstructured":"Jameson, J. L. & Longo, D. L. Precision medicine--personalized, problematic, and promising. N. Engl. J. Med. 372, 2229\u20132234 (2015).","journal-title":"N. Engl. J. Med."},{"key":"29_CR7","doi-asserted-by":"publisher","first-page":"198","DOI":"10.1093\/jamia\/ocw042","volume":"24","author":"BA Goldstein","year":"2017","unstructured":"Goldstein, B. A., Navar, A. M., Pencina, M. J. & Ioannidis, J. P. A. Opportunities and challenges in developing risk prediction models with electronic health records data: a systematic review. J. Am. Med. Inform. Assoc. 24, 198\u2013208 (2017).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"29_CR8","unstructured":"Press, G. Cleaning big data: most time-consuming, least enjoyable data science task, survey says. Forbes (2016). Available at: https:\/\/www.forbes.com\/sites\/gilpress\/2016\/03\/23\/data-preparation-most-time-consuming-least-enjoyable-data-science-task-survey-says\/ (Accessed 22 Oct 2017)."},{"key":"29_CR9","unstructured":"Lohr, S. For Big-Data Scientists, \u2018Janitor Work\u2019 Is Key Hurdle to Insights. (NY Times, 2014)."},{"key":"29_CR10","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0110274","volume":"9","author":"BJ Drew","year":"2014","unstructured":"Drew, B. J. et al. Insights into the problem of alarm fatigue with physiologic monitor devices: a comprehensive observational study of consecutive intensive care unit patients. PLoS ONE 9, e110274 (2014).","journal-title":"PLoS ONE"},{"key":"29_CR11","doi-asserted-by":"publisher","first-page":"1199","DOI":"10.1001\/jama.2014.710","volume":"311","author":"V Chopra","year":"2014","unstructured":"Chopra, V. & McMahon, L. F. Jr. Redesigning hospital alarms for patient safety: alarmed and potentially dangerous. JAMA 311, 1199\u20131200 (2014).","journal-title":"JAMA"},{"key":"29_CR12","doi-asserted-by":"publisher","first-page":"1629","DOI":"10.1056\/NEJMoa1415236","volume":"372","author":"KM Kaukonen","year":"2015","unstructured":"Kaukonen, K.-M., Bailey, M., Pilcher, D., Cooper, D. J. & Bellomo, R. Systemic inflammatory response syndrome criteria in defining severe sepsis. N. Engl. J. Med. 372, 1629\u20131638 (2015).","journal-title":"N. Engl. J. Med."},{"key":"29_CR13","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y LeCun","year":"2015","unstructured":"LeCun, Y., Bengio, Y. & Hinton, G. Deep learning. Nature 521, 436\u2013444 (2015).","journal-title":"Nature"},{"key":"29_CR14","unstructured":"Frome, A. et al. DeViSE: a deep visual-semantic embedding model. In Advances in Neural Information Processing Systems 26 (eds Burges, C. J. C., Bottou, L., Welling, M., Ghahramani, Z. & Weinberger, K. Q.), pp 2121\u20132129 (Curran Associates, Inc. Red Hook, NY, 2013)."},{"key":"29_CR15","doi-asserted-by":"publisher","first-page":"2402","DOI":"10.1001\/jama.2016.17216","volume":"316","author":"V Gulshan","year":"2016","unstructured":"Gulshan, V. et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 316, 2402\u20132410 (2016).","journal-title":"JAMA"},{"key":"29_CR16","unstructured":"Wu, Y. et al. Google\u2019s neural machine translation system: bridging the gap between human and machine translation. arXi\n                           v [cs.CL] (2016)."},{"key":"29_CR17","unstructured":"Dai, A. M. & Le, Q. V. Semi-supervised sequence learning. In Advances in Neural Information Processing Systems 28 (eds Cortes, C., Lawrence, N. D., Lee, D. D., Sugiyama, M. & Garnett, R.), pp 3079\u20133087 (Curran Associates, Inc. Red Hook, NY, 2015)."},{"key":"29_CR18","doi-asserted-by":"publisher","first-page":"1798","DOI":"10.1109\/TPAMI.2013.50","volume":"35","author":"Y Bengio","year":"2013","unstructured":"Bengio, Y., Courville, A. & Vincent, P. Representation learning: a review and new perspectives. IEEE. Trans. Pattern Anal. Mach. Intell. 35, 1798\u20131828 (2013).","journal-title":"IEEE. Trans. Pattern Anal. Mach. Intell."},{"key":"29_CR19","doi-asserted-by":"publisher","first-page":"652","DOI":"10.1056\/NEJM196803212781204","volume":"278","author":"LL Weed","year":"1968","unstructured":"Weed, L. L. Medical records that guide and teach. N. Engl. J. Med. 278, 652\u2013657 (1968). concl.","journal-title":"N. Engl. J. Med."},{"key":"29_CR20","doi-asserted-by":"publisher","first-page":"2174","DOI":"10.1377\/hlthaff.2015.0992","volume":"34","author":"J Adler-Milstein","year":"2015","unstructured":"Adler-Milstein, J. et al. Electronic health record adoption In US hospitals: progress continues, but challenges persist. Health Aff. 34, 2174\u20132180 (2015).","journal-title":"Health Aff."},{"key":"29_CR21","doi-asserted-by":"publisher","first-page":"S27","DOI":"10.1086\/511159","volume":"44","author":"LA Mandell","year":"2007","unstructured":"Mandell, L. A. et al. Infectious Diseases Society of America\/American Thoracic Society consensus guidelines on the management of community-acquired pneumonia in adults. Clin. Infect. Dis. 44, S27\u2013S72 (2007). Suppl 2.","journal-title":"Clin. Infect. Dis."},{"key":"29_CR22","doi-asserted-by":"publisher","DOI":"10.1136\/bmjresp-2015-000091","volume":"2","author":"WS Lim","year":"2015","unstructured":"Lim, W. S., Smith, D. L., Wise, M. P. & Welham, S. A. British Thoracic Society community acquired pneumonia guideline and the NICE pneumonia guideline: how they fit together. BMJ Open Respir. Res. 2, e000091 (2015).","journal-title":"BMJ Open Respir. Res."},{"key":"29_CR23","doi-asserted-by":"publisher","first-page":"368","DOI":"10.1097\/CCM.0000000000001571","volume":"44","author":"MM Churpek","year":"2016","unstructured":"Churpek, M. M. et al. Multicenter comparison of machine learning methods and conventional regression for predicting clinical deterioration on the wards. Crit. Care. Med. 44, 368\u2013374 (2016).","journal-title":"Crit. Care. Med."},{"key":"29_CR24","doi-asserted-by":"publisher","first-page":"2562","DOI":"10.1097\/CCM.0b013e318259007b","volume":"40","author":"MD Howell","year":"2012","unstructured":"Howell, M. D. et al. Sustained effectiveness of a primary-team-based rapid response system. Crit. Care. Med. 40, 2562\u20132568 (2012).","journal-title":"Crit. Care. Med."},{"key":"29_CR25","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1016\/j.jbi.2015.10.009","volume":"58","author":"H Sun","year":"2015","unstructured":"Sun, H. et al. Semantic processing of EHR data for clinical research. J. Biomed. Inform. 58, 247\u2013259 (2015).","journal-title":"J. Biomed. Inform."},{"key":"29_CR26","doi-asserted-by":"publisher","first-page":"e147","DOI":"10.1136\/amiajnl-2012-000896","volume":"20","author":"KM Newton","year":"2013","unstructured":"Newton, K. M. et al. Validation of electronic medical record-based phenotyping algorithms: results and lessons learned from the eMERGE network. J. Am. Med. Inform. Assoc. 20, e147\u2013e154 (2013).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"29_CR27","unstructured":"OHDSI. OMOP common data model. Observational health data sciences and informatics. Available at: https:\/\/www.ohdsi.org\/data-standardization\/the-common-data-model\/ (Accessed 23 Jan 2018)."},{"key":"29_CR28","doi-asserted-by":"publisher","first-page":"899","DOI":"10.1093\/jamia\/ocv189","volume":"23","author":"JC Mandel","year":"2016","unstructured":"Mandel, J. C., Kreda, D. A., Mandl, K. D., Kohane, I. S. & Ramoni, R. B. SMART on FHIR: a standards-based, interoperable apps platform for electronic health records. J. Am. Med. Inform. Assoc. 23, 899\u2013908 (2016).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"29_CR29","doi-asserted-by":"publisher","DOI":"10.1038\/srep26094","volume":"6","author":"R Miotto","year":"2016","unstructured":"Miotto, R., Li, L., Kidd, B. A. & Dudley, J. T. Deep patient: an unsupervised representation to predict the future of patients from the electronic health records. Sci. Rep. 6, 26094 (2016).","journal-title":"Sci. Rep."},{"key":"29_CR30","unstructured":"Lipton, Z. C., Kale, D. C., Elkan, C. & Wetzel, R. Learning to diagnose with LSTM recurrent neural networks. arXiv [cs.LG] (2015)."},{"key":"29_CR31","unstructured":"Aczon, M. et al. Dynamic mortality risk predictions in pediatric critical care using recurrent neural networks. arXiv [stat.ML] (2017)."},{"key":"29_CR32","unstructured":"Choi, E., Bahadori, M. T., Schuetz, A., Stewart, W. F. & Sun, J. Doctor AI: predicting clinical events via recurrent neural networks. In Proceedings of the 1st Machine Learning for Healthcare Conference, vol 56 (eds F. Doshi-Velez, J. Fackler, D. Kale and B. Wallace, J. Wiens) 301\u2013318 (PMLR, Los Angeles, CA, 2016)."},{"key":"29_CR33","unstructured":"Suresh, H. et al. Clinical intervention prediction and understanding using deep networks. arXiv [cs.LG] (PMLR, Los Angeles, CA, USA, 2017)."},{"key":"29_CR34","unstructured":"Razavian, N., Marcus, J. & Sontag, D. Multi-task prediction of disease onsets from longitudinal laboratory tests. In Proceedings of the 1st Machine Learning for Healthcare Conference, (eds F. Doshi-Velez, J. Fackler, D. Kale and B. Wallace, J. Wiens) Vol. 56, pp 73\u2013100 (PMLR, Los Angeles, CA, 2016)."},{"key":"29_CR35","unstructured":"Che, Z., Purushotham, S., Cho, K., Sontag, D. & Liu, Y. Recurrent neural networks for multivariate time series with missing values. arXiv [cs.LG] (2016)."},{"key":"29_CR36","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2016.35","volume":"3","author":"AEW Johnson","year":"2016","unstructured":"Johnson, A. E. W. et al. MIMIC-III, a freely accessible critical care database. Sci. Data 3, 160035 (2016).","journal-title":"Sci. Data"},{"key":"29_CR37","unstructured":"Harutyunyan, H., Khachatrian, H., Kale, D. C. & Galstyan, A. Multitask learning and benchmarking with clinical time series data. arXiv [stat.ML] (2017)."},{"key":"29_CR38","unstructured":"Society of Critical Care Medicine. Critical care statistics. Available at: http:\/\/www.sccm.org\/Communications\/Pages\/CriticalCareStats.aspx (Accessed 25 Jan 2018)."},{"key":"29_CR39","unstructured":"American Hospital Association. Fast facts on U.S. Hospitals, 2018. Available at: https:\/\/www.aha.org\/statistics\/fast-facts-us-hospitals (Accessed 25 Jan 2018)."},{"key":"29_CR40","doi-asserted-by":"crossref","unstructured":"Shickel, B., Tighe, P., Bihorac, A. & Rashidi, P. Deep EHR: a survey of recent advances in deep learning techniques for electronic health record (EHR) analysis. arXiv [cs.LG] (2017).","DOI":"10.1109\/JBHI.2017.2767063"},{"key":"29_CR41","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1097\/00006199-198707000-00002","volume":"36","author":"N Bergstrom","year":"1987","unstructured":"Bergstrom, N., Braden, B. J., Laguzza, A. & Holman, V. The braden scale for predicting pressure sore risk. Nurs. Res. 36, 205\u2013210 (1987).","journal-title":"Nurs. Res."},{"key":"29_CR42","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1136\/amiajnl-2013-001790","volume":"21","author":"YP Tabak","year":"2014","unstructured":"Tabak, Y. P., Sun, X., Nunez, C. M. & Johannes, R. S. Using electronic health record data to develop inpatient mortality predictive model: Acute Laboratory Risk of Mortality Score (ALaRMS). J. Am. Med. Inform. Assoc. 21, 455\u2013463 (2014).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"29_CR43","doi-asserted-by":"publisher","first-page":"473","DOI":"10.1002\/jhm.2568","volume":"11","author":"OK Nguyen","year":"2016","unstructured":"Nguyen, O. K. et al. Predicting all-cause readmissions using electronic health record data from the entire hospitalization: Model development and comparison. J. Hosp. Med. 11, 473\u2013480 (2016).","journal-title":"J. Hosp. Med."},{"key":"29_CR44","doi-asserted-by":"publisher","first-page":"739","DOI":"10.1097\/MLR.0b013e3181e359f3","volume":"48","author":"V Liu","year":"2010","unstructured":"Liu, V., Kipnis, P., Gould, M. K. & Escobar, G. J. Length of stay predictions: improvements through the use of automated laboratory and comorbidity variables. Med. Care 48, 739\u2013744 (2010).","journal-title":"Med. Care"},{"key":"29_CR45","doi-asserted-by":"publisher","first-page":"418","DOI":"10.1016\/j.jbi.2014.08.006","volume":"52","author":"C Walsh","year":"2014","unstructured":"Walsh, C. & Hripcsak, G. The effects of data sources, cohort selection, and outcome definition on a predictive model of risk of thirty-day hospital readmissions. J. Biomed. Inform. 52, 418\u2013426 (2014).","journal-title":"J. Biomed. Inform."},{"key":"29_CR46","doi-asserted-by":"publisher","first-page":"297","DOI":"10.1016\/j.resuscitation.2011.08.022","volume":"83","author":"J Kellett","year":"2012","unstructured":"Kellett, J. & Kim, A. Validation of an abbreviated VitalpacTM Early Warning Score (ViEWS) in 75,419 consecutive admissions to a Canadian regional hospital. Resuscitation 83, 297\u2013302 (2012).","journal-title":"Resuscitation"},{"key":"29_CR47","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1097\/MLR.0b013e3181589bb6","volume":"46","author":"GJ Escobar","year":"2008","unstructured":"Escobar, G. J. et al. Risk-adjusting hospital inpatient mortality using automated inpatient, outpatient, and laboratory databases. Med. Care. 46, 232\u2013239 (2008).","journal-title":"Med. Care."},{"key":"29_CR48","doi-asserted-by":"publisher","first-page":"551","DOI":"10.1503\/cmaj.091117","volume":"182","author":"C van Walraven","year":"2010","unstructured":"van Walraven, C. et al. Derivation and validation of an index to predict early death or unplanned readmission after discharge from hospital to the community. CMAJ 182, 551\u2013557 (2010).","journal-title":"CMAJ"},{"key":"29_CR49","doi-asserted-by":"publisher","DOI":"10.1186\/s12913-015-0889-x","volume":"15","author":"H Yamana","year":"2015","unstructured":"Yamana, H., Matsui, H., Fushimi, K. & Yasunaga, H. Procedure-based severity index for inpatients: development and validation using administrative database. BMC Health Serv. Res. 15, 261 (2015).","journal-title":"BMC Health Serv. Res."},{"key":"29_CR50","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1177\/0272989X08323297","volume":"29","author":"M Pine","year":"2009","unstructured":"Pine, M. et al. Modifying ICD-9-CM coding of secondary diagnoses to improve risk-adjustment of inpatient mortality rates. Med. Decis. Making 29, 69\u201381 (2009).","journal-title":"Med. Decis. Making"},{"key":"29_CR51","doi-asserted-by":"publisher","first-page":"465","DOI":"10.1016\/j.resuscitation.2012.12.016","volume":"84","author":"GB Smith","year":"2013","unstructured":"Smith, G. B., Prytherch, D. R., Meredith, P., Schmidt, P. E. & Featherstone, P. I. The ability of the National Early Warning Score (NEWS) to discriminate patients at risk of early cardiac arrest, unanticipated intensive care unit admission, and death. Resuscitation 84, 465\u2013470 (2013).","journal-title":"Resuscitation"},{"key":"29_CR52","doi-asserted-by":"publisher","first-page":"688","DOI":"10.1016\/j.amjmed.2016.02.037","volume":"129","author":"HS Khurana","year":"2016","unstructured":"Khurana, H. S. et al. Real-time automated sampling of electronic medical records predicts hospital mortality. Am. J. Med. 129, 688\u2013698.e2 (2016).","journal-title":"Am. J. Med."},{"key":"29_CR53","doi-asserted-by":"publisher","first-page":"837","DOI":"10.1016\/j.jbi.2013.06.011","volume":"46","author":"MJ Rothman","year":"2013","unstructured":"Rothman, M. J., Rothman, S. I. & Beals, J. 4th Development and validation of a continuous measure of patient condition using the electronic medical record. J. Biomed. Inform. 46, 837\u2013848 (2013).","journal-title":"J. Biomed. Inform."},{"key":"29_CR54","doi-asserted-by":"publisher","first-page":"116","DOI":"10.1002\/jhm.2132","volume":"9","author":"GD Finlay","year":"2014","unstructured":"Finlay, G. D., Rothman, M. J. & Smith, R. A. Measuring the modified early warning score and the Rothman index: advantages of utilizing the electronic medical record in an early warning system. J. Hosp. Med. 9, 116\u2013119 (2014).","journal-title":"J. Hosp. Med."},{"key":"29_CR55","doi-asserted-by":"publisher","first-page":"451","DOI":"10.1016\/j.ejim.2012.01.005","volume":"23","author":"A Zapatero","year":"2012","unstructured":"Zapatero, A. et al. Predictive model of readmission to internal medicine wards. Eur. J. Intern. Med. 23, 451\u2013456 (2012).","journal-title":"Eur. J. Intern. Med."},{"key":"29_CR56","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1007\/s10729-014-9278-y","volume":"18","author":"I Shams","year":"2015","unstructured":"Shams, I., Ajorlou, S. & Yang, K. A predictive analytics approach to reducing 30-day avoidable readmissions among patients with heart failure, acute myocardial infarction, pneumonia, or COPD. Health Care. Manag. Sci. 18, 19\u201334 (2015).","journal-title":"Health Care. Manag. Sci."},{"key":"29_CR57","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1177\/1460458213501095","volume":"21","author":"E Tsui","year":"2013","unstructured":"Tsui, E., Au, S. Y., Wong, C. P., Cheung, A. & Lam, P. Development of an automated model to predict the risk of elderly emergency medical admissions within a month following an index hospital visit: A Hong Kong experience. Health Inform. J. 21, 46\u201356 (2013).","journal-title":"Health Inform. J."},{"key":"29_CR58","doi-asserted-by":"publisher","first-page":"219","DOI":"10.5210\/ojphi.v5i2.4726","volume":"5","author":"SA Choudhry","year":"2013","unstructured":"Choudhry, S. A. et al. A public-private partnership develops and externally validates a 30-day hospital readmission risk prediction model. Online J. Public Health Inform. 5, 219 (2013).","journal-title":"Online J. Public Health Inform."},{"key":"29_CR59","doi-asserted-by":"crossref","unstructured":"Caruana, R. et al. Intelligible models for healthcare: predicting pneumonia risk and hospital 30-day readmission. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp 1721\u20131730. http:\/\/doi.acm.org\/10.1145\/2783258.2788613 (ACM, Sydney, NSW, Australia, 2015).","DOI":"10.1145\/2783258.2788613"},{"key":"29_CR60","doi-asserted-by":"publisher","first-page":"636","DOI":"10.1002\/jhm.2595","volume":"11","author":"O Tonkikh","year":"2016","unstructured":"Tonkikh, O. et al. Functional status before and during acute hospitalization and readmission risk identification. J. Hosp. Med. 11, 636\u2013641 (2016).","journal-title":"J. Hosp. Med."},{"key":"29_CR61","doi-asserted-by":"publisher","first-page":"1068","DOI":"10.1016\/j.hlc.2015.04.168","volume":"24","author":"V Betihavas","year":"2015","unstructured":"Betihavas, V. et al. An absolute risk prediction model to determine unplanned cardiovascular readmissions for adults with chronic heart failure. Heart Lung Circ. 24, 1068\u20131073 (2015).","journal-title":"Heart Lung Circ."},{"key":"29_CR62","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1016\/j.cgh.2010.08.017","volume":"9","author":"TL Whitlock","year":"2011","unstructured":"Whitlock, T. L. et al. A scoring system to predict readmission of patients with acute pancreatitis to the hospital within thirty days of discharge. Clin. Gastroenterol. Hepatol. 9, 175\u2013180 (2011). quiz e18.","journal-title":"Clin. Gastroenterol. Hepatol."},{"key":"29_CR63","doi-asserted-by":"publisher","first-page":"1449","DOI":"10.1111\/j.1475-6773.2004.00298.x","volume":"39","author":"EA Coleman","year":"2004","unstructured":"Coleman, E. A., Min, S.-J., Chomiak, A. & Kramer, A. M. Posthospital care transitions: patterns, complications, and risk identification. Health Serv. Res. 39, 1449\u20131465 (2004).","journal-title":"Health Serv. Res."},{"key":"29_CR64","doi-asserted-by":"publisher","first-page":"562","DOI":"10.1177\/0194599813500023","volume":"149","author":"EM Graboyes","year":"2013","unstructured":"Graboyes, E. M., Liou, T.-N., Kallogjeri, D., Nussenbaum, B. & Diaz, J. A. Risk factors for unplanned hospital readmission in otolaryngology patients. Otolaryngol. Head Neck Surg. 149, 562\u2013571 (2013).","journal-title":"Otolaryngol. Head Neck Surg."},{"key":"29_CR65","doi-asserted-by":"publisher","first-page":"272","DOI":"10.1136\/amiajnl-2013-002151","volume":"21","author":"D He","year":"2014","unstructured":"He, D., Mathews, S. C., Kalloo, A. N. & Hutfless, S. Mining high-dimensional administrative claims data to predict early hospital readmissions. J. Am. Med. Inform. Assoc. 21, 272\u2013279 (2014).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"29_CR66","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1016\/j.jbi.2015.05.016","volume":"56","author":"J Futoma","year":"2015","unstructured":"Futoma, J., Morris, J. & Lucas, J. A comparison of models for predicting early hospital readmissions. J. Biomed. Inform. 56, 229\u2013238 (2015).","journal-title":"J. Biomed. Inform."},{"key":"29_CR67","doi-asserted-by":"publisher","first-page":"632","DOI":"10.1001\/jamainternmed.2013.3023","volume":"173","author":"J Donz\u00e9","year":"2013","unstructured":"Donz\u00e9, J., Aujesky, D., Williams, D. & Schnipper, J. L. Potentially avoidable 30-day hospital readmissions in medical patients: derivation and validation of a prediction model. JAMA Intern. Med. 173, 632\u2013638 (2013).","journal-title":"JAMA Intern. Med."},{"key":"29_CR68","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1136\/amiajnl-2013-002159","volume":"21","author":"A Perotte","year":"2014","unstructured":"Perotte, A. et al. Diagnosis code assignment: models and evaluation metrics. J. Am. Med. Inform. Assoc. 21, 231\u2013237 (2014).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"29_CR69","doi-asserted-by":"publisher","first-page":"1669","DOI":"10.1001\/jama.2016.12537","volume":"316","author":"HM Krumholz","year":"2016","unstructured":"Krumholz, H. M., Terry, S. F. & Waldstreicher, J. Data acquisition, curation, and use for a continuously learning health system. JAMA 316, 1669\u20131670 (2016).","journal-title":"JAMA"},{"key":"29_CR70","doi-asserted-by":"publisher","first-page":"1109","DOI":"10.1001\/jama.2014.705","volume":"311","author":"K Grumbach","year":"2014","unstructured":"Grumbach, K., Lucey, C. R. & Claiborne Johnston, S. Transforming from centers of learning to learning health systems: the challenge for academic health centers. JAMA 311, 1109\u20131110 (2014).","journal-title":"JAMA"},{"key":"29_CR71","doi-asserted-by":"publisher","first-page":"907","DOI":"10.1056\/NEJMp1709851","volume":"377","author":"JD Halamka","year":"2017","unstructured":"Halamka, J. D. & Tripathi, M. The HITECH era in retrospect. N. Engl. J. Med. 377, 907\u2013909 (2017).","journal-title":"N. Engl. J. Med."},{"key":"29_CR72","doi-asserted-by":"publisher","first-page":"523","DOI":"10.1197\/jamia.M1370","volume":"10","author":"DW Bates","year":"2003","unstructured":"Bates, D. W. et al. Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. J. Am. Med. Inform. Assoc. 10, 523\u2013530 (2003).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"29_CR73","doi-asserted-by":"publisher","first-page":"1216","DOI":"10.1056\/NEJMp1606181","volume":"375","author":"Z Obermeyer","year":"2016","unstructured":"Obermeyer, Z. & Emanuel, E. J. Predicting the future --- big data, machine learning, and clinical medicine. N. Engl. J. Med. 375, 1216\u20131219 (2016).","journal-title":"N. Engl. J. Med."},{"key":"29_CR74","doi-asserted-by":"crossref","unstructured":"Avati, A. et al. Improving palliative care with deep learning. arXiv [cs.CY] (2017).","DOI":"10.1109\/BIBM.2017.8217669"},{"key":"29_CR75","unstructured":"Health Level 7. FHIR Specification Home Page (2017). Available at: http:\/\/hl7.org\/fhir\/ (Accessed 3 Aug 2017)."},{"key":"29_CR76","doi-asserted-by":"publisher","first-page":"916","DOI":"10.1097\/MLR.0000000000000435","volume":"53","author":"GJ Escobar","year":"2015","unstructured":"Escobar, G. J. et al. Nonelective rehospitalizations and postdischarge mortality: predictive models suitable for use in real time. Med. Care. 53, 916\u2013923 (2015).","journal-title":"Med. Care."},{"key":"29_CR77","unstructured":"2016 Measure updates and specifications report: hospital-wide all-cause unplanned readmission --- version 5.0. Yale--New Haven Health Services Corporation\/Center for Outcomes Research & Evaluation (New Haven, CT, 2016)."},{"key":"29_CR78","doi-asserted-by":"publisher","first-page":"818","DOI":"10.1097\/00003246-198510000-00009","volume":"13","author":"WA Knaus","year":"1985","unstructured":"Knaus, W. A., Draper, E. A., Wagner, D. P. & Zimmerman, J. E. APACHE II: a severity of disease classification system. Crit. Care Med. 13, 818\u2013829 (1985).","journal-title":"Crit. Care Med."},{"key":"29_CR79","doi-asserted-by":"publisher","first-page":"1688","DOI":"10.1001\/jama.2011.1515","volume":"306","author":"D Kansagara","year":"2011","unstructured":"Kansagara, D. et al. Risk prediction models for hospital readmission: a systematic review. JAMA 306, 1688\u20131698 (2011).","journal-title":"JAMA"},{"key":"29_CR80","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter, S. & Schmidhuber, J. Long short-term memory. Neural Comput. 9, 1735\u20131780 (1997).","journal-title":"Neural Comput."},{"key":"29_CR81","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10462-009-9124-7","volume":"33","author":"L Rokach","year":"2010","unstructured":"Rokach, L. Ensemble-based Classifiers. Artif. Intell. Rev. 33, 1\u201339 (2010).","journal-title":"Artif. Intell. Rev."},{"key":"29_CR82","doi-asserted-by":"publisher","first-page":"517","DOI":"10.1001\/jama.2017.7797","volume":"18","author":"F Cabitza","year":"2017","unstructured":"Cabitza, F., Rasoini, R. & Gensini, G. F. Unintended consequences of machine learning in medicine. JAMA 18, 517\u2013518 (2017).","journal-title":"JAMA"},{"key":"29_CR83","unstructured":"Bahdanau, D., Cho, K. & Bengio, Y. Neural machine translation by jointly learning to align and translate. arXiv [cs.CL] (2014)."},{"key":"29_CR84","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa, F. et al. Scikit-learn: machine learning in python. J. Mach. Learn. Res. 12, 2825\u20132830 (2011).","journal-title":"J. Mach. Learn. Res."},{"key":"29_CR85","doi-asserted-by":"publisher","first-page":"1063","DOI":"10.1001\/jama.2015.11082","volume":"314","author":"MJ Pencina","year":"2015","unstructured":"Pencina, M. J. & D\u2019Agostino, R. B. Sr. Evaluating discrimination of risk prediction models: the C statistic. JAMA 314, 1063\u20131064 (2015).","journal-title":"JAMA"},{"key":"29_CR86","doi-asserted-by":"publisher","first-page":"2052","DOI":"10.1097\/01.CCM.0000275267.64078.B0","volume":"35","author":"AA Kramer","year":"2007","unstructured":"Kramer, A. A. & Zimmerman, J. E. Assessing the calibration of mortality benchmarks in critical care: the Hosmer-Lemeshow test revisited. Crit. Care Med. 35, 2052\u20132056 (2007).","journal-title":"Crit. Care Med."},{"key":"29_CR87","doi-asserted-by":"publisher","DOI":"10.1186\/s13054-015-0999-1","volume":"19","author":"S Romero-Brufau","year":"2015","unstructured":"Romero-Brufau, S., Huddleston, J. M., Escobar, G. J. & Liebow, M. Why the C-statistic is not informative to evaluate early warning scores and what metrics to use. Crit. Care 19, 285 (2015).","journal-title":"Crit. Care"},{"key":"29_CR88","unstructured":"SciKit Learn. SciKit learn documentation on area under the curve scores. Available at: http:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.metrics.roc_auc_score.html (Accessed 3 Aug 2017)."},{"key":"29_CR89","unstructured":"SciKit Learn. SciKit learn documentation on F1 score. Available at: http:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.metrics.f1_score.html (Accessed 3 Aug 2017)."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-018-0029-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-018-0029-1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-018-0029-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,21]],"date-time":"2022-12-21T07:38:30Z","timestamp":1671608310000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-018-0029-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,5,8]]},"references-count":89,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2018,12]]}},"alternative-id":["29"],"URL":"https:\/\/doi.org\/10.1038\/s41746-018-0029-1","relation":{"has-review":[{"id-type":"doi","id":"10.3410\/f.733181042.793560978","asserted-by":"object"},{"id-type":"doi","id":"10.3410\/f.733181042.793560090","asserted-by":"object"}]},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,5,8]]},"assertion":[{"value":"26 January 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 March 2018","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 March 2018","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 May 2018","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"18"}}