{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,6]],"date-time":"2026-02-06T01:49:39Z","timestamp":1770342579740,"version":"3.49.0"},"reference-count":37,"publisher":"Oxford University Press (OUP)","issue":"8","license":[{"start":{"date-parts":[[2021,5,19]],"date-time":"2021-05-19T00:00:00Z","timestamp":1621382400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,7,30]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Objective<\/jats:title><jats:p>To compare the accuracy of computer versus physician predictions of hospitalization and to explore the potential synergies of hybrid physician\u2013computer models.<\/jats:p><\/jats:sec><jats:sec><jats:title>Materials and Methods<\/jats:title><jats:p>A single-center prospective observational study in a tertiary pediatric hospital in Boston, Massachusetts, United States. Nine emergency department (ED) attending physicians participated in the study. Physicians predicted the likelihood of admission for patients in the ED whose hospitalization disposition had not yet been decided. In parallel, a random-forest computer model was developed to predict hospitalizations from the ED, based on data available within the first hour of the ED encounter. The model was tested on the same cohort of patients evaluated by the participating physicians.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>198 pediatric patients were considered for inclusion. Six patients were excluded due to incomplete or erroneous physician forms. Of the 192 included patients, 54 (28%) were admitted and 138 (72%) were discharged. The positive predictive value for the prediction of admission was 66% for the clinicians, 73% for the computer model, and 86% for a hybrid model combining the two. To predict admission, physicians relied more heavily on the clinical appearance of the patient, while the computer model relied more heavily on technical data-driven features, such as the rate of prior admissions or distance traveled to hospital.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>Computer-generated predictions of patient disposition were more accurate than clinician-generated predictions. A hybrid prediction model improved accuracy over both individual predictions, highlighting the complementary and synergistic effects of both approaches.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>The integration of computer and clinician predictions can yield improved predictive performance.<\/jats:p><\/jats:sec>","DOI":"10.1093\/jamia\/ocab076","type":"journal-article","created":{"date-parts":[[2021,4,10]],"date-time":"2021-04-10T03:52:16Z","timestamp":1618026736000},"page":"1736-1745","source":"Crossref","is-referenced-by-count":16,"title":["Prediction of patient disposition: comparison of computer and human approaches and a proposed synthesis"],"prefix":"10.1093","volume":"28","author":[{"given":"Yuval","family":"Barak-Corren","sequence":"first","affiliation":[{"name":"Predictive Medicine Group, Computational Health Informatics Program, Boston Children\u2019s Hospital, Boston, Massachusetts, USA"}]},{"given":"Isha","family":"Agarwal","sequence":"additional","affiliation":[{"name":"Harvard Medical School, Boston, Massachusetts, USA"},{"name":"Emergency Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts, USA"}]},{"given":"Kenneth A","family":"Michelson","sequence":"additional","affiliation":[{"name":"Harvard Medical School, Boston, Massachusetts, USA"},{"name":"Emergency Medicine, Boston Children\u2019s Hospital, Boston, Massachusetts, USA"}]},{"given":"Todd W","family":"Lyons","sequence":"additional","affiliation":[{"name":"Harvard Medical School, Boston, Massachusetts, USA"},{"name":"Emergency Medicine, Boston Children\u2019s Hospital, Boston, Massachusetts, USA"}]},{"given":"Mark I","family":"Neuman","sequence":"additional","affiliation":[{"name":"Harvard Medical School, Boston, Massachusetts, USA"},{"name":"Emergency Medicine, Boston Children\u2019s Hospital, Boston, Massachusetts, USA"}]},{"given":"Susan C","family":"Lipsett","sequence":"additional","affiliation":[{"name":"Harvard Medical School, Boston, Massachusetts, USA"},{"name":"Emergency Medicine, Boston Children\u2019s Hospital, Boston, Massachusetts, USA"}]},{"given":"Amir A","family":"Kimia","sequence":"additional","affiliation":[{"name":"Harvard Medical School, Boston, Massachusetts, USA"},{"name":"Emergency Medicine, Boston Children\u2019s Hospital, Boston, Massachusetts, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2937-2222","authenticated-orcid":false,"given":"Matthew A","family":"Eisenberg","sequence":"additional","affiliation":[{"name":"Harvard Medical School, Boston, Massachusetts, USA"},{"name":"Emergency Medicine, Boston Children\u2019s Hospital, Boston, Massachusetts, USA"}]},{"given":"Andrew J","family":"Capraro","sequence":"additional","affiliation":[{"name":"Harvard Medical School, Boston, Massachusetts, USA"},{"name":"Emergency Medicine, Boston Children\u2019s Hospital, Boston, Massachusetts, USA"}]},{"given":"Jason A","family":"Levy","sequence":"additional","affiliation":[{"name":"Harvard Medical School, Boston, Massachusetts, USA"},{"name":"Emergency Medicine, Boston Children\u2019s Hospital, Boston, Massachusetts, USA"}]},{"given":"Joel D","family":"Hudgins","sequence":"additional","affiliation":[{"name":"Harvard Medical School, Boston, Massachusetts, USA"},{"name":"Emergency Medicine, Boston Children\u2019s Hospital, Boston, Massachusetts, USA"}]},{"given":"Ben Y","family":"Reis","sequence":"additional","affiliation":[{"name":"Predictive Medicine Group, Computational Health Informatics Program, Boston Children\u2019s Hospital, Boston, Massachusetts, USA"},{"name":"Harvard Medical School, Boston, Massachusetts, USA"}]},{"given":"Andrew M","family":"Fine","sequence":"additional","affiliation":[{"name":"Harvard Medical School, Boston, Massachusetts, USA"},{"name":"Emergency Medicine, Boston Children\u2019s Hospital, Boston, Massachusetts, USA"}]}],"member":"286","published-online":{"date-parts":[[2021,5,19]]},"reference":[{"key":"2021073020264147500_ocab076-B1","doi-asserted-by":"crossref","first-page":"2328","DOI":"10.4103\/jfmpc.jfmpc_440_19","article-title":"Overview of artificial intelligence in medicine","volume":"8","author":"Amisha","year":"2019","journal-title":"J Family Med Prim Care"},{"key":"2021073020264147500_ocab076-B2","article-title":"Artificial intelligence versus clinicians: systematic review of design, reporting standards, and claims of deep learning studies","volume":"368","author":"Nagendran","year":"2020","journal-title":"BMJ"},{"key":"2021073020264147500_ocab076-B3","doi-asserted-by":"crossref","first-page":"d8312","DOI":"10.1136\/bmj.d8312","article-title":"Clinical prediction rules","volume":"344","author":"Adams","year":"2012","journal-title":"BMJ"},{"issue":"7651","key":"2021073020264147500_ocab076-B4","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1038\/544413a","article-title":"Artificial intelligence: chess match of the century","volume":"544","author":"Hassabis","year":"2017","journal-title":"Nature"},{"key":"2021073020264147500_ocab076-B5","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1147\/JRD.2012.2184356","article-title":"Introduction to \u201cThis is Watson.\u201d","volume":"56","author":"Ferrucci","year":"2012","journal-title":"IBM J Res Dev"},{"issue":"7676","key":"2021073020264147500_ocab076-B6","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1038\/nature24270","article-title":"Mastering the game of Go without human knowledge","volume":"550","author":"Silver","year":"2017","journal-title":"Nature"},{"key":"2021073020264147500_ocab076-B7","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1038\/s41746-019-0106-0","article-title":"Physician perspectives on integration of artificial intelligence into diagnostic pathology","volume":"2","author":"Sarwar","year":"2019","journal-title":"NPJ Digit Med"},{"issue":"6","key":"2021073020264147500_ocab076-B8","doi-asserted-by":"crossref","first-page":"e15154","DOI":"10.2196\/15154","article-title":"Artificial intelligence and human trust in healthcare: focus on clinicians","volume":"22","author":"Asan","year":"2020","journal-title":"J Med Internet Res"},{"issue":"7","key":"2021073020264147500_ocab076-B9","doi-asserted-by":"crossref","first-page":"e18599","DOI":"10.2196\/18599","article-title":"Role of artificial intelligence in patient safety outcomes: systematic literature review","volume":"8","author":"Choudhury","year":"2020","journal-title":"JMIR Med Inform"},{"issue":"1","key":"2021073020264147500_ocab076-B10","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1038\/s41591-018-0300-7","article-title":"High-performance medicine: the convergence of human and artificial intelligence","volume":"25","author":"Topol","year":"2019","journal-title":"Nat Med"},{"issue":"1","key":"2021073020264147500_ocab076-B11","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1186\/s12913-018-3359-4","article-title":"Will artificial intelligence solve the human resource crisis in healthcare?","volume":"18","author":"Mesk\u00f3","year":"2018","journal-title":"BMC Health Serv Res"},{"issue":"5","key":"2021073020264147500_ocab076-B12","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1089\/omi.2019.0038","article-title":"Integrating artificial and human intelligence: a partnership for responsible innovation in biomedical engineering and medicine","volume":"24","author":"Dzobo","year":"2020","journal-title":"OMICS"},{"issue":"2","key":"2021073020264147500_ocab076-B13","doi-asserted-by":"crossref","first-page":"89","DOI":"10.4103\/iju.IJU_74_19","article-title":"Augmented intelligence: a synergy between man and the machine","volume":"35","author":"Bhandari","year":"2019","journal-title":"Indian J Urol"},{"key":"2021073020264147500_ocab076-B14","doi-asserted-by":"crossref","DOI":"10.1176\/appi.ps.202000214","article-title":"Reconciling statistical and clinicians\u2019 predictions of suicide risk","author":"Simon","year":"2021","journal-title":"Psychiatr Serv"},{"issue":"12","key":"2021073020264147500_ocab076-B15","doi-asserted-by":"crossref","first-page":"1636","DOI":"10.1097\/PAS.0000000000001151","article-title":"Impact of deep learning assistance on the histopathologic review of lymph nodes for metastatic breast cancer","volume":"42","author":"Steiner","year":"2018","journal-title":"Am J Surg Pathol"},{"issue":"1","key":"2021073020264147500_ocab076-B16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.jemermed.2005.08.007","article-title":"How well do paramedics predict admission to the hospital? A prospective study","volume":"31","author":"Levine","year":"2006","journal-title":"J Emerg Med"},{"issue":"10","key":"2021073020264147500_ocab076-B17","doi-asserted-by":"crossref","first-page":"691","DOI":"10.1136\/emj.2007.054924","article-title":"Can emergency medical service staff predict the disposition of patients they are transporting?","volume":"25","author":"Clesham","year":"2008","journal-title":"Emerg Med J"},{"issue":"3","key":"2021073020264147500_ocab076-B18","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1080\/10903120590962012","article-title":"Prehospital provider prediction of emergency department disposition: implications for selective diversion","volume":"9","author":"Price","year":"2005","journal-title":"Prehosp Emerg Care"},{"issue":"9","key":"2021073020264147500_ocab076-B19","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1111\/acem.13931","article-title":"Diagnostic performance of emergency physician gestalt for predicting acute appendicitis in patients age 5 to 20 years","volume":"27","author":"Simon","year":"2020","journal-title":"Acad Emerg Med"},{"issue":"3","key":"2021073020264147500_ocab076-B20","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1016\/j.annemergmed.2016.12.004","article-title":"Structured clinical decision aids are seldom compared with subjective physician judgment and are seldom superior","volume":"70","author":"Schriger","year":"2017","journal-title":"Ann Emerg Med"},{"issue":"1","key":"2021073020264147500_ocab076-B21","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1001\/jama.2018.18932","article-title":"Questions for artificial intelligence in health care","volume":"321","author":"Maddox","year":"2019","journal-title":"JAMA"},{"issue":"9","key":"2021073020264147500_ocab076-B22","first-page":"993","article-title":"The impact of \u2018admit no bed\u2019 and long boarding times in the emergency department on stroke outcome","volume":"35","author":"Al-Khathaami","year":"2014","journal-title":"Saudi Med J"},{"issue":"3","key":"2021073020264147500_ocab076-B23","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1016\/j.jemermed.2005.05.023","article-title":"Emergency department overcrowding and ambulance diversion: the impact and potential solutions of extended boarding of admitted patients in the emergency department","volume":"30","author":"Olshaker","year":"2006","journal-title":"J Emerg Med"},{"issue":"9","key":"2021073020264147500_ocab076-B24","doi-asserted-by":"crossref","first-page":"E1045","DOI":"10.1111\/j.1553-2712.2012.01435.x","article-title":"Predicting emergency department inpatient admissions to improve same-day patient flow","volume":"19","author":"Peck","year":"2012","journal-title":"Acad Emerg Med"},{"issue":"8","key":"2021073020264147500_ocab076-B25","doi-asserted-by":"crossref","first-page":"844","DOI":"10.1111\/j.1553-2712.2011.01125.x","article-title":"Predicting hospital admissions at emergency department triage using routine administrative data","volume":"18","author":"Sun","year":"2011","journal-title":"Acad Emerg Med"},{"issue":"3","key":"2021073020264147500_ocab076-B26","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1136\/emermed-2013-203200","article-title":"A simple tool to predict admission at the time of triage","volume":"32","author":"Cameron","year":"2015","journal-title":"Emerg Med J"},{"key":"2021073020264147500_ocab076-B27","doi-asserted-by":"crossref","first-page":"10458","DOI":"10.1109\/ACCESS.2018.2808843","article-title":"Using data mining to predict hospital admissions from the emergency department","volume":"6","author":"Graham","year":"2018","journal-title":"IEEE Access"},{"issue":"5","key":"2021073020264147500_ocab076-B28","doi-asserted-by":"crossref","first-page":"e20162785","DOI":"10.1542\/peds.2016-2785","article-title":"Early prediction model of patient hospitalization from the pediatric emergency department","volume":"139","author":"Barak-Corren","year":"2017","journal-title":"Pediatrics"},{"issue":"5","key":"2021073020264147500_ocab076-B29","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1136\/emermed-2014-203819","article-title":"Progressive prediction of hospitalisation in the emergency department: uncovering hidden patterns to improve patient flow","volume":"34","author":"Barak-Corren","year":"2017","journal-title":"Emerg Med J"},{"issue":"1","key":"2021073020264147500_ocab076-B30","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1111\/j.1553-2712.2004.tb01371.x","article-title":"Reliability and validity of scores on The Emergency Severity Index version 3","volume":"11","author":"Tanabe","year":"2004","journal-title":"Acad Emergency Med"},{"issue":"2","key":"2021073020264147500_ocab076-B31","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/j.pedn.2012.07.009","article-title":"The Cardiac Children\u2019s Hospital Early Warning Score (C-CHEWS)","volume":"28","author":"McLellan","year":"2013","journal-title":"J Pediatr Nurs"},{"issue":"11","key":"2021073020264147500_ocab076-B32","doi-asserted-by":"crossref","first-page":"1146","DOI":"10.1111\/acem.12256","article-title":"Value of point-of-care ketones in assessing dehydration and acidosis in children with gastroenteritis","volume":"20","author":"Levy","year":"2013","journal-title":"Acad Emerg Med"},{"issue":"3","key":"2021073020264147500_ocab076-B33","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1016\/j.annemergmed.2012.01.021","article-title":"Extremity fracture pain after emergency department reduction and casting: predictors of pain after discharge","volume":"60","author":"Thompson","year":"2012","journal-title":"Ann Emerg Med"},{"key":"2021073020264147500_ocab076-B34","year":"2020"},{"key":"2021073020264147500_ocab076-B35","first-page":"18","article-title":"Classification and regression by random forest","volume":"2","author":"Liaw","year":"2002","journal-title":"R News"},{"issue":"8","key":"2021073020264147500_ocab076-B36","doi-asserted-by":"crossref","first-page":"e0203316","DOI":"10.1371\/journal.pone.0203316","article-title":"Emergency department crowding: a systematic review of causes, consequences, and solutions","volume":"13","author":"Morley","year":"2018","journal-title":"PLoS ONE"},{"issue":"6","key":"2021073020264147500_ocab076-B37","doi-asserted-by":"crossref","first-page":"e271","DOI":"10.1016\/S2589-7500(19)30123-2","article-title":"A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis","volume":"1","author":"Liu","year":"2019","journal-title":"Lancet Digital Health"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/8\/1736\/39502182\/ocab076.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/8\/1736\/39502182\/ocab076.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,28]],"date-time":"2024-08-28T01:23:13Z","timestamp":1724808193000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/28\/8\/1736\/6278435"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,19]]},"references-count":37,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2021,5,19]]},"published-print":{"date-parts":[[2021,7,30]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocab076","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,8,1]]},"published":{"date-parts":[[2021,5,19]]}}}