{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T08:27:26Z","timestamp":1781857646934,"version":"3.54.5"},"reference-count":45,"publisher":"American Medical Association (AMA)","issue":"5","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JAMA Netw Open"],"abstract":"Importance<\/jats:title>Emergency department (ED) visits by older adults with life-limiting illnesses are a critical opportunity to establish patient care end-of-life preferences, but little is known about the optimal screening criteria for resource-constrained EDs.<\/jats:p><\/jats:sec>Objectives<\/jats:title>To externally validate the Geriatric End-of-Life Screening Tool (GEST) in an independent population and compare it with commonly used serious illness diagnostic criteria.<\/jats:p><\/jats:sec>Design, Setting, and Participants<\/jats:title>This prognostic study assessed a cohort of patients aged 65 years and older who were treated in a tertiary care ED in Boston, Massachusetts, from 2017 to 2021. Patients arriving in cardiac arrest or who died within 1 day of ED arrival were excluded. Data analysis was performed from August 1, 2023, to March 27, 2024.<\/jats:p><\/jats:sec>Exposure<\/jats:title>GEST, a logistic regression algorithm that uses commonly available electronic health record (EHR) datapoints and was developed and validated across 9 EDs, was compared with serious illness diagnoses as documented in the EHR. Serious illnesses included stroke\/transient ischemic attack, liver disease, cancer, lung disease, and age greater than 80 years, among others.<\/jats:p><\/jats:sec>Main Outcomes and Measures<\/jats:title>The primary outcome was 6-month mortality following an ED encounter. Statistical analyses included area under the receiver operating characteristic curve, calibration analyses, Kaplan-Meier survival curves, and decision curves.<\/jats:p><\/jats:sec>Results<\/jats:title>This external validation included 82\u202f371 ED encounters by 40\u202f505 unique individuals (mean [SD] age, 76.8 [8.4] years; 54.3% women, 13.8% 6-month mortality rate). GEST had an external validation area under the receiver operating characteristic curve of 0.79 (95% CI, 0.78-0.79) that was stable across years and demographic subgroups. Of included encounters, 53.4% had a serious illness, with a sensitivity of 77.4% (95% CI, 76.6%-78.2%) and specificity of 50.5% (95% CI, 50.1%-50.8%). Varying GEST cutoffs from 5% to 30% increased specificity (5%: 49.1% [95% CI, 48.7%-49.5%]; 30%: 92.2% [95% CI, 92.0%-92.4%]) at the cost of sensitivity (5%: 89.3% [95% CI, 88.8-89.9]; 30%: 36.2% [95% CI, 35.3-37.1]). In a decision curve analysis, GEST outperformed serious illness criteria across all tested thresholds. When comparing patients referred to intervention by GEST with serious illness criteria, GEST reclassified 45.1% of patients with serious illness as having low risk of mortality with an observed mortality rate 8.1% and 2.6% of patients without serious illness as having high mortality risk with an observed mortality rate of 34.3% for a total reclassification rate of 25.3%.<\/jats:p><\/jats:sec>Conclusions and Relevance<\/jats:title>The findings of this study suggest that both serious illness criteria and GEST identified older ED patients at risk for 6-month mortality, but GEST offered more useful screening characteristics. Future trials of serious illness interventions for high mortality risk in older adults may consider transitioning from diagnosis code criteria to GEST, an automatable EHR-based algorithm.<\/jats:p><\/jats:sec>","DOI":"10.1001\/jamanetworkopen.2024.14213","type":"journal-article","created":{"date-parts":[[2024,5,31]],"date-time":"2024-05-31T15:32:57Z","timestamp":1717169577000},"page":"e2414213","source":"Crossref","is-referenced-by-count":5,"title":["Geriatric End-of-Life Screening Tool Prediction of 6-Month Mortality in Older Patients"],"prefix":"10.1001","volume":"7","author":[{"given":"Adrian D.","family":"Haimovich","sequence":"first","affiliation":[{"name":"Department of Emergency Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ryan C.","family":"Burke","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Larry A.","family":"Nathanson","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Rubins","sequence":"additional","affiliation":[{"name":"Department of Internal Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"R. Andrew","family":"Taylor","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, Yale School of Medicine, New Haven, Connecticut"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Erin K.","family":"Kross","sequence":"additional","affiliation":[{"name":"Division of Pulmonary, Critical Care, and Sleep Medicine, University of Washington, Seattle"},{"name":"Cambia Palliative Care Center of Excellence at UW Medicine, Seattle, Washington"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kei","family":"Ouchi","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, Brigham and Women\u2019s Hospital, Boston, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nathan I.","family":"Shapiro","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mara A.","family":"Schonberg","sequence":"additional","affiliation":[{"name":"Department of Internal Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"10","published-online":{"date-parts":[[2024,5,31]]},"reference":[{"issue":"2","key":"zoi240485r1","doi-asserted-by":"publisher","first-page":"276","DOI":"10.1016\/j.annemergmed.2019.01.003","article-title":"Goals-of-care conversations for older adults with serious illness in the emergency department: challenges and opportunities.","volume":"74","author":"Ouchi","year":"2019","journal-title":"Ann Emerg Med"},{"issue":"2","key":"zoi240485r2","doi-asserted-by":"publisher","DOI":"10.1177\/23814683211058082","article-title":"Paths of emergency department care: development of a decision aid to facilitate shared decision making in goals of care discussions in the acute setting.","volume":"6","author":"Walker","year":"2021","journal-title":"MDM Policy Pract"},{"issue":"4","key":"zoi240485r3","doi-asserted-by":"publisher","first-page":"362","DOI":"10.1016\/j.annemergmed.2010.10.010","article-title":"Trajectories of end-of-life care in the emergency department.","volume":"57","author":"Bailey","year":"2011","journal-title":"Ann Emerg Med"},{"issue":"1","key":"zoi240485r4","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1089\/jpm.2016.0243","article-title":"Availability of advance care planning documentation for older emergency department patients: a cross-sectional study.","volume":"20","author":"Platts-Mills","year":"2017","journal-title":"J Palliat Med"},{"key":"zoi240485r5","article-title":"What\u2019s wrong with advance care planning?","author":"Sean Morrison","journal-title":"JAMA"},{"issue":"1","key":"zoi240485r6","doi-asserted-by":"publisher","first-page":"234","DOI":"10.1111\/jgs.v69.1","article-title":"Deconstructing the complexities of advance care planning outcomes: what do we know and where do we go? a scoping review.","volume":"69","author":"McMahan","year":"2021","journal-title":"J Am Geriatr Soc"},{"issue":"1","key":"zoi240485r7","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1016\/j.jpainsymman.2022.10.006","article-title":"Communication training and code status conversation patterns reported by emergency clinicians.","volume":"65","author":"Prachanukool","year":"2023","journal-title":"J Pain Symptom Manage"},{"issue":"3","key":"zoi240485r8","doi-asserted-by":"publisher","first-page":"363","DOI":"10.1017\/S1478951521001012","article-title":"Palliative care in the emergency department: A qualitative study exploring barriers, facilitators, desired clinician qualities, and future directions.","volume":"20","author":"Gips","year":"2022","journal-title":"Palliat Support Care"},{"issue":"2","key":"zoi240485r9","first-page":"179","article-title":"Adverse outcomes in older adults attending emergency departments: a systematic review and meta-analysis of the Identification of Seniors at Risk (ISAR) screening tool.","volume":"46","author":"Galvin","year":"2017","journal-title":"Age Ageing"},{"issue":"3","key":"zoi240485r10","doi-asserted-by":"publisher","first-page":"288","DOI":"10.1089\/rej.2011.1239","article-title":"Risk stratification of older patients in the emergency department: comparison between the Identification of Seniors at Risk and Triage Risk Screening Tool.","volume":"15","author":"Salvi","year":"2012","journal-title":"Rejuvenation Res"},{"issue":"1","key":"zoi240485r11","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1186\/s12245-023-00538-5","article-title":"Screening Tool Risk Score Assessment in the Emergency Department for Geriatric (S-TRIAGE) in 28-day mortality.","volume":"16","author":"Supatanakij","year":"2023","journal-title":"Int J Emerg Med"},{"issue":"9","key":"zoi240485r12","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2019.11139","article-title":"Association of emergency clinicians\u2019 assessment of mortality risk with actual 1-month mortality among older adults admitted to the hospital.","volume":"2","author":"Ouchi","year":"2019","journal-title":"JAMA Netw Open"},{"issue":"6","key":"zoi240485r13","doi-asserted-by":"publisher","first-page":"1694","DOI":"10.1111\/jgs.v71.6","article-title":"Identifying emergency department patients with life-limiting illnesses may be getting a little easier.","volume":"71","author":"Goldberg","year":"2023","journal-title":"J Am Geriatr Soc"},{"issue":"6","key":"zoi240485r14","doi-asserted-by":"publisher","first-page":"694","DOI":"10.1111\/acem.2016.23.issue-6","article-title":"Acceptability and reliability of a novel palliative care screening tool among emergency department providers.","volume":"23","author":"Bowman","year":"2016","journal-title":"Acad Emerg Med"},{"issue":"S2","key":"zoi240485r15","doi-asserted-by":"publisher","first-page":"S7","DOI":"10.1089\/jpm.2017.0548","article-title":"Identifying the population with serious illness: the \u201cdenominator\u201d challenge.","volume":"21","author":"Kelley","year":"2018","journal-title":"J Palliat Med"},{"issue":"6","key":"zoi240485r16","doi-asserted-by":"publisher","first-page":"1137","DOI":"10.1016\/j.jpainsymman.2019.03.006","article-title":"Identifying older adults with serious illness: transitioning from ICD-9 to ICD-10.","volume":"57","author":"Kelley","year":"2019","journal-title":"J Pain Symptom Manage"},{"issue":"23","key":"zoi240485r17","doi-asserted-by":"publisher","first-page":"2028","DOI":"10.1001\/jama.2023.8812","article-title":"Intervention to promote communication about goals of care for hospitalized patients with serious illness: a randomized clinical trial.","volume":"329","author":"Curtis","year":"2023","journal-title":"JAMA"},{"issue":"S1","key":"zoi240485r18","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1089\/jpm.2019.0142","article-title":"Population-based pragmatic trial of advance care planning in primary care in the University of California Health System.","volume":"22","author":"Walling","year":"2019","journal-title":"J Palliat Med"},{"issue":"6","key":"zoi240485r19","doi-asserted-by":"publisher","first-page":"1829","DOI":"10.1111\/jgs.v71.6","article-title":"Automatable end-of-life screening for older adults in the emergency department using electronic health records.","volume":"71","author":"Haimovich","year":"2023","journal-title":"J Am Geriatr Soc"},{"issue":"4","key":"zoi240485r20","doi-asserted-by":"publisher","DOI":"10.1161\/CIRCOUTCOMES.121.008487","article-title":"Generalizability of cardiovascular disease clinical prediction models: 158 independent external validations of 104 unique models.","volume":"15","author":"Gulati","year":"2022","journal-title":"Circ Cardiovasc Qual Outcomes"},{"issue":"1","key":"zoi240485r21","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1097\/CCM.0000000000005712","article-title":"External validation of mortality prediction models for critical illness reveals preserved discrimination but poor calibration.","volume":"51","author":"Cox","year":"2023","journal-title":"Crit Care Med"},{"key":"zoi240485r22","doi-asserted-by":"publisher","DOI":"10.1136\/bmj-2021-069881","article-title":"Clinical prediction models for mortality in patients with covid-19: external validation and individual participant data meta-analysis.","volume":"378","author":"de Jong","year":"2022","journal-title":"BMJ"},{"key":"zoi240485r23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12916-014-0241-z","article-title":"Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement.","volume":"13","author":"Collins","year":"2015","journal-title":"BMC Med"},{"issue":"11","key":"zoi240485r24","doi-asserted-by":"publisher","first-page":"1389","DOI":"10.1109\/LSP.2014.2337313","article-title":"Fast implementation of DeLong\u2019s algorithm for comparing the areas under correlated receiver operating characteristic curves.","volume":"21","author":"Sun","year":"2014","journal-title":"IEEE Signal Process Lett"},{"issue":"6","key":"zoi240485r25","doi-asserted-by":"publisher","DOI":"10.1001\/jamahealthforum.2023.1197","article-title":"Awareness of racial and ethnic bias and potential solutions to address bias with use of health care algorithms.","volume":"4","author":"Jain","year":"2023","journal-title":"JAMA Health Forum"},{"issue":"10","key":"zoi240485r26","doi-asserted-by":"publisher","first-page":"1359","DOI":"10.1377\/hlthaff.2023.00553","article-title":"Mitigating racial and ethnic bias and advancing health equity in clinical algorithms: a scoping review.","volume":"42","author":"Cary","year":"2023","journal-title":"Health Aff (Millwood)"},{"issue":"8","key":"zoi240485r27","doi-asserted-by":"publisher","DOI":"10.1161\/CIRCOUTCOMES.121.007858","article-title":"External validations of cardiovascular clinical prediction models: a large-scale review of the literature.","volume":"14","author":"Wessler","year":"2021","journal-title":"Circ Cardiovasc Qual Outcomes"},{"key":"zoi240485r28","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1186\/s41512-016-0002-x","article-title":"Validation and updating of risk models based on multinomial logistic regression.","volume":"1","author":"Van Calster","year":"2017","journal-title":"Diagn Progn Res"},{"issue":"7","key":"zoi240485r29","doi-asserted-by":"publisher","first-page":"822","DOI":"10.1111\/acem.2017.24.issue-7","article-title":"Predicting mortality in the emergency department: external validation and derivation of a clinical prediction tool.","volume":"24","author":"Moman","year":"2017","journal-title":"Acad Emerg Med"},{"issue":"1","key":"zoi240485r30","doi-asserted-by":"publisher","first-page":"214","DOI":"10.1186\/s12911-020-01235-6","article-title":"Development, implementation, and prospective validation of a model to predict 60-day end-of-life in hospitalized adults upon admission at three sites.","volume":"20","author":"Major","year":"2020","journal-title":"BMC Med Inform Decis Mak"},{"key":"zoi240485r31","doi-asserted-by":"publisher","DOI":"10.1056\/CAT.20.0655","article-title":"Supporting acute advance care planning with precise, timely mortality risk predictions.","author":"Wang","journal-title":"NEJM Cat"},{"issue":"10","key":"zoi240485r32","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2019.15997","article-title":"Machine learning approaches to predict 6-month mortality among patients with cancer.","volume":"2","author":"Parikh","year":"2019","journal-title":"JAMA Netw Open"},{"issue":"5","key":"zoi240485r33","doi-asserted-by":"publisher","first-page":"591","DOI":"10.1001\/jamaoncol.2015.5252","article-title":"Emergency department\u2013initiated palliative care in advanced cancer: a randomized clinical trial.","volume":"2","author":"Grudzen","year":"2016","journal-title":"JAMA Oncol"},{"issue":"6","key":"zoi240485r34","doi-asserted-by":"publisher","first-page":"521","DOI":"10.1016\/j.jpainsymman.2023.01.024","article-title":"The team-based serious illness care program, a qualitative evaluation of implementation and teaming.","volume":"65","author":"Garcia","year":"2023","journal-title":"J Pain Symptom Manage"},{"issue":"4","key":"zoi240485r35","doi-asserted-by":"publisher","first-page":"426","DOI":"10.1016\/j.annemergmed.2016.09.018","article-title":"Emergency department visits without hospitalization are associated with functional decline in older persons.","volume":"69","author":"Nagurney","year":"2017","journal-title":"Ann Emerg Med"},{"issue":"6","key":"zoi240485r36","doi-asserted-by":"publisher","first-page":"878","DOI":"10.1016\/j.jpainsymman.2018.09.003","article-title":"Fidelity and feasibility of a brief emergency department intervention to empower adults with serious illness to initiate advance care planning conversations.","volume":"56","author":"Leiter","year":"2018","journal-title":"J Pain Symptom Manage"},{"issue":"4","key":"zoi240485r37","doi-asserted-by":"publisher","first-page":"527","DOI":"10.1016\/j.annemergmed.2023.05.010","article-title":"Advance care planning billing claims by emergency physicians.","volume":"82","author":"Haimovich","year":"2023","journal-title":"Ann Emerg Med"},{"issue":"1","key":"zoi240485r38","doi-asserted-by":"publisher","first-page":"866","DOI":"10.1186\/s13063-022-06797-6","article-title":"Emergency department\u2013based, nurse-initiated, serious illness conversation intervention for older adults: a protocol for a randomized controlled trial.","volume":"23","author":"Prachanukool","year":"2022","journal-title":"Trials"},{"issue":"4","key":"zoi240485r39","doi-asserted-by":"publisher","first-page":"517","DOI":"10.1089\/jpm.2022.0136","article-title":"Assessing the acceptability and feasibility of leveraging emergency department social workers\u2019 advanced communication skills to assess elderly patients\u2019 goals and values.","volume":"26","author":"Aaronson","year":"2023","journal-title":"J Palliat Med"},{"issue":"2","key":"zoi240485r40","doi-asserted-by":"publisher","first-page":"372","DOI":"10.1016\/j.jpainsymman.2019.09.020","article-title":"End-of-life care, palliative care consultation, and palliative care referral in the emergency department: a systematic review.","volume":"59","author":"Wilson","year":"2020","journal-title":"J Pain Symptom Manage"},{"issue":"3","key":"zoi240485r42","doi-asserted-by":"publisher","first-page":"e281","DOI":"10.1016\/j.jpainsymman.2021.08.002","article-title":"Arranging hospice care from the emergency department: a single center retrospective study.","volume":"63","author":"Rege","year":"2022","journal-title":"J Pain Symptom Manage"},{"issue":"1","key":"zoi240485r43","doi-asserted-by":"publisher","first-page":"170","DOI":"10.1038\/s41746-023-00913-9","article-title":"Considerations for addressing bias in artificial intelligence for health equity.","volume":"6","author":"Abr\u00e0moff","year":"2023","journal-title":"NPJ Digit Med"},{"issue":"1","key":"zoi240485r44","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1038\/s41746-022-00556-2","article-title":"Enhancing serious illness communication using artificial intelligence.","volume":"5","author":"Chua","year":"2022","journal-title":"NPJ Digit Med"},{"issue":"12","key":"zoi240485r45","doi-asserted-by":"publisher","DOI":"10.1001\/jamaoncol.2020.4759","article-title":"Effect of integrating machine learning mortality estimates with behavioral nudges to clinicians on serious illness conversations among patients with cancer: a stepped-wedge cluster randomized clinical trial.","volume":"6","author":"Manz","year":"2020","journal-title":"JAMA Oncol"},{"key":"zoi240485r41","unstructured":"Kelen? GD, Wolfe? R, D\u2019Onofrio? G, . Emergency department crowding: the canary in the health care system. NEJM Catal. September 28, 2021. Accessed December 13, 2022. https:\/\/catalyst.nejm.org\/doi\/full\/10.1056\/CAT.21.0217"}],"container-title":["JAMA Network Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/articlepdf\/2819339\/haimovich_2024_oi_240485_1716387859.943.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,31]],"date-time":"2024-05-31T15:33:02Z","timestamp":1717169582000},"score":1,"resource":{"primary":{"URL":"https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/fullarticle\/2819339"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,31]]},"references-count":45,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2024,5,1]]}},"URL":"https:\/\/doi.org\/10.1001\/jamanetworkopen.2024.14213","relation":{},"ISSN":["2574-3805"],"issn-type":[{"value":"2574-3805","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,31]]}}}