{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,23]],"date-time":"2026-10-23T03:19:38Z","timestamp":1792725578718,"version":"4.5.0"},"reference-count":33,"publisher":"American Medical Association (AMA)","issue":"7","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JAMA Netw Open"],"abstract":"Importance<\/jats:title>Goal-concordant care (GCC) is recognized as the highest quality of care and most important outcome measure for serious illness research, yet practical methods for measuring it are lacking.<\/jats:p><\/jats:sec>Objective<\/jats:title>To measure GCC using clinical notes in patients\u2019 medical records.<\/jats:p><\/jats:sec>Design, Setting, and Participants<\/jats:title>This longitudinal cohort study involved a retrospective medical record review in 3 urban hospitals in a single health system. Participants included adults with a hospital encounter of 3 or more days between April 1 and July 31, 2019, and 50% or higher predicted 6-month mortality risk. Data abstraction occurred from July 2021 through June 2022.<\/jats:p><\/jats:sec>Exposure<\/jats:title>Acute care hospitalization and a 50% or higher predicted 6-month mortality risk.<\/jats:p><\/jats:sec>Main Outcomes and Measures<\/jats:title>Pairs of clinicians independently reviewed clinical notes from admission through 6 months or death to classify the care received during each epoch between patients\u2019 documented goals of care (GOC) discussions, into 1 of 4 categories: (1) comfort focused, (2) maintain or improve function, (3) life extension, or (4) unclear. The GOC discussions had been previously classified using the same 4 categories. The primary study outcome was GCC, defined as the alignment of classification of care received and GOC. Secondary outcomes included goal-discordant care, if GOC and care-received classifications were misaligned, and uncertain concordance, if either care received or GOC was classified as unclear or GOC were not documented. Interrater reliability for classification of care received was assessed using Cohen \u03ba statistics.<\/jats:p><\/jats:sec>Results<\/jats:title>Among 109 patients (53 female [49%]), the median (IQR) age was 70 (63-79) years. The most common serious illnesses were cardiac disease (76 patients [70%]), metastatic cancer (50 patients [45%]), and chronic kidney disease (42 patients [39%]). Interrater reliability for care-received classification was almost perfect (95% interrater agreement, Cohen \u03ba\u2009=\u20090.92; 95% CI, 0.86-0.99). A total of 398 epochs of care were identified, 198 (50%) of which were classified as goal concordant. Of the remaining 200 epochs, 74 (19%) were classified as goal discordant and 126 (32%) of uncertain concordance. During at least 1 epoch of care over the 6-month follow-up, 85 patients (78%) received care of uncertain concordance and 43 (39%) received goal-discordant care.<\/jats:p><\/jats:sec>Conclusions and Relevance<\/jats:title>In this cohort study of seriously ill adults, GCC was measured using clinical notes alone. These findings can inform automated text-based classification methods to improve the efficiency and scalability of this method and facilitate pragmatic and reliable measurement of GCC in serious illness research and quality improvement efforts.<\/jats:p><\/jats:sec>","DOI":"10.1001\/jamanetworkopen.2025.18967","type":"journal-article","created":{"date-parts":[[2025,7,3]],"date-time":"2025-07-03T15:31:06Z","timestamp":1751556666000},"page":"e2518967","source":"Crossref","is-referenced-by-count":8,"title":["Measuring Goal-Concordant Care Using Electronic Clinical Notes"],"prefix":"10.1001","volume":"8","author":[{"given":"Catherine L.","family":"Auriemma","sequence":"first","affiliation":[{"name":"Division of Pulmonary, Allergy, and Critical Care, Hospital of the University of Pennsylvania, Philadelphia"},{"name":"Palliative and Advanced Illness Research Center, University of Pennsylvania, Philadelphia"},{"name":"Department of Medicine, University of Pennsylvania, Philadelphia"},{"name":"Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anne","family":"Song","sequence":"additional","affiliation":[{"name":"Palliative and Advanced Illness Research Center, University of Pennsylvania, Philadelphia"},{"name":"Department of Medicine, University of Pennsylvania, Philadelphia"},{"name":"Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lake","family":"Walsh","sequence":"additional","affiliation":[{"name":"Division of Internal Medicine and Primary Care, Brigham and Women\u2019s Hospital, Boston, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jason","family":"Han","sequence":"additional","affiliation":[{"name":"Department of Surgery, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sophia","family":"Yapalater","sequence":"additional","affiliation":[{"name":"Supportive Oncology and Palliative Care Program, Fox Chase Cancer Center, Temple University Health System, Philadelphia, Pennsylvania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Bain","sequence":"additional","affiliation":[{"name":"Division of Pulmonary and Critical Care, New York University-Langone, New York, New York"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lindsay","family":"Haines","sequence":"additional","affiliation":[{"name":"Department of Medicine, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stefania","family":"Scott","sequence":"additional","affiliation":[{"name":"Palliative and Advanced Illness Research Center, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Casey","family":"Whitman","sequence":"additional","affiliation":[{"name":"Palliative and Advanced Illness Research Center, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephanie","family":"Parks Taylor","sequence":"additional","affiliation":[{"name":"Division of Hospital Medicine, University of Michigan, Ann Arbor"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gary E.","family":"Weissman","sequence":"additional","affiliation":[{"name":"Palliative and Advanced Illness Research Center, University of Pennsylvania, Philadelphia"},{"name":"Department of Medicine, University of Pennsylvania, Philadelphia"},{"name":"Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew J.","family":"Gonzales","sequence":"additional","affiliation":[{"name":"The Institute for Human Caring at Providence, Gardena, California"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Roshanthi","family":"Weerasinghe","sequence":"additional","affiliation":[{"name":"Providence Health Research Accelerator, Portland, Oregon"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Staci J.","family":"Wendt","sequence":"additional","affiliation":[{"name":"Providence Health Research Accelerator, Portland, Oregon"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Katherine R.","family":"Courtright","sequence":"additional","affiliation":[{"name":"Palliative and Advanced Illness Research Center, University of Pennsylvania, Philadelphia"},{"name":"Department of Medicine, University of Pennsylvania, Philadelphia"},{"name":"Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"10","published-online":{"date-parts":[[2025,7,3]]},"reference":[{"issue":"12","key":"zoi250590r1","doi-asserted-by":"publisher","first-page":"1994","DOI":"10.1001\/jamainternmed.2014.5271","article-title":"Communication about serious illness care goals: a review and synthesis of best practices.","volume":"174","author":"Bernacki","year":"2014","journal-title":"JAMA Intern Med"},{"issue":"4","key":"zoi250590r2","doi-asserted-by":"publisher","first-page":"773","DOI":"10.1016\/j.jpainsymman.2015.01.012","article-title":"Measuring what matters: top-ranked quality indicators for hospice and palliative care from the American Academy of Hospice and Palliative Medicine and Hospice and Palliative Nurses Association.","volume":"49","author":"Dy","year":"2015","journal-title":"J Pain Symptom Manage"},{"issue":"3","key":"zoi250590r3","doi-asserted-by":"publisher","first-page":"472","DOI":"10.1097\/CCM.0000000000004876","article-title":"Choosing wisely for critical care: the next five.","volume":"49","author":"Zimmerman","year":"2021","journal-title":"Crit Care Med"},{"issue":"2","key":"zoi250590r7","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1016\/j.jpainsymman.2017.08.025","article-title":"Outcomes that define successful advance care planning: a Delphi panel consensus.","volume":"55","author":"Sudore","year":"2018","journal-title":"J Pain Symptom Manage"},{"issue":"12","key":"zoi250590r8","doi-asserted-by":"publisher","first-page":"1847","DOI":"10.1007\/s00134-017-4873-2","article-title":"Goal-concordant care in the ICU: a conceptual framework for future research.","volume":"43","author":"Turnbull","year":"2017","journal-title":"Intensive Care Med"},{"issue":"S2","key":"zoi250590r9","doi-asserted-by":"publisher","first-page":"S17","DOI":"10.1089\/jpm.2017.0459","article-title":"Achieving goal-concordant care: a conceptual model and approach to measuring serious illness communication and its impact.","volume":"21","author":"Sanders","year":"2018","journal-title":"J Palliat Med"},{"issue":"17","key":"zoi250590r10","doi-asserted-by":"publisher","first-page":"1603","DOI":"10.1056\/NEJMp1908153","article-title":"Goal-concordant care: searching for the holy grail.","volume":"381","author":"Halpern","year":"2019","journal-title":"N Engl J Med"},{"issue":"3","key":"zoi250590r11","doi-asserted-by":"publisher","first-page":"e305","DOI":"10.1016\/j.jpainsymman.2021.02.030","article-title":"Measuring goal-concordant care in palliative care research.","volume":"62","author":"Ernecoff","year":"2021","journal-title":"J Pain Symptom Manage"},{"issue":"11","key":"zoi250590r12","doi-asserted-by":"publisher","first-page":"667","DOI":"10.12788\/jhm.3714","article-title":"Deficits in identification of goals and goal-concordant care after sepsis hospitalization.","volume":"16","author":"Parks Taylor","year":"2021","journal-title":"J Hospital Med"},{"key":"zoi250590r13","doi-asserted-by":"publisher","first-page":"210","DOI":"10.1200\/JCO.2022.40.28_suppl.210","article-title":"Meaningful measures for advanced cancer: building a measure set to gpromote goal-concordant care.","volume":"40","author":"Landrum","year":"2022","journal-title":"J Clin Oncol"},{"issue":"4","key":"zoi250590r14","doi-asserted-by":"publisher","first-page":"765","DOI":"10.1016\/j.jpainsymman.2020.04.026","article-title":"Patient-reported receipt of goal-concordant care among seriously ill outpatients: prevalence and associated factors.","volume":"60","author":"Modes","year":"2020","journal-title":"J Pain Symptom Manage"},{"issue":"4","key":"zoi250590r15","doi-asserted-by":"publisher","first-page":"410","DOI":"10.1016\/j.jpainsymman.2022.06.004","article-title":"Seriously ill patients\u2019 prioritized goals and their clinicians\u2019 perceptions of those goals.","volume":"64","author":"Modes","year":"2022","journal-title":"J Pain Symptom Manage"},{"issue":"3","key":"zoi250590r16","doi-asserted-by":"publisher","first-page":"e199","DOI":"10.1016\/j.jpainsymman.2022.11.002","article-title":"Determining goal concordant care in the intensive care unit using electronic health records.","volume":"65","author":"Ahmad","year":"2023","journal-title":"J Pain Symptom Manage"},{"issue":"12","key":"zoi250590r17","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2015-009403","article-title":"How do we deal with multiple goals for care within an individual patient trajectory? a document content analysis of health service research papers on goals for care.","volume":"5","author":"Berntsen","year":"2015","journal-title":"BMJ Open"},{"issue":"10","key":"zoi250590r18","doi-asserted-by":"publisher","first-page":"1839","DOI":"10.1007\/s11606-024-08773-z","article-title":"Classification of documented goals of care among hospitalized patients with high mortality risk: a mixed-methods feasibility study.","volume":"39","author":"Auriemma","year":"2024","journal-title":"J Gen Intern Med"},{"issue":"4","key":"zoi250590r19","doi-asserted-by":"publisher","first-page":"344","DOI":"10.1016\/j.jclinepi.2007.11.008","article-title":"The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies.","volume":"61","author":"von Elm","year":"2008","journal-title":"J Clin Epidemiol"},{"issue":"9","key":"zoi250590r20","doi-asserted-by":"publisher","first-page":"1841","DOI":"10.1007\/s11606-019-05169-2","article-title":"Electronic health record mortality prediction model for targeted palliative care among hospitalized medical patients: a pilot quasi-experimental study.","volume":"34","author":"Courtright","year":"2019","journal-title":"J Gen Intern Med"},{"issue":"5","key":"zoi250590r21","doi-asserted-by":"publisher","first-page":"1559","DOI":"10.1007\/s11606-019-05446-0","article-title":"Use and meaning of \u201cgoals of care\u201d in the healthcare literature: a systematic review and qualitative discourse analysis.","volume":"35","author":"Secunda","year":"2020","journal-title":"J Gen Intern Med"},{"issue":"8","key":"zoi250590r22","doi-asserted-by":"publisher","first-page":"1116","DOI":"10.1007\/s00134-019-05562-9","article-title":"Eight things we would never do regarding end-of-life care in the ICU.","volume":"45","author":"Ely","year":"2019","journal-title":"Intensive Care Med"},{"issue":"7","key":"zoi250590r23","doi-asserted-by":"publisher","first-page":"1085","DOI":"10.1001\/jamainternmed.2014.1183","article-title":"Stability of end-of-life preferences: a systematic review of the evidence.","volume":"174","author":"Auriemma","year":"2014","journal-title":"JAMA Intern Med"},{"issue":"1","key":"zoi250590r24","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1001\/jamainternmed.2017.6313","article-title":"Care planning for inpatients referred for palliative care consultation.","volume":"178","author":"Bischoff","year":"2018","journal-title":"JAMA Intern Med"},{"issue":"1","key":"zoi250590r25","doi-asserted-by":"publisher","first-page":"e15","DOI":"10.1016\/j.jpainsymman.2022.08.015","article-title":"Pro-active palliative care for hospitalized primary care patients.","volume":"65","author":"Lien","year":"2023","journal-title":"J Pain Symptom Manage"},{"issue":"1","key":"zoi250590r26","doi-asserted-by":"publisher","first-page":"136","DOI":"10.1016\/j.jpainsymman.2020.08.024","article-title":"Identifying goals of care conversations in the electronic health record using natural language processing and machine learning.","volume":"61","author":"Lee","year":"2021","journal-title":"J Pain Symptom Manage"},{"issue":"2","key":"zoi250590r27","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1177\/0269216318810421","article-title":"Deep learning algorithms to identify documentation of serious illness conversations during intensive care unit admissions.","volume":"33","author":"Chan","year":"2019","journal-title":"Palliat Med"},{"issue":"4","key":"zoi250590r28","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1186\/s12911-018-0677-8","article-title":"Improving palliative care with deep learning.","volume":"18","author":"Avati","year":"2018","journal-title":"BMC Med Inform Decis Mak"},{"key":"zoi250590r29","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2024.104618","article-title":"Detecting goals of care conversations in clinical notes with active learning.","volume":"151","author":"Weissenbacher","year":"2024","journal-title":"J Biomed Inform"},{"issue":"S2","key":"zoi250590r30","doi-asserted-by":"publisher","first-page":"S52","DOI":"10.1089\/jpm.2017.0542","article-title":"Using electronic health records for quality measurement and accountability in care of the seriously ill: opportunities and challenges.","volume":"21","author":"Curtis","year":"2018","journal-title":"J Palliat Med"},{"issue":"3","key":"zoi250590r31","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2023.1204","article-title":"Assessment of natural language processing of electronic health records to measure goals-of-care discussions as a clinical trial outcome.","volume":"6","author":"Lee","year":"2023","journal-title":"JAMA Netw Open"},{"issue":"1","key":"zoi250590r32","doi-asserted-by":"publisher","first-page":"17885","DOI":"10.1038\/s41598-023-45223-y","article-title":"A vignette-based evaluation of ChatGPT\u2019s ability to provide appropriate and equitable medical advice across care contexts.","volume":"13","author":"Nastasi","year":"2023","journal-title":"Sci Rep"},{"issue":"1","key":"zoi250590r33","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1093\/jamia\/ocab248","article-title":"Development and validation of a prediction model for actionable aspects of frailty in the text of clinicians\u2019 encounter notes.","volume":"29","author":"Martin","year":"2021","journal-title":"J Am Med Inform Assoc"},{"key":"zoi250590r4","unstructured":"American Society for Radiation Oncology. Five things physicians and patients should question. Choosing Wisely: An Initiative of the ABIM Foundation. September 23, 2013. Accessed April 9, 2024. https:\/\/www.oregonclinic.com\/wp-content\/uploads\/2023\/07\/ASTRO-Choosing-Wisely-five-things-to-question.pdf"},{"key":"zoi250590r5","unstructured":"Commission on Cancer. Five things physicians and patients should question. Choosing wisely: an initiative of the ABIM Foundation. 2012. Accessed April 9, 2024. https:\/\/www.aabb.org\/docs\/default-source\/default-document-library\/resources\/choosing-wisely-five-things-physicians-and-patients-should-question.pdf"},{"key":"zoi250590r6","unstructured":"Institute of Medicine. Dying in America: improving quality and honoring individual preferences near the end of life. April 19, 2015. Accessed May 27, 2025. https:\/\/nap.nationalacademies.org\/catalog\/18748\/dying-in-america-improving-quality-and-honoring-individual-preferences-near"}],"container-title":["JAMA Network Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/articlepdf\/2836019\/auriemma_2025_oi_250590_1750958607.90361.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,3]],"date-time":"2025-07-03T15:31:08Z","timestamp":1751556668000},"score":1,"resource":{"primary":{"URL":"https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/fullarticle\/2836019"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,3]]},"references-count":33,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2025,7,1]]}},"URL":"https:\/\/doi.org\/10.1001\/jamanetworkopen.2025.18967","relation":{},"ISSN":["2574-3805"],"issn-type":[{"value":"2574-3805","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,3]]}}}