{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T11:22:39Z","timestamp":1787311359610,"version":"build-2736575974"},"reference-count":45,"publisher":"American Society of Clinical Oncology (ASCO)","issue":"11","content-domain":{"domain":["ascopubs.org"],"crossmark-restriction":true},"short-container-title":["JCO Glob Oncol"],"published-print":{"date-parts":[[2025,4]]},"abstract":"<jats:sec>\n                    <jats:title>PURPOSE<\/jats:title>\n                    <jats:p>This study aimed to differentiate nonscheduled visits (NSVs) in an outpatient palliative care setting that are driven by or accompanied by uncontrolled symptoms from those that are administrative or routine, such as prescription refills and examination readings. A small language model (SLM) was used to enhance the detection and management of symptoms, thus improving health care resource allocation.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>METHODS<\/jats:title>\n                    <jats:p>A retrospective analysis was performed on 25,867 patient visits to an outpatient palliative care unit, including 7,036 NSVs. A stratified random sample of 384 NSVs was reviewed to determine the presence of symptoms, using physician audits as the gold standard. A Phi-3\u2013based SLM was validated against these audits to assess its accuracy in detecting the symptoms. The validated SLM was then applied to the entire NSV data set to identify symptom patterns. Multivariate linear regression was used to analyze the association of age, cancer type, and insurance category with the presence of symptoms.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>RESULTS<\/jats:title>\n                    <jats:p>SLM demonstrated high sensitivity (99.4%) and accuracy (95.3%) in identifying symptom-driven NSVs. The analysis revealed that 85.7% of the NSVs were driven by symptoms, indicating a significant hidden burden of unmanaged symptoms. The study found that certain demographic and clinical factors, including younger age groups and specific cancer types, were significantly associated with an increased symptom burden.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>CONCLUSION<\/jats:title>\n                    <jats:p>This study highlights the substantial burden of symptom-driven NSVs in palliative care and demonstrates the effectiveness of using a SLM to identify and manage symptoms. Implementing such models in clinical practice can improve patient care by optimizing the allocation of health care resources and tailoring interventions to the needs of patients with advanced illnesses.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1200\/go-24-00432","type":"journal-article","created":{"date-parts":[[2025,4,4]],"date-time":"2025-04-04T15:59:39Z","timestamp":1743782379000},"update-policy":"https:\/\/doi.org\/10.1200\/crossmark","source":"Crossref","is-referenced-by-count":4,"title":["Leveraging Artificial Intelligence to Uncover Symptom Burden in Palliative Care: Analysis of Nonscheduled Visits Using a Phi-3 Small Language Model"],"prefix":"10.1200","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7051-0362","authenticated-orcid":true,"given":"Javier","family":"Retamales","sequence":"first","affiliation":[{"name":"Hospital Sotero del R\u00edo, Santiago, Chile"},{"name":"Grupo Oncologico Cooperativo Chileno de Investigacion\u2014GOCCHI, Santiago, Chile"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Juan Pablo","family":"Retamales","sequence":"additional","affiliation":[{"name":"QJV, Santiago, Chile"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ana Maria","family":"Demarchi","sequence":"additional","affiliation":[{"name":"Hospital Sotero del R\u00edo, Santiago, Chile"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marcela","family":"Gonzalez","sequence":"additional","affiliation":[{"name":"Hospital Sotero del R\u00edo, Santiago, Chile"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Caroll","family":"Lopez","sequence":"additional","affiliation":[{"name":"Hospital Sotero del R\u00edo, Santiago, Chile"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nina","family":"Ramirez","sequence":"additional","affiliation":[{"name":"Hospital Sotero del R\u00edo, Santiago, Chile"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tamara","family":"Retamal","sequence":"additional","affiliation":[{"name":"Hospital Sotero del R\u00edo, Santiago, Chile"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3129-4235","authenticated-orcid":true,"given":"Virginia","family":"Sun","sequence":"additional","affiliation":[{"name":"City of Hope Comprehensive Cancer Center, Duarte, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"233","reference":[{"key":"e_1_3_6_2_2","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.19.00470"},{"key":"e_1_3_6_3_2","doi-asserted-by":"publisher","DOI":"10.1177\/1049909120922779"},{"key":"e_1_3_6_4_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpainsymman.2014.07.007"},{"key":"e_1_3_6_5_2","doi-asserted-by":"publisher","DOI":"10.1089\/jpm.2006.0155"},{"key":"e_1_3_6_6_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1945-1474.2009.00025.x"},{"key":"e_1_3_6_7_2","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.22.02532"},{"key":"e_1_3_6_8_2","doi-asserted-by":"publisher","DOI":"10.1089\/jpm.2017.0548"},{"key":"e_1_3_6_9_2","doi-asserted-by":"publisher","DOI":"10.1370\/afm.1919"},{"key":"e_1_3_6_10_2","doi-asserted-by":"publisher","DOI":"10.1111\/jgs.12105"},{"key":"e_1_3_6_11_2","doi-asserted-by":"publisher","DOI":"10.1186\/1472-6963-12-424"},{"key":"e_1_3_6_12_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00520-012-1459-y"},{"key":"e_1_3_6_13_2","unstructured":"Atlas of palliative care in Latin America. https:\/\/cuidadospaliativos.org\/uploads\/2013\/12\/Atlas%20of%20Palliative%20Care%20in%20Latin%20America.pdf"},{"key":"e_1_3_6_14_2","doi-asserted-by":"publisher","unstructured":"Taylor N Ghose U Rohanian O et al: Efficiency at scale: Investigating the performance of diminutive language models in clinical tasks. arXiv 10.48550\/arXiv.2402.10597","DOI":"10.48550\/arXiv.2402.10597"},{"key":"e_1_3_6_15_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1937-5956.2010.01210.x"},{"key":"e_1_3_6_16_2","doi-asserted-by":"publisher","DOI":"10.1089\/apc.2010.0086"},{"key":"e_1_3_6_17_2","doi-asserted-by":"publisher","DOI":"10.1002\/pon.1996"},{"key":"e_1_3_6_18_2","unstructured":"Papers with code\u2014MMLU benchmark (multi-task language understanding). https:\/\/paperswithcode.com\/sota\/multi-task-language-understanding-on-mmlu"},{"key":"e_1_3_6_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.athoracsur.2019.08.030"},{"key":"e_1_3_6_20_2","doi-asserted-by":"publisher","DOI":"10.1136\/bmjspcare-2015-000850"},{"key":"e_1_3_6_21_2","doi-asserted-by":"publisher","DOI":"10.1089\/jpm.2011.0403"},{"key":"e_1_3_6_22_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00520-005-0009-2"},{"key":"e_1_3_6_23_2","doi-asserted-by":"publisher","DOI":"10.2196\/13809"},{"key":"e_1_3_6_24_2","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.2015.63.0830"},{"key":"e_1_3_6_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpainsymman.2019.09.017"},{"key":"e_1_3_6_26_2","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocae045"},{"key":"e_1_3_6_27_2","doi-asserted-by":"publisher","DOI":"10.15265\/IY-2017-029"},{"key":"e_1_3_6_28_2","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.23.02439"},{"key":"e_1_3_6_29_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-020-0304-9"},{"key":"e_1_3_6_30_2","article-title":"Implementing standard diagnosis and treatment for locally advanced breast cancer through global research in Latin America: Results from a multicountry pragmatic trial","author":"Retamales J","unstructured":"Retamales J, Daneri-Navarro A, Artagaveytia N, et al: Implementing standard diagnosis and treatment for locally advanced breast cancer through global research in Latin America: Results from a multicountry pragmatic trial. JCO Glob Oncol 10.1200\/GO.23.00216","journal-title":"JCO Glob Oncol"},{"key":"e_1_3_6_31_2","doi-asserted-by":"publisher","DOI":"10.1136\/emermed-2016-205709"},{"key":"e_1_3_6_32_2","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2018-028257"},{"key":"e_1_3_6_33_2","doi-asserted-by":"publisher","DOI":"10.1093\/sw\/swz045"},{"key":"e_1_3_6_34_2","first-page":"856","article-title":"Artificial intelligence for mental health care: Clinical applications, barriers, facilitators, and artificial wisdom","volume":"6","author":"Lee EE","year":"2021","unstructured":"Lee EE, Torous J, De Choudhury M, et al: Artificial intelligence for mental health care: Clinical applications, barriers, facilitators, and artificial wisdom. Biol Psychiatry Cogn Neurosci Neuroimaging 6:856-864, 2021","journal-title":"Biol Psychiatry Cogn Neurosci Neuroimaging"},{"key":"e_1_3_6_35_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12916-019-1426-2"},{"key":"e_1_3_6_36_2","first-page":"e39305","article-title":"Embracing large language models for medical applications: Opportunities and challenges","volume":"15","author":"Karabacak M","year":"2023","unstructured":"Karabacak M, Margetis K: Embracing large language models for medical applications: Opportunities and challenges. Cureus 15:e39305, 2023","journal-title":"Cureus"},{"key":"e_1_3_6_37_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-019-0651-8"},{"key":"e_1_3_6_38_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamainternmed.2018.3763"},{"key":"e_1_3_6_39_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-018-0677-8"},{"key":"e_1_3_6_40_2","unstructured":"ASCO AI principles 2024. https:\/\/society.asco.org\/sites\/new-www.asco.org\/files\/ASCO-AI-Principles-2024.pdf"},{"key":"e_1_3_6_41_2","doi-asserted-by":"publisher","DOI":"10.1177\/08404704221139383"},{"key":"e_1_3_6_42_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10278-021-00525-3"},{"key":"e_1_3_6_43_2","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.2005.12.181"},{"key":"e_1_3_6_44_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2021.102111"},{"key":"e_1_3_6_45_2","doi-asserted-by":"publisher","unstructured":"Chen F Lu HL Simonetti A: Practical statistical considerations for the clinical validation of AI\/ML-enabled medical diagnostic devices. arXiv 10.48550\/arXiv.2303.05399","DOI":"10.48550\/arXiv.2303.05399"},{"key":"e_1_3_6_46_2","doi-asserted-by":"publisher","DOI":"10.1200\/JCO.2008.18.2162"}],"container-title":["JCO Global Oncology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/ascopubs.org\/doi\/pdfdirect\/10.1200\/GO-24-00432","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,4,4]],"date-time":"2025-04-04T16:00:00Z","timestamp":1743782400000},"score":1,"resource":{"primary":{"URL":"https:\/\/ascopubs.org\/doi\/10.1200\/GO-24-00432"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4]]},"references-count":45,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2025,4]]}},"alternative-id":["10.1200\/GO-24-00432"],"URL":"https:\/\/doi.org\/10.1200\/go-24-00432","relation":{},"ISSN":["2687-8941"],"issn-type":[{"value":"2687-8941","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4]]},"assertion":[{"value":"2024-08-30","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-02-08","order":1,"name":"revised","label":"Revised","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-02-24","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-04-04","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e2400432"}}