{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,14]],"date-time":"2026-08-14T21:30:15Z","timestamp":1786743015824,"version":"build-2736575974"},"reference-count":30,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Med Internet Res"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Early risk stratification in emergency medical services (EMS) is essential for patients presenting with acute cardiopulmonary symptoms, yet prehospital decision-making at the dispatch stage is often based on limited structured information. Free-text dispatch narratives may contain additional clinical signals, but their role in early risk assessment remains insufficiently characterized.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aims to develop and temporally validate a natural language processing\u2013assisted machine learning framework for early risk stratification using free-text EMS dispatch narratives and to evaluate its incremental value beyond conventional structured dispatch information.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n We conducted a population-based retrospective cohort study using EMS dispatch records from Nanning, China, between 2021 and 2025. Adult patients with suspected cardiopulmonary symptoms were identified based on predefined complaint keywords. After excluding nonmedical and incomplete records, 38,523 cases with available free-text narratives were included. To simulate real-world deployment, data from 2021 to 2024 (n=28,332) were used for model development, and 2025 data (n=10,191) served as an independent temporal test cohort. Dispatch narratives were processed using a natural language processing pipeline based on character-level n-grams and combined with structured variables (age, sex, call time) in a multimodal machine learning framework. The primary outcome was a composite prehospital critical outcome comprising death, clinical deterioration, or lack of response to initial treatment. Model performance was evaluated using area under the receiver operating characteristic curve (AUROC), area under the precision-recall curve, calibration, and decision curve analysis.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n Among the 38,523 included patients, 12,476 (32.4%) experienced the primary composite outcome. The median age was 68.0 (IQR 54.0\u201079.0) years, and 23,019 (59.8%) patients were male. In the temporally independent 2025 cohort, an expanded structured baseline model achieved an AUROC of 0.681 (95% CI 0.669\u20100.693). Incorporation of narrative features improved performance (AUROC 0.803, 95% CI 0.792\u20100.814), with marginal additional gain from multimodal integration (AUROC 0.808, 95% CI 0.798\u20100.818). The multimodal model achieved an area under the precision-recall curve of 0.630 (95% CI 0.611\u20100.651), substantially exceeding the no-skill baseline defined by the outcome prevalence in the temporal test cohort (2464\/10,191, 24.2%). Model performance remained consistent across age and sex subgroups, and calibration was acceptable (Brier score 0.1878). In a risk enrichment analysis, the top 10% (n=1019) of predicted high-risk cases accounted for 32.1% (n=791) of all critical outcomes, representing a 3.2-fold enrichment. Decision curve analysis indicated a higher net benefit compared with treat-all and treat-none strategies across a range of threshold probabilities.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n Free-text dispatch narratives contain clinically relevant information associated with early risk stratification in patients with suspected cardiopulmonary emergencies. Incorporating narrative-derived features into a structured modeling framework may complement existing EMS dispatch systems and support more informed decision-making prior to patient contact. Further external validation and prospective evaluation are warranted.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/97672","type":"journal-article","created":{"date-parts":[[2026,8,14]],"date-time":"2026-08-14T20:43:35Z","timestamp":1786740215000},"page":"e97672-e97672","source":"Crossref","is-referenced-by-count":0,"title":["Predicting Critical Outcomes in Suspected Cardiopulmonary Emergencies Using Dispatch Narratives: Temporal Validation Study"],"prefix":"10.2196","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-9945-1561","authenticated-orcid":false,"given":"Zhe","family":"Li","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-0921-4040","authenticated-orcid":false,"given":"Lei","family":"Shi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-5052-2271","authenticated-orcid":false,"given":"Chunting","family":"Luo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-5964-2069","authenticated-orcid":false,"given":"Siqi","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-9879-2445","authenticated-orcid":false,"given":"Jianmin","family":"Qin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-0655-2991","authenticated-orcid":false,"given":"Min","family":"Yao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-9417-9174","authenticated-orcid":false,"given":"Sanshan","family":"Zhu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-0513-6694","authenticated-orcid":false,"given":"Zhengzhuang","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-4405-5439","authenticated-orcid":false,"given":"Yinghua","family":"Nong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-8458-9778","authenticated-orcid":false,"given":"Guozheng","family":"Qiu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-8676-6163","authenticated-orcid":false,"given":"Liwen","family":"Lyu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,8,14]]},"reference":[{"issue":"22","key":"R1","doi-asserted-by":"publisher","first-page":"2135","DOI":"10.1016\/j.jacc.2024.11.009","article-title":"ACC\/AHA\/ACEP\/NAEMSP\/SCAI guideline for the management of patients with acute coronary syndromes: a report of the American College of Cardiology\/American Heart Association Joint Committee on Clinical Practice Guidelines","volume":"85","author":"Rao","journal-title":"J Am Coll Cardiol"},{"issue":"1","key":"R2","doi-asserted-by":"publisher","DOI":"10.1186\/s12873-025-01308-7","article-title":"Major medical events in patients with acute coronary syndrome during helicopter emergency medical service operations","volume":"25","author":"Ganter","journal-title":"BMC Emerg Med"},{"issue":"2","key":"R3","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1017\/S1049023X21000030","article-title":"Improving the appropriateness of advanced life support teams\u2019 dispatch: a before-after study","volume":"36","author":"Gamberini","journal-title":"Prehosp Disaster Med"},{"issue":"11","key":"R4","doi-asserted-by":"publisher","DOI":"10.3390\/jcm14113698","article-title":"AI-based predictive models for cardiogenic shock in STEMI: real-world data for early risk assessment and prognostic insights","volume":"14","author":"Stamate","journal-title":"J Clin Med"},{"issue":"3","key":"R5","doi-asserted-by":"publisher","first-page":"304","DOI":"10.1093\/ehjacc\/zuad157","article-title":"Diagnosis and treatment of right ventricular failure secondary to acutely increased right ventricular afterload (acute cor pulmonale): a clinical consensus statement of the association for acute cardiovascular care of the European Society of Cardiology","volume":"13","author":"Arrigo","journal-title":"Eur Heart J Acute Cardiovasc Care"},{"issue":"11","key":"R6","doi-asserted-by":"publisher","first-page":"1001","DOI":"10.1093\/eurjpc\/zwae281","article-title":"Global burden of cardiovascular diseases: projections from 2025 to 2050","volume":"32","author":"Chong","journal-title":"Eur J Prev Cardiol"},{"issue":"6","key":"R7","doi-asserted-by":"publisher","first-page":"633","DOI":"10.1001\/jamacardio.2021.0122","article-title":"Use of machine learning models to predict death after acute myocardial infarction","volume":"6","author":"Khera","journal-title":"JAMA Cardiol"},{"issue":"9","key":"R8","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2025.33962","article-title":"Incidence, diagnoses, and outcomes of pediatric nontraumatic chest pain attended by ambulance","volume":"8","author":"Okyere","journal-title":"JAMA Netw Open"},{"issue":"1","key":"R9","doi-asserted-by":"publisher","DOI":"10.1186\/s12245-024-00745-8","article-title":"Prehospital management and outcomes of patients calling with chest pain as the main complaint","volume":"17","author":"Ahmed","journal-title":"Int J Emerg Med"},{"key":"R10","doi-asserted-by":"publisher","DOI":"10.1016\/j.resplu.2021.100168","article-title":"Seizure-like activity at the onset of emergency medical service-witnessed out-of-hospital cardiac arrest: an observational study","volume":"8","author":"Murasaka","journal-title":"Resusc Plus"},{"key":"R11","doi-asserted-by":"publisher","DOI":"10.1016\/j.resuscitation.2022.07.014","article-title":"Israeli dispatchers\u2019 response time to out-of-hospital cardiac arrest emergency calls","volume":"178","author":"Jaffe","journal-title":"Resuscitation"},{"issue":"5","key":"R12","doi-asserted-by":"publisher","first-page":"687","DOI":"10.1080\/10903127.2022.2074180","article-title":"Identification of factors associated with return of spontaneous circulation after pediatric out-of-hospital cardiac arrest using natural language processing","volume":"27","author":"Harris","journal-title":"Prehosp Emerg Care"},{"issue":"4","key":"R13","doi-asserted-by":"publisher","DOI":"10.1002\/aet2.10707","article-title":"Using natural language processing to compare task\u2010specific verbal cues in coached versus noncoached cardiac arrest teams during simulated pediatrics resuscitation","volume":"5","author":"Jones","journal-title":"AEM Educ Train"},{"issue":"2","key":"R14","doi-asserted-by":"publisher","first-page":"138","DOI":"10.1177\/1077558719844123","article-title":"Analysis of unstructured text-based data using machine learning techniques: the case of pediatric emergency department records in Nicaragua","volume":"78","author":"Lorenzoni","journal-title":"Med Care Res Rev"},{"key":"R15","doi-asserted-by":"publisher","DOI":"10.1016\/j.resplu.2025.101193","article-title":"Dispatcher-assisted cardiopulmonary resuscitation for out-of-hospital cardiac arrest patients: a site-level analysis of the PAROS trial","volume":"27","author":"Siddiqui","journal-title":"Resusc Plus"},{"issue":"6","key":"R16","doi-asserted-by":"publisher","first-page":"1869","DOI":"10.1007\/s11739-025-03991-7","article-title":"Experiences, challenges, and best practices of dispatcher-assisted cardiopulmonary resuscitation: a scoping review","volume":"20","author":"Imbriaco","journal-title":"Intern Emerg Med"},{"key":"R17","doi-asserted-by":"publisher","DOI":"10.1016\/j.ajem.2024.04.024","article-title":"How artificial intelligence could transform emergency care","volume":"81","author":"Kachman","journal-title":"Am J Emerg Med"},{"key":"R18","doi-asserted-by":"publisher","DOI":"10.2196\/56729","article-title":"Improving triage accuracy in prehospital emergency telemedicine: scoping review of machine learning-enhanced approaches","volume":"13","author":"Raff","journal-title":"Interact J Med Res"},{"key":"R19","doi-asserted-by":"publisher","DOI":"10.1016\/j.resuscitation.2024.110189","article-title":"Resuscitation (un-)wanted: does anyone care? A retrospective real data analysis","volume":"198","author":"Rupp","journal-title":"Resuscitation"},{"key":"R20","doi-asserted-by":"publisher","DOI":"10.1016\/j.resuscitation.2021.08.032","article-title":"Early recognition of a caller\u2019s emotion in out-of-hospital cardiac arrest dispatching: an artificial intelligence approach","volume":"167","author":"Chin","journal-title":"Resuscitation"},{"issue":"1","key":"R21","doi-asserted-by":"publisher","DOI":"10.1186\/s13049-022-01021-5","article-title":"The potential of new prediction models for emergency medical dispatch prioritisation of patients with chest pain: a cohort study","volume":"30","author":"Wibring","journal-title":"Scand J Trauma Resusc Emerg Med"},{"issue":"3","key":"R22","doi-asserted-by":"publisher","first-page":"2512","DOI":"10.1109\/JBHI.2025.3607023","article-title":"Leveraging multi-text joint prompts in SAM for robust medical image segmentation","volume":"30","author":"Zhang","journal-title":"IEEE J Biomed Health Inform"},{"key":"R23","doi-asserted-by":"publisher","DOI":"10.1016\/j.resuscitation.2024.110266","article-title":"Early intramuscular adrenaline administration is associated with improved survival from out-of-hospital cardiac arrest","volume":"201","author":"Palatinus","journal-title":"Resuscitation"},{"issue":"1","key":"R24","doi-asserted-by":"publisher","DOI":"10.1186\/s13049-026-01550-3","article-title":"A European paramedic curriculum for geriatric emergency medicine developed via a modified Delphi technique","volume":"34","author":"Krohn","journal-title":"Scand J Trauma Resusc Emerg Med"},{"key":"R25","doi-asserted-by":"publisher","DOI":"10.3389\/fmolb.2022.928530","article-title":"Medical terminology-based computing system: a lightweight post-processing solution for out-of-vocabulary multi-word terms","volume":"9","author":"Saeed","journal-title":"Front Mol Biosci"},{"issue":"1","key":"R26","doi-asserted-by":"publisher","DOI":"10.1186\/s13049-024-01201-5","article-title":"Impact of delayed mobile medical team dispatch for respiratory distress calls: a propensity score matched study from a French emergency communication center","volume":"32","author":"Charrin","journal-title":"Scand J Trauma Resusc Emerg Med"},{"key":"R27","doi-asserted-by":"publisher","DOI":"10.1016\/j.resuscitation.2022.10.010","article-title":"Development of a clinical decision rule for the early prediction of shock-refractory out-of-hospital cardiac arrest","volume":"181","author":"Lupton","journal-title":"Resuscitation"},{"issue":"1","key":"R28","doi-asserted-by":"publisher","DOI":"10.1186\/s12873-022-00624-6","article-title":"Emergency cricothyroidotomy in difficult airway simulation\u2014a national observational study of Air Ambulance crew performance","volume":"22","author":"Andresen","journal-title":"BMC Emerg Med"},{"issue":"1","key":"R29","doi-asserted-by":"publisher","DOI":"10.1186\/s13049-025-01533-w","article-title":"Managing apnoea in trauma victims: the potential for dispatcher-assisted airway handling\u2014a narrative review","volume":"34","author":"Imbriaco","journal-title":"Scand J Trauma Resusc Emerg Med"},{"key":"R30","doi-asserted-by":"publisher","DOI":"10.1016\/j.resplu.2024.100715","article-title":"Interventions to optimize dispatcher-assisted CPR instructions: a scoping review","volume":"19","author":"Dainty","journal-title":"Resusc Plus"}],"container-title":["Journal of Medical Internet Research"],"original-title":[],"language":"en","deposited":{"date-parts":[[2026,8,14]],"date-time":"2026-08-14T20:43:37Z","timestamp":1786740217000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jmir.org\/2026\/1\/e97672"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,14]]},"references-count":30,"URL":"https:\/\/doi.org\/10.2196\/97672","relation":{},"ISSN":["1438-8871"],"issn-type":[{"value":"1438-8871","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,14]]},"article-number":"v28i22e97672"}}