{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T13:05:59Z","timestamp":1784293559932,"version":"3.55.0"},"reference-count":36,"publisher":"Association for Computing Machinery (ACM)","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Healthcare"],"abstract":"<jats:p>In this study, we present a proof-of-concept system exploring the feasibility of automatically capturing physiological values during the primary survey phase of trauma resuscitation\u2014a complex, time-sensitive evaluation of severely injured patients. We developed and evaluated a speech-driven activity recognition system designed to detect and extract key physiological parameters (e.g., age, manual blood pressure, Glasgow Coma Scale) from spoken clinical dialogue in real-time. By using audio recordings from actual trauma resuscitation cases, our system performs streaming inference to identify verbalized measurements associated with primary survey activities. Experimental results show that our approach can recognize seven attributes with an average accuracy of 72% in a challenging clinical environment with acceptable latency. We present this work as an initial feasibility demonstration rather than a deployment-ready system, highlighting both the opportunities and the remaining challenges of automating documentation in fast-paced emergency environments.<\/jats:p>","DOI":"10.1145\/3829355","type":"journal-article","created":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T12:50:03Z","timestamp":1784292603000},"update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Automatic Detection of Physiological Attributes from Verbal Communication During Time-Critical Medical Events"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0280-7882","authenticated-orcid":false,"given":"Chenyang","family":"Gao","sequence":"first","affiliation":[{"name":"Rutgers, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-9825-0978","authenticated-orcid":false,"given":"Wenjin","family":"Zhang","sequence":"additional","affiliation":[{"name":"Rutgers, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-8579-8052","authenticated-orcid":false,"given":"Aaron H.","family":"Mun","sequence":"additional","affiliation":[{"name":"Division of Trauma and Burn Surgery, Children\u2019s National Hospital, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2126-8527","authenticated-orcid":false,"given":"Aleksandra","family":"Sarcevic","sequence":"additional","affiliation":[{"name":"Drexel, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-7025-6636","authenticated-orcid":false,"given":"Mary S.","family":"Kim","sequence":"additional","affiliation":[{"name":"Division of Trauma and Burn Surgery, Children\u2019s National Hospital, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4465-9117","authenticated-orcid":false,"given":"Randall S.","family":"Burd","sequence":"additional","affiliation":[{"name":"Division of Trauma and Burn Surgery, Children\u2019s National Hospital, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1033-6865","authenticated-orcid":false,"given":"Ivan","family":"Marsic","sequence":"additional","affiliation":[{"name":"Rutgers, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,7,17]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1016\/j.ekir.2023.10.019","article-title":"Clinical decision support tools in the electronic medical record","volume":"9","author":"Alexiuk Mackenzie","year":"2024","unstructured":"Mackenzie Alexiuk, Heba Elgubtan, and Navdeep Tangri. 2024. Clinical decision support tools in the electronic medical record. Kidney International Reports 9, 1 (2024), 29\u201338.","journal-title":"Kidney International Reports"},{"key":"e_1_2_1_2_1","volume-title":"Clinical decision support systems. Vol.\u00a0233","author":"Berner S","unstructured":"Eta\u00a0S Berner. 2007. Clinical decision support systems. Vol.\u00a0233. Springer."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4615-3210-1"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSTSP.2022.3188113"},{"key":"e_1_2_1_5_1","doi-asserted-by":"crossref","first-page":"1574","DOI":"10.1016\/j.surg.2021.04.034","article-title":"Predicting the need for massive transfusion: prospective validation of a smartphone-based clinical decision support tool","volume":"170","author":"Dente J","year":"2021","unstructured":"Christopher\u00a0J Dente, Michael\u00a0J Mina, Bryan\u00a0C Morse, Hannah Hensman, Seth Schobel, Rondi\u00a0B Gelbard, Arnaud Belard, Timothy\u00a0G Buchman, Allan\u00a0D Kirk, and Eric\u00a0A Elster. 2021. Predicting the need for massive transfusion: prospective validation of a smartphone-based clinical decision support tool. Surgery 170, 5 (2021), 1574\u20131580.","journal-title":"Surgery"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3580798"},{"key":"e_1_2_1_7_1","doi-asserted-by":"crossref","first-page":"104446","DOI":"10.1016\/j.jbi.2023.104446","article-title":"Automating medical simulations","volume":"144","author":"Gershov Sapir","year":"2023","unstructured":"Sapir Gershov, Daniel Braunold, Robert Spektor, Alexander Ioscovich, Aeyal Raz, and Shlomi Laufer. 2023. Automating medical simulations. Journal of Biomedical Informatics 144 (2023), 104446.","journal-title":"Journal of Biomedical Informatics"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2023.107215"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the Second Workshop on Natural Language Processing for Medical Conversations. 30\u201334","author":"Gershov Sapir","year":"2021","unstructured":"Sapir Gershov, Yaniv Ringel, Erez Dvir, Tzvia Tsirilman, Elad\u00a0Ben Zvi, Sandra Braun, Aeyal Raz, and Shlomi Laufer. 2021. Automatic speech-based checklist for medical simulations. In Proceedings of the Second Workshop on Natural Language Processing for Medical Conversations. 30\u201334."},{"key":"e_1_2_1_10_1","volume-title":"et\u00a0al","author":"Gulati Anmol","year":"2020","unstructured":"Anmol Gulati, James Qin, Chung-Cheng Chiu, Niki Parmar, Yu Zhang, Jiahui Yu, Wei Han, Shibo Wang, Zhengdong Zhang, Yonghui Wu, et\u00a0al. 2020. Conformer: Convolution-augmented transformer for speech recognition. arXiv preprint arXiv:2005.08100 (2020)."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-016-0497-2"},{"key":"e_1_2_1_12_1","volume-title":"Clinicalbert: Modeling clinical notes and predicting hospital readmission. arXiv preprint arXiv:1904.05342","author":"Huang Kexin","year":"2019","unstructured":"Kexin Huang, Jaan Altosaar, and Rajesh Ranganath. 2019. Clinicalbert: Modeling clinical notes and predicting hospital readmission. arXiv preprint arXiv:1904.05342 (2019)."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3581791.3596853"},{"key":"e_1_2_1_14_1","volume-title":"et\u00a0al","author":"Kim Yubin","year":"2025","unstructured":"Yubin Kim, Taehan Kim, Wonjune Kang, Eugene Park, Joonsik Yoon, Dongjae Lee, Xin Liu, Daniel McDuff, Hyeonhoon Lee, Cynthia Breazeal, et\u00a0al. 2025. VocalAgent: Large Language Models for Vocal Health Diagnostics with Safety-Aware Evaluation. arXiv preprint arXiv:2505.13577 (2025)."},{"key":"e_1_2_1_15_1","volume-title":"Kingma and Jimmy Ba","author":"P.","year":"2015","unstructured":"Diederik\u00a0P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings, Yoshua Bengio and Yann LeCun (Eds.). http:\/\/arxiv.org\/abs\/1412.6980"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300777"},{"key":"e_1_2_1_17_1","volume-title":"Exploring Runtime Decision Support for Trauma Resuscitation. arXiv preprint arXiv:2207.02922","author":"Li Keyi","year":"2022","unstructured":"Keyi Li, Sen Yang, Travis\u00a0M Sullivan, Randall\u00a0S Burd, and Ivan Marsic. 2022. Exploring Runtime Decision Support for Trauma Resuscitation. arXiv preprint arXiv:2207.02922 (2022)."},{"key":"e_1_2_1_18_1","volume-title":"2016 IEEE international conference on RFID (RFID). IEEE, 1\u20139.","author":"Li Xinyu","year":"2016","unstructured":"Xinyu Li, Dongyang Yao, Xuechao Pan, Jonathan Johannaman, JaeWon Yang, Rachel Webman, Aleksandra Sarcevic, Ivan Marsic, and Randall\u00a0S Burd. 2016. Activity recognition for medical teamwork based on passive RFID. In 2016 IEEE international conference on RFID (RFID). IEEE, 1\u20139."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2994551.2994569"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.15441\/ceem.22.335"},{"key":"e_1_2_1_21_1","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1002\/cpt.334","article-title":"Clinical decision support tools: the evolution of a revolution","volume":"99","author":"Mould DR","year":"2016","unstructured":"DR Mould, G D\u2019haens, and RN Upton. 2016. Clinical decision support tools: the evolution of a revolution. Clinical Pharmacology & Therapeutics 99, 4 (2016), 405\u2013418.","journal-title":"Clinical Pharmacology & Therapeutics"},{"key":"e_1_2_1_22_1","doi-asserted-by":"crossref","first-page":"1968","DOI":"10.1093\/jamia\/ocaa200","article-title":"A scoping review of clinical decision support tools that generate new knowledge to support decision making in real time","volume":"27","author":"Ostropolets Anna","year":"2020","unstructured":"Anna Ostropolets, Linying Zhang, and George Hripcsak. 2020. A scoping review of clinical decision support tools that generate new knowledge to support decision making in real time. Journal of the American Medical Informatics Association 27, 12 (2020), 1968\u20131976.","journal-title":"Journal of the American Medical Informatics Association"},{"key":"e_1_2_1_23_1","volume-title":"Specaugment: A simple data augmentation method for automatic speech recognition. arXiv preprint arXiv:1904.08779","author":"Park S","year":"2019","unstructured":"Daniel\u00a0S Park, William Chan, Yu Zhang, Chung-Cheng Chiu, Barret Zoph, Ekin\u00a0D Cubuk, and Quoc\u00a0V Le. 2019. Specaugment: A simple data augmentation method for automatic speech recognition. arXiv preprint arXiv:1904.08779 (2019)."},{"key":"e_1_2_1_24_1","volume-title":"StatPearls [Internet]","author":"Planas H","unstructured":"Jason\u00a0H Planas, Muhammad Waseem, and David\u00a0F Sigmon. 2023. Trauma primary survey. In StatPearls [Internet]. StatPearls Publishing."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.injury.2014.12.026"},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the 38th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol.\u00a0139)","author":"Radford Alec","year":"2021","unstructured":"Alec Radford, Jong\u00a0Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. 2021. Learning Transferable Visual Models From Natural Language Supervision. In Proceedings of the 38th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol.\u00a0139), Marina Meila and Tong Zhang (Eds.). PMLR, 8748\u20138763. https:\/\/proceedings.mlr.press\/v139\/radford21a.html"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2023.127063"},{"key":"e_1_2_1_28_1","doi-asserted-by":"crossref","first-page":"304","DOI":"10.1097\/TA.0000000000003709","article-title":"Development and validation of a Bayesian belief network predicting the probability of blood transfusion after pediatric injury","volume":"94","author":"Sullivan M.","year":"2022","unstructured":"Travis\u00a0M. Sullivan, Zachary\u00a0P Milestone, Peyton\u00a0E. Tempel, Sarah Gao, and Randall\u00a0S. Burd. 2022. Development and validation of a Bayesian belief network predicting the probability of blood transfusion after pediatric injury. Journal of Trauma and Acute Care Surgery 94 (2022), 304 \u2013 311. https:\/\/api.semanticscholar.org\/CorpusID:249622354","journal-title":"Journal of Trauma and Acute Care Surgery"},{"key":"e_1_2_1_29_1","first-page":"6","article-title":"Development and validation of a Bayesian network predicting neurosurgical intervention after injury in children and adolescents","volume":"94","author":"Sullivan M","year":"2023","unstructured":"Travis\u00a0M Sullivan, Genevieve\u00a0J Sippel, Elizabeth\u00a0A Matison, Waverly\u00a0V Gestrich-Thompson, Peter\u00a0E DeWitt, M\u00a0Adam Carlisle, David Oluigbo, Chima Oluigbo, Tellen\u00a0D Bennett, and Randall\u00a0S Burd. 2023. Development and validation of a Bayesian network predicting neurosurgical intervention after injury in children and adolescents. J. Trauma Acute Care Surg. 94, 6 (June 2023), 839\u2013846.","journal-title":"J. Trauma Acute Care Surg."},{"key":"e_1_2_1_30_1","volume-title":"Attention is all you need. Advances in neural information processing systems 30","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan\u00a0N Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems 30 (2017)."},{"key":"e_1_2_1_31_1","volume-title":"Real-Time Multimodal Cognitive Assistant for Emergency Medical Services. arXiv preprint arXiv:2403.06734","author":"Weerasinghe Keshara","year":"2024","unstructured":"Keshara Weerasinghe, Saahith Janapati, Xueren Ge, Sion Kim, Sneha Iyer, John\u00a0A Stankovic, and Homa Alemzadeh. 2024. Real-Time Multimodal Cognitive Assistant for Emergency Medical Services. arXiv preprint arXiv:2403.06734 (2024)."},{"key":"e_1_2_1_32_1","volume-title":"et\u00a0al","author":"Xu Jin","year":"2025","unstructured":"Jin Xu, Zhifang Guo, Jinzheng He, Hangrui Hu, Ting He, Shuai Bai, Keqin Chen, Jialin Wang, Yang Fan, Kai Dang, et\u00a0al. 2025. Qwen2. 5-omni technical report. arXiv preprint arXiv:2503.20215 (2025)."},{"key":"e_1_2_1_33_1","volume-title":"et\u00a0al","author":"Yang An","year":"2025","unstructured":"An Yang, Anfeng Li, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Gao, Chengen Huang, Chenxu Lv, et\u00a0al. 2025. Qwen3 technical report. arXiv preprint arXiv:2505.09388 (2025)."},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2111\u20132120","author":"Yang Sen","year":"2017","unstructured":"Sen Yang, Xin Dong, Leilei Sun, Yichen Zhou, Richard\u00a0A Farneth, Hui Xiong, Randall\u00a0S Burd, and Ivan Marsic. 2017. A data-driven process recommender framework. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2111\u20132120."},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 14625\u201314635","author":"Zhang Yanyi","year":"2021","unstructured":"Yanyi Zhang, Xinyu Li, and Ivan Marsic. 2021. Multi-Label Activity Recognition Using Activity-Specific Features and Activity Correlations. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 14625\u201314635."},{"key":"e_1_2_1_36_1","volume-title":"et\u00a0al","author":"Zhang Yue","year":"2023","unstructured":"Yue Zhang, Yafu Li, Leyang Cui, Deng Cai, Lemao Liu, Tingchen Fu, Xinting Huang, Enbo Zhao, Yu Zhang, Yulong Chen, et\u00a0al. 2023. Siren's song in the AI ocean: a survey on hallucination in large language models. arXiv preprint arXiv:2309.01219 (2023)."}],"container-title":["ACM Transactions on Computing for Healthcare"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3829355","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T12:50:20Z","timestamp":1784292620000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3829355"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,17]]},"references-count":36,"alternative-id":["10.1145\/3829355"],"URL":"https:\/\/doi.org\/10.1145\/3829355","relation":{},"ISSN":["2637-8051"],"issn-type":[{"value":"2637-8051","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,17]]},"assertion":[{"value":"2025-03-10","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-06-17","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-07-17","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"3829355"}}