{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,7]],"date-time":"2026-08-07T16:40:32Z","timestamp":1786120832937,"version":"build-2736575974"},"reference-count":32,"publisher":"Oxford University Press (OUP)","issue":"Supplement_1","license":[{"start":{"date-parts":[[2026,7,1]],"date-time":"2026-07-01T00:00:00Z","timestamp":1782864000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/100016156","name":"U.S. Army Medical Research and Development Command","doi-asserted-by":"publisher","award":["W81XWH21C0119"],"award-info":[{"award-number":["W81XWH21C0119"]}],"id":[{"id":"10.13039\/100016156","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["#2140612"],"award-info":[{"award-number":["#2140612"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,8,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Introduction<\/jats:title>\n                    <jats:p>First responders in emergency medicine often work in austere conditions where expert consultation is limited, communication networks are unreliable, and rapid decision-making is essential. In these environments, procedural precision directly impacts patient outcomes. To address these challenges, we present an artificial intelligence (AI) Copilot for First Response Medicine, an augmented reality-based system that delivers real-time procedural guidance, decision support, and objective skill evaluation to frontline medics.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and Methods<\/jats:title>\n                    <jats:p>This is a feasibility and technical validation study. The system consists of 2 components: an augmented reality (AR) headset for multimodal user interaction and a Graphics Processing Unit (GPU)-equipped microprocessor for local execution of machine learning algorithms. This edge-based design provides sufficient computational power while ensuring offline operation, essential for low-resource and disconnected settings. The system integrates multiple models to analyze egocentric video streams from the headset and assist medics during procedures, including action recognition, action anticipation, visual question answering, hand tracking, and object detection, and can support skill assessment. Performance was benchmarked against expert-labeled ground truth using the Trauma THOMPSON dataset.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The MViTv2 model achieved the best performance for procedural guidance: 89.75% Top-5 accuracy for action recognition and 87.02% Top-5 for action anticipation. For context-aware clinical decision support, the Bootstrapping Language Image Pretraining (BLIP) model achieved 88.64% Visual Question Answering (VQA) accuracy. The system demonstrated robust 100% classification accuracy in differentiating expert and novice skill levels based on hand kinematic features, with average velocity and acceleration identified as the most influential factors.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Unlike AI-assisted surgical systems built for controlled hospital environments, the proposed AI Copilot is optimized for Role 1-2 field care, emphasizing autonomy, speed, and resilience. By offering proactive, real-time mentorship through AR, the system reduces cognitive load, enhances procedural accuracy, and provides an objective metric for continuous military medical training. This work bridges the gap between expert-level (Role 4) medical care and frontline responders and may improve the care in high-stakes and resource-limited scenarios.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/milmed\/usag065","type":"journal-article","created":{"date-parts":[[2026,2,4]],"date-time":"2026-02-04T12:44:44Z","timestamp":1770209084000},"page":"251-258","source":"Crossref","is-referenced-by-count":0,"title":["An Artificial Intelligence Copilot for First Response Medicine"],"prefix":"10.1093","volume":"191","author":[{"given":"Yupeng","family":"Zhuo","sequence":"first","affiliation":[{"name":"Edwardson School of Industrial Engineering, Purdue University , West Lafayette, IN 47907,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Masudur","family":"Radman","sequence":"additional","affiliation":[{"name":"Edwardson School of Industrial Engineering, Purdue University , West Lafayette, IN 47907,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eddie","family":"Zhang","sequence":"additional","affiliation":[{"name":"Edwardson School of Industrial Engineering, Purdue University , West Lafayette, IN 47907,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aditya","family":"Pachpande","sequence":"additional","affiliation":[{"name":"Edwardson School of Industrial Engineering, Purdue University , West Lafayette, IN 47907,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiangchen","family":"Yu","sequence":"additional","affiliation":[{"name":"Edwardson School of Industrial Engineering, Purdue University , West Lafayette, IN 47907,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew W","family":"Kirkpatrick","sequence":"additional","affiliation":[{"name":"Departments of Surgery and Critical Care Medicine, University of Calgary , Calgary, AB T2N 1N4,","place":["Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kyle","family":"Couperus","sequence":"additional","affiliation":[{"name":"The Geneva Foundation , Tacoma, WA 98402,","place":["United States"]},{"name":"Madigan Army Medical Center , Tacoma, WA 98431,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christopher","family":"Colombo","sequence":"additional","affiliation":[{"name":"Department of Medicine , Uniformed Services University of Health Sciences, Bethesda, MD,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jessica","family":"McKee","sequence":"additional","affiliation":[{"name":"Departments of Surgery and Critical Care Medicine, University of Calgary , Calgary, AB T2N 1N4,","place":["Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Oanh","family":"Tran","sequence":"additional","affiliation":[{"name":"The Geneva Foundation , Tacoma, WA 98402,","place":["United States"]},{"name":"Madigan Army Medical Center , Tacoma, WA 98431,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonah","family":"Beck","sequence":"additional","affiliation":[{"name":"The Geneva Foundation , Tacoma, WA 98402,","place":["United States"]},{"name":"Madigan Army Medical Center , Tacoma, WA 98431,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"DeAnna","family":"DeVane","sequence":"additional","affiliation":[{"name":"The Geneva Foundation , Tacoma, WA 98402,","place":["United States"]},{"name":"Madigan Army Medical Center , Tacoma, WA 98431,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chad","family":"Gorbatkin","sequence":"additional","affiliation":[{"name":"Madigan Army Medical Center , Tacoma, WA 98431,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ross","family":"Candelore","sequence":"additional","affiliation":[{"name":"Madigan Army Medical Center , Tacoma, WA 98431,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eleanor","family":"Birch","sequence":"additional","affiliation":[{"name":"Madigan Army Medical Center , Tacoma, WA 98431,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Juan P","family":"Wachs","sequence":"additional","affiliation":[{"name":"Edwardson School of Industrial Engineering, Purdue University , West Lafayette, IN 47907,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2026,8,6]]},"reference":[{"key":"2026080621040106000_usag065-B1","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1146\/annurev-bioeng-083120-023315","article-title":"Procedural telementoring in rural, underdeveloped, and austere settings: origins, present challenges, and future perspectives","volume":"23","author":"Wachs","year":"2021","journal-title":"Annu Rev Biomed Eng."},{"key":"2026080621040106000_usag065-B2","doi-asserted-by":"publisher","first-page":"e001859","DOI":"10.1136\/bmjmilitary-2021-001859","article-title":"Health economic evaluation: cost-effective strategies in humanitarian and disaster relief medicine","volume":"168","author":"Stewart","year":"2022","journal-title":"BMJ Mil Health."},{"key":"2026080621040106000_usag065-B3","doi-asserted-by":"publisher","first-page":"S186","DOI":"10.1097\/TA.0000000000003252","article-title":"Case-control analysis of prehospital death and prolonged field care survival during recent US military combat operations","volume":"91","author":"Shackelford","year":"2021","journal-title":"J Trauma Acute Care Surg."},{"key":"2026080621040106000_usag065-B4","doi-asserted-by":"publisher","first-page":"e45464","DOI":"10.2196\/45464","article-title":"Augmented reality in real-time telemedicine and telementoring: scoping review","volume":"11","author":"Dinh","year":"2023","journal-title":"JMIR Mhealth Uhealth."},{"key":"2026080621040106000_usag065-B5","doi-asserted-by":"publisher","first-page":"896","DOI":"10.1097\/SLA.0000000000005700","article-title":"Intraoperative applications of artificial intelligence in robotic surgery: a scoping review of current development stages and levels of autonomy","volume":"278","author":"Vasey","year":"2023","journal-title":"Ann Surg."},{"key":"2026080621040106000_usag065-B6","doi-asserted-by":"publisher","first-page":"101994","DOI":"10.1016\/j.media.2021.101994","article-title":"Detection, segmentation, and 3D pose estimation of surgical tools using convolutional neural networks and algebraic geometry","volume":"70","author":"Hasan","year":"2021","journal-title":"Med Image Anal."},{"key":"2026080621040106000_usag065-B7","doi-asserted-by":"publisher","first-page":"562","DOI":"10.3390\/bios12080562","article-title":"Artificial Intelligence (AI) and Internet of Medical Things (IoMT) assisted biomedical systems for intelligent healthcare","volume":"12","author":"Manickam","year":"2022","journal-title":"Biosensors (Basel)."},{"key":"2026080621040106000_usag065-B8","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1016\/B978-0-12-814309-4.00014-8","volume-title":"Fundamentals of Telemedicine and Telehealth","author":"Novaes","year":"2020"},{"key":"2026080621040106000_usag065-B9","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/21681163.2020.1835548","article-title":"The AI-Medic: an artificial intelligent mentor for trauma surgery","volume":"9","author":"Rojas","year":"2021","journal-title":"Comput Methods Biomech Biomed Eng Imaging Vis"},{"key":"2026080621040106000_usag065-B10","author":"Xu","year":"2022"},{"key":"2026080621040106000_usag065-B11","article-title":"The essence of the surgical navigation system using artificial intelligence and augmented reality","volume":"2019;6:2395\u201356","author":"Jha","journal-title":"Int Res J Eng Technol"},{"key":"2026080621040106000_usag065-B12","doi-asserted-by":"publisher","first-page":"1331","DOI":"10.1038\/s41591-022-01833-z","article-title":"Evaluating and reducing cognitive load should be a priority for machine learning in healthcare","volume":"28","author":"Ehrmann","year":"2022","journal-title":"Nat Med."},{"key":"2026080621040106000_usag065-B13","first-page":"1","volume-title":"2021 International Joint Conference on Neural Networks (IJCNN)","author":"Kar","year":"2021"},{"key":"2026080621040106000_usag065-B14","doi-asserted-by":"publisher","first-page":"e29080","DOI":"10.2196\/29080","article-title":"Augmented, mixed, and virtual reality-based head-mounted devices for medical education: systematic review","volume":"9","author":"Barteit","year":"2021","journal-title":"JMIR Serious Games."},{"key":"2026080621040106000_usag065-B15","doi-asserted-by":"publisher","first-page":"1062","DOI":"10.1093\/abm\/kaab016","article-title":"Using virtual technology for fear of medical procedures: a systematic review of the effectiveness of virtual reality-based interventions","volume":"55","author":"K\u0131l\u0131\u00e7","year":"2021","journal-title":"Ann Behav Med."},{"key":"2026080621040106000_usag065-B16","doi-asserted-by":"publisher","first-page":"e0229596","DOI":"10.1371\/journal.pone.0229596","article-title":"The virtual operative assistant: an explainable artificial intelligence tool for simulation-based training in surgery and medicine","volume":"15","author":"Mirchi","year":"2020","journal-title":"PLoS One."},{"key":"2026080621040106000_usag065-B17","doi-asserted-by":"publisher","first-page":"1580","DOI":"10.1007\/s00586-019-06054-6","article-title":"Augmented reality and artificial intelligence-based navigation during percutaneous vertebroplasty: a pilot randomised clinical trial","volume":"29","author":"Auloge","year":"2020","journal-title":"Eur Spine J."},{"key":"2026080621040106000_usag065-B18","first-page":"47","volume-title":"AI for Brain Lesion Detection and Trauma Video Action Recognition","author":"Zhuo","year":"2023"},{"key":"2026080621040106000_usag065-B19","doi-asserted-by":"publisher","first-page":"671","DOI":"10.1007\/s11263-017-1061-3","article-title":"Discriminative correlation filter with channel and spatial reliability","volume":"126","author":"Luke\u017ei\u010d","year":"2018","journal-title":"Int J Comput Vis."},{"key":"2026080621040106000_usag065-B20","first-page":"3192","author":"Liu"},{"key":"2026080621040106000_usag065-B21","volume-title":"The International Conference on Machine Learning (ICML)","author":"Bertasius"},{"key":"2026080621040106000_usag065-B22","doi-asserted-by":"publisher","author":"Li","year":"2022","DOI":"10.48550\/arXiv.2211.09552"},{"key":"2026080621040106000_usag065-B23","author":"Tong","year":"2022"},{"key":"2026080621040106000_usag065-B24","author":"Li","year":"2022"},{"key":"2026080621040106000_usag065-B25","first-page":"6586","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"Zhao"},{"key":"2026080621040106000_usag065-B26","first-page":"12888","volume-title":"International conference on machine learning","author":"Li"},{"key":"2026080621040106000_usag065-B27","first-page":"5583","author":"Kim"},{"key":"2026080621040106000_usag065-B28","doi-asserted-by":"publisher","author":"Xiao","year":"2023","DOI":"10.48550\/arXiv.2311.06242"},{"key":"2026080621040106000_usag065-B29","doi-asserted-by":"publisher","author":"Khanam","year":"2024","DOI":"10.48550\/arXiv.2410.17725"},{"key":"2026080621040106000_usag065-B30","doi-asserted-by":"crossref","DOI":"10.1002\/9781119239932","volume-title":"Active Disturbance Rejection Control for Nonlinear Systems: An Introduction","author":"Guo","year":"2016","edition":"1st edn"},{"key":"2026080621040106000_usag065-B31","doi-asserted-by":"publisher","first-page":"101559","DOI":"10.1016\/j.cpsurg.2024.101559","article-title":"Validation and motion analyses of laparoscopic radical nephrectomy with Thiel-embalmed cadavers","volume":"61","author":"Yan","year":"2024","journal-title":"Curr Probl Surg."},{"key":"2026080621040106000_usag065-B32","doi-asserted-by":"publisher","author":"Lundberg","year":"2017","DOI":"10.48550\/arXiv.1705.07874"}],"container-title":["Military Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/milmed\/article-pdf\/191\/Supplement_1\/251\/70491054\/usag065.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/milmed\/article-pdf\/191\/Supplement_1\/251\/70491054\/usag065.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,7]],"date-time":"2026-08-07T01:04:10Z","timestamp":1786064650000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/milmed\/article\/191\/Supplement_1\/251\/8752065"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7]]},"references-count":32,"journal-issue":{"issue":"Supplement_1","published-online":{"date-parts":[[2026,8,6]]},"published-print":{"date-parts":[[2026,8,1]]}},"URL":"https:\/\/doi.org\/10.1093\/milmed\/usag065","relation":{},"ISSN":["0026-4075","1930-613X"],"issn-type":[{"value":"0026-4075","type":"print"},{"value":"1930-613X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,7]]},"published":{"date-parts":[[2026,7]]}}}