{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,28]],"date-time":"2026-08-28T23:26:04Z","timestamp":1787959564202,"version":"build-2784847793"},"reference-count":43,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2024,12,3]],"date-time":"2024-12-03T00:00:00Z","timestamp":1733184000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"University of Washington alumni Jack and Luellen Cherneski"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Diagnostics"],"abstract":"<jats:p>Background: Quantitative pupillometry has been proposed as an objective means to diagnose acute sports-related concussion (SRC). Objective: To assess the diagnostic accuracy of a smartphone-based quantitative pupillometer in the acute diagnosis of SRC. Methods: Division I college football players had baseline pupillometry including pupillary light reflex (PLR) parameters of maximum resting diameter, minimum diameter after light stimulus, percent change in pupil diameter, latency of pupil constriction onset, mean constriction velocity, maximum constriction velocity, and mean dilation velocity using a smartphone-based app. When an SRC occurred, athletes had the smartphone pupillometry repeated as part of their concussion testing. All combinations of the seven PLR parameters were tested in machine learning binary classification models to determine the optimal combination for differentiating between non-concussed and concussed athletes. Results: 93 football athletes underwent baseline pupillometry testing. Among these athletes, 11 suffered future SRC and had pupillometry recordings repeated at the time of diagnosis. In the machine learning pupillometry analysis that used the synthetic minority oversampling technique to account for the significant class imbalance in our dataset, the best-performing model was a random forest algorithm with the combination of latency, maximum diameter, minimum diameter, mean constriction velocity, and maximum constriction velocity PLR parameters as feature inputs. This model produced 91% overall accuracy, 98% sensitivity, 84.2% specificity, area under the curve (AUC) of 0.91, and an F1 score of 91.6% in differentiating between baseline and SRC recordings. In the machine learning analysis prior to oversampling of our imbalanced dataset, the best-performing model was k-nearest neighbors using latency, maximum diameter, maximum constriction velocity, and mean dilation velocity to produce 82% accuracy, 40% sensitivity, 87% specificity, AUC of 0.64, and F1 score of 24%. Conclusions: Smartphone pupillometry in combination with machine learning may provide fast and objective SRC diagnosis in football athletes.<\/jats:p>","DOI":"10.3390\/diagnostics14232723","type":"journal-article","created":{"date-parts":[[2024,12,3]],"date-time":"2024-12-03T09:18:32Z","timestamp":1733217512000},"page":"2723","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Smartphone-Based Pupillometry Using Machine Learning for the Diagnosis of Sports-Related Concussion"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6697-9966","authenticated-orcid":false,"given":"Anthony J.","family":"Maxin","sequence":"first","affiliation":[{"name":"Department of Neurological Surgery, University of Washington, Seattle, WA 98195, USA"},{"name":"School of Medicine, Creighton University, Omaha, NE 68178, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7758-0208","authenticated-orcid":false,"given":"Bridget M.","family":"Whelan","sequence":"additional","affiliation":[{"name":"Department of Family Medicine, Sports Medicine Section, University of Washington, Seattle, WA 98195, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3612-3347","authenticated-orcid":false,"given":"Michael R.","family":"Levitt","sequence":"additional","affiliation":[{"name":"Department of Neurological Surgery, University of Washington, Seattle, WA 98195, USA"},{"name":"Departments of Radiology, Mechanical Engineering, Stroke & Applied Neuroscience Center, University of Washington, Seattle, WA 98195, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lynn B.","family":"McGrath","sequence":"additional","affiliation":[{"name":"Department of Neurological Surgery, Northern Light Health, Portland, ME 04102, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3670-6609","authenticated-orcid":false,"given":"Kimberly G.","family":"Harmon","sequence":"additional","affiliation":[{"name":"Department of Family Medicine, Sports Medicine Section, University of Washington, Seattle, WA 98195, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,12,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"e20154635","DOI":"10.1542\/peds.2015-4635","article-title":"Sports- and Recreation-Related Concussions in US Youth","volume":"138","author":"Bryan","year":"2016","journal-title":"Pediatrics"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"912","DOI":"10.1249\/MSS.0000000000002874","article-title":"Association between Preseason\/Regular Season Head Impact Exposure and Concussion Incidence in NCAA Football","volume":"54","author":"Stemper","year":"2022","journal-title":"Med. Sci. Sports Exerc."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1136\/bjsports-2018-100338","article-title":"American Medical Society for Sports Medicine position statement on concussion in sport","volume":"53","author":"Harmon","year":"2019","journal-title":"Br. J. Sports Med."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"e2416223","DOI":"10.1001\/jamanetworkopen.2024.16223","article-title":"Diagnosis of Sports-Related Concussion Using Symptom Report or Standardized Assessment of Concussion","volume":"7","author":"Harmon","year":"2024","journal-title":"JAMA Netw. Open"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/j.socscimed.2015.04.011","article-title":"Concussion under-reporting and pressure from coaches, teammates, fans, and parents","volume":"134","author":"Kroshus","year":"2015","journal-title":"Soc. Sci. Med."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"722","DOI":"10.1136\/bjsports-2022-106661","article-title":"Acute evaluation of sport-related concussion and implications for the Sport Concussion Assessment Tool (SCAT6) for adults, adolescents and children: A systematic review","volume":"57","author":"Echemendia","year":"2023","journal-title":"Br. J. Sports Med."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1136\/bjsports-2020-102072","article-title":"Use of the Sport Concussion Assessment Tool 5 (SCAT5) in professional hockey, part 2: Which components differentiate concussed and non-concussed players?","volume":"55","author":"Bruce","year":"2020","journal-title":"Br. J. Sports Med."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1136\/bjsports-2020-103840","article-title":"Diagnostic accuracy and reliability of sideline concussion evaluation: A prospective, case-controlled study in college athletes comparing newer tools Ma and established tests","volume":"56","author":"Harmon","year":"2022","journal-title":"Br. J. Sports Med."},{"key":"ref_9","unstructured":"King, A., and Devick, S.T. (1976). The Proposed King-Devick Test and Its Relation to the Pierce Saccade Test and Reading Levels, Illinois College of Optometry."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"628","DOI":"10.1093\/milmed\/usae205","article-title":"Comparative Performance of Three Eye-Tracking Devices in Detection of Mild Traumatic Brain Injury in Acute Versus Chronic Subject Populations","volume":"189","author":"King","year":"2024","journal-title":"Mil. Med."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"e207991","DOI":"10.1212\/WNL.0000000000207991","article-title":"Association of Blood Biomarkers of Inflammation with Acute Concussion in Collegiate Athletes and Military Service Academy Cadets","volume":"102","author":"Meier","year":"2024","journal-title":"Neurology"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Carrick, F.R., Azzolino, S.F., Hunfalvay, M., Pagnacco, G., Oggero, E., D\u2019Arcy, R.C.N., Abdulrahman, M., and Sugaya, K. (2021). The Pupillary Light Reflex as a Biomarker of Concussion. Life, 11.","DOI":"10.3390\/life11101104"},{"key":"ref_13","first-page":"1","article-title":"Pupillary Light Reflex as an Objective Biomarker for Early Identification of Blast-Induced mTBI","volume":"S4","author":"Urosevich","year":"2013","journal-title":"J. Spine"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1420","DOI":"10.3109\/02699052.2015.1045029","article-title":"Pupillary responses to light in chronic non-blast-induced mTBI","volume":"29","author":"Thiagarajan","year":"2015","journal-title":"Brain Inj"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1378","DOI":"10.1080\/02699052.2016.1195922","article-title":"Comparison of pupillary dynamics to light in the mild traumatic brain injury (mTBI) and normal populations","volume":"30","author":"Truong","year":"2016","journal-title":"Brain Inj"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1093\/milmed\/usx166","article-title":"Validation of Visual Objective Biomarkers for Acute Concussion","volume":"183","author":"Beltran","year":"2018","journal-title":"Mil. Med."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1177\/0883073820964040","article-title":"Concussion Alters Dynamic Pupillary Light Responses in Children","volume":"36","author":"Hsu","year":"2021","journal-title":"J. Child. Neurol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1135","DOI":"10.1001\/jamaophthalmol.2020.3466","article-title":"Utility of Pupillary Light Reflex Metrics as a Physiologic Biomarker for Adolescent Sport-Related Concussion","volume":"138","author":"Master","year":"2020","journal-title":"JAMA Ophthalmol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1177\/0885066619881124","article-title":"Quantitative Pupillometry in the Intensive Care Unit","volume":"36","author":"Bower","year":"2021","journal-title":"J. Intensive Care Med."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"S359","DOI":"10.1016\/j.pmrj.2011.07.018","article-title":"The pathophysiology of concussion","volume":"3","author":"Signoretti","year":"2011","journal-title":"PM R"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"953","DOI":"10.1097\/OPX.0000000000001289","article-title":"iPhone-based Pupillometry: A Novel Approach for Assessing the Pupillary Light Reflex","volume":"95","author":"McAnany","year":"2018","journal-title":"Optom. Vis. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"891","DOI":"10.1016\/j.bbe.2021.05.012","article-title":"Pupillometry via smartphone for low-resource settings","volume":"41","author":"Piaggio","year":"2021","journal-title":"Biocybern. Biomed. Eng."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"McGrath, L.B., Eaton, J., Abecassis, I.J., Maxin, A., Kelly, C., Chesnut, R.M., and Levitt, M.R. (2022). Mobile smartphone-based digital pupillometry curves in the diagnosis of traumatic brain injury. Front. Neurosci., 16.","DOI":"10.3389\/fnins.2022.893711"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"e58398","DOI":"10.2196\/58398","article-title":"Smartphone Pupillometry and Machine Learning for Detection of Acute Mild Traumatic Brain Injury: Cohort Study","volume":"3","author":"Maxin","year":"2024","journal-title":"JMIR Neurotech"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1457","DOI":"10.1007\/s40279-023-01830-3","article-title":"Premorbid Risk Factors and Acute Injury Characteristics of Sport-Related Concussion Across the National Collegiate Athletic Association: Findings from the Concussion Assessment, Research, and Education (CARE) Consortium","volume":"53","author":"Memmini","year":"2023","journal-title":"Sports Med."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"695","DOI":"10.1136\/bjsports-2023-106898","article-title":"Consensus statement on concussion in sport: The 6th International Conference on Concussion in Sport-Amsterdam, October 2022","volume":"57","author":"Patricios","year":"2023","journal-title":"Br. J. Sports Med."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2118","DOI":"10.1089\/neu.2022.0516","article-title":"Validation of a Smartphone Pupillometry Application in Diagnosing Severe Traumatic Brain Injury","volume":"40","author":"Maxin","year":"2023","journal-title":"J. Neurotrauma"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"107922","DOI":"10.1016\/j.jstrokecerebrovasdis.2024.107922","article-title":"Smartphone pupillometry for detection of cerebral vasospasm after aneurysmal subarachnoid hemorrhage","volume":"33","author":"Maxin","year":"2024","journal-title":"J. Stroke Cerebrovasc. Dis."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"107430","DOI":"10.1016\/j.jstrokecerebrovasdis.2023.107430","article-title":"A smartphone pupillometry tool for detection of acute large vessel occlusion","volume":"32","author":"Maxin","year":"2023","journal-title":"J. Stroke Cerebrovasc. Dis."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1145\/3131896","article-title":"PupilScreen: Using smartphones to assess traumatic brain injury","volume":"1","author":"Mariakakis","year":"2017","journal-title":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2374289519873088","DOI":"10.1177\/2374289519873088","article-title":"Artificial Intelligence and Machine Learning in Pathology: The Present Landscape of Supervised Methods","volume":"6","author":"Rashidi","year":"2019","journal-title":"Acad. Pathol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1613\/jair.953","article-title":"SMOTE: Synthetic minority over-sampling technique","volume":"16","author":"Chawla","year":"2002","journal-title":"J. Artif. Intell. Res."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1739","DOI":"10.1007\/s40279-018-0880-x","article-title":"Quantifying the Value of Multidimensional Assessment Models for Acute Concussion: An Analysis of Data from the NCAA-DoD Care Consortium","volume":"48","author":"Garcia","year":"2018","journal-title":"Sports Med."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"e000012","DOI":"10.1136\/bmjsem-2015-000012","article-title":"The sensitivity and specificity of clinical measures of sport concussion: Three tests are better than one","volume":"2","author":"Resch","year":"2016","journal-title":"BMJ Open Sport Exerc. Med."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"651","DOI":"10.1136\/bjsports-2023-106860","article-title":"Sport Concussion Office Assessment Tool\u20146","volume":"57","author":"Patricios","year":"2023","journal-title":"Br. J. Sports Med."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2283","DOI":"10.1089\/neu.2017.5490","article-title":"Sideline Concussion Assessment: The King-Devick Test in Canadian Professional Football","volume":"35","author":"Naidu","year":"2018","journal-title":"J. Neurotrauma"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1526","DOI":"10.1136\/bjsports-2017-098560","article-title":"King-Devick concussion test performs poorly as a screening tool in elite rugby union players: A prospective cohort study of two screening tests versus a clinical reference standard","volume":"53","author":"Fuller","year":"2019","journal-title":"Br. J. Sports Med."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.pediatrneurol.2024.01.016","article-title":"Evaluation of Quantitative Pupillometry in Acute Postinjury Pediatric Concussion","volume":"153","author":"Heyming","year":"2024","journal-title":"Pediatr. Neurol."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Oeur, A., Mull, M., Riccobono, G., Arbogast, K.B., Ciuffreda, K.J., Joshi, N., Fedonni, D., Master, C.L., and Margulies, S.S. (2023). Pupillary Light Response Deficits in 4-Week-Old Piglets and Adolescent Children after Low-Velocity Head Rotations and Sports-Related Concussions. Biomedicines, 11.","DOI":"10.3390\/biomedicines11020587"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/j.aucc.2017.06.003","article-title":"The use and uptake of pupillometers in the Intensive Care Unit","volume":"31","author":"Lee","year":"2018","journal-title":"Aust. Crit. Care"},{"key":"ref_41","first-page":"e12628","article-title":"Diagnostic performance of light reflex pupillometry in Alzheimer\u2019s disease","volume":"16","author":"Gramkow","year":"2024","journal-title":"Alzheimers. Dement."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1186\/s12995-021-00330-2","article-title":"The pupillary light reflex (PLR) as a marker for the ability to work or drive\u2014A feasibility study","volume":"16","author":"Kaifie","year":"2021","journal-title":"J. Occup. Med. Toxicol."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"3","DOI":"10.5114\/biolsport.2024.125590","article-title":"Pupillometry as a new window to player fatigue? A glimpse inside the eyes of a Euro Cup Women\u2019s Basketball team","volume":"41","author":"Huyghe","year":"2024","journal-title":"Biol. Sport"}],"container-title":["Diagnostics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4418\/14\/23\/2723\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:46:00Z","timestamp":1760114760000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4418\/14\/23\/2723"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,3]]},"references-count":43,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["diagnostics14232723"],"URL":"https:\/\/doi.org\/10.3390\/diagnostics14232723","relation":{},"ISSN":["2075-4418"],"issn-type":[{"value":"2075-4418","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,3]]}}}