{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,7]],"date-time":"2026-08-07T17:57:12Z","timestamp":1786125432587,"version":"build-2736575974"},"reference-count":21,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"3","license":[{"start":{"date-parts":[[2020,4,15]],"date-time":"2020-04-15T00:00:00Z","timestamp":1586908800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Neurosurg.","NEUROS"],"published-print":{"date-parts":[[2020,9]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>BACKGROUND<\/jats:title>\n                    <jats:p>On-field visible signs (VS) are used to help identify sport-related concussion (SRC) in the National Football League (NFL). However, the predictive utility of a VS checklist for SRC is unknown.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>OBJECTIVE<\/jats:title>\n                    <jats:p>To report the frequency, sensitivity, specificity, and predictive value of VS in a cohort of NFL athletes.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>METHODS<\/jats:title>\n                    <jats:p>On-field VS ratings from 2 experts who independently reviewed video footage of a cohort of 251 injury plays that resulted in an SRC diagnosis (n\u00a0=\u00a0211) and no diagnosis (n\u00a0=\u00a040) from the 2017 NFL season were examined. The frequency, sensitivity, specificity, and a receiver operating characteristic (ROC) curve with area under the curve (AUC) were calculated for each VS.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>RESULTS<\/jats:title>\n                    <jats:p>Slow to get up (65.9%) and motor incoordination (28.4%) were the most frequent VS in concussed athletes, and slow to get up (60.0%) was the most common VS among nonconcussed athletes. The most sensitive VS was slow to get up (66%); the most specific signs in concussed NFL athletes were blank\/vacant look and impact seizure (both 100%). Approximately 26% of concussed NFL players did not exhibit a VS, and the overall sensitivity and specificity for the VS checklist to detect SRC were 73% and 65%, respectively. The VS checklist demonstrated \u201cpoor\u201d ability to discriminate between SRC and non-SRC groups (AUC\u00a0=\u00a00.66).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>CONCLUSION<\/jats:title>\n                    <jats:p>In the NFL, the diagnosis of concussion cannot be made from on-field VS alone. The VS checklist is one part of the comprehensive sideline\/acute evaluation of concussion, and the diagnosis remains a multimodal clinical decision.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/neuros\/nyaa072","type":"journal-article","created":{"date-parts":[[2020,2,25]],"date-time":"2020-02-25T15:15:59Z","timestamp":1582643759000},"page":"530-537","source":"Crossref","is-referenced-by-count":25,"title":["Sensitivity and Specificity of On-Field Visible Signs of Concussion in the National Football League"],"prefix":"10.1227","volume":"87","author":[{"given":"Robert J","family":"Elbin","sequence":"first","affiliation":[{"name":"Department of Health Human Performance and Recreation\/Office for Sport Concussion Research, University of Arkansas, Fayetteville, Arkansas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Scott L","family":"Zuckerman","sequence":"additional","affiliation":[{"name":"Vanderbilt Sports Concussion Center, Vanderbilt University Medical Center, Nashville, Tennessee"},{"name":"Department of Neurological Surgery, Vanderbilt University Medical Center, Nashville, Tennessee"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Allen K","family":"Sills","sequence":"additional","affiliation":[{"name":"Vanderbilt Sports Concussion Center, Vanderbilt University Medical Center, Nashville, Tennessee"},{"name":"Department of Neurological Surgery, Vanderbilt University Medical Center, Nashville, Tennessee"},{"name":"Player Health and Safety Department, National Football League, New York, New York"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeff R","family":"Crandall","sequence":"additional","affiliation":[{"name":"Biomechanics Consulting and Research LLC, Charlottesville, Virginia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David J","family":"Lessley","sequence":"additional","affiliation":[{"name":"Biomechanics Consulting and Research LLC, Charlottesville, Virginia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0674-0718","authenticated-orcid":false,"given":"Gary S","family":"Solomon","sequence":"additional","affiliation":[{"name":"Vanderbilt Sports Concussion Center, Vanderbilt University Medical Center, Nashville, Tennessee"},{"name":"Department of Neurological Surgery, Vanderbilt University Medical Center, Nashville, Tennessee"},{"name":"Player Health and Safety Department, National Football League, New York, New York"},{"name":"Department of Orthopaedic Surgery and Rehabilitation, Vanderbilt University Medical Center, Nashville, Tennessee"},{"name":"Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, Tennessee"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"276","published-online":{"date-parts":[[2020,9]]},"reference":[{"issue":"3","key":"bib1-20231011","doi-asserted-by":"crossref","first-page":"e20160910","DOI":"10.1542\/peds.2016-0910","article-title":"Removal from play after concussion and recovery time","volume":"138","author":"Elbin","year":"2016","journal-title":"Pediatrics"},{"issue":"6","key":"bib2-20231011","doi-asserted-by":"crossref","first-page":"1465","DOI":"10.1177\/0363546518757984","article-title":"Immediate removal from activity after sport-related concussion is associated with shorter clinical recovery and less severe symptoms in collegiate student-athletes","volume":"46","author":"Asken","year":"2018","journal-title":"Am J Sports Med"},{"issue":"1","key":"bib3-20231011","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1097\/00042752-200401000-00003","article-title":"Unreported concussion in high school football players","volume":"14","author":"McCrea","year":"2004","journal-title":"Clin J Sport Med"},{"issue":"1","key":"bib4-20231011","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1177\/0363546517728264","article-title":"Concussion nondisclosure during professional career among a cohort of former National Football League athletes","volume":"46","author":"Kerr","year":"2018","journal-title":"Am J Sports Med"},{"issue":"1","key":"bib5-20231011","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1177\/0363546515612082","article-title":"Motivations associated with nondisclosure of self-reported concussions in former collegiate athletes","volume":"44","author":"Kerr","year":"2016","journal-title":"Am J Sports Med"},{"issue":"8","key":"bib6-20231011","doi-asserted-by":"crossref","first-page":"1009","DOI":"10.3109\/02699052.2014.904049","article-title":"Disclosure and non-disclosure of concussion and concussion symptoms in athletes: review and application of the socio-ecological framework","volume":"28","author":"Kerr","year":"2014","journal-title":"Brain Inj"},{"issue":"10","key":"bib7-20231011","doi-asserted-by":"crossref","first-page":"859","DOI":"10.1016\/j.jsams.2016.02.015","article-title":"The reliability and validity of video analysis for the assessment of the clinical signs of concussion in Australian football","volume":"19","author":"Makdissi","year":"2016","journal-title":"J Sci Med Sport"},{"issue":"12","key":"bib8-20231011","doi-asserted-by":"crossref","first-page":"958","DOI":"10.1016\/j.jsams.2016.02.014","article-title":"Using video analysis for concussion surveillance in Australian football","volume":"19","author":"Makdissi","year":"2016","journal-title":"J Sci Med Sport"},{"issue":"20","key":"bib9-20231011","doi-asserted-by":"crossref","first-page":"1299","DOI":"10.1136\/bjsports-2018-099727","article-title":"International study of video review of concussion in professional sports","volume":"53","author":"Davis","year":"2019","journal-title":"Br J Sports Med"},{"issue":"17","key":"bib10-20231011","doi-asserted-by":"crossref","first-page":"1149","DOI":"10.1136\/bjsports-2016-097090","article-title":"Can visible signs predict concussion diagnosis in the National Hockey League?","volume":"52","author":"Echemendia","year":"2018","journal-title":"Br J Sports Med"},{"issue":"17","key":"bib11-20231011","doi-asserted-by":"crossref","first-page":"1143","DOI":"10.1136\/bjsports-2016-097091","article-title":"Development of a risk prediction model among professional hockey players with visible signs of concussion","volume":"52","author":"Bruce","year":"2018","journal-title":"Br J Sports Med"},{"issue":"1","key":"bib12-20231011","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1186\/s40798-017-0117-9","article-title":"A video review of multiple concussion signs in National Rugby League match play","volume":"4","author":"Gardner","year":"2018","journal-title":"Sports Med - Open"},{"issue":"1","key":"bib13-20231011","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1186\/s40798-017-0097-9","article-title":"Evidence of concussion signs in national rugby league match play: a video review and validation study","volume":"3","author":"Gardner","year":"2017","journal-title":"Sports Med\u2014Open"},{"issue":"1","key":"bib14-20231011","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1186\/s40798-018-0133-4","article-title":"The use of sideline video review to facilitate management decisions following head trauma in super rugby","volume":"4","author":"Gardner","year":"2018","journal-title":"Sports Med - Open"},{"issue":"14","key":"bib15-20231011","doi-asserted-by":"crossref","first-page":"3502","DOI":"10.1177\/0363546518804498","article-title":"Video analysis of reported concussion events in the National Football League during the 2015-2016 and 2016-2017 seasons","volume":"46","author":"Lessley","year":"2018","journal-title":"Am J Sports Med"},{"issue":"14","key":"bib16-20231011","doi-asserted-by":"crossref","first-page":"894","DOI":"10.1136\/bjsports-2018-099203","article-title":"National football league head, neck and spine committee's concussion diagnosis and management protocol: 2017\u201318 season","volume":"52","author":"Ellenbogen","year":"2018","journal-title":"Br J Sports Med"},{"issue":"11","key":"bib19-20231011","doi-asserted-by":"crossref","first-page":"898","DOI":"10.1016\/j.jsams.2016.02.005","article-title":"Use of video to facilitate sideline concussion diagnosis and management decision-making","volume":"19","author":"Davis","year":"2016","journal-title":"J Sci Med Sport"},{"issue":"9","key":"bib20-20231011","doi-asserted-by":"crossref","first-page":"1315","DOI":"10.1097\/JTO.0b013e3181ec173d","article-title":"Receiver operating characteristic curve in diagnostic test assessment","volume":"5","author":"Mandrekar","year":"2010","journal-title":"J Thorac Oncol"},{"issue":"20","key":"bib22-20231011","doi-asserted-by":"crossref","first-page":"1264","DOI":"10.1136\/bjsports-2019-100628","article-title":"Definitions of video signs of concussion in professional sports","volume":"53","author":"Davis","year":"2019","journal-title":"Br J Sports Med"},{"issue":"2","key":"bib23-20231011","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1136\/bjsports-2012-092059","article-title":"An observational method to code concussions in the National Hockey League (NHL): the heads-up checklist","volume":"48","author":"Hutchison","year":"2014","journal-title":"Br J Sports Med"},{"issue":"8","key":"bib24-20231011","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1136\/bjsports-2013-092234","article-title":"A systematic video analysis of National Hockey League (NHL) concussions, part I: who, when, where and what?","volume":"49","author":"Hutchison","year":"2015","journal-title":"Br J Sports Med"}],"container-title":["Neurosurgery"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/neurosurgery\/article-pdf\/87\/3\/530\/33644381\/nyaa072.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/www.ovid.com\/10.1093\/neuros\/nyaa072","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,7]],"date-time":"2026-08-07T16:55:29Z","timestamp":1786121729000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ovid.com\/10.1093\/neuros\/nyaa072"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,15]]},"references-count":21,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020]]}},"URL":"https:\/\/doi.org\/10.1093\/neuros\/nyaa072","relation":{},"ISSN":["0148-396X","1524-4040"],"issn-type":[{"value":"0148-396X","type":"print"},{"value":"1524-4040","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,4,15]]}}}