{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,12]],"date-time":"2026-09-12T05:34:10Z","timestamp":1789191250782,"version":"build-2803163510"},"reference-count":30,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2021,12,20]],"date-time":"2021-12-20T00:00:00Z","timestamp":1639958400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100004329","name":"Genzyme","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100004329","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100001267","name":"NFL","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100001267","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,2,22]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Objective<\/jats:title><jats:p>Neuropsychologists commonly use a large battery of tests to inform clinical decisions. Decision analysis can be used to determine which individual tests play a role in the decision-making process. The objective of this project was to conduct quantitative and qualitative decision analysis of decisions by team neuropsychologists with professional hockey players being evaluated as part of the National Hockey League (NHL)\/NHL Players Association Concussion Protocol.<\/jats:p><\/jats:sec><jats:sec><jats:title>Method<\/jats:title><jats:p>We extracted neuropsychological data from an NHL clinical program database. Team neuropsychologists evaluated concussed players using a hybrid neuropsychological test battery. The neuropsychologists then determined whether players were experiencing concussion-related cognitive difficulties. Logistic regression was used to examine which tests accounted for unique variance in the decision-making process. We also conducted a survey of NHL neuropsychologists, asking them to rate the usefulness of each test in the battery.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Five of the fifteen measures accounted for unique variance in team neuropsychologists\u2019 decisions, including the ImPACT Verbal Memory Composite, Visual Motor Composite, Reaction Time Composite, Symptom Score, and Brief Visuospatial Memory Test\u2014Revised Delayed Recall. Notable discrepancies were uncovered between quantitative indications of usefulness and self-reported qualitative perceptions of test usefulness when making decisions. Qualitatively, clinicians reported that the Hopkins Verbal Learning Test\u2014Revised, Symbol Digit Modalities Test, ImPACT Reaction Time, and Color Trails 2 were the most useful tests when making decisions.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>Along with validation studies, decision analysis can be used as part of a comprehensive evaluation process to inform the development of best-practice batteries for use among athletes with sports concussion.<\/jats:p><\/jats:sec>","DOI":"10.1093\/arclin\/acab092","type":"journal-article","created":{"date-parts":[[2021,11,22]],"date-time":"2021-11-22T20:11:35Z","timestamp":1637611895000},"page":"621-632","source":"Crossref","is-referenced-by-count":3,"title":["A Cross-Sectional Decision-Making Approach to Inform Neuropsychological Battery Development in Professional Hockey"],"prefix":"10.1093","volume":"37","author":[{"given":"Jared M","family":"Bruce","sequence":"first","affiliation":[{"name":"Department of Biomedical and Health Informatics, University of Missouri-Kansas City, Kansas City, MO 64108, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Willem","family":"Meeuwisse","sequence":"additional","affiliation":[{"name":"The National Hockey League"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joan","family":"Thelen","sequence":"additional","affiliation":[{"name":"Department of Psychology, University of Missouri-Kansas City, Kansas City, MO 64108, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael G","family":"Hutchison","sequence":"additional","affiliation":[{"name":"Faculty of Kinesiology and Physical Education, University of Toronto, Toronto, ON MS55 1A1, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul","family":"Comper","sequence":"additional","affiliation":[{"name":"Faculty of Kinesiology and Physical Education, University of Toronto, Toronto, ON MS55 1A1, Canada"},{"name":"Toronto Rehabilitation Institute, Toronto, ON M5G 2A2, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ruben J","family":"Echemendia","sequence":"additional","affiliation":[{"name":"Psychological and Neurobehavioral Associates, Inc., State College, PA 16801, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2021,12,20]]},"reference":[{"issue":"3","key":"2022042403035451800_ref1","first-page":"297","article-title":"Methodologic issues in neuropsychological testing","volume":"36","author":"Barr","year":"2001","journal-title":"Journal of Athletic Training"},{"key":"2022042403035451800_ref2","volume-title":"Brief visuospatial memory test-revised","author":"Benedict","year":"1997"},{"key":"2022042403035451800_ref3","volume-title":"Multilingual aphasia examination","author":"Benton","year":"1994"},{"key":"2022042403035451800_ref4","volume-title":"Hopkins verbal learning test-revised","author":"Brandt","year":"2001"},{"issue":"2","key":"2022042403035451800_ref5","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1136\/jnnp.2005.073155","article-title":"Cognition in the days following concussion: Comparison of symptomatic versus asymptomatic athletes","volume":"77","author":"Collie","year":"2006","journal-title":"Journal of Neurology, Neurosurgery, and Psychiatry"},{"issue":"3","key":"2022042403035451800_ref6","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1136\/bjsm.2003.000293","article-title":"Statistical procedures for determining the extent of cognitive change following concussion","volume":"38","author":"Collie","year":"2004","journal-title":"British Journal of Sports Medicine"},{"issue":"3","key":"2022042403035451800_ref7","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1080\/21622965.2013.816849","article-title":"Preliminary normative data on the Penn State University symbol cancellation task with nonconcussed adolescents","volume":"4","author":"Conder","year":"2015","journal-title":"Applied Neuropsychology: Child"},{"key":"2022042403035451800_ref8","volume-title":"Color Trails Test. Professional manual","author":"D'Elia","year":"1996"},{"issue":"1","key":"2022042403035451800_ref9","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1007\/s10439-011-0413-3","article-title":"A review of return to play issues and sports-related concussion","volume":"40","author":"Doolan","year":"2012","journal-title":"Annals of Biomedical Engineering"},{"issue":"1","key":"2022042403035451800_ref10","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1207\/S15324826AN1001_7","article-title":"Return to play following sports-related mild traumatic brain injury: The role for neuropsychology","volume":"10","author":"Echemendia","year":"2003","journal-title":"Applied Neuropsychology"},{"issue":"8","key":"2022042403035451800_ref11","doi-asserted-by":"crossref","first-page":"1289","DOI":"10.1080\/13854046.2011.618466","article-title":"Role of neuropsychologists in the evaluation and management of sport-related concussion: An inter-organization position statement","volume":"25","author":"Echemendia","year":"2011","journal-title":"The Clinical Neuropsychologist"},{"issue":"5","key":"2022042403035451800_ref12","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1136\/bjsports-2013-092186","article-title":"Advances in neuropsychological assessment of sport-related concussion","volume":"47","author":"Echemendia","year":"2013","journal-title":"British Journal of Sports Medicine"},{"issue":"1","key":"2022042403035451800_ref13","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1097\/00042752-200101000-00005","article-title":"Neuropsychological test performance prior to and following sports-related mild traumatic brain injury","volume":"11","author":"Echemendia","year":"2001","journal-title":"Clinical Journal of Sport Medicine"},{"issue":"5","key":"2022042403035451800_ref14","doi-asserted-by":"crossref","first-page":"899","DOI":"10.1080\/13854046.2019.1690051","article-title":"Testing the hybrid battery approach to evaluating sports-related concussion in the National Hockey League: A factor analytic study","volume":"34","author":"Echemendia","year":"2019","journal-title":"The Clinical Neuropsychologist"},{"issue":"3","key":"2022042403035451800_ref15","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1093\/arclin\/acz077","article-title":"Neuropsychological assessment of professional ice hockey players: A cross-cultural examination of baseline data across language groups","volume":"35","author":"Echemendia","year":"2020","journal-title":"Archives of Clinical Neuropsychology"},{"issue":"3","key":"2022042403035451800_ref16","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1080\/02699050500487910","article-title":"Tracking neuropsychological recovery following concussion in sport","volume":"20","author":"Iverson","year":"2006","journal-title":"Brain Injury"},{"issue":"2","key":"2022042403035451800_ref17","doi-asserted-by":"crossref","first-page":"263","DOI":"10.3109\/02699052.2014.965214","article-title":"Advanced topics in neuropsychological assessment following sport-related concussion","volume":"29","author":"Iverson","year":"2015","journal-title":"Brain Injury"},{"issue":"3","key":"2022042403035451800_ref18","doi-asserted-by":"crossref","first-page":"510","DOI":"10.1227\/00006123-199609000-00014","article-title":"Neuropsychological functioning and recovery after mild head injury in collegiate athletes","volume":"39","author":"Macciocchi","year":"1996","journal-title":"Neurosurgery"},{"key":"2022042403035451800_ref19","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1016\/j.jpeds.2017.10.032","article-title":"Returning adolescents to driving after sports-related concussions: What influences physician decision-making","volume":"194","author":"MacDonald","year":"2018","journal-title":"The Journal of Pediatrics"},{"issue":"5","key":"2022042403035451800_ref20","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1136\/bjsports-2013-092256","article-title":"Revisiting the modifiers: How should the evaluation and management of acute concussions differ in specific groups?","volume":"47","author":"Makdissi","year":"2013","journal-title":"British Journal of Sports Medicine"},{"issue":"1","key":"2022042403035451800_ref21","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1017\/S1355617705050083","article-title":"Standard regression-based methods for measuring recovery after sport-related concussion","volume":"11","author":"McCrea","year":"2005","journal-title":"Journal of the International Neuropsychological Society"},{"issue":"11","key":"2022042403035451800_ref22","doi-asserted-by":"crossref","first-page":"838","DOI":"10.1136\/bjsports-2017-097699","article-title":"Consensus statement on concussion in sport-the 5(th) international conference on concussion in sport held in Berlin, October 2016","volume":"51","author":"McCrory","year":"2017","journal-title":"British Journal of Sports Medicine"},{"key":"2022042403035451800_ref23","doi-asserted-by":"crossref","first-page":"bjsports-2017-097699","DOI":"10.1136\/bjsports-2017-097699","article-title":"Consensus statement on concussion in sport-the 5th international conference on concussion in sport held in Berlin, October 2016","author":"McCrory","year":"2017","journal-title":"British Journal of Sports Medicine"},{"issue":"1","key":"2022042403035451800_ref24","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1097\/01.CSMR.0000306514.79430.cd","article-title":"Repeat mild traumatic brain injury: How to adjust return to play guidelines","volume":"5","author":"Putukian","year":"2006","journal-title":"Current Sports Medicine Reports"},{"issue":"10 Suppl 2","key":"2022042403035451800_ref25","doi-asserted-by":"crossref","first-page":"S425","DOI":"10.1016\/j.pmrj.2011.08.003","article-title":"Neuropsychological testing as it relates to recovery from sports-related concussion","volume":"3","author":"Putukian","year":"2011","journal-title":"PM & R : The Journal of Injury, Function, and Rehabilitation"},{"issue":"3","key":"2022042403035451800_ref26","first-page":"139","article-title":"Is neuropsychological testing useful in the management of sport-related concussion?","volume":"40","author":"Randolph","year":"2005","journal-title":"Journal of Athletic Training"},{"issue":"4","key":"2022042403035451800_ref27","doi-asserted-by":"crossref","first-page":"274","DOI":"10.1097\/HTR.0b013e3182585d37","article-title":"Reliable change, sensitivity, and specificity of a multidimensional concussion assessment battery: Implications for caution in clinical practice","volume":"28","author":"Register-Mihalik","year":"2013","journal-title":"The Journal of Head Trauma Rehabilitation"},{"issue":"5","key":"2022042403035451800_ref28","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1097\/00001199-200210000-00003","article-title":"Applications of computer-based neuropsychological assessment","volume":"17","author":"Schatz","year":"2002","journal-title":"The Journal of Head Trauma Rehabilitation"},{"key":"2022042403035451800_ref29","volume-title":"Symbol digit modalities test","author":"Smith","year":"1982"},{"issue":"10","key":"2022042403035451800_ref30","doi-asserted-by":"crossref","first-page":"1630","DOI":"10.1177\/0363546506288677","article-title":"The \"value added\" of neurocognitive testing after sports-related concussion","volume":"34","author":"Van Kampen","year":"2006","journal-title":"The American Journal of Sports Medicine"}],"container-title":["Archives of Clinical Neuropsychology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/acn\/article-pdf\/37\/3\/621\/43408976\/acab092.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/acn\/article-pdf\/37\/3\/621\/43408976\/acab092.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,12]],"date-time":"2024-09-12T21:01:09Z","timestamp":1726174869000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/acn\/article\/37\/3\/621\/6470587"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,20]]},"references-count":30,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2021,12,20]]},"published-print":{"date-parts":[[2022,2,22]]}},"URL":"https:\/\/doi.org\/10.1093\/arclin\/acab092","relation":{},"ISSN":["1873-5843"],"issn-type":[{"value":"1873-5843","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,5]]},"published":{"date-parts":[[2021,12,20]]}}}