{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T05:29:03Z","timestamp":1777440543475,"version":"3.51.4"},"reference-count":39,"publisher":"SAGE Publications","issue":"7","license":[{"start":{"date-parts":[[2021,6,11]],"date-time":"2021-06-11T00:00:00Z","timestamp":1623369600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Assessment"],"published-print":{"date-parts":[[2022,10]]},"abstract":"<jats:p>Recent research has yielded multivariate base rates (MBRs) of low scores in healthy populations using a widely adopted concussion screening measure, Immediate Postconcussion and Cognitive Testing (ImPACT). However, the extent to which individuals with concussion obtain reliable changes at divergent frequencies relative to healthy individuals is largely unknown. The present study examined whether MBRs of reliable change accurately discriminated between those with and without concussion. This archival review consisted of 129 healthy individuals and 81 individuals with concussion. MBRs of reliable change scores were examined at varying cutoffs and frequencies between those with and without concussion. Composites showed small to medium effect sizes in differentiating between those with and without concussion. MBRs of reliable change scores on ImPACT provided limited discriminative utility in isolation. Computations of posttest probabilities using Bayes\u2019 Theorem yielded evidence for incremental gains when utilizing MBRs of reliable change under certain constraints.<\/jats:p>","DOI":"10.1177\/10731911211022840","type":"journal-article","created":{"date-parts":[[2021,6,12]],"date-time":"2021-06-12T01:56:24Z","timestamp":1623462984000},"page":"1548-1558","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":1,"title":["Multivariate Base Rates and Concussion Detection: A Comparative Study"],"prefix":"10.1177","volume":"29","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1602-9652","authenticated-orcid":false,"given":"Charles E.","family":"Gaudet","sequence":"first","affiliation":[{"name":"Brown University, Providence, Rhode Island, USA"},{"name":"University of Rhode Island, Kingston, Rhode Island, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2021,6,11]]},"reference":[{"key":"bibr1-10731911211022840","doi-asserted-by":"crossref","unstructured":"Alsalaheen B., Stockdale K., Pechumer D., Broglio S. P. (2016a). Measurement error in the immediate postconcussion assessment and cognitive testing (ImPACT): Systematic review. Journal of Head Trauma Rehabilitation, 31(4), 242-251. https:\/\/doi.org\/10.1097\/HTR.0000000000000175","DOI":"10.1097\/HTR.0000000000000175"},{"key":"bibr2-10731911211022840","doi-asserted-by":"publisher","DOI":"10.1007\/s40279-016-0532-y"},{"key":"bibr3-10731911211022840","doi-asserted-by":"crossref","unstructured":"Binder L. M., Iverson G. L., Brooks B. L. (2009). To err is human: \u201cAbnormal\u201d neuropsychological scores and variability are common in healthy adults. Archives of Clinical Neuropsychology, 24(1), 31-46. https:\/\/doi.org\/10.1093\/arclin\/acn001","DOI":"10.1093\/arclin\/acn001"},{"key":"bibr4-10731911211022840","doi-asserted-by":"crossref","unstructured":"Broglio S. P., Katz B. P., Zhao S., McCrea M., McAllister T., Reed Hoy A., Hazzard J., Kelly L., Ortega J., Port N., Putukian M., Langford D., Campbell D., McGinty G., O\u2019Donnell P., Svoboda S., DiFiori J., Giza C., Benjamin H. Lintner L. (2018). Test-retest reliability and interpretation of common concussion assessment tools: Findings from the NCAA-DoD CARE Consortium. Sports Medicine, 48(5), 1255-1268. https:\/\/doi.org\/10.1007\/s40279-017-0813-0","DOI":"10.1007\/s40279-017-0813-0"},{"key":"bibr5-10731911211022840","doi-asserted-by":"crossref","unstructured":"Brooks B. L., Iverson G. L., Koushik N. S., Mazur-Mosiewicz A., MacNeill Horton A.Jr., Reynolds C. R. (2013). Prevalence of low scores in children and adolescents on the test of verbal conceptualization and fluency. Applied Neuropsychology: Child, 2(1), 70-77. https:\/\/doi.org\/10.1080\/21622965.2012.742792","DOI":"10.1080\/21622965.2012.742792"},{"key":"bibr6-10731911211022840","doi-asserted-by":"crossref","unstructured":"Brooks B. L., Iverson G. L., Sherman E. M. S., Roberge M. C. (2010). Identifying cognitive problems in children and adolescents with depression using computerized neuropsychological testing. Applied Neuropsychology, 17(1), 37-43. https:\/\/doi.org\/10.1080\/09084280903526083","DOI":"10.1080\/09084280903526083"},{"key":"bibr7-10731911211022840","doi-asserted-by":"crossref","unstructured":"Brooks B. L., Iverson G. L., White T. (2007). Substantial risk of \u201caccidental MCI\u201d in healthy older adults: Base rates of low memory scores in neuropsychological assessment. Journal of the International Neuropsychological Society, 13(3), 490-500. https:\/\/doi.org\/10.1017\/S1355617707070531","DOI":"10.1017\/S1355617707070531"},{"key":"bibr8-10731911211022840","doi-asserted-by":"crossref","unstructured":"Buckley T. A., Burdette G., Kelly K. (2015). Concussion-management practice patterns of National Collegiate Athletic Association Division II and III athletic trainers: How the other half lives. Journal of Athletic Training, 50(8), 879-888. https:\/\/doi.org\/10.4085\/1062-6050-50.7.04","DOI":"10.4085\/1062-6050-50.7.04"},{"key":"bibr9-10731911211022840","doi-asserted-by":"crossref","unstructured":"Cook N. E., Karr J. E., Brooks B. L., Garcia-Barrera M. A., Holdnack J. A., Iverson G. L. (2019). Multivariate base rates for the assessment of executive functioning among children and adolescents. Child Neuropsychology, 25(6), 836-858. https:\/\/doi.org\/10.1080\/09297049.2018.1543389","DOI":"10.1080\/09297049.2018.1543389"},{"key":"bibr10-10731911211022840","doi-asserted-by":"crossref","unstructured":"Crawford J. R., Garthwaite P. H., Gault C. B. (2007). Estimating the percentage of the population with abnormally low scores (or abnormally large score differences) on standardized neuropsychological test batteries: A generic method with applications. Neuropsychology, 21(4), 419-430. https:\/\/doi.org\/10.1037\/0894-4105.21.4.419","DOI":"10.1037\/0894-4105.21.4.419"},{"key":"bibr11-10731911211022840","doi-asserted-by":"crossref","unstructured":"Czerniak L. L., Liebel S. W., Garcia G. G. P., Lavieri M. S., McCrea M. A., McAllister T. W., Broglio S. P., Anderson S. A., Benjamin H. J., Brooks A., Buckley T., Cameron K. L., Chrisman S. P. D., Clugston J. R., Duma S. M., Eckner J., Feigenbaum L. A., Goldman J. T., Hazzard J. B. Whitlow C. T. (2020). Sensitivity and specificity of computer-based neurocognitive tests in sport-related concussion: Findings from the NCAA-DoD CARE Consortium. Sports Medicine, 51(2), 351-365. https:\/\/doi.org\/10.1007\/s40279-020-01393-7","DOI":"10.1007\/s40279-020-01393-7"},{"key":"bibr12-10731911211022840","doi-asserted-by":"crossref","unstructured":"Duff K. (2012). Current topics in science and practice evidence-based indicators of neuropsychological change in the individual patient: Relevant concepts and methods. Archives of Clinical Neuropsychology, 27(3), 248-261. https:\/\/doi.org\/10.1093\/arclin\/acr120","DOI":"10.1093\/arclin\/acr120"},{"key":"bibr13-10731911211022840","doi-asserted-by":"crossref","unstructured":"Eagle S. R., Womble M. N., Elbin R. J., Pan R., Collins M. W., Kontos A. P. (2020). Concussion symptom cutoffs for identification and prognosis of sports-related concussion: Role of time since injury. American Journal of Sports Medicine, 48(10), 2544-2551. https:\/\/doi.org\/10.1177\/0363546520937291","DOI":"10.1177\/0363546520937291"},{"key":"bibr14-10731911211022840","doi-asserted-by":"crossref","unstructured":"Farnsworth J. L., Dargo L., Ragan B. G., Kang M. (2017). Reliability of computerized neurocognitive tests for concussion assessment: A meta-analysis. Journal of Athletic Training, 52(9), 826-833. https:\/\/doi.org\/10.4085\/1062-6050-52.6.03","DOI":"10.4085\/1062-6050-52.6.03"},{"key":"bibr15-10731911211022840","doi-asserted-by":"crossref","unstructured":"Gaudet C. E., Cook N. E., Kavanaugh B. C., Studeny J., Holler K. (2019). Prevalence of low test scores in a pediatric psychiatric inpatient population: Applying multivariate base rate analyses. Applied Neuropsychology: Child, 8(2), 163-173. https:\/\/doi.org\/10.1080\/21622965.2017.1417126","DOI":"10.1080\/21622965.2017.1417126"},{"key":"bibr16-10731911211022840","doi-asserted-by":"crossref","unstructured":"Gaudet C. E., Konin J., Faust D. (2020). Immediate post-concussion and cognitive testing: Ceiling effects, reliability, and implications for interpretation. Archives of Clinical Neuropsychology, 36(4), 561-569. https:\/\/doi.org\/10.1093\/arclin\/acaa074","DOI":"10.1093\/arclin\/acaa074"},{"key":"bibr17-10731911211022840","doi-asserted-by":"crossref","unstructured":"Gavett B. E. (2015). The value of Bayes\u2019 theorem for interpreting abnormal test scores in cognitively healthy and clinical samples. Journal of the International Neuropsychological Society, 21(3), 249-257. https:\/\/doi.org\/10.1017\/S1355617715000168","DOI":"10.1017\/S1355617715000168"},{"key":"bibr18-10731911211022840","volume-title":"Comprehensive norms for an extended Halstead\u2013Reitan Battery: Demographic corrections, research findings, and clinical applications","author":"Heaton R. K.","year":"1991"},{"key":"bibr19-10731911211022840","volume-title":"Revised comprehensive norms for an expanded Halstead-Reitan Battery: Demographically adjusted neuropsychological norms for African American and Caucasian adults","author":"Heaton R. K.","year":"2004"},{"key":"bibr20-10731911211022840","doi-asserted-by":"crossref","unstructured":"Hides J. A., Franettovich Smith M. M., Mendis M. D., Treleaven J., Rotstein A. H., Sexton C. T., Low Choy N., McCrory P. (2017). Self-reported concussion history and sensorimotor tests predict head\/neck injuries. Medicine & Science in Sports & Exercise, 49(12), 2385-2393. https:\/\/doi.org\/10.1249\/MSS.0000000000001372","DOI":"10.1249\/MSS.0000000000001372"},{"key":"bibr21-10731911211022840","doi-asserted-by":"crossref","unstructured":"Hinton-Bayre A. (2016). Clarifying discrepancies in responsiveness between reliable change indices. Archives of Clinical Neuropsychology, 31(7), 754-768. https:\/\/doi.org\/10.1093\/arclin\/acw064","DOI":"10.1093\/arclin\/acw064"},{"key":"bibr22-10731911211022840","doi-asserted-by":"crossref","unstructured":"Holdnack J. A., Tulsky D. S., Brooks B. L., Slotkin J., Gershon R., Heinemann A. W., Iverson G. L. (2017). Interpreting patterns of low scores on the NIH Toolbox Cognition Battery. Archives of Clinical Neuropsychology, 32(5), 574-584. https:\/\/doi.org\/10.1093\/arclin\/acx032","DOI":"10.1093\/arclin\/acx032"},{"key":"bibr23-10731911211022840","doi-asserted-by":"crossref","unstructured":"Horton A. M., Reynolds C. R., Brooks B. L., Koushik N. S., Mazur-Mosiewicz A., Iverson G. L. (2012). Prevalence of low scores in children and adolescents on the test of verbal conceptualization and fluency. Applied Neuropsychology: Child, 2(1), 70-77. https:\/\/doi.org\/10.1080\/21622965.2012.742792","DOI":"10.1080\/21622965.2012.742792"},{"key":"bibr24-10731911211022840","doi-asserted-by":"crossref","unstructured":"Houck Z. M., Asken B. M., Bauer R. M., Kontos A. P., McCrea M. A., Mcallister T. W., Broglio S. P., Clugston J. R. (2019). Multivariate base rates of low scores and reliable decline on ImPACT in healthy collegiate athletes using CARE Consortium norms. Journal of the International Neuropsychological Society, 25(9), 961-971. https:\/\/doi.org\/10.1017\/S1355617719000729","DOI":"10.1017\/S1355617719000729"},{"key":"bibr25-10731911211022840","doi-asserted-by":"crossref","unstructured":"Iverson G. L., Brooks B. L., Collins M. W., Lovell M. R. (2006). Tracking neuropsychological recovery following concussion in sport. Brain Injury, 20(3), 245-252. https:\/\/doi.org\/10.1080\/02699050500487910","DOI":"10.1080\/02699050500487910"},{"key":"bibr26-10731911211022840","doi-asserted-by":"crossref","unstructured":"Iverson G. L., Lovell M. R., Collins M. W. (2004). Interpreting change on ImPACT following sport concussion. The Clinical Neuropsychologist, 17(4), 460-467. https:\/\/doi.org\/10.1076\/clin.17.4.460.27934","DOI":"10.1076\/clin.17.4.460.27934"},{"key":"bibr27-10731911211022840","doi-asserted-by":"crossref","unstructured":"Karr J. E., Garcia-Barrera M. A., Holdnack J. A., Iverson G. L. (2017). Using multivariate base rates to interpret low scores on an abbreviated battery of the Delis\u2013Kaplan executive function system. Archives of Clinical Neuropsychology, 32(3), 297-305. https:\/\/doi.org\/10.1093\/arclin\/acw105","DOI":"10.1093\/arclin\/acw105"},{"key":"bibr28-10731911211022840","doi-asserted-by":"crossref","unstructured":"Kim H.Y. (2017). Statistical notes for clinical researchers: Chi-squared test and Fisher\u2019s exact test. Restorative Dentistry & Endodontics, 42(2), 152-155. https:\/\/doi.org\/10.5395\/rde.2017.42.2.152","DOI":"10.5395\/rde.2017.42.2.152"},{"key":"bibr29-10731911211022840","doi-asserted-by":"crossref","unstructured":"Labarge A. S., Mccaffrey R. J., Brown T. A. (2003). Neuropsychologists\u2019 abilities to determine the predictive value of diagnostic tests. Archives of Clinical Neuropsychology, 18(2), 165-175. https:\/\/doi.org\/10.1093\/arclin\/18.2.165","DOI":"10.1093\/arclin\/18.2.165"},{"key":"bibr30-10731911211022840","unstructured":"Lovell M. R. (2016). ImPACT administration and interpretation manual. ImPACT Applications, Inc. www.impacttest.com"},{"key":"bibr31-10731911211022840","doi-asserted-by":"crossref","unstructured":"Lynall R. C., Laudner K. G., Mihalik J. P., Stanek J. M. (2013). Concussion-assessment and -management techniques used by athletic trainers. Journal of Athletic Training, 48(6), 844-850. https:\/\/doi.org\/10.4085\/1062-6050-48.6.04","DOI":"10.4085\/1062-6050-48.6.04"},{"key":"bibr32-10731911211022840","doi-asserted-by":"crossref","unstructured":"McCrory P., Meeuwisse W., Aubry M., Cantu R. C., Dvo\u0159\u00e1k J., Echemendia R. J., Engebretsen L., Johnston K., Kutcher J. S., Raftery M., Sills A., Benson B. W., Davis G. A., Ellenbogen R., Guskiewicz K. M., Herring S. A., Iverson G. L., Jordan B. D., Kissick J. Turner M. (2013). Consensus statement on concussion in sport: The 4th International Conference on Concussion in Sport, Zurich, November 2012. Journal of Athletic Training, 48(4), 554-575. https:\/\/doi.org\/10.4085\/1062-6050-48.4.05","DOI":"10.4085\/1062-6050-48.4.05"},{"key":"bibr33-10731911211022840","doi-asserted-by":"crossref","unstructured":"McCrory P., Meeuwisse W., Dvo\u0159\u00e1k J., Aubry M., Bailes J., Broglio S., Cantu R. C., Cassidy D., Echemendia R. J., Castellani R. J., Davis G. A., Ellenbogen R., Emery C., Engebretsen L., Feddermann-Demont N., Giza C. C., Guskiewicz K. M., Herring S., Iverson G. L. Vos P. E. (2017). Consensus statement on concussion in sport: The 5th international conference on concussion in sport held in Berlin, October 2016. British Journal of Sports Medicine, 51(11), 838-847. https:\/\/doi.org\/10.1136\/bjsports-2017-097699","DOI":"10.1136\/bjsports-2017-097699"},{"key":"bibr34-10731911211022840","doi-asserted-by":"crossref","unstructured":"McCrory P., Meeuwisse W., Johnston K., Dvorak J., Aubry M., Molloy M., Cantu R. (2009). Consensus statement on concussion in sport: The 3rd International Conference on concussion in sport, held in Zurich, November 2008. Journal of Clinical Neuroscience, 16(6), 755-763. https:\/\/doi.org\/10.1016\/j.jocn.2009.02.002","DOI":"10.1016\/j.jocn.2009.02.002"},{"key":"bibr35-10731911211022840","doi-asserted-by":"crossref","unstructured":"Meehan W. P., Collins C. L., Taylor A. M., Dawn Comstock R. (2012). Computerized neurocognitive testing for the management of sport-related concussions. Pediatrics, 129(1), 38-44. https:\/\/doi.org\/10.1542\/peds.2011-1972","DOI":"10.1542\/peds.2011-1972"},{"key":"bibr36-10731911211022840","doi-asserted-by":"crossref","unstructured":"Nelson L. D., Laroche A. A., Pfaller A. Y., Lerner E. B., Hammeke T. A., Randolph C., Barr W. B., Guskiewicz K., McCrea M. A. (2015). Prospective, head-to-head study of three computerized neurocognitive assessment tools (CNTs): Reliability and validity for the assessment of sport-related concussion. Journal of the International Neuropsychological Society, 22(1), 24-37. https:\/\/doi.org\/10.1017\/S1355617715001101","DOI":"10.1017\/S1355617715001101"},{"key":"bibr37-10731911211022840","doi-asserted-by":"crossref","unstructured":"Resch J. E., Macciocchi S., Ferrara M. S. (2013). Preliminary evidence of equivalence of alternate forms of the impact. Clinical Neuropsychologist, 27(8), 1265-1280. https:\/\/doi.org\/10.1080\/13854046.2013.845247","DOI":"10.1080\/13854046.2013.845247"},{"key":"bibr38-10731911211022840","doi-asserted-by":"crossref","unstructured":"Schretlen D. J., Munro C. A., Anthony J. C., Pearlson G. D. (2003). Examining the range of normal intraindividual variability in neuropsychological test performance. Journal of the International Neuropsychological Society, 9(6), 864-870. https:\/\/doi.org\/10.10170S1355617703960061","DOI":"10.1017\/S1355617703960061"},{"key":"bibr39-10731911211022840","doi-asserted-by":"crossref","unstructured":"Van Kampen D. A., Lovell M. R., Pardini J. E., Collins M. W., Fu F. H. (2006). The \u201cvalue added\u201d of neurocognitive testing after sports-related concussion. American Journal of Sports Medicine, 34(10), 1630-1635. https:\/\/doi.org\/10.1177\/0363546506288677","DOI":"10.1177\/0363546506288677"}],"container-title":["Assessment"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10731911211022840","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/10731911211022840","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10731911211022840","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T12:11:46Z","timestamp":1777378306000},"score":1,"resource":{"primary":{"URL":"http:\/\/journals.sagepub.com\/doi\/10.1177\/10731911211022840"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,11]]},"references-count":39,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2022,10]]}},"alternative-id":["10.1177\/10731911211022840"],"URL":"https:\/\/doi.org\/10.1177\/10731911211022840","relation":{},"ISSN":["1073-1911","1552-3489"],"issn-type":[{"value":"1073-1911","type":"print"},{"value":"1552-3489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,11]]}}}