{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,15]],"date-time":"2026-10-15T16:45:00Z","timestamp":1792082700131,"version":"4.4.0"},"reference-count":51,"publisher":"Oxford University Press (OUP)","issue":"7","license":[{"start":{"date-parts":[[2026,10,15]],"date-time":"2026-10-15T00:00:00Z","timestamp":1792022400000},"content-version":"vor","delay-in-days":36,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000288","name":"The Royal Society","doi-asserted-by":"publisher","award":["RGS\\R2\\180055"],"award-info":[{"award-number":["RGS\\R2\\180055"]}],"id":[{"id":"10.13039\/501100000288","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,9,9]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>The aim of the study was to map trajectories of inter- and intra-individual cognitive performance in non-injured elite rugby players to further understand the effects of serial cognitive assessment in athletes at risk of concussion.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Method<\/jats:title>\n                    <jats:p>The Trail Making Test (TMT) was administered to male elite rugby league players (N\u2009=\u200938) at three time-points pre-season and on average 6.8 times per month during a playing season. Three players were excluded from the analyses due to concussion or suspected concussion. The data were analyzed using multilevel models including fixed and random effects of time to assess within- and between-individual variability.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Time was the greatest predictor of both TMT-A and TMT-B scores; test performance improved until it reached a plateau and then remained stable. The reduction of within-individual variance indicated that test repetition contributed to improvements in TMT-A and TMT-B performance within each player. Importantly, performance was significantly different between players at first testing and over the course of a playing season which indicated performance heterogeneity within one cohort of elite rugby league players.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>The current study has contributed to further understanding pre-injury cognitive performance in elite rugby players and indicated the need for future studies to implement strategies for reducing practice effects. Most importantly, these findings are relevant when assessing cognitive functioning in athletes at risk of concussion. This study emphasized the need to account for variability in performance pre-injury, the assessment of potential performance confounds and recommends the application of methods to reduce practice effects.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/arclin\/acag082","type":"journal-article","created":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T11:41:08Z","timestamp":1790682068000},"source":"Crossref","is-referenced-by-count":0,"title":["The effects of serial assessment using the trail making test in elite rugby league players"],"prefix":"10.1093","volume":"41","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1208-6588","authenticated-orcid":false,"given":"Cassandra","family":"Richardson","sequence":"first","affiliation":[{"name":"School of Psychology and Social Sciences, University of Winchester , Winchester SO22 4NR ,","place":["UK"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephen","family":"Atkins","sequence":"additional","affiliation":[{"name":"School of Health & Society, University of Salford , Salford M5 4WT ,","place":["UK"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Howard","family":"Hurst","sequence":"additional","affiliation":[{"name":"School of Health, Social Work and Sport, University of Lancashire , Preston PR1 2HE ,","place":["UK"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ian","family":"Bentley","sequence":"additional","affiliation":[{"name":"School of Health, Social Work and Sport, University of Lancashire , Preston PR1 2HE ,","place":["UK"]},{"name":"Wigan Warriors RLFC , Wigan WN5 0UH ,","place":["UK"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonathan Kenneth","family":"Sinclair","sequence":"additional","affiliation":[{"name":"School of Health, Social Work and Sport, University of Lancashire , Preston PR1 2HE ,","place":["UK"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2026,10,15]]},"reference":[{"issue":"6","key":"2026101511472923500_ref1","doi-asserted-by":"publisher","first-page":"697","DOI":"10.1001\/jamaneurol.2018.0031","article-title":"Prevalence of invalid performance on baseline testing for sport-related concussion by age and validity indicator","volume":"75","author":"Abeare","year":"2018","journal-title":"JAMA Neurology"},{"issue":"2","key":"2026101511472923500_ref2","doi-asserted-by":"publisher","first-page":"270","DOI":"10.1177\/1094428112470848","article-title":"Best-practice recommendations for defining, identifying, and handling outliers","volume":"16","author":"Aguinis","year":"2013","journal-title":"Organizational Research Methods"},{"issue":"2","key":"2026101511472923500_ref3","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1016\/j.smhs.2025.07.003","article-title":"Mapping the acute trajectory of sport-related concussion outcomes across symptoms, cognition, and blood biomarkers","volume":"8","author":"Ahn","year":"2026","journal-title":"Sports Medicine and Health Science"},{"issue":"2","key":"2026101511472923500_ref4","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1007\/BF03324425","article-title":"Variability of trail making test, symbol digit test and line trait test in normal people. A normative study taking into account age-dependent decline and sociobiological variables","volume":"14","author":"Amodio","year":"2002","journal-title":"Aging Clinical and Experimental Research"},{"issue":"4","key":"2026101511472923500_ref5","doi-asserted-by":"publisher","first-page":"518","DOI":"10.1076\/1380-3395(200008)22:4;1-0;FT518","article-title":"Trail making test, part B as a measure of executive control: Validation using a set-switching paradigm","volume":"22","author":"Arbuthnott","year":"2000","journal-title":"Journal of Clinical and Experimental Neuropsychology"},{"issue":"7","key":"2026101511472923500_ref6","doi-asserted-by":"publisher","first-page":"1193","DOI":"10.1080\/13854046.2011.589410","article-title":"Using versions of the trail making test as alternate forms","volume":"25","author":"Atkinson","year":"2011","journal-title":"The Clinical Neuropsychologist"},{"issue":"1","key":"2026101511472923500_ref7","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1080\/13854040801945078","article-title":"The prediction of change: Normative neuropsychological trajectories","volume":"23","author":"Attix","year":"2009","journal-title":"The Clinical Neuropsychologist"},{"issue":"1","key":"2026101511472923500_ref8","doi-asserted-by":"publisher","first-page":"118","DOI":"10.1186\/1471-2202-11-118","article-title":"Practice effects in healthy adults: A longitudinal study on frequent repetitive cognitive testing","volume":"11","author":"Bartels","year":"2010","journal-title":"BMC Neuroscience"},{"issue":"4","key":"2026101511472923500_ref9","doi-asserted-by":"publisher","first-page":"517","DOI":"10.1016\/j.acn.2004.12.003","article-title":"Practice effects and the use of alternate forms in serial neuropsychological testing","volume":"20","author":"Beglinger","year":"2005","journal-title":"Archives of Clinical Neuropsychology"},{"issue":"3","key":"2026101511472923500_ref10","doi-asserted-by":"publisher","first-page":"e213467","DOI":"10.1001\/jamanetworkopen.2021.3467","article-title":"Latent profile analysis of neuropsychiatric symptoms and cognitive function of adults 2 weeks after traumatic brain injury: Findings from the TRACK-TBI study","volume":"4","author":"Brett","year":"2021","journal-title":"JAMA Network Open"},{"issue":"23","key":"2026101511472923500_ref11","doi-asserted-by":"publisher","first-page":"2776","DOI":"10.1089\/neu.2018.5643","article-title":"National Institute of Neurological Disorders and Stroke and Department of Defense sport-related concussion common data elements version 1.0 recommendations","volume":"35","author":"Broglio","year":"2018","journal-title":"Journal of Neurotrauma"},{"issue":"4","key":"2026101511472923500_ref12","doi-asserted-by":"publisher","first-page":"543","DOI":"10.1080\/13854046.2012.680913","article-title":"Scoring higher the second time around: Meta-analyses of practice effects in neuropsychological assessment","volume":"26","author":"Calamia","year":"2012","journal-title":"The Clinical Neuropsychologist"},{"issue":"2","key":"2026101511472923500_ref13","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1136\/jnnp.2005.073155","article-title":"Cognition in the days following concussion: Comparison of symptomatic versus asymptomatic athletes","volume":"77","author":"Collie","year":"2006","journal-title":"Journal of Neurology, Neurosurgery & Psychiatry"},{"issue":"10","key":"2026101511472923500_ref14","doi-asserted-by":"publisher","first-page":"964","DOI":"10.1001\/jama.282.10.964","article-title":"Relationship between concussion and neuropsychological performance in college football players","volume":"282","author":"Collins","year":"1999","journal-title":"JAMA"},{"issue":"4","key":"2026101511472923500_ref15","doi-asserted-by":"publisher","first-page":"346","DOI":"10.1017\/S1355617799544056","article-title":"Test\u2013retest reliability and practice effects of expanded Halstead\u2013Reitan neuropsychological test battery","volume":"5","author":"Dikmen","year":"1999","journal-title":"Journal of the International Neuropsychological Society"},{"issue":"1","key":"2026101511472923500_ref16","first-page":"39","article-title":"Demographic characteristics and normative observations for derived-trail making test indices","volume":"15","author":"Drane","year":"2002","journal-title":"Neuropsychiatry, Neuropsychology, and Behavioral Neurology"},{"issue":"5","key":"2026101511472923500_ref17","doi-asserted-by":"publisher","first-page":"294","DOI":"10.1136\/bjsports-2013-092186","article-title":"Advances in neuropsychological assessment of sport-related concussion","volume":"47","author":"Echemendia","year":"2013","journal-title":"British Journal of Sports Medicine"},{"issue":"5","key":"2026101511472923500_ref18","doi-asserted-by":"publisher","first-page":"473","DOI":"10.1093\/arclin\/acs050","article-title":"Neuropsychological testing for sports-related concussion: How athletes can sandbag their baseline testing without detection","volume":"27","author":"Erdal","year":"2012","journal-title":"Archives of Clinical Neuropsychology"},{"issue":"12","key":"2026101511472923500_ref19","doi-asserted-by":"publisher","first-page":"1204","DOI":"10.1016\/j.jsams.2021.06.002","article-title":"Expansion of cognitive testing for off-field concussion screening in elite rugby players: A cohort study","volume":"24","author":"Fuller","year":"2021","journal-title":"Journal of Science and Medicine in Sport"},{"issue":"1","key":"2026101511472923500_ref20","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1016\/j.dadm.2014.11.003","article-title":"Practice effects due to serial cognitive assessment: Implications for preclinical Alzheimer's disease randomized controlled trials","volume":"1","author":"Goldberg","year":"2015","journal-title":"Alzheimer's & Dementia"},{"key":"2026101511472923500_ref21","doi-asserted-by":"publisher","first-page":"1707","DOI":"10.3389\/fpsyg.2019.01707","article-title":"Effects of open versus closed skill exercise on cognitive function: A systematic review","volume":"10","author":"Gu","year":"2019","journal-title":"Frontiers in Psychology"},{"key":"2026101511472923500_ref22","doi-asserted-by":"publisher","first-page":"117168","DOI":"10.1016\/j.jns.2020.117168","article-title":"The learning effect of the king-Devick test in semi-professional rugby union athletes","volume":"419","author":"Gunasekaran","year":"2020","journal-title":"Journal of the Neurological Sciences"},{"issue":"8","key":"2026101511472923500_ref23","doi-asserted-by":"publisher","first-page":"897","DOI":"10.1080\/13803390802687423","article-title":"Development and validation of an attention-deficit\/hyperactivity disorder (ADHD) executive function and behavior rating screening battery","volume":"31","author":"Hale","year":"2009","journal-title":"Journal of Clinical and Experimental Neuropsychology"},{"issue":"2","key":"2026101511472923500_ref24","doi-asserted-by":"publisher","first-page":"e200123","DOI":"10.1212\/CPJ.0000000000200123","article-title":"Sport-related concussion: A cognitive perspective","volume":"13","author":"Hallock","year":"2023","journal-title":"Neurology. Clinical Practice"},{"issue":"1","key":"2026101511472923500_ref25","doi-asserted-by":"publisher","first-page":"e001904","DOI":"10.1136\/bmjsem-2024-001904","article-title":"Performance of current tools used for on-the-day assessment and diagnosis of mild traumatic brain injury in sport: A systematic review","volume":"11","author":"Haste","year":"2025","journal-title":"BMJ Open Sport & Exercise Medicine"},{"issue":"1","key":"2026101511472923500_ref26","doi-asserted-by":"publisher","first-page":"187","DOI":"10.2466\/pms.1995.80.1.187","article-title":"Trail making test norms for psychiatric patients","volume":"80","author":"Hays","year":"1995","journal-title":"Perceptual and Motor Skills"},{"issue":"8","key":"2026101511472923500_ref27","doi-asserted-by":"publisher","first-page":"1267","DOI":"10.1080\/13854046.2010.526785","article-title":"Official position of the american academy of clinical neuropsychology on serial neuropsychological assessments: The utility and challenges of repeat test administrations in clinical and forensic contexts","volume":"24","author":"Heilbronner","year":"2010","journal-title":"The Clinical Neuropsychologist"},{"issue":"3","key":"2026101511472923500_ref28","doi-asserted-by":"publisher","first-page":"244","DOI":"10.1093\/arclin\/acq008","article-title":"Deriving reliable change statistics from test\u2013retest normative data: Comparison of models and mathematical expressions","volume":"25","author":"Hinton-Bayre","year":"2010","journal-title":"Archives of Clinical Neuropsychology"},{"key":"2026101511472923500_ref29","volume-title":"Multilevel analysis: techniques and applications","author":"Hox","year":"2018","edition":"3"},{"issue":"2","key":"2026101511472923500_ref30","doi-asserted-by":"publisher","first-page":"263","DOI":"10.3109\/02699052.2014.965214","article-title":"Advanced topics in neuropsychological assessment following sport-related concussion","volume":"29","author":"Iverson","year":"2015","journal-title":"Brain Injury"},{"issue":"1","key":"2026101511472923500_ref31","doi-asserted-by":"publisher","first-page":"162","DOI":"10.1186\/s12874-017-0442-1","article-title":"When and how should multiple imputation be used for handling missing data in randomised clinical trials - a practical guide with flowcharts","volume":"17","author":"Jakobsen","year":"2017","journal-title":"BMC Medical Research Methodology"},{"issue":"12","key":"2026101511472923500_ref32","doi-asserted-by":"publisher","first-page":"676","DOI":"10.1016\/j.jsams.2023.09.013","article-title":"Effects of sociodemographic and player characteristics on baseline cognitive performance in 1000 rugby players: A retrospective 8-year follow-up study","volume":"26","author":"Julien","year":"2023","journal-title":"Journal of Science and Medicine in Sport"},{"issue":"3","key":"2026101511472923500_ref33","first-page":"230","article-title":"Derived Trail making test indices: A preliminary report","volume":"7","author":"Lamberty","year":"1994","journal-title":"Neuropsychiatry Neuropsychology and Behavioral Neurology"},{"issue":"3","key":"2026101511472923500_ref34","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1080\/1385404049052420","article-title":"Normative data for determining significance of test\u2013retest differences on eight common neuropsychological instruments","volume":"18","author":"Levine","year":"2004","journal-title":"The Clinical Neuropsychologist"},{"key":"2026101511472923500_ref35","volume-title":"Neuropsychological assessment","author":"Lezak","year":"2012","edition":"5"},{"issue":"4","key":"2026101511472923500_ref36","doi-asserted-by":"publisher","first-page":"725","DOI":"10.1080\/1612197X.2022.2084764","article-title":"Trained athletes and cognitive function: A systematic review and meta-analysis","volume":"21","author":"Logan","year":"2022","journal-title":"International Journal of Sport and Exercise Psychology"},{"issue":"7","key":"2026101511472923500_ref37","doi-asserted-by":"publisher","first-page":"725","DOI":"10.1080\/20445911.2019.1669609","article-title":"A meta-analysis of executive functioning in dyslexia with consideration of the impact of comorbid ADHD","volume":"31","author":"Lonergan","year":"2019","journal-title":"Journal of Cognitive Psychology"},{"issue":"1","key":"2026101511472923500_ref38","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1017\/S1355617705050083","article-title":"Standard regression-based methods for measuring recovery after sport-related concussion","volume":"11","author":"McCrea","year":"2005","journal-title":"Journal of the International Neuropsychological Society"},{"issue":"2","key":"2026101511472923500_ref39","doi-asserted-by":"publisher","first-page":"168","DOI":"10.1093\/arclin\/acw090","article-title":"Normative data for a comprehensive neuropsychological test battery used in the assessment of sports-related concussion","volume":"32","author":"Merritt","year":"2017","journal-title":"Archives of Clinical Neuropsychology"},{"issue":"3_suppl","key":"2026101511472923500_ref40","doi-asserted-by":"publisher","first-page":"1355","DOI":"10.2466\/pms.1997.84.3c.1355","article-title":"Trail making test in assessing children with reading disabilities: A test of executive functions or content information","volume":"84","author":"N\u00e4rhi","year":"1997","journal-title":"Perceptual and Motor Skills"},{"issue":"1","key":"2026101511472923500_ref41","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1177\/03635465241296868","article-title":"Quantifying the diagnostic utility of baseline testing in concussion management: An analysis of collegiate athletes from the NCAA-DoD CARE consortium dataset","volume":"53","author":"Pandey","year":"2025","journal-title":"The American Journal of Sports Medicine"},{"issue":"11","key":"2026101511472923500_ref42","doi-asserted-by":"publisher","first-page":"695","DOI":"10.1136\/bjsports-2023-106898","article-title":"Consensus statement on concussion in sport: The 6th international conference on concussion in sport-Amsterdam, October 2022","volume":"57","author":"Patricios","year":"2023","journal-title":"British Journal of Sports Medicine"},{"issue":"3","key":"2026101511472923500_ref43","doi-asserted-by":"publisher","first-page":"271","DOI":"10.2466\/pms.1958.8.3.271","article-title":"Validity of the trail making test as an indicator of organic brain damage","volume":"8","author":"Reitan","year":"1958","journal-title":"Perceptual and Motor Skills"},{"key":"2026101511472923500_ref44","doi-asserted-by":"publisher","first-page":"S83","DOI":"10.1016\/S0140-6736(17)30479-8","article-title":"Executive function testing to assist identification of pitch-side concussion in elite rugby players","volume":"389","author":"Richardson","year":"2017","journal-title":"The Lancet"},{"key":"2026101511472923500_ref45","volume-title":"Multilevel analysis: An introduction to basic and advanced multilevel modeling","author":"Snijders","year":"2012"},{"key":"2026101511472923500_ref46","volume-title":"A compendium of neuropsychological tests: Administration, norms, and commentary","author":"Spreen"},{"issue":"1","key":"2026101511472923500_ref47","doi-asserted-by":"publisher","first-page":"311","DOI":"10.2466\/pms.1984.58.1.311","article-title":"Age and educational differences on the trail making test and Wechsler memory scales","volume":"58","author":"Stanton","year":"1984","journal-title":"Perceptual and Motor Skills"},{"issue":"10","key":"2026101511472923500_ref48","doi-asserted-by":"publisher","first-page":"2674","DOI":"10.1016\/j.cortex.2013.06.007","article-title":"Developmental dyscalculia is related to visuo-spatial memory and inhibition impairment","volume":"49","author":"Szucs","year":"2013","journal-title":"Cortex"},{"issue":"2","key":"2026101511472923500_ref49","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1016\/S0887-6177(03)00039-8","article-title":"Trail making test A and B: normative data stratified by age and education","volume":"19","author":"Tombaugh","year":"2004","journal-title":"Archives of Clinical Neuropsychology"},{"issue":"4","key":"2026101511472923500_ref50","doi-asserted-by":"publisher","first-page":"314","DOI":"10.1093\/arclin\/acr024","article-title":"Reliability of three alternate forms of the trail making tests A and B","volume":"26","author":"Wagner","year":"2011","journal-title":"Archives of Clinical Neuropsychology"},{"issue":"3","key":"2026101511472923500_ref51","doi-asserted-by":"publisher","first-page":"160","DOI":"10.1179\/2042618612Y.0000000001","article-title":"Clinimetrics corner: A closer look at the minimal clinically important difference (MCID)","volume":"20","author":"Wright","year":"2012","journal-title":"The Journal of Manual & Manipulative Therapy"}],"container-title":["Archives of Clinical Neuropsychology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/acn\/article-pdf\/41\/7\/acag082\/71972764\/acag082.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/acn\/article-pdf\/41\/7\/acag082\/71972764\/acag082.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,15]],"date-time":"2026-10-15T15:47:36Z","timestamp":1792079256000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/acn\/article\/doi\/10.1093\/arclin\/acag082\/8918431"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,9]]},"references-count":51,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2026,9,9]]}},"URL":"https:\/\/doi.org\/10.1093\/arclin\/acag082","relation":{},"ISSN":["1873-5843"],"issn-type":[{"value":"1873-5843","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,10]]},"published":{"date-parts":[[2026,9,9]]},"article-number":"acag082"}}