{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T20:42:47Z","timestamp":1777927367013,"version":"3.51.4"},"reference-count":50,"publisher":"SAGE Publications","issue":"15-16","license":[{"start":{"date-parts":[[2023,8,1]],"date-time":"2023-08-01T00:00:00Z","timestamp":1690848000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2023,8,1]],"date-time":"2023-08-01T00:00:00Z","timestamp":1690848000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Neurotrauma"],"published-print":{"date-parts":[[2023,8]]},"abstract":"<jats:p>\n                    Repetitive mild traumatic brain injury (rmTBI) is a potentially debilitating condition with long-term sequelae. Animal models are used to study rmTBI in a controlled environment, but there is currently no established standard battery of behavioral tests used. Primarily, we aimed to identify the best combination and timing of behavioral tests to distinguish injured from uninjured animals in rmTBI studies, and secondarily, to determine whether combinations of independent experiments have better behavioral outcome prediction accuracy than individual experiments. Data from 1203 mice from 58 rmTBI experiments, some of which have already been published, were used. In total, 11 types of behavioral tests were measured by 37 parameters at 13 time points during the first 6 months after injury. Univariate regression analyses were used to identify optimal combinations of behavioral tests and whether the inclusion of multiple heterogenous experiments improved accuracy.\n                    <jats:italic toggle=\"yes\">k<\/jats:italic>\n                    -means clustering was used to determine whether a combination of multiple tests could distinguish mice with rmTBI from uninjured mice. We found that a combination of behavioral tests outperformed individual tests alone when distinguishing animals with rmTBI from uninjured animals. The best timing for most individual behavioral tests was 3\u20134 months after first injury. Overall, Morris water maze (MWM; hidden and probe frequency) was the behavioral test with the best capability of detecting injury effects (area under the curve [AUC]\u2009=\u20090.98). Combinations of open field tests and elevated plus mazes also performed well (AUC\u2009=\u20090.92), as did the forced swim test alone (AUC\u2009=\u20090.90). In summary, multiple heterogeneous experiments tended to predict outcome better than individual experiments, and MWM 3\u20134 months after injury was the optimal test, also several combinations also performed well. In order to design future pre-clinical rmTBI trials, we have included an interactive application available online utilizing the data from the study via the Supplementary URL.\n                  <\/jats:p>","DOI":"10.1089\/neu.2022.0486","type":"journal-article","created":{"date-parts":[[2023,2,4]],"date-time":"2023-02-04T06:07:21Z","timestamp":1675490841000},"page":"1762-1778","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":4,"title":["Optimizing Choice and Timing of Behavioral Outcome Tests After Repetitive Mild Traumatic Brain Injury: A Machine Learning-Based Approach on Multiple Pre-Clinical Experiments"],"prefix":"10.1177","volume":"40","author":[{"given":"Philipp","family":"Lassar\u00e9n","sequence":"first","affiliation":[{"name":"Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Grace","family":"Conley","sequence":"additional","affiliation":[{"name":"Division of Emergency Medicine, Boston Children's Hospital, Boston, Massachusetts, USA."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Masen L.","family":"Boucher","sequence":"additional","affiliation":[{"name":"Division of Emergency Medicine, Boston Children's Hospital, Boston, Massachusetts, USA."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ashley N.","family":"Conley","sequence":"additional","affiliation":[{"name":"School of Medicine, Boston University, Boston, Massachusetts, USA."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicholas J.","family":"Morriss","sequence":"additional","affiliation":[{"name":"Division of Emergency Medicine, Boston Children's Hospital, Boston, Massachusetts, USA."},{"name":"Duke University School of Medicine, Duke University Medical Center, Durham, North Carolina, USA."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianhua","family":"Qiu","sequence":"additional","affiliation":[{"name":"Division of Emergency Medicine, Boston Children's Hospital, Boston, Massachusetts, USA."},{"name":"Harvard Medical School, Boston, Massachusetts, USA."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rebekah C.","family":"Mannix","sequence":"additional","affiliation":[{"name":"Division of Emergency Medicine, Boston Children's Hospital, Boston, Massachusetts, USA."},{"name":"Harvard Medical School, Boston, Massachusetts, USA."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eric Peter","family":"Thelin","sequence":"additional","affiliation":[{"name":"Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden."},{"name":"Department of Neurology, Karolinska University Hospital, Stockholm, Sweden."}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2023,8,16]]},"reference":[{"key":"e_1_3_6_2_2","doi-asserted-by":"publisher","DOI":"10.1038\/nrdp.2016.84"},{"key":"e_1_3_6_3_2","doi-asserted-by":"publisher","DOI":"10.1177\/0963689717714092"},{"key":"e_1_3_6_4_2","doi-asserted-by":"publisher","DOI":"10.1016\/S1474-4422(17)30279-X"},{"key":"e_1_3_6_5_2","doi-asserted-by":"publisher","DOI":"10.1089\/neu.2018.6149"},{"key":"e_1_3_6_6_2","doi-asserted-by":"publisher","DOI":"10.1186\/1747-5341-4-2"},{"key":"e_1_3_6_7_2","doi-asserted-by":"publisher","DOI":"10.1093\/ilar\/ilu037"},{"key":"e_1_3_6_8_2","doi-asserted-by":"publisher","DOI":"10.1089\/neu.2015.4113"},{"key":"e_1_3_6_9_2","doi-asserted-by":"publisher","DOI":"10.1089\/neu.2012.2511"},{"key":"e_1_3_6_10_2","doi-asserted-by":"crossref","unstructured":"James G Witten D Hastie T et al. An Introduction to Statistical Learning with Applications in R. Springer: New York NY; 2013.","DOI":"10.1007\/978-1-4614-7138-7"},{"key":"e_1_3_6_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroscience.2019.10.016"},{"key":"e_1_3_6_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.bbr.2017.04.017"},{"key":"e_1_3_6_13_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature14658"},{"key":"e_1_3_6_14_2","doi-asserted-by":"publisher","DOI":"10.1002\/ana.23858"},{"key":"e_1_3_6_15_2","doi-asserted-by":"publisher","DOI":"10.1227\/NEU.0b013e318265a439"},{"key":"e_1_3_6_16_2","doi-asserted-by":"publisher","DOI":"10.1089\/neu.2016.4823"},{"key":"e_1_3_6_17_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-017-01068-4"},{"key":"e_1_3_6_18_2","doi-asserted-by":"publisher","DOI":"10.1089\/neu.2016.4457"},{"key":"e_1_3_6_19_2","doi-asserted-by":"publisher","DOI":"10.3171\/2014.7.JNS14272"},{"key":"e_1_3_6_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4522(92)90313-q"},{"key":"e_1_3_6_21_2","doi-asserted-by":"publisher","DOI":"10.1111\/joim.12909"},{"key":"e_1_3_6_22_2","doi-asserted-by":"publisher","DOI":"10.1016\/0014-4886(68)90144-1"},{"key":"e_1_3_6_23_2","doi-asserted-by":"publisher","DOI":"10.1038\/srep13281"},{"key":"e_1_3_6_24_2","unstructured":"R Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing: Vienna Austria; 2020."},{"key":"e_1_3_6_25_2","unstructured":"Husson F Josse J Le S et al. FactoMineR: Multivariate Exploratory Data Analysis and Data Mining. 2020."},{"key":"e_1_3_6_26_2","unstructured":"Kolde R. pheatmap: Pretty Heatmaps. The Comprehensive R Archive Network: Vienna Austria; 2018."},{"key":"e_1_3_6_27_2","unstructured":"Chang W Cheng J Allaire JJ et al. shiny: Web Application Framework for R. The Comprehensive R Archive Network: Vienna Austria; 2021."},{"key":"e_1_3_6_28_2","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v028.i05"},{"key":"e_1_3_6_29_2","doi-asserted-by":"publisher","DOI":"10.1016\/0165-0270(84)90007-4"},{"key":"e_1_3_6_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/0166-4328(88)90157-x"},{"key":"e_1_3_6_31_2","doi-asserted-by":"crossref","unstructured":"Kraeuter A-K Guest PC Sarnyai Z. The Y-Maze for Assessment of Spatial Working and Reference Memory in Mice. In: Pre-Clinical Models: Techniques and Protocols. (Guest PC. ed.) Springer New York: New York; 2019; pp. 105\u2013111.","DOI":"10.1007\/978-1-4939-8994-2_10"},{"key":"e_1_3_6_32_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF00504983"},{"key":"e_1_3_6_33_2","doi-asserted-by":"crossref","unstructured":"Kraeuter A-K Guest PC Sarnyai Z. The Open Field Test for Measuring Locomotor Activity and Anxiety-Like Behavior. In: Pre-Clinical Models: Techniques and Protocols. (Guest PC. ed.) Springer New York: New York; 2019; pp. 99\u2013103.","DOI":"10.1007\/978-1-4939-8994-2_9"},{"key":"e_1_3_6_34_2","doi-asserted-by":"publisher","DOI":"10.1038\/266730a0"},{"key":"e_1_3_6_35_2","doi-asserted-by":"publisher","DOI":"10.1016\/0091-3057(80)90067-2"},{"key":"e_1_3_6_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF00428203"},{"key":"e_1_3_6_37_2","doi-asserted-by":"publisher","DOI":"10.1016\/0091-3057(82)90053-3"},{"key":"e_1_3_6_38_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF00537801"},{"key":"e_1_3_6_39_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF01908075"},{"key":"e_1_3_6_40_2","unstructured":"R Core Team and contributors worldwide. stats: The R Stats Package. The Comprehensive R Archive Network: Vienna Austria; 2020."},{"issue":"1","key":"e_1_3_6_41_2","first-page":"100","article-title":"A K-means clustering algorithm","volume":"28","author":"Hartigan JA","year":"1979","unstructured":"Hartigan JA, , Wong MA. A K-means clustering algorithm. J Royal Stat Soc C Appl Stat, 1979; 28(1):100\u2013108; doi:https:\/\/doi.org\/10.2307\/2346830","journal-title":"J Royal Stat Soc C Appl Stat"},{"key":"e_1_3_6_42_2","doi-asserted-by":"publisher","DOI":"10.5694\/j.1326-5377.1960.tb73127.x"},{"key":"e_1_3_6_43_2","doi-asserted-by":"publisher","DOI":"10.1089\/neu.2018.6261"},{"key":"e_1_3_6_44_2","doi-asserted-by":"publisher","DOI":"10.1038\/jcbfm.2014.75"},{"key":"e_1_3_6_45_2","doi-asserted-by":"publisher","DOI":"10.1111\/ejn.13192"},{"key":"e_1_3_6_46_2","doi-asserted-by":"publisher","DOI":"10.1038\/nrn2652"},{"issue":"2","key":"e_1_3_6_47_2","first-page":"A143","article-title":"A low-cost Morris Water Maze for undergraduate research: construction and demonstration in a rat model of obesity-induced diabetes","volume":"16","author":"Gallivan LM","year":"2018","unstructured":"Gallivan LM, , Schmitzer-Torbert N. A low-cost Morris Water Maze for undergraduate research: construction and demonstration in a rat model of obesity-induced diabetes. J Undergrad Neurosci Educ, 2018; 16(2):A143\u2013A151","journal-title":"J Undergrad Neurosci Educ"},{"key":"e_1_3_6_48_2","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-019-02133-2"},{"key":"e_1_3_6_49_2","doi-asserted-by":"publisher","DOI":"10.2176\/9\/bioprotoc.2744"},{"key":"e_1_3_6_50_2","doi-asserted-by":"publisher","DOI":"10.1177\/1179069519844020"},{"key":"e_1_3_6_51_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.nicl.2017.11.020"}],"container-title":["Journal of Neurotrauma"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1089\/neu.2022.0486","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1089\/neu.2022.0486","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1089\/neu.2022.0486","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T22:42:13Z","timestamp":1777675333000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1089\/neu.2022.0486"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8]]},"references-count":50,"journal-issue":{"issue":"15-16","published-print":{"date-parts":[[2023,8]]}},"alternative-id":["10.1089\/neu.2022.0486"],"URL":"https:\/\/doi.org\/10.1089\/neu.2022.0486","relation":{},"ISSN":["0897-7151","1557-9042"],"issn-type":[{"value":"0897-7151","type":"print"},{"value":"1557-9042","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8]]}}}