{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,9]],"date-time":"2026-08-09T19:08:32Z","timestamp":1786302512687,"version":"build-2736575974"},"reference-count":27,"publisher":"SAGE Publications","issue":"12","license":[{"start":{"date-parts":[[2020,5,27]],"date-time":"2020-05-27T00:00:00Z","timestamp":1590537600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Neurotrauma"],"published-print":{"date-parts":[[2020,6]]},"abstract":"<jats:p>The purpose of this study was to determine the interobserver variability among providers of different specialties and levels of experience across five established computed tomography (CT) scoring systems for acute traumatic brain injury (TBI). One hundred cases were selected at random from a retrospective population of adult patients transported to our emergency department and subjected to a non-contrast head CT due to suspicion of TBI. Eight neuroradiologists and neurosurgeons in trainee (residents and fellows) and attending roles independently scored each non-contrast head CT scan on the Marshall, Rotterdam, Helsinki, Stockholm, and NeuroImaging Radiological Interpretation System (NIRIS) head CT scales. Interobserver variability of scale scores\u2014overall and by specialty and level of training\u2014was quantified using the intraclass correlation coefficient (ICC), and agreement with respect to National Institutes of Health Common Data Elements (NIH CDEs) was assessed using Cohen's kappa. All CT severity scoring systems showed high interobserver agreement as evidenced by high ICCs, ranging from 0.75\u20130.89. For all scoring systems, neuroradiologists (ICC range from 0.81\u20130.94) tended to have higher interobserver agreement than neurosurgeons (ICC range from 0.63\u20130.76). For all scoring systems, attendings (ICC range from 0.76\u20130.89) had similar interobserver agreement to trainees (ICC range from 0.73\u20130.89). Agreement with respect to NIH CDEs was high for ascertaining presence\/absence of hemorrhage, skull fracture, and mass effect, with estimated kappa statistics of least 0.89. Acute TBI CT scoring systems demonstrate high interobserver agreement. These results provide scientific rigor for future use of these systems for the classification of acute TBI.<\/jats:p>","DOI":"10.1089\/neu.2019.6871","type":"journal-article","created":{"date-parts":[[2020,1,30]],"date-time":"2020-01-30T01:03:28Z","timestamp":1580346208000},"page":"1445-1451","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":13,"title":["Interobserver Agreement for the Computed Tomography Severity Grading Scales for Acute Traumatic Brain Injury"],"prefix":"10.1177","volume":"37","author":[{"given":"Sean","family":"Creeden","sequence":"first","affiliation":[{"name":"Department of Radiology, Stanford University, Stanford, California, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Victoria Y.","family":"Ding","sequence":"additional","affiliation":[{"name":"Department of Medicine, Stanford University, Stanford, California, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonathon J.","family":"Parker","sequence":"additional","affiliation":[{"name":"Department of Neurosurgery, Stanford University, Stanford, California, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bin","family":"Jiang","sequence":"additional","affiliation":[{"name":"Department of Radiology, Stanford University, Stanford, California, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ying","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Radiology, Stanford University, Stanford, California, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bryan","family":"Lanzman","sequence":"additional","affiliation":[{"name":"Department of Radiology, Stanford University, Stanford, California, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Austin","family":"Trinh","sequence":"additional","affiliation":[{"name":"Department of Radiology, Stanford University, Stanford, California, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Khalaf","sequence":"additional","affiliation":[{"name":"Department of Radiology, Stanford University, Stanford, California, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dylan","family":"Wolman","sequence":"additional","affiliation":[{"name":"Department of Radiology, Stanford University, Stanford, California, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Casey H.","family":"Halpern","sequence":"additional","affiliation":[{"name":"Department of Neurosurgery, Stanford University, Stanford, California, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Derek","family":"Boothroyd","sequence":"additional","affiliation":[{"name":"Department of Medicine, Stanford University, Stanford, California, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Max","family":"Wintermark","sequence":"additional","affiliation":[{"name":"Department of Radiology, Stanford University, Stanford, California, USA."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2020,5,27]]},"reference":[{"key":"e_1_3_4_2_2","unstructured":"Centers for Disease Control and Prevention National Center for Injury Prevention and Control. Traumatic brain injury in the United States. www.cdc.gov\/traumaticbraininjury. Last accessed February9 2020."},{"key":"e_1_3_4_3_2","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2014.3979"},{"key":"e_1_3_4_4_2","doi-asserted-by":"publisher","DOI":"10.1080\/02699052.2016.1217351"},{"key":"e_1_3_4_5_2","first-page":"print","article-title":"Improving understanding and outcomes of traumatic brain injury using bidirectional translational research","author":"Armstead W.M.","year":"2019","unstructured":"Armstead W.M., and Vavilala M.S. (2019). Improving understanding and outcomes of traumatic brain injury using bidirectional translational research. J. Neurotrauma 2019 Jun 13; Epub ahead of. print.","journal-title":"J. Neurotrauma 2019 Jun 13; Epub ahead of"},{"key":"e_1_3_4_6_2","doi-asserted-by":"publisher","DOI":"10.1089\/neu.2009.1115"},{"key":"e_1_3_4_7_2","doi-asserted-by":"publisher","DOI":"10.1089\/neu.2008.0586"},{"key":"e_1_3_4_8_2","doi-asserted-by":"publisher","DOI":"10.1089\/neu.2017.5311"},{"key":"e_1_3_4_9_2","doi-asserted-by":"publisher","DOI":"10.3171\/sup.1991.75.1s.0s14"},{"key":"e_1_3_4_10_2","doi-asserted-by":"publisher","DOI":"10.1227\/01.NEU.0000186013.63046.6B"},{"key":"e_1_3_4_11_2","first-page":"632","article-title":"Predicting outcome in traumatic brain injury: development of a novel computerized tomography classification system (Helsinki computerized tomography score)","volume":"75","author":"Raj R.","year":"2014","unstructured":"Raj R., , Siironen J., , Skrifvars M.B., , Hernesniemi J., , and Kivisaari R. (2014). Predicting outcome in traumatic brain injury: development of a novel computerized tomography classification system (Helsinki computerized tomography score). J Neurotrauma, 75, 632\u2013646.","journal-title":"J Neurotrauma"},{"key":"e_1_3_4_12_2","doi-asserted-by":"publisher","DOI":"10.1089\/neu.2009.0986"},{"key":"e_1_3_4_13_2","doi-asserted-by":"publisher","DOI":"10.1002\/jmri.22259"},{"key":"e_1_3_4_14_2","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.86.2.420"},{"key":"e_1_3_4_15_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcm.2016.02.012"},{"key":"e_1_3_4_16_2","doi-asserted-by":"publisher","DOI":"10.1177\/001316446002000104"},{"key":"e_1_3_4_17_2","doi-asserted-by":"publisher","DOI":"10.2307\/2529310"},{"key":"e_1_3_4_18_2","article-title":"R: A language and environment for statistical computing","author":"R Core Team","year":"2019","unstructured":"R Core Team. (2019). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. www.R-project.org. Last accessed February9, 2020.","journal-title":"R Foundation for Statistical Computing"},{"key":"e_1_3_4_19_2","doi-asserted-by":"publisher","DOI":"10.1089\/neu.2018.6061"},{"key":"e_1_3_4_20_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.1002368"},{"key":"e_1_3_4_21_2","doi-asserted-by":"publisher","DOI":"10.1259\/bjr\/16360063"},{"key":"e_1_3_4_22_2","doi-asserted-by":"publisher","DOI":"10.1067\/j.cpradiol.2016.11.005"},{"key":"e_1_3_4_23_2","doi-asserted-by":"publisher","DOI":"10.1007\/s13244-018-0596-3"},{"key":"e_1_3_4_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jacr.2009.09.015"},{"key":"e_1_3_4_25_2","doi-asserted-by":"publisher","DOI":"10.2214\/AJR.14.13047"},{"key":"e_1_3_4_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.acra.2016.09.010"},{"key":"e_1_3_4_27_2","doi-asserted-by":"publisher","DOI":"10.1259\/bjr\/21256379"},{"key":"e_1_3_4_28_2","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.2392042127"}],"container-title":["Journal of Neurotrauma"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1089\/neu.2019.6871","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1089\/neu.2019.6871","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1089\/neu.2019.6871","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T22:35:38Z","timestamp":1777674938000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1089\/neu.2019.6871"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,27]]},"references-count":27,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2020,6]]}},"alternative-id":["10.1089\/neu.2019.6871"],"URL":"https:\/\/doi.org\/10.1089\/neu.2019.6871","relation":{},"ISSN":["0897-7151","1557-9042"],"issn-type":[{"value":"0897-7151","type":"print"},{"value":"1557-9042","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,5,27]]}}}