{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,12]],"date-time":"2026-03-12T08:21:50Z","timestamp":1773303710404,"version":"3.50.1"},"reference-count":49,"publisher":"Public Library of Science (PLoS)","issue":"12","license":[{"start":{"date-parts":[[2020,12,14]],"date-time":"2020-12-14T00:00:00Z","timestamp":1607904000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000005","name":"U.S. Department of Defense","doi-asserted-by":"publisher","award":["W81XWH-14-2-0176"],"award-info":[{"award-number":["W81XWH-14-2-0176"]}],"id":[{"id":"10.13039\/100000005","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:sec id=\"sec001\">\n<jats:title>Introduction<\/jats:title>\n<jats:p>The high failure rate of clinical trials in traumatic brain injury (TBI) may be attributable, in part, to the use of untested or insensitive measurement instruments. Of more than 1,000 clinical outcome assessment measures (COAs) for TBI, few have been systematically vetted to determine their performance within specific \u201ccontexts of use (COU).\u201d As described in guidance issued by the U.S. Food and Drug Administration (FDA), the COU specifies the population of interest and the purpose for which the COA will be employed. COAs are commonly used for screening, diagnostic categorization, outcome prediction, and establishing treatment effectiveness. COA selection typically relies on expert consensus; there is no established methodology to match the appropriateness of a particular COA to a specific COU. We developed and pilot-tested the <jats:italic>E<\/jats:italic>vidence-<jats:italic>B<\/jats:italic>ased <jats:italic>C<\/jats:italic>linical <jats:italic>O<\/jats:italic>utcome assessment <jats:italic>P<\/jats:italic>latform (EB-COP) to systematically and transparently evaluate the suitability of TBI COAs for specific purposes.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"sec002\">\n<jats:title>Methods and findings<\/jats:title>\n<jats:p>Following a review of existing literature and published guidelines on psychometric standards for COAs, we developed a 6-step, semi-automated, evidence-based assessment platform to grade COA performance for six specific purposes: diagnosis, symptom detection, prognosis, natural history, subgroup stratification and treatment effectiveness. Mandatory quality indicators (QIs) were identified for each purpose using a modified Delphi consensus-building process. The EB-COP framework was incorporated into a Qualtrics software platform and pilot-tested on the Glasgow Outcome Scale\u2014Extended (GOSE), the most widely-used COA in TBI clinical studies.<\/jats:p>\n<\/jats:sec>\n<jats:sec id=\"sec003\">\n<jats:title>Conclusion<\/jats:title>\n<jats:p>The EB-COP provides a systematic methodology for conducting more precise, evidence-based assessment of COAs by evaluating performance within specific COUs. The EB-COP platform was shown to be feasible when applied to a TBI COA frequently used to detect treatment effects and can be modified to address other populations and COUs. Additional testing and validation of the EB-COP are warranted.<\/jats:p>\n<\/jats:sec>","DOI":"10.1371\/journal.pone.0242811","type":"journal-article","created":{"date-parts":[[2020,12,14]],"date-time":"2020-12-14T18:38:00Z","timestamp":1607971080000},"page":"e0242811","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":6,"title":["An evidence-based methodology for systematic evaluation of clinical outcome assessment measures for traumatic brain injury"],"prefix":"10.1371","volume":"15","author":[{"given":"Andrea N.","family":"Christoforou","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2163-1907","authenticated-orcid":true,"given":"Melissa J.","family":"Armstrong","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael J. G.","family":"Bergin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ann","family":"Robbins","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shannon A.","family":"Merillat","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Patricia","family":"Erwin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7295-1970","authenticated-orcid":true,"given":"Thomas S. D.","family":"Getchius","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"McCrea","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Amy J.","family":"Markowitz","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Geoffrey T.","family":"Manley","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7916-9698","authenticated-orcid":true,"given":"Joseph T.","family":"Giacino","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2020,12,14]]},"reference":[{"key":"pone.0242811.ref001","doi-asserted-by":"crossref","first-page":"1062","DOI":"10.1001\/jamaneurol.2016.1948","article-title":"Association of Traumatic Brain Injury With Late-Life Neurodegenerative Conditions and Neuropathologic Findings","volume":"73","author":"PK Crane","year":"2016","journal-title":"JAMA Neurol"},{"key":"pone.0242811.ref002","doi-asserted-by":"crossref","first-page":"987","DOI":"10.1016\/S1474-4422(17)30371-X","article-title":"Traumatic brain injury: integrated approaches to improve prevention, clinical care, and research","volume":"16","author":"AIR Maas","year":"2017","journal-title":"Lancet Neurol"},{"key":"pone.0242811.ref003","doi-asserted-by":"crossref","first-page":"1461","DOI":"10.1089\/neu.2015.4233","article-title":"A State-of-the-Science Overview of Randomized Controlled Trials Evaluating Acute Management of Moderate-to-Severe Traumatic Brain Injury","volume":"33","author":"P Bragge","year":"2015","journal-title":"J Neurotrauma"},{"key":"pone.0242811.ref004","doi-asserted-by":"crossref","first-page":"1259","DOI":"10.3109\/02699052.2015.1065344","article-title":"Embracing failure: What the Phase III progesterone studies can teach about TBI clinical trials","volume":"29","author":"DG Stein","year":"2015","journal-title":"Brain Inj"},{"key":"pone.0242811.ref005","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1089\/neu.2010.1599","article-title":"Re-orientation of clinical research in traumatic brain injury: report of an international workshop on comparative effectiveness research","volume":"29","author":"AIR Maas","year":"2012","journal-title":"J Neurotrauma"},{"key":"pone.0242811.ref006","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1038\/nrneurol.2014.261","article-title":"Progress, failures and new approaches for TBI research","volume":"11","author":"DK Menon","year":"2015","journal-title":"Nat Rev Neurol"},{"key":"pone.0242811.ref007","doi-asserted-by":"crossref","DOI":"10.1097\/CCM.0b013e3181921225","article-title":"Unique challenges in clinical trials in traumatic brain injury","volume":"37","author":"DK Menon","year":"2009","journal-title":"Crit Care Med"},{"key":"pone.0242811.ref008","unstructured":"U.S. Food and Drug Administration. Drug Development Tools Qualification Programs\u2014Roadmap to Patient-Focused Outcome Measurement in Clinical Trials (text version). In: http:\/\/www.fda.gov\/Drugs\/DevelopmentApprovalProcess\/DrugDevelopmentToolsQualificationProgram\/ucm370177.htm. 2016."},{"key":"pone.0242811.ref009","unstructured":"U.S. Food and Drug Administration. Wheel and Spokes Diagram: Clinical Outcome Assessments (text version). https:\/\/www.fda.gov\/drugs\/drug-development-tool-ddt-qualification-programs\/wheel-and-spokes-diagram-clinical-outcome-assessments-text-version"},{"key":"pone.0242811.ref010","unstructured":"U.S. Food and Drug Administration. Guidance for Industry Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims. http:\/\/www.fda.gov\/downloads\/Drugs\/Guidances\/UCM193282.pdf"},{"key":"pone.0242811.ref011","unstructured":"U.S. Food and Drug Administration. Pilot Clinical Outcome Assessment (COA) Compendium, Version 1 [online]. 2016. http:\/\/www.fda.gov\/downloads\/Drugs\/DevelopmentApprovalProcess\/DevelopmentResources\/UCM481225.pdf."},{"key":"pone.0242811.ref012","unstructured":"U.S. Food and Drug Administration. Clinical Outcome Assessment Compendium. 2016. http:\/\/www.fda.gov\/Drugs\/DevelopmentApprovalProcess\/DevelopmentResources\/ucm459231.htm"},{"key":"pone.0242811.ref013","unstructured":"U.S. Food and Drug Administration. Qualification of Medical Device Development Tools: Guidance for Industry, Tool Developers, and Food and Drug Administration Staff. 2017 Aug. https:\/\/www.fda.gov\/regulatory-information\/search-fda-guidance-documents\/qualification-medical-device-development-tools"},{"key":"pone.0242811.ref014","doi-asserted-by":"crossref","first-page":"1341","DOI":"10.1016\/0895-4356(92)90194-R","article-title":"Measuring health status: What are the necessary measurement properties?","volume":"45","author":"GH Guyatt","year":"1992","journal-title":"J Clin Epidemiol"},{"key":"pone.0242811.ref015","doi-asserted-by":"crossref","first-page":"573","DOI":"10.1089\/neu.1998.15.573","article-title":"Structured Interviews for the Glasgow Outcome Scale and the Extended Glasgow Outcome Scale: Guidelines for Their Use","volume":"15","author":"JL Wilson","year":"1998","journal-title":"J Neurotrauma"},{"key":"pone.0242811.ref016","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1038\/nrneurol.2016.89","article-title":"The Glasgow Outcome Scale\u201440 years of application and refinement","volume":"12","author":"T McMillan","year":"2016","journal-title":"Nat Rev Neurol"},{"key":"pone.0242811.ref017","doi-asserted-by":"crossref","first-page":"1049","DOI":"10.1001\/jamaneurol.2019.1313","article-title":"Recovery After Mild Traumatic Brain Injury in Patients Presenting to US Level I Trauma Centers: A Transforming Research and Clinical Knowledge in Traumatic Brain Injury (TRACK-TBI) Study","volume":"76","author":"LD Nelson","year":"2019","journal-title":"JAMA Neurol"},{"key":"pone.0242811.ref018","doi-asserted-by":"crossref","first-page":"1650","DOI":"10.1016\/j.apmr.2010.06.033","article-title":"Recommendations for the Use of Common Outcome Measures in Traumatic Brain Injury Research","volume":"91","author":"EA Wilde","year":"2010","journal-title":"Arch Phys Med Rehabil"},{"key":"pone.0242811.ref019","doi-asserted-by":"crossref","first-page":"1852","DOI":"10.1089\/neu.2013.2938","article-title":"Progress in Developing Common Data Elements for Traumatic Brain Injury Research: Version Two\u2014The End of the Beginning","volume":"30","author":"R Hicks","year":"2013","journal-title":"J Neurotrauma"},{"key":"pone.0242811.ref020","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1007\/s11136-018-1798-3","article-title":"COSMIN guideline for systematic reviews of patient-reported outcome measures","volume":"27","author":"CAC Prinsen","year":"2018","journal-title":"Qual Life Res"},{"key":"pone.0242811.ref021","unstructured":"Gronseth GS, Cox J, Gloss D, Merillat S, Dittman J, Armstrong MJ, et al. Clinical Practice Guideline Process Manual, 2017 ed. Minneapolis, MN: The American Academy of Neurology; 2017. https:\/\/www.aan.com\/siteassets\/home-page\/policy-and-guidelines\/guidelines\/about-guidelines\/17guidelineprocman_pg.pdf"},{"key":"pone.0242811.ref022","volume-title":"Finding What Works in Health Care: Standards for Systematic Reviews","author":"Institute of Medicine","year":"2011"},{"key":"pone.0242811.ref023","volume-title":"Clinical Practice Guidelines We Can Trust","author":"Institute of Medicine","year":"2011"},{"key":"pone.0242811.ref024","doi-asserted-by":"crossref","first-page":"e1002148","DOI":"10.1371\/journal.pmed.1002148","article-title":"Core Outcome Set\u2013STAndards for Reporting: The COS-STAR Statement","volume":"13","author":"JJ Kirkham","year":"2016","journal-title":"PLOS Med"},{"key":"pone.0242811.ref025","doi-asserted-by":"crossref","first-page":"e1002447","DOI":"10.1371\/journal.pmed.1002447","article-title":"Core Outcome Set-STAndards for Development: The COS-STAD recommendations","volume":"14","author":"JJ Kirkham","year":"2017","journal-title":"PLOS Med"},{"key":"pone.0242811.ref026","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1007\/s11136-010-9606-8","article-title":"The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study","volume":"19","author":"LB Mokkink","year":"2010","journal-title":"Qual Life Res Int J Qual Life Asp Treat Care Rehabil"},{"key":"pone.0242811.ref027","doi-asserted-by":"crossref","first-page":"529","DOI":"10.7326\/0003-4819-155-8-201110180-00009","article-title":"QUADAS-2: A Revised Tool for the Quality Assessment of Diagnostic Accuracy Studies","volume":"155","author":"PF Whiting","year":"2011","journal-title":"Ann Intern Med"},{"key":"pone.0242811.ref028","doi-asserted-by":"crossref","first-page":"280","DOI":"10.7326\/0003-4819-158-4-201302190-00009","article-title":"Assessing Bias in Studies of Prognostic Factors","volume":"158","author":"JA Hayden","year":"2013","journal-title":"Ann Intern Med"},{"key":"pone.0242811.ref029","doi-asserted-by":"crossref","first-page":"805","DOI":"10.1002\/mds.22989","article-title":"Fatigue rating scales critique and recommendations by the Movement Disorders Society task force on rating scales for Parkinson\u2019s disease","volume":"25","author":"JH Friedman","year":"2010","journal-title":"Mov Disord"},{"key":"pone.0242811.ref030","doi-asserted-by":"crossref","first-page":"661","DOI":"10.2340\/16501977-0844","article-title":"Strategies for assessment and outcome measurement in Physical and Rehabilitation Medicine: An educational review","volume":"43","author":"AA K\u00fc\u00e7\u00fckdeveci","year":"2011","journal-title":"J Rehabil Med"},{"key":"pone.0242811.ref031","doi-asserted-by":"crossref","first-page":"737","DOI":"10.1016\/j.jclinepi.2010.02.006","article-title":"The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes","volume":"63","author":"LB Mokkink","year":"2010","journal-title":"J Clin Epidemiol"},{"key":"pone.0242811.ref032","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3310\/hta2140","article-title":"Evaluating patient-based outcome measures for use in clinical trials: a review","volume":"2","author":"R Fitzpatrick","year":"1998","journal-title":"Health Technol Assess"},{"key":"pone.0242811.ref033","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1016\/S0895-4356(99)00206-1","article-title":"Methods for assessing responsiveness: a critical review and recommendations","volume":"53","author":"JA Husted","year":"2000","journal-title":"J Clin Epidemiol"},{"key":"pone.0242811.ref034","doi-asserted-by":"crossref","first-page":"1795","DOI":"10.1016\/j.apmr.2010.07.218","article-title":"Assessment Scales for Disorders of Consciousness: Evidence-Based Recommendations for Clinical Practice and Research","volume":"91","author":"RT Seel","year":"2010","journal-title":"Arch Phys Med Rehabil"},{"key":"pone.0242811.ref035","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1016\/j.apmr.2013.09.010","article-title":"Development and Use of a Knowledge Translation Tool: The Rehabilitation Measures Database","volume":"95","author":"JL Moore","year":"2014","journal-title":"Arch Phys Med Rehabil"},{"key":"pone.0242811.ref036","doi-asserted-by":"crossref","first-page":"2721","DOI":"10.1089\/neu.2016.4729","article-title":"The Traumatic Brain Injury Endpoints Development (TED) Initiative: Progress on a Public-Private Regulatory Collaboration To Accelerate Diagnosis and Treatment of Traumatic Brain Injury","volume":"34","author":"GT Manley","year":"2017","journal-title":"J Neurotrauma"},{"key":"pone.0242811.ref037","first-page":"1","volume-title":"Evidence-Based Review of Moderate to Severe Acquired Brain Injury","author":"K Salter","year":"2017"},{"key":"pone.0242811.ref038","volume-title":"Rey auditory verbal learning test: A handbook","author":"M Schmidt","year":"1996"},{"key":"pone.0242811.ref039","doi-asserted-by":"crossref","first-page":"1115","DOI":"10.1007\/s11136-009-9528-5","article-title":"Development of a methodological PubMed search filter for finding studies on measurement properties of measurement instruments","volume":"18","author":"CB Terwee","year":"2009","journal-title":"Qual Life Res Int J Qual Life Asp Treat Care Rehabil"},{"key":"pone.0242811.ref040","unstructured":"Mokkink L, Terwee C, Patrick D, Alonso A, Stratford P, Knol D, et al. COSMIN checklist manual. 2012. http:\/\/fac.ksu.edu.sa\/sites\/default\/files\/cosmin_checklist_manual_v9.pdf"},{"key":"pone.0242811.ref041","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.jclinepi.2006.03.012","article-title":"Quality criteria were proposed for measurement properties of health status questionnaires","volume":"60","author":"CB Terwee","year":"2007","journal-title":"J Clin Epidemiol"},{"key":"pone.0242811.ref042","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1136\/jnnp.44.4.285","article-title":"Disability after severe head injury: observations on the use of the Glasgow Outcome Scale","volume":"44","author":"B Jennett","year":"1981","journal-title":"J Neurol Neurosurg Psychiatry"},{"key":"pone.0242811.ref043","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1089\/neu.1998.15.587","article-title":"Analyzing Outcome of Treatment of Severe Head Injury: A Review and Update on Advancing the Use of the Glasgow Outcome Scale","volume":"15","author":"GM Teasdale","year":"1998","journal-title":"J Neurotrauma"},{"key":"pone.0242811.ref044","article-title":"Reliability of Ratings on the Glasgow Outcome Scales from In-person and Telephone Structured Interviews","volume":"18","author":"LEL Pettigrew","year":"2003","journal-title":"J Head Trauma Rehabil"},{"key":"pone.0242811.ref045","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1089\/089771501750291819","article-title":"Validity and Sensitivity to Change of the Extended Glasgow Outcome Scale in Mild to Moderate Traumatic Brain Injury","volume":"18","author":"HS Levin","year":"2001","journal-title":"J Neurotrauma"},{"key":"pone.0242811.ref046","unstructured":"Qualtrics. Qualtrics Survey Software. https:\/\/www.qualtrics.com\/"},{"key":"pone.0242811.ref047","article-title":"Common Data Elements: Critical Assessment of Harmonization between Current Multi-Center Traumatic Brain Injury Studies","author":"S Meeuws","year":"2020","journal-title":"J Neurotrauma"},{"key":"pone.0242811.ref048","doi-asserted-by":"crossref","first-page":"1171","DOI":"10.1007\/s11136-017-1765-4","article-title":"COSMIN Risk of Bias checklist for systematic reviews of Patient-Reported Outcome Measures","volume":"27","author":"LB Mokkink","year":"2018","journal-title":"Qual Life Res"},{"key":"pone.0242811.ref049","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1007\/BF00868811","article-title":"The Rivermead Post Concussion Symptoms Questionnaire: a measure of symptoms commonly experienced after head injury and its reliability","volume":"242","author":"NS King","year":"1995","journal-title":"J Neurol"}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0242811","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,12,14]],"date-time":"2020-12-14T18:38:30Z","timestamp":1607971110000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0242811"}},"subtitle":[],"editor":[{"given":"Andrea","family":"Cortegiani","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2020,12,14]]},"references-count":49,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2020,12,14]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0242811","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12,14]]}}}