{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T02:12:19Z","timestamp":1787019139835,"version":"build-2736575974"},"reference-count":90,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2019,11,28]],"date-time":"2019-11-28T00:00:00Z","timestamp":1574899200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/100000890","name":"National Multiple Sclerosis Society","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000890","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100008659","name":"European Committee for Treatment and Research in Multiple Sclerosis","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100008659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Mult Scler"],"published-print":{"date-parts":[[2020,1]]},"abstract":"<jats:p>Randomized controlled clinical trials and real-world observational studies provide complementary information but with different validity. Some clinical questions (disease behavior, prognosis, validation of outcome measures, comparative effectiveness, and long-term safety of therapies) are often better addressed using real-world data reflecting larger, more representative populations. Integration of disease history, clinician-reported outcomes, performance tests, and patient-reported outcome measures during patient encounters; imaging and biospecimen analyses; and data from wearable devices increase dataset utility. However, observational studies utilizing these data are susceptible to many potential sources of bias, creating barriers to acceptance by regulatory agencies and the medical community. Therefore, data standardization and validation within datasets, harmonization across datasets, and application of appropriate analysis methods are important considerations. We review approaches to improve the scope, quality, and analyses of real-world data to advance understanding of multiple sclerosis and its treatment, as an example of opportunities to better support patient care and research.<\/jats:p>","DOI":"10.1177\/1352458519892555","type":"journal-article","created":{"date-parts":[[2019,11,28]],"date-time":"2019-11-28T10:39:21Z","timestamp":1574937561000},"page":"23-37","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":68,"title":["Leveraging real-world data to investigate multiple sclerosis disease behavior, prognosis, and treatment"],"prefix":"10.1177","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9245-9772","authenticated-orcid":false,"given":"Jeffrey A","family":"Cohen","sequence":"first","affiliation":[{"name":"Department of Neurology, Mellen Center for Multiple Sclerosis Treatment and Research, Neurological Institute, Cleveland Clinic, Cleveland, OH, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maria","family":"Trojano","sequence":"additional","affiliation":[{"name":"Department of Basic Medical Sciences, Neurosciences and Sense Organs, University of Bari \u201cAldo Moro,\u201d Bari, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ellen M","family":"Mowry","sequence":"additional","affiliation":[{"name":"Department of Neurology, School of Medicine, The Johns Hopkins University, Baltimore, MD, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bernard MJ","family":"Uitdehaag","sequence":"additional","affiliation":[{"name":"Department of Neurology, Amsterdam University Medical Center, Amsterdam, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephen C","family":"Reingold","sequence":"additional","affiliation":[{"name":"Scientific and Clinical Review Associates, LLC, Salisbury, CT, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1855-5595","authenticated-orcid":false,"given":"Ruth Ann","family":"Marrie","sequence":"additional","affiliation":[{"name":"Departments of Internal Medicine (Neurology) and Community Health Sciences, Rady Faculty of Health Sciences, Max Rady College of Medicine, University of Manitoba, Winnipeg, MB, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2019,11,28]]},"reference":[{"key":"bibr1-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1177\/1352458517751049"},{"key":"bibr2-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1212\/WNL.0000000000005347"},{"key":"bibr3-1352458519892555","unstructured":"Centers for Medicare Medicaid Services. Electronic health records, https:\/\/www.cms.gov\/Medicare\/E-Health\/EHealthRecords\/index.html (accessed 22 February 2019)."},{"key":"bibr4-1352458519892555","volume-title":"Clinical trials: A methodologic perspective","author":"Piantadosi S.","year":"2017","edition":"3"},{"key":"bibr5-1352458519892555","volume-title":"Registries for evaluating patient outcomes: A user\u2019s guide","author":"Gliklich R","year":"2014","edition":"3"},{"key":"bibr6-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1002\/sim.4780030413"},{"key":"bibr7-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMp1604635"},{"key":"bibr8-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1038\/nrneurol.2016.188"},{"issue":"2","key":"bibr9-1352458519892555","first-page":"91","volume":"48","author":"Koch-Henriksen N","year":"2001","journal-title":"Dan Med Bull"},{"key":"bibr10-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1016\/j.msard.2018.09.032"},{"key":"bibr11-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1177\/1352458517698250"},{"key":"bibr12-1352458519892555","unstructured":"Posada M, del Otero L, Villaverde A, et al. EpiRare Deliverale D4. Guidelines for data sources and quality for RD registries in Europe, February 2014, https:\/\/ec.europa.eu\/health\/sites\/health\/files\/ehealth\/docs\/ev_20150512_co013_en.pdf (accessed 24 November 2019)."},{"key":"bibr13-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1197\/jamia.M1087"},{"key":"bibr14-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1002\/bjs.9723"},{"key":"bibr15-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2011-000681"},{"key":"bibr16-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1177\/1352458516662728"},{"key":"bibr17-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1177\/1352458517747407"},{"key":"bibr18-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1159\/000493638"},{"key":"bibr19-1352458519892555","doi-asserted-by":"publisher","DOI":"10.14236\/jhi.v25i2.1062"},{"key":"bibr20-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1007\/s12325-019-00958-x"},{"key":"bibr21-1352458519892555","first-page":"e51318","volume":"30","author":"Rudick RA","year":"2014","journal-title":"J Vis Exp"},{"key":"bibr22-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocx078"},{"key":"bibr23-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1016\/S1474-4422(12)70059-5"},{"key":"bibr24-1352458519892555","doi-asserted-by":"publisher","DOI":"10.3389\/fneur.2017.00729"},{"key":"bibr25-1352458519892555","unstructured":"US Food and Drug Administration. Guidance for industry\u2014Patient-reported outcome measures: Use in medical product development to support labeling claims, December 2009, https:\/\/www.fda.gov\/downloads\/drugs\/guidances\/ucm193282.pdf (accessed 6 December 2011)."},{"key":"bibr26-1352458519892555","doi-asserted-by":"publisher","DOI":"10.7224\/1537-2073-1.1.28"},{"key":"bibr27-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1016\/S1470-2045(16)30510-1"},{"key":"bibr28-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1038\/nrneurol.2015.157"},{"key":"bibr29-1352458519892555","doi-asserted-by":"publisher","DOI":"10.3174\/ajnr.A4539"},{"key":"bibr30-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1016\/j.jacr.2016.09.037"},{"key":"bibr31-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1016\/S1474-4422(10)70168-X"},{"key":"bibr32-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1177\/1352458514538110"},{"key":"bibr33-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1212\/WNL.0000000000002774"},{"key":"bibr34-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1038\/s41582-018-0058-z"},{"key":"bibr35-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1212\/CPJ.0000000000000382"},{"key":"bibr36-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1212\/WNL.0000000000005302"},{"key":"bibr37-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1111\/ene.12990"},{"key":"bibr38-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1016\/j.envres.2018.06.003"},{"key":"bibr39-1352458519892555","unstructured":"US Food and Drug Administration. Real world evidence, 2019, https:\/\/www.fda.gov\/scienceresearch\/specialtopics\/realworldevidence\/default.htm (accessed 20 January 2019)."},{"key":"bibr40-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2017.9991"},{"key":"bibr41-1352458519892555","unstructured":"US Food and Drug Administration. Postmarketing studies and clinical trials\u2014Implementation of Section 505(o)(3) of the Federal Food, Drug, and Cosmetic Act, April 2011, https:\/\/www.fda.gov\/downloads\/Drugs\/GuidanceComplianceRegulatoryInformation\/Guidances\/UCM172001.pdf (accessed 20 January 2019)."},{"key":"bibr42-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1016\/j.jacbts.2016.06.003"},{"key":"bibr43-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1001\/jamaoncol.2017.5618"},{"key":"bibr44-1352458519892555","unstructured":"European Medicines Agency. Patient registries workshop, 28 October 2016: Observations and recommendations arising from the workshop, https:\/\/www.ema.europa.eu\/documents\/report\/report-patient-registries-workshop_en.pdf (accessed 20 January 2019)."},{"key":"bibr45-1352458519892555","unstructured":"European Medicines Agency. Report on multiple sclerosis registries\u2014Workshop 7 July 2017. Patient registry initiative, https:\/\/www.ema.europa.eu\/documents\/report\/report-multiple-sclerosis-registries_en.pdf (accessed 20 January 2019)."},{"key":"bibr46-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1002\/sim.5686"},{"key":"bibr47-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1093\/aje\/kwu125"},{"key":"bibr48-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.d5928"},{"key":"bibr49-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1186\/s13643-018-0915-2"},{"key":"bibr50-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.i4919"},{"key":"bibr51-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1016\/j.envint.2018.08.018"},{"key":"bibr52-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2288-3-25"},{"key":"bibr53-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2288-6-9"},{"key":"bibr54-1352458519892555","doi-asserted-by":"publisher","DOI":"10.7326\/0003-4819-155-8-201110180-00009"},{"key":"bibr55-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1016\/j.envint.2016.01.004"},{"key":"bibr56-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1016\/j.envint.2018.11.004"},{"key":"bibr57-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2016.08.003"},{"key":"bibr58-1352458519892555","doi-asserted-by":"publisher","DOI":"10.31887\/DCNS.2011.13.2\/npatsopoulos"},{"key":"bibr59-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2008.12.011"},{"key":"bibr60-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMp1310102"},{"key":"bibr61-1352458519892555","doi-asserted-by":"publisher","DOI":"10.3310\/hta18430"},{"key":"bibr62-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1017\/S0317167100017157"},{"key":"bibr63-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2016.18"},{"key":"bibr64-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0200926"},{"key":"bibr65-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1016\/j.jalz.2017.06.2270"},{"key":"bibr66-1352458519892555","doi-asserted-by":"publisher","DOI":"10.2471\/BLT.09.074393"},{"key":"bibr67-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1177\/1352458517748475"},{"key":"bibr68-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1007\/s10654-009-9412-1"},{"key":"bibr69-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1177\/1352458518783345"},{"key":"bibr70-1352458519892555","unstructured":"Maelstrom. Pediatric MS tool-kit, https:\/\/www.maelstrom-research.org\/mica\/network\/tool-kit#\/ (accessed 20 January 2019)."},{"key":"bibr71-1352458519892555","unstructured":"National Institutes of Neurological Disorders and Stroke. NINDS common data elements: Multiple sclerosis, https:\/\/www.commondataelements.ninds.nih.gov\/MS.aspx#tab=Data_Standards (accessed 22 February 2019)."},{"key":"bibr72-1352458519892555","unstructured":"Multiple Sclerosis Outcome Assessments Consortium and the CFAST Multiple Sclerosis Development Team. Therapeutic area data standards user guide for multiple sclerosis (Version 1.0), 2 May 2014, https:\/\/www.cdisc.org\/standards\/therapeutic-areas\/multiple-sclerosis (accessed 22 February 2019)."},{"key":"bibr73-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1093\/aje\/kwr194"},{"issue":"1","key":"bibr74-1352458519892555","first-page":"103","volume":"46","author":"Fortier I","year":"2017","journal-title":"Int J Epidemiol"},{"key":"bibr75-1352458519892555","unstructured":"Iaffaldano P, Butzkueven H, Hillert J, et al. Big multiple sclerosis data network: Data sharing among five large MS registries (P738), https:\/\/onlinelibrary.ectrims-congress.eu\/ectrims\/2017\/ACTRIMS-ECTRIMS2017\/200393\/pietro.iaffaldano.big.multiple.sclerosis.data.network.data.sharing.among.five.html (accessed 24 November 2019)."},{"issue":"4","key":"bibr76-1352458519892555","first-page":"e134","volume":"6","author":"Suissa S","year":"2012","journal-title":"Open Med"},{"key":"bibr77-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1007\/s11023-018-9467-4"},{"issue":"9","key":"bibr78-1352458519892555","first-page":"71","volume":"6","author":"Ardeshirdavani A","year":"2014","journal-title":"Genome Med"},{"key":"bibr79-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1186\/1742-7622-10-12"},{"key":"bibr80-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1159\/000368959"},{"key":"bibr81-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1186\/s12910-017-0184-y"},{"key":"bibr82-1352458519892555","unstructured":"The European Parliament and the Council of the European Union. REGULATION (EU) 2016\/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95\/46\/EC (General Data Protection Regulation), http:\/\/eurlex.europa.eu\/eli\/reg\/2016\/679\/oj (accessed 20 January 2019)."},{"key":"bibr83-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1007\/s00439-018-1919-7"},{"key":"bibr84-1352458519892555","unstructured":"US Department of Health and Human Services. OCR privacy brief: Summary of the HIPAA Privacy Rule, May 2003, https:\/\/www.hhs.gov\/sites\/default\/files\/privacysummary.pdf (accessed 14 April 2019)."},{"key":"bibr85-1352458519892555","unstructured":"Reynolds A; International Association of Privacy Professionals. GDPR matchup: U.S. state data breach laws, May 2018, https:\/\/iapp.org\/news\/a\/gdpr-match-up-u-s-state-data-breach-laws (accessed 20 January 2019)."},{"key":"bibr86-1352458519892555","unstructured":"US Department of Health and Human Services. HIPAA Breach Notification Rule, 45 CFR \u00a7\u00a7 164.400-414, https:\/\/www.hhs.gov\/hipaa\/for-professionals\/breach-notification\/index.html (accessed 20 January 2019)."},{"key":"bibr87-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1017\/S0317167100017194"},{"key":"bibr88-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1186\/1750-1172-9-81"},{"key":"bibr89-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1126\/scitranslmed.3000296"},{"key":"bibr90-1352458519892555","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.0040297"}],"container-title":["Multiple Sclerosis Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1352458519892555","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/1352458519892555","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1352458519892555","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T04:01:22Z","timestamp":1777694482000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1352458519892555"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,28]]},"references-count":90,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,1]]}},"alternative-id":["10.1177\/1352458519892555"],"URL":"https:\/\/doi.org\/10.1177\/1352458519892555","relation":{},"ISSN":["1352-4585","1477-0970"],"issn-type":[{"value":"1352-4585","type":"print"},{"value":"1477-0970","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,28]]}}}