{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,23]],"date-time":"2026-07-23T18:49:04Z","timestamp":1784832544219,"version":"3.55.0"},"reference-count":53,"publisher":"Wiley","issue":"9","license":[{"start":{"date-parts":[[2018,7,13]],"date-time":"2018-07-13T00:00:00Z","timestamp":1531440000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Pharmacoepidemiology and Drug"],"published-print":{"date-parts":[[2018,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Poor\u2010quality patient drug information has been identified as a major cause of preventable medication errors in the United States. The US Food and Drug Administration (FDA) has the authority to require marketing authorization holders of medicinal products to implement risk evaluation and mitigation strategies (REMS) to ensure that the benefits of a drug or biological product outweigh its risks. Aside from medication guides, no research has been conducted to assess the quality of patient\u2010targeted REMS materials, including whether, and to what extent, patients find these materials understandable and actionable.<\/jats:p><\/jats:sec><jats:sec><jats:title>Purpose<\/jats:title><jats:p>To describe the readability, understandability, and actionability of patient educational materials in currently approved REMS programs, and to highlight opportunities for improving both the quality and effectiveness of these important drug safety tools.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>Seventy\u2010seven REMS programs were identified from the FDA REMS database. We excluded medication guides (MGs) from our analysis because of the fact that there is a mandatory MG template. Based on this, we identified a total of 27 (non\u2010MG) REMS patient materials on the FDA REMS website for analysis purposes. The materials were tested for readability using the Lexile Measure, the Gunning Fog Index, and Flesch Kincaid and then assessed using the Patient Education Materials Assessment Tool for printable materials, for understandability and actionability.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Twenty\u2010three of 77 (30%) REMS programs used educational materials to communicate serious risks to patients, yielding a total of 27 REMS patient materials for analysis. The median readability score for these materials was at a ninth\u2010grade reading level or higher. While most (89%) of these patient education materials met established criteria for being understandable, less than half (49%) were deemed actionable.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>Currently approved REMS patient materials fell short in terms of recommended reading level, and over half did not meet recommended standards for actionability. Developers of these materials should apply plain language principles when design these materials to improve their readability and to assess both understandability and actionability in order to increase the effectiveness when distributed to patients.<\/jats:p><\/jats:sec>","DOI":"10.1002\/pds.4614","type":"journal-article","created":{"date-parts":[[2018,7,13]],"date-time":"2018-07-13T10:44:49Z","timestamp":1531478689000},"page":"969-978","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["What is the quality of drug safety information for patients: <scp>A<\/scp>n analysis of <scp>REMS<\/scp> educational materials"],"prefix":"10.1002","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5855-3650","authenticated-orcid":false,"given":"Hilda W.","family":"Chan","sequence":"first","affiliation":[{"name":"Global Patient Safety and Labeling, Amgen, Inc.  Thousand Oaks CA USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrea M.","family":"Russell","sequence":"additional","affiliation":[{"name":"Global Patient Safety and Labeling, Amgen, Inc.  Thousand Oaks CA USA"},{"name":"Health Literacy and Learning Program, Division of General Internal Medicine, Feinberg School of Medicine Northwestern University  Chicago IL USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Meredith Y.","family":"Smith","sequence":"additional","affiliation":[{"name":"Global Patient Safety and Labeling, Amgen, Inc.  Thousand Oaks CA USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2018,7,13]]},"reference":[{"key":"e_1_2_9_2_1","volume-title":"National Action Plan to Improve Health Literacy","author":"US DHHS","year":"2011"},{"key":"e_1_2_9_3_1","volume-title":"Federal Plain Language Guidelines","author":"PLAIN","year":"2011"},{"key":"e_1_2_9_4_1","volume-title":"Preventing Medication Errors. Institute of Medicine","author":"Aspden P","year":"2006"},{"key":"e_1_2_9_5_1","doi-asserted-by":"publisher","DOI":"10.7326\/0003-4819-145-12-200612190-00144"},{"key":"e_1_2_9_6_1","doi-asserted-by":"publisher","DOI":"10.7326\/0003-4819-155-2-201107190-00005"},{"key":"e_1_2_9_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.sapharm.2012.10.007"},{"key":"e_1_2_9_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pec.2006.06.010"},{"key":"e_1_2_9_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11606-012-2068-7"},{"key":"e_1_2_9_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11606-008-0662-5"},{"key":"e_1_2_9_11_1","doi-asserted-by":"publisher","DOI":"10.1097\/MLR.0b013e3181f38174"},{"key":"e_1_2_9_12_1","doi-asserted-by":"publisher","DOI":"10.3109\/02770903.2011.648297"},{"key":"e_1_2_9_13_1","doi-asserted-by":"publisher","DOI":"10.1177\/0092861512462371"},{"key":"e_1_2_9_14_1","unstructured":"Food and Drug Administration Amendments Act of 2007 (FDAAA) Public Law \u00a7115\u201385 (2007)."},{"key":"e_1_2_9_15_1","volume-title":"Guidance for Industry: Format and Content of Proposed Risk Evaluation and Mitigation Strategies (REMS), REMS Assessments, and Proposed REMS Modifications","author":"US FDA","year":"2012"},{"key":"e_1_2_9_16_1","unstructured":"US FDA.Draft guidance: format and content of a REMS document.Center forBiologicsEvaluation and Research (CBER)2017."},{"key":"e_1_2_9_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11606-007-0109-4"},{"key":"e_1_2_9_18_1","doi-asserted-by":"publisher","DOI":"10.1080\/02770900600709856"},{"key":"e_1_2_9_19_1","doi-asserted-by":"publisher","DOI":"10.1345\/aph.1P477"},{"key":"e_1_2_9_20_1","doi-asserted-by":"publisher","DOI":"10.1001\/archinternmed.2009.454"},{"key":"e_1_2_9_21_1","doi-asserted-by":"publisher","DOI":"10.1002\/pds.3762"},{"key":"e_1_2_9_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/pds.3400"},{"key":"e_1_2_9_23_1","volume-title":"Guidance Medication Guides\u2014Distribution Requirements and Inclusion in Risk Evaluation and Mitigation Strategies (REMS)","author":"US FDA","year":"2011"},{"key":"e_1_2_9_24_1","volume-title":"Background Materials for REMS Standardization and Evaluation Public Meeting: REMS Tools","author":"US FDA","year":"2014"},{"key":"e_1_2_9_25_1","volume-title":"Healthy People 2010: Understanding and Improving Health and Objectives for Improving Health","author":"US DHHS","year":"2000"},{"key":"e_1_2_9_26_1","unstructured":"LennonC BurdickH.The lexile framework as an approach for reading measurement and success. electronic publication on www lexile com.2004."},{"key":"e_1_2_9_27_1","unstructured":"GunningR.The technique of clear Writing1952."},{"key":"e_1_2_9_28_1","doi-asserted-by":"publisher","DOI":"10.21236\/ADA006655"},{"key":"e_1_2_9_29_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1399-0012.2011.01480.x"},{"key":"e_1_2_9_30_1","first-page":"2012","article-title":"Readability, suitability, and characteristics of asthma action plans: examination of factors that may impair understanding","author":"Yin HS","year":"2012","journal-title":"Pediatrics"},{"key":"e_1_2_9_31_1","unstructured":"usingenglish.com.Text content analysis tool.2017;https:\/\/www.usingenglish.com\/resources\/text\u2010statistics.php 2017."},{"key":"e_1_2_9_32_1","volume-title":"Gunning Fog Index","author":"Bond S.","year":"2017"},{"key":"e_1_2_9_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pec.2014.05.027"},{"key":"e_1_2_9_34_1","doi-asserted-by":"publisher","DOI":"10.1177\/001316446002000104"},{"key":"e_1_2_9_35_1","doi-asserted-by":"publisher","DOI":"10.2307\/2529310"},{"key":"e_1_2_9_36_1","doi-asserted-by":"publisher","DOI":"10.12788\/jhm.2688"},{"key":"e_1_2_9_37_1","first-page":"1","article-title":"Are patients comprehending? A critical assessment of online patient educational materials","author":"Bui T\u2010L","year":"2017","journal-title":"Journal of Dermatological Treatment"},{"key":"e_1_2_9_38_1","doi-asserted-by":"publisher","DOI":"10.1080\/13548509608400003"},{"key":"e_1_2_9_39_1","volume-title":"Toolkit for Making Written Material Clear and Effective","year":"2010"},{"key":"e_1_2_9_40_1","volume-title":"Pink Book\u2010Making Health Communication Programs Work","author":"US NIH","year":"2002"},{"key":"e_1_2_9_41_1","volume-title":"Teaching Patients with Low Literacy Levels. Philadelphia, PA: JB","author":"Doak C","year":"1996"},{"key":"e_1_2_9_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pec.2005.05.004"},{"key":"e_1_2_9_43_1","unstructured":"US NIH.How to write easy\u2010to\u2010read health materials. National Library of Medicine Website2013."},{"key":"e_1_2_9_44_1","doi-asserted-by":"publisher","DOI":"10.1001\/journalofethics.2017.19.3.pfor1-1703"},{"key":"e_1_2_9_45_1","volume-title":"Simply Put: A Guide for Creating Easy\u2010to\u2010Understand Materials","author":"CDC","year":"2009"},{"key":"e_1_2_9_46_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15326985EP3801_1"},{"key":"e_1_2_9_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pec.2008.11.005"},{"key":"e_1_2_9_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.sapharm.2017.07.015"},{"key":"e_1_2_9_49_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.327.7417.741"},{"key":"e_1_2_9_50_1","doi-asserted-by":"publisher","DOI":"10.1093\/jnci\/djr318"},{"key":"e_1_2_9_51_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-statistics-010814-020148"},{"key":"e_1_2_9_52_1","volume-title":"Communicating Risks And benefits: An evidence Based User's Guide","author":"Fischhoff B","year":"2012"},{"key":"e_1_2_9_53_1","doi-asserted-by":"publisher","DOI":"10.4103\/1357-6283.210517"},{"key":"e_1_2_9_54_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.sapharm.2016.10.006"}],"container-title":["Pharmacoepidemiology and Drug Safety"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fpds.4614","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/pds.4614","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/pds.4614","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/pds.4614","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,9]],"date-time":"2023-09-09T15:57:17Z","timestamp":1694275037000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/pds.4614"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,7,13]]},"references-count":53,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2018,9]]}},"alternative-id":["10.1002\/pds.4614"],"URL":"https:\/\/doi.org\/10.1002\/pds.4614","archive":["Portico"],"relation":{},"ISSN":["1053-8569","1099-1557"],"issn-type":[{"value":"1053-8569","type":"print"},{"value":"1099-1557","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,7,13]]},"assertion":[{"value":"2017-10-25","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-06-11","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-07-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}