{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,11]],"date-time":"2026-08-11T12:38:39Z","timestamp":1786451919250,"version":"build-2736575974"},"reference-count":39,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,5,14]],"date-time":"2026-05-14T00:00:00Z","timestamp":1778716800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,8,11]],"date-time":"2026-08-11T00:00:00Z","timestamp":1786406400000},"content-version":"vor","delay-in-days":89,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Johns Hopkins Physician-Scientist Training Program"},{"DOI":"10.13039\/100005367","name":"American Foundation for Surgery of the Hand","doi-asserted-by":"publisher","award":["3698"],"award-info":[{"award-number":["3698"]}],"id":[{"id":"10.13039\/100005367","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Patient Rep Outcomes"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Patients with low literacy have difficulty completing patient-reported outcomes measures (PROMs). The Multimedia Adaptation Protocol (MAP) guides the process of adapting traditional PROMs to multimedia versions that patients with low literacy can self-administer. We previously executed the first MAP stage, forward adaptation, to adapt the Patient-Reported Outcomes Measurement Information System Upper Extremity (PROMIS-UE) to a multimedia version (multimedia PROMIS-UE). The goal of this study was to refine the multimedia PROMIS-UE via the next MAP stages, back adaptation and qualitative evaluation, to result in a conceptually-equivalent, user-tested multimedia PROMIS-UE ready for psychometric validation.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methodology<\/jats:title>\n                    <jats:p>For back adaptation, mixed-literacy and English-speaking participants masked to the PROMIS-UE \u201ctranslated\u201d multimedia components back to text. We compared text back-adaptations to the original PROMIS-UE, identified areas of non-equivalence, and updated the multimedia PROMIS-UE accordingly. For qualitative evaluation, we used an iterative design process to conduct cycles of testing to assess usability and face validity. We performed analyses including memo writing and framework-guided thematic analysis. Findings were synthesized into usability, functionality, or content-related themes that guided ideation workshops focused on identifying solutions.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We recruited 11 participants for back adaptation. We identified areas of non-equivalence between the PROMIS-UE and multimedia PROMIS-UE for 85% of the questions, which were addressed in an updated multimedia PROMIS-UE. We conducted two cycles of qualitative evaluation. We recruited 20 patients and identified 16 themes\/challenges: animations unused, audio unused, instructions unclear, instructions unused, difficulty starting questionnaire, response audio button misinterpreted, difficulty with incomplete forms, difficulty submitting answers, purpose of avatars unclear, purpose of smiley scale unclear, difficulty differentiating smileys, inaccurate animation, unclear how to select answer, audio button unused or misinterpreted, confusion with scrolling, and incomplete popup window missed. We updated the multimedia PROMIS-UE after each cycle to address each theme.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>\n                      We developed a conceptually-equivalent, user-tested multimedia PROMIS-UE ready to undergo psychometric testing and validation. This work represents an essential intermediary and preparatory phase of PROM development, is analogous to cross-cultural translation phases intentionally positioned prior to psychometric validation, and advances\n                      <jats:italic>how<\/jats:italic>\n                      PROMs can be adapted to a multimedia format. Ultimately, a validated multimedia PROMIS-UE will expand clinicians\u2019 and investigators\u2019 abilities to capture patient-reported outcomes in low literacy populations.\n                    <\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s41687-026-01081-6","type":"journal-article","created":{"date-parts":[[2026,5,14]],"date-time":"2026-05-14T04:45:34Z","timestamp":1778733934000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Refining a multimedia patient-reported outcomes measure for patients with low literacy"],"prefix":"10.1186","volume":"10","author":[{"given":"Chao Long","family":"Azad","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aygul","family":"Iskandarova","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Caroline","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laura","family":"Beres","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Albert W.","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Allan","family":"Fong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aviram","family":"Giladi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,5,14]]},"reference":[{"issue":"11","key":"1081_CR1","doi-asserted-by":"publisher","first-page":"1026","DOI":"10.1097\/MLR.0b013e3180616c1b","volume":"45","author":"AM Arozullah","year":"2007","unstructured":"Arozullah AM, Yarnold PR, Bennett CL, Soltysik RC, Wolf MS, Ferreira RM et al (2007) Development and validation of a short-form, rapid estimate of adult literacy in medicine. Med Care 45(11):1026\u20131033. https:\/\/doi.org\/10.1097\/MLR.0b013e3180616c1b","journal-title":"Med Care"},{"key":"1081_CR2","doi-asserted-by":"publisher","unstructured":"Bass PF 3rd, Wilson JF, Griffith CH (2003) A shortened instrument for literacy screening. J Gen Intern Med 18(12):1036\u20131038. https:\/\/doi.org\/10.1111\/j.1525-1497.2003.10651.x","DOI":"10.1111\/j.1525-1497.2003.10651.x"},{"key":"1081_CR3","doi-asserted-by":"publisher","unstructured":"Yost KJ, Webster K, Baker DW, Jacobs EA, Anderson A, Hahn EA (2010) Acceptability of the talking touchscreen for health literacy assessment. J Health Commun 15 Suppl 2(Suppl 280\u201392. https:\/\/doi.org\/10.1080\/10810730.2010.500713","DOI":"10.1080\/10810730.2010.500713"},{"key":"1081_CR4","volume-title":"Adult Literacy in America: A First Look at the Findings of the National Adult Literacy Survey","author":"IS Kirsch","year":"2002","unstructured":"Kirsch IS, Jungeblut A, Jenkins L, Kolstad A (2002) Adult Literacy in America: A First Look at the Findings of the National Adult Literacy Survey. National Center for Education Statistics, Washington"},{"key":"1081_CR5","unstructured":"Adult Literacy in the United States (2019) National Center for Education Statistics, Washington. https:\/\/nces.ed.gov\/pubs2019\/2019179\/index.asp. Accessed 16 Sep 2020"},{"issue":"3","key":"1081_CR6","first-page":"257","volume":"5","author":"BD Weiss","year":"1992","unstructured":"Weiss BD, Hart G, McGee DL, D\u2019Estelle S (1992) Health status of illiterate adults: relation between literacy and health status among persons with low literacy skills. J Am Board Fam Pract 5(3):257\u2013264","journal-title":"J Am Board Fam Pract"},{"issue":"Suppl 1","key":"1081_CR7","doi-asserted-by":"publisher","first-page":"S8","DOI":"10.5555\/ajhb.2007.31.supp.S8","volume":"31","author":"RE Rudd","year":"2007","unstructured":"Rudd RE (2007) Health literacy skills of U.S. adults. Am J Health Behav 31(Suppl 1):S8\u201318. https:\/\/doi.org\/10.5555\/ajhb.2007.31.supp.S8","journal-title":"Am J Health Behav"},{"issue":"6","key":"1081_CR8","doi-asserted-by":"publisher","first-page":"1711","DOI":"10.1007\/s11136-021-02999-8","volume":"31","author":"C Long","year":"2022","unstructured":"Long C, Beres LK, Wu AW, Giladi AM (2022) Patient-level barriers and facilitators to completion of patient-reported outcomes measures. Qual Life Res 31(6):1711\u20131718. https:\/\/doi.org\/10.1007\/s11136-021-02999-8","journal-title":"Qual Life Res"},{"issue":"10","key":"1081_CR9","doi-asserted-by":"publisher","first-page":"2265","DOI":"10.1093\/jamia\/ocab138","volume":"28","author":"RC Sisodia","year":"2021","unstructured":"Sisodia RC, Rodriguez JA, Sequist TD (2021) Digital disparities: lessons learned from a patient reported outcomes program during the COVID-19 pandemic. J Am Med Inf Assoc 28(10):2265\u20132268. https:\/\/doi.org\/10.1093\/jamia\/ocab138","journal-title":"J Am Med Inf Assoc"},{"issue":"7","key":"1081_CR10","doi-asserted-by":"publisher","first-page":"2113","DOI":"10.1007\/s11136-025-03975-2","volume":"34","author":"E Adjei Boakye","year":"2025","unstructured":"Adjei Boakye E, Nair M, Al-Antary N, Wilson C, Kerr K, Zatirka TM et al (2025) Exploratory analysis of electronic patient-reported outcomes collection: comparing online and in-clinic modalities in cancer care. Qual Life Res 34(7):2113\u20132121. https:\/\/doi.org\/10.1007\/s11136-025-03975-2","journal-title":"Qual Life Res"},{"key":"1081_CR11","volume-title":"Methodological Issues in the Selection, Administration and Use of Patient-Reported Outcomes in Performance Measurement in Health Care Settings","author":"D Cella","year":"2012","unstructured":"Cella D, Hahn EA, Jensen SE, Butt Z, Nowinski C, Rothrock N (2012) Methodological Issues in the Selection, Administration and Use of Patient-Reported Outcomes in Performance Measurement in Health Care Settings. National Quality Forum, Washington"},{"key":"1081_CR12","volume-title":"Quality of Life and Pharmacoeconomics in Clinical Trials","author":"B Spilker","year":"1995","unstructured":"Spilker B (1995) Quality of Life and Pharmacoeconomics in Clinical Trials. Lippincott Williams & Wilkins, Baltimore"},{"issue":"6","key":"1081_CR13","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1001\/archfami.5.6.329","volume":"5","author":"DW Baker","year":"1996","unstructured":"Baker DW, Parker RM, Williams MV, Pitkin K, Parikh NS, Coates W et al (1996) The health care experience of patients with low literacy. Arch Fam Med 5(6):329\u2013334. https:\/\/doi.org\/10.1001\/archfami.5.6.329","journal-title":"Arch Fam Med"},{"issue":"1","key":"1081_CR14","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1016\/0738-3991(95)00787-3","volume":"27","author":"NS Parikh","year":"1996","unstructured":"Parikh NS, Parker RM, Nurss JR, Baker DW, Williams MV (1996) Shame and health literacy: the unspoken connection. Patient Educ Couns 27(1):33\u201339. https:\/\/doi.org\/10.1016\/0738-3991(95)00787-3","journal-title":"Patient Educ Couns"},{"issue":"6","key":"1081_CR15","doi-asserted-by":"publisher","first-page":"1120","DOI":"10.1038\/s41591-022-01781-8","volume":"28","author":"MJ Calvert","year":"2022","unstructured":"Calvert MJ, Cruz Rivera S, Retzer A, Hughes SE, Campbell L, Molony-Oates B et al (2022) Patient reported outcome assessment must be inclusive and equitable. Nat Med 28(6):1120\u20131124. https:\/\/doi.org\/10.1038\/s41591-022-01781-8","journal-title":"Nat Med"},{"issue":"6","key":"1081_CR16","doi-asserted-by":"publisher","first-page":"e0252684","DOI":"10.1371\/journal.pone.0252684","volume":"16","author":"C Long","year":"2021","unstructured":"Long C, Beres LK, Wu AW, Giladi AM (2021) Developing a protocol for adapting multimedia patient-reported outcomes measures for low literacy patients. PLoS ONE 16(6):e0252684. https:\/\/doi.org\/10.1371\/journal.pone.0252684","journal-title":"PLoS ONE"},{"issue":"6","key":"1081_CR17","doi-asserted-by":"publisher","first-page":"e0304351","DOI":"10.1371\/journal.pone.0304351","volume":"19","author":"CL Azad","year":"2024","unstructured":"Azad CL, Beres LK, Wu AW, Fong A, Giladi AM (2024) Developing a multimedia patient-reported outcomes measure for low literacy patients with a human-centered design approach. PLoS ONE 19(6):e0304351. https:\/\/doi.org\/10.1371\/journal.pone.0304351","journal-title":"PLoS ONE"},{"key":"1081_CR18","unstructured":"Summary Table for NIH CDE Initiatives (2020) National Library of Medicine, Bethesda. nlm.nih.gov\/cde\/summary_table_1. Accessed September 18"},{"key":"1081_CR19","unstructured":"Item RT, Health Measures (2020) Chicago. https:\/\/healthmeasures.net\/resource-center\/measurement-science\/item-response-theory. Accessed September 18"},{"key":"1081_CR20","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1007\/s11136-007-9175-7","volume":"16","author":"RD Hays","year":"2007","unstructured":"Hays RD, Lipscomb J (2007) Next steps for use of item response theory in the assessment of health outcomes. Qual Life Res 16:195\u2013199. https:\/\/doi.org\/10.1007\/s11136-007-9175-7","journal-title":"Qual Life Res"},{"issue":"5","key":"1081_CR21","doi-asserted-by":"publisher","first-page":"R147","DOI":"10.1186\/ar3461","volume":"13","author":"JF Fries","year":"2011","unstructured":"Fries JF, Krishnan E, Rose M, Lingala B, Bruce B (2011) Improved responsiveness and reduced sample size requirements of PROMIS physical function scales with item response theory. Arthritis Res Ther 13(5):R147. https:\/\/doi.org\/10.1186\/ar3461","journal-title":"Arthritis Res Ther"},{"key":"1081_CR22","unstructured":"PROMIS\u00aeInstrument Development and Validation Scientific Standards Version 2.0 (2013) HealthMeasures, Chicago. https:\/\/www.healthmeasures.net\/images\/PROMIS\/PROMISStandards_Vers2.0_Final.pdf. Accessed April 14, 2026"},{"issue":"3","key":"1081_CR23","doi-asserted-by":"publisher","first-page":"e434","DOI":"10.3928\/01477447-20210415-02","volume":"44","author":"MM Shipp","year":"2021","unstructured":"Shipp MM, Thakkar MY, Sanghavi KK, Means KR Jr, Giladi AM (2021) Disparities Limit the Effect and Benefit of a Web-Based Clinic Intake System. Orthopedics 44(3):e434\u2013e439. https:\/\/doi.org\/10.3928\/01477447-20210415-02","journal-title":"Orthopedics"},{"key":"1081_CR24","unstructured":": County Health Rankings & Roadmaps, City B (2019) MD University of Wisconsin Population Health Institute, Madison. https:\/\/www.countyhealthrankings.org\/explore-health-rankings\/maryland\/baltimore-city?year=2019. Accessed 21 Nov 2019"},{"key":"1081_CR25","unstructured":"Data USA: Baltimore, MD Data USA, Cambridge (2014) https:\/\/datausa.io\/profile\/geo\/baltimore-md\/. Accessed 7 Mar 2020"},{"key":"1081_CR26","unstructured":"Multimedia PROMIS-UE, Prototype https:\/\/mi2apps.medstar.net\/mprom\/20210806\/index.html. Accessed 21 Aug 2021"},{"issue":"1","key":"1081_CR27","first-page":"34","volume":"5","author":"R Macefield","year":"2009","unstructured":"Macefield R (2009) How To Specify the Participant Group Size for Usability Studies: A Practitioner\u2019s Guide. J Usability Stud 5(1):34\u201345","journal-title":"J Usability Stud"},{"issue":"6","key":"1081_CR28","doi-asserted-by":"publisher","first-page":"855","DOI":"10.1177\/104973230201200611","volume":"12","author":"JB Averill","year":"2002","unstructured":"Averill JB (2002) Matrix analysis as a complementary analytic strategy in qualitative inquiry. Qual Health Res 12(6):855\u2013866. https:\/\/doi.org\/10.1177\/104973230201200611","journal-title":"Qual Health Res"},{"key":"1081_CR29","unstructured":"The Field Guide to Human-Centered Design (2021) IDEO.org, San Francisco. https:\/\/www.designkit.org\/resources\/1.html. Accessed 19 Feb 2021"},{"key":"1081_CR30","unstructured":"Nielsen J (2000) Why You only need to test with 5 Users. Nielsen Norman Group, Fremont. https:\/\/www.nngroup.com\/articles\/why-you-only-need-to-test-with-5-users\/. Accessed 19 Feb 2021"},{"issue":"11","key":"1081_CR31","doi-asserted-by":"publisher","first-page":"e0186744","DOI":"10.1371\/journal.pone.0186744","volume":"12","author":"AN Bazzano","year":"2017","unstructured":"Bazzano AN, Martin J, Hicks E, Faughnan M, Murphy L (2017) Human-centred design in global health: A scoping review of applications and contexts. PLoS ONE 12(11):e0186744. https:\/\/doi.org\/10.1371\/journal.pone.0186744","journal-title":"PLoS ONE"},{"key":"1081_CR32","doi-asserted-by":"publisher","DOI":"10.4135\/9781412983655","volume-title":"Cognitive Interviewing: A Tool For Improving Questionnaire Design","author":"GB Willis","year":"2005","unstructured":"Willis GB (2005) Cognitive Interviewing: A Tool For Improving Questionnaire Design. SAGE, Thousand Oaks"},{"issue":"31","key":"1081_CR33","doi-asserted-by":"publisher","first-page":"e2202116119","DOI":"10.1073\/pnas.2202116119","volume":"119","author":"F Chierichetti","year":"2022","unstructured":"Chierichetti F, Kumar R, Tomkins A (2022) On the number of trials needed to distinguish similar alternatives. Proc Natl Acad Sci U S A 119(31):e2202116119. https:\/\/doi.org\/10.1073\/pnas.2202116119","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"1\u20132","key":"1081_CR34","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1016\/s1532-0464(03)00060-1","volume":"36","author":"J Zhang","year":"2003","unstructured":"Zhang J, Johnson TR, Patel VL, Paige DL, Kubose T (2003) Using usability heuristics to evaluate patient safety of medical devices. J Biomed Inf 36(1\u20132):23\u201330. https:\/\/doi.org\/10.1016\/s1532-0464(03)00060-1","journal-title":"J Biomed Inf"},{"key":"1081_CR35","doi-asserted-by":"publisher","DOI":"10.1145\/259963.260531","volume-title":"Usability Inspection Methods","author":"J Nielsen","year":"1994","unstructured":"Nielsen J, Mack RL (1994) Usability Inspection Methods. Wiley, Hoboken"},{"key":"1081_CR36","unstructured":"Multimedia PROMIS-UE, Final Version (2024). https:\/\/shrey94.github.io\/MPROM\/Question_1.html. Accessed 1 Jan"},{"key":"1081_CR37","doi-asserted-by":"publisher","unstructured":"HahnEA, Cella D, Dobrez D, Shiomoto G, Marcus E, Taylor SG, et al (2004) The talking touchscreen: a new approach to outcomes assessment in low literacy. Psychosoc 13(2):86-95. Epub 2004\/02\/12. 10.1002\/pon.719. PubMed PMID: 14872527. https:\/\/doi.org\/10.1002\/pon.719","DOI":"10.1002\/pon.719"},{"key":"1081_CR38","doi-asserted-by":"publisher","unstructured":"GhiassiR, Murphy K, Cummin AR, Partridge MR (2011) Developing a pictorial Epworth Sleepiness Scale. Thorax 66(2):97-100. Epub 2010\/10\/28. 10.1136\/thx.2010.136879. PubMed PMID: 20978025. https:\/\/doi.org\/10.1136\/thx.2010.136879","DOI":"10.1136\/thx.2010.136879"},{"key":"1081_CR39","doi-asserted-by":"publisher","unstructured":"Lopez-OlivoMA, Ingleshwar A, Volk RJ, Jibaja-Weiss M, Barbo A, Saag K, et al (2018) Development and pilot testing of multimedia patient education tools for patients With knee osteoarthritis, osteoporosis, and rheumatoid arthritis. Arthritis Care Res (Hoboken) 70(2):213-20. Epub 2017\/05\/04. 10.1002\/acr.23271. PubMed PMID: 28464546; PubMed Central PMCID: PMCPMC6442741. https:\/\/doi.org\/10.1002\/acr.23271","DOI":"10.1002\/acr.23271"}],"container-title":["Journal of Patient-Reported Outcomes"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s41687-026-01081-6","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s41687-026-01081-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s41687-026-01081-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,11]],"date-time":"2026-08-11T12:04:29Z","timestamp":1786449869000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s41687-026-01081-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,14]]},"references-count":39,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["1081"],"URL":"https:\/\/doi.org\/10.1186\/s41687-026-01081-6","relation":{},"ISSN":["2509-8020"],"issn-type":[{"value":"2509-8020","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,14]]},"assertion":[{"value":"8 March 2026","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 May 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 May 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"This study was performed in accordance with the ethical standards in the 1964 Declaration of Helsinki and with relevant regulations of the US Health Insurance Portability and Accountability Act (HIPAA). This study was approved by the MedStar Health Research Institute institutional review board (STUDY00002319). The recruitment period started April 29, 2021 and ended May 26, 2023. Participants provided written informed consent.","order":1,"name":"Ethics","label":"Ethics approval and consent to participate","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","label":"Competing interests","group":{"name":"EthicsHeading","label":"Declarations"}}],"article-number":"138"}}