{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T18:47:57Z","timestamp":1775069277312,"version":"3.50.1"},"reference-count":84,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2019,10,31]],"date-time":"2019-10-31T00:00:00Z","timestamp":1572480000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000056","name":"National Institute of Nursing Research","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000056","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01 NR015737"],"award-info":[{"award-number":["R01 NR015737"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["T32 NR007969"],"award-info":[{"award-number":["T32 NR007969"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["K99 NR017829"],"award-info":[{"award-number":["K99 NR017829"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000056","name":"National Institute of Nursing Research","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000056","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,2,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Objective<\/jats:title><jats:p>The study sought to design symptom reports of longitudinal patient-reported outcomes data that are understandable and meaningful to end users.<\/jats:p><\/jats:sec><jats:sec><jats:title>Materials and Methods<\/jats:title><jats:p>We completed a 2-phase iterative design and evaluation process. In phase I, we developed symptom reports and refined them according to expert input. End users then completed a survey containing demographics, a measure of health literacy, and items to assess visualization preferences and comprehension of reports. We then collected participants\u2019 perspectives on reports through semistructured interviews and modified them accordingly. In phase II, refined reports were evaluated in a survey that included demographics, validated measures of health and graph literacy, and items to assess preferences and comprehension of reports. Surveys were administered using a think-aloud protocol.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Fifty-five English- and Spanish-speaking end users, 89.1% of whom had limited health literacy, participated. In phase I, experts recommended improvements and 20 end users evaluated reports. From the feedback received, we added emojis, changed date and font formats, and simplified the y-axis scale of reports. In phase II, 35 end users evaluated refined designs, of whom 94.3% preferred reports with emojis, the favorite being a bar graph combined with emojis, which also promoted comprehension. In both phases, participants literally interpreted reports and provided suggestions for future visualizations.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>A bar graph combined with emojis was participants\u2019 preferred format and the one that promoted comprehension. Target end users must be included in visualization design to identify literal interpretations of images and ensure final products are meaningful.<\/jats:p><\/jats:sec>","DOI":"10.1093\/jamia\/ocz189","type":"journal-article","created":{"date-parts":[[2019,10,2]],"date-time":"2019-10-02T11:17:21Z","timestamp":1570015041000},"page":"212-224","source":"Crossref","is-referenced-by-count":37,"title":["Patient preferences for visualization of longitudinal patient-reported outcomes data"],"prefix":"10.1093","volume":"27","author":[{"given":"Samantha","family":"Stonbraker","sequence":"first","affiliation":[{"name":"Columbia University School of Nursing, New York, New York, USA"}]},{"given":"Tiffany","family":"Porras","sequence":"additional","affiliation":[{"name":"Columbia University School of Nursing, New York, New York, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2184-4045","authenticated-orcid":false,"given":"Rebecca","family":"Schnall","sequence":"additional","affiliation":[{"name":"Columbia University School of Nursing, New York, New York, USA"}]}],"member":"286","published-online":{"date-parts":[[2019,10,31]]},"reference":[{"key":"2020110613090500900_ocz189-B1","year":"2017"},{"issue":"9937","key":"2020110613090500900_ocz189-B2","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1016\/S0140-6736(14)60648-6","article-title":"Prevention of chronic disease in the 21st century: elimination of the leading preventable causes of premature death and disability in the USA","volume":"384","author":"Bauer","year":"2014","journal-title":"Lancet"},{"key":"2020110613090500900_ocz189-B3","first-page":"785\u201394","article-title":"Symptoms and impact of symptoms on function and health in patients with chronic obstructive pulmonary disease and chronic heart failure in primary health care","volume":"9","author":"Theander","year":"2014","journal-title":"Int J Chron Obstruct Pulmon Dis"},{"issue":"3","key":"2020110613090500900_ocz189-B4","doi-asserted-by":"crossref","first-page":"578","DOI":"10.1016\/j.ygyno.2016.09.013","article-title":"Cancer and treatment-related symptoms are associated with mobility disability in women with ovarian cancer: a cross-sectional study","volume":"143","author":"Campbell","year":"2016","journal-title":"Gynecol Oncol"},{"issue":"9","key":"2020110613090500900_ocz189-B5","doi-asserted-by":"crossref","first-page":"1159","DOI":"10.1080\/09540121.2010.498860","article-title":"Prevalence, correlates, and self-management of HIV-related depressive symptoms","volume":"22","author":"Eller","year":"2010","journal-title":"AIDS Care"},{"issue":"1","key":"2020110613090500900_ocz189-B6","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1007\/s10461-017-1786-6","article-title":"Self-management strategies for coping with adverse symptoms in persons living with HIV with HIV associated non-AIDS conditions","volume":"22","author":"Iribarren","year":"2018","journal-title":"AIDS Behav"},{"issue":"6","key":"2020110613090500900_ocz189-B7","doi-asserted-by":"crossref","first-page":"774","DOI":"10.1080\/09540121.2017.1417532","article-title":"Racial and socioeconomic disparities in the symptom profile of persons living with HIV","volume":"30","author":"Schnall","year":"2018","journal-title":"AIDS Care"},{"key":"2020110613090500900_ocz189-B8","doi-asserted-by":"crossref","first-page":"S3.","DOI":"10.1097\/01.mlr.0000258615.42478.55","article-title":"The Patient-Reported Outcomes Measurement Information System (PROMIS): progress of an NIH roadmap cooperative group during its first two years","volume":"45(5 Suppl 1)","author":"Cella","year":"2007","journal-title":"Med Care"},{"issue":"1","key":"2020110613090500900_ocz189-B9","doi-asserted-by":"crossref","first-page":"211.","DOI":"10.1186\/1472-6963-13-211","article-title":"A systematic review of the impact of routine collection of patient reported outcome measures on patients, providers and health organisations in an oncologic setting","volume":"13","author":"Chen","year":"2013","journal-title":"BMC Health Serv Res"},{"issue":"8","key":"2020110613090500900_ocz189-B10","doi-asserted-by":"crossref","first-page":"1305","DOI":"10.1007\/s11136-011-0054-x","article-title":"Implementing patient-reported outcomes assessment in clinical practice: a review of the options and considerations","volume":"21","author":"Snyder","year":"2012","journal-title":"Qual Life Res"},{"issue":"1","key":"2020110613090500900_ocz189-B11","first-page":"1015.","article-title":"Advances in patient-reported outcomes: the NIH PROMIS\u00ae measures","volume":"1","author":"Broderick","year":"2013","journal-title":"EGEMS (Wash DC)"},{"key":"2020110613090500900_ocz189-B12","first-page":"148\u201353.","article-title":"Montreal Accord on Patient-Reported Outcomes (PROs) use series-Paper 6: creating national initiatives to support development and use-the PROMIS example","volume":"89","author":"Bartlett","year":"2017","journal-title":"J Clin Epidemiol"},{"issue":"6","key":"2020110613090500900_ocz189-B13","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1377\/hlthaff.20.6.64","article-title":"Improving chronic illness care: translating evidence into action","volume":"20","author":"Wagner","year":"2001","journal-title":"Health Aff"},{"issue":"4","key":"2020110613090500900_ocz189-B14","doi-asserted-by":"crossref","first-page":"511","DOI":"10.2307\/3350391","article-title":"Organizing care for patients with chronic illness","volume":"74","author":"Wagner","year":"1996","journal-title":"Milbank Q"},{"issue":"5","key":"2020110613090500900_ocz189-B15","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1111\/j.1365-2753.2006.00650.x","article-title":"Impact of patient-reported outcome measures on routine practice: a structured review","volume":"12","author":"Marshall","year":"2006","journal-title":"J Eval Clin Pract"},{"issue":"4","key":"2020110613090500900_ocz189-B16","first-page":"163","article-title":"Effectiveness of an intervention to improve primary care provider recognition of depression","volume":"4","author":"Dobscha","year":"2001","journal-title":"Eff Clin Pract"},{"issue":"3","key":"2020110613090500900_ocz189-B17","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1002\/1099-1611(200005\/06)9:3<203::AID-PON453>3.0.CO;2-Y","article-title":"Impact of computerized quality of life screening on physician behaviour and patient satisfaction in lung cancer outpatients","volume":"9","author":"Taenzer","year":"2000","journal-title":"Psycho-Oncol"},{"issue":"2","key":"2020110613090500900_ocz189-B18","doi-asserted-by":"crossref","first-page":"137.","DOI":"10.5056\/jnm.2013.19.2.137","article-title":"Patient-reported outcomes in gastroenterology: clinical and research applications","volume":"19","author":"Spiegel","year":"2013","journal-title":"J Neurogastroenterol Motil"},{"issue":"4","key":"2020110613090500900_ocz189-B19","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1377\/hlthaff.2015.1362","article-title":"Incorporating patient-reported outcomes into health care to engage patients and enhance care","volume":"35","author":"Lavallee","year":"2016","journal-title":"Health Aff"},{"key":"2020110613090500900_ocz189-B20","doi-asserted-by":"crossref","DOI":"10.1136\/bmj.f167","article-title":"Patient reported outcome measures could help transform healthcare","author":"Black","year":"2013","journal-title":"Br Med J"},{"issue":"4","key":"2020110613090500900_ocz189-B21","doi-asserted-by":"crossref","first-page":"714","DOI":"10.1200\/JCO.2004.06.078","article-title":"Measuring quality of life in routine oncology practice improves communication and patient well-being: a randomized controlled trial","volume":"22","author":"Velikova","year":"2004","journal-title":"J Clin Oncol"},{"key":"2020110613090500900_ocz189-B22","doi-asserted-by":"crossref","first-page":"g7818","DOI":"10.1136\/bmj.g7818","article-title":"Patient reported outcome measures in practice","volume":"350","author":"Nelson","year":"2015","journal-title":"BMJ"},{"issue":"9","key":"2020110613090500900_ocz189-B23","doi-asserted-by":"crossref","first-page":"1273\u20139.","DOI":"10.1054\/bjoc.2001.2073","article-title":"Promoting patient participation and shortening cancer consultations: a randomised trial","volume":"85","author":"Brown","year":"2001","journal-title":"Br J Cancer"},{"issue":"11","key":"2020110613090500900_ocz189-B24","first-page":"256","article-title":"Engagement with health care providers affects self-efficacy, self-esteem, medication adherence and quality of life in people living with HIV","volume":"4","author":"Chen","year":"2013","journal-title":"J AIDS Clin Res"},{"issue":"4","key":"2020110613090500900_ocz189-B25","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1089\/108729100317795","article-title":"Relationships between perception of engagement with health care provider and demographic characteristics, health status, and adherence to therapeutic regimen in persons with HIV\/AIDS","volume":"14","author":"Bakken","year":"2000","journal-title":"AIDS Patient Care STDS"},{"issue":"1","key":"2020110613090500900_ocz189-B26","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1016\/j.jbi.2011.08.017","article-title":"Healthcare in the pocket: mapping the space of mobile-phone health interventions","volume":"45","author":"Klasnja","year":"2012","journal-title":"J Biomed Inform"},{"issue":"10","key":"2020110613090500900_ocz189-B27","doi-asserted-by":"crossref","first-page":"1848","DOI":"10.1002\/cncr.30530","article-title":"What do these scores mean? Presenting patient-reported outcomes data to patients and clinicians to improve interpretability","volume":"123","author":"Snyder","year":"2017","journal-title":"Cancer"},{"key":"2020110613090500900_ocz189-B28","year":"2008"},{"issue":"4","key":"2020110613090500900_ocz189-B29","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1007\/s11904-013-0178-4","article-title":"Health literacy: impact on the health of HIV-infected individuals","volume":"10","author":"Wawrzyniak","year":"2013","journal-title":"Curr HIV\/AIDS Rep"},{"issue":"6","key":"2020110613090500900_ocz189-B30","doi-asserted-by":"crossref","first-page":"741","DOI":"10.1177\/1060028014526562","article-title":"Impact of health literacy on medication adherence a systematic review and meta-analysis","volume":"48","author":"Zhang","year":"2014","journal-title":"Ann Pharmacother"},{"key":"2020110613090500900_ocz189-B31","doi-asserted-by":"crossref","first-page":"562637.","DOI":"10.1100\/2012\/562637","article-title":"Using visual aids to improve communication of risks about health: a review","volume":"2012","author":"Garcia-Retamero","year":"2012","journal-title":"Sci World J"},{"issue":"12","key":"2020110613090500900_ocz189-B32","doi-asserted-by":"crossref","first-page":"2117","DOI":"10.1007\/s11606-008-0803-x","article-title":"Numeracy and communication with patients: they are counting on us","volume":"23","author":"Apter","year":"2008","journal-title":"J Gen Intern Med"},{"key":"2020110613090500900_ocz189-B33","doi-asserted-by":"crossref","DOI":"10.31478\/201401a","volume-title":"Designing Health Literate Mobile Apps","author":"Broderick","year":"2014"},{"issue":"3","key":"2020110613090500900_ocz189-B34","doi-asserted-by":"crossref","first-page":"263\u201374","DOI":"10.1017\/S1930297500001467","article-title":"Risk communication with pictographs: the role of numeracy and graph processing","volume":"6","author":"Hess","year":"2011","journal-title":"Judgm Decis Mak"},{"issue":"1","key":"2020110613090500900_ocz189-B35","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1080\/13669877.2010.488745","article-title":"How do people perceive graphical risk communication? The role of subjective numeracy","volume":"14","author":"Hess","year":"2011","journal-title":"J Risk Res"},{"issue":"S2","key":"2020110613090500900_ocz189-B36","doi-asserted-by":"crossref","DOI":"10.1186\/1472-6947-13-S2-S7","article-title":"Presenting quantitative information about decision outcomes: a risk communication primer for patient decision aid developers","volume":"13","author":"Trevena","year":"2013","journal-title":"BMC Med Inform Decis Mak"},{"issue":"4","key":"2020110613090500900_ocz189-B37","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1177\/0272989X11424926","article-title":"The influence of graphic display format on the interpretations of quantitative risk information among adults with lower education and literacy: a randomized experimental study","volume":"32","author":"McCaffery","year":"2012","journal-title":"Med Decis Making"},{"key":"2020110613090500900_ocz189-B38","first-page":"1347","article-title":"Multi-modal methodology for adapting digital health tools to new populations: adaptation of the video information provider (VIP) for persons living with HIV with HIV associated non-AIDS (HANA) conditions","volume":"264","author":"Schnall","year":"2019","journal-title":"Stud Health Technol Inform"},{"issue":"3","key":"2020110613090500900_ocz189-B39","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1016\/0022-3956(75)90026-6","article-title":"Mini-mental state\u201d: a practical method for grading the cognitive state of patients for the clinician","volume":"12","author":"Folstein","year":"1975","journal-title":"J Psychiatry Res"},{"key":"2020110613090500900_ocz189-B40","volume-title":"Visualize This: The FlowingData Guide to Design, Visualization, and Statistics","author":"Yau","year":"2011"},{"key":"2020110613090500900_ocz189-B41","year":"2017"},{"issue":"6","key":"2020110613090500900_ocz189-B42","doi-asserted-by":"crossref","first-page":"514","DOI":"10.1370\/afm.405","article-title":"Quick assessment of literacy in primary care: The Newest Vital Sign","volume":"3","author":"Weiss","year":"2005","journal-title":"Ann Fam Med"},{"issue":"11","key":"2020110613090500900_ocz189-B43","doi-asserted-by":"crossref","first-page":"1295","DOI":"10.1016\/j.pec.2015.04.003","article-title":"Optimal health literacy measurement for the clinical setting: a systematic review","volume":"98","author":"Duell","year":"2015","journal-title":"Patient Educ Couns"},{"key":"2020110613090500900_ocz189-B44","doi-asserted-by":"crossref","first-page":"S36","DOI":"10.5993\/AJHB.31.s1.6","article-title":"Measuring adult literacy in health care: performance of the Newest Vital Sign","volume":"31 (Suppl 1)","author":"Osborn","year":"2007","journal-title":"Am J Health Behav"},{"issue":"12","key":"2020110613090500900_ocz189-B45","doi-asserted-by":"crossref","first-page":"1513","DOI":"10.1016\/j.pec.2015.07.012","article-title":"Tools to measure health literacy among Spanish speakers: an integrative review of the literature","volume":"98","author":"Stonbraker","year":"2015","journal-title":"Patient Educ Couns"},{"issue":"2","key":"2020110613090500900_ocz189-B46","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1080\/0144929X.2012.708786","article-title":"The impact of two different think-aloud instructions in a usability test: a case of just following orders?","volume":"33","author":"Zhao","year":"2014","journal-title":"Behav Inf Technol"},{"issue":"3","key":"2020110613090500900_ocz189-B47","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1177\/0272989X10373805","article-title":"Graph literacy: a cross-cultural comparison","volume":"31","author":"Galesic","year":"2011","journal-title":"Med Decis Making"},{"issue":"9","key":"2020110613090500900_ocz189-B48","doi-asserted-by":"crossref","first-page":"1277","DOI":"10.1177\/1049732305276687","article-title":"Three approaches to qualitative content analysis","volume":"15","author":"Hsieh","year":"2005","journal-title":"Qual Health Res"},{"issue":"3","key":"2020110613090500900_ocz189-B49","doi-asserted-by":"crossref","first-page":"398","DOI":"10.1111\/nhs.12048","article-title":"Content analysis and thematic analysis: implications for conducting a qualitative descriptive study","volume":"15","author":"Vaismoradi","year":"2013","journal-title":"Nurs Health Sci"},{"issue":"9","key":"2020110613090500900_ocz189-B50","first-page":"1408\u201316","article-title":"Are we there yet? Data saturation in qualitative research","volume":"20","author":"Fusch","year":"2015","journal-title":"Qual Rep"},{"issue":"1","key":"2020110613090500900_ocz189-B51","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1177\/1525822X05279903","article-title":"How many interviews are enough? An experiment with data saturation and variability","volume":"18","author":"Guest","year":"2006","journal-title":"Field Methods"},{"issue":"2","key":"2020110613090500900_ocz189-B52","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1016\/S0304-3959(00)00375-4","article-title":"Smiling face as anchor for pain intensity scales","volume":"89","author":"Wong","year":"2001","journal-title":"Pain"},{"issue":"3","key":"2020110613090500900_ocz189-B53","doi-asserted-by":"crossref","first-page":"448","DOI":"10.1016\/j.pec.2015.09.009","article-title":"Relevance of graph literacy in the development of patient-centered communication tools","volume":"99","author":"Nayak","year":"2016","journal-title":"Patient Educ Couns"},{"issue":"1","key":"2020110613090500900_ocz189-B54","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1186\/1472-6874-8-18","article-title":"Frequency format diagram and probability chart for breast cancer risk communication: a prospective, randomized trial","volume":"8","author":"Ghosh","year":"2008","journal-title":"BMC Womens Health"},{"issue":"4","key":"2020110613090500900_ocz189-B55","doi-asserted-by":"crossref","first-page":"483","DOI":"10.1016\/j.pec.2015.10.027","article-title":"Graphical displays of patient-reported outcomes (PRO) for use in clinical practice: What makes a pro picture worth a thousand words?","volume":"99","author":"Bantug","year":"2016","journal-title":"Patient Educ Couns"},{"issue":"3","key":"2020110613090500900_ocz189-B56","first-page":"104\u201328.","article-title":"Commercial smartphone-based devices and smart applications for personalized healthcare monitoring and management","volume":"4","author":"Vashist","year":"2014","journal-title":"Diagnostics (Basel)"},{"issue":"1","key":"2020110613090500900_ocz189-B57","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1186\/1471-2296-15-4","article-title":"Integrating a tailored e-health self-management application for chronic obstructive pulmonary disease patients into primary care: a pilot study","volume":"15","author":"Voncken-Brewster","year":"2014","journal-title":"BMC Fam Pract"},{"issue":"2","key":"2020110613090500900_ocz189-B58","doi-asserted-by":"crossref","first-page":"e47.","DOI":"10.2196\/mhealth.5242","article-title":"User preferences for content, features, and style for an app to reduce harmful drinking in young adults: analysis of user feedback in app stores and focus group interviews","volume":"4","author":"Milward","year":"2016","journal-title":"JMIR Mhealth Uhealth"},{"issue":"4","key":"2020110613090500900_ocz189-B59","doi-asserted-by":"crossref","first-page":"e53.","DOI":"10.2196\/mhealth.6654","article-title":"Developing a patient-centered mHealth app: a tool for adolescents with type 1 diabetes and their parents","volume":"5","author":"Holtz","year":"2017","journal-title":"JMIR Mhealth Uhealth"},{"issue":"1","key":"2020110613090500900_ocz189-B60","doi-asserted-by":"crossref","first-page":"e5.","DOI":"10.2196\/humanfactors.7133","article-title":"A self-regulation theory\u2013based asthma management mobile app for adolescents: a usability assessment","volume":"4","author":"Sage","year":"2017","journal-title":"JMIR Hum Factors"},{"issue":"1","key":"2020110613090500900_ocz189-B61","first-page":"63","article-title":"Power Up: Patient and public involvement in developing a shared decision-making app for mental health","volume":"3","author":"Edridge","year":"2018","journal-title":"J Health Des"},{"key":"2020110613090500900_ocz189-B62","article-title":"Patient-reported outcomes, emoji, and activity measured on the Apple Watch in cancer patients","volume":"36 (Suppl 15)","author":"Thompson","year":"2018","journal-title":"J Clin Oncol"},{"issue":"5","key":"2020110613090500900_ocz189-B63","doi-asserted-by":"crossref","first-page":"789","DOI":"10.1016\/j.surg.2013.12.007","article-title":"User-centered design of quality of life reports for clinical care of patients with prostate cancer","volume":"155","author":"Izard","year":"2014","journal-title":"Surgery"},{"issue":"2","key":"2020110613090500900_ocz189-B64","doi-asserted-by":"crossref","first-page":"1.","DOI":"10.1007\/s10916-014-0182-2","article-title":"Empirical studies on usability of mHealth apps: a systematic literature review","volume":"39","author":"Zapata","year":"2015","journal-title":"J Med Syst"},{"issue":"4","key":"2020110613090500900_ocz189-B65","doi-asserted-by":"crossref","first-page":"289\u201396.","DOI":"10.1037\/prj0000019","article-title":"Development and usability testing of FOCUS: a smartphone system for self-management of schizophrenia","volume":"36","author":"Ben-Zeev","year":"2013","journal-title":"Psychiatr Rehabil J"},{"issue":"3","key":"2020110613090500900_ocz189-B66","doi-asserted-by":"crossref","first-page":"e33.","DOI":"10.2196\/mhealth.3359","article-title":"Supporting cancer patients in illness management: usability evaluation of a mobile app","volume":"2","author":"Mirkovic","year":"2014","journal-title":"JMIR Mhealth Uhealth"},{"issue":"3","key":"2020110613090500900_ocz189-B67","doi-asserted-by":"crossref","DOI":"10.2196\/jmir.2395","article-title":"Using text messaging to assess adolescents' health information needs: an ecological momentary assessment","volume":"15","author":"Schnall","year":"2013","journal-title":"J Med Internet Res"},{"key":"2020110613090500900_ocz189-B68","doi-asserted-by":"crossref","first-page":"573","DOI":"10.1007\/978-981-13-1165-9_53","volume-title":"Third International Congress on Information and Communication Technology","author":"Khan","year":"2019"},{"issue":"1","key":"2020110613090500900_ocz189-B69","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1016\/j.pec.2010.04.027","article-title":"Health literacy, numeracy, and interpretation of graphical breast cancer risk estimates","volume":"83","author":"Brown","year":"2011","journal-title":"Patient Educ Couns"},{"issue":"3","key":"2020110613090500900_ocz189-B70","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1007\/s12160-008-9037-8","article-title":"Clinical implications of numeracy: theory and practice","volume":"35","author":"Nelson","year":"2008","journal-title":"Ann Behav Med"},{"issue":"6","key":"2020110613090500900_ocz189-B71","doi-asserted-by":"crossref","first-page":"553","DOI":"10.1016\/0883-0355(90)90025-4","article-title":"A theoretical framework for research on learning from graphics","volume":"14","author":"Winn","year":"1990","journal-title":"Int J Educ Res"},{"key":"2020110613090500900_ocz189-B72","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1007\/978-0-387-70802-7_40","volume-title":"Advances in Information Systems Development: New Methods and Practice for the Networked Society","author":"Moody","year":"2007"},{"issue":"1","key":"2020110613090500900_ocz189-B73","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1177\/0272989X0102100105","article-title":"General performance on a numeracy scale among highly educated samples","volume":"21","author":"Lipkus","year":"2001","journal-title":"Med Decis Making"},{"issue":"6","key":"2020110613090500900_ocz189-B74","doi-asserted-by":"crossref","first-page":"1312","DOI":"10.1016\/j.drudis.2018.05.013","article-title":"The extent and effects of patient involvement in pictogram design for written drug information: a short systematic review","volume":"23","author":"van Beusekom","year":"2018","journal-title":"Drug Discov Today"},{"key":"2020110613090500900_ocz189-B75","article-title":"Participatory design with health consumers","author":"Skeels","year":"2008","journal-title":"AMIA Annu Symp Proc"},{"key":"2020110613090500900_ocz189-B76","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1080\/10810730.2016.1193915","article-title":"The association of graph literacy with use of and skills using an online personal health record in outpatient veterans","volume":"21 (Suppl 2)","author":"Ruiz","year":"2016","journal-title":"J Health Commun"},{"issue":"9","key":"2020110613090500900_ocz189-B77","doi-asserted-by":"crossref","first-page":"e11450.","DOI":"10.2196\/11450","article-title":"A mobile health intervention for HIV prevention among racially and ethnically diverse young men: usability evaluation","volume":"6","author":"Cho","year":"2018","journal-title":"JMIR Mhealth Uhealth"},{"issue":"1","key":"2020110613090500900_ocz189-B78","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1093\/jamia\/ocv094","article-title":"Integrating community-based participatory research and informatics approaches to improve the engagement and health of underserved populations","volume":"23","author":"Unertl","year":"2016","journal-title":"J Am Med Inform Assoc"},{"issue":"4","key":"2020110613090500900_ocz189-B79","doi-asserted-by":"crossref","first-page":"943","DOI":"10.4338\/ACI-2014-07-RA-0058","article-title":"Identifying consumer\u2019s needs of health information technology through an innovative participatory design approach among English-and Spanish-speaking urban older adults","volume":"5","author":"Lucero","year":"2014","journal-title":"Appl Clin Inform"},{"issue":"3","key":"2020110613090500900_ocz189-B80","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/j.hjdsi.2016.08.004","article-title":"Patient portals and health apps: pitfalls, promises, and what one might learn from the other","volume":"5","author":"Baldwin","year":"2017","journal-title":"Healthcare"},{"issue":"12","key":"2020110613090500900_ocz189-B81","doi-asserted-by":"crossref","first-page":"1417","DOI":"10.1007\/s11606-016-3771-6","article-title":"Usability of commercially available mobile applications for diverse patients","volume":"31","author":"Sarkar","year":"2016","journal-title":"J Gen Intern Med"},{"issue":"6","key":"2020110613090500900_ocz189-B82","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1089\/apc.2009.0306","article-title":"Beliefs about participating in research among a sample of minority persons living with HIV\/AIDS in New York City","volume":"24","author":"Floyd","year":"2010","journal-title":"AIDS Patient Care STDS"},{"issue":"2","key":"2020110613090500900_ocz189-B83","doi-asserted-by":"crossref","first-page":"e16","DOI":"10.2105\/AJPH.2013.301706","article-title":"A systematic review of barriers and facilitators to minority research participation among African Americans, Latinos, Asian Americans, and Pacific Islanders","volume":"104","author":"George","year":"2014","journal-title":"Am J Public Health"},{"issue":"3","key":"2020110613090500900_ocz189-B84","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1093\/pubmed\/fdi031","article-title":"Mode of questionnaire administration can have serious effects on data quality","volume":"27","author":"Bowling","year":"2005","journal-title":"J Public Health"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/2\/212\/34153162\/ocz189.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/2\/212\/34153162\/ocz189.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,21]],"date-time":"2023-09-21T05:12:13Z","timestamp":1695273133000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/27\/2\/212\/5610614"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,31]]},"references-count":84,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2019,10,31]]},"published-print":{"date-parts":[[2020,2,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocz189","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,2]]},"published":{"date-parts":[[2019,10,31]]}}}