{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,1]],"date-time":"2026-08-01T00:43:04Z","timestamp":1785544984248,"version":"3.56.0"},"reference-count":56,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Aging"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Medication adherence technologies (MATs) offer innovative solutions to support older adults in managing complex medication regimens, yet usability challenges can prevent their successful use. Older adults often face cognitive, physical, sensory, motivational, and environmental barriers, which can influence how they interact with these devices. Therefore, performance-based usability testing is essential for identifying usability issues.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aimed to evaluate the performance-based usability and user experience of 13 MATs among older adults with diverse capabilities.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n A prospective mixed methods design was used, with 96 participants aged 60 years and older testing smart and electronic MATs using cognitive walkthroughs and predefined usability tasks without formal training to simulate first-use conditions. This manuscript focuses specifically on the performance-based usability metrics collected as part of the mixed methods study. Validated tools, including the Self-Medication Assessment Tool (SMAT), Daily Living Tasks Dependent on Vision (DLTV), Whisper Test, Self-Efficacy for Appropriate Medication Use Scale (SEAMS), and Martin and Park Environmental Demands (MPED) Questionnaire, were used to assess individual barriers. Poisson generalized estimating equations (GEE) was used to determine predictors of unassisted task success and error rates while accounting for repeated observations.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n A total of 96 participants (mean age 75.1, SD 7.7, range 61\u201095 y) were included, with 37.5% (36\/96) male and 62.5% (60\/96) female. Poisson GEE models identified significant predictors of unassisted task success rate, including cognitive score (\n P<\/jats:italic>\n <.001), physical score (\n P<\/jats:italic>\n <.001), vision score (\n P<\/jats:italic>\n <.001), motivational score (\n P<\/jats:italic>\n <.001), and lower environmental busyness (\n P<\/jats:italic>\n =.049). Female sex was associated with a 9% lower success rate (\n P<\/jats:italic>\n =.002). Predictors of total error rate included age (\n P<\/jats:italic>\n =.02), sex (\n P<\/jats:italic>\n \u2264.001), physical score (\n P<\/jats:italic>\n \u2264.001), vision score (\n P<\/jats:italic>\n =.004), DLTV vision score (\n P<\/jats:italic>\n =.01), MPED routine score (environmental;\n P<\/jats:italic>\n =.05), and interaction between physical score and sex (\n P<\/jats:italic>\n =.004).\n <\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n Both device design and user characteristics strongly influence the usability of MATs. Performance-based evaluations provide actionable findings for user-centered design and selection, guiding manufacturers and health care providers toward developing and choosing accessible technologies that could improve medication adherence among older adults.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/88398","type":"journal-article","created":{"date-parts":[[2026,7,13]],"date-time":"2026-07-13T18:22:53Z","timestamp":1783966973000},"page":"e88398-e88398","source":"Crossref","is-referenced-by-count":0,"title":["Performance-Based Usability of Medication Adherence Technologies Among Older Adults With Diverse Capabilities: Quantitative Study"],"prefix":"10.2196","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-6778-4708","authenticated-orcid":false,"given":"Bincy","family":"Baby","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3247-9795","authenticated-orcid":false,"given":"Ghada","family":"Elba","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-5420-616X","authenticated-orcid":false,"given":"SooMin","family":"Park","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-0333-7119","authenticated-orcid":false,"given":"Imra","family":"Hudani","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7014-9754","authenticated-orcid":false,"given":"Rishabh","family":"Sharma","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-4257-8579","authenticated-orcid":false,"given":"Kirk","family":"Patterson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7887-3122","authenticated-orcid":false,"given":"Annette","family":"McKinnon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9552-9139","authenticated-orcid":false,"given":"Sara J T","family":"Guilcher","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4661-6911","authenticated-orcid":false,"given":"Feng","family":"Chang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9774-9568","authenticated-orcid":false,"given":"Linda","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6182-958X","authenticated-orcid":false,"given":"Catherine","family":"Burns","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-0365-6613","authenticated-orcid":false,"given":"Dagmar","family":"Hajducek","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4173-023X","authenticated-orcid":false,"given":"Ryan H","family":"Griffin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3002-8306","authenticated-orcid":false,"given":"Tejal","family":"Patel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,7,13]]},"reference":[{"key":"R1","unstructured":"Government of Canada. Aging and chronic diseases: A profile of Canadian seniors. 2020. URL: https:\/\/www.canada.ca\/en\/public-health\/services\/publications\/diseases-conditions\/aging-chronic-diseases-profile-canadian-seniors-report.html [Accessed 17-01-2025]"},{"issue":"1","key":"R2","doi-asserted-by":"publisher","DOI":"10.1186\/s12913-019-4149-3","article-title":"Insights on multimorbidity and associated health service use and costs from three population-based studies of older adults in Ontario with diabetes, dementia and stroke","volume":"19","author":"Griffith","journal-title":"BMC Health Serv Res"},{"issue":"3","key":"R3","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1080\/17843286.2016.1148298","article-title":"Polypharmacy in a Belgian cohort of community-dwelling oldest old (80+)","volume":"71","author":"Wauters","journal-title":"Acta Clin Belg"},{"key":"R4","doi-asserted-by":"publisher","DOI":"10.5888\/pcd13.160174","article-title":"Multimorbidity and functional limitations among adults 65 or older, NHANES 2005-2012","volume":"13","author":"Jindai","journal-title":"Prev Chronic Dis"},{"issue":"1","key":"R5","doi-asserted-by":"publisher","DOI":"10.1186\/s12877-021-02620-0","article-title":"Number of chronic conditions and associated functional limitations among older adults: cross-sectional findings from the longitudinal aging study in India","volume":"21","author":"Sharma","journal-title":"BMC Geriatr"},{"key":"R6","unstructured":"Medication use in older adults. CAMH. 2025. URL: https:\/\/www.camh.ca\/en\/health-info\/guides-and-publications\/medication-use-in-older-adults#:~:text=Although%20adults%20aged%2065%20and,one%20medication%20at%20a%20time [Accessed 17-01-2025]"},{"issue":"3","key":"R7","doi-asserted-by":"publisher","first-page":"213","DOI":"10.2174\/1574884710666150812141525","article-title":"Ability of older people with dementia or cognitive impairment to manage medicine regimens: a narrative review","volume":"10","author":"Elliott","journal-title":"Curr Clin Pharmacol"},{"issue":"2","key":"R8","doi-asserted-by":"publisher","first-page":"332","DOI":"10.1177\/0898264303251893","article-title":"Predictors of older adults\u2019 capacity for medication management in a self-medication program: a retrospective chart review","volume":"15","author":"Maddigan","journal-title":"J Aging Health"},{"issue":"Supplement 1","key":"R9","volume":"67","author":"Abed","journal-title":"J Am Geriatr Soc"},{"key":"R10","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2018.03.012","article-title":"Aging barriers influencing mobile health usability for older adults: a literature based framework (MOLD-US)","volume":"114","author":"Wildenbos","journal-title":"Int J Med Inform"},{"issue":"2","key":"R11","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0170651","article-title":"A systematic review of medication non-adherence in persons with dementia or cognitive impairment","volume":"12","author":"Smith","journal-title":"PLoS ONE"},{"issue":"2","key":"R12","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1093\/rheumatology\/22.2.95","article-title":"Problems for rheumatic patients in opening dispensed drug containers","volume":"22","author":"Lisberg","journal-title":"Br J Rheumatol"},{"issue":"601","key":"R13","doi-asserted-by":"publisher","first-page":"e530","DOI":"10.3399\/bjgp12X653570","article-title":"Help needed in medication self-management for people with visual impairment: case-control study","volume":"62","author":"McCann","journal-title":"Br J Gen Pract"},{"issue":"1","key":"R14","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0262012","article-title":"Integration of a smart multidose blister package for medication intake: a mixed method ethnographic informed study of older adults with chronic diseases","volume":"17","author":"Faisal","journal-title":"PLoS ONE"},{"issue":"8","key":"R15","doi-asserted-by":"publisher","first-page":"852","DOI":"10.1111\/j.1525-1497.2006.00536.x","article-title":"Predictors of medication self-management skill in a low-literacy population","volume":"21","author":"Kripalani","journal-title":"J Gen Intern Med"},{"issue":"2","key":"R16","doi-asserted-by":"publisher","first-page":"7302205060p1","DOI":"10.5014\/ajot.2019.029793","article-title":"Scoring, clinical utility, and psychometric properties of the In-HOME Medication Management Performance Evaluation (HOME-Rx)","volume":"73","author":"Somerville","journal-title":"Am J Occup Ther"},{"issue":"5","key":"R17","doi-asserted-by":"publisher","first-page":"881","DOI":"10.1111\/j.1532-5415.2008.01676.x","article-title":"Association between unmet needs for medication support and all-cause hospitalization in community-dwelling disabled elderly people","volume":"56","author":"Kuzuya","journal-title":"J Am Geriatr Soc"},{"issue":"2","key":"R18","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1111\/j.1532-5415.2007.01047.x","article-title":"Adverse drug events resulting from patient errors in older adults","volume":"55","author":"Field","journal-title":"J Am Geriatr Soc"},{"issue":"2","key":"R19","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1111\/j.1365-2648.2008.04656.x","article-title":"Interventions to improve medication adherence in people with multiple chronic conditions: a systematic review","volume":"63","author":"Williams","journal-title":"J Adv Nurs"},{"key":"R20","unstructured":"Woo K . Usability of Medication Adherence Technologies among Older Adults. 2012."},{"key":"R21","volume":"150","author":"Farooqi","journal-title":"Can Pharm J"},{"key":"R22","doi-asserted-by":"publisher","DOI":"10.2196\/50990","article-title":"Key features of smart medication adherence products: updated scoping review","volume":"6","author":"Faisal","journal-title":"JMIR Aging"},{"issue":"3","key":"R23","doi-asserted-by":"publisher","DOI":"10.2196\/35157","article-title":"Technologies for medication adherence monitoring and technology assessment criteria: narrative review","volume":"10","author":"Mason","journal-title":"JMIR Mhealth Uhealth"},{"key":"R24","unstructured":"Center for Technology and Aging. Technologies for Optimizing Medication Use in Older Adults. 2009:15-17."},{"key":"R25","unstructured":"Sam T . Developing drug administration devices for geriatric use. In: Stegemann S , editor. Developing Drug Products in an Aging Society. Springer; 2016. ISBN: 978-3-319-43097-3"},{"issue":"1","key":"R26","doi-asserted-by":"publisher","DOI":"10.1186\/s12877-024-04893-7","article-title":"Tools to measure barriers to medication management capacity in older adults: a scoping review","volume":"24","author":"Baby","journal-title":"BMC Geriatr"},{"issue":"6","key":"R27","doi-asserted-by":"publisher","DOI":"10.2196\/18073","article-title":"A prospective study of usability and workload of electronic medication adherence products by older adults, caregivers, and health care providers","volume":"22","author":"Patel","journal-title":"J Med Internet Res"},{"key":"R28","unstructured":"ISO. Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs)\u2014Part 11: Guidance on Usability (ISO 9241-11:1998(E)). 1998."},{"issue":"11","key":"R29","doi-asserted-by":"publisher","first-page":"841","DOI":"10.1016\/j.ijmedinf.2014.07.004","article-title":"Assessing the impact of cognitive impairment on the usability of an electronic medication delivery unit in an assisted living population","volume":"83","author":"Ligons","journal-title":"Int J Med Inform"},{"key":"R30","doi-asserted-by":"crossref","unstructured":"Albert B Tullis T . Measuring the User Experience. 1st ed. Morgan Kaufmann Publications; 2008. [doi: 10.1016\/B978-0-12-373558-4.00001-7]","DOI":"10.1016\/B978-0-12-373558-4.00001-7"},{"key":"R31","doi-asserted-by":"crossref","unstructured":"Sauro J Lewis J . Quantifying the User Experience. 2nd ed. Morgan Kaufmann Publications; 2016. [doi: 10.1016\/B978-0-12-802308-2.00002-3]","DOI":"10.1016\/B978-0-12-802308-2.00002-3"},{"key":"R32","doi-asserted-by":"crossref","unstructured":"Albert B Tullis T . Measuring the User Experience. 2nd ed. Morgan Kaufmann Publications; 2013. ISBN: 978-0-12-415781-1","DOI":"10.1016\/B978-0-12-415781-1.00001-7"},{"key":"R33","doi-asserted-by":"crossref","unstructured":"Bailey RW Wolfson CA Nall J Koyani S . Performance-based usability testing: metrics that have the greatest impact for improving a system\u2019s usability. Presented at: Human-Centered Design Proceedings of the First International Conference; Jul 19-24, 2009:3-12; San Diego, CA, USA. [doi: 10.1007\/978-3-642-02806-9_1]","DOI":"10.1007\/978-3-642-02806-9_1"},{"issue":"3","key":"R34","doi-asserted-by":"publisher","first-page":"499","DOI":"10.1207\/s15327906mbr2603_7","article-title":"How many subjects does it take to do a regression analysis","volume":"26","author":"Green","journal-title":"Multivariate Behav Res"},{"key":"R35","doi-asserted-by":"crossref","unstructured":"Nielsen J Landauer TK . A mathematical model of the finding of usability problems. Presented at: CHI \u201993: Proceedings of the INTERACT \u201993 and CHI \u201993 Conference on Human Factors in Computing Systems; May 1, 1993:206-213; Amsterdam, The Netherlands. [doi: 10.1145\/169059.169166]","DOI":"10.1145\/169059.169166"},{"key":"R36","unstructured":"Nielsen J . Why you only need to test with 5 users. Neilsen Norman Group. 2000. URL: http:\/\/www.nngroup.com\/articles\/why-you-only-need-to-test-with-5-users [Accessed 22-06-2014]"},{"issue":"3","key":"R37","doi-asserted-by":"publisher","DOI":"10.1016\/j.mcpdig.2025.100237","article-title":"Medication adherence technologies: a classification taxonomy based on features","volume":"3","author":"Baby","journal-title":"Mayo Clin Proc Digit Health"},{"key":"R38","unstructured":"Self-medication assessment tool (SMAT). Mount Allison University. URL: https:\/\/mta.ca\/self-medication-assessment-tool-smat [Accessed 20-09-2022]"},{"issue":"3","key":"R39","doi-asserted-by":"publisher","first-page":"225","DOI":"10.4212\/cjhp.v63i3.918","article-title":"Acceptability and face validity of a geriatric self-medication assessment tool","volume":"63","author":"Irvine-Meek","journal-title":"Can J Hosp Pharm"},{"issue":"2","key":"R40","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1080\/09286580600573049","article-title":"Validation of the Daily Living Tasks Dependent on Vision (DLTV) questionnaire in a U.S. population with age-related macular degeneration","volume":"13","author":"Schmier","journal-title":"Ophthalmic Epidemiol"},{"issue":"8","key":"R41","doi-asserted-by":"publisher","first-page":"e25","DOI":"10.2105\/AJPH.2014.302041","article-title":"Self-management: a comprehensive approach to management of chronic conditions","volume":"104","author":"Grady","journal-title":"Am J Public Health"},{"issue":"10","key":"R42","doi-asserted-by":"publisher","first-page":"1239","DOI":"10.1592\/phco.22.15.1239.33473","article-title":"Individualized drug use assessment in the elderly","volume":"22","author":"Raehl","journal-title":"Pharmacotherapy"},{"key":"R43","unstructured":"Hearing tests. Patient. URL: https:\/\/patient.info\/doctor\/hearing-tests-pro [Accessed 20-09-2022]"},{"issue":"3","key":"R44","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1891\/106137407783095757","article-title":"Development and psychometric evaluation of the Self-efficacy for Appropriate Medication Use Scale (SEAMS) in low-literacy patients with chronic disease","volume":"15","author":"Risser","journal-title":"J Nurs Meas"},{"issue":"3","key":"R45","doi-asserted-by":"publisher","DOI":"10.1111\/ijn.12525","article-title":"Depression and medication adherence among older Korean patients with hypertension: mediating role of self-efficacy","volume":"23","author":"Son","journal-title":"Int J Nurs Pract"},{"issue":"1","key":"R46","doi-asserted-by":"publisher","DOI":"10.1186\/s12877-021-02097-x","article-title":"A community-based nurse-led medication self-management intervention in the improvement of medication adherence in older patients with multimorbidity: protocol for a randomised controlled trial","volume":"21","author":"Yang","journal-title":"BMC Geriatr"},{"key":"R47","unstructured":"Creech CL . The \u201cmedication matters... to you!\u201d educational intervention session: a pilot study to improve medication management in community-living older adults [Dissertation]. Texas Woman\u2019s University; 2016. URL: https:\/\/twu-ir.tdl.org\/items\/b3432417-9032-4fff-b0f0-b079885cd276\/full [Accessed 30-06-2026]"},{"issue":"1","key":"R48","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1007\/BF03324483","article-title":"The Martin and Park Environmental Demands (MPED) questionnaire: psychometric properties of a brief instrument to measure self-reported environmental demands","volume":"15","author":"Martin","journal-title":"Aging Clin Exp Res"},{"issue":"1","key":"R49","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1016\/j.jbi.2004.01.003","article-title":"Cognitive and usability engineering methods for the evaluation of clinical information systems","volume":"37","author":"Kushniruk","journal-title":"J Biomed Inform"},{"issue":"2","key":"R50","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1016\/j.ijhcs.2005.06.002","article-title":"Current practice in measuring usability: challenges to usability studies and research","volume":"64","author":"Hornb\u00e6k","journal-title":"Int J Hum Comput Stud"},{"issue":"3","key":"R51","doi-asserted-by":"publisher","first-page":"e142","DOI":"10.1331\/JAPhA.2013.13514","article-title":"Caring for visually impaired patients","volume":"53","author":"Orrico","journal-title":"J Am Pharm Assoc (2003)"},{"key":"R52","doi-asserted-by":"publisher","DOI":"10.1016\/j.rcsop.2024.100467","article-title":"Assistive products in pharmacy practice to optimize medications use for visually impaired patients: focus groups to explore community pharmacists\u2019 opinions and expectations","volume":"15","author":"Merenda","journal-title":"Explor Res Clin Soc Pharm"},{"key":"R53","doi-asserted-by":"publisher","DOI":"10.2196\/43197","article-title":"Understanding older adults\u2019 experiences with technologies for health self-management: interview study","volume":"6","author":"Garcia Reyes","journal-title":"JMIR Aging"},{"issue":"1","key":"R54","doi-asserted-by":"publisher","first-page":"677","DOI":"10.1057\/s41599-025-04947-0","article-title":"Technological self-efficacy, motivation, and contextual factors in advanced EFL e-learning: a mixed-methods study of strategy use and satisfaction","volume":"12","author":"Mekheimer","journal-title":"Humanit Soc Sci Commun"},{"issue":"2","key":"R55","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1037\/0882-7974.21.2.333","article-title":"Factors predicting the use of technology: findings from the Center for Research and Education on Aging and Technology Enhancement (CREATE)","volume":"21","author":"Czaja","journal-title":"Psychol Aging"},{"issue":"1","key":"R56","doi-asserted-by":"publisher","first-page":"4","DOI":"10.3390\/digital5010004","article-title":"Adapting voice assistant technology for older adults: a comprehensive study on usability, learning patterns, and acceptance","volume":"5","author":"Jakob","journal-title":"Digital"}],"container-title":["JMIR Aging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/aging.jmir.org\/2026\/1\/e88398","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T22:24:57Z","timestamp":1785536697000},"score":1,"resource":{"primary":{"URL":"https:\/\/aging.jmir.org\/2026\/1\/e88398"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,13]]},"references-count":56,"URL":"https:\/\/doi.org\/10.2196\/88398","relation":{},"ISSN":["2561-7605"],"issn-type":[{"value":"2561-7605","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,13]]},"article-number":"v9i1e88398"}}