{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,18]],"date-time":"2026-10-18T02:25:26Z","timestamp":1792290326307,"version":"4.4.0"},"reference-count":37,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Mhealth Uhealth"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Although highly effective HIV pre-exposure prophylaxis (PrEP) is available, its usage and adherence among young men who have sex with men and young transgender women remain low, reducing its overall effectiveness. The study included a 3-arm randomized clinical trial of Prepared, Protected, emPowered (P3), a comprehensive PrEP adherence digital health intervention, compared to an enhanced version, P3+, which incorporates in-app adherence coaching.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aims to analyze data from study participants in the P3\/P3+ intervention arms to understand how different levels of user engagement with the app\u2019s features were associated with adherence to PrEP as well as the costs of each intervention and their relative cost-effectiveness.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n \n Descriptive statistics for study variables at baseline were calculated. To examine the differences in intervention engagement and acceptability by arm, independent samples 2-tailed\n t<\/jats:italic>\n tests for continuous variables and a\n \n chi-square analysis for categorical variables were conducted. To examine the effect of arm and engagement categories on PrEP adherence at 3 months, three logistic regression analyses were conducted: (1) the effect of arm on PrEP adherence, (2) the effect of predefined engagement categories (high vs moderate and low) on PrEP adherence, and (3) the interaction effect of arm and predefined engagement categories on PrEP adherence, along with the main effects of arm and predefined engagement categories. The study team calculated the average cost per participant and the incremental cost-effectiveness for PrEP adherence and engagement measures.\n <\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n A total of 163 participants were randomized to the P3 intervention (82 to the P3 arm and 81 to the P3+ arm). Participants in the P3+ arm earned higher incentives (US $90.6 vs $75.4;\n P<\/jats:italic>\n =.04), had more app log-ins (96.6 vs 76.1;\n P<\/jats:italic>\n =.01), used the app on more days (63.3 d vs 53.2 d;\n P<\/jats:italic>\n =.04), and spent more time in the intervention (378.8 min vs 186.66 min;\n P<\/jats:italic>\n <.001) compared to those in the P3 arm. There was no significant association between intervention arm and PrEP adherence at 3 months (\n P<\/jats:italic>\n =.99). Engagement category (high vs moderate or low) was significantly associated with PrEP adherence at 3 months (\n P<\/jats:italic>\n =.003). The overall average total monthly cost of P3 was US $1118 (SD $305.1). Average total monthly cost per P3 participant was $280 (SD $118.5), with an additional cost for P3+ of $72.\n <\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n This study highlights the critical role of user engagement in enhancing PrEP adherence among young individuals at high risk for HIV. While the P3+ intervention led to increased engagement, this did not translate into significantly better adherence compared to the standard P3 arm. This, coupled with the increased cost and complexity of P3+ delivery, indicates that further studies are necessary to determine whether this intensified intervention is the appropriate fit.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/66837","type":"journal-article","created":{"date-parts":[[2026,1,29]],"date-time":"2026-01-29T17:35:20Z","timestamp":1769708120000},"page":"e66837-e66837","source":"Crossref","is-referenced-by-count":4,"title":["Improving Pre-Exposure Prophylaxis Adherence in People at Risk for HIV: Secondary Analysis of a Digital Health Intervention to Enhance User Engagement"],"prefix":"10.2196","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2421-923X","authenticated-orcid":false,"given":"Lisa","family":"Hightow-Weidman","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0405-7787","authenticated-orcid":false,"given":"Seul-Ki","family":"Choi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0556-9960","authenticated-orcid":false,"given":"Ibrahim","family":"Yigit","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-1312-7325","authenticated-orcid":false,"given":"Crissi","family":"Rainer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8095-3535","authenticated-orcid":false,"given":"Victoria","family":"Phillips","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8522-3240","authenticated-orcid":false,"given":"Kathryn","family":"Muessig","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,3,10]]},"reference":[{"issue":"27","key":"R1","doi-asserted-by":"publisher","first-page":"2587","DOI":"10.1056\/NEJMoa1011205","article-title":"Preexposure chemoprophylaxis for HIV prevention in men who have sex with men","volume":"363","author":"Grant","journal-title":"N Engl J Med"},{"issue":"151","key":"R2","doi-asserted-by":"publisher","DOI":"10.1126\/scitranslmed.3004006","article-title":"Emtricitabine-tenofovir concentrations and pre-exposure prophylaxis efficacy in men who have sex with men","volume":"4","author":"Anderson","journal-title":"Sci Transl Med"},{"issue":"11","key":"R3","doi-asserted-by":"publisher","first-page":"1063","DOI":"10.1001\/jamapediatrics.2017.2007","article-title":"Safety and feasibility of antiretroviral preexposure prophylaxis for adolescent men who have sex with men aged 15 to 17 years in the United States","volume":"171","author":"Hosek","journal-title":"JAMA Pediatr"},{"issue":"7S6","key":"R4","doi-asserted-by":"publisher","DOI":"10.7448\/IAS.19.7.21107","article-title":"Preventing HIV among adolescents with oral PrEP: observations and challenges in the United States and South Africa","volume":"19","author":"Hosek","journal-title":"J Int AIDS Soc"},{"issue":"4","key":"R5","first-page":"399","volume":"29","author":"Cambou","journal-title":"Top Antivir Med"},{"issue":"10","key":"R6","doi-asserted-by":"publisher","first-page":"2654","DOI":"10.1007\/s10461-019-02641-2","article-title":"The PrEP care continuum and Black men who have sex with men: a scoping review of published data on awareness, uptake, adherence, and retention in PrEP care","volume":"23","author":"Ezennia","journal-title":"AIDS Behav"},{"key":"R7","doi-asserted-by":"publisher","DOI":"10.2196\/42799","article-title":"Effectiveness of mHealth on adherence to antiretroviral therapy in patients living with HIV: meta-analysis of randomized controlled trials","volume":"11","author":"Sun","journal-title":"JMIR Mhealth Uhealth"},{"issue":"8","key":"R8","doi-asserted-by":"publisher","DOI":"10.2196\/39094","article-title":"An identity-affirming web application to help sexual and gender minority youth cope with minority stress: pilot randomized controlled trial","volume":"24","author":"Bauermeister","journal-title":"J Med Internet Res"},{"key":"R9","doi-asserted-by":"publisher","DOI":"10.2196\/43727","article-title":"Assessing patient adherence to and engagement with digital interventions for depression in clinical trials: systematic literature review","volume":"25","author":"Forbes","journal-title":"J Med Internet Res"},{"issue":"12","key":"R10","doi-asserted-by":"publisher","DOI":"10.18332\/tpc\/70088","article-title":"Effectiveness of mobile apps for smoking cessation: a review","volume":"3","author":"Regmi","journal-title":"Tob Prev Cessat"},{"issue":"4","key":"R11","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.1430","article-title":"Engagement and retention: measuring breadth and depth of participant use of an online intervention","volume":"12","author":"Couper","journal-title":"J Med Internet Res"},{"issue":"6","key":"R12","doi-asserted-by":"publisher","DOI":"10.2196\/33867","article-title":"Correlates of engagement within an online HIV prevention intervention for single young men who have sex with men: randomized controlled trial","volume":"8","author":"Choi","journal-title":"JMIR Public Health Surveill"},{"issue":"5","key":"R13","doi-asserted-by":"publisher","first-page":"1166","DOI":"10.1007\/s10461-018-2289-9","article-title":"A randomized trial of an online risk reduction intervention for young Black MSM","volume":"23","author":"Hightow-Weidman","journal-title":"AIDS Behav"},{"issue":"8","key":"R14","doi-asserted-by":"publisher","first-page":"2599","DOI":"10.1007\/s10461-021-03222-y","article-title":"Epic allies: a gamified mobile app to improve engagement in HIV care and antiretroviral adherence among young men who have sex with men","volume":"25","author":"Hightow-Weidman","journal-title":"AIDS Behav"},{"key":"R15","doi-asserted-by":"publisher","DOI":"10.2196\/40176","article-title":"Uptake of an app-based case management service for HIV-positive men who have sex with men in China: process evaluation study","volume":"25","author":"Fan","journal-title":"J Med Internet Res"},{"issue":"7","key":"R16","doi-asserted-by":"publisher","DOI":"10.21037\/mhealth.2019.10.01","article-title":"Engagement in mHealth behavioral interventions for HIV prevention and care: making sense of the metrics","volume":"6","author":"Hightow-Weidman","journal-title":"Mhealth"},{"issue":"23","key":"R17","doi-asserted-by":"publisher","DOI":"10.21037\/mhealth-20-48","article-title":"Engaging youth in mHealth: what works and how can we be sure?","volume":"7","author":"Hightow-Weidman","journal-title":"Mhealth"},{"issue":"2","key":"R18","doi-asserted-by":"publisher","DOI":"10.2196\/publichealth.8923","article-title":"A gamified smartphone app to support engagement in care and medication adherence for HIV-positive young men who have sex with men (AllyQuest): development and pilot study","volume":"4","author":"Hightow-Weidman","journal-title":"JMIR Public Health Surveill"},{"issue":"2","key":"R19","doi-asserted-by":"publisher","DOI":"10.2196\/30671","article-title":"The use of gamification and incentives in mobile health apps to improve medication adherence: scoping review","volume":"10","author":"Tran","journal-title":"JMIR Mhealth Uhealth"},{"issue":"3","key":"R20","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0173403","article-title":"Does gamification increase engagement with online programs? A systematic review","volume":"12","author":"Looyestyn","journal-title":"PLoS ONE"},{"key":"R21","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2017.05.011","article-title":"A systematic review of gamification in e-Health","volume":"71","author":"Sardi","journal-title":"J Biomed Inform"},{"issue":"1","key":"R22","doi-asserted-by":"publisher","DOI":"10.2196\/games.3139","article-title":"Gamification: what it is and why it matters to digital health behavior change developers","volume":"1","author":"Cugelman","journal-title":"JMIR Serious Games"},{"issue":"12","key":"R23","doi-asserted-by":"publisher","DOI":"10.2196\/10448","article-title":"Testing the efficacy of a social networking gamification app to improve pre-exposure prophylaxis adherence (P3: Prepared, Protected, emPowered): protocol for a randomized controlled trial","volume":"7","author":"LeGrand","journal-title":"JMIR Res Protoc"},{"issue":"6","key":"R24","doi-asserted-by":"publisher","first-page":"689","DOI":"10.1177\/1740774512453520","article-title":"Novel incentive-based approaches to adherence","volume":"9","author":"Kimmel","journal-title":"Clin Trials"},{"issue":"5","key":"R25","doi-asserted-by":"publisher","first-page":"314","DOI":"10.4278\/ajhp.140714-LIT-333","article-title":"The role of behavioral economic incentive design and demographic characteristics in financial incentive-based approaches to changing health behaviors: a meta-analysis","volume":"29","author":"Haff","journal-title":"Am J Health Promot"},{"issue":"1","key":"R26","doi-asserted-by":"publisher","DOI":"10.1186\/s12889-019-7407-8","article-title":"Changing health behaviors using financial incentives: a review from behavioral economics","volume":"19","author":"Vlaev","journal-title":"BMC Public Health"},{"issue":"7","key":"R27","doi-asserted-by":"publisher","first-page":"1812","DOI":"10.1007\/s10461-018-2291-2","article-title":"Integrated next step counseling (iNSC) for sexual health and PrEP use among young men who have sex with men: implementation and observations from ATN110\/113","volume":"23","author":"Amico","journal-title":"AIDS Behav"},{"issue":"721","key":"R28","doi-asserted-by":"publisher","DOI":"10.3389\/fphar.2019.00721","article-title":"Comparing self-report pre-exposure prophylaxis adherence questions to pharmacologic measures of recent and cumulative pre-exposure prophylaxis exposure","volume":"10","author":"Blumenthal","journal-title":"Front Pharmacol"},{"issue":"4","key":"R29","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1007\/s11904-021-00560-3","article-title":"The value of assessing self-reported and biological indicators of outcomes in evaluating HIV programs","volume":"18","author":"Zimmerman","journal-title":"Curr HIV\/AIDS Rep"},{"issue":"6","key":"R30","doi-asserted-by":"publisher","first-page":"998","DOI":"10.1002\/ejsp.674","article-title":"How are habits formed: Modelling habit formation in the real world","volume":"40","author":"Lally","journal-title":"Euro J Social Psych"},{"issue":"6","key":"R31","doi-asserted-by":"publisher","first-page":"2031","DOI":"10.1007\/s10461-013-0469-1","article-title":"Feasibility, acceptability and preliminary efficacy of an online peer-to-peer social support ART adherence intervention","volume":"17","author":"Horvath","journal-title":"AIDS Behav"},{"issue":"1","key":"R32","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1111\/dar.12522","article-title":"The Client Satisfaction Questionnaire-8: Psychometric properties in a cross-sectional survey of people attending residential substance abuse treatment","volume":"37","author":"Kelly","journal-title":"Drug Alcohol Rev"},{"key":"R33","unstructured":"Drummond MF Sculpher MJ Torrance GW O\u2019Brien BJ Stoddart GL . Methods for the Economic Evaluation of Health Care Programmes. Oxford University Press; 2002. ISBN: 978-0-19-852944-6"},{"issue":"42","key":"R34","doi-asserted-by":"publisher","DOI":"10.1097\/MD.0000000000035614","article-title":"A review of cost-effectiveness analysis: from theory to clinical practice","volume":"102","author":"Brand\u00e3o","journal-title":"Medicine (Baltimore)"},{"issue":"6","key":"R35","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1007\/s11904-023-00679-5","article-title":"Paradata: measuring engagement in digital HIV interventions for sexual and gender minorities","volume":"20","author":"Choi","journal-title":"Curr HIV\/AIDS Rep"},{"issue":"12","key":"R36","doi-asserted-by":"publisher","DOI":"10.2196\/30000","article-title":"Understanding engagement strategies in digital interventions for mental health promotion: scoping review","volume":"8","author":"Saleem","journal-title":"JMIR Ment Health"},{"issue":"6","key":"R37","doi-asserted-by":"publisher","first-page":"446","DOI":"10.1007\/s12160-016-9830-8","article-title":"Just-in-time adaptive interventions (JITAIs) in mobile health: key components and design principles for ongoing health behavior support","volume":"52","author":"Nahum-Shani","journal-title":"Ann Behav Med"}],"container-title":["JMIR mHealth and uHealth"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/mhealth.jmir.org\/2026\/1\/e66837","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T22:28:24Z","timestamp":1785536904000},"score":1,"resource":{"primary":{"URL":"https:\/\/mhealth.jmir.org\/2026\/1\/e66837"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,10]]},"references-count":37,"URL":"https:\/\/doi.org\/10.2196\/66837","relation":{},"ISSN":["2291-5222"],"issn-type":[{"value":"2291-5222","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,10]]},"article-number":"v14i27e66837"}}