{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T17:20:22Z","timestamp":1790875222956,"version":"4.1.0"},"reference-count":33,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Med Internet Res"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Mobile health (mHealth) interventions can be effective for people living with HIV, who are sensitive to privacy breach risks. Understanding the perceived experiences of intervention participants can provide comprehensive insights into potential users and predict intervention effectiveness. Thus, it is necessary to plan engagement measurement and consider ways to enhance engagement during the app development phase.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aims to evaluate engagement with a mHealth app using the engagement index and time and to examine differences in engagement according to participant characteristics.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n This observational study, conducted from March 27 to August 31, 2024, was based on an engagement evaluation framework. A total of 261 people living with HIV across 13 medical institutions and 3 related organizations in South Korea engaged in an app-based intervention for 4 weeks. Self-reported surveys were conducted before and after the app usage period, and usage data were collected during the intervention to assess user engagement. User engagement was evaluated using 2 measures: engagement index and engagement time. The engagement index represents a standardized percentage derived from 5 subindices: click depth, loyalty, recency, feedback, and interaction.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n The median engagement index and time were 67.6% (IQR 59.7\u201074.1) and 27.2 minutes (IQR 4.9\u201081.4), respectively, with a statistically significant positive correlation between the two (\n \n \n \n \u03c1<\/mml:mi>\n <\/mml:math>\n <\/jats:inline-formula>\n <\/jats:italic>\n =0.589;\n P<\/jats:italic>\n <.001). The engagement index was higher among those with self-help group participation (\n U<\/jats:italic>\n =6014.0,\n z<\/jats:italic>\n =\u22122.49;\n P<\/jats:italic>\n =.01). There were no differences in engagement index and time according to other personal characteristics.\n <\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n When developing mHealth apps for people living with HIV, it is essential to track both objective indicators such as login data and subjective indicators such as patient experience for comprehensive intervention evaluation. Based on this study\u2019s results, high engagement suggests that apps should prioritize user needs through rewards, privacy protection, tailored information, and esthetic features. While the app in this study demonstrated inclusive usability, targeted support strategies may benefit users without self-help group participation.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/78810","type":"journal-article","created":{"date-parts":[[2025,7,15]],"date-time":"2025-07-15T09:55:08Z","timestamp":1752573308000},"page":"e78810-e78810","source":"Crossref","is-referenced-by-count":3,"title":["User Engagement With a Mobile Health App for People Living With HIV: Observational Study Based on an Engagement Evaluation Framework"],"prefix":"10.2196","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9823-6107","authenticated-orcid":false,"given":"Gwang Suk","family":"Kim","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0556-9936","authenticated-orcid":false,"given":"Seoyoung","family":"Baek","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6772-5979","authenticated-orcid":false,"given":"Layoung","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5544-4456","authenticated-orcid":false,"given":"Sooyoung","family":"Kwon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2025,9,9]]},"reference":[{"issue":"4","key":"R1","doi-asserted-by":"publisher","first-page":"504","DOI":"10.1111\/inr.12685","article-title":"Best of both worlds: digital health and nursing together for healthier communities","volume":"68","author":"Troncoso","journal-title":"Int Nurs Rev"},{"issue":"1","key":"R2","doi-asserted-by":"publisher","DOI":"10.1186\/s12981-024-00653-0","article-title":"Brief communication: effect of mobile health intervention on medication time adherence among people living with HIV\/AIDS receiving care at selected hospitals in Owerri, Imo State Nigeria","volume":"21","author":"Ezelote","journal-title":"AIDS Res Ther"},{"issue":"1","key":"R3","doi-asserted-by":"publisher","first-page":"24","DOI":"10.24875\/AIDSRev.21000025","article-title":"Mobile applications in HIV self-management: a systematic review of scientific literature","volume":"24","author":"Mehraeen","journal-title":"AIDS Rev"},{"issue":"6","key":"R4","doi-asserted-by":"publisher","first-page":"100937","DOI":"10.1016\/j.hlpt.2024.100937","article-title":"Evaluating mobile health interventions for HIV patients in Nigeria: healthcare policy implications from a simulation study","volume":"13","author":"Demir","journal-title":"Health Policy Technol"},{"issue":"9","key":"R5","doi-asserted-by":"publisher","first-page":"2306","DOI":"10.1016\/j.jstrokecerebrovasdis.2018.05.013","article-title":"Tele-rehabilitation after stroke: an updated systematic review of the Literature","volume":"27","author":"Sarfo","journal-title":"J Stroke Cerebrovasc Dis"},{"issue":"2","key":"R6","doi-asserted-by":"publisher","first-page":"254","DOI":"10.1007\/s13142-016-0453-1","article-title":"Conceptualising engagement with digital behaviour change interventions: a systematic review using principles from critical interpretive synthesis","volume":"7","author":"Perski","journal-title":"Transl Behav Med"},{"issue":"3","key":"R7","doi-asserted-by":"publisher","DOI":"10.3389\/fdgth.2021.764079","article-title":"Effect of engagement with digital interventions on mental health outcomes: a systematic review and meta-analysis","volume":"3","author":"Gan","journal-title":"Front Digit Health"},{"issue":"1","key":"R8","doi-asserted-by":"publisher","DOI":"10.2196\/25586","article-title":"Dose-response effects of patient engagement on health outcomes in an mHealth intervention: secondary analysis of a randomized controlled trial","volume":"10","author":"Li","journal-title":"JMIR Mhealth Uhealth"},{"issue":"26","key":"R9","doi-asserted-by":"publisher","DOI":"10.2196\/50508","article-title":"User engagement with mHealth interventions to promote treatment adherence and self-management in people with chronic health conditions: systematic review","volume":"26","author":"Eaton","journal-title":"J Med Internet Res"},{"issue":"4","key":"R10","doi-asserted-by":"publisher","first-page":"432","DOI":"10.1089\/tmj.2020.0098","article-title":"A specific mobile health application for older HIV-infected patients: usability and patient\u2019s Satisfaction","volume":"27","author":"Puig","journal-title":"Telemed J E Health"},{"issue":"32","key":"R11","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1016\/j.chb.2013.12.001","article-title":"Measuring engagement in video game-based environments: investigation of the User Engagement Scale","volume":"32","author":"Wiebe","journal-title":"Comput Human Behav"},{"key":"R12","unstructured":"Peterson ET Carrabis J . Measuring the immeasurable: visitor engagement. Web Analytics Demystified; 2008. URL: https:\/\/f.hubspotusercontent40.net\/hub\/74398\/file-15425996.pdf\/web_analytics_demystified_and_nextstage_global_-_measuring_the_immeasurable_-_visitor_engagement.pdf [Accessed 05-08-2025]"},{"issue":"10","key":"R13","doi-asserted-by":"publisher","DOI":"10.2196\/39204","article-title":"Digital mental health interventions for depression: scoping review of user engagement","volume":"24","author":"Lipschitz","journal-title":"J Med Internet Res"},{"issue":"10","key":"R14","doi-asserted-by":"publisher","DOI":"10.1177\/20552076241249294","article-title":"Three cycles of mobile app design to improve HIV self-management: a development and evaluation study","volume":"10","author":"Kim","journal-title":"Digit Health"},{"issue":"13","key":"R15","doi-asserted-by":"publisher","DOI":"10.2196\/60905","article-title":"Providing 2 types of mHealth interventions to support self-management among people living with HIV: randomized clinical trial","volume":"13","author":"Kim","journal-title":"JMIR Mhealth Uhealth"},{"issue":"1","key":"R16","doi-asserted-by":"publisher","DOI":"10.2196\/28621","article-title":"Validity and reliability of the Korean version of the Health Information Technology Usability Evaluation Scale: psychometric evaluation","volume":"10","author":"Lee","journal-title":"JMIR Med Inform"},{"issue":"4","key":"R17","doi-asserted-by":"publisher","DOI":"10.2196\/16140","article-title":"Adoption and attitudes of eHealth among people living with HIV and their physicians: online multicenter questionnaire study","volume":"8","author":"Jacomet","journal-title":"JMIR Mhealth Uhealth"},{"issue":"6","key":"R18","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.9487","article-title":"Testing a smartphone app (young with diabetes) to improve self-management of diabetes over 12 months: randomized controlled trial","volume":"6","author":"Castens\u00f8e-Seidenfaden","journal-title":"JMIR Mhealth Uhealth"},{"issue":"10","key":"R19","doi-asserted-by":"publisher","first-page":"4135","DOI":"10.1111\/jan.16137","article-title":"Network visualization to interpret which healthcare services are central to people living with HIV","volume":"80","author":"Kim","journal-title":"J Adv Nurs"},{"issue":"4","key":"R20","doi-asserted-by":"publisher","DOI":"10.2196\/35120","article-title":"Challenges in participant engagement and retention using mobile health apps: literature review","volume":"24","author":"Amagai","journal-title":"J Med Internet Res"},{"issue":"11","key":"R21","doi-asserted-by":"publisher","first-page":"119","DOI":"10.2174\/1874613601711010119","article-title":"mHealth interventions to support self-management in HIV: a systematic review","volume":"11","author":"Cooper","journal-title":"Open AIDS J"},{"issue":"10","key":"R22","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.9856","article-title":"Development of an mHealth platform for HIV care: gathering user perspectives through co-design workshops and interviews","volume":"6","author":"Marent","journal-title":"JMIR Mhealth Uhealth"},{"issue":"6","key":"R23","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.7236","article-title":"Assessing user engagement of an mHealth intervention: development and implementation of the growing healthy app engagement index","volume":"5","author":"Taki","journal-title":"JMIR Mhealth Uhealth"},{"issue":"9","key":"R24","doi-asserted-by":"publisher","first-page":"35565015","DOI":"10.3390\/ijerph19095626","article-title":"Measuring user engagement with a socially connected, gamified health promotion mobile App","volume":"19","author":"White","journal-title":"Int J Environ Res Public Health"},{"issue":"146","key":"R25","doi-asserted-by":"publisher","DOI":"10.1016\/j.worlddev.2021.105575","article-title":"Self-help groups as platforms for development: the role of social capital","volume":"146","author":"Nichols","journal-title":"World Dev"},{"issue":"4","key":"R26","doi-asserted-by":"publisher","first-page":"1154","DOI":"10.1111\/jan.15178","article-title":"Effectiveness of a nurse-led smartphone-based self-management programme for people with poorly controlled type 2 diabetes: a randomized controlled trial","volume":"78","author":"Jiang","journal-title":"J Adv Nurs"},{"key":"R27","doi-asserted-by":"publisher","DOI":"10.1111\/jocn.17802","article-title":"Patient engagement in mobile technology\u2010based rehabilitation for arthroplasty: a scoping review","author":"Wang","journal-title":"J Clin Nurs"},{"issue":"11","key":"R28","doi-asserted-by":"publisher","DOI":"10.2196\/14645","article-title":"User engagement and attrition in an app-based physical activity intervention: secondary analysis of a randomized controlled trial","volume":"21","author":"Edney","journal-title":"J Med Internet Res"},{"issue":"10","key":"R29","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyt.2019.00568","article-title":"Designing and using digital mental health interventions for older adults: being aware of digital inequality","volume":"10","author":"Seifert","journal-title":"Front Psychiatry"},{"key":"R30","unstructured":"Millennials vs Gen Z: why marketers need to know the difference. HubSpot. 2024. URL: https:\/\/blog.hubspot.com\/marketing\/millennials-vs-gen-z [Accessed 05-08-2025]"},{"issue":"10","key":"R31","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2022.906089","article-title":"Research progress on digital health literacy of older adults: a scoping review","volume":"10","author":"Wang","journal-title":"Front Public Health"},{"issue":"1","key":"R32","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-022-01761-5","article-title":"E-health literacy in older adults: an evolutionary concept analysis","volume":"22","author":"Jung","journal-title":"BMC Med Inform Decis Mak"},{"key":"R33","unstructured":"Marikyan D Papagiannidis S . Technology acceptance model: a review. TheoryHub Book. 2025. URL: https:\/\/open.ncl.ac.uk [Accessed 05-08-2025]"}],"container-title":["Journal of Medical Internet Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jmir.org\/2025\/1\/e78810","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T18:11:34Z","timestamp":1782843094000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jmir.org\/2025\/1\/e78810"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,9]]},"references-count":33,"URL":"https:\/\/doi.org\/10.2196\/78810","relation":{},"ISSN":["1438-8871"],"issn-type":[{"value":"1438-8871","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,9]]},"article-number":"v27i4e78810"}}