{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T19:08:50Z","timestamp":1782846530191,"version":"3.54.5"},"reference-count":58,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Form Res"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n HIV incidence has continued to increase among men who have sex with men (MSM) in Peru, despite intervention efforts. Addressing stigma, risky behaviors, and low medication adherence is key to reducing incidence rates. Ecological momentary assessment (EMA) allows for collection of discrete, real-time data on stigmatized, risky behaviors while reducing recall bias.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n The aim of this study was to develop and assess the usability of an EMA smartphone app among MSM with HIV in Peru, which tracks daily health risk behaviors to determine ease of use, usefulness, and satisfaction with the app.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n A mixed-method 3-phase study was conducted with 10 MSM with HIV, which included a usability test, 10-day field testing, and a debriefing focus group. Quantitative survey data and user analytics allowed for assessments of acceptability and user compliance. Qualitative interview and focus group data were thematically analyzed for in-depth assessments of user satisfaction.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n Acceptability of the EMA app was high, with a mean usability rating of 6.4 of 7.0 (SD 0.62), indicating high user satisfaction, ease of use, and usefulness. A 10-day field test demonstrated a high average compliance rate of 93% (93\/100), which suggests high feasibility of the app for daily tracking of health risk behaviors among MSM with HIV. Interview and focus group findings indicated that the app was navigable, time-efficient, and holds promise for long-term use, particularly with the inclusion of daily reminders and incentives for prolonged use.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n EMA apps can provide valuable real-time data while protecting users\u2019 privacy. This formative work lays the foundation for future larger-scale EMAs of substance use and sexual risk behaviors among high-risk HIV populations, and for the development of just-in-time interventions to address stigma, improve medication adherence, and reduce risky behaviors.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/85108","type":"journal-article","created":{"date-parts":[[2026,3,2]],"date-time":"2026-03-02T17:15:05Z","timestamp":1772471705000},"page":"e85108-e85108","source":"Crossref","is-referenced-by-count":0,"title":["An Ecological Momentary Assessment Smartphone App for High-Risk HIV Populations: Development and Usability Study"],"prefix":"10.2196","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6021-7736","authenticated-orcid":false,"given":"Archana","family":"Krishnan","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2172-5882","authenticated-orcid":false,"given":"Pallavi","family":"Khurana","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-8516-5389","authenticated-orcid":false,"given":"Alexandra R","family":"Stankus","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2406-4389","authenticated-orcid":false,"given":"Samy J","family":"Galvez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6020-8266","authenticated-orcid":false,"given":"Jorge","family":"Sanchez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7860-693X","authenticated-orcid":false,"given":"Frederick L","family":"Altice","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,5,1]]},"reference":[{"issue":"9839","key":"R1","doi-asserted-by":"publisher","first-page":"367","DOI":"10.1016\/S0140-6736(12)60821-6","article-title":"Global epidemiology of HIV infection in men who have sex with men","volume":"380","author":"Beyrer","journal-title":"Lancet"},{"issue":"12","key":"R2","doi-asserted-by":"publisher","first-page":"1039","DOI":"10.1177\/0956462416645727","article-title":"Peru\u2019s HIV care continuum among men who have sex with men and transgender women: opportunities to optimize treatment and prevention","volume":"27","author":"Chow","journal-title":"Int J STD AIDS"},{"key":"R3","doi-asserted-by":"publisher","DOI":"10.1016\/j.lana.2023.100642","article-title":"Recent HIV infection and annualized HIV incidence rates among sexual and gender minorities in Brazil and Peru (ImPrEP seroincidence study): a cross-sectional, multicenter study","volume":"28","author":"Torres","journal-title":"Lancet Reg Health Am"},{"issue":"5","key":"R4","doi-asserted-by":"publisher","first-page":"578","DOI":"10.1097\/QAI.0b013e318033ff82","article-title":"HIV-1, sexually transmitted infections, and sexual behavior trends among men who have sex with men in Lima, Peru","volume":"44","author":"Sanchez","journal-title":"J Acquir Immune Defic Syndr"},{"issue":"1","key":"R5","doi-asserted-by":"publisher","DOI":"10.1186\/s12889-016-3561-4","article-title":"High HIV prevalence and the internet as a source of HIV-related service information at a community-based organization in Peru: a cross-sectional study of men who have sex with men","volume":"16","author":"Passaro","journal-title":"BMC Public Health"},{"issue":"10","key":"R6","doi-asserted-by":"publisher","first-page":"765","DOI":"10.1016\/S1473-3099(12)70144-5","article-title":"Prevalences of sexually transmitted infections in young adults and female sex workers in Peru: a national population-based survey","volume":"12","author":"C\u00e1rcamo","journal-title":"Lancet Infect Dis"},{"key":"R7","unstructured":"Peru. UNAIDS. 2021. URL: https:\/\/www.unaids.org\/en\/regionscountries\/countries\/peru [Accessed 27-07-2022]"},{"key":"R8","doi-asserted-by":"publisher","DOI":"10.1086\/651481","article-title":"Global prevention of HIV infection for neglected populations: men who have sex with men","volume":"50 Suppl 3","author":"Beyrer","journal-title":"Clin Infect Dis"},{"issue":"10","key":"R9","doi-asserted-by":"publisher","first-page":"1301","DOI":"10.1080\/09540121.2016.1178699","article-title":"HIV testing among social media-using Peruvian men who have sex with men: correlates and social context","volume":"28","author":"Krueger","journal-title":"AIDS Care"},{"issue":"1","key":"R10","doi-asserted-by":"publisher","DOI":"10.1186\/s12889-019-6956-1","article-title":"Homophobia and heteronormativity as dimensions of stigma that influence sexual risk behaviors among men who have sex with men (MSM) and women (MSMW) in Lima, Peru: a mixed-methods analysis","volume":"19","author":"Perez-Brumer","journal-title":"BMC Public Health"},{"issue":"1","key":"R11","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1080\/09540121.2014.963013","article-title":"Alcohol use disorders negatively influence antiretroviral medication adherence among men who have sex with men in Peru","volume":"27","author":"Ferro","journal-title":"AIDS Care"},{"issue":"8","key":"R12","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0069966","article-title":"Screening for drug and alcohol use disorders and their association with HIV-related sexual risk behaviors among men who have sex with men in Peru","volume":"8","author":"Ludford","journal-title":"PLoS ONE"},{"key":"R13","doi-asserted-by":"publisher","DOI":"10.1016\/j.drugalcdep.2016.01.030","article-title":"Impact of alcohol use on sexual behavior among men who have sex with men and transgender women in Lima, Peru","volume":"161","author":"Herrera","journal-title":"Drug Alcohol Depend"},{"issue":"1-2","key":"R14","doi-asserted-by":"publisher","first-page":"134","DOI":"10.1016\/j.drugalcdep.2013.01.011","article-title":"Problem drinking is associated with increased prevalence of sexual risk behaviors among men who have sex with men (MSM) in Lima, Peru","volume":"132","author":"Deiss","journal-title":"Drug Alcohol Depend"},{"issue":"4","key":"R15","first-page":"267","volume":"34","author":"Vagenas","journal-title":"Rev Panam Salud Publica"},{"key":"R16","doi-asserted-by":"publisher","DOI":"10.1097\/01.aids.0000167350.00503.db","article-title":"Illicit substance use, sexual risk, and HIV-positive gay and bisexual men: differences by serostatus of casual partners","volume":"19 Suppl 1","author":"Purcell","journal-title":"AIDS"},{"issue":"6","key":"R17","doi-asserted-by":"publisher","first-page":"926","DOI":"10.2105\/ajph.93.6.926","article-title":"High-risk behaviors among men who have sex with men in 6 US cities: baseline data from the EXPLORE Study","volume":"93","author":"Koblin","journal-title":"Am J Public Health"},{"issue":"4","key":"R18","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1023\/A:1021104930612","article-title":"Does \u201chigh = high risk\u201d? an event-based analysis of the relationship between substance use and unprotected anal sex among gay and bisexual men","volume":"6","author":"Gillmore","journal-title":"AIDS Behav"},{"issue":"3","key":"R19","doi-asserted-by":"publisher","first-page":"500","DOI":"10.15288\/jsad.2013.74.500","article-title":"Measuring alcohol consumption using timeline followback in non-treatment-seeking medical clinic patients with and without HIV infection: 7-, 14-, or 30-day recall","volume":"74","author":"Fiellin","journal-title":"J Stud Alcohol Drugs"},{"issue":"4","key":"R20","doi-asserted-by":"publisher","first-page":"486","DOI":"10.1037\/a0017074","article-title":"Ecological momentary assessment (EMA) in studies of substance use","volume":"21","author":"Shiffman","journal-title":"Psychol Assess"},{"issue":"6","key":"R21","doi-asserted-by":"publisher","first-page":"1394","DOI":"10.1007\/s10461-011-0131-8","article-title":"A review of the literature on event-level substance use and sexual risk behavior among men who have sex with men","volume":"16","author":"Vosburgh","journal-title":"AIDS Behav"},{"key":"R22","doi-asserted-by":"crossref","unstructured":"Stone AA Shiffman S Atienza AA Nebeling L , editors. The Science of Real-Time Data Capture: Self-Reports in Health Research. Oxford Academic; 2007. [doi: 10.1093\/oso\/9780195178715.001.0001] ISBN: 9780195178715","DOI":"10.1093\/oso\/9780195178715.001.0001"},{"issue":"3","key":"R23","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1093\/abm\/16.3.199","article-title":"Ecological momentary assessment (EMA) in behavioral medicine","volume":"16","author":"Stone","journal-title":"Ann Behav Med"},{"issue":"1","key":"R24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1146\/annurev.clinpsy.3.022806.091415","article-title":"Ecological momentary assessment","volume":"4","author":"Shiffman","journal-title":"Annu Rev Clin Psychol"},{"issue":"3","key":"R25","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1016\/S0304-3959(00)00450-4","article-title":"Electronic diaries for monitoring chronic pain: 1-year validation study","volume":"91","author":"Jamison","journal-title":"Pain"},{"issue":"3","key":"R26","doi-asserted-by":"publisher","first-page":"235","DOI":"10.1080\/14622200110050466","article-title":"Temporal analysis of the relationship of smoking behavior and urges to mood states in men versus women","volume":"3","author":"Delfino","journal-title":"Nicotine Tob Res"},{"issue":"11","key":"R27","doi-asserted-by":"publisher","first-page":"1368","DOI":"10.1093\/ntr\/ntp150","article-title":"A method comparison study of timeline followback and ecological momentary assessment of daily cigarette consumption","volume":"11","author":"Griffith","journal-title":"Nicotine Tob Res"},{"issue":"6","key":"R28","doi-asserted-by":"publisher","first-page":"1670","DOI":"10.1037\/\/0022-3514.74.6.1670","article-title":"A comparison of coping assessed by ecological momentary assessment and retrospective recall","volume":"74","author":"Stone","journal-title":"J Pers Soc Psychol"},{"issue":"1","key":"R29","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1037\/\/1064-1297.11.1.73","article-title":"The feasibility of using cellular phones to collect ecological momentary assessment data: application to alcohol consumption","volume":"11","author":"Collins","journal-title":"Exp Clin Psychopharmacol"},{"issue":"12","key":"R30","doi-asserted-by":"publisher","first-page":"2209","DOI":"10.1111\/j.1530-0277.2011.01571.x","article-title":"Promoting behavior change from alcohol use through mobile technology: the future of ecological momentary assessment","volume":"35","author":"Cohn","journal-title":"Alcoholism Clin & Exp Res"},{"issue":"1","key":"R31","doi-asserted-by":"publisher","first-page":"178","DOI":"10.1037\/\/0022-006x.65.1.178","article-title":"Comparison of palmtop-computer-assisted brief cognitive-behavioral treatment to cognitive-behavioral treatment for panic disorder","volume":"65","author":"Newman","journal-title":"J Consult Clin Psychol"},{"key":"R32","doi-asserted-by":"publisher","DOI":"10.1155\/2016\/9510172","article-title":"Feasibility and acceptability of a smartphone app for daily reports of substance use and antiretroviral therapy adherence among HIV-infected adults","volume":"2016","author":"Przybyla","journal-title":"AIDS Res Treat"},{"issue":"2","key":"R33","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.4344","article-title":"Feasibility and acceptability of smartphone-based ecological momentary assessment of alcohol use among African American men who have sex with men in Baltimore","volume":"3","author":"Yang","journal-title":"JMIR Mhealth Uhealth"},{"issue":"3","key":"R34","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1080\/09540121.2014.963014","article-title":"Communication technology use and mHealth acceptance among HIV-infected men who have sex with men in Peru: implications for HIV prevention and treatment","volume":"27","author":"Krishnan","journal-title":"AIDS Care"},{"issue":"2","key":"R35","doi-asserted-by":"publisher","first-page":"368","DOI":"10.1177\/001872089403600215","article-title":"Sample sizes for usability studies: additional considerations","volume":"36","author":"Lewis","journal-title":"Hum Factors"},{"key":"R36","unstructured":"Turner CW . Determining usability test sample size. In: International Encyclopedia of Ergonomics and Human Factors. Vol 3. CRC Press; 2006:3084-3088."},{"key":"R37","unstructured":"Mobile operating system market share Peru. 2024. URL: https:\/\/gs.statcounter.com\/os-market-share\/mobile\/peru [Accessed 22-04-2026]"},{"key":"R38","unstructured":"Alpha testing and beta testing (a complete guide). Software Testing Help. 2022. URL: https:\/\/www.softwaretestinghelp.com\/what-is-alpha-testing-beta-testing\/ [Accessed 22-04-2026]"},{"key":"R39","doi-asserted-by":"crossref","unstructured":"Hai-Jew S . Alpha testing, beta testing, and customized testing. In: Designing Instruction For Open Sharing. Springer; 2019:381-428. [doi: 10.1007\/978-3-030-02713-1_9]","DOI":"10.1007\/978-3-030-02713-1_9"},{"issue":"4","key":"R40","doi-asserted-by":"publisher","DOI":"10.2196\/11500","article-title":"The mHealth App Usability Questionnaire (MAUQ): development and validation study","volume":"7","author":"Zhou","journal-title":"JMIR Mhealth Uhealth"},{"issue":"10","key":"R41","doi-asserted-by":"publisher","DOI":"10.14569\/IJACSA.2021.0121019","article-title":"Expert\u2019s usability evaluation of the pelvic floor muscle training mHealth app for pregnant women","volume":"12","author":"Jaffar","journal-title":"Int J Adv Comput Sci Appl"},{"issue":"2","key":"R42","doi-asserted-by":"publisher","DOI":"10.2196\/19099","article-title":"Usability of mobile health apps for postoperative care: systematic review","volume":"3","author":"Patel","journal-title":"JMIR Perioper Med"},{"issue":"3","key":"R43","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1177\/135910457000100301","article-title":"Back-translation for cross-cultural research","volume":"1","author":"Brislin","journal-title":"J Cross Cult Psychol"},{"issue":"2","key":"R44","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1191\/1478088706qp063oa","article-title":"Using thematic analysis in psychology","volume":"3","author":"Braun","journal-title":"Qual Res Psychol"},{"issue":"3","key":"R45","doi-asserted-by":"publisher","first-page":"324","DOI":"10.4103\/2249-4863.161306","article-title":"Validity, reliability, and generalizability in qualitative research","volume":"4","author":"Leung","journal-title":"J Family Med Prim Care"},{"key":"R46","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2981892","article-title":"Usability of mobile applications: a systematic literature study","volume":"8","author":"Weichbroth","journal-title":"IEEE Access"},{"key":"R47","doi-asserted-by":"crossref","unstructured":"Nayebi F Desharnais JM Abran A . The state of the art of mobile application usability evaluation. Presented at: 2012 25th IEEE Canadian Conference on Electrical and Computer Engineering (CCECE); 1-4; Montreal, QC. 2012.[doi: 10.1109\/CCECE.2012.6334930]","DOI":"10.1109\/CCECE.2012.6334930"},{"key":"R48","doi-asserted-by":"crossref","unstructured":"Parnas DL . On the use of transition diagrams in the design of a user interface for an interactive computer system. In: Proceedings of the 1969 24th National Conference. Association for Computing Machinery; 1969:379-385. [doi: 10.1145\/800195.805945]","DOI":"10.1145\/800195.805945"},{"issue":"1","key":"R49","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/2194-0827-1-1","article-title":"Usability of mobile applications: literature review and rationale for a new usability model","volume":"1","author":"Harrison","journal-title":"J Interact Sci"},{"issue":"8","key":"R50","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.7836","article-title":"Usability testing of the BRANCH smartphone app designed to reduce harmful drinking in young adults","volume":"5","author":"Milward","journal-title":"JMIR Mhealth Uhealth"},{"issue":"2","key":"R51","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10916-014-0182-2","article-title":"Empirical studies on usability of mHealth apps: a systematic literature review","volume":"39","author":"Zapata","journal-title":"J Med Syst"},{"key":"R52","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-015-0197-8","article-title":"User interface design for mobile-based sexual health interventions for young people: design recommendations from a qualitative study on an online chlamydia clinical care pathway","volume":"15","author":"Gkatzidou","journal-title":"BMC Med Inform Decis Mak"},{"issue":"3","key":"R53","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1207\/S15324796ABM2403_09","article-title":"Capturing momentary, self-report data: a proposal for reporting guidelines","volume":"24","author":"Stone","journal-title":"Ann Behav Med"},{"issue":"4","key":"R54","doi-asserted-by":"publisher","first-page":"609","DOI":"10.1111\/add.14503","article-title":"Compliance with ecological momentary assessment protocols in substance users: a meta-analysis","volume":"114","author":"Jones","journal-title":"Addiction"},{"issue":"1","key":"R55","doi-asserted-by":"publisher","first-page":"549","DOI":"10.1146\/annurev.psych.58.110405.085530","article-title":"Missing data analysis: making it work in the real world","volume":"60","author":"Graham","journal-title":"Annu Rev Psychol"},{"issue":"8","key":"R56","doi-asserted-by":"publisher","DOI":"10.2196\/27751","article-title":"Ecological momentary assessment and mHealth interventions among men who have sex with men: scoping review","volume":"23","author":"Clark","journal-title":"J Med Internet Res"},{"issue":"11","key":"R57","doi-asserted-by":"publisher","DOI":"10.2196\/22890","article-title":"Smartphone-delivered ecological momentary interventions based on ecological momentary assessments to promote health behaviors: systematic review and adapted checklist for reporting ecological momentary assessment and intervention studies","volume":"9","author":"Dao","journal-title":"JMIR Mhealth Uhealth"},{"key":"R58","doi-asserted-by":"publisher","DOI":"10.2196\/51689","article-title":"Cross-platform ecological momentary assessment app (JTrack-EMA+): development and usability study","volume":"27","author":"Sahandi Far","journal-title":"J Med Internet Res"}],"container-title":["JMIR Formative Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/formative.jmir.org\/2026\/1\/e85108","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T18:19:12Z","timestamp":1782843552000},"score":1,"resource":{"primary":{"URL":"https:\/\/formative.jmir.org\/2026\/1\/e85108"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,1]]},"references-count":58,"URL":"https:\/\/doi.org\/10.2196\/85108","relation":{},"ISSN":["2561-326X"],"issn-type":[{"value":"2561-326X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,1]]},"article-number":"v10i9839e85108"}}