{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,15]],"date-time":"2026-10-15T15:28:14Z","timestamp":1792078094234,"version":"4.4.0"},"reference-count":53,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Form Res"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Latino\/a\/x adults have higher rates of unmet mental health needs than other racial and ethnic groups. One promising solution to help bridge this gap in care is digital mental health tools. Digital tools, such as self-help websites, have demonstrated the ability to enhance mental health literacy, reduce stigma, and improve mental health symptoms. Despite the potential benefits, engagement remains a critical challenge, and there has been a large oversight of unique considerations for Latino\/a\/x adults as end users.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n Guided by the Technology Acceptance Model and the Behavioral Model for Vulnerable Populations, the study\u2019s overarching objective is to characterize within-group variation of Latino\/a\/x adults\u2019 engagement with a government-funded, prevention-focused mental health website that was co-designed with community partners during the COVID-19 pandemic.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n The Together for Wellness\/Juntos Por Nuestro Bienestar (T4W\/Juntos) website offered free digital mental health resources to help Californians cope with the COVID-19 pandemic. A pilot evaluation of the website involved baseline and 4-week follow-up surveys about demographics, behavioral health needs, and overall website user experience. This current subanalysis focused on a stratified sample of Latino\/a\/x adult participants (baseline N=131; baseline and follow-up n=68). The baseline sample was mostly female (106\/130, 81.5%); 66.9% (87\/130) preferred to use the website in English and 30% (39\/130) preferred Spanish. Behavioral health needs were assessed using the Patient Health Questionnaire-2, Generalized Anxiety Disorder 2-item scale, and a COVID-19 stressors checklist. We measured usability, comfort using the website, relevance of the website, and past-month use of resources. Data were analyzed using ordered and standard logistic regression methods.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n Latino\/a\/x adults who preferred using the website in English (odds ratio [OR] 13.76,\n P<\/jats:italic>\n <.001) compared with Spanish were more comfortable using the website. Compared with adults aged 18\u201030 years, adults aged 41\u201050 years had significantly lower odds of agreeing that the website was easy to use. Sensitivity analyses revealed that participants who found the website easier to use (OR 2.22,\n P<\/jats:italic>\n =.001) and those with greater behavioral health needs (OR 1.22,\n P<\/jats:italic>\n =.045) were more likely to perceive the website\u2019s topics as relevant. Participants with higher behavioral health needs at baseline were more likely to use the website and engage with resources for anxiety or stress at follow-up (OR 1.42,\n P<\/jats:italic>\n =.047).\n <\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n This study addresses gaps in understanding Latino\/a\/x adults\u2019 experiences with a prevention-focused mental health website. The language-based disparity in comfort highlights the need to significantly improve the user experience for Latino\/a\/x Spanish speakers. Still, the website can be a helpful resource for Latino\/a\/x adults with high behavioral health needs, bridging a critical gap in support. A collaborative approach to developing resource-rich websites with trusted community organizations is vital for effectively reaching Latino\/a\/x communities and tailoring resources to address their unique needs.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/72952","type":"journal-article","created":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T18:53:10Z","timestamp":1781117590000},"page":"e72952-e72952","source":"Crossref","is-referenced-by-count":1,"title":["Usability, Relevance, and User Engagement of a Government-Sponsored and Community Co-Designed Digital Mental Health Website During the COVID-19 Pandemic: A Pilot Study on Latino\/a\/x Adults"],"prefix":"10.2196","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7875-4983","authenticated-orcid":false,"given":"Blanche","family":"Wright","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6251-6913","authenticated-orcid":false,"given":"Lily","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8132-9099","authenticated-orcid":false,"given":"Jocelyn I","family":"Meza","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5460-2475","authenticated-orcid":false,"given":"Lupita","family":"Rodriguez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-3752-3291","authenticated-orcid":false,"given":"Irisela","family":"Contreras","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-6190-529X","authenticated-orcid":false,"given":"Vanessa","family":"Ter\u00e1n","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9367-9213","authenticated-orcid":false,"given":"Alexander S","family":"Young","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2089-7276","authenticated-orcid":false,"given":"Miriam","family":"Nu\u00f1o","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6004-8581","authenticated-orcid":false,"given":"Tiffany","family":"Dzou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5058-4575","authenticated-orcid":false,"given":"Sergio","family":"Aguilar-Gaxiola","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7454-6589","authenticated-orcid":false,"given":"Kenneth B","family":"Wells","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,6,10]]},"reference":[{"issue":"2","key":"R1","doi-asserted-by":"publisher","first-page":"961","DOI":"10.1007\/s40615-022-01284-9","article-title":"Racial and ethnic disparities in mental health and mental health care during the COVID-19 pandemic","volume":"10","author":"Thomeer","journal-title":"J Racial Ethn Health Disparities"},{"issue":"6","key":"R2","doi-asserted-by":"publisher","first-page":"578","DOI":"10.1176\/appi.ps.201400248","article-title":"Insurance status, use of mental health services, and unmet need for mental health care in the United States","volume":"66","author":"Walker","journal-title":"Psychiatr Serv"},{"issue":"1","key":"R3","doi-asserted-by":"publisher","first-page":"36","DOI":"10.32398\/cjhp.v15i1.1887","article-title":"Who gets needed mental health care? Use of mental health services among adults with mental health need in California","volume":"15","author":"Tran","journal-title":"Calif J Health Promot"},{"issue":"1","key":"R4","doi-asserted-by":"publisher","first-page":"104","DOI":"10.1016\/j.jpsychires.2010.04.031","article-title":"Limited English proficiency as a barrier to mental health service use: a study of Latino and Asian immigrants with psychiatric disorders","volume":"45","author":"Kim","journal-title":"J Psychiatr Res"},{"key":"R5","unstructured":"Lin L Stamm K Conroy J Assefa M . Survey of health service psychologists. American Psychological Association; 2021. URL: https:\/\/www.apa.org\/workforce\/publications\/health-service-psychologists-survey\/full-technical-report.pdf [Accessed 24-11-2024]"},{"issue":"5","key":"R6","doi-asserted-by":"publisher","first-page":"162","DOI":"10.15585\/mmwr.mm7005a3","article-title":"Racial and ethnic disparities in the prevalence of stress and worry, mental health conditions, and increased substance use among adults during the COVID-19 pandemic\u2014United States, April and May 2020","volume":"70","author":"McKnight-Eily","journal-title":"MMWR Morb Mortal Wkly Rep"},{"key":"R7","doi-asserted-by":"publisher","DOI":"10.1016\/j.cpr.2021.102006","article-title":"Addressing the mental health impact of COVID-19 through population health","volume":"85","author":"Boden","journal-title":"Clin Psychol Rev"},{"issue":"2","key":"R8","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1038\/s44159-021-00003-1","article-title":"An overview of and recommendations for more accessible digital mental health services","volume":"1","author":"Lattie","journal-title":"Nat Rev Psychol"},{"issue":"6","key":"R9","doi-asserted-by":"publisher","first-page":"1024","DOI":"10.1111\/eip.12695","article-title":"Effectiveness of information and communication technologies interventions to increase mental health literacy: a systematic review","volume":"12","author":"Tay","journal-title":"Early Interv Psychiatry"},{"issue":"3","key":"R10","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1007\/s40501-019-00181-z","article-title":"Use of digital mental health for marginalized and underserved populations","volume":"6","author":"Schueller","journal-title":"Curr Treat Options Psych"},{"issue":"6","key":"R11","doi-asserted-by":"publisher","first-page":"448","DOI":"10.1197\/jamia.M1535","article-title":"Bridging the digital divide: reaching vulnerable populations","volume":"11","author":"Chang","journal-title":"J Am Med Inform Assoc"},{"key":"R12","unstructured":"Demographics of mobile device ownership and adoption in the United States: mobile fact sheet. Pew Research Center. 2024. URL: https:\/\/www.pewresearch.org\/internet\/fact-sheet\/mobile\/ [Accessed 17-05-2026]"},{"issue":"8","key":"R13","doi-asserted-by":"publisher","first-page":"1595","DOI":"10.1016\/j.pec.2020.02.030","article-title":"Literacy skills, language use, and online health information seeking among Hispanic adults in the United States","volume":"103","author":"Millar","journal-title":"Patient Educ Couns"},{"issue":"1","key":"R14","doi-asserted-by":"publisher","first-page":"88","DOI":"10.1007\/s10615-016-0589-y","article-title":"Enhancing parenting practices with Latino\/a immigrants: integrating evidence-based knowledge and culture according to the voices of Latino\/a parents","volume":"45","author":"Parra-Cardona","journal-title":"Clin Soc Work J"},{"issue":"9","key":"R15","doi-asserted-by":"publisher","DOI":"10.2196\/14567","article-title":"Objective user engagement with mental health apps: systematic search and panel-based usage analysis","volume":"21","author":"Baumel","journal-title":"J Med Internet Res"},{"issue":"12","key":"R16","doi-asserted-by":"publisher","DOI":"10.2196\/42031","article-title":"Engagement, use, and impact of digital mental health resources for diverse populations in COVID-19: community-partnered evaluation","volume":"6","author":"Wells","journal-title":"JMIR Form Res"},{"issue":"12","key":"R17","doi-asserted-by":"publisher","DOI":"10.2196\/23776","article-title":"Ethics of digital mental health during COVID-19: crisis and opportunities","volume":"7","author":"Martinez-Martin","journal-title":"JMIR Ment Health"},{"key":"R18","unstructured":"World Health Organization. Classification of Digital Interventions, Services and Applications in Health: A Shared Language to Describe the Uses of Digital Technology for Health. World Health Organization; 2023. ISBN: 9789240081949"},{"issue":"4","key":"R19","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1001\/jama.297.4.407","article-title":"Strategies for academic and clinician engagement in community-participatory partnered research","volume":"297","author":"Jones","journal-title":"JAMA"},{"issue":"1","key":"R20","doi-asserted-by":"publisher","first-page":"506","DOI":"10.1353\/hpu.2022.0039","article-title":"Community-partnered development of a digital mental health resource website to support diverse communities during the COVID-19 pandemic","volume":"33","author":"Goodsmith","journal-title":"J Health Care Poor Underserved"},{"issue":"3","key":"R21","doi-asserted-by":"publisher","first-page":"319","DOI":"10.2307\/249008","article-title":"Perceived usefulness, perceived ease of use, and user acceptance of information technology","volume":"13","author":"Davis","journal-title":"MIS Q"},{"issue":"3","key":"R22","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1016\/S0378-7206(01)00143-4","article-title":"Why do people use information technology? A critical review of the technology acceptance model","volume":"40","author":"Legris","journal-title":"Information & Management"},{"issue":"1","key":"R23","doi-asserted-by":"publisher","first-page":"21","DOI":"10.9790\/0050-0112133","article-title":"Technology acceptance model for mobile health systems","volume":"1","author":"El-Wajeeh","journal-title":"IOSR J Mobile Comput Appl"},{"key":"R24","doi-asserted-by":"crossref","unstructured":"\u00d6zcan H . Analyzing correlations between refined comfort score, usability, and performance in assistive technology. Presented at: 2025 7th International Congress on Human-Computer Interaction, Optimization and Robotic Applications (ICHORA); May 23-24, 2025:1-6; Ankara, Turkey. [doi: 10.1109\/ICHORA65333.2025.11016995]","DOI":"10.1109\/ICHORA65333.2025.11016995"},{"issue":"6","key":"R25","first-page":"1273","volume":"34","author":"Gelberg","journal-title":"Health Serv Res"},{"issue":"3","key":"R26","doi-asserted-by":"publisher","DOI":"10.2196\/24387","article-title":"Barriers to and facilitators of user engagement with digital mental health interventions: systematic review","volume":"23","author":"Borghouts","journal-title":"J Med Internet Res"},{"issue":"4","key":"R27","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1007\/s40501-023-00298-2","article-title":"Moving evidence-based mental health interventions into practice: implementation of digital mental health interventions","volume":"10","author":"Liu","journal-title":"Curr Treat Options Psych"},{"key":"R28","doi-asserted-by":"publisher","DOI":"10.2196\/55517","article-title":"Community members\u2019 perceptions of a resource-rich well-being website in California during the COVID-19 pandemic: qualitative thematic analysis","volume":"8","author":"Heilemann","journal-title":"JMIR Form Res"},{"issue":"7","key":"R29","doi-asserted-by":"publisher","first-page":"2017","DOI":"10.1007\/s10461-020-02862-w","article-title":"Understanding the impact of COVID-19 on Latino sexual minority men in a US HIV hot spot","volume":"24","author":"Harkness","journal-title":"AIDS Behav"},{"issue":"11","key":"R30","doi-asserted-by":"publisher","first-page":"1284","DOI":"10.1097\/01.MLR.0000093487.78664.3C","article-title":"The Patient Health Questionnaire-2: validity of a two-item depression screener","volume":"41","author":"Kroenke","journal-title":"Med Care"},{"issue":"5","key":"R31","doi-asserted-by":"publisher","first-page":"317","DOI":"10.7326\/0003-4819-146-5-200703060-00004","article-title":"Anxiety disorders in primary care: prevalence, impairment, comorbidity, and detection","volume":"146","author":"Kroenke","journal-title":"Ann Intern Med"},{"issue":"5","key":"R32","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1097\/CIN.0000000000000142","article-title":"Predicting nurses\u2019 use of healthcare technology using the technology acceptance model: an integrative review","volume":"33","author":"Strudwick","journal-title":"Comput Inform Nurs"},{"issue":"2","key":"R33","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1080\/10447318.2012.681221","article-title":"Usability ratings for everyday products measured with the System Usability Scale","volume":"29","author":"Kortum","journal-title":"Int J Hum Comput Interact"},{"issue":"2","key":"R34","doi-asserted-by":"publisher","first-page":"186","DOI":"10.1287\/mnsc.46.2.186.11926","article-title":"A theoretical extension of the technology acceptance model: four longitudinal field studies","volume":"46","author":"Venkatesh","journal-title":"Manage Sci"},{"issue":"3","key":"R35","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1080\/10864415.2003.11044275","article-title":"Consumer acceptance of electronic commerce: integrating trust and risk with the technology acceptance model","volume":"7","author":"Pavlou","journal-title":"International Journal of Electronic Commerce"},{"issue":"10","key":"R36","doi-asserted-by":"publisher","first-page":"1268","DOI":"10.1007\/s11606-013-2484-3","article-title":"Community-partnered cluster-randomized comparative effectiveness trial of community engagement and planning or resources for services to address depression disparities","volume":"28","author":"Wells","journal-title":"J Gen Intern Med"},{"issue":"Suppl 2","key":"R37","doi-asserted-by":"publisher","first-page":"493","DOI":"10.18865\/ed.28.S2.493","article-title":"Participatory technology development to enhance community resilience","volume":"28","author":"Arevian","journal-title":"Ethn Dis"},{"issue":"1","key":"R38","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1027\/1015-5759\/a000699","article-title":"Single item measures in psychological science","volume":"38","author":"Allen","journal-title":"Eur J Psychol Assess"},{"key":"R39","unstructured":"Stata Statistical Software: release 15. StataCorp LLC; 2017."},{"issue":"2","key":"R40","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1080\/01973533.2016.1277529","article-title":"Extracting the Variance inflation factor and other multicollinearity diagnostics from typical regression results","volume":"39","author":"Thompson","journal-title":"Basic Appl Soc Psych"},{"issue":"1","key":"R41","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1080\/00098655.2017.1342434","article-title":"#Class Again? How education faculty engage the disengaged college student","volume":"91","author":"Dassa","journal-title":"Clearing House J Educ Strateg Issues Ideas"},{"key":"R42","unstructured":"Moslimani M Passel J . What the data says about immigrants in the US. Pew Research Center; 2024."},{"issue":"9","key":"R43","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2023-076193","article-title":"Sensitivity and specificity of the Patient Health Questionnaire (PHQ-9, PHQ-8, PHQ-2) and General Anxiety Disorder scale (GAD-7, GAD-2) for depression and anxiety diagnosis: a cross-sectional study in a Peruvian hospital population","volume":"13","author":"Villarreal-Zegarra","journal-title":"BMJ Open"},{"issue":"1","key":"R44","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1016\/S1567-4223(03)00005-X","article-title":"The role of cultural context in multilingual website usability","volume":"2","author":"Hillier","journal-title":"Electron Commer Res Appl"},{"issue":"1","key":"R45","first-page":"10","volume":"9","author":"Resnicow","journal-title":"Ethn Dis"},{"issue":"3","key":"R46","doi-asserted-by":"publisher","first-page":"891","DOI":"10.1007\/s10826-015-0259-7","article-title":"The impact of Latino caregiver acculturation on treatment engagement in children\u2019s community mental health services","volume":"25","author":"Kim","journal-title":"J Child Fam Stud"},{"issue":"1","key":"R47","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1177\/0739986318822535","article-title":"Measuring the elusive construct of among Mexican American, Puerto Rican, and Cuban American adults","volume":"41","author":"Davis","journal-title":"Hisp J Behav Sci"},{"issue":"10","key":"R48","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pdig.0000279","article-title":"Digital literacy as a new determinant of health: a scoping review","volume":"2","author":"Arias L\u00f3pez","journal-title":"PLOS Digit Health"},{"key":"R49","doi-asserted-by":"crossref","unstructured":"Jagne J Duncker-Gassen E Smith-Atakan S Curzon P . Cross-Cultural System Design Strategy: Avoiding Problems in Usability Evaluation. IADIS International Conference WWW\/Internet; 2006. URL: https:\/\/tinyurl.com\/2kb4p7dy [Accessed 28-05-2026] [doi: 10.1007\/s10209-006-0048-6]","DOI":"10.1007\/s10209-006-0048-6"},{"issue":"1","key":"R50","doi-asserted-by":"publisher","DOI":"10.2196\/mental.4751","article-title":"A web-disseminated self-help and peer support program could fill gaps in mental health care: lessons from a consumer survey","volume":"4","author":"Bernecker","journal-title":"JMIR Ment Health"},{"issue":"6","key":"R51","doi-asserted-by":"publisher","first-page":"491","DOI":"10.1111\/bioe.13266","article-title":"Can digital health democratize health care?","volume":"38","author":"Hendl","journal-title":"Bioethics"},{"issue":"3","key":"R52","doi-asserted-by":"publisher","DOI":"10.2196\/33060","article-title":"Informing the future of integrated digital and clinical mental health care: synthesis of the outcomes from project synergy","volume":"9","author":"LaMonica","journal-title":"JMIR Ment Health"},{"issue":"1","key":"R53","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1111\/jpm.12744","article-title":"User perceptions of mobile digital apps for mental health: acceptability and usability\u2014an integrative review","volume":"29","author":"Chan","journal-title":"J Psychiatr Ment Health Nurs"}],"container-title":["JMIR Formative Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/formative.jmir.org\/2026\/1\/e72952","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T22:27:09Z","timestamp":1785536829000},"score":1,"resource":{"primary":{"URL":"https:\/\/formative.jmir.org\/2026\/1\/e72952"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,10]]},"references-count":53,"URL":"https:\/\/doi.org\/10.2196\/72952","relation":{},"ISSN":["2561-326X"],"issn-type":[{"value":"2561-326X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,10]]},"article-number":"v10i2e72952"}}