{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T01:03:31Z","timestamp":1783040611522,"version":"3.54.6"},"reference-count":42,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Form Res"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n American Indian\/Alaska Native (AI\/AN) people represent a culturally diverse people group within the United States. AI\/AN people experience some of the most severe health disparities in the United States, including behavioral health. A quarter of AI\/AN people in the United States live on tribal lands, experiencing significant barriers to mental health resources and broadband infrastructure for telehealth. We developed Amplifying Resilience Over Restricted Internet Access (ARORA)\u2014a mobile health (mHealth) smartphone app, promoting mindfulness practices and community building through AI\/AN culture and values. Originally co-designed with both Hopi\/Tewa and Navajo youth and adults, this study evaluated app resonance among Hopi\/Tewa youth, supporting its iterative design. While we initially planned in-person user testing, this was moved online due to the COVID-19 pandemic.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study assessed the potential and acceptability of an mHealth app supporting Hopi\/Tewa youth practicing mindfulness inspired by their culture, values, and beliefs. This research served as preliminary work for an ongoing, iterative participatory action research study, identifying points of improvement to align with our partner community\u2019s goals.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n After meeting with 6 community advisory board members and focus groups prior to this study, we developed a prototype for ARORA. This study evaluated intuitiveness and usability through testing and interviews with Hopi\/Tewa youth. All meetings with stakeholders were moved online due to the COVID-19 pandemic. Using screen-sharing via Zoom (Zoom Communications, Inc) and Android emulators, we received feedback for the iterative design process.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n This study involved 9 participants aged 16-24 years. Of these participants, 1 was male and 8 were female; all identified as Hopi\/Tewa and\/or Tewa. This study included a quantitative assessment using a modified version of the User Version of the Mobile Application Rating Scale. The mean score across all questions was 3.71 (SD 0.427), suggesting generally positive reception. Qualitative results from thematically analyzing open-ended focus group data produced 5 open codes and 12 axial themes, reaching thematic saturation after engaging with 9 participants. Qualitative feedback revealed that while its use was generally enjoyable, the ARORA app could be more specific to Hopi\/Tewa culture. Finally, we reflect on adaptations made to our initial protocol in response to the COVID-19 pandemic, offering guidelines for future mHealth work involving rural or hard-to-reach communities.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n In this evaluation and usability testing of the ARORA prototype, participants expressed interest and engagement in the mindfulness activities. Participants also identified spaces in which the app could improve, both in usability and in cultural groundedness, especially with the visual dimensions of the app. Reflecting on our experience in facilitating remote user testing, we encourage future work in rural mHealth to consider practices for conducting research when in-person meetings are not feasible.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/77898","type":"journal-article","created":{"date-parts":[[2026,2,16]],"date-time":"2026-02-16T18:35:08Z","timestamp":1771266908000},"page":"e77898-e77898","source":"Crossref","is-referenced-by-count":2,"title":["User Testing an mHealth Behavioral Health App for Hopi\/Tewa Youth During the COVID-19 Pandemic: Usability Study"],"prefix":"10.2196","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7260-2252","authenticated-orcid":false,"given":"Shelby","family":"Hagemann","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9010-5380","authenticated-orcid":false,"given":"Morgan","family":"Vigil-Hayes","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3722-0720","authenticated-orcid":false,"given":"Ashish","family":"Amresh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-6190-2289","authenticated-orcid":false,"given":"Marissa","family":"Adams","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0386-3093","authenticated-orcid":false,"given":"Darold","family":"H Joseph","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7627-5447","authenticated-orcid":false,"given":"Ann","family":"Futterman Collier","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,3,24]]},"reference":[{"key":"R1","unstructured":"Tribes. United States Department of the Interior. URL: https:\/\/www.doi.gov\/international\/what-we-do\/tribes#:~:text=The%20United%20States%20federal%20maintains,are%20distinct%2C%20independent%20political%20communities [Accessed 25-02-2026]"},{"key":"R2","unstructured":"US Department of Health and Human Services. Mental and behavioral health\u2013American Indians\/Alaska Natives. US Department of Health and Human Services Office of Minority Health. URL: https:\/\/minorityhealth.hhs.gov\/mental-and-behavioral-health-american-indiansalaska-natives [Accessed 04-03-2025]"},{"key":"R3","unstructured":"Zein M Rossel M . Mental health disparities: American Indians and Alaska Natives. American Psychiatric Association; 2017."},{"key":"R4","unstructured":"Shearer E Matsa KE Mitchell A Jurkowitz M Worden K Forman-Katz N . 5. Coverage of tribal governments: in many cases, a struggle for editorial independence. Pew Research Center. URL: https:\/\/www.pewresearch.org\/journalism\/2022\/04\/05\/coverage-of-tribal-governments-in-many-cases-a-struggle-for-editorial-independence\/#:~:text=Within%20the%20United%20States%2C%20there,of%20the%202020%20U.S.%20census).&text=About%20a%20quarter%20of%20Native,and%20enforce%20laws%20and%20regulations [Accessed 04-03-2025]"},{"key":"R5","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-clinpsy-032511-143127","article-title":"American Indian and Alaska Native mental health: diverse perspectives on enduring disparities","volume":"8","author":"Gone","journal-title":"Annu Rev Clin Psychol"},{"key":"R6","unstructured":"Mej\u00eda D . American Indian and Alaska Natives in tribal areas have among lowest rates of high-speed internet access. United States Census Bureau. Jul 18, 2024. URL: https:\/\/www.census.gov\/library\/stories\/2024\/06\/broadband-access-tribal-areas.html [Accessed 25-02-2026]"},{"issue":"7","key":"R7","doi-asserted-by":"publisher","first-page":"617","DOI":"10.1177\/070674370004500703","article-title":"Mental health services for American Indians and Alaska Natives: need, use, and barriers to effective care","volume":"45","author":"Manson","journal-title":"Can J Psychiatry"},{"issue":"1","key":"R8","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1007\/s10488-016-0777-7","article-title":"Identifying and reducing disparities in mental health outcomes among American Indians and Alaskan Natives using public health, mental healthcare and legal perspectives","volume":"45","author":"Payne","journal-title":"Adm Policy Ment Health"},{"issue":"2","key":"R9","doi-asserted-by":"publisher","first-page":"11","DOI":"10.12927\/hcpap.2019.25925","article-title":"Culturally responsive services as a path to equity in mental healthcare","volume":"18","author":"Kirmayer","journal-title":"Healthc Pap"},{"key":"R10","doi-asserted-by":"crossref","unstructured":"To A Smith ADR Showkat D Adjagbodjou A Harrington C . Flourishing in the everyday: moving beyond damage-centered design in HCI for BIPOC communities. Presented at: Proceedings of the 2023 ACM Designing Interactive Systems Conference (DIS \u201923); Jul 10-14, 2023:917-933; Pittsburgh, PA, USA. Jul 10, 2023.[doi: 10.1145\/3563657.3596057]","DOI":"10.1145\/3563657.3596057"},{"issue":"1","key":"R11","doi-asserted-by":"publisher","DOI":"10.2196\/games.9530","article-title":"Empirical evidence for the outcomes of therapeutic video games for adolescents with anxiety disorders: systematic review","volume":"6","author":"Barnes","journal-title":"JMIR Serious Games"},{"key":"R12","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcbs.2022.11.010","article-title":"Magis - A magical adventure: Using a mobile game to deliver an ACT intervention for elementary schoolchildren in classroom settings","volume":"27","author":"Keinonen","journal-title":"J Contextual Behav Sci"},{"issue":"1","key":"R13","doi-asserted-by":"publisher","DOI":"10.2196\/games.3804","article-title":"The design and relevance of a computerized gamified depression therapy program for indigenous M\u0101ori adolescents","volume":"3","author":"Shepherd","journal-title":"JMIR Serious Games"},{"issue":"3","key":"R14","doi-asserted-by":"publisher","DOI":"10.2196\/games.8752","article-title":"Indigenous adolescents\u2019 perception of an eMental health program (SPARX): exploratory qualitative assessment","volume":"6","author":"Shepherd","journal-title":"JMIR Serious Games"},{"key":"R15","doi-asserted-by":"publisher","DOI":"10.2196\/78343","article-title":"Digital health literacy and its role in awareness of and access to sexual health products and services among displaced youth in Uganda\u2019s informal urban settlements: community-based cross-sectional study","volume":"27","author":"Okumu","journal-title":"J Med Internet Res"},{"issue":"1","key":"R16","doi-asserted-by":"publisher","first-page":"406","DOI":"10.1186\/s12884-019-2531-0","article-title":"mHealth communication to strengthen postnatal care in rural areas: a systematic review","volume":"19","author":"Mbuthia","journal-title":"BMC Pregnancy Childbirth"},{"key":"R17","doi-asserted-by":"publisher","DOI":"10.2196\/70051","article-title":"Tailoring mHealth for healthy aging: focus group study with retirement-age adults","volume":"13","author":"Collazo-Casti\u00f1eira","journal-title":"JMIR Mhealth Uhealth"},{"key":"R18","doi-asserted-by":"publisher","DOI":"10.2196\/63409","article-title":"Adherence to eHealth interventions among patients with heart failure: scoping review","volume":"13","author":"Gingele","journal-title":"JMIR Mhealth Uhealth"},{"issue":"1","key":"R19","doi-asserted-by":"publisher","DOI":"10.2196\/65983","article-title":"Perspectives and experiences of family caregivers using supportive mobile apps in dementia care: meta-synthesis of qualitative research","volume":"13","author":"Shen","journal-title":"JMIR Mhealth Uhealth"},{"issue":"4","key":"R20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3687133","article-title":"ICT-facilitated health interventions for indigenous communities: a critical literature review","volume":"1","author":"Vigil-Hayes","journal-title":"ACM J Responsib Comput"},{"key":"R21","doi-asserted-by":"crossref","unstructured":"Bautista JR Wong N Reddy M Schueller SM . Healing through stories: co-designing digital mental health with Asian Americans. Presented at: 2025 CHI Conference on Human Factors in Computing Systems (CHI \u201925); Apr 26 to May 1, 2025:1-19; Yokohama, Japan. Apr 26, 2025.[doi: 10.1145\/3706598.3714142]","DOI":"10.1145\/3706598.3714142"},{"key":"R22","doi-asserted-by":"crossref","unstructured":"Iriarte MP Koren N Blinder EB Bonsignore E . Funds of identity in co-design. Presented at: Proceedings of the 22nd Annual ACM Interaction Design and Children Conference; Jun 19-23, 2023; Chicago, IL, USA. Jun 19, 2023.[doi: 10.1145\/3585088.3593901]","DOI":"10.1145\/3585088.3593901"},{"key":"R23","doi-asserted-by":"crossref","unstructured":"Cheng NY Wong N Reddy M . Understanding mental wellbeing and tools for support with Taiwanese emerging adults: an eastern cultural perspective. Presented at: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems; Apr 26 to May 1, 2025; Yokohama, Japan. Apr 26, 2025.[doi: 10.1145\/3706598.3713143]","DOI":"10.1145\/3706598.3713143"},{"issue":"CSCW2","key":"R24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3687045","article-title":"Limitations of using mobile phones for managing type 1 diabetes (T1D) among youth in low and middle-income countries: Implications for mHealth","volume":"8","author":"Wyche","journal-title":"Proc ACM Hum Comput Interact"},{"key":"R25","doi-asserted-by":"crossref","unstructured":"Dirks LG Belarde-Lewis M Pratt W . Amplifying cultural values with collaborative photo-elicitation: strengths-focused co-design with Alaska native people. Presented at: 2025 ACM Designing Interactive Systems Conference; Jul 5-9, 2025; Madeira, Portugal. 2025.[doi: 10.1145\/3715336.3735688]","DOI":"10.1145\/3715336.3735688"},{"issue":"CSCW1","key":"R26","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1145\/3449239","article-title":"Integrating cultural relevance into a behavioral mHealth intervention for Native American Youth","volume":"5","author":"Vigil-Hayes","journal-title":"Proc ACM Hum Comput Interact"},{"key":"R27","doi-asserted-by":"crossref","unstructured":"Stillman L . Participatory action research & inclusive information and knowledge management for empowerment. Presented at: Sixth International Conference on Information and Communications Technologies and Development: Notes-Volume 2; Dec 7-10, 2013; Cape Town, South Africa. Dec 7, 2013.[doi: 10.1145\/2517899.2517903]","DOI":"10.1145\/2517899.2517903"},{"key":"R28","doi-asserted-by":"crossref","unstructured":"Robinson RB Osborne A Ji C Fey JC Dagan E Isbister K . \u201cThat\u2019s not good science!\u201d: an argument for the thoughtful use of formative situations in research through design. Presented at: CHI Conference on Human Factors in Computing Systems; May 11-16, 2016; Honolulu, HI, USA. May 11, 2024.[doi: 10.1145\/3613905.3644063]","DOI":"10.1145\/3613905.3644063"},{"issue":"3","key":"R29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3453862","article-title":"As a squash plant grows: social textures of sparse internet connectivity in rural and tribal communities","volume":"28","author":"Duarte","journal-title":"ACM Trans Comput Hum Interact"},{"issue":"2","key":"R30","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.5849","article-title":"Development and validation of the user version of the Mobile Application Rating Scale (uMARS)","volume":"4","author":"Stoyanov","journal-title":"JMIR Mhealth Uhealth"},{"key":"R31","unstructured":"Nwadike C Tyke H . Use of brisk walking intervention to reduce stress among adults [dissertation]. University of Massachusetts Global; 2022. URL: https:\/\/www.proquest.com\/docview\/2659058893?pq-origsite=gscholar&fromopenview=true&sourcetype=Dissertations%20&%20Theses [Accessed 01-01-2026]"},{"key":"R32","doi-asserted-by":"crossref","unstructured":"Aggarwal A Qiao S Yang CH Taylor S Tam CC Li X . Feasibility and preliminary efficacy of an online mindful walking intervention among COVID-19 long haulers: a mixed method study including daily diary surveys. arXiv. Preprint posted online on 2024. [doi: 10.1101\/2024.01.23.24301694]","DOI":"10.1101\/2024.01.23.24301694"},{"issue":"1","key":"R33","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-024-78162-3","article-title":"Clinical effectiveness of guided breathing exercises in reducing anxiety, stress, and depression in COVID-19 patients","volume":"14","author":"Sheikh","journal-title":"Sci Rep"},{"issue":"5","key":"R34","doi-asserted-by":"publisher","first-page":"863","DOI":"10.1007\/s12671-018-1050-9","article-title":"Mobile mindfulness meditation: a randomised controlled trial of the effect of two popular apps on mental health","volume":"10","author":"Flett","journal-title":"Mindfulness (N Y)"},{"key":"R35","doi-asserted-by":"publisher","DOI":"10.2196\/46912","article-title":"A video game intervention to prevent opioid misuse among older adolescents: development and preimplementation study","volume":"11","author":"Aneni","journal-title":"JMIR Serious Games"},{"issue":"1","key":"R36","doi-asserted-by":"publisher","DOI":"10.2196\/51512","article-title":"Developing an automated virtual reality therapy for improving positive self-beliefs and psychological well-being (Phoenix VR Self-Confidence Therapy): tutorial","volume":"12","author":"Rosebrock","journal-title":"JMIR Serious Games"},{"issue":"1","key":"R37","doi-asserted-by":"publisher","DOI":"10.2196\/41638","article-title":"Gamifying cognitive behavioral therapy techniques on smartphones for Bangkok\u2019s millennials with depressive symptoms: interdisciplinary game development","volume":"11","author":"Sriwatanathamma","journal-title":"JMIR Serious Games"},{"issue":"1","key":"R38","doi-asserted-by":"publisher","DOI":"10.2196\/31638","article-title":"A reusable multiplayer game for promoting active school transport: development study","volume":"10","author":"Laine","journal-title":"JMIR Serious Games"},{"issue":"12","key":"R39","doi-asserted-by":"publisher","first-page":"549","DOI":"10.1177\/01410768211051710","article-title":"The inequitable impact of Covid-19 among American Indian\/Alaskan Native (AI\/AN) communities is the direct result of centuries of persecution and racism","volume":"114","author":"Hill","journal-title":"J R Soc Med"},{"issue":"5","key":"R40","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0232076","article-title":"A simple method to assess and report thematic saturation in qualitative research","volume":"15","author":"Guest","journal-title":"PLoS One"},{"key":"R41","unstructured":"Muller MJ Kogan S . Grounded theory method in HCI and CSCW. In: Human Computer Interaction Handbook. CRC Press; 2010. URL: https:\/\/www.taylorfrancis.com\/chapters\/edit\/10.1201\/b11963-ch-44\/grounded-theory-method-human-computer-interaction-computer-supported-cooperative-work-michael-muller-sandra-kogan [Accessed 01-01-2026]"},{"key":"R42","doi-asserted-by":"publisher","DOI":"10.1145\/3359298","article-title":"Rural HCI research: definitions, distinctions, methods, and opportunities","author":"Hardy","journal-title":"Proc ACM Hum-Comput Interact 3, CSCW"}],"container-title":["JMIR Formative Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/formative.jmir.org\/2026\/1\/e77898","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T18:10:15Z","timestamp":1782843015000},"score":1,"resource":{"primary":{"URL":"https:\/\/formative.jmir.org\/2026\/1\/e77898"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,24]]},"references-count":42,"URL":"https:\/\/doi.org\/10.2196\/77898","relation":{},"ISSN":["2561-326X"],"issn-type":[{"value":"2561-326X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,24]]},"article-number":"v10i7e77898"}}