{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T07:12:39Z","timestamp":1781334759048,"version":"3.54.1"},"publisher-location":"New York, NY, USA","reference-count":60,"publisher":"ACM","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,7,5]]},"DOI":"10.1145\/3715668.3735621","type":"proceedings-article","created":{"date-parts":[[2025,7,5]],"date-time":"2025-07-05T08:10:41Z","timestamp":1751703041000},"page":"131-136","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Designing for Engagement in Digital Mental Health Services"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6498-2785","authenticated-orcid":false,"given":"Bruna","family":"Oewel","sequence":"first","affiliation":[{"name":"Department of Informatics, University of California, Irvine, Irvine, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,7,5]]},"reference":[{"key":"e_1_3_3_1_2_2","doi-asserted-by":"publisher","unstructured":"Elena Agapie Shefali Haldar and Sharmaine\u00a0G Poblete. 2022. Using HCI in Cross-Disciplinary Teams: A Case Study of Academic Collaboration in HCI-Health Teams in the US Using a Team Science Perspective. Proceedings of the ACM on Human-Computer Interaction 6 CSCW2 (2022) 1\u201335. 10.1145\/3555610","DOI":"10.1145\/3555610"},{"key":"e_1_3_3_1_3_2","doi-asserted-by":"publisher","unstructured":"Gwen\u00a0L Alexander Jennifer\u00a0B McClure Josephine\u00a0H Calvi George\u00a0W Divine Melanie\u00a0A Stopponi Sharon\u00a0J Rolnick Jerianne Heimendinger Dennis\u00a0D Tolsma Kenneth Resnicow Marci\u00a0K Campbell et\u00a0al. 2010. A randomized clinical trial evaluating online interventions to improve fruit and vegetable consumption. American Journal of Public Health 100 2 (2010) 319\u2013326. 10.2105\/ajph.2008.154468","DOI":"10.2105\/ajph.2008.154468"},{"key":"e_1_3_3_1_4_2","doi-asserted-by":"publisher","unstructured":"Sven Alfonsson Erik Olsson Sara Linderman Sofia Winnerhed and Timo Hursti. 2016. Is online treatment adherence affected by presentation and therapist support? A randomized controlled trial. Computers in Human Behavior 60 (2016) 550\u2013558. 10.1016\/j.chb.2016.01.035","DOI":"10.1016\/j.chb.2016.01.035"},{"key":"e_1_3_3_1_5_2","doi-asserted-by":"crossref","unstructured":"Chelsea Arnold Kristi-Ann Villagonzalo Denny Meyer John Farhall Fiona Foley Michael Kyrios and Neil Thomas. 2019. Predicting engagement with an online psychosocial intervention for psychosis: exploring individual-and intervention-level predictors. Internet interventions 18 (2019) 100266.","DOI":"10.1016\/j.invent.2019.100266"},{"key":"e_1_3_3_1_6_2","doi-asserted-by":"publisher","unstructured":"Chelsea Arnold Anne Williams and Neil Thomas. 2020. Engaging with a web-based psychosocial intervention for psychosis: qualitative study of user experiences. JMIR mental health 7 6 (2020) e16730. 10.2196\/16730","DOI":"10.2196\/16730"},{"key":"e_1_3_3_1_7_2","doi-asserted-by":"publisher","unstructured":"Amit Baumel Frederick Muench Stav Edan and John\u00a0M Kane. 2019. Objective user engagement with mental health apps: systematic search and panel-based usage analysis. Journal of Medical Internet Research 21 9 (2019) e14567. 10.2196\/14567","DOI":"10.2196\/14567"},{"key":"e_1_3_3_1_8_2","doi-asserted-by":"publisher","unstructured":"Dror Ben-Zeev Rachel\u00a0M Brian Geneva Jonathan Lisa Razzano Nicole Pashka Elizabeth Carpenter-Song Robert\u00a0E Drake and Emily\u00a0A Scherer. 2018. Mobile health (mHealth) versus clinic-based group intervention for people with serious mental illness: a randomized controlled trial. Psychiatric Services 69 9 (2018) 978\u2013985. 10.1176\/appi.ps.201800063","DOI":"10.1176\/appi.ps.201800063"},{"key":"e_1_3_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/1520340.152074"},{"key":"e_1_3_3_1_10_2","doi-asserted-by":"crossref","unstructured":"Mary\u00a0Jo Bitner Amy\u00a0L Ostrom and Felicia\u00a0N Morgan. 2008. Service blueprinting: a practical technique for service innovation. California management review 50 3 (2008) 66\u201394.","DOI":"10.2307\/41166446"},{"key":"e_1_3_3_1_11_2","doi-asserted-by":"publisher","unstructured":"Jonathan Bricker Zhen Miao Kristin Mull Margarita Santiago-Torres and David\u00a0M Vock. 2023. Can a single variable predict early dropout from digital health interventions? Comparison of predictive models from two large randomized trials. Journal of Medical Internet Research 25 (2023) e43629. 10.2196\/43629","DOI":"10.2196\/43629"},{"key":"e_1_3_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/3395035.3425316"},{"key":"e_1_3_3_1_13_2","doi-asserted-by":"publisher","unstructured":"Kate Cavanagh and Abigail Millings. 2013. Increasing engagement with computerised cognitive behavioural therapies. 11\u00a0pages. 10.4108\/trans.amsys.01-06.2013.e3","DOI":"10.4108\/trans.amsys.01-06.2013.e3"},{"key":"e_1_3_3_1_14_2","doi-asserted-by":"publisher","unstructured":"Nathan\u00a0K Cobb Amanda\u00a0L Graham Beth\u00a0C Bock George Papandonatos and David\u00a0B Abrams. 2005. Initial evaluation of a real-world Internet smoking cessation system. Nicotine & Tobacco Research 7 2 (2005) 207\u2013216. 10.1080\/14622200500055319","DOI":"10.1080\/14622200500055319"},{"key":"e_1_3_3_1_15_2","doi-asserted-by":"publisher","unstructured":"Sunny Consolvo Predrag Klasnja David\u00a0W McDonald James\u00a0A Landay et\u00a0al. 2014. Designing for healthy lifestyles: Design considerations for mobile technologies to encourage consumer health and wellness. Foundations and Trends in Human\u2013Computer Interaction 6 3\u20134 (2014) 167\u2013315. 10.1561\/1100000040","DOI":"10.1561\/1100000040"},{"key":"e_1_3_3_1_16_2","doi-asserted-by":"publisher","unstructured":"Laura\u00a0J Damschroder Caitlin\u00a0M Reardon Marilla A\u00a0Opra Widerquist and Julie Lowery. 2022. The Updated Consolidated Framework for Implementation Research based on User Feedback. Implementation science 17 1 (2022) 75. 10.1186\/s13012-022-01245-0","DOI":"10.1186\/s13012-022-01245-0"},{"key":"e_1_3_3_1_17_2","doi-asserted-by":"publisher","unstructured":"Kevin Doherty and Gavin Doherty. 2018. The construal of experience in HCI: Understanding self-reports. International Journal of Human-Computer Studies 110 (2018) 63\u201374. 10.1016\/j.ijhcs.2017.10.006","DOI":"10.1016\/j.ijhcs.2017.10.006"},{"key":"e_1_3_3_1_18_2","doi-asserted-by":"publisher","unstructured":"Kevin Doherty and Gavin Doherty. 2018. Engagement in HCI: conception theory and measurement. ACM computing surveys (CSUR) 51 5 (2018) 1\u201339. 10.1145\/3234149","DOI":"10.1145\/3234149"},{"key":"e_1_3_3_1_19_2","doi-asserted-by":"publisher","unstructured":"Liesje Donkin Helen Christensen Sharon\u00a0L Naismith Bruce Neal Ian\u00a0B Hickie Nick Glozier et\u00a0al. 2011. A systematic review of the impact of adherence on the effectiveness of e-therapies. Journal of Medical Internet Research 13 3 (2011) e1772. 10.2196\/jmir.1772","DOI":"10.2196\/jmir.1772"},{"key":"e_1_3_3_1_20_2","doi-asserted-by":"publisher","unstructured":"Liesje Donkin Ian\u00a0B Hickie Helen Christensen Sharon\u00a0L Naismith Bruce Neal Nicole\u00a0L Cockayne and Nick Glozier. 2013. Rethinking the dose-response relationship between usage and outcome in an online intervention for depression: randomized controlled trial. Journal of medical Internet research 15 10 (2013) e231. 10.2196\/jmir.2771","DOI":"10.2196\/jmir.2771"},{"key":"e_1_3_3_1_21_2","doi-asserted-by":"publisher","unstructured":"Paul Dourish. 2004. What we talk about when we talk about context. Personal and ubiquitous computing 8 (2004) 19\u201330. 10.1007\/s00779-003-0253-8","DOI":"10.1007\/s00779-003-0253-8"},{"key":"e_1_3_3_1_22_2","doi-asserted-by":"publisher","unstructured":"Peter Farvolden Eilenna Denisoff Peter Selby R\u00a0Michael Bagby Laura Rudy et\u00a0al. 2005. Usage and longitudinal effectiveness of a Web-based self-help cognitive behavioral therapy program for panic disorder. Journal of Medical Internet Research 7 1 (2005) e129. 10.2196\/jmir.7.1.e7","DOI":"10.2196\/jmir.7.1.e7"},{"key":"e_1_3_3_1_23_2","doi-asserted-by":"crossref","unstructured":"Jayde\u00a0AM Flett Harlene Hayne Benjamin\u00a0C Riordan Laura\u00a0M Thompson and Tamlin\u00a0S Conner. 2019. Mobile mindfulness meditation: a randomised controlled trial of the effect of two popular apps on mental health. Mindfulness 10 (2019) 863\u2013876.","DOI":"10.1007\/s12671-018-1050-9"},{"key":"e_1_3_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1142\/S1793966607000042"},{"key":"e_1_3_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/1013115.1013152"},{"key":"e_1_3_3_1_26_2","unstructured":"Risa Gelles-Watnick. 2024. Americans\u2019 use of mobile technology and home broadband. Pew Research Center (2024)."},{"key":"e_1_3_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-02191-6"},{"key":"e_1_3_3_1_28_2","doi-asserted-by":"crossref","unstructured":"Clara\u00a0E Hill Barbara\u00a0J Thompson and Elizabeth\u00a0Nutt Williams. 1997. A guide to conducting consensual qualitative research. The counseling psychologist 25 4 (1997) 517\u2013572.","DOI":"10.1177\/0011000097254001"},{"key":"e_1_3_3_1_29_2","doi-asserted-by":"publisher","unstructured":"Jina Huh-Yoo and Emilee Rader. 2020. It\u2019s the Wild Wild West: Lessons learned from IRB members\u2019 risk perceptions toward digital research data. Proceedings of the ACM on Human-Computer Interaction 4 CSCW1 (2020) 1\u201322. 10.1145\/3392868","DOI":"10.1145\/3392868"},{"key":"e_1_3_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/1463160.1463182"},{"key":"e_1_3_3_1_31_2","doi-asserted-by":"crossref","unstructured":"Eirini Karyotaki Annet Kleiboer Filip Smit David\u00a0Trevor Turner A\u00a0Mira Pastor Gerhard Andersson Thomas Berger Cristina Botella JM Breton Per Carlbring et\u00a0al. 2015. Predictors of treatment dropout in self-guided web-based interventions for depression: an \u2019individual patient data\u2019 meta-analysis. Psychological medicine 45 13 (2015) 2717\u20132726.","DOI":"10.1017\/S0033291715000665"},{"key":"e_1_3_3_1_32_2","doi-asserted-by":"publisher","unstructured":"Saskia\u00a0M Kelders Llewellyn\u00a0Ellardus Van\u00a0Zyl and Geke\u00a0DS Ludden. 2020. The concept and components of engagement in different domains applied to eHealth: a systematic scoping review. Frontiers in psychology 11 (2020) 926. 10.3389\/fpsyg.2020.00926","DOI":"10.3389\/fpsyg.2020.00926"},{"key":"e_1_3_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376309"},{"key":"e_1_3_3_1_34_2","doi-asserted-by":"publisher","unstructured":"Emily\u00a0G Lattie Elizabeth\u00a0C Adkins Nathan Winquist Colleen Stiles-Shields Q\u00a0Eileen Wafford and Andrea\u00a0K Graham. 2019. Digital mental health interventions for depression anxiety and enhancement of psychological well-being among college students: systematic review. Journal of Medical Internet Research 21 7 (2019) e12869. 10.2196\/12869","DOI":"10.2196\/12869"},{"key":"e_1_3_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3502128"},{"key":"e_1_3_3_1_36_2","doi-asserted-by":"publisher","unstructured":"Jessica\u00a0M Lipschitz Chelsea\u00a0K Pike Timothy\u00a0P Hogan Susan\u00a0A Murphy and Katherine\u00a0E Burdick. 2023. The engagement problem: a review of engagement with digital mental health interventions and recommendations for a path forward. Current treatment options in psychiatry 10 3 (2023) 119\u2013135. 10.1007\/s40501-023-00297-3","DOI":"10.1007\/s40501-023-00297-3"},{"key":"e_1_3_3_1_37_2","doi-asserted-by":"publisher","unstructured":"Carmel Maher Mark Hadfield Maggie Hutchings and Adam De\u00a0Eyto. 2018. Ensuring rigor in qualitative data analysis: A design research approach to coding combining NVivo with traditional material methods. International journal of qualitative methods 17 1 (2018) 1609406918786362. 10.1177\/1609406918786362","DOI":"10.1177\/1609406918786362"},{"key":"e_1_3_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411763.3443437"},{"key":"e_1_3_3_1_39_2","doi-asserted-by":"crossref","unstructured":"John McCarthy and Peter Wright. 2004. Technology as Experience.","DOI":"10.7551\/mitpress\/6687.001.0001"},{"key":"e_1_3_3_1_40_2","doi-asserted-by":"publisher","unstructured":"David\u00a0C Mohr Joyce Ho Jenna Duffecy Kelly\u00a0G Baron Kenneth\u00a0A Lehman Ling Jin and Douglas Reifler. 2010. Perceived barriers to psychological treatments and their relationship to depression. Journal of Clinical Psychology 66 4 (2010) 394\u2013409. 10.1002\/jclp.20659","DOI":"10.1002\/jclp.20659"},{"key":"e_1_3_3_1_41_2","doi-asserted-by":"publisher","unstructured":"David\u00a0C Mohr Aaron\u00a0R Lyon Emily\u00a0G Lattie Madhu Reddy and Stephen\u00a0M Schueller. 2017. Accelerating digital mental health research from early design and creation to successful implementation and sustainment. Journal of Medical Internet Research 19 5 (2017) e7725. 10.2196\/jmir.7725","DOI":"10.2196\/jmir.7725"},{"key":"e_1_3_3_1_42_2","doi-asserted-by":"publisher","unstructured":"David\u00a0C Mohr Ken\u00a0R Weingardt Madhu Reddy and Stephen\u00a0M Schueller. 2017. Three problems with current digital mental health research... and three things we can do about them. Psychiatric services 68 5 (2017) 427\u2013429. 10.1176\/appi.ps.201600541","DOI":"10.1176\/appi.ps.201600541"},{"key":"e_1_3_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3502039"},{"key":"e_1_3_3_1_44_2","doi-asserted-by":"publisher","unstructured":"Michelle\u00a0M Ng Joseph Firth Mia Minen and John Torous. 2019. User engagement in mental health apps: a review of measurement reporting and validity. Psychiatric Services 70 7 (2019) 538\u2013544. 10.1176\/appi.ps.201800519","DOI":"10.1176\/appi.ps.201800519"},{"key":"e_1_3_3_1_45_2","doi-asserted-by":"publisher","unstructured":"Donald\u00a0A Norman and Pieter\u00a0Jan Stappers. 2015. DesignX: complex sociotechnical systems. She Ji: The Journal of Design Economics and Innovation 1 2 (2015) 83\u2013106. 10.1016\/j.sheji.2016.01.002","DOI":"10.1016\/j.sheji.2016.01.002"},{"key":"e_1_3_3_1_46_2","doi-asserted-by":"publisher","unstructured":"Heather\u00a0L O\u2019Brien Ido Roll Andrea Kampen and Nilou Davoudi. 2022. Rethinking (Dis) engagement in human-computer interaction. Computers in human behavior 128 (2022) 107109. 10.1016\/j.chb.2021.107109","DOI":"10.1016\/j.chb.2021.107109"},{"key":"e_1_3_3_1_47_2","doi-asserted-by":"publisher","unstructured":"Heather\u00a0L O\u2019Brien and Elaine\u00a0G Toms. 2008. What is user engagement? A conceptual framework for defining user engagement with technology. Journal of the American society for Information Science and Technology 59 6 (2008) 938\u2013955. 10.1002\/asi.20801","DOI":"10.1002\/asi.20801"},{"key":"e_1_3_3_1_48_2","unstructured":"National\u00a0Institute of Mental Health\u00a0(NIMH). 1998. Bridging science and service: a report by the national advisory mental health council\u2019s clinical treatment and services research workgroup."},{"key":"e_1_3_3_1_49_2","doi-asserted-by":"publisher","unstructured":"Olga Perski Ann Blandford Robert West and Susan Michie. 2017. Conceptualising engagement with digital behaviour change interventions: a systematic review using principles from critical interpretive synthesis. Translational behavioral medicine 7 2 (2017) 254\u2013267. 10.1007\/s13142-016-0453-1","DOI":"10.1007\/s13142-016-0453-1"},{"key":"e_1_3_3_1_50_2","unstructured":"Andy Polaine. 2013. Service design: From insight to implementation. Rosenfeld Media (2013)."},{"key":"e_1_3_3_1_51_2","doi-asserted-by":"publisher","unstructured":"Enola Proctor Hiie Silmere Ramesh Raghavan Peter Hovmand Greg Aarons Alicia Bunger Richard Griffey and Melissa Hensley. 2011. Outcomes for implementation research: conceptual distinctions measurement challenges and research agenda. Administration and policy in mental health and mental health services research 38 (2011) 65\u201376. 10.1007\/s10488-010-0319-7","DOI":"10.1007\/s10488-010-0319-7"},{"key":"e_1_3_3_1_52_2","volume-title":"The coding manual for qualitative researchers","author":"Saldana Johnny","year":"2021","unstructured":"Johnny Saldana. 2021. The coding manual for qualitative researchers. SAGE publications Ltd."},{"key":"e_1_3_3_1_53_2","volume-title":"This is service design thinking: Basics, tools, cases","author":"Stickdorn Marc","year":"2012","unstructured":"Marc Stickdorn and Jakob Schneider. 2012. This is service design thinking: Basics, tools, cases. John Wiley & Sons."},{"key":"e_1_3_3_1_54_2","doi-asserted-by":"publisher","unstructured":"Deborah\u00a0F Tate Rena\u00a0R Wing and Richard\u00a0A Winett. 2001. Using Internet Technology to Deliver a Behavioral Weight Loss Program. Jama 285 9 (2001) 1172\u20131177. 10.1001\/jama.285.9.1172","DOI":"10.1001\/jama.285.9.1172"},{"key":"e_1_3_3_1_55_2","doi-asserted-by":"publisher","unstructured":"John Torous Jessica Lipschitz Michelle Ng and Joseph Firth. 2020. Dropout rates in clinical trials of smartphone apps for depressive symptoms: a systematic review and meta-analysis. Journal of Affective Disorders 263 (2020) 413\u2013419. 10.1016\/j.jad.2019.11.167","DOI":"10.1016\/j.jad.2019.11.167"},{"key":"e_1_3_3_1_56_2","doi-asserted-by":"publisher","unstructured":"John Torous Jennifer Nicholas Mark\u00a0E Larsen Joseph Firth and Helen Christensen. 2018. Clinical review of user engagement with mental health smartphone apps: evidence theory and improvements. BMJ Ment Health 21 3 (2018) 116\u2013119. 10.1136\/eb-2018-102891","DOI":"10.1136\/eb-2018-102891"},{"key":"e_1_3_3_1_57_2","doi-asserted-by":"publisher","unstructured":"Camila Villegas\u00a0Mejia Danielle Remmerswaal Rutger\u00a0CME Engels Geke\u00a0DS Ludden and Marilisa Boffo. 2024. Macro-engagement in mHealth: Exploring user engagement beyond the screen. Digital Health 10 (2024) 20552076231225591. 10.1177\/20552076231225591","DOI":"10.1177\/20552076231225591"},{"key":"e_1_3_3_1_58_2","doi-asserted-by":"publisher","unstructured":"Emily Wright Emily\u00a0C Dore Karestan\u00a0C Koenen Christina Mangurian David\u00a0R Williams and Rita Hamad. 2025. Prevalence of and Inequities in Poor Mental Health Across 3 US Surveys 2011 to 2022. JAMA Network Open 8 1 (2025) e2454718\u2013e2454718. 10.1001\/jamanetworkopen.2024.54718","DOI":"10.1001\/jamanetworkopen.2024.54718"},{"key":"e_1_3_3_1_59_2","doi-asserted-by":"publisher","unstructured":"Lucy Yardley Bonnie\u00a0J Spring Heleen Riper Leanne\u00a0G Morrison David\u00a0H Crane Kristina Curtis Gina\u00a0C Merchant Felix Naughton and Ann Blandford. 2016. Understanding and promoting effective engagement with digital behavior change interventions. American Journal of Preventive Medicine 51 5 (2016) 833\u2013842. 10.1016\/j.amepre.2016.06.015","DOI":"10.1016\/j.amepre.2016.06.015"},{"key":"e_1_3_3_1_60_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-50732-9_93"},{"key":"e_1_3_3_1_61_2","doi-asserted-by":"publisher","unstructured":"Yuezhou Zhang Amos\u00a0A Folarin Shaoxiong Sun Nicholas Cummins Yatharth Ranjan Zulqarnain Rashid Callum Stewart Pauline Conde Heet Sankesara Petroula Laiou et\u00a0al. 2024. Longitudinal Assessment of Seasonal Impacts and Depression Associations on Circadian Rhythm Using Multimodal Wearable Sensing: Retrospective Analysis. Journal of Medical Internet Research 26 (2024) e55302. 10.2196\/55302","DOI":"10.2196\/55302"}],"event":{"name":"DIS '25: Designing Interactive Systems Conference","location":"Funchal Portugal","acronym":"DIS '25"},"container-title":["Companion Publication of the 2025 ACM Designing Interactive Systems Conference"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3715668.3735621","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,5]],"date-time":"2025-07-05T08:12:24Z","timestamp":1751703144000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3715668.3735621"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,5]]},"references-count":60,"alternative-id":["10.1145\/3715668.3735621","10.1145\/3715668"],"URL":"https:\/\/doi.org\/10.1145\/3715668.3735621","relation":{},"subject":[],"published":{"date-parts":[[2025,7,5]]},"assertion":[{"value":"2025-07-05","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}