{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,19]],"date-time":"2026-10-19T20:40:33Z","timestamp":1792442433609,"version":"4.5.0"},"reference-count":53,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Form Res"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Digital mental health interventions (DMHIs) are increasingly popular for their ability to disseminate evidence-based treatments in a scalable, accessible way. Engagement with digital treatments is critical for effectiveness but remains poorly defined and measured. Most studies rely on subjective self-reports or 1 or 2 objective metrics, overlooking the multidimensional nature of how users interact with DMHIs.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This exploratory secondary analysis applied a road map for comprehensive behavioral engagement measurement, developed for a prior smartphone cognitive behavioral therapy program for body dysmorphic disorder, to a 12-week randomized controlled trial of smartphone cognitive behavioral therapy for obsessive compulsive disorder (OCD; N=60). Aims were to (1) comprehensively characterize behavioral engagement using 21 objective app analytics-based variables, (2) identify distinct behavioral engagement profiles via cluster analysis, (3) assess whether profiles were differentially associated with OCD symptom change, and (4) evaluate associations between profiles and pretreatment credibility, expectancy, posttreatment satisfaction, and perceived app quality.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n Behavioral engagement was measured via 21 objective variables derived from app analytics, spanning use volume, frequency, feature usage, session duration, and temporal patterns. Hierarchical agglomerative cluster analysis identified engagement profiles. Associations between cluster membership and OCD severity change (Yale-Brown Obsessive Compulsive Scale) were examined using hierarchical generalized linear mixed models. Objective measures were complemented with subjective self-reports: namely, cluster differences in treatment credibility, expectancy, satisfaction, and perceived app quality were examined using ANOVAs and Wilcoxon rank-sum tests.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n Cluster analysis indicated a 3-cluster solution representing high (cluster 1: 21\/60, 35%), moderate (cluster 2: 31\/60, 52%), and low (cluster 3: 8\/60, 13%) app users. All 3 clusters experienced significant reductions in OCD severity, with no significant differences in pre- to posttreatment Yale-Brown Obsessive Compulsive Scale change across clusters. Descriptively, cluster 1 had a higher rate of treatment responders than cluster 3. While clusters 1 and 2 had similar perceptions of treatment credibility and expectancy at baseline and satisfaction at posttreatment, cluster 3 perceived the intervention as significantly less credible, had lower expectations, and reported significantly lower satisfaction than cluster 2. All clusters rated app quality as similarly high.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n Comprehensive behavioral engagement measurement is feasible and informative across different DMHIs and clinical populations. The finding that all engagement profiles showed comparable symptom improvement challenges simple dose-response assumptions and may suggest that multiple paths of engagement can be therapeutically beneficial; nonsignificant differences in improvement across clusters may also reflect limited power to detect differences. Pretreatment credibility and expectancy are associated with engagement patterns, identifying a potential modifiable intervention target.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/98129","type":"journal-article","created":{"date-parts":[[2026,10,19]],"date-time":"2026-10-19T20:03:50Z","timestamp":1792440230000},"page":"e98129-e98129","source":"Crossref","is-referenced-by-count":0,"title":["Characterizing Behavioral Engagement in Smartphone Cognitive Behavioral Therapy for Obsessive Compulsive Disorder: Secondary Analysis of a Randomized Controlled Trial"],"prefix":"10.2196","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3448-3755","authenticated-orcid":false,"given":"Hilary","family":"Weingarden","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4762-561X","authenticated-orcid":false,"given":"Geneva K","family":"Jonathan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2060-1666","authenticated-orcid":false,"given":"Susanne S","family":"Hoeppner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-8137-6266","authenticated-orcid":false,"given":"Sara","family":"Velazquez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9154-5580","authenticated-orcid":false,"given":"Ryan J","family":"Jacoby","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2919-3673","authenticated-orcid":false,"given":"Jennifer L","family":"Greenberg","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6947-2581","authenticated-orcid":false,"given":"Oliver","family":"Harrison","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5316-2711","authenticated-orcid":false,"given":"Sabine","family":"Wilhelm","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,10,19]]},"reference":[{"issue":"1","key":"R1","doi-asserted-by":"publisher","DOI":"10.1186\/s12874-024-02308-0","article-title":"User engagement in clinical trials of digital mental health interventions: a systematic review","volume":"24","author":"Elkes","journal-title":"BMC Med Res Methodol"},{"key":"R2","doi-asserted-by":"publisher","DOI":"10.3389\/fdgth.2021.764079","article-title":"Effect of engagement with digital interventions on mental health outcomes: a systematic review and meta-analysis","volume":"3","author":"Gan","journal-title":"Front Digit Health"},{"issue":"3","key":"R3","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1007\/s40501-023-00297-3","article-title":"The engagement problem: a review of engagement with digital mental health interventions and recommendations for a path forward","volume":"10","author":"Lipschitz","journal-title":"Curr Treat Options Psychiatry"},{"issue":"5","key":"R4","doi-asserted-by":"publisher","DOI":"10.1192\/bjo.2020.72","article-title":"Beyond clicks and downloads: a call for a more comprehensive approach to measuring mobile-health app engagement","volume":"6","author":"O\u2019Brien","journal-title":"BJPsych Open"},{"key":"R5","doi-asserted-by":"publisher","DOI":"10.1016\/j.invent.2021.100403","article-title":"Targeting subjective engagement in experimental therapeutics for digital mental health interventions","volume":"25","author":"Graham","journal-title":"Internet Interv"},{"issue":"7","key":"R6","doi-asserted-by":"publisher","first-page":"538","DOI":"10.1176\/appi.ps.201800519","article-title":"User engagement in mental health apps: a review of measurement, reporting, and validity","volume":"70","author":"Ng","journal-title":"Psychiatr Serv"},{"issue":"9","key":"R7","doi-asserted-by":"publisher","DOI":"10.2196\/14567","article-title":"Objective user engagement with mental health apps: systematic search and panel-based usage analysis","volume":"21","author":"Baumel","journal-title":"J Med Internet Res"},{"key":"R8","doi-asserted-by":"publisher","DOI":"10.1016\/j.invent.2021.100454","article-title":"Engagement with mobile health interventions for depression: a systematic review","volume":"26","author":"Molloy","journal-title":"Internet Interv"},{"key":"R9","doi-asserted-by":"publisher","DOI":"10.1016\/j.invent.2023.100615","article-title":"Characterizing observed and effective behavioral engagement with smartphone cognitive behavioral therapy for body dysmorphic disorder: a methods roadmap and use case","volume":"32","author":"Weingarden","journal-title":"Internet Interv"},{"key":"R10","unstructured":"Duesser R Saxena S McCracken A et al. America\u2019s OCD Care Crisis: National Findings on the Failure of Effective OCD Treatment to Reach Patients International OCD Foundation. International OCD Foundation; 2025. URL: https:\/\/iocdf.org\/wp-content\/uploads\/2025\/12\/Full-Report-Americas-OCD-Care-Crisis-12-9-2025.pdf [Accessed 25-09-2026]"},{"issue":"1","key":"R11","doi-asserted-by":"publisher","DOI":"10.1186\/s12888-025-06655-0","article-title":"Help-seeking behavior, treatment barriers and facilitators, attitudes and access to first-line treatment in German adults with obsessive-compulsive disorder","volume":"25","author":"Bey","journal-title":"BMC Psychiatry"},{"issue":"8","key":"R12","doi-asserted-by":"publisher","first-page":"772","DOI":"10.1016\/j.janxdis.2013.04.006","article-title":"Assessing therapist reservations about exposure therapy for anxiety disorders: the Therapist Beliefs about Exposure Scale","volume":"27","author":"Deacon","journal-title":"J Anxiety Disord"},{"issue":"7","key":"R13","doi-asserted-by":"publisher","first-page":"643","DOI":"10.1002\/jclp.23797","article-title":"Exposure and response prevention in OCD: a framework to capitalize change","volume":"81","author":"Faustino","journal-title":"J Clin Psychol"},{"issue":"1","key":"R14","doi-asserted-by":"publisher","DOI":"10.1186\/s12888-025-06737-z","article-title":"Treatment expectancy and credibility as predictors of concentrated exposure treatment outcomes in patients with difficult-to-treat obsessive-compulsive disorder","volume":"25","author":"Berg","journal-title":"BMC Psychiatry"},{"key":"R15","doi-asserted-by":"publisher","DOI":"10.1016\/j.brat.2018.03.007","article-title":"What matters more? Common or specific factors in cognitive behavioral therapy for OCD: therapeutic alliance and expectations as predictors of treatment outcome","volume":"105","author":"Strauss","journal-title":"Behav Res Ther"},{"issue":"1","key":"R16","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-025-02230-9","article-title":"A randomized clinical trial of app cognitive behavior therapy vs. HealthWatch for obsessive compulsive disorder","volume":"8","author":"Wilhelm","journal-title":"NPJ Digit Med"},{"issue":"7","key":"R17","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2020.10791","article-title":"A machine learning approach to understanding patterns of engagement with internet-delivered mental health interventions","volume":"3","author":"Chien","journal-title":"JAMA Netw Open"},{"key":"R18","doi-asserted-by":"publisher","DOI":"10.2196\/47198","article-title":"User engagement clusters of an 8-week digital mental health intervention guided by a relational agent (Woebot): exploratory study","volume":"25","author":"Hoffman","journal-title":"J Med Internet Res"},{"issue":"12","key":"R19","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0053244","article-title":"The effectiveness of an online support group for members of the community with depression: a randomised controlled trial","volume":"7","author":"Griffiths","journal-title":"PLoS One"},{"issue":"7624","key":"R20","doi-asserted-by":"publisher","first-page":"806","DOI":"10.1136\/bmj.39335.541782.AD","article-title":"Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies","volume":"335","author":"von Elm","journal-title":"BMJ"},{"issue":"Suppl 20","key":"R21","first-page":"22","volume":"59 Suppl 20","author":"Sheehan","journal-title":"J Clin Psychiatry"},{"key":"R22","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2019.103208","article-title":"The REDCap consortium: building an international community of software platform partners","volume":"95","author":"Harris","journal-title":"J Biomed Inform"},{"issue":"2","key":"R23","doi-asserted-by":"publisher","first-page":"377","DOI":"10.1016\/j.jbi.2008.08.010","article-title":"Research Electronic Data Capture (REDCap)\u2014a metadata-driven methodology and workflow process for providing translational research informatics support","volume":"42","author":"Harris","journal-title":"J Biomed Inform"},{"key":"R24","unstructured":"Posner K Brent D Lucas C et al. Columbia-suicide severity rating scale (c-SSRS) [database record]. APA PsycTests; 2007. URL: https:\/\/cssrs.columbia.edu\/wp-content\/uploads\/C-SSRS-Baseline-Screening_AU5.1_eng-USori-2026.pdf [Accessed 12-10-2026]"},{"key":"R25","unstructured":"American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. Fifth Edition, Text Revision ed. American Psychiatric Association; 2022:978. ISBN: 978-0-89042-575-6"},{"issue":"11","key":"R26","doi-asserted-by":"publisher","first-page":"1006","DOI":"10.1001\/archpsyc.1989.01810110048007","article-title":"The Yale-Brown Obsessive Compulsive Scale. I. Development, use, and reliability","volume":"46","author":"Goodman","journal-title":"Arch Gen Psychiatry"},{"key":"R27","doi-asserted-by":"publisher","DOI":"10.1016\/j.comppsych.2015.08.007","article-title":"Defining clinical severity in adults with obsessive-compulsive disorder","volume":"63","author":"Storch","journal-title":"Compr Psychiatry"},{"issue":"7","key":"R28","first-page":"28","volume":"4","author":"Busner","journal-title":"Psychiatry (Edgmont)"},{"issue":"1","key":"R29","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1002\/wps.20299","article-title":"Towards an international expert consensus for defining treatment response, remission, recovery and relapse in obsessive-compulsive disorder","volume":"15","author":"Mataix-Cols","journal-title":"World Psychiatry"},{"issue":"1","key":"R30","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.6645","article-title":"IntelliCare: an eclectic, skills-based app suite for the treatment of depression and anxiety","volume":"19","author":"Mohr","journal-title":"J Med Internet Res"},{"issue":"2","key":"R31","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1016\/s0005-7916(00)00012-4","article-title":"Psychometric properties of the credibility\/expectancy questionnaire","volume":"31","author":"Devilly","journal-title":"J Behav Ther Exp Psychiatry"},{"issue":"3","key":"R32","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1016\/0149-7189(82)90074-x","article-title":"The Client Satisfaction Questionnaire. Psychometric properties and correlations with service utilization and psychotherapy outcome","volume":"5","author":"Attkisson","journal-title":"Eval Program Plann"},{"issue":"2","key":"R33","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.5849","article-title":"Development and Validation of the User Version of the Mobile Application Rating Scale (uMARS)","volume":"4","author":"Stoyanov","journal-title":"JMIR Mhealth Uhealth"},{"issue":"1","key":"R34","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: A practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","journal-title":"J R Stat Soc Ser B Stat"},{"issue":"1","key":"R35","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1037\/ccp0000459","article-title":"Attrition and adherence in smartphone-delivered interventions for mental health problems: a systematic and meta-analytic review","volume":"88","author":"Linardon","journal-title":"J Consult Clin Psychol"},{"issue":"1","key":"R36","doi-asserted-by":"publisher","DOI":"10.1186\/s13033-023-00592-9","article-title":"Implementing digital mental health interventions at scale: one-year evaluation of a national digital CBT service in Ireland","volume":"17","author":"Harty","journal-title":"Int J Ment Health Syst"},{"issue":"1","key":"R37","doi-asserted-by":"publisher","DOI":"10.2196\/mental.3935","article-title":"mHealth in the wild: using novel data to examine the reach, use, and impact of PTSD coach","volume":"2","author":"Owen","journal-title":"JMIR Ment Health"},{"issue":"1","key":"R38","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1186\/s44247-024-00105-9","article-title":"Engagement and retention in digital mental health interventions: a narrative review","volume":"2","author":"Boucher","journal-title":"BMC Digit Health"},{"issue":"5","key":"R39","doi-asserted-by":"publisher","first-page":"485","DOI":"10.1080\/00223980.2025.2591890","article-title":"Relationships between conscientiousness and obsessive-compulsive symptoms: evidence from a bi-factor model","volume":"160","author":"Zhang","journal-title":"J Psychol"},{"issue":"3","key":"R40","doi-asserted-by":"publisher","first-page":"254","DOI":"10.7334\/psicothema2015.7","article-title":"Obsessive-compulsive disorder and its relationship with disgust vulnerability and conscientiousness","volume":"27","author":"Inchausti","journal-title":"Psicothema"},{"issue":"3","key":"R41","doi-asserted-by":"publisher","first-page":"327","DOI":"10.1017\/S1352465819000675","article-title":"Modelling OCD: a test of the inflated responsibility model","volume":"48","author":"Mitchell","journal-title":"Behav Cogn Psychother"},{"issue":"2","key":"R42","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1080\/16506073.2023.2277121","article-title":"The relationships between perfectionism and symptoms of depression, anxiety and obsessive-compulsive disorder in adults: a systematic review and meta-analysis","volume":"53","author":"Callaghan","journal-title":"Cogn Behav Ther"},{"issue":"5","key":"R43","doi-asserted-by":"publisher","first-page":"394","DOI":"10.1002\/cpp.1842","article-title":"Incompleteness as a link between obsessive-compulsive personality traits and specific symptom dimensions of obsessive-compulsive disorder","volume":"21","author":"Ecker","journal-title":"Clin Psychol Psychother"},{"issue":"7","key":"R44","doi-asserted-by":"publisher","first-page":"836","DOI":"10.1037\/amp0000983","article-title":"Engagement in digital interventions","volume":"77","author":"Nahum-Shani","journal-title":"Am Psychol"},{"key":"R45","doi-asserted-by":"publisher","DOI":"10.1016\/j.jadr.2021.100267","article-title":"Effectiveness and feasibility of intensive versus regular cognitive behaviour therapy in patients with anxiety and obsessive-compulsive disorders: A meta-analysis","volume":"6","author":"Remmerswaal","journal-title":"J Affect Disord Rep"},{"key":"R46","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2023.06.038","article-title":"Improving adherence to unguided Internet-based therapy for obsessive-compulsive disorder: a randomized controlled trial","volume":"338","author":"Jelinek","journal-title":"J Affect Disord"},{"issue":"12","key":"R47","doi-asserted-by":"publisher","first-page":"1168","DOI":"10.1037\/hea0000805","article-title":"Dose-response research in digital health interventions: concepts, considerations, and challenges","volume":"38","author":"McVay","journal-title":"Health Psychol"},{"issue":"1","key":"R48","doi-asserted-by":"publisher","DOI":"10.2196\/25586","article-title":"Dose-response effects of patient engagement on health outcomes in an mHealth intervention: secondary analysis of a randomized controlled trial","volume":"10","author":"Li","journal-title":"JMIR Mhealth Uhealth"},{"issue":"2","key":"R49","doi-asserted-by":"publisher","first-page":"173","DOI":"10.1891\/088983905780907216","article-title":"Effectiveness of cognitive therapy for obsessive-compulsive disorder: an open trial","volume":"19","author":"Wilhelm","journal-title":"J Cogn Psychother"},{"issue":"4","key":"R50","doi-asserted-by":"publisher","first-page":"294","DOI":"10.1891\/0889-8391.23.4.294","article-title":"Modular cognitive therapy for obsessive-compulsive disorder: a wait-list controlled trial","volume":"23","author":"Wilhelm","journal-title":"J Cogn Psychother"},{"issue":"4","key":"R51","doi-asserted-by":"publisher","first-page":"473","DOI":"10.1037\/pst0000169","article-title":"A meta-analysis of the association between patients\u2019 early treatment outcome expectation and their posttreatment outcomes","volume":"55","author":"Constantino","journal-title":"Psychotherapy (Chic)"},{"issue":"4","key":"R52","doi-asserted-by":"publisher","first-page":"839","DOI":"10.1016\/j.beth.2018.12.008","article-title":"Predictors of response to cognitive-behavioral therapy for body dysmorphic disorder","volume":"50","author":"Greenberg","journal-title":"Behav Ther"},{"issue":"9","key":"R53","doi-asserted-by":"publisher","first-page":"595","DOI":"10.1037\/ccp0000969","article-title":"Credibility and expectations: Important factors for understanding clinical response, treatment completion, and dropout in internet-delivered psychological interventions","volume":"93","author":"Dear","journal-title":"J Consult Clin Psychol"}],"container-title":["JMIR Formative Research"],"original-title":[],"language":"en","deposited":{"date-parts":[[2026,10,19]],"date-time":"2026-10-19T20:03:51Z","timestamp":1792440231000},"score":1,"resource":{"primary":{"URL":"https:\/\/formative.jmir.org\/2026\/1\/e98129"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10,19]]},"references-count":53,"URL":"https:\/\/doi.org\/10.2196\/98129","relation":{},"ISSN":["2561-326X"],"issn-type":[{"value":"2561-326X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10,19]]},"article-number":"v10i1e98129"}}