{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,22]],"date-time":"2026-06-22T08:53:05Z","timestamp":1782118385974,"version":"3.54.5"},"reference-count":38,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2026,2,16]],"date-time":"2026-02-16T00:00:00Z","timestamp":1771200000000},"content-version":"vor","delay-in-days":46,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"},{"start":{"date-parts":[[2026,1,1]],"date-time":"2026-01-01T00:00:00Z","timestamp":1767225600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Clin Psychology and Psychoth"],"published-print":{"date-parts":[[2026,1]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n                  <jats:p>Self\u2010guided digital mental health apps often show high attrition, highlighting the need to understand engagement beyond behavioural metrics. The Homework Rating Scale\u2014Mobile Application (HRS\u2010MA) was developed to assess cognitive, emotional and attitudinal aspects of engagement. This study evaluated its psychometric properties. The HRS\u2010MA was integrated into the MoodMission app and administered after 30\u2009days of use, alongside additional self\u2010report measures. Data from 2100 users were analysed for reliability, construct, convergent, divergent and predictive validity. The HRS\u2010MA showed excellent internal consistency (Cronbach's \u03b1\u2009=\u20090.90; McDonald's \u03c9\u2009=\u20090.94). Factor analyses supported a two\u2010factor structure\u2014engagement and difficulty and obstacles. The measure demonstrated strong convergent and divergent validity and modest predictive validity. A derived coefficient of psychological effort, representing the interaction between engagement and perceived barriers, significantly predicted symptom reduction, particularly in depression. The HRS\u2010MA is a psychometrically sound tool for capturing cognitive and attitudinal dimensions of engagement in digital interventions. It complements behavioural indicators by offering a more comprehensive view of user experience and effort, providing researchers and developers with a valuable framework for optimizing mental health app design and evaluation.<\/jats:p>","DOI":"10.1002\/cpp.70239","type":"journal-article","created":{"date-parts":[[2026,2,16]],"date-time":"2026-02-16T09:24:00Z","timestamp":1771233840000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Psychometric Evaluation of the Homework Rating Scale\u2014Mobile Application: Reliability and Predictive Validity for Assessing Engagement in Smartphone\u2010Delivered Cognitive Behavioural Therapy"],"prefix":"10.1002","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6321-4450","authenticated-orcid":false,"given":"Danilo","family":"Moggia","sequence":"first","affiliation":[{"name":"Serra Hunter Fellow Autonomous University of Barcelona  Barcelona Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5141-3847","authenticated-orcid":false,"given":"Wolfgang","family":"Lutz","sequence":"additional","affiliation":[{"name":"Department of Clinical Psychology and Psychotherapy Trier University  Trier Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0343-1100","authenticated-orcid":false,"given":"David","family":"Bakker","sequence":"additional","affiliation":[{"name":"Monash University  Melbourne Australia"},{"name":"University of Tasmania  Hobart Australia"},{"name":"Cognitive Behavior Therapy Network  Adelaide Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4695-4953","authenticated-orcid":false,"given":"Brian","family":"Schwartz","sequence":"additional","affiliation":[{"name":"Department of Clinical Psychology and Psychotherapy Trier University  Trier Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9559-4160","authenticated-orcid":false,"given":"Nikolaos","family":"Kazantzis","sequence":"additional","affiliation":[{"name":"Cognitive Behavior Therapy Network  Adelaide Australia"},{"name":"Beck Institute for Cognitive Behavior Therapy  Philadelphia Pennsylvania USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2026,2,16]]},"reference":[{"key":"e_1_2_10_2_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1352465820000922"},{"key":"e_1_2_10_3_1","doi-asserted-by":"publisher","DOI":"10.3991\/ijim.v14i03.11233"},{"key":"e_1_2_10_4_1","doi-asserted-by":"publisher","DOI":"10.1186\/s40359\u2010017\u20100172\u20105"},{"key":"e_1_2_10_5_1","unstructured":"Bakker D. andN.Kazantzis.2020.Homework Rating Scale\u2014Mobile Application Version (HRS\u2010MA) [Measurement Instrument]. Cognitive Behavior Therapy Research Unit.https:\/\/www.cbtru.com."},{"key":"e_1_2_10_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.brat.2018.08.003"},{"key":"e_1_2_10_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cbpra.2018.07.002"},{"key":"e_1_2_10_8_1","doi-asserted-by":"publisher","DOI":"10.1111\/ap.12383"},{"key":"e_1_2_10_9_1","doi-asserted-by":"publisher","DOI":"10.2196\/27791"},{"key":"e_1_2_10_10_1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.9275"},{"key":"e_1_2_10_11_1","volume-title":"Mobile Application Rating Scale (MARS)","author":"Hides L.","year":"2014"},{"key":"e_1_2_10_12_1","doi-asserted-by":"publisher","DOI":"10.1080\/10503307.2023.2267166"},{"key":"e_1_2_10_13_1","doi-asserted-by":"publisher","DOI":"10.1080\/10705519909540118"},{"key":"e_1_2_10_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.psc.2024.03.002"},{"key":"e_1_2_10_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.psc.2017.08.001"},{"key":"e_1_2_10_16_1","doi-asserted-by":"publisher","DOI":"10.1002\/jclp.10239"},{"key":"e_1_2_10_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10608\u2010021\u201010247\u2010z"},{"key":"e_1_2_10_18_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022\u2010006X.69.6.1079"},{"key":"e_1_2_10_19_1","doi-asserted-by":"publisher","DOI":"10.1046\/j.1525\u20101497.2001.016009606.x"},{"key":"e_1_2_10_20_1","doi-asserted-by":"publisher","DOI":"10.1080\/00050067.2024.2315025"},{"key":"e_1_2_10_21_1","doi-asserted-by":"publisher","DOI":"10.1002\/wps.21183"},{"key":"e_1_2_10_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40501\u2010023\u201000297\u20103"},{"issue":"2","key":"e_1_2_10_23_1","first-page":"80","article-title":"Smartphones: Fulfilling the Need for Immediacy in Everyday Life, but at What Cost","volume":"4","author":"Lundquist A. R.","year":"2014","journal-title":"International Journal of Humanities and Social Science"},{"key":"e_1_2_10_24_1","doi-asserted-by":"publisher","DOI":"10.1002\/jcad.12535"},{"key":"e_1_2_10_25_1","doi-asserted-by":"publisher","DOI":"10.1177\/0093854813480781"},{"key":"e_1_2_10_26_1","doi-asserted-by":"publisher","DOI":"10.1080\/10503307.2023.2286993"},{"key":"e_1_2_10_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.beth.2023.05.014"},{"key":"e_1_2_10_28_1","doi-asserted-by":"publisher","DOI":"10.1192\/bjo.2020.72"},{"key":"e_1_2_10_29_1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.8598"},{"key":"e_1_2_10_30_1","doi-asserted-by":"publisher","DOI":"10.1002\/jclp.22227"},{"key":"e_1_2_10_31_1","doi-asserted-by":"publisher","DOI":"10.1001\/archinte.166.10.1092"},{"key":"e_1_2_10_32_1","unstructured":"StekhovenD. J.2013.MissForest: Nonparametric Missing Value Imputation Using Random Forest. R Package Version 1.4.https:\/\/cran.rproject.org\/web\/packages\/missForest\/missForest.pdf."},{"key":"e_1_2_10_33_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btr597"},{"key":"e_1_2_10_34_1","doi-asserted-by":"publisher","DOI":"10.2196\/mhealth.3422"},{"key":"e_1_2_10_35_1","doi-asserted-by":"publisher","DOI":"10.2196\/mental.5283"},{"key":"e_1_2_10_36_1","doi-asserted-by":"publisher","DOI":"10.2196\/resprot.5841"},{"key":"e_1_2_10_37_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41746\u2010021\u201000386\u20108"},{"key":"e_1_2_10_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10608-019-10059-2"},{"key":"e_1_2_10_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10608\u2010019\u201010036\u20109"}],"updated-by":[{"DOI":"10.1002\/cpp.70302","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2026,6,22]],"date-time":"2026-06-22T00:00:00Z","timestamp":1782086400000}}],"container-title":["Clinical Psychology &amp; Psychotherapy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/cpp.70239","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/cpp.70239","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/cpp.70239","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,8]],"date-time":"2026-03-08T09:43:27Z","timestamp":1772963007000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/cpp.70239"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1]]},"references-count":38,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,1]]}},"alternative-id":["10.1002\/cpp.70239"],"URL":"https:\/\/doi.org\/10.1002\/cpp.70239","archive":["Portico"],"relation":{},"ISSN":["1063-3995","1099-0879"],"issn-type":[{"value":"1063-3995","type":"print"},{"value":"1099-0879","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1]]},"assertion":[{"value":"2025-12-03","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-02-02","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-02-16","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e70239"}}