{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,22]],"date-time":"2026-10-22T17:43:33Z","timestamp":1792691013700,"version":"4.5.0"},"reference-count":114,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Med Internet Res"],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Ecological momentary assessment (EMA) is increasingly being incorporated into intervention studies to acquire a more fine-grained and ecologically valid assessment of change. The added utility of including relatively burdensome EMA measures in a clinical trial hinges on several psychometric assumptions, including that these measure are (1) reliable, (2) related to but not redundant with conventional self-report measures (convergent and discriminant validity), (3) sensitive to intervention-related change, and (4) associated with a clinically relevant criterion of improvement (criterion validity) above conventional self-report measures (incremental validity).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>This study aimed to evaluate the reliability, validity, and sensitivity to change of conventional self-report versus EMA measures of rumination improvement.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We conducted a secondary analysis of data from 4 trials of app-based meditation interventions (N=412). Participants included adolescents (samples 1-2; n=232, 56.3%; aged 12-15 years), college students (sample 3; n=88, 21.4%; aged 18-21 years), and adults (sample 4; n=92, 22.3%; aged 18-80 years). All participants completed validated conventional self-report rumination measures (Children\u2019s Response Styles Questionnaire, Response Styles Questionnaire, or Perseverative Thinking Questionnaire) at baseline and the postintervention time point and EMA rumination assessments throughout 3- to 4-week intervention periods (mean compliance 72.2%-80.2%). We examined the reliability of conventional self-report and EMA measures, computed correlations between measurement approaches, compared rumination improvement using standardized effect sizes, and tested criterion validity by predicting depression symptom improvement.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Reliability of conventional self-report rumination was high at baseline (Cronbach \u03b1=0.89-0.94) and the postintervention time point (Cronbach \u03b1=0.90-0.95) but decreased for residualized change scores (\u03c1= 0.71-0.90). EMA rumination showed high mean-level reliability (\u03c1=0.89-0.96) but substantially lower reliability for change scores (\u03c1=0.50-0.77). Conventional self-report and EMA measures showed medium correlations at individual time points (r=0.28-0.47; P&lt;.01 in all cases) but nonsignificant correlations between change scores (Child and Adolescent Research in Emotion samples: r=0.03 and P=.66; Healthy Minds Program sample: r=0.20 and P=.06). Conventional self-report detected larger intervention effects than EMA measures (Cohen d=0.37 vs 0.14 for group differences; Cohen d=0.77 vs 0.17 for pretest-posttest change). Despite modest intercorrelations, both measurement approaches demonstrated incremental predictive validity for depression improvement. In the Child and Adolescent Research in Emotion samples, improvements in both conventional rumination (b=0.04; SE 0.017; P=.03) and EMA rumination (b=0.03; SE 0.014; P=.04) significantly predicted reduced depression symptoms until the 12-week follow-up. Similarly, in the Healthy Minds Program sample, both conventional rumination change (b=0.23; SE 0.060; P&lt;.001) and EMA rumination change (b=20.49; SE 9.94; P=.04) predicted depression improvement.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Conventional self-report and EMA measures of rumination provide distinct and clinically meaningful information. When deciding to use EMA in intervention studies, researchers should carefully consider the psychometric properties of their measures and the precise construct they intend to capture.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.2196\/69297","type":"journal-article","created":{"date-parts":[[2025,7,16]],"date-time":"2025-07-16T20:45:09Z","timestamp":1752698709000},"page":"e69297","source":"Crossref","is-referenced-by-count":10,"title":["Ecological Momentary Assessment as a Measure of Intervention Change: Evaluation in 4 Digital Mental Health Trials"],"prefix":"10.2196","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8310-4539","authenticated-orcid":false,"given":"Christian A","family":"Webb","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6767-0445","authenticated-orcid":false,"given":"Lori M","family":"Hilt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-6373-4997","authenticated-orcid":false,"given":"Caroline M","family":"Swords","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7593-4439","authenticated-orcid":false,"given":"Daniel M","family":"Bolt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3421-3966","authenticated-orcid":false,"given":"Hadar","family":"Fisher","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6888-0126","authenticated-orcid":false,"given":"Simon B","family":"Goldberg","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2025,9,9]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","DOI":"10.1016\/j.beth.2021.03.004"},{"key":"ref2","doi-asserted-by":"publisher","DOI":"10.2196\/11845"},{"key":"ref3","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpsychires.2016.01.011"},{"key":"ref4","doi-asserted-by":"publisher","DOI":"10.1002\/eat.23324"},{"key":"ref5","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpsychires.2021.02.012"},{"key":"ref6","doi-asserted-by":"publisher","DOI":"10.1007\/s12671-021-01719-0"},{"key":"ref7","doi-asserted-by":"publisher","DOI":"10.1037\/ccp0000763"},{"key":"ref8","doi-asserted-by":"publisher","DOI":"10.1037\/ccp0000830"},{"key":"ref9","doi-asserted-by":"publisher","DOI":"10.1038\/npp.2008.66"},{"key":"ref10","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1007\/978-0-387-09488-5_8","author":"Stone, AA","year":"2010","journal-title":"Handbook of Behavioral Medicine: Methods and Applications"},{"key":"ref11","doi-asserted-by":"publisher","DOI":"10.1097\/YCO.0000000000000267"},{"key":"ref12","author":"Beck, AT","year":"1996","journal-title":"Manual for the Beck Depression Inventory-II"},{"issue":"2","key":"ref13","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/S0749-3797(18)30622-6","volume":"10","author":"Andresen, EM","year":"1994","journal-title":"Am J Prev Med"},{"key":"ref14","doi-asserted-by":"publisher","DOI":"10.1136\/jnnp.23.1.56"},{"key":"ref15","unstructured":"PoznanskiEOMokrosHBChildren's Depression Rating Scale, revised (CDRS-R)Western Psychological Services19962024-05-29https:\/\/eprovide.mapi-trust.org\/instruments\/children-s-depression-rating-scale-revised"},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.1037\/\/0021-843x.100.4.569"},{"key":"ref17","doi-asserted-by":"publisher","DOI":"10.1023\/a:1019873015594"},{"key":"ref18","doi-asserted-by":"publisher","DOI":"10.1111\/1467-8624.00200"},{"key":"ref19","doi-asserted-by":"publisher","DOI":"10.1097\/j.pain.0000000000000102"},{"key":"ref20","doi-asserted-by":"publisher","DOI":"10.1016\/j.pain.2008.03.024"},{"key":"ref21","doi-asserted-by":"publisher","DOI":"10.1007\/BF03003071"},{"key":"ref22","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejpain.2010.02.011"},{"key":"ref23","doi-asserted-by":"publisher","DOI":"10.1080\/09658211.2019.1640252"},{"key":"ref24","doi-asserted-by":"publisher","DOI":"10.1016\/j.pain.2003.09.020"},{"key":"ref25","doi-asserted-by":"publisher","DOI":"10.1037\/pspp0000248"},{"key":"ref26","doi-asserted-by":"publisher","DOI":"10.1037\/emo0001031"},{"key":"ref27","doi-asserted-by":"publisher","DOI":"10.1177\/0956797614551004"},{"key":"ref28","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9280.1993.tb00589.x"},{"key":"ref29","doi-asserted-by":"publisher","DOI":"10.1016\/s0304-3959(03)00003-4"},{"key":"ref30","doi-asserted-by":"publisher","DOI":"10.1016\/0304-3959(96)02994-6"},{"key":"ref31","doi-asserted-by":"publisher","DOI":"10.1097\/PSY.0b013e3182546f18"},{"key":"ref32","doi-asserted-by":"publisher","DOI":"10.1037\/a0017823"},{"key":"ref33","doi-asserted-by":"publisher","DOI":"10.1037\/rev0000394"},{"key":"ref34","doi-asserted-by":"publisher","DOI":"10.1037\/\/0022-3514.83.1.198"},{"key":"ref35","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.psych.53.100901.135114"},{"key":"ref36","doi-asserted-by":"publisher","DOI":"10.1002\/bdm.1755"},{"key":"ref37","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0201655"},{"key":"ref38","doi-asserted-by":"publisher","DOI":"10.1037\/met0000312"},{"key":"ref39","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1712277115"},{"key":"ref40","doi-asserted-by":"publisher","DOI":"10.1037\/pas0001108"},{"key":"ref41","doi-asserted-by":"publisher","DOI":"10.1007\/S12144-023-04773-0"},{"key":"ref42","doi-asserted-by":"publisher","DOI":"10.1177\/10731911241245793"},{"key":"ref43","doi-asserted-by":"publisher","DOI":"10.1038\/S43586-021-00055-W"},{"key":"ref44","doi-asserted-by":"publisher","DOI":"10.1016\/j.copsyc.2017.06.004"},{"key":"ref45","doi-asserted-by":"publisher","DOI":"10.1037\/emo0001545"},{"key":"ref46","doi-asserted-by":"publisher","DOI":"10.1037\/met0000536"},{"key":"ref47","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1007\/978-3-030-82965-0_7","author":"Dejonckheere, E","year":"2021","journal-title":"Affect Dynamics"},{"key":"ref48","doi-asserted-by":"publisher","DOI":"10.1080\/15374416.2022.2158840"},{"key":"ref49","doi-asserted-by":"publisher","DOI":"10.1007\/S10862-025-10196-X"},{"key":"ref50","doi-asserted-by":"publisher","DOI":"10.1037\/a0035768"},{"key":"ref51","doi-asserted-by":"publisher","DOI":"10.1016\/j.janxdis.2013.11.006"},{"key":"ref52","unstructured":"Healthy minds program app dosageNational Library of Medicine2025-05-29https:\/\/clinicaltrials.gov\/study\/NCT05229406"},{"key":"ref53","unstructured":"Healthy minds program dosage study: feasibility and acceptabilityOpen Science Framework2025-05-29https:\/\/osf.io\/fszvj?view_only=9cb1b9e67cc042f9bc7a0309e94b2f52"},{"key":"ref54","doi-asserted-by":"publisher","DOI":"10.1016\/j.drugalcdep.2009.02.013"},{"key":"ref55","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2014859117"},{"key":"ref56","doi-asserted-by":"publisher","DOI":"10.2196\/23825"},{"key":"ref57","doi-asserted-by":"publisher","DOI":"10.1037\/edu0000739"},{"key":"ref58","unstructured":"KovacsMThe Children\u2019s Depression Inventory (CDI) manualMulti-Health Systems19922025-05-29https:\/\/www.scienceopen.com\/book?vid=761e0bdc-c7a2-44a1-9730-c8aa4bed7424"},{"key":"ref59","doi-asserted-by":"publisher","DOI":"10.1037\/\/1040-3590.7.2.171"},{"key":"ref60","doi-asserted-by":"publisher","DOI":"10.1207\/s15374424jccp3403_3"},{"key":"ref61","doi-asserted-by":"publisher","DOI":"10.1002\/da.20002"},{"key":"ref62","doi-asserted-by":"publisher","DOI":"10.1177\/1073191111411667"},{"key":"ref63","doi-asserted-by":"publisher","DOI":"10.1186\/s41687-019-0127-0"},{"key":"ref64","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-6924.2008.00088.x"},{"key":"ref65","doi-asserted-by":"publisher","DOI":"10.1037\/\/0022-3514.61.1.115"},{"key":"ref66","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbtep.2006.03.002"},{"key":"ref67","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbtep.2010.12.003"},{"key":"ref68","doi-asserted-by":"publisher","DOI":"10.1007\/s10802-012-9638-3"},{"key":"ref69","doi-asserted-by":"publisher","DOI":"10.1037\/0021-843X.117.2.314"},{"key":"ref70","unstructured":"RevelleWpsych: Procedures for Psychological, Psychometric, and Personality ResearchNorthwestern University2025-08-06https:\/\/cran.r-project.org\/web\/packages\/psych\/index.html"},{"key":"ref71","doi-asserted-by":"publisher","DOI":"10.1037\/abn0000025"},{"key":"ref72","doi-asserted-by":"publisher","DOI":"10.1016\/j.jaac.2020.03.010"},{"key":"ref73","doi-asserted-by":"publisher","DOI":"10.1080\/00220973.1982.11011846"},{"key":"ref74","unstructured":"HomepageNational Center on Intensive Intervention20142024-05-06https:\/\/intensiveintervention.org\/sites\/default\/files\/APM_FAQs_2014.pdf"},{"key":"ref75","doi-asserted-by":"publisher","DOI":"10.1177\/0734282917696936"},{"key":"ref76","doi-asserted-by":"publisher","DOI":"10.1177\/1534508407313482"},{"key":"ref77","author":"Raudenbush, SW","year":"2002","journal-title":"Hierarchical Linear Models: Applications and Data Analysis Methods"},{"key":"ref78","doi-asserted-by":"publisher","DOI":"10.1177\/1073191119885019"},{"key":"ref79","unstructured":"HarrellFStatistical errors in the medical literatureStatistical Thinking2025-06-19https:\/\/www.fharrell.com\/post\/errmed\/#change"},{"key":"ref80","doi-asserted-by":"publisher","DOI":"10.1037\/a0014699"},{"key":"ref81","doi-asserted-by":"publisher","DOI":"10.1080\/02699931.2016.1262332"},{"key":"ref82","author":"Crocker, LM","year":"1986","journal-title":"Introduction to Classical and Modern Test Theory"},{"key":"ref83","author":"Cohen, J","year":"1988","journal-title":"Statistical Power Analysis for the Behavioral Science. 2 nd edition"},{"key":"ref84","doi-asserted-by":"publisher","DOI":"10.1037\/emo0000583"},{"key":"ref85","doi-asserted-by":"publisher","DOI":"10.1037\/h0029382"},{"key":"ref86","doi-asserted-by":"publisher","DOI":"10.1177\/001316448904900309"},{"key":"ref87","doi-asserted-by":"publisher","DOI":"10.1177\/0146621696020001"},{"key":"ref88","doi-asserted-by":"publisher","DOI":"10.1177\/0146167206287721"},{"key":"ref89","doi-asserted-by":"publisher","DOI":"10.1037\/pas0001178"},{"key":"ref90","doi-asserted-by":"publisher","DOI":"10.1037\/pas0001231"},{"key":"ref91","first-page":"302","author":"Shrout, PE","year":"2012","journal-title":"Handbook of Research Methods for Studying Daily Life"},{"key":"ref92","doi-asserted-by":"publisher","DOI":"10.1177\/2515245919879695"},{"key":"ref93","author":"Bolger, N","year":"2013","journal-title":"Intensive Longitudinal Methods: An Introduction to Diary and Experience Sampling Research"},{"key":"ref94","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2019.10.003"},{"key":"ref95","doi-asserted-by":"publisher","DOI":"10.1016\/j.psychres.2008.02.010"},{"key":"ref96","doi-asserted-by":"publisher","DOI":"10.1016\/j.brat.2010.03.012"},{"key":"ref97","doi-asserted-by":"publisher","DOI":"10.1037\/a0016869"},{"key":"ref98","doi-asserted-by":"publisher","DOI":"10.1177\/1948550618774772"},{"key":"ref99","doi-asserted-by":"publisher","DOI":"10.1177\/10731911211008254"},{"key":"ref100","author":"Kahneman, D","year":"2011","journal-title":"Thinking, Fast and Slow"},{"key":"ref101","doi-asserted-by":"publisher","DOI":"10.1027\/1614-0001\/a000083"},{"key":"ref102","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.clinpsy.3.022806.091415"},{"key":"ref103","doi-asserted-by":"publisher","DOI":"10.1016\/j.cpr.2019.01.002"},{"key":"ref104","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.clinpsy.3.022806.091432"},{"key":"ref105","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2753.2008.00983.x"},{"key":"ref106","doi-asserted-by":"publisher","DOI":"10.1037\/pas0000275"},{"key":"ref107","doi-asserted-by":"publisher","DOI":"10.1080\/10705511.2021.1915788"},{"key":"ref108","doi-asserted-by":"publisher","DOI":"10.1016\/j.paid.2009.05.005"},{"key":"ref109","doi-asserted-by":"publisher","DOI":"10.1037\/A0018821"},{"key":"ref110","author":"Bandalos, DL","year":"2018","journal-title":"Measurement Theory and Applications for the Social Sciences"},{"key":"ref111","doi-asserted-by":"publisher","DOI":"10.1177\/014662169602000308"},{"key":"ref112","doi-asserted-by":"publisher","DOI":"10.1177\/0013164411409929"},{"key":"ref113","doi-asserted-by":"publisher","DOI":"10.1080\/23311835.2015.1064626"},{"key":"ref114","unstructured":"Are ecological momentary assessment measures of intervention change worth the trouble? Evaluation in four digital mental health trialsOpen Science Framework2024-05-29https:\/\/osf.io\/2bnmk\/"}],"container-title":["Journal of Medical Internet Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jmir.org\/2025\/1\/e69297","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T17:56:52Z","timestamp":1782842212000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jmir.org\/2025\/1\/e69297"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,9]]},"references-count":114,"URL":"https:\/\/doi.org\/10.2196\/69297","relation":{"has-preprint":[{"id-type":"doi","id":"10.2196\/preprints.69297","asserted-by":"object"}]},"ISSN":["1438-8871"],"issn-type":[{"value":"1438-8871","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,9]]}}}