{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,6]],"date-time":"2026-10-06T07:01:12Z","timestamp":1791270072573,"version":"4.1.0"},"reference-count":38,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Med Internet Res"],"abstract":"\n Background<\/jats:title>\n Ecological momentary assessment (EMA) is a measurement methodology that involves the repeated collection of real-time data on participants\u2019 behavior and experience in their natural environment. While EMA allows researchers to gain valuable insights into dynamic behavioral processes, the need for frequent self-reporting can be burdensome and disruptive. Compliance with EMA protocols is important for accurate, unbiased sampling; yet, there is no \u201cgold standard\u201d for EMA study design to promote compliance.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n The purpose of this study was to use a factorial design to identify optimal study design factors, or combinations of factors, for achieving the highest completion rates for smartphone-based EMAs.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n Participants recruited from across the United States were randomized to 1 of 2 levels on each of 5 design factors in a 2\u00d72\u00d72\u00d72\u00d72 design (32 conditions): factor 1\u2014number of questions per EMA survey (15 vs 25); factor 2\u2014number of EMAs per day (2 vs 4); factor 3\u2014EMA prompting schedule (random vs fixed times); factor 4\u2014payment type (US $1 paid per EMA vs payment based on the percentage of EMAs completed); and factor 5\u2014EMA response scale type (ie, slider-type response scale vs Likert-type response scale; this is the only within-person factor; each participant was randomized to complete slider- or Likert-type questions for the first 14 days or second 14 days of the study period). All participants were asked to complete prompted EMAs for 28 days. The effect of each factor on EMA completion was examined, as well as the effects of factor interactions on EMA completion. Finally, relations between demographic and socioenvironmental factors and EMA completion were examined.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n Participants (N=411) were aged 48.4 (SD 12.1) years; 75.7% (311\/411) were female, 72.5% (298\/411) were White, 18.0% (74\/411) were Black or African American, 2.7% (11\/411) were Asian, 1.5% (6\/411) were American Indian or Alaska Native, 5.4% (22\/411) belonged to more than one race, and 9.6% (38\/396) were Hispanic\/Latino. On average, participants completed 83.8% (28,948\/34,552) of scheduled EMAs, and 96.6% (397\/411) of participants completed the follow-up survey. Results indicated that there were no significant main effects of the design factors on compliance and no significant interactions. Analyses also indicated that older adults, those without a history of substance use problems, and those without current depression tended to complete more EMAs than their counterparts. No other demographic or socioenvironmental factors were related to EMA completion rates. Finally, the app was well liked (ie, system usability scale score=82.7), and there was a statistically significant positive association between liking the app and EMA compliance.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n Study results have broad implications for developing best practices guidelines for future studies that use EMA methodologies.<\/jats:p>\n <\/jats:sec>\n \n Trial Registration<\/jats:title>\n ClinicalTrials.gov number NCT05194228; https:\/\/clinicaltrials.gov\/study\/NCT05194228<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/50275","type":"journal-article","created":{"date-parts":[[2024,8,12]],"date-time":"2024-08-12T14:00:36Z","timestamp":1723471236000},"page":"e50275","source":"Crossref","is-referenced-by-count":39,"title":["Investigating Best Practices for Ecological Momentary Assessment: Nationwide Factorial Experiment"],"prefix":"10.2196","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9038-2238","authenticated-orcid":false,"given":"Michael S","family":"Businelle","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5922-164X","authenticated-orcid":false,"given":"Emily T","family":"H\u00e9bert","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5652-3818","authenticated-orcid":false,"given":"Dingjing","family":"Shi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9895-5283","authenticated-orcid":false,"given":"Lizbeth","family":"Benson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8387-2781","authenticated-orcid":false,"given":"Krista M","family":"Kezbers","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5638-4363","authenticated-orcid":false,"given":"Sarah","family":"Tonkin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9876-5460","authenticated-orcid":false,"given":"Megan E","family":"Piper","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4282-7826","authenticated-orcid":false,"given":"Tianchen","family":"Qian","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2024,8,12]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.clinpsy.3.022806.091415"},{"issue":"3","key":"ref2","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1093\/abm\/16.3.199","volume":"16","author":"Stone, AA","year":"1994","journal-title":"Ann Behav Med"},{"key":"ref3","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0089911"},{"key":"ref4","doi-asserted-by":"publisher","DOI":"10.1037\/0021-843X.114.4.661"},{"key":"ref5","doi-asserted-by":"publisher","DOI":"10.1007\/s12160-017-9897-x"},{"key":"ref6","doi-asserted-by":"publisher","DOI":"10.1007\/s12160-014-9594-y"},{"key":"ref7","doi-asserted-by":"publisher","DOI":"10.1037\/abn0000473"},{"key":"ref8","doi-asserted-by":"publisher","DOI":"10.1111\/add.14503"},{"key":"ref9","doi-asserted-by":"publisher","DOI":"10.1016\/s0304-3959(03)00040-x"},{"key":"ref10","doi-asserted-by":"publisher","DOI":"10.1177\/1073191120957102"},{"key":"ref11","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-021-01683-6"},{"key":"ref12","doi-asserted-by":"publisher","DOI":"10.1037\/pas0000662"},{"key":"ref13","doi-asserted-by":"publisher","DOI":"10.1177\/10731911211032718"},{"key":"ref14","doi-asserted-by":"publisher","DOI":"10.2196\/14475"},{"key":"ref15","doi-asserted-by":"publisher","DOI":"10.2196\/17023"},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2008.08.010"},{"key":"ref17","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2008.03.014"},{"key":"ref18","doi-asserted-by":"publisher","DOI":"10.1037\/a0036216"},{"key":"ref19","doi-asserted-by":"publisher","DOI":"10.1111\/j.1525-1497.2006.00532.x"},{"key":"ref20","doi-asserted-by":"publisher","DOI":"10.1080\/10447310802205776"},{"key":"ref21","unstructured":"SauroJMeasuring Usability with the System Usability Scale (SUS)20112024-06-26https:\/\/measuringu.com\/sus\/"},{"key":"ref22","doi-asserted-by":"publisher","DOI":"10.1016\/s0306-4603(97)00063-4"},{"key":"ref23","doi-asserted-by":"publisher","DOI":"10.1037\/a0022797"},{"key":"ref24","doi-asserted-by":"publisher","DOI":"10.1037\/\/0022-3514.74.6.1670"},{"key":"ref25","doi-asserted-by":"publisher","DOI":"10.1037\/\/0022-006x.64.2.366"},{"key":"ref26","doi-asserted-by":"publisher","DOI":"10.1037\/a0035153"},{"key":"ref27","doi-asserted-by":"publisher","DOI":"10.1016\/j.addbeh.2010.07.001"},{"issue":"2","key":"ref28","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1037\/0021-843X.109.2.198","volume":"109","author":"Swendsen, JD","year":"2000","journal-title":"J Abnorm Psychol"},{"key":"ref29","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.5137"},{"key":"ref30","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.6058"},{"key":"ref31","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.6307"},{"key":"ref32","unstructured":"MohadisHMAliNMA study of smartphone usage and barriers among the elderly20143rd International Conference on User Science and Engineering (i-USEr)2014 November 14Bangi, Malaysia"},{"key":"ref33","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1007\/978-3-030-75867-7_4","author":"Paschoarelli, L","year":"2021","journal-title":"Perspectives on Design and Digital Communication II: Research, Innovations and Best Practices"},{"key":"ref34","doi-asserted-by":"publisher","DOI":"10.2196\/11398"},{"key":"ref35","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpsychires.2009.01.014"},{"key":"ref36","unstructured":"TaylorPMobile operating systems' market share worldwide from 1st quarter 2009 to 4th quarter 2022 20232024-06-26https:\/\/www.statista.com\/statistics\/272698\/global-market-share-held-by-mobile-operating-systems-since-2009\/"},{"key":"ref37","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2022.09.003"},{"key":"ref38","doi-asserted-by":"publisher","DOI":"10.1093\/pubmed\/fdaa250"}],"container-title":["Journal of Medical Internet Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jmir.org\/2024\/1\/e50275","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T17:32:51Z","timestamp":1782840771000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jmir.org\/2024\/1\/e50275"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,12]]},"references-count":38,"URL":"https:\/\/doi.org\/10.2196\/50275","relation":{"has-preprint":[{"id-type":"doi","id":"10.2196\/preprints.50275","asserted-by":"object"}]},"ISSN":["1438-8871"],"issn-type":[{"value":"1438-8871","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,12]]}}}