{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T22:32:27Z","timestamp":1774391547715,"version":"3.50.1"},"reference-count":77,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,11,10]],"date-time":"2023-11-10T00:00:00Z","timestamp":1699574400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000026","name":"National Institute on Drug Abuse","doi-asserted-by":"publisher","award":["R01DA014818, P50 DA054039, R01 DA039901"],"award-info":[{"award-number":["R01DA014818, P50 DA054039, R01 DA039901"]}],"id":[{"id":"10.13039\/100000026","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000054","name":"National Cancer Institute","doi-asserted-by":"publisher","award":["P30CA042014, U01 CA229437"],"award-info":[{"award-number":["P30CA042014, U01 CA229437"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010638","name":"Huntsman Cancer Institute","doi-asserted-by":"publisher","award":["F32CA232796"],"award-info":[{"award-number":["F32CA232796"]}],"id":[{"id":"10.13039\/100010638","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["UL1TR002538, 5TL1TR002540"],"award-info":[{"award-number":["UL1TR002538, 5TL1TR002540"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010637","name":"Huntsman Cancer Foundation","doi-asserted-by":"publisher","award":["\u00a0"],"award-info":[{"award-number":["\u00a0"]}],"id":[{"id":"10.13039\/100010637","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IGE-1806874"],"award-info":[{"award-number":["IGE-1806874"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Digit. Health"],"abstract":"<jats:p>Advances in digital technology have greatly increased the ease of collecting intensive longitudinal data (ILD) such as ecological momentary assessments (EMAs) in studies of behavior changes. Such data are typically multilevel (e.g., with repeated measures nested within individuals), and are inevitably characterized by some degrees of missingness. Previous studies have validated the utility of multiple imputation as a way to handle missing observations in ILD when the imputation model is properly specified to reflect time dependencies. In this study, we illustrate the importance of proper accommodation of multilevel ILD structures in performing multiple imputations, and compare the performance of a multilevel multiple imputation (multilevel MI) approach relative to other approaches that do not account for such structures in a Monte Carlo simulation study. Empirical EMA data from a tobacco cessation study are used to demonstrate the utility of the multilevel MI approach, and the implications of separating participant- and study-initiated EMAs in evaluating individuals\u2019 affective dynamics and urge.<\/jats:p>","DOI":"10.3389\/fdgth.2023.1099517","type":"journal-article","created":{"date-parts":[[2023,11,13]],"date-time":"2023-11-13T11:57:38Z","timestamp":1699876658000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Multiple imputation of missing data in multilevel ecological momentary assessments: an example using smoking cessation study data"],"prefix":"10.3389","volume":"5","author":[{"given":"Linying","family":"Ji","sequence":"first","affiliation":[]},{"given":"Yanling","family":"Li","sequence":"additional","affiliation":[]},{"given":"Lindsey N.","family":"Potter","sequence":"additional","affiliation":[]},{"given":"Cho Y.","family":"Lam","sequence":"additional","affiliation":[]},{"given":"Inbal","family":"Nahum-Shani","sequence":"additional","affiliation":[]},{"given":"David W.","family":"Wetter","sequence":"additional","affiliation":[]},{"given":"Sy-Miin","family":"Chow","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2023,11,10]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"366","DOI":"10.1037\/0022-006X.64.2.366","article-title":"First lapses to smoking: within-subjects analysis of real-time reports","volume":"64","author":"Shiffman","year":"1996","journal-title":"J Consult Clin Psychol"},{"key":"B2","doi-asserted-by":"publisher","first-page":"e6058","DOI":"10.2196\/jmir.6058","article-title":"An ecological momentary intervention for smoking cessation: evaluation of feasibility, effectiveness","volume":"18","author":"Businelle","year":"2016","journal-title":"J Med Internet Res"},{"key":"B3","doi-asserted-by":"publisher","first-page":"1049","DOI":"10.1037\/hea0000797","article-title":"Momentary precipitants connecting stress, smoking lapse during a quit attempt","volume":"38","author":"Cambron","year":"2019","journal-title":"Health Psychol"},{"key":"B4","doi-asserted-by":"publisher","first-page":"1185","DOI":"10.1080\/14622200802163118","article-title":"Ecological momentary assessment of adolescent smoking cessation: a feasibility study","volume":"10","author":"Gwaltney","year":"2008","journal-title":"Nicotine Tob Res"},{"key":"B5","doi-asserted-by":"publisher","first-page":"569","DOI":"10.1093\/ntr\/ntt190","article-title":"Individual, combined effects of multiple high-risk triggers on postcessation smoking urge and lapse","volume":"16","author":"Lam","year":"2014","journal-title":"Nicotine Tob Res"},{"key":"B6","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1016\/j.drugalcdep.2007.05.017","article-title":"Prediction of lapse from associations between smoking and situational antecedents assessed by ecological momentary assessment","volume":"91","author":"Shiffman","year":"2007","journal-title":"Drug Alcohol Depend"},{"key":"B7","doi-asserted-by":"publisher","first-page":"1038","DOI":"10.1037\/hea0000535","article-title":"The association of positive emotion and first smoking lapse: an ecological momentary assessment study","volume":"36","author":"Vinci","year":"2017","journal-title":"Health Psychol"},{"key":"B8","doi-asserted-by":"publisher","first-page":"255","DOI":"10.1136\/tc.2005.011577","article-title":"Do u smoke after txt? Results of a randomised trial of smoking cessation using mobile phone text messaging","volume":"14","author":"Rodgers","year":"2005","journal-title":"Tob Control"},{"key":"B9","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1207\/S15328007SEM0802_2","article-title":"Piecewise growth mixture modeling of adolescent alcohol use data","volume":"8","author":"Li","year":"2001","journal-title":"Struct Equ Modeling"},{"key":"B10","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1093\/jssam\/smt015","article-title":"Alternative sequential mixed-mode designs: effects on attrition rates, attrition bias, and costs","volume":"1","author":"Lynn","year":"2013","journal-title":"J Surv Stat Methodol"},{"key":"B11","doi-asserted-by":"publisher","first-page":"1541","DOI":"10.3758\/s13428-021-01683-6","article-title":"The effects of assessment intensity on participant burden, compliance, within-person variance, and within-person relationships in ambulatory assessment","volume":"54","author":"Hasselhorn","year":"2021","journal-title":"Behav Res Methods"},{"key":"B12","doi-asserted-by":"publisher","first-page":"136","DOI":"10.1177\/1073191120957102","article-title":"The effects of sampling frequency, questionnaire length on perceived burden, compliance,, careless responding in experience sampling data in a student population","volume":"29","author":"Eisele","year":"2022","journal-title":"Assessment"},{"key":"B13","doi-asserted-by":"publisher","first-page":"715","DOI":"10.1080\/10705511.2017.1417046","article-title":"Handling missing data in the modeling of intensive longitudinal data","volume":"25","author":"Ji","year":"2018","journal-title":"Struct Equ Modeling"},{"key":"B14","doi-asserted-by":"crossref","DOI":"10.1201\/9780429492259","volume-title":"Flexible imputation of missing data","author":"van Buuren","year":"2018"},{"key":"B15","volume-title":"Multiple imputation, its application","author":"Carpenter","year":"2012"},{"key":"B16","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1093\/abm\/kaz034","article-title":"Socioeconomic status, social context,, smoking lapse during a quit attempt: an ecological momentary assessment study","volume":"54","author":"Cambron","year":"2020","journal-title":"Ann Behav Med"},{"key":"B17","doi-asserted-by":"publisher","first-page":"917","DOI":"10.1037\/pspp0000083","article-title":"Personality and stressor-related affect","volume":"111","author":"Leger","year":"2016","journal-title":"J Pers Soc Psychol"},{"key":"B18","doi-asserted-by":"publisher","first-page":"138","DOI":"10.1016\/j.paid.2019.01.003","article-title":"Neuroticism and extraversion are differentially related to between-and within-person variation of daily negative emotion and physical symptoms","volume":"141","author":"Zhang","year":"2019","journal-title":"Pers Individ Dif"},{"key":"B19","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1007\/BF02294246","article-title":"A dynamic factor model for the analysis of multivariate time series","volume":"50","author":"Molenaar","year":"1985","journal-title":"Psychometrika"},{"key":"B20","doi-asserted-by":"publisher","first-page":"242","DOI":"10.1080\/00273171.2016.1277681","article-title":"Equivalent dynamic models","volume":"52","author":"Molenaar","year":"2017","journal-title":"Multivariate Behav Res"},{"key":"B21","first-page":"235","volume-title":"Dynamic factor analysis models for representing process in multivariate time-series","author":"Nesselroade","year":"2002"},{"key":"B22","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1080\/10705511.2017.1406803","article-title":"Dynamic structural equation models","volume":"25","author":"Asparouhov","year":"2018","journal-title":"Struct Equ Model"},{"key":"B23","doi-asserted-by":"publisher","first-page":"820","DOI":"10.1080\/00273171.2018.1446819","article-title":"At the frontiers of modeling intensive longitudinal data: dynamic structural equation models for the affective measurements from the cogito study","volume":"53","author":"Hamaker","year":"2018","journal-title":"Multivariate Behav Res"},{"key":"B24","doi-asserted-by":"publisher","first-page":"452","DOI":"10.1080\/10705511.2021.1911657","article-title":"Fitting multilevel vector autoregressive models in Stan, JAGS, and Mplus","volume":"29","author":"Li","year":"2022","journal-title":"Struct Equ Modeling"},{"key":"B25","doi-asserted-by":"publisher","first-page":"581","DOI":"10.1093\/biomet\/63.3.581","article-title":"Inference and missing data","volume":"63","author":"Rubin","year":"1976","journal-title":"Biometrika"},{"key":"B26","doi-asserted-by":"publisher","first-page":"631","DOI":"10.1080\/10705511.2014.937378","article-title":"Graphical representation of missing data problems","volume":"22","author":"Thoemmes","year":"2015","journal-title":"Struct Equ Modeling"},{"key":"B27","doi-asserted-by":"publisher","first-page":"1138","DOI":"10.3758\/s13428-014-0444-4","article-title":"iVAR: a program for imputing missing data in multivariate time series using vector autoregressive models","volume":"46","author":"Liu","year":"2014","journal-title":"Behav Res Methods"},{"key":"B28","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1111\/cdep.12008","article-title":"Dealing with missing data in developmental research","volume":"7","author":"Enders","year":"2013","journal-title":"Child Dev Perspect"},{"key":"B29","volume-title":"Statistical analysis with missing data","author":"Little","year":"2019"},{"key":"B30","volume-title":"Multiple imputation for nonresponse in surveys","author":"Rubin","year":"2004"},{"key":"B31","doi-asserted-by":"publisher","first-page":"473","DOI":"10.1080\/01621459.1996.10476908","article-title":"Multiple imputation after 18+ years","volume":"91","author":"Rubin","year":"1996","journal-title":"J Am Stat Assoc"},{"key":"B32","doi-asserted-by":"publisher","first-page":"71","DOI":"10.2307\/271029","article-title":"Estimation of linear models with incomplete data","volume":"17","author":"Allison","year":"1987","journal-title":"Sociol Methodol"},{"key":"B33","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1037\/1082-989X.7.2.147","article-title":"Missing data: our view of the state of the art","volume":"7","author":"Schafer","year":"2002","journal-title":"Psychol Methods"},{"key":"B34","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1037\/1082-989X.6.4.317","article-title":"The use of multiple imputation for the analysis of missing data","volume":"6","author":"Sinharay","year":"2001","journal-title":"Psychol Methods"},{"key":"B35","author":"Schafer","year":""},{"key":"B36","doi-asserted-by":"publisher","first-page":"114","DOI":"10.1186\/s12874-017-0372-y","article-title":"A comparison of multiple imputation methods for handling missing values in longitudinal data in the presence of a time-varying covariate with a non-linear association with time: a simulation study","volume":"17","author":"De Silva","year":"2017","journal-title":"BMC Med Res Methodol"},{"key":"B37","first-page":"199","article-title":"Multiple imputation as a solution to the missing data problem in the social sciences","volume":"1","author":"Tufis","year":"2008","journal-title":"Calitatea Vietii"},{"key":"B38","doi-asserted-by":"publisher","first-page":"1541","DOI":"10.1002\/sim.689","article-title":"Multiple imputation in public health research","volume":"20","author":"Zhou","year":"2001","journal-title":"Stat Med"},{"key":"B39","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4614-4018-5","volume-title":"Missing data analysis and design","author":"Graham","year":"2012"},{"key":"B40","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1177\/1094428117703686","article-title":"Multiple imputation of missing data for multilevel models: simulations and recommendations","volume":"21","author":"Grund","year":"2018","journal-title":"Organ Res Methods"},{"key":"B41","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1007\/s11121-016-0735-3","article-title":"Explicating the conditions under which multilevel multiple imputation mitigates bias resulting from random coefficient-dependent missing longitudinal data","volume":"18","author":"Gottfredson","year":"2017","journal-title":"Prev Sci"},{"key":"B42","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12874-018-0615-6","article-title":"A comparison of multiple imputation methods for missing data in longitudinal studies","volume":"18","author":"Huque","year":"2018","journal-title":"BMC Med Res Methodol"},{"key":"B43","author":"Plummer","year":""},{"key":"B44","author":"Plummer","year":""},{"key":"B45","doi-asserted-by":"crossref","DOI":"10.1201\/b16018","volume-title":"Bayesian data analysis","author":"Gelman","year":"2013"},{"key":"B46","doi-asserted-by":"crossref","DOI":"10.1515\/9780691218632","volume-title":"Time series analysis","author":"Hamilton","year":"1994"},{"key":"B47","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-540-27752-1","volume-title":"Introduction to multiple time series analysis","author":"L\u00fctkepohl","year":"2005"},{"key":"B48","doi-asserted-by":"publisher","first-page":"222","DOI":"10.1037\/met0000063","article-title":"Multilevel multiple imputation: a review and evaluation of joint modeling and chained equations imputation","volume":"21","author":"Enders","year":"2016","journal-title":"Psychol Methods"},{"key":"B49","first-page":"442","author":"Ji","year":"2020"},{"key":"B50","doi-asserted-by":"publisher","first-page":"257","DOI":"10.3102\/1076998610375833","article-title":"A comparison of imputation methods for Bayesian factor analysis models","volume":"36","author":"Merkle","year":"2011","journal-title":"J Educ Behav Stat"},{"key":"B51","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1080\/01650250444000405","article-title":"The actor-partner interdependence model: a model of bidirectional effects in developmental studies","volume":"29","author":"Cook","year":"2005","journal-title":"Int J Behav Dev"},{"key":"B52","doi-asserted-by":"publisher","first-page":"740","DOI":"10.1007\/s11336-013-9330-8","article-title":"Nonlinear regime-switching state-space (RSSS) models","volume":"78","author":"Chow","year":"2013","journal-title":"Psychometrika"},{"key":"B53","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1037\/a0017824","article-title":"Dynamic infant-parent affect coupling during the face-to-face\/still-face","volume":"10","author":"Chow","year":"2010","journal-title":"Emotion"},{"key":"B54","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1080\/00273171.2019.1627659","article-title":"A diagnostic procedure for detecting outliers in linear state-space models","volume":"55","author":"You","year":"2020","journal-title":"Multivariate Behav Res"},{"key":"B55","author":"van Buuren","year":""},{"key":"B56","author":"Vink","year":""},{"key":"B57","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1037\/hea0001036","article-title":"A time-varying model of the dynamics of smoking lapse","volume":"40","author":"Potter","year":"2021","journal-title":"Health Psychol"},{"key":"B58","doi-asserted-by":"publisher","first-page":"302","DOI":"10.5281\/zenodo.3298841","article-title":"dynr.mi: An R program for multiple imputation in dynamic modeling","volume":"13","author":"Li","year":"2019","journal-title":"Int J Comput Electr Autom Control Inf Eng"},{"key":"B59","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12874-020-01068-x","article-title":"Multiple imputation with missing indicators as proxies for unmeasured variables: simulation study","volume":"20","author":"Sperrin","year":"2020","journal-title":"BMC Med Res Methodol"},{"key":"B60","doi-asserted-by":"publisher","first-page":"2685","DOI":"10.1177\/09622802211047346","article-title":"Multiple imputation with missing data indicators","volume":"30","author":"Beesley","year":"2021","journal-title":"Stat Methods Med Res"},{"key":"B61","author":"Plummer","year":""},{"key":"B62","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v093.i08","article-title":"mgm: Estimating time-varying mixed graphical models in high-dimensional data","volume":"93","author":"Haslbeck","year":"2020","journal-title":"J Stat Softw"},{"key":"B63","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1080\/00273171.2020.1743630","article-title":"A tutorial on estimating time-varying vector autoregressive models","volume":"56","author":"Haslbeck","year":"2021","journal-title":"Multivariate Behav Res"},{"key":"B64","volume-title":"Mplus version 7 user\u2019s guide","author":"Muth\u00e9n","year":"2012"},{"key":"B65","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1037\/a0022640","article-title":"Missing not at random models for latent growth curve analyses","volume":"16","author":"Enders","year":"2011","journal-title":"Psychol Methods"},{"key":"B66","doi-asserted-by":"publisher","first-page":"1746","DOI":"10.1080\/03610918.2018.1506028","article-title":"Comparison of maximum likelihood approach, Diggle\u2013Kenward selection model, pattern mixture model with MAR and MNAR dropout data","volume":"49","author":"Chen","year":"2020","journal-title":"Commun Stat - Simul Comput"},{"key":"B67","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1080\/00273171.2016.1151333","article-title":"Dealing with multiple solutions in structural vector autoregressive models","volume":"51","author":"Beltz","year":"2016","journal-title":"Multivariate Behav Res"},{"key":"B68","doi-asserted-by":"publisher","first-page":"1009","DOI":"10.1027\/1015-5759\/a000612","article-title":"Affect and personality: ramifications of modeling (non-)directionality in dynamic network models","volume":"36","author":"Park","year":"2020","journal-title":"Eur J Psychol Assess"},{"key":"B69","author":"Chow","year":""},{"key":"B70","doi-asserted-by":"publisher","first-page":"214","DOI":"10.1007\/s11336-021-09767-0","article-title":"Time to intervene: a continuous-time approach to network analysis and centrality","volume":"87","author":"Ryan","year":"2022","journal-title":"Psychometrika"},{"key":"B71","doi-asserted-by":"publisher","first-page":"1299","DOI":"10.1017\/S003329171700277X","article-title":"A longitudinal mediation analysis of the effect of negative-self-schemas on positive symptoms via negative affect","volume":"48","author":"Jaya","year":"2018","journal-title":"Psychol Med"},{"key":"B72","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1037\/met0000154","article-title":"Tutorial: the practical application of longitudinal structural equation mediation models in clinical trials","volume":"23","author":"Goldsmith","year":"2018","journal-title":"Psychol Methods"},{"key":"B73","doi-asserted-by":"publisher","first-page":"331","DOI":"10.1080\/00461520.2016.1207175","article-title":"The merits of using longitudinal mediation","volume":"51","author":"Jose","year":"2016","journal-title":"Educ Psychol"},{"key":"B74","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1080\/15427600902911247","article-title":"Mediation models for longitudinal data in developmental research","volume":"6","author":"Selig","year":"2009","journal-title":"Res Hum Dev"},{"key":"B75","volume-title":"Time series analysis by state space methods","author":"Durbin","year":"2001"},{"key":"B76","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1348\/000711010X497262","article-title":"Bayesian estimation of semiparametric dynamic latent variable models using the Dirichlet process prior","volume":"64","author":"Chow","year":"2011","journal-title":"Br J Math Stat Psychol"},{"key":"B77","author":"Li","year":""}],"container-title":["Frontiers in Digital Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdgth.2023.1099517\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,13]],"date-time":"2023-11-13T11:57:49Z","timestamp":1699876669000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdgth.2023.1099517\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,10]]},"references-count":77,"alternative-id":["10.3389\/fdgth.2023.1099517"],"URL":"https:\/\/doi.org\/10.3389\/fdgth.2023.1099517","relation":{},"ISSN":["2673-253X"],"issn-type":[{"value":"2673-253X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,10]]},"article-number":"1099517"}}