{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,20]],"date-time":"2026-06-20T21:40:36Z","timestamp":1781991636764,"version":"3.54.5"},"reference-count":47,"publisher":"Oxford University Press (OUP)","issue":"12","license":[{"start":{"date-parts":[[2018,9,28]],"date-time":"2018-09-28T00:00:00Z","timestamp":1538092800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"name":"NIH\/NIMH","award":["1DP2MH103909"],"award-info":[{"award-number":["1DP2MH103909"]}]},{"name":"Natalia Mental Health Foundation"},{"name":"Dupont-Warren Fellowship from the Harvard Medical School Department of Psychiatry"},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2018,12,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Objectives<\/jats:title><jats:p>As smartphones and sensors become more prominently used in mobile health, the methods used to analyze the resulting data must also be carefully considered. The advantages of smartphone-based studies, including large quantities of temporally dense longitudinally captured data, must be matched with the appropriate statistical methods in order draw valid conclusions. In this paper, we review and provide recommendations in 3 critical domains of analysis for these types of temporally dense longitudinal data and highlight how misleading results can arise from improper use of these methods.<\/jats:p><\/jats:sec><jats:sec><jats:title>Target Audience<\/jats:title><jats:p>Clinicians, biostatisticians, and data analysts who have digital phenotyping data or are interested in performing a digital phenotyping study or any other type of longitudinal study with frequent measurements taken over an extended period of time.<\/jats:p><\/jats:sec><jats:sec><jats:title>Scope<\/jats:title><jats:p>We cover the following topics: 1) statistical models using longitudinal repeated measures, 2) multiple comparisons of correlated tests, and 3) dimension reduction for correlated behavioral covariates. While these 3 classes of methods are frequently used in digital phenotyping data analysis, we demonstrate via actual clinical studies data that they may sometimes not perform as expected when applied to novel digital data.<\/jats:p><\/jats:sec>","DOI":"10.1093\/jamia\/ocy121","type":"journal-article","created":{"date-parts":[[2018,8,23]],"date-time":"2018-08-23T19:30:58Z","timestamp":1535052658000},"page":"1669-1674","source":"Crossref","is-referenced-by-count":45,"title":["Beyond smartphones and sensors: choosing appropriate statistical methods for the analysis of longitudinal data"],"prefix":"10.1093","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3256-5703","authenticated-orcid":false,"given":"Ian","family":"Barnett","sequence":"first","affiliation":[{"name":"Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania, Philadelphia, Pennsylvania, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John","family":"Torous","sequence":"additional","affiliation":[{"name":"Department of Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA"},{"name":"Division of Clinical Informatics, Department of Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Patrick","family":"Staples","sequence":"additional","affiliation":[{"name":"Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matcheri","family":"Keshavan","sequence":"additional","affiliation":[{"name":"Department of Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jukka-Pekka","family":"Onnela","sequence":"additional","affiliation":[{"name":"Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2018,9,28]]},"reference":[{"key":"2020110613035051400_ocy121-B1","author":"Smith","year":"2017"},{"issue":"2","key":"2020110613035051400_ocy121-B2","doi-asserted-by":"crossref","first-page":"e16.","DOI":"10.2196\/mental.5165","article-title":"New tools for new research in psychiatry: a scalable and customizable platform to empower data driven smartphone research","volume":"3","author":"Torous","year":"2016","journal-title":"JMIR Ment Health"},{"issue":"3","key":"2020110613035051400_ocy121-B3","doi-asserted-by":"crossref","first-page":"e1053","DOI":"10.1038\/tp.2017.25","article-title":"New dimensions and new tools to realize the potential of RDoC: digital phenotyping via smartphones and connected devices","volume":"7","author":"Torous","year":"2017","journal-title":"Transl Psychiatry"},{"issue":"7","key":"2020110613035051400_ocy121-B4","doi-asserted-by":"crossref","first-page":"1691","DOI":"10.1038\/npp.2016.7","article-title":"Harnessing smartphone-based digital phenotyping to enhance behavioral and mental health","volume":"41","author":"Onnela","year":"2016","journal-title":"Neuropsychopharmacol"},{"key":"2020110613035051400_ocy121-B5","first-page":"886","author":"Wang","year":"2016"},{"issue":"7","key":"2020110613035051400_ocy121-B6","doi-asserted-by":"crossref","first-page":"e175","DOI":"10.2196\/jmir.4273","article-title":"Mobile phone sensor correlates of depressive symptom severity in daily-life behavior: an exploratory study","volume":"17","author":"Saeb","year":"2015","journal-title":"J Med Internet Res"},{"issue":"3","key":"2020110613035051400_ocy121-B7","doi-asserted-by":"crossref","first-page":"160011","DOI":"10.1038\/sdata.2016.11","article-title":"The mPower study, Parkinson disease mobile data collected using ResearchKit","volume":"3","author":"Bot","year":"2016","journal-title":"Sci Data"},{"issue":"4","key":"2020110613035051400_ocy121-B8","first-page":"565","article-title":"Remote assessment of disease and relapse (RADAR-CNS)","volume":"5","author":"Garza-Rey","year":"2017","journal-title":"TMLAI"},{"issue":"9","key":"2020110613035051400_ocy121-B9","doi-asserted-by":"crossref","first-page":"e214","DOI":"10.2196\/jmir.2617","article-title":"Monitoring dietary intake and physical activity electronically: feasibility, usability, and ecological validity of a mobile-based Ecological Momentary Assessment tool","volume":"15","author":"Spook","year":"2013","journal-title":"J Med Internet Res"},{"issue":"1","key":"2020110613035051400_ocy121-B10","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1093\/biomet\/73.1.13","article-title":"Longitudinal data analysis using generalized linear models","volume":"73","author":"Liang","year":"1986","journal-title":"Biometrika"},{"issue":"421","key":"2020110613035051400_ocy121-B11","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1080\/01621459.1993.10594284","article-title":"Approximate inference in generalized linear mixed models","volume":"88","author":"Breslow","year":"1993","journal-title":"J Am Stat Assoc"},{"issue":"1","key":"2020110613035051400_ocy121-B12","first-page":"221","article-title":"The behavior of maximum likelihood estimates under nonstandard conditions","volume":"1","author":"Huber","year":"1967","journal-title":"Proc Fifth Berkeley Symp Math Stat Probab"},{"issue":"2","key":"2020110613035051400_ocy121-B13","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1214\/aoms\/1177704156","article-title":"Asymptotic normality and consistency of the least squares estimators for families of linear regressions","volume":"34","author":"Eicker","year":"1963","journal-title":"Ann Math Statist"},{"issue":"4","key":"2020110613035051400_ocy121-B14","doi-asserted-by":"crossref","first-page":"817","DOI":"10.2307\/1912934","article-title":"A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity","volume":"48","author":"White","year":"1980","journal-title":"Econometrica"},{"issue":"1","key":"2020110613035051400_ocy121-B15","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1111\/j.1541-0420.2010.01438.x","article-title":"Regularized sandwich estimators for analysis of high-dimensional data using generalized estimating equations","volume":"67","author":"Warton","year":"2011","journal-title":"Biometrics"},{"issue":"427","key":"2020110613035051400_ocy121-B16","doi-asserted-by":"crossref","first-page":"846","DOI":"10.1080\/01621459.1994.10476818","article-title":"Estimation of regression coefficients when some regressors are not always observed","volume":"89","author":"Robins","year":"1994","journal-title":"J Am Stat Assoc"},{"issue":"429","key":"2020110613035051400_ocy121-B17","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1080\/01621459.1995.10476493","article-title":"Analysis of semiparametric regression models for repeated outcomes in the presence of missing data","volume":"90","author":"James","year":"1995","journal-title":"J Am Stat Assoc"},{"issue":"1","key":"2020110613035051400_ocy121-B18","doi-asserted-by":"crossref","first-page":"49","DOI":"10.2307\/2986113","article-title":"Informative drop-out in longitudinal data analysis","volume":"43","author":"Diggle","year":"1994","journal-title":"Appl Stat"},{"issue":"421","key":"2020110613035051400_ocy121-B19","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1080\/01621459.1993.10594302","article-title":"Pattern-mixture models for multivariate incomplete data","volume":"88","author":"Little","year":"1993","journal-title":"J Am Stat Assoc"},{"issue":"3","key":"2020110613035051400_ocy121-B20","doi-asserted-by":"crossref","first-page":"471","DOI":"10.1093\/biomet\/81.3.471","article-title":"A class of pattern-mixture models for normal incomplete data","volume":"81","author":"Little","year":"1994","journal-title":"Biometrika"},{"key":"2020110613035051400_ocy121-B21","article-title":"Inferring mobility measures from GPS traces with missing data","author":"Barnett","journal-title":"arXiv preprint: arXiv:"},{"issue":"2","key":"2020110613035051400_ocy121-B22","doi-asserted-by":"crossref","first-page":"123","DOI":"10.2307\/3318584","article-title":"Sieve bootstrap for time series","volume":"3","author":"B\u00fchlmann","year":"1997","journal-title":"Bernoulli"},{"issue":"272","key":"2020110613035051400_ocy121-B23","doi-asserted-by":"crossref","first-page":"1096","DOI":"10.1080\/01621459.1955.10501294","article-title":"A multiple comparison procedure for comparing several treatments with a control","volume":"50","author":"Dunnett","year":"1955","journal-title":"J Am Stat Assoc"},{"issue":"2","key":"2020110613035051400_ocy121-B24","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1093\/biomet\/75.2.383","article-title":"A stagewise rejective multiple test procedure based on a modified Bonferroni test","volume":"75","author":"Hommel","year":"1988","journal-title":"Biometrika"},{"issue":"1","key":"2020110613035051400_ocy121-B25","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: a practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"J R Stat Soc B Methodol"},{"issue":"6","key":"2020110613035051400_ocy121-B26","doi-asserted-by":"crossref","first-page":"2013","DOI":"10.1214\/aos\/1074290335","article-title":"The positive false discovery rate: a bayesian interpretation oand the q-value","volume":"31","author":"Storey","year":"2003","journal-title":"Ann Statist"},{"issue":"1","key":"2020110613035051400_ocy121-B27","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1002\/gepi.1124","article-title":"Empirical Bayes methods and false discovery rates for microarrays","volume":"23","author":"Efron","year":"2002","journal-title":"Genet Epidemiol"},{"issue":"4","key":"2020110613035051400_ocy121-B28","doi-asserted-by":"crossref","first-page":"1165","DOI":"10.1214\/aos\/1013699998","article-title":"The control of the false discovery rate in multiple testing under dependency","volume":"29","author":"Benjamini","year":"2001","journal-title":"Ann Statist"},{"issue":"2","key":"2020110613035051400_ocy121-B29","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1111\/j.1467-9868.2008.00694.x","article-title":"Large-scale multiple testing under dependency","volume":"71","author":"Sun","year":"2009","journal-title":"J R Stat Soc B"},{"issue":"1","key":"2020110613035051400_ocy121-B30","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1111\/j.1467-9868.2004.00439.x","article-title":"Strong control, conservative pioint estimation and simultaneous conservative consistency of false discovery rates: a unified approach","volume":"66","author":"Storey","year":"2004","journal-title":"J R Stat Soc B"},{"issue":"48","key":"2020110613035051400_ocy121-B31","doi-asserted-by":"crossref","first-page":"18718","DOI":"10.1073\/pnas.0808709105","article-title":"A general framework for multiple testing dependence","volume":"105","author":"Leek","year":"2008","journal-title":"Proc Natl Acad Sci USA"},{"issue":"488","key":"2020110613035051400_ocy121-B32","doi-asserted-by":"crossref","first-page":"1406","DOI":"10.1198\/jasa.2009.tm08332","article-title":"A factor model approach to multiple testing under dependence","volume":"104","author":"Friguet","year":"2009","journal-title":"J Am Stat Assoc"},{"issue":"517","key":"2020110613035051400_ocy121-B33","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1080\/01621459.2016.1192039","article-title":"The generalized higher criticism for testing SNP-set effects in genetic association studies","volume":"112","author":"Barnett","year":"2017","journal-title":"J Am Stat Assoc"},{"issue":"39","key":"2020110613035051400_ocy121-B34","doi-asserted-by":"crossref","first-page":"14790","DOI":"10.1073\/pnas.0807471105","article-title":"Higher criticism thresholding: optimal feature selection when useful features are rare and weak","volume":"105","author":"Donoho","year":"2008","journal-title":"Proc Natl Acad Sci USA"},{"issue":"477","key":"2020110613035051400_ocy121-B35","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1198\/016214506000001211","article-title":"Correlation and large-scale simultaneous significance testing","volume":"102","author":"Efron","year":"2007","journal-title":"J Am Stat Assoc"},{"issue":"465","key":"2020110613035051400_ocy121-B36","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1198\/016214504000000089","article-title":"Large-scale simultaneous hypothesis testing:","volume":"99","author":"Efron","year":"2004","journal-title":"J Am Stat Assoc"},{"issue":"4","key":"2020110613035051400_ocy121-B37","doi-asserted-by":"crossref","first-page":"1351","DOI":"10.1214\/009053606000001460","article-title":"Size, power, and false discovery rates","volume":"35","author":"Efron","year":"2007","journal-title":"Ann Statist"},{"issue":"499","key":"2020110613035051400_ocy121-B38","doi-asserted-by":"crossref","first-page":"1019","DOI":"10.1080\/01621459.2012.720478","article-title":"Estimating false discovery proportion under arbitrary covariance dependence","volume":"107","author":"Fan","year":"2012","journal-title":"J Am Stat Assoc"},{"key":"2020110613035051400_ocy121-B39","first-page":"25","article-title":"Subspace Method in Pattern Recognition","author":"Watanabe","year":"1973","journal-title":"Proceedings of the 1st IJCPR"},{"key":"2020110613035051400_ocy121-B40","volume-title":"Principal Component Neural Networks: Theory and Applications","author":"Diamantaras","year":"1996"},{"issue":"1\u20132","key":"2020110613035051400_ocy121-B41","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1016\/S0169-7439(98)00031-8","article-title":"Missing values in principal component analysis","volume":"42","author":"Grung","year":"1998","journal-title":"Chemometr Intell Lab Syst"},{"key":"2020110613035051400_ocy121-B42","first-page":"1957","article-title":"Practical approaches to principal component analysis in the presence of missing values","volume":"11","author":"Ilin","year":"2010","journal-title":"J Mach Learn Res"},{"key":"2020110613035051400_ocy121-B43","volume-title":"Learning from Incomplete Data","author":"Ghahramani","year":"1995"},{"key":"2020110613035051400_ocy121-B44","first-page":"215","author":"Boscardin","year":"2004:"},{"key":"2020110613035051400_ocy121-B45","first-page":"115","volume-title":"Principal Component Analysis and Factor Analysis","author":"Jolliffe","year":"1986"},{"issue":"1","key":"2020110613035051400_ocy121-B46","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.2517-6161.1977.tb01600.x","article-title":"Maximum likelihood from incomplete data via the EM algorithm","volume":"39","author":"Dempster","year":"1977","journal-title":"J R Stat Soc B Methodol"},{"key":"2020110613035051400_ocy121-B47","doi-asserted-by":"crossref","first-page":"276","DOI":"10.3389\/fgene.2015.00276","article-title":"An introductory review of parallel independent component analysis (p-ICA) and a guide to applying p-ICA to genetic data and imaging phenotypes to identify disease-associated biological pathways","volume":"6","author":"Pearlson","year":"2015","journal-title":"Front Genet"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/25\/12\/1669\/34150640\/ocy121.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/25\/12\/1669\/34150640\/ocy121.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,9]],"date-time":"2024-07-09T14:58:05Z","timestamp":1720537085000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/25\/12\/1669\/5110357"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,9,28]]},"references-count":47,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2018,9,28]]},"published-print":{"date-parts":[[2018,12,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocy121","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2018,12]]},"published":{"date-parts":[[2018,9,28]]}}}