{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,29]],"date-time":"2025-10-29T19:43:33Z","timestamp":1761767013761,"version":"build-2065373602"},"reference-count":37,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2022,1,28]],"date-time":"2022-01-28T00:00:00Z","timestamp":1643328000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS2113564"],"award-info":[{"award-number":["DMS2113564"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Motivated by mobile devices that record data at a high frequency, we propose a new methodological framework for analyzing a semi-parametric regression model that allow us to study a nonlinear relationship between a scalar response and multiple functional predictors in the presence of scalar covariates. Utilizing functional principal component analysis (FPCA) and the least-squares kernel machine method (LSKM), we are able to substantially extend the framework of semi-parametric regression models of scalar responses on scalar predictors by allowing multiple functional predictors to enter the nonlinear model. Regularization is established for feature selection in the setting of reproducing kernel Hilbert spaces. Our method performs simultaneously model fitting and variable selection on functional features. For the implementation, we propose an effective algorithm to solve related optimization problems in that iterations take place between both linear mixed-effects models and a variable selection method (e.g., sparse group lasso). We show algorithmic convergence results and theoretical guarantees for the proposed methodology. We illustrate its performance through simulation experiments and an analysis of accelerometer data.<\/jats:p>","DOI":"10.3390\/e24020203","type":"journal-article","created":{"date-parts":[[2022,1,29]],"date-time":"2022-01-29T01:41:59Z","timestamp":1643420519000},"page":"203","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Multivariate Functional Kernel Machine Regression and Sparse Functional Feature Selection"],"prefix":"10.3390","volume":"24","author":[{"given":"Joseph","family":"Naiman","sequence":"first","affiliation":[{"name":"Department of Biostatistics, University of Michigan, Ann Arbor, MI 48109, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7881-7182","authenticated-orcid":false,"given":"Peter Xuekun","family":"Song","sequence":"additional","affiliation":[{"name":"Department of Biostatistics, University of Michigan, Ann Arbor, MI 48109, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1111\/ijpo.12033","article-title":"Classification of Physical Activity Intensities Using a Wrist-worn Accelerometer in 8\u201312-Year-old Children","volume":"11","author":"Chandler","year":"2016","journal-title":"Pediatric Obes."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"S490","DOI":"10.1249\/01.mss.0000185571.49104.82","article-title":"The Technology of Accelerometry-based Activity Monitors: Current and Future","volume":"37","author":"Chen","year":"2005","journal-title":"Med. Sci. Sport. Exerc."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Bai, J., Di, C., Xiao, L., Evenson, K.R., LaCroix, A.Z., Crainiceanu, C.M., and Buchner, D.M. (2016). An Activity Index for Raw Accelerometry Data and Its Comparison with Other Activity Metrics. PLoS ONE, 11.","DOI":"10.1371\/journal.pone.0160644"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"S86","DOI":"10.1249\/MSS.0b013e3182399f5e","article-title":"ActiGraph and Actical Physical Activity Monitors: A Peek under the Hood","volume":"44","author":"John","year":"2012","journal-title":"Med. Sci. Sport. Exerc."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Kim, Y., Lee, J.M., Peters, B.P., Gaesser, G.A., and Welk, G.J. (2014). Examination of Different Accelerometer Cut-points for Assessing Sedentary Behaviors in Children. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0090630"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"744","DOI":"10.1111\/biom.12781","article-title":"A Two-stage Model for Wearable Device Data","volume":"74","author":"Bai","year":"2018","journal-title":"Biometrics"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"941","DOI":"10.1249\/MSS.0000000000000844","article-title":"Performance of Activity Classification Algorithms in Free-Living Older Adults","volume":"48","author":"Sasaki","year":"2016","journal-title":"Med. Sci. Sport. Exerc."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"458","DOI":"10.1214\/08-AOAS206","article-title":"Multilevel Functional Principal Component Analysis","volume":"3","author":"Di","year":"2009","journal-title":"Ann. Appl. Stat."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1723","DOI":"10.1249\/MSS.0000000000000968","article-title":"New Insights into Activity Patterns in Children, Found Using Functional Data Analyses","volume":"48","author":"Goldsmith","year":"2016","journal-title":"Med. Sci. Sport. Exerc."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"754","DOI":"10.1093\/biostatistics\/kxv015","article-title":"Methods to Assess An Exercise Intervention Trial Based on 3-Level Functional Data","volume":"16","author":"Li","year":"2015","journal-title":"Biostatistics"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1007\/s12561-019-09250-6","article-title":"A Review of Statistical Analyses on Physical Activity Data Collected from Accelerometers","volume":"11","author":"Zhang","year":"2019","journal-title":"Stat. Biosci."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Ramsay, J.O., and Silverman, B.W. (2005). Functional Data Analysis, Springer.","DOI":"10.1007\/b98888"},{"key":"ref_13","first-page":"571","article-title":"Spline Estimators for the Functional Linear model","volume":"13","author":"Cardot","year":"2003","journal-title":"Stat. Sin."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/S0167-7152(99)00036-X","article-title":"Functional Linear Model","volume":"45","author":"Cardot","year":"1999","journal-title":"Stat. Probab. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1111\/rssb.12036","article-title":"Structured Functional Additive Regression in Reproducing Kernel Hilbert Spaces","volume":"76","author":"Zhu","year":"2014","journal-title":"J. R. Stat. Soc. Ser. (Stat. Methodol.)"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.1467-842X.2007.00480.x","article-title":"Nonparametric Regression on Functional Data: Inference and Practical Aspects","volume":"49","author":"Ferraty","year":"2007","journal-title":"Aust. N. Z. J. Stat."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1080\/10618600.2012.729985","article-title":"Functional Generalized Additive Models","volume":"23","author":"McLean","year":"2014","journal-title":"J. Comput. Graph. Stat."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Bosq, D. (2000). Linear Processes in Function Spaces, Springer. Lecture Notes in Statistics.","DOI":"10.1007\/978-1-4612-1154-9"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1493","DOI":"10.1214\/009053606000000272","article-title":"Properties of Principal Component Methods for Functional and Longitudinal Data Analysis","volume":"34","author":"Hall","year":"2006","journal-title":"Ann. Stat."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1111\/j.1467-9868.2005.00535.x","article-title":"On Properties of Functional Principal Components Analysis","volume":"68","author":"Hall","year":"2006","journal-title":"J. R. Stat. Soc. Ser. (Stat. Methodol.)"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1534","DOI":"10.1198\/016214508000000751","article-title":"Functional Additive Models","volume":"103","author":"Yao","year":"2008","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2272","DOI":"10.1214\/009053606000000722","article-title":"Component Selection and Smoothing in Multivariate Nonparametric Regression","volume":"34","author":"Lin","year":"2006","journal-title":"Ann. Stat."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1079","DOI":"10.1111\/j.1541-0420.2007.00799.x","article-title":"Semiparametric Regression of Multidimensional Genetic Pathway Data: Least-Squares Kernel Machines and Linear Mixed Models","volume":"63","author":"Liu","year":"2007","journal-title":"Biometrics"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wood, S.N. (2006). Generalized Additive Models: An Introduction with R, Chapman and Hall.","DOI":"10.1201\/9781420010404"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1111\/1467-9868.00183","article-title":"Inference in Generalized Additive Mixed Models by Using Smoothing Splines","volume":"61","author":"Lin","year":"1999","journal-title":"J. R. Stat. Soc. Ser. (Stat. Methodol.)"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1111\/j.1467-9868.2005.00532.x","article-title":"Model Selection and Estimation in Regression with Grouped Variables","volume":"68","author":"Yuan","year":"2006","journal-title":"J. R. Stat. Soc. Ser. (Stat. Methodol.)"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1080\/10618600.2012.681250","article-title":"A Sparse-Group Lasso","volume":"22","author":"Simon","year":"2013","journal-title":"J. Comput. Graph. Stat."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1080\/00401706.1995.10484371","article-title":"Better Subset Regression Using the Nonnegative Garrote","volume":"37","author":"Breiman","year":"1995","journal-title":"Technometrics"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1007\/s10589-012-9476-9","article-title":"Convergence Analysis of a Proximal Gauss\u2013Newton Method","volume":"53","author":"Salzo","year":"2012","journal-title":"Comput. Optim. Appl."},{"key":"ref_30","unstructured":"Naiman, J. (2020). Multivariate Functional Kernel Machine Regression and Feature Selection with Applications to Accelerometer Mobile Health Devices. [Ph.D. Dissertation, University of Michigan]."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1362","DOI":"10.1016\/j.jspi.2010.10.003","article-title":"Penalized Least Squares for Single Index Models","volume":"141","author":"Peng","year":"2011","journal-title":"J. Stat. Plan. Inference"},{"key":"ref_32","unstructured":"Geer, S.A. (2000). Empirical Processes in M-Estimation, Cambridge University Press."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1093\/pan\/mpt019","article-title":"Kernel Regularized Least Squares: Reducing Misspecification Bias with a Flexible and Interpretable Machine Learning Approach","volume":"22","author":"Hainmueller","year":"2014","journal-title":"Political Anal."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1198\/016214504000001745","article-title":"Functional Data Analysis for Sparse Longitudinal Data","volume":"100","author":"Yao","year":"2005","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"2390","DOI":"10.1016\/j.chemosphere.2013.08.038","article-title":"Predictors of Urinary Bisphenol A and Phthalate Metabolite Concentrations in Mexican Children","volume":"93","author":"Lewis","year":"2013","journal-title":"Chemosphere"},{"key":"ref_36","first-page":"973","article-title":"Assessing the Physical Cliff: Detailed Quantification of Age-related Differences in Daily Patterns of Physical Activity","volume":"69","author":"Schrack","year":"2014","journal-title":"J. Gerontol. Ser. Biol. Sci. Med. Sci."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1016\/j.jpeds.2018.07.087","article-title":"Adiposity in Adolescents: The Interplay of Sleep Duration and Sleep Variability","volume":"203","author":"Jansen","year":"2018","journal-title":"J. Pediatr."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/2\/203\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:09:53Z","timestamp":1760134193000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/2\/203"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,28]]},"references-count":37,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["e24020203"],"URL":"https:\/\/doi.org\/10.3390\/e24020203","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2022,1,28]]}}}