{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,30]],"date-time":"2026-07-30T14:08:39Z","timestamp":1785420519687,"version":"3.56.0"},"reference-count":48,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2020,8,27]],"date-time":"2020-08-27T00:00:00Z","timestamp":1598486400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,3,2]]},"abstract":"<jats:title>Summary<\/jats:title>\n               <jats:p>Large samples are generated routinely from various sources. Classic statistical models, such as smoothing spline ANOVA models, are not well equipped to analyse such large samples because of high computational costs. In particular, the daunting computational cost of selecting smoothing parameters renders smoothing spline ANOVA models impractical. In this article, we develop an asympirical, i.e., asymptotic and empirical, smoothing parameters selection method for smoothing spline ANOVA models in large samples. The idea of our approach is to use asymptotic analysis to show that the optimal smoothing parameter is a polynomial function of the sample size and an unknown constant. The unknown constant is then estimated through empirical subsample extrapolation. The proposed method significantly reduces the computational burden of selecting smoothing parameters in high-dimensional and large samples. We show that smoothing parameters chosen by the proposed method tend to the optimal smoothing parameters that minimize a specific risk function. In addition, the estimator based on the proposed smoothing parameters achieves the optimal convergence rate. Extensive simulation studies demonstrate the numerical advantage of the proposed method over competing methods in terms of relative efficacy and running time. In an application to molecular dynamics data containing nearly one million observations, the proposed method has the best prediction performance.<\/jats:p>","DOI":"10.1093\/biomet\/asaa047","type":"journal-article","created":{"date-parts":[[2020,6,5]],"date-time":"2020-06-05T03:20:07Z","timestamp":1591327207000},"page":"149-166","source":"Crossref","is-referenced-by-count":15,"title":["An asymptotic and empirical smoothing parameters selection method for smoothing spline ANOVA models in large samples"],"prefix":"10.1093","volume":"108","author":[{"given":"Xiaoxiao","family":"Sun","sequence":"first","affiliation":[{"name":"Department of Epidemiology and Biostatistics, University of Arizona, 1295 North Martin Avenue, Tucson, Arizona 85724, U.S.A"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenxuan","family":"Zhong","sequence":"additional","affiliation":[{"name":"Department of Statistics, University of Georgia, 310 Herty Drive, Athens, Georgia 30602, U.S.A"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ping","family":"Ma","sequence":"additional","affiliation":[{"name":"Department of Statistics, University of Georgia, 310 Herty Drive, Athens, Georgia 30602, U.S.A"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2020,8,27]]},"reference":[{"key":"2021030708334457900_B1","first-page":"222","article-title":"Smoothing parameter selection for nonparametric regression using smoothing spline","volume":"6","author":"Aydin,","year":"2013","journal-title":"Eur. J. Pure Appl. Math."},{"key":"2021030708334457900_B2","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1214\/aos\/1176347115","article-title":"Linear smoothers and additive models","volume":"17","author":"Buja,","year":"1989","journal-title":"Ann. Statist."},{"key":"2021030708334457900_B3","doi-asserted-by":"crossref","first-page":"e1603015","DOI":"10.1126\/sciadv.1603015","article-title":"Machine learning of accurate energy-conserving molecular force fields","volume":"3","author":"Chmiela,","year":"2017","journal-title":"Sci. Adv."},{"key":"2021030708334457900_B4","doi-asserted-by":"crossref","first-page":"789","DOI":"10.1137\/0721053","article-title":"Multivariate smoothing spline functions","volume":"21","author":"Cox,","year":"1984","journal-title":"SIAM J. Numer. Anal."},{"key":"2021030708334457900_B5","doi-asserted-by":"crossref","first-page":"1676","DOI":"10.1214\/aos\/1176347872","article-title":"Asymptotic analysis of penalized likelihood and related estimators","volume":"18","author":"Cox,","year":"1990","journal-title":"Ann. Statist."},{"key":"2021030708334457900_B6","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1007\/BF01404567","article-title":"Smoothing noisy data with spline functions: Estimating the correct degree of smoothing by the method of generalized cross-validation","volume":"31","author":"Craven,","year":"1978","journal-title":"Numer. Math."},{"key":"2021030708334457900_B7","doi-asserted-by":"crossref","first-page":"347","DOI":"10.2307\/3316020","article-title":"Model diagnostics for smoothing spline ANOVA models","volume":"32","author":"Gu,","year":"2004","journal-title":"Can. J. Statist."},{"key":"2021030708334457900_B8","volume-title":"Smoothing Spline ANOVA Models, vol. 297 of Springer Series in Statistics","author":"Gu,","year":"2013"},{"key":"2021030708334457900_B9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v058.i05","article-title":"Smoothing spline ANOVA models: R package gss","volume":"58","author":"Gu,","year":"2014","journal-title":"J. Statist. Software"},{"key":"2021030708334457900_B10","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1214\/aos\/1176349023","article-title":"Smoothing spline density estimation: Theory","volume":"21","author":"Gu,","year":"1993","journal-title":"Ann. Statist."},{"key":"2021030708334457900_B11","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1137\/0912021","article-title":"Minimizing GCV\/GML scores with multiple smoothing parameters via the Newton method","volume":"12","author":"Gu,","year":"1991","journal-title":"SIAM J. Sci. Statist. Comp."},{"key":"2021030708334457900_B12","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1016\/0047-259X(90)90080-2","article-title":"Using the bootstrap to estimate mean squared error and select smoothing parameter in nonparametric problems","volume":"32","author":"Hall,","year":"1990","journal-title":"J. Mult. Anal."},{"key":"2021030708334457900_B13","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.commatsci.2018.07.052","article-title":"A data-driven statistical model for predicting the critical temperature of a superconductor","volume":"154","author":"Hamidieh,","year":"2018","journal-title":"Comp. Mater. Sci."},{"key":"2021030708334457900_B14","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1214\/ss\/1177013604","article-title":"Generalized additive models","volume":"1","author":"Hastie,","year":"1986","journal-title":"Statist. Sci."},{"key":"2021030708334457900_B15","doi-asserted-by":"crossref","first-page":"715","DOI":"10.1080\/10618600.2014.926819","article-title":"Fast and stable multiple smoothing parameter selection in smoothing spline analysis of variance models with large samples","volume":"24","author":"Helwig,","year":"2015","journal-title":"J. Comp. Graph. Statist."},{"key":"2021030708334457900_B16","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1111\/1467-9868.00125","article-title":"Smoothing parameter selection in nonparametric regression using an improved Akaike information criterion","volume":"B 60","author":"Hurvich,","year":"1998","journal-title":"J. R. Statist. Soc."},{"key":"2021030708334457900_B17","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1046\/j.1369-7412.2003.05316.x","article-title":"Smoothing spline Gaussian regression: More scalable computation via efficient approximation","volume":"B 66","author":"Kim,","year":"2004","journal-title":"J. R. Statist. Soc."},{"key":"2021030708334457900_B18","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/0022-247X(71)90184-3","article-title":"Some results on Tchebycheffian spline functions","volume":"33","author":"Kimeldorf,","year":"1971","journal-title":"J. Math. Anal. Appl."},{"key":"2021030708334457900_B19","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1177\/1471082X1001100104","article-title":"P-spline ANOVA-type interaction models for spatio-temporal smoothing","volume":"11","author":"Lee,","year":"2011","journal-title":"Statist. Mod."},{"key":"2021030708334457900_B20","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1016\/j.csda.2012.11.013","article-title":"Efficient two-dimensional smoothing with P-spline ANOVA mixed models and nested bases","volume":"61","author":"Lee,","year":"2013","journal-title":"Comp. Statist. Data Anal."},{"key":"2021030708334457900_B21","doi-asserted-by":"crossref","first-page":"734","DOI":"10.1214\/aos\/1015951996","article-title":"Tensor product space ANOVA models","volume":"28","author":"Lin,","year":"2000","journal-title":"Ann. Statist."},{"key":"2021030708334457900_B22","doi-asserted-by":"crossref","first-page":"631","DOI":"10.1093\/biomet\/asv009","article-title":"Efficient computation of smoothing splines via adaptive basis sampling","volume":"102","author":"Ma,","year":"2015","journal-title":"Biometrika"},{"key":"2021030708334457900_B23","first-page":"661","article-title":"Some comments on ${C_P}$","volume":"15","author":"Mallows,","year":"1973","journal-title":"Technometrics"},{"key":"2021030708334457900_B24","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1016\/S0167-9473(98)00033-4","article-title":"Direct generalized additive modeling with penalized likelihood","volume":"28","author":"Marx,","year":"1998","journal-title":"Comp. Statist. Data Anal."},{"key":"2021030708334457900_B25","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/asaa047","article-title":"More efficient approximation of smoothing splines via space-filling basis selection","volume":"107","author":"Meng,","year":"2020","journal-title":"Biometrika"},{"key":"2021030708334457900_B26","doi-asserted-by":"crossref","first-page":"095003","DOI":"10.1088\/1367-2630\/15\/9\/095003","article-title":"Machine learning of molecular electronic properties in chemical compound space","volume":"15","author":"Montavon,","year":"2013","journal-title":"New J. Phys."},{"key":"2021030708334457900_B27","volume-title":"R: A Language and Environment for Statistical Computing","year":"2021"},{"key":"2021030708334457900_B28","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1214\/aos\/1176346065","article-title":"Smoothing splines: Regression, derivatives and deconvolution","volume":"11","author":"Rice,","year":"1983","journal-title":"Ann. Statist."},{"key":"2021030708334457900_B29","doi-asserted-by":"crossref","first-page":"941","DOI":"10.1007\/s11222-014-9464-2","article-title":"Fast smoothing parameter separation in multidimensional generalized P-splines: The SAP algorithm","volume":"25","author":"Rodr\u00edguez-\u00c1lvarez,","year":"2015","journal-title":"Statist. Comp."},{"key":"2021030708334457900_B30","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511755453","volume-title":"Semiparametric Regression","author":"Ruppert,","year":"2003"},{"key":"2021030708334457900_B31","doi-asserted-by":"crossref","first-page":"13890","DOI":"10.1038\/ncomms13890","article-title":"Quantum-chemical insights from deep tensor neural networks","volume":"8","author":"Sch\u00fctt,","year":"2017","journal-title":"Nature Commun."},{"key":"2021030708334457900_B32","first-page":"3809","article-title":"Computational limits of a distributed algorithm for smoothing spline","volume":"18","author":"Shang,","year":"2017","journal-title":"J. Mach. Learn. Res."},{"key":"2021030708334457900_B33","doi-asserted-by":"crossref","first-page":"795","DOI":"10.1214\/aos\/1176345872","article-title":"On the estimation of a probability density function by the maximum penalized likelihood method","volume":"10","author":"Silverman,","year":"1982","journal-title":"Ann. Statist."},{"key":"2021030708334457900_B34","doi-asserted-by":"crossref","first-page":"970","DOI":"10.1214\/aos\/1176349650","article-title":"Spline smoothing and optimal rates of convergence in nonparametric regression models","volume":"13","author":"Speckman,","year":"1985","journal-title":"Ann. Statist."},{"key":"2021030708334457900_B35","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1007\/BF01437407","article-title":"Smoothing noisy data with spline functions","volume":"24","author":"Wahba,","year":"1975","journal-title":"Numer. Math."},{"key":"2021030708334457900_B36","doi-asserted-by":"crossref","first-page":"651","DOI":"10.1137\/0714044","article-title":"Practical approximate solutions to linear operator equations when the data are noisy","volume":"14","author":"Wahba,","year":"1977","journal-title":"SIAM J. Numer. Anal."},{"key":"2021030708334457900_B37","doi-asserted-by":"crossref","first-page":"1378","DOI":"10.1214\/aos\/1176349743","article-title":"A comparison of GCV and GML for choosing the smoothing parameter in the generalized spline smoothing problem","volume":"13","author":"Wahba,","year":"1985","journal-title":"Ann. Statist."},{"key":"2021030708334457900_B38","volume-title":"Spline Models for Observational Dta, vol. 59 of CBMS-NSF Regional Conference Series in Applied Mathematics","author":"Wahba,","year":"1990"},{"key":"2021030708334457900_B39","doi-asserted-by":"crossref","first-page":"1865","DOI":"10.1214\/aos\/1034713638","article-title":"Smoothing spline ANOVA for exponential families, with application to the Wisconsin epidemiological study of diabetic retinopathy","volume":"23","author":"Wahba,","year":"1995","journal-title":"Ann. Statist."},{"key":"2021030708334457900_B40","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1007\/s001800300142","article-title":"Smoothing and mixed models","volume":"18","author":"Wand,","year":"2003","journal-title":"Comp. Statist."},{"key":"2021030708334457900_B41","doi-asserted-by":"crossref","DOI":"10.1201\/b10954","volume-title":"Smoothing Splines: Methods and Applications","author":"Wang,","year":"2011"},{"key":"2021030708334457900_B42","doi-asserted-by":"crossref","first-page":"673","DOI":"10.1198\/016214504000000980","article-title":"Stable and efficient multiple smoothing parameter estimation for generalized additive models","volume":"99","author":"Wood,","year":"2004","journal-title":"J. Am. Statist. Assoc."},{"key":"2021030708334457900_B43","doi-asserted-by":"crossref","first-page":"1025","DOI":"10.1111\/j.1541-0420.2006.00574.x","article-title":"Low-rank scale-invariant tensor product smooths for generalized additive mixed models","volume":"62","author":"Wood,","year":"2006","journal-title":"Biometrics"},{"key":"2021030708334457900_B44","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1111\/j.1467-9868.2010.00749.x","article-title":"Fast stable restricted maximum likelihood and marginal likelihood estimation of semiparametric generalized linear models","volume":"B 73","author":"Wood,","year":"2011","journal-title":"J. R. Statist. Soc."},{"key":"2021030708334457900_B45","doi-asserted-by":"crossref","first-page":"1071","DOI":"10.1111\/biom.12666","article-title":"A generalized Fellner-Schall method for smoothing parameter optimization with application to Tweedie location, scale and shape models","volume":"73","author":"Wood,","year":"2017","journal-title":"Biometrics"},{"key":"2021030708334457900_B46","doi-asserted-by":"crossref","first-page":"1199","DOI":"10.1080\/01621459.2016.1195744","article-title":"Generalized additive models for gigadata: Modeling the UK black smoke network daily data","volume":"112","author":"Wood,","year":"2017","journal-title":"J. Am. Statist. Assoc."},{"key":"2021030708334457900_B47","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1007\/s11222-012-9314-z","article-title":"Straightforward intermediate rank tensor product smoothing in mixed models","volume":"23","author":"Wood,","year":"2013","journal-title":"Statist. Comp."},{"key":"2021030708334457900_B48","doi-asserted-by":"crossref","first-page":"677","DOI":"10.1080\/10618600.2017.1402775","article-title":"Divide and recombine approaches for fitting smoothing spline models with large datasets","volume":"27","author":"Xu,","year":"2018","journal-title":"J. Comp. Graph. Statist."}],"container-title":["Biometrika"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/biomet\/advance-article-pdf\/doi\/10.1093\/biomet\/asaa047\/33686646\/asaa047.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/biomet\/article-pdf\/108\/1\/149\/36441097\/asaa047.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/biomet\/article-pdf\/108\/1\/149\/36441097\/asaa047.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,7]],"date-time":"2021-03-07T08:35:03Z","timestamp":1615106103000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/biomet\/article\/108\/1\/149\/5897688"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,27]]},"references-count":48,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,8,27]]},"published-print":{"date-parts":[[2021,3,2]]}},"URL":"https:\/\/doi.org\/10.1093\/biomet\/asaa047","relation":{},"ISSN":["0006-3444","1464-3510"],"issn-type":[{"value":"0006-3444","type":"print"},{"value":"1464-3510","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,3,1]]},"published":{"date-parts":[[2020,8,27]]}}}