{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T06:37:00Z","timestamp":1775111820789,"version":"3.50.1"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2022,1,30]],"date-time":"2022-01-30T00:00:00Z","timestamp":1643500800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,1,30]],"date-time":"2022-01-30T00:00:00Z","timestamp":1643500800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001663","name":"Volkswagen Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001663","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Comput Stat"],"published-print":{"date-parts":[[2022,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Tuning of model-based boosting algorithms relies mainly on the number of iterations, while the step-length is fixed at a predefined value. For complex models with several predictors such as Generalized additive models for location, scale and shape (GAMLSS), imbalanced updates of predictors, where some distribution parameters are updated more frequently than others, can be a problem that prevents some submodels to be appropriately fitted within a limited number of boosting iterations. We propose an approach using adaptive step-length (ASL) determination within a non-cyclical boosting algorithm for Gaussian location and scale models, as an important special case of the wider class of GAMLSS, to prevent such imbalance. Moreover, we discuss properties of the ASL and derive a semi-analytical form of the ASL that avoids manual selection of the search interval and numerical optimization to find the optimal step-length, and consequently improves computational efficiency. We show competitive behavior of the proposed approaches compared to penalized maximum likelihood and boosting with a fixed step-length for Gaussian location and scale models in two simulations and two applications, in particular for cases of large variance and\/or more variables than observations. In addition, the underlying concept of the ASL is also applicable to the whole GAMLSS framework and to other models with more than one predictor like zero-inflated count models, and brings up insights into the choice of the reasonable defaults for the step-length in the simpler special case of (Gaussian) additive models.<\/jats:p>","DOI":"10.1007\/s00180-022-01199-3","type":"journal-article","created":{"date-parts":[[2022,1,30]],"date-time":"2022-01-30T09:02:15Z","timestamp":1643533335000},"page":"2295-2332","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Adaptive step-length selection in gradient boosting for Gaussian location and scale models"],"prefix":"10.1007","volume":"37","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9161-921X","authenticated-orcid":false,"given":"Boyao","family":"Zhang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tobias","family":"Hepp","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sonja","family":"Greven","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Elisabeth","family":"Bergherr","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,1,30]]},"reference":[{"key":"1199_CR1","unstructured":"Brent RP (2013) Algorithms for minimization without derivatives. Courier Corporation"},{"issue":"2","key":"1199_CR2","doi-asserted-by":"publisher","first-page":"559","DOI":"10.1214\/009053606000000092","volume":"34","author":"P B\u00fchlmann","year":"2006","unstructured":"B\u00fchlmann P (2006) Boosting for high-dimensional linear models. Ann Stat 34(2):559\u2013583","journal-title":"Ann Stat"},{"issue":"4","key":"1199_CR3","first-page":"477","volume":"22","author":"P B\u00fchlmann","year":"2007","unstructured":"B\u00fchlmann P, Hothorn T (2007) Boosting algorithms: regularization, prediction and model fitting. Stat Sci 22(4):477\u2013505","journal-title":"Stat Sci"},{"issue":"462","key":"1199_CR4","doi-asserted-by":"publisher","first-page":"324","DOI":"10.1198\/016214503000125","volume":"98","author":"P B\u00fchlmann","year":"2003","unstructured":"B\u00fchlmann P, Yu B (2003) Boosting with the L2 loss. J Am Stat Assoc 98(462):324\u2013339. https:\/\/doi.org\/10.1198\/016214503000125","journal-title":"J Am Stat Assoc"},{"issue":"1","key":"1199_CR5","doi-asserted-by":"publisher","first-page":"255","DOI":"10.1146\/annurev-statistics-022513-115545","volume":"1","author":"P B\u00fchlmann","year":"2014","unstructured":"B\u00fchlmann P, Kalisch M, Meier L (2014) High-dimensional statistics with a view toward applications in biology. Annu Rev Stat Appl 1(1):255\u2013278. https:\/\/doi.org\/10.1146\/annurev-statistics-022513-115545","journal-title":"Annu Rev Stat Appl"},{"issue":"4","key":"1199_CR6","doi-asserted-by":"publisher","first-page":"533","DOI":"10.1214\/15-STS527","volume":"30","author":"R Dezeure","year":"2015","unstructured":"Dezeure R, B\u00fchlmann P, Meier L, Meinshausen N (2015) High-dimensional inference: Confidence intervals, p-values and R-software HDI. Stat Sci 30(4):533\u2013558","journal-title":"Stat Sci"},{"key":"1199_CR7","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780199533022.001.0001","volume-title":"Bayesian smoothing and regression for longitudinal, spatial and event history data","author":"L Fahrmeir","year":"2011","unstructured":"Fahrmeir L, Kneib T (2011) Bayesian smoothing and regression for longitudinal, spatial and event history data. Oxford University Press, Oxford"},{"issue":"2","key":"1199_CR8","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1214\/aos\/1016218223","volume":"28","author":"J Friedman","year":"2000","unstructured":"Friedman J, Hastie T, Tibshirani R (2000) Additive logistic regression: a statistical view of boosting (with discussion and a rejoinder by the authors). Ann Stat 28(2):337\u2013407","journal-title":"Ann Stat"},{"issue":"1","key":"1199_CR9","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v033.i01","volume":"33","author":"J Friedman","year":"2010","unstructured":"Friedman J, Hastie T, Tibshirani R (2010) Regularization paths for generalized linear models via coordinate descent. J Stat Softw 33(1):1\u201322","journal-title":"J Stat Softw"},{"issue":"5","key":"1199_CR10","doi-asserted-by":"publisher","first-page":"1189","DOI":"10.1214\/aos\/1013203451","volume":"29","author":"JH Friedman","year":"2001","unstructured":"Friedman JH (2001) Greedy function approximation: a gradient boosting machine. Ann Stat 29(5):1189\u20131232","journal-title":"Ann Stat"},{"key":"1199_CR11","first-page":"1","volume":"1","author":"T Hastie","year":"2007","unstructured":"Hastie T, Taylor J, Tibshirani R, Walther G (2007) Forward stagewise regression and the monotone lasso. Electr J Stat 1:1\u201329","journal-title":"Electr J Stat"},{"issue":"5","key":"1199_CR12","doi-asserted-by":"publisher","first-page":"422","DOI":"10.3414\/ME16-01-0033","volume":"55","author":"T Hepp","year":"2016","unstructured":"Hepp T, Schmid M, Gefeller O, Waldmann E, Mayr A (2016) Approaches to regularized regression\u2014a comparison between gradient boosting and the Lasso. Methods Inf Med 55(5):422\u2013430","journal-title":"Methods Inf Med"},{"issue":"1","key":"1199_CR13","doi-asserted-by":"publisher","first-page":"20180110","DOI":"10.1515\/ijb-2018-0110","volume":"15","author":"T Hepp","year":"2019","unstructured":"Hepp T, Schmid M, Mayr A (2019) Significance tests for boosted location and scale models with linear base-learners. Int J Biostat 15(1):20180110","journal-title":"Int J Biostat"},{"issue":"1\u20132","key":"1199_CR14","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/s00180-012-0382-5","volume":"29","author":"B Hofner","year":"2014","unstructured":"Hofner B, Mayr A, Robinzonov N, Schmid M (2014) Model-based boosting in R: a hands-on tutorial using the R package mboost. Comput Stat 29(1\u20132):3\u201335","journal-title":"Comput Stat"},{"issue":"1","key":"1199_CR15","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1186\/s12859-015-0575-3","volume":"16","author":"B Hofner","year":"2015","unstructured":"Hofner B, Boccuto L, G\u00f6ker M (2015) Controlling false discoveries in high-dimensional situations: boosting with stability selection. BMC Bioinf 16(1):144","journal-title":"BMC Bioinf"},{"issue":"1","key":"1199_CR16","first-page":"1","volume":"74","author":"B Hofner","year":"2016","unstructured":"Hofner B, Mayr A, Schmid M (2016) gamboostlss: an R package for model building and variable selection in the GAMLSS framework. J Stat Softw Articles 74(1):1\u201331","journal-title":"J Stat Softw Articles"},{"key":"1199_CR17","unstructured":"Hofner B, Mayr A, Fenske N, Schmid M (2018) gamboostLSS: Boosting methods for GAMLSS models. R package version 2.0-1"},{"key":"1199_CR18","first-page":"2109","volume":"11","author":"T Hothorn","year":"2010","unstructured":"Hothorn T, Buehlmann P, Kneib T, Schmid M, Hofner B (2010) Model-based boosting 2.0. J Mach Learn Res 11:2109\u20132113","journal-title":"J Mach Learn Res"},{"issue":"2","key":"1199_CR19","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1890\/10-0602.1","volume":"81","author":"T Hothorn","year":"2011","unstructured":"Hothorn T, M\u00fcller J, Schr\u00f6der B, Kneib T, Brandl R (2011) Decomposing environmental, spatial, and spatiotemporal components of species distributions. Ecol Monogr 81(2):329\u2013347. https:\/\/doi.org\/10.1890\/10-0602.1","journal-title":"Ecol Monogr"},{"key":"1199_CR20","unstructured":"Hothorn T, Buehlmann P, Kneib T, Schmid M, Hofner B (2018) mboost: Model-based boosting. R package version 2.9-1"},{"issue":"2","key":"1199_CR21","first-page":"1137","volume":"14","author":"R Kohavi","year":"1995","unstructured":"Kohavi R et al (1995) A study of cross-validation and bootstrap for accuracy estimation and model selection. Ijcai 14(2):1137\u20131145","journal-title":"Ijcai"},{"issue":"3","key":"1199_CR22","doi-asserted-by":"publisher","first-page":"403","DOI":"10.1111\/j.1467-9876.2011.01033.x","volume":"61","author":"A Mayr","year":"2012","unstructured":"Mayr A, Fenske N, Hofner B, Kneib T, Schmid M (2012) Generalized additive models for location, scale and shape for high dimensional data-a flexible approach based on boosting. J R Stat Soc Ser C Appl Stat 61(3):403\u2013427. https:\/\/doi.org\/10.1111\/j.1467-9876.2011.01033.x","journal-title":"J R Stat Soc Ser C Appl Stat"},{"issue":"4","key":"1199_CR23","doi-asserted-by":"publisher","first-page":"417","DOI":"10.1111\/j.1467-9868.2010.00740.x","volume":"72","author":"N Meinshausen","year":"2010","unstructured":"Meinshausen N, B\u00fchlmann P (2010) Stability selection. J R Stat Soc Ser B Stat Methodol 72(4):417\u2013473. https:\/\/doi.org\/10.1111\/j.1467-9868.2010.00740.x","journal-title":"J R Stat Soc Ser B Stat Methodol"},{"issue":"3","key":"1199_CR24","doi-asserted-by":"publisher","first-page":"507","DOI":"10.1111\/j.1467-9876.2005.00510.x","volume":"54","author":"RA Rigby","year":"2005","unstructured":"Rigby RA, Stasinopoulos DM (2005) Generalized additive models for location, scale and shape. J R Stat Soc Ser C Appl Stat 54(3):507\u2013554. https:\/\/doi.org\/10.1111\/j.1467-9876.2005.00510.x","journal-title":"J R Stat Soc Ser C Appl Stat"},{"key":"1199_CR25","doi-asserted-by":"publisher","DOI":"10.1142\/9781860945410_0007","author":"BD Ripley","year":"2004","unstructured":"Ripley BD (2004) Selecting amongst large classes of models. Methods Models Stat. https:\/\/doi.org\/10.1142\/9781860945410_0007","journal-title":"Methods Models Stat"},{"issue":"7","key":"1199_CR26","first-page":"1","volume":"23","author":"D Stasinopoulos","year":"2007","unstructured":"Stasinopoulos D, Rigby R (2007) Generalized additive models for location scale and shape (GAMLSS) in R. J Stat Softw Articles 23(7):1\u201346","journal-title":"J Stat Softw Articles"},{"key":"1199_CR27","doi-asserted-by":"crossref","unstructured":"Stasinopoulos D, Rigby R, Heller G, Voudouris V, De\u00a0Bastiani F (2017) Flexible regression and smoothing: using GAMLSS in R. Chapman and Hall\/CRC","DOI":"10.1201\/b21973"},{"issue":"3","key":"1199_CR28","doi-asserted-by":"publisher","first-page":"673","DOI":"10.1007\/s11222-017-9754-6","volume":"28","author":"J Thomas","year":"2018","unstructured":"Thomas J, Mayr A, Bischl B, Schmid M, Smith A, Hofner B (2018) Gradient boosting for distributional regression: faster tuning and improved variable selection via noncyclical updates. Stat Comput 28(3):673\u2013687","journal-title":"Stat Comput"},{"issue":"4","key":"1199_CR29","doi-asserted-by":"publisher","first-page":"1538","DOI":"10.1214\/009053605000000255","volume":"33","author":"T Zhang","year":"2005","unstructured":"Zhang T, Yu B (2005) Boosting with early stopping: convergence and consistency. Ann Stat 33(4):1538\u20131579","journal-title":"Ann Stat"}],"container-title":["Computational Statistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00180-022-01199-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00180-022-01199-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00180-022-01199-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,29]],"date-time":"2022-09-29T20:04:47Z","timestamp":1664481887000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00180-022-01199-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,30]]},"references-count":29,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2022,11]]}},"alternative-id":["1199"],"URL":"https:\/\/doi.org\/10.1007\/s00180-022-01199-3","relation":{},"ISSN":["0943-4062","1613-9658"],"issn-type":[{"value":"0943-4062","type":"print"},{"value":"1613-9658","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,30]]},"assertion":[{"value":"10 March 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 January 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 January 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}