{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T06:46:46Z","timestamp":1772606806017,"version":"3.50.1"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2021,12,12]],"date-time":"2021-12-12T00:00:00Z","timestamp":1639267200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,12,12]],"date-time":"2021-12-12T00:00:00Z","timestamp":1639267200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Comput Stat"],"published-print":{"date-parts":[[2022,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Nonparametric univariate regression via wavelets is usually implemented under the assumptions of dyadic sample size, equally spaced fixed sample points, and i.i.d. normal errors. In this work, we propose, study and compare some wavelet based nonparametric estimation methods designed to recover a one-dimensional regression function for data that not necessary possess the above requirements. These methods use appropriate regularizations by penalizing the decomposition of the unknown regression function on a wavelet basis of functions evaluated on the sampling design. Exploiting the sparsity of wavelet decompositions for signals belonging to homogeneous Besov spaces, we use some efficient proximal gradient descent algorithms, available in recent literature, for computing the estimates with fast computation times. Our wavelet based procedures, in both the standard and the robust regression case have favorable theoretical properties, thanks in large part to the separability nature of the (non convex) regularization they are based on. We establish asymptotic global optimal rates of convergence under weak conditions. It is known that such rates are, in general, unattainable by smoothing splines or other linear nonparametric smoothers. Lastly, we present several experiments to examine the empirical performance of our procedures and their comparisons with other proposals available in the literature. An interesting regression analysis of some real data applications using these procedures unambiguously demonstrate their effectiveness.<\/jats:p>","DOI":"10.1007\/s00180-021-01174-4","type":"journal-article","created":{"date-parts":[[2021,12,12]],"date-time":"2021-12-12T11:02:31Z","timestamp":1639306951000},"page":"1621-1651","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Penalized wavelet estimation and robust denoising for irregular spaced data"],"prefix":"10.1007","volume":"37","author":[{"given":"Umberto","family":"Amato","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anestis","family":"Antoniadis","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3694-8202","authenticated-orcid":false,"given":"Italia","family":"De Feis","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ir\u00e8ne","family":"Gijbels","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,12,12]]},"reference":[{"issue":"1","key":"1174_CR1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10260-020-00511-z","volume":"30","author":"U Amato","year":"2021","unstructured":"Amato U, Antoniadis A, De Feis I, Gijbels I (2021) Penalised robust estimators for sparse and high-dimensional linear models. Stat Methods Appl 30(1):1\u201348. https:\/\/doi.org\/10.1007\/s10260-020-00511-z","journal-title":"Stat Methods Appl"},{"key":"1174_CR2","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1214\/07-ss014","volume":"1","author":"A Antoniadis","year":"2007","unstructured":"Antoniadis A (2007) Wavelet methods in statistics: some recent developments and their applications. Stat Surv 1:16\u201355. https:\/\/doi.org\/10.1214\/07-ss014","journal-title":"Stat Surv"},{"issue":"455","key":"1174_CR3","doi-asserted-by":"publisher","first-page":"939","DOI":"10.1198\/016214501753208942","volume":"96","author":"A Antoniadis","year":"2001","unstructured":"Antoniadis A, Fan J (2001) Regularization of wavelet approximations. J Am Stat Assoc 96(455):939\u2013955. https:\/\/doi.org\/10.1198\/016214501753208942","journal-title":"J Am Stat Assoc"},{"issue":"3","key":"1174_CR4","doi-asserted-by":"publisher","first-page":"585","DOI":"10.1007\/s10463-009-0242-4","volume":"63","author":"A Antoniadis","year":"2011","unstructured":"Antoniadis A, Gijbels I, Nikolova M (2011) Penalized likelihood regression for generalized linear models with non-quadratic penalties. Ann Inst Stat Math 63(3):585\u2013615. https:\/\/doi.org\/10.1007\/s10463-009-0242-4","journal-title":"Ann Inst Stat Math"},{"issue":"1","key":"1174_CR5","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1214\/aos\/1046294459","volume":"31","author":"R Averkamp","year":"2003","unstructured":"Averkamp R, Houdr\u00e9 C (2003) Wavelets thresholding for non-necessary Gaussian noise: idealism. Ann Stat 31(1):110\u2013151. https:\/\/doi.org\/10.1214\/aos\/1046294459","journal-title":"Ann Stat"},{"key":"1174_CR6","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1117\/12.170036","volume":"2242","author":"A Bruce","year":"1994","unstructured":"Bruce A, Donoho D, Gao H, Martin D (1994) Denoising and robust non-linear wavelet analysis. SPIE Proc Wavelet Appl 2242:325\u2013336. https:\/\/doi.org\/10.1117\/12.170036","journal-title":"SPIE Proc Wavelet Appl"},{"issue":"5","key":"1174_CR7","doi-asserted-by":"publisher","first-page":"1783","DOI":"10.1214\/aos\/1024691357","volume":"26","author":"T Cai","year":"1998","unstructured":"Cai T, Brown L (1998) Wavelet shrinkage for nonequispaced samples. Ann Stat 26(5):1783\u20131799. https:\/\/doi.org\/10.1214\/aos\/1024691357","journal-title":"Ann Stat"},{"issue":"3","key":"1174_CR8","doi-asserted-by":"publisher","first-page":"313","DOI":"10.1016\/S0167-7152(98)00223-5","volume":"42","author":"T Cai","year":"1999","unstructured":"Cai T, Brown L (1999) Wavelet estimation for samples with random uniform design. Stat Probab Lett 42(3):313\u2013321. https:\/\/doi.org\/10.1016\/S0167-7152(98)00223-5","journal-title":"Stat Probab Lett"},{"issue":"1","key":"1174_CR9","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1137\/S003614450037906X","volume":"20","author":"S Chen","year":"1998","unstructured":"Chen S, Donoho D, Saunders M (1998) Atomic decomposition by basis pursuit. SIAM J Sci Comput 20(1):33\u201361. https:\/\/doi.org\/10.1137\/S003614450037906X","journal-title":"SIAM J Sci Comput"},{"issue":"11","key":"1174_CR10","doi-asserted-by":"publisher","first-page":"1413","DOI":"10.1002\/cpa.20042","volume":"57","author":"I Daubechies","year":"2004","unstructured":"Daubechies I, Defrise M, De Mol C (2004) An iterative thresholding algorithm for linear inverse problems with a sparsity constraint. Commun Pure Appl Math 57(11):1413\u20131457. https:\/\/doi.org\/10.1002\/cpa.20042","journal-title":"Commun Pure Appl Math"},{"issue":"432","key":"1174_CR11","doi-asserted-by":"publisher","first-page":"1200","DOI":"10.1080\/01621459.1995.10476626","volume":"90","author":"D Donoho","year":"1995","unstructured":"Donoho D, Johnstone I (1995) Adapting to unknown smoothness via wavelet shrinkage. J Am Stat Assoc 90(432):1200\u20131224. https:\/\/doi.org\/10.1080\/01621459.1995.10476626","journal-title":"J Am Stat Assoc"},{"issue":"2","key":"1174_CR12","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1111\/j.2517-6161.1995.tb02032.x","volume":"57","author":"D Donoho","year":"1995","unstructured":"Donoho D, Johnstone I, Kerkyacharian G, Picard D (1995) Wavelet shrinkage: asymptopia? J R Stat Soc Ser B (Methodol) 57(2):301\u2013337. https:\/\/doi.org\/10.1111\/j.2517-6161.1995.tb02032.x","journal-title":"J R Stat Soc Ser B (Methodol)"},{"key":"1174_CR13","doi-asserted-by":"publisher","DOI":"10.1201\/9781482273144","volume-title":"Nonparametric regression and spline smoothing","author":"R Eubank","year":"1999","unstructured":"Eubank R (1999) Nonparametric regression and spline smoothing, 2nd edn. CRC Press, Cambridge. https:\/\/doi.org\/10.1201\/9781482273144","edition":"2"},{"key":"1174_CR14","doi-asserted-by":"publisher","first-page":"1348","DOI":"10.1198\/016214501753382273","volume":"96","author":"J Fan","year":"2001","unstructured":"Fan J, Li R (2001) Variable selection via nonconcave penalized likelihood and its oracle properties. J Am Stat Assoc 96:1348\u20131360. https:\/\/doi.org\/10.1198\/016214501753382273","journal-title":"J Am Stat Assoc"},{"issue":"3","key":"1174_CR15","doi-asserted-by":"publisher","first-page":"928","DOI":"10.1214\/009053604000000256","volume":"32","author":"J Fan","year":"2004","unstructured":"Fan J, Peng H (2004) Nonconcave penalized likelihood with a diverging number of parameters. Ann Stat 32(3):928\u2013961. https:\/\/doi.org\/10.1214\/009053604000000256","journal-title":"Ann Stat"},{"key":"1174_CR16","doi-asserted-by":"publisher","DOI":"10.1201\/b15710","volume-title":"Nonparametric regression and generalized linear models","author":"P Green","year":"1993","unstructured":"Green P, Silverman B (1993) Nonparametric regression and generalized linear models. Chapman and Hall\/CRC, Cambridge. https:\/\/doi.org\/10.1201\/b15710"},{"key":"1174_CR17","doi-asserted-by":"publisher","DOI":"10.1017\/ccol0521382483","volume-title":"Applied nonparametric regression","author":"W H\u00e4rdle","year":"1990","unstructured":"H\u00e4rdle W (1990) Applied nonparametric regression. Cambridge University Press, Cambridge. https:\/\/doi.org\/10.1017\/ccol0521382483"},{"key":"1174_CR18","unstructured":"Haris A, Shojaie A, Simon N (2018) Wavelet regression and additive models for irregularly spaced data. In: Bengio S, Wallach H, Larochelle H, Grauman K, Cesa-Bianchi N, Garnett R (eds) Advances in neural information processing systems, vol 31. Curran Associates Inc, Red Hook. URL: https:\/\/dl.acm.org\/doi\/abs\/10.5555\/3327546.3327573"},{"key":"1174_CR19","first-page":"1603","volume":"18","author":"J Huang","year":"2008","unstructured":"Huang J, Ma S, Zhang C (2008) Adaptive lasso for sparse high-dimensional regression models. Stat Sin 18:1603\u20131618","journal-title":"Stat Sin"},{"issue":"449","key":"1174_CR20","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1080\/01621459.2000.10473912","volume":"95","author":"A Kovac","year":"2000","unstructured":"Kovac A, Silverman B (2000) Extending the scope of wavelet regression methods by coefficient-dependent thresholding. J Am Stat Assoc 95(449):172\u2013183. https:\/\/doi.org\/10.1080\/01621459.2000.10473912","journal-title":"J Am Stat Assoc"},{"key":"1174_CR21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.csda.2020.106943","volume":"147","author":"W Liu","year":"2020","unstructured":"Liu W, Tang Y, Wu X (2020) Separating variables to accelerate non-convex regularized optimization. Comput Stat Data Anal 147:1\u201318. https:\/\/doi.org\/10.1016\/j.csda.2020.106943","journal-title":"Comput Stat Data Anal"},{"issue":"2","key":"1174_CR22","doi-asserted-by":"publisher","first-page":"866","DOI":"10.1214\/16-AOS1471","volume":"45","author":"P Loh","year":"2017","unstructured":"Loh P (2017) Statistical consistency and asymptotic normality for high-dimensional robust $$M$$-estimators. Ann Stat 45(2):866\u2013896. https:\/\/doi.org\/10.1214\/16-AOS1471","journal-title":"Ann Stat"},{"key":"1174_CR23","first-page":"559","volume":"16","author":"P Loh","year":"2015","unstructured":"Loh P, Wainwright M (2015) Regularized m-estimators with nonconvexity: statistical and algorithmic theory for local optima. J Mach Learn Res 16:559\u2013616","journal-title":"J Mach Learn Res"},{"key":"1174_CR24","doi-asserted-by":"publisher","DOI":"10.1016\/b978-0-12-374370-1.x0001-8","volume-title":"A wavelet tour of signal processing","author":"S Mallat","year":"2009","unstructured":"Mallat S (2009) A wavelet tour of signal processing. Elsevier, Amsterdam. https:\/\/doi.org\/10.1016\/b978-0-12-374370-1.x0001-8"},{"key":"1174_CR25","doi-asserted-by":"publisher","unstructured":"Nesterov Y (2007) Gradient methods for minimizing composite objective function. Discussion paper 2007076, Center for Operations Research and Econometrics (CORE). Universit\u00e9 Catholique de Louvain. https:\/\/doi.org\/10.1007\/s10107-006-0089","DOI":"10.1007\/s10107-006-0089"},{"issue":"4","key":"1174_CR26","doi-asserted-by":"publisher","first-page":"893","DOI":"10.1093\/biomet\/asm064","volume":"94","author":"H Oh","year":"2007","unstructured":"Oh H, Nychka D, Lee T (2007) The role of pseudo data for robust smoothing with application to wavelet regression. Biometrika 94(4):893\u2013904. https:\/\/doi.org\/10.1093\/biomet\/asm064","journal-title":"Biometrika"},{"key":"1174_CR27","first-page":"2241","volume":"11","author":"G Raskutti","year":"2010","unstructured":"Raskutti G, Wainwright M, Yu B (2010) Restricted eigenvalue conditions for correlated Gaussian designs. J Mach Learn Res 11:2241\u20132259","journal-title":"J Mach Learn Res"},{"issue":"6","key":"1174_CR28","doi-asserted-by":"publisher","first-page":"1146","DOI":"10.1109\/ICASSP.1997.604599","volume":"49","author":"S Sardy","year":"2001","unstructured":"Sardy S, Tseng P, Bruce A (2001) Robust wavelet thresholding. IEEE Trans Signal Process 49(6):1146\u20131152. https:\/\/doi.org\/10.1109\/ICASSP.1997.604599","journal-title":"IEEE Trans Signal Process"},{"key":"1174_CR29","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","volume":"56","author":"R Tibshirani","year":"1996","unstructured":"Tibshirani R (1996) Regression shrinkage and selection via the lasso. J R Stat Soc Ser B (Methodol) 56:267\u2013288. https:\/\/doi.org\/10.1111\/j.2517-6161.1996.tb02080.x","journal-title":"J R Stat Soc Ser B (Methodol)"},{"issue":"1","key":"1174_CR30","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1111\/sjos.12032","volume":"41","author":"S van de Geer","year":"2014","unstructured":"van de Geer S (2014) Weakly decomposable regularization penalties and structured sparsity. Scand J Stat 41(1):72\u201386. https:\/\/doi.org\/10.1111\/sjos.12032","journal-title":"Scand J Stat"},{"issue":"5","key":"1174_CR31","doi-asserted-by":"publisher","first-page":"2183","DOI":"10.1109\/TIT.2009.2016018","volume":"55","author":"M Wainwright","year":"2009","unstructured":"Wainwright M (2009) Sharp thresholds for high-dimensional and noisy sparsity recovery using $$\\ell _{1}$$-constrained quadratic programming (lasso). IEEE Trans Inf Theory 55(5):2183\u20132202. https:\/\/doi.org\/10.1109\/TIT.2009.2016018","journal-title":"IEEE Trans Inf Theory"},{"key":"1174_CR32","doi-asserted-by":"publisher","first-page":"1654","DOI":"10.1214\/11-ejs652","volume":"5","author":"M Wand","year":"2011","unstructured":"Wand M, Ormerod J (2011) Penalized wavelets: embedding wavelets into semiparametric regression. Electron J Stat 5:1654\u20131717. https:\/\/doi.org\/10.1214\/11-ejs652","journal-title":"Electron J Stat"},{"issue":"1","key":"1174_CR33","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1080\/24754269.2017.1326079","volume":"1","author":"S Xiong","year":"2017","unstructured":"Xiong S, Dai B, Qian P (2017) Achieving the oracle property of OEM with nonconvex penalties. Stat Theory Relat Fields 1(1):28\u201336. https:\/\/doi.org\/10.1080\/24754269.2017.1326079","journal-title":"Stat Theory Relat Fields"},{"issue":"2","key":"1174_CR34","doi-asserted-by":"publisher","first-page":"894","DOI":"10.1214\/09-AOS729","volume":"38","author":"C Zhang","year":"2010","unstructured":"Zhang C (2010) Nearly unbiased variable selection under minimax concave penalty. Ann Stat 38(2):894\u2013942. https:\/\/doi.org\/10.1214\/09-AOS729","journal-title":"Ann Stat"},{"key":"1174_CR35","first-page":"1081","volume":"11","author":"T Zhang","year":"2010","unstructured":"Zhang T (2010) Analysis of multi-stage convex relaxation for sparse regularization. J Mach Learn Res 11:1081\u20131107","journal-title":"J Mach Learn Res"},{"key":"1174_CR36","first-page":"2541","volume":"7","author":"P Zhao","year":"2006","unstructured":"Zhao P, Yu B (2006) On model selection consistency of lasso. J Mach Learn Res 7:2541\u20132563","journal-title":"J Mach Learn Res"},{"issue":"476","key":"1174_CR37","doi-asserted-by":"publisher","first-page":"1418","DOI":"10.1198\/016214506000000735","volume":"101","author":"H Zou","year":"2006","unstructured":"Zou H (2006) The adaptive lasso and its oracle properties. J Am Stat Assoc 101(476):1418\u20131429. https:\/\/doi.org\/10.1198\/016214506000000735","journal-title":"J Am Stat Assoc"}],"container-title":["Computational Statistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00180-021-01174-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00180-021-01174-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00180-021-01174-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,7,17]],"date-time":"2022-07-17T05:09:53Z","timestamp":1658034593000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00180-021-01174-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,12]]},"references-count":37,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,9]]}},"alternative-id":["1174"],"URL":"https:\/\/doi.org\/10.1007\/s00180-021-01174-4","relation":{},"ISSN":["0943-4062","1613-9658"],"issn-type":[{"value":"0943-4062","type":"print"},{"value":"1613-9658","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,12]]},"assertion":[{"value":"22 March 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 November 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 December 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Upon request to the authors.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Availability of data and materials"}}]}}