{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T12:49:05Z","timestamp":1777726145261,"version":"3.51.4"},"reference-count":57,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2020,10,28]],"date-time":"2020-10-28T00:00:00Z","timestamp":1603843200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003382","name":"Core Research for Evolutional Science and Technology","doi-asserted-by":"publisher","award":["JPMJCR1662"],"award-info":[{"award-number":["JPMJCR1662"]}],"id":[{"id":"10.13039\/501100003382","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003382","name":"Core Research for Evolutional Science and Technology","doi-asserted-by":"publisher","award":["JPMJCR1666"],"award-info":[{"award-number":["JPMJCR1666"]}],"id":[{"id":"10.13039\/501100003382","id-type":"DOI","asserted-by":"publisher"}]},{"name":"KAKENHI","award":["18J20290"],"award-info":[{"award-number":["18J20290"]}]},{"name":"KAKENHI","award":["18H05413"],"award-info":[{"award-number":["18H05413"]}]},{"name":"KAKENHI","award":["20H02145"],"award-info":[{"award-number":["20H02145"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>We propose a new constrained optimization approach to hyperspectral (HS) image restoration. Most existing methods restore a desirable HS image by solving some optimization problems, consisting of a regularization term(s) and a data-fidelity term(s). The methods have to handle a regularization term(s) and a data-fidelity term(s) simultaneously in one objective function; therefore, we need to carefully control the hyperparameter(s) that balances these terms. However, the setting of such hyperparameters is often a troublesome task because their suitable values depend strongly on the regularization terms adopted and the noise intensities on a given observation. Our proposed method is formulated as a convex optimization problem, utilizing a novel hybrid regularization technique named Hybrid Spatio-Spectral Total Variation (HSSTV) and incorporating data-fidelity as hard constraints. HSSTV has a strong noise and artifact removal ability while avoiding oversmoothing and spectral distortion, without combining other regularizations such as low-rank modeling-based ones. In addition, the constraint-type data-fidelity enables us to translate the hyperparameters that balance between regularization and data-fidelity to the upper bounds of the degree of data-fidelity that can be set in a much easier manner. We also develop an efficient algorithm based on the alternating direction method of multipliers (ADMM) to efficiently solve the optimization problem. We illustrate the advantages of the proposed method over various HS image restoration methods through comprehensive experiments, including state-of-the-art ones.<\/jats:p>","DOI":"10.3390\/rs12213541","type":"journal-article","created":{"date-parts":[[2020,10,29]],"date-time":"2020-10-29T09:44:53Z","timestamp":1603964693000},"page":"3541","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["A Constrained Convex Optimization Approach to Hyperspectral Image Restoration with Hybrid Spatio-Spectral Regularization"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8282-2491","authenticated-orcid":false,"given":"Saori","family":"Takeyama","sequence":"first","affiliation":[{"name":"Department of Information and Communications Engineering, School of Engineering, Tokyo Institute of Technology, Kanagawa 226-8503, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7890-5131","authenticated-orcid":false,"given":"Shunsuke","family":"Ono","sequence":"additional","affiliation":[{"name":"Department of Computer Science, School of Computing, Tokyo Institute of Technology, Kanagawa 226-8503, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5409-2727","authenticated-orcid":false,"given":"Itsuo","family":"Kumazawa","sequence":"additional","affiliation":[{"name":"Laboratory for Future Interdisciplinary Research of Science and Technology (FIRST), Institute of Innovative Research (IIR), Tokyo Institute of Technology, Kanagawa 226-8503, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,10,28]]},"reference":[{"key":"ref_1","unstructured":"Chang, C.I. (2003). Hyperspectral Imaging: Techniques for Spectral Detection and Classification, Springer Science & Business Media."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"S110","DOI":"10.1016\/j.rse.2007.07.028","article-title":"Recent advances in techniques for hyperspectral image processing","volume":"113","author":"Plaza","year":"2009","journal-title":"Remote Sens. Environ."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Rasti, B., Scheunders, P., Ghamisi, P., Licciardi, G., and Chanussot, J. (2018). Noise reduction in hyperspectral imagery: Overview and application. Remote Sens., 10.","DOI":"10.3390\/rs10030482"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1109\/MSP.2013.2279507","article-title":"Sparsity and structure in hyperspectral imaging: Sensing, reconstruction, and target detection","volume":"31","author":"Willett","year":"2014","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1109\/MSP.2013.2278763","article-title":"Compressive coded aperture spectral imaging: An introduction","volume":"31","author":"Arce","year":"2014","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3660","DOI":"10.1109\/TGRS.2012.2185054","article-title":"Hyperspectral image denoising employing a spectral\u2013spatial adaptive total variation model","volume":"50","author":"Yuan","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","first-page":"442","article-title":"Hyperspectral Image Denoising Using Spatio-Spectral Total Variation","volume":"13","author":"Aggarwal","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1852","DOI":"10.1109\/TIP.2015.2404782","article-title":"Anisotropic spectral-spatial total variation model for multispectral remote sensing image destriping","volume":"24","author":"Chang","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_9","first-page":"1","article-title":"Hyperspectral Image Restoration Based on Low-Rank Recovery with a Local Neighborhood Weighted Spectral-Spatial Total Variation Model","volume":"57","author":"Liu","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"4729","DOI":"10.1109\/TGRS.2013.2284280","article-title":"Hyperspectral image restoration using low-rank matrix recovery","volume":"52","author":"Zhang","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","unstructured":"Sun, L., Ma, C., Chen, Y., Zheng, Y., Shim, H.J., Wu, Z., and Jeon, B. (2019). Low rank component induced spatial-spectral kernel method for hyperspectral image classification. IEEE Trans. Circuits Syst. Video Technol., 4133\u20134148."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Li, H., Sun, P., Liu, H., Wu, Z., and Wei, Z. (2018, January 22\u201327). Non-Convex Low-Rank Approximation for Hyperspectral Image Recovery with Weighted Total Varaition Regularization. Proceedings of the 2018 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8517993"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1109\/TGRS.2015.2452812","article-title":"Total-variation-regularized low-rank matrix factorization for hyperspectral image restoration","volume":"54","author":"He","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"4257","DOI":"10.1109\/JSTARS.2016.2521898","article-title":"Hyperspectral unmixing in the presence of mixed noise using joint-sparsity and total variation","volume":"9","author":"Aggarwal","year":"2016","journal-title":"IEEE Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1174","DOI":"10.1109\/JSTARS.2020.2980576","article-title":"Weighted Nonlocal Low-Rank Tensor Decomposition Method for Sparse Unmixing of Hyperspectral Images","volume":"13","author":"Sun","year":"2020","journal-title":"IEEE Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"713","DOI":"10.1109\/JSTARS.2018.2800701","article-title":"Hyperspectral image denoising using local low-rank matrix recovery and global spatial\u2013spectral total variation","volume":"11","author":"He","year":"2018","journal-title":"IEEE Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Kong, X., Zhao, Y., Xue, J., Chan, J.C., Ren, Z., Huang, H., and Zang, J. (2020). Hyperspectral Image Denoising Based on Nonlocal Low-Rank and TV Regularization. Remote Sens., 12.","DOI":"10.3390\/rs12121956"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3863","DOI":"10.1109\/JSTARS.2018.2866815","article-title":"A robust PCA approach with noise structure learning and spatial\u2013spectral low-rank modeling for hyperspectral image restoration","volume":"11","author":"Cao","year":"2018","journal-title":"IEEE Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1227","DOI":"10.1109\/JSTARS.2017.2779539","article-title":"Hyperspectral image restoration via total variation regularized low-rank tensor decomposition","volume":"11","author":"Wang","year":"2017","journal-title":"IEEE Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.sigpro.2017.06.012","article-title":"Low rank constraint and spatial spectral total variation for hyperspectral image mixed denoising","volume":"142","author":"Wang","year":"2018","journal-title":"Signal Process."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Sun, L., Zhan, T., Wu, Z., Xiao, L., and Jeon, B. (2018). Hyperspectral mixed denoising via spectral difference-induced total variation and low-rank approximation. Remote Sens., 10.","DOI":"10.3390\/rs10121956"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"52095","DOI":"10.1109\/ACCESS.2019.2911864","article-title":"Hyperspectral Image Denoising Using Group Low-Rank and Spatial-Spectral Total Variation","volume":"7","author":"Ince","year":"2019","journal-title":"IEEE Access"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/0898-1221(76)90003-1","article-title":"A dual algorithm for the solution of nonlinear variational problems via finite elements approximations","volume":"2","author":"Gabay","year":"1976","journal-title":"Comput. Math. Appl."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1007\/BF01581204","article-title":"On the Douglas\u2014Rachford splitting method and the proximal point algorithm for maximal monotone operators","volume":"55","author":"Eckstein","year":"1992","journal-title":"Math. Program."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/2200000016","article-title":"Distributed optimization and statistical learning via the alternating direction method of multipliers","volume":"3","author":"Boyd","year":"2011","journal-title":"Found. Trends Mach. Learn."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Takeyama, S., Ono, S., and Kumazawa, I. (2017, January 5\u20139). Hyperspectral Image Restoration by Hybrid Spatio-Spectral Total Variation. Proceedings of the 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), New Orleans, LA, USA.","DOI":"10.1109\/ICASSP.2017.7953025"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Takeyama, S., Ono, S., and Kumazawa, I. (2019, January 22\u201325). Mixed Noise Removal for Hyperspectral Images Using Hybrid Spatio-Spectral Total Variation. Proceedings of the 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan.","DOI":"10.1109\/ICIP.2019.8803239"},{"key":"ref_28","first-page":"2897","article-title":"Fonctions convexes duales et points proximaux dans un espace hilbertien","volume":"255","author":"Moreau","year":"1962","journal-title":"C. R. Acad. Sci. Paris Ser. A Math."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"455","DOI":"10.3934\/ipi.2008.2.455","article-title":"Fast dual minimization of the vectorial total variation norm and applications to color image processing","volume":"2","author":"Bresson","year":"2008","journal-title":"Inverse Probl. Imag."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2979","DOI":"10.3390\/rs12182979","article-title":"SLRL4D: Joint Restoration of Subspace Low-Rank Learning and Non-Local 4-D Transform Filtering for Hyperspectral Image","volume":"12","author":"Sun","year":"2020","journal-title":"Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1109\/TIP.2010.2076294","article-title":"An augmented Lagrangian approach to the constrained optimization formulation of imaging inverse problems","volume":"20","author":"Afonso","year":"2011","journal-title":"IEEE Trans. Image Process."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1737","DOI":"10.1007\/s11760-014-0664-1","article-title":"Epigraphical projection and proximal tools for solving constrained convex optimization problems","volume":"9","author":"Chierchia","year":"2015","journal-title":"Signal Image Video Process."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"6149","DOI":"10.1109\/TSP.2015.2472365","article-title":"Signal recovery with certain involved convex data-fidelity constraints","volume":"63","author":"Ono","year":"2015","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"4642","DOI":"10.1109\/TGRS.2016.2547879","article-title":"Hyperspectral image restoration via iteratively regularized weighted schatten p-norm minimization","volume":"54","author":"Xie","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1554","DOI":"10.1109\/TIP.2017.2651392","article-title":"L0 gradient projection","volume":"26","author":"Ono","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Takeyama, S., Ono, S., and Kumazawa, I. (2018, January 15\u201320). Robust and effective hyperspectral pansharpening using spatio-spectral total variation. Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.","DOI":"10.1109\/ICASSP.2018.8462464"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Takeyama, S., Ono, S., and Kumazawa, I. (2018, January 12\u201315). Hyperspectral Pansharpening Using Noisy Panchromatic Image. Proceedings of the Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Honolulu, HI, USA.","DOI":"10.23919\/APSIPA.2018.8659523"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"3097","DOI":"10.1109\/TIP.2011.2158229","article-title":"An augmented Lagrangian method for total variation video restoration","volume":"20","author":"Chan","year":"2011","journal-title":"IEEE Trans. Image Process."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Takeyama, S., Ono, S., and Kumazawa, I. (2019, January 12\u201317). Hyperspectral and Multispectral Data Fusion by a Regularization Considering. Proceedings of the 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brighton, UK.","DOI":"10.1109\/ICASSP.2019.8683646"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Hansen, P.C., Nagy, J.G., and O\u2019Leary, D.P. (2006). Deblurring Images: Matrices, Spectra, and Filtering, SIAM.","DOI":"10.1137\/1.9780898718874"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Combettes, P.L., and Pesquet, J.C. (2011). Proximal splitting methods in signal processing. Fixed-Point Algorithms for Inverse Problems in Science and Engineering, Springer.","DOI":"10.1007\/978-1-4419-9569-8_10"},{"key":"ref_42","unstructured":"Golub, G.H., and Loan, C.F.V. (2012). Matrix Computations, Johns Hopkins University Press. [4th ed.]."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1007\/s10851-010-0251-1","article-title":"A first-order primal-dual algorithm for convex problems with applications to imaging","volume":"40","author":"Chambolle","year":"2010","journal-title":"J. Math. Imaging Vis."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1007\/s11228-011-0191-y","article-title":"Primal-dual splitting algorithm for solving inclusions with mixtures of composite, Lipschitzian, and parallel-sum type monotone operators","volume":"20","author":"Combettes","year":"2012","journal-title":"Set-Valued Var. Anal."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1007\/s10957-012-0245-9","article-title":"A primal-dual splitting method for convex optimization involving Lipschitzian, proximable and linear composite terms","volume":"158","author":"Condat","year":"2013","journal-title":"J. Optim. Theory Appl."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Ono, S., Yamagishi, M., Miyata, T., and Kumazawa, I. (2016, January 20\u201325). Image restoration using a stochastic variant of the alternating direction method of multipliers. Proceedings of the 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Shanghai, China.","DOI":"10.1109\/ICASSP.2016.7472533"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"2783","DOI":"10.1137\/17M1134834","article-title":"Stochastic primal-dual hybrid gradient algorithm with arbitrary sampling and imaging applications","volume":"28","author":"Chambolle","year":"2018","journal-title":"SIAM J. Optim."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Combettes, P.L., and Pesquet, J.C. (September, January 29). Stochastic forward-backward and primal-dual approximation algorithms with application to online image restoration. Proceedings of the 2016 24th European Signal Processing Conference (EUSIPCO), Budapest, Hungary.","DOI":"10.1109\/EUSIPCO.2016.7760561"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Ono, S. (2019, January 12\u201317). Efficient constrained signal reconstruction by randomized epigraphical projection. Proceedings of the 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brighton, UK.","DOI":"10.1109\/ICASSP.2019.8682191"},{"key":"ref_50","unstructured":"(2016, July 04). SpecTIR. Available online: http:\/\/www.spectir.com\/free-data-samples\/."},{"key":"ref_51","unstructured":"(2016, July 04). MultiSpec. Available online: https:\/\/engineering.purdue.edu\/biehl\/MultiSpec."},{"key":"ref_52","unstructured":"(2016, July 04). GIC. Available online: http:\/\/www.ehu.eus\/ccwintco\/index.php?title=Hyperspectral_Remote_Sensing_Scenes."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Liu, W., and Lee, J. (2019). A 3-D Atrous Convolution Neural Network for Hyperspectral Image Denoising. IEEE Trans. Geosci. Remote Sens.","DOI":"10.1109\/TGRS.2019.2901737"},{"key":"ref_54","unstructured":"Gou, Y., Li, B., Liu, Z., Yang, S., and Peng, X. (2020, January 6\u201312). CLEARER: Multi-Scale Neural Architecture Search for Image Restoration. Proceedings of the NeurIPS 2020: Thirty-Fourth Conference on Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1109\/MSP.2007.4286571","article-title":"Compressive sensing","volume":"24","author":"Baraniuk","year":"2007","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1109\/MSP.2007.914731","article-title":"An introduction to compressive sampling","volume":"25","author":"Wakin","year":"2008","journal-title":"IEEE Signal Process. Mag."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/21\/3541\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:30:17Z","timestamp":1760178617000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/21\/3541"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,28]]},"references-count":57,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2020,11]]}},"alternative-id":["rs12213541"],"URL":"https:\/\/doi.org\/10.3390\/rs12213541","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,10,28]]}}}