{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:56:02Z","timestamp":1760147762023,"version":"build-2065373602"},"reference-count":59,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2023,3,1]],"date-time":"2023-03-01T00:00:00Z","timestamp":1677628800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003141","name":"Consejo Nacional de Ciencia y Tecnolog\u00eda","doi-asserted-by":"publisher","award":["717754","789304"],"award-info":[{"award-number":["717754","789304"]}],"id":[{"id":"10.13039\/501100003141","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The present work, unlike others, does not try to reduce the noise in hyperspectral images to increase the semantic segmentation performance metrics; rather, we present a classification framework for noisy Hyperspectral Images (HSI), studying the classification performance metrics for different SNR levels and where the inputs are compressed. This framework consists of a 3D Convolutional Neural Network (3DCNN) that uses as input data a spectrally compressed version of the HSI, obtained from the Tucker Decomposition (TKD). The advantage of this classifier is the ability to handle spatial and spectral features from the core tensor, exploiting the spatial correlation of remotely sensed images of the earth surface. To test the performance of this framework, signal-independent thermal noise and signal-dependent photonic noise generators are implemented to simulate an extensive collection of tests, from 60 dB to \u221220 dB of Signal-to-Noise Ratio (SNR) over three datasets: Indian Pines (IP), University of Pavia (UP), and Salinas (SAL). For comparison purposes, we have included tests with Support Vector Machine (SVM), Random Forest (RF), 1DCNN, and 2DCNN. For the test cases, the datasets were compressed to only 40 tensor bands for a relative reconstruction error less than 1%. This framework allows us to classify the noisy data with better accuracy and significantly reduces the computational complexity of the Deep Learning (DL) model. The framework exhibits an excellent performance from 60 dB to 0 dB of SNR for 2DCNN and 3DCNN, achieving a Kappa coefficient from 0.90 to 1.0 in all the noisy data scenarios for a representative set of labeled samples of each class for training, from 5% to 10% for the datasets used in this work. The source code and log files of the experiments used for this paper are publicly available for research purposes.<\/jats:p>","DOI":"10.3390\/rs15051399","type":"journal-article","created":{"date-parts":[[2023,3,2]],"date-time":"2023-03-02T01:39:21Z","timestamp":1677721161000},"page":"1399","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["A Semantic Segmentation Framework for Hyperspectral Imagery Based on Tucker Decomposition and 3DCNN Tested with Simulated Noisy Scenarios"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9880-7157","authenticated-orcid":false,"given":"Efrain","family":"Padilla-Zepeda","sequence":"first","affiliation":[{"name":"Center for Research and Advanced Studies of the National Polytechnic Institute, Telecommunications Group, Av del Bosque 1145, Zapopan 45017, Mexico"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9813-7712","authenticated-orcid":false,"given":"Deni","family":"Torres-Roman","sequence":"additional","affiliation":[{"name":"Center for Research and Advanced Studies of the National Polytechnic Institute, Telecommunications Group, Av del Bosque 1145, Zapopan 45017, Mexico"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7121-8195","authenticated-orcid":false,"given":"Andres","family":"Mendez-Vazquez","sequence":"additional","affiliation":[{"name":"Center for Research and Advanced Studies of the National Polytechnic Institute, Telecommunications Group, Av del Bosque 1145, Zapopan 45017, Mexico"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Borengasser, M., Hungate, W.S., and Watkins, R.L. (2008). Hyperspectral Remote Sensing: Principles and Applications, CRC Press.","DOI":"10.1201\/9781420012606"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1016\/j.isprsjprs.2019.09.006","article-title":"Deep learning classifiers for hyperspectral imaging: A review","volume":"158","author":"Paoletti","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Rasti, B., Scheunders, P., Ghamisi, P., Licciardi, G., and Chanussot, J. (2018). Noise Reduction in Hyperspectral Imagery: Overview and Application. Remote Sens., 10.","DOI":"10.3390\/rs10030482"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Bourennane, S., Fossati, C., and Lin, T. (2018). Noise Removal Based on Tensor Modelling for Hyperspectral Image Classification. Remote Sens., 10.","DOI":"10.3390\/rs10091330"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Gu, S., Zhang, L., Zuo, W., and Feng, X. (2014, January 23\u201328). Weighted nuclear norm minimization with application to image denoising. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.366"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1109\/JSTSP.2011.2132692","article-title":"Noise reduction of hyperspectral images using kernel non-negative tucker decomposition","volume":"5","author":"Karami","year":"2011","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1205","DOI":"10.1109\/TGRS.2018.2865197","article-title":"Hyperspectral image denoising employing a spatial-spectral deep residual convolutional neural network","volume":"57","author":"Yuan","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"6196","DOI":"10.1109\/TGRS.2018.2833473","article-title":"Spatial-Spectral Total Variation Regularized Low-Rank Tensor Decomposition for Hyperspectral Image Denoising","volume":"56","author":"Fan","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1380","DOI":"10.1109\/ACCESS.2017.2778947","article-title":"Hyperspectral Image Denoising with Group Sparse and Low-Rank Tensor Decomposition","volume":"6","author":"Huang","year":"2017","journal-title":"IEEE Access"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"6232","DOI":"10.1109\/TGRS.2016.2584107","article-title":"Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks","volume":"54","author":"Chen","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1007\/978-3-030-32456-8_3","article-title":"A Comparison and Strategy of Semantic Segmentation on Remote Sensing Images","volume":"1074","author":"Hu","year":"2019","journal-title":"Adv. Intell. Syst. Comput."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1109\/LGRS.2018.2871507","article-title":"DeepLab-Based Spatial Feature Extraction for Hyperspectral Image Classification","volume":"16","author":"Niu","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zhong, Z., Li, J., Ma, L., Jiang, H., and Zhao, H. (2017, January 23\u201328). Deep residual networks for hyperspectral image classification. Proceedings of the International Geoscience and Remote Sensing Symposium (IGARSS), Fort Worth, TX, USA.","DOI":"10.1109\/IGARSS.2017.8127330"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"5329","DOI":"10.1109\/TGRS.2019.2899057","article-title":"Classification of Hyperspectral Images Based on Multiclass Spatial-Spectral Generative Adversarial Networks","volume":"57","author":"Feng","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"258619","DOI":"10.1155\/2015\/258619","article-title":"Deep convolutional neural networks for hyperspectral image classification","volume":"2015","author":"Hu","year":"2015","journal-title":"J. Sens."},{"key":"ref_16","first-page":"7420","article-title":"Transferable Semi-Supervised Semantic Segmentation","volume":"32","author":"Xiao","year":"2018","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Sun, R., Zhu, X., Wu, C., Huang, C., Shi, J., and Ma, L. (2019, January 15\u201319). Not all areas are equal: Transfer learning for semantic segmentation via hierarchical region selection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00449"},{"key":"ref_18","first-page":"2593","article-title":"Unsupervised Model Adaptation for Continual Semantic Segmentation","volume":"35","author":"Stan","year":"2021","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"ref_19","first-page":"2307","article-title":"Boost Supervised Pretraining for Visual Transfer Learning: Implications of Self-Supervised Contrastive Representation Learning","volume":"36","author":"Sun","year":"2022","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"116744","DOI":"10.1109\/ACCESS.2020.3003914","article-title":"Semantic Segmentation of Remote Sensing Images Using Transfer Learning and Deep Convolutional Neural Network with Dense Connection","volume":"8","author":"Cui","year":"2020","journal-title":"IEEE Access"},{"key":"ref_21","first-page":"234","article-title":"U-Net: Convolutional Networks for Biomedical Image Segmentation","volume":"Volume 9351","author":"Ronneberger","year":"2015","journal-title":"Medical Image Computing and Computer-Assisted Intervention\u2014MICCAI 2015"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Pasquali, G., Iannelli, G.C., and Dell\u2019Acqua, F. (2019). Building Footprint Extraction from Multispectral, Spaceborne Earth Observation Datasets Using a Structurally Optimized U-Net Convolutional Neural Network. Remote Sens., 11.","DOI":"10.3390\/rs11232803"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"111203","DOI":"10.1016\/j.rse.2019.05.022","article-title":"Multi-sensor cloud and cloud shadow segmentation with a convolutional neural network","volume":"230","author":"Wieland","year":"2019","journal-title":"Remote Sens. Environ."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"186257","DOI":"10.1109\/ACCESS.2020.3030112","article-title":"U-net convolutional networks for mining land cover classification based on high-resolution UAV imagery","volume":"8","author":"Giang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_25","first-page":"1","article-title":"A Novel Band Selection and Spatial Noise Reduction Method for Hyperspectral Image Classification","volume":"60","author":"Fu","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"3474","DOI":"10.1109\/TGRS.2012.2185053","article-title":"Information fusion in the redundant-wavelet-transform domain for noise-robust hyperspectral classification","volume":"50","author":"Prasad","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1948","DOI":"10.1109\/JSTARS.2019.2915272","article-title":"Noise-robust hyperspectral image classification via multi-scale total variation","volume":"12","author":"Duan","year":"2019","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Gong, Z., Zhong, P., Yao, W., Zhou, W., Qi, J., and Hu, P. (2022). A CNN with noise inclined module and denoise framework for hyperspectral image classification. IET Image Process.","DOI":"10.1049\/ipr2.12733"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1047","DOI":"10.1109\/JSTARS.2013.2295610","article-title":"Spectral\u2013Spatial Preprocessing Using Multihypothesis Prediction for Noise-Robust Hyperspectral Image Classification","volume":"7","author":"Chen","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Gao, L., Zhao, B., Jia, X., Liao, W., Zhang, B., Wang, Q., Younan, N.H., L\u00f3pez-Mart\u00ednez, C., and Thenkabail, P.S. (2017). Optimized Kernel Minimum Noise Fraction Transformation for Hyperspectral Image Classification. Remote Sens., 9.","DOI":"10.3390\/rs9060548"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Fu, P., Sun, X., and Sun, Q. (2017). Hyperspectral Image Segmentation via Frequency-Based Similarity for Mixed Noise Estimation. Remote Sens., 9.","DOI":"10.3390\/rs9121237"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"de Los Reyes, R., Langheinrich, M., Schwind, P., Richter, R., Pflug, B., Bachmann, M., M\u00fcller, R., Carmona, E., Zekoll, V., and Reinartz, P. (2020). PACO: Python-Based Atmospheric COrrection. Sensors, 20.","DOI":"10.3390\/s20051428"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zekoll, V., Main-Knorn, M., Alonso, K., Louis, J., Frantz, D., Richter, R., and Pflug, B. (2021). Comparison of Masking Algorithms for Sentinel-2 Imagery. Remote Sens., 13.","DOI":"10.3390\/rs13010137"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"8830","DOI":"10.3390\/rs70708830","article-title":"The EnMAP Spaceborne Imaging Spectroscopy Mission for Earth Observation","volume":"7","author":"Guanter","year":"2015","journal-title":"Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Alonso, K., Bachmann, M., Burch, K., Carmona, E., Cerra, D., de los Reyes, R., Dietrich, D., Heiden, U., H\u00f6lderlin, A., and Ickes, J. (2019). Data Products, Quality and Validation of the DLR Earth Sensing Imaging Spectrometer (DESIS). Sensors, 19.","DOI":"10.3390\/s19204471"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"L\u00f3pez, J., Torres, D., Santos, S., and Atzberger, C. (2020). Spectral Imagery Tensor Decomposition for Semantic Segmentation of Remote Sensing Data through Fully Convolutional Networks. Remote Sens., 12.","DOI":"10.3390\/rs12030517"},{"key":"ref_37","first-page":"10","article-title":"Noise analysis using Tucker decomposition and PCA on spectral images","volume":"7","year":"2020","journal-title":"ECORFAN J.-Boliv."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1137\/07070111X","article-title":"Tensor decompositions and applications","volume":"51","author":"Kolda","year":"2009","journal-title":"SIAM Rev."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"5396","DOI":"10.1109\/TGRS.2013.2288525","article-title":"Reduction of signal-dependent noise from hyperspectral images for target detection","volume":"52","author":"Liu","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Li, Y., Zhang, H., and Shen, Q. (2017). Spectral\u2013Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network. Remote Sens., 9.","DOI":"10.3390\/rs9010067"},{"key":"ref_41","unstructured":"Grandini, M., Bagli, E., and Visani, G. (2020). Metrics for Multi-Class Classification: An Overview. arXiv."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/j.patcog.2019.02.023","article-title":"The impact of class imbalance in classification performance metrics based on the binary confusion matrix","volume":"91","author":"Luque","year":"2019","journal-title":"Pattern Recognit."},{"key":"ref_43","first-page":"11","article-title":"Analysis of multi-class classification performance metrics for remote sensing imagery imbalanced datasets","volume":"8","author":"Lopez","year":"2021","journal-title":"ECORFAN J. Quant. Stat. Anal."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"6884","DOI":"10.1109\/TGRS.2018.2845450","article-title":"Tensor-based classification models for hyperspectral data analysis","volume":"56","author":"Makantasis","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"3551","DOI":"10.1109\/TSP.2017.2690524","article-title":"Tensor Decomposition for Signal Processing and Machine Learning","volume":"65","author":"Sidiropoulos","year":"2017","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"An, J., Lei, J., Song, Y., Zhang, X., and Guo, J. (2019). Tensor Based Multiscale Low Rank Decomposition for Hyperspectral Images Dimensionality Reduction. Remote Sens., 11.","DOI":"10.3390\/rs11121485"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Kong, X., Zhao, Y., Xue, J., and Chan, J.C.W. (2019). Hyperspectral Image Denoising Using Global Weighted Tensor Norm Minimum and Nonlocal Low-Rank Approximation. Remote Sens., 11.","DOI":"10.3390\/rs11192281"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/TNN.2007.901277","article-title":"MPCA: Multilinear principal component analysis of tensor objects","volume":"19","author":"Lu","year":"2008","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_49","unstructured":"(2020, June 15). AVIRIS\u2014eoPortal Directory\u2014Airborne Sensors, Available online: https:\/\/aviris.jpl.nasa.gov\/."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1007\/BF02289464","article-title":"Some mathematical notes on three-mode factor analysis","volume":"31","author":"Tucker","year":"1966","journal-title":"Psychometrika"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Alparone, L., Selva, M., Aiazzi, B., Baronti, S., Butera, F., and Chiarantini, L. (2009, January 26\u201328). Signal-dependent noise modelling and estimation of new-generation imaging spectrometers. Proceedings of the WHISPERS \u201909\u20141st Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing, Grenoble, France.","DOI":"10.1109\/WHISPERS.2009.5289080"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"2676","DOI":"10.1109\/TIP.2006.877363","article-title":"CCD noise removal in digital images","volume":"15","author":"Faraji","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_53","unstructured":"Jain, A.K. (1989). Fundamentals of Digital Image Processing, Prentice-Hall, Inc."},{"key":"ref_54","unstructured":"Padilla-Zepeda, E. (2022, March 10). Noisy-Hyperspectral-Semantic-Segmentation-Framework-Based-on-Tucker-Decomposition-and-3D-CNN. Available online: https:\/\/github.com\/EfrainPadilla\/Noisy-Hyperspectral-Semantic-Segmentation-Framework-based-on-Tucker-Decomposition-and-3D-CNN."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/S0034-4257(98)00064-9","article-title":"Imaging spectroscopy and the Airborne Visible\/Infrared Imaging Spectrometer (AVIRIS)","volume":"65","author":"Green","year":"1998","journal-title":"Remote Sens. Environ."},{"key":"ref_56","first-page":"134","article-title":"ROSIS (Reflective Optics System Imaging Spectrometer) - A Candidate Instrument For Polar Platform Missions","volume":"868","author":"Kunkel","year":"1988","journal-title":"Optoelectron. Technol. Remote Sens. Space SPIE"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1038\/s41586-020-2649-2","article-title":"Array programming with NumPy","volume":"585","author":"Harris","year":"2020","journal-title":"Nature"},{"key":"ref_58","first-page":"1","article-title":"TensorLy: Tensor Learning in Python","volume":"20","author":"Kossaifi","year":"2019","journal-title":"J. Mach. Learn. Res."},{"key":"ref_59","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/5\/1399\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:45:40Z","timestamp":1760121940000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/5\/1399"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,1]]},"references-count":59,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["rs15051399"],"URL":"https:\/\/doi.org\/10.3390\/rs15051399","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2023,3,1]]}}}