{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T19:42:08Z","timestamp":1776886928464,"version":"3.51.2"},"reference-count":47,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2023,7,19]],"date-time":"2023-07-19T00:00:00Z","timestamp":1689724800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Social Science Fund of China","award":["21AMZ011"],"award-info":[{"award-number":["21AMZ011"]}]},{"name":"National Social Science Fund of China","award":["ZDPY2206"],"award-info":[{"award-number":["ZDPY2206"]}]},{"name":"Major Cultivation Fund for Philosophy and Social Sciences of South China Normal University","award":["21AMZ011"],"award-info":[{"award-number":["21AMZ011"]}]},{"name":"Major Cultivation Fund for Philosophy and Social Sciences of South China Normal University","award":["ZDPY2206"],"award-info":[{"award-number":["ZDPY2206"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Thangka refers to a form of Tibetan Buddhist painting on a fabric, scroll, or Thangka, often depicting deities, scenes, or mandalas. Deep-learning-based super-resolution techniques have been applied to improve the spatial resolution of hyperspectral images (HSIs), especially for the preservation and analysis of Thangka cultural heritage. However, existing CNN-based methods encounter difficulties in effectively preserving spatial information, due to challenges such as registration errors and spectral variability. To overcome these limitations, we present a novel cross-sensor super-resolution (SR) framework that utilizes high-resolution RGBs (HR-RGBs) to enhance the spectral features in low-resolution hyperspectral images (LR-HSIs). Our approach utilizes spatial\u2013spectral integration (SSI) blocks and spatial\u2013spectral restoration (SSR) blocks to effectively integrate and reconstruct spatial and spectral features. Furthermore, we introduce a frequency multi-head self-attention (F-MSA) mechanism that treats high-, medium-, and low-frequency features as tokens, enabling self-attention computations across the frequency dimension. We evaluate our method on a custom dataset of ancient Thangka paintings and demonstrate its effectiveness in enhancing the spectral resolution in high-resolution hyperspectral images (HR-HSIs), while preserving the spatial characteristics of Thangka artwork with minimal information loss.<\/jats:p>","DOI":"10.3390\/rs15143603","type":"journal-article","created":{"date-parts":[[2023,7,19]],"date-time":"2023-07-19T21:21:46Z","timestamp":1689801706000},"page":"3603","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Thangka Hyperspectral Image Super-Resolution Based on a Spatial\u2013Spectral Integration Network"],"prefix":"10.3390","volume":"15","author":[{"given":"Sai","family":"Wang","sequence":"first","affiliation":[{"name":"School of Geography, South China Normal University, Guangzhou 510631, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6190-9072","authenticated-orcid":false,"given":"Fenglei","family":"Fan","sequence":"additional","affiliation":[{"name":"School of Geography, South China Normal University, Guangzhou 510631, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,7,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"3","DOI":"10.2307\/3179514","article-title":"Conservation Treatment of Tibetan Thangkas","volume":"30","author":"Shaftel","year":"1991","journal-title":"J. Am. Inst. Conserv."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1179\/sic.2011.56.2.81","article-title":"Conservation of Thangkas: A Review of the Literature since the 1970s","volume":"56","author":"Cotte","year":"2011","journal-title":"Stud. Conserv."},{"key":"ref_3","unstructured":"Wang, W., Qian, J., and Lu, X. (2012). Advanced Topics in Multimedia Research, InTech."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"13683","DOI":"10.1007\/s10586-018-2068-4","article-title":"Damaged Region Filling by Improved Criminisi Image Inpainting Algorithm for Thangka","volume":"22","author":"Yao","year":"2019","journal-title":"Clust. Comput."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"48841","DOI":"10.1109\/ACCESS.2021.3068199","article-title":"Thangka Mural Line Drawing Based on Cross Dense Residual Architecture and Hard Pixel Balancing","volume":"9","author":"Wang","year":"2021","journal-title":"IEEE Access"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2851","DOI":"10.3390\/heritage5040148","article-title":"Studying Saraha: Technical and Multi-Analytical Investigation of the Painting Materials and Techniques in an 18th Century Tibetan Thangka","volume":"5","author":"Dyer","year":"2022","journal-title":"Heritage"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1002\/jrs.2443","article-title":"In Situ Raman Microscopy Applied to Large Central Asian Paintings","volume":"41","author":"Ernst","year":"2010","journal-title":"J. Raman Spectrosc."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1186\/s40494-014-0021-2","article-title":"A Scientific Study of the Pigments in the Wall Paintings at Jokhang Monastery in Lhasa, Tibet, China","volume":"2","author":"Li","year":"2014","journal-title":"Herit. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Pouyet, E., Miteva, T., Rohani, N., and de Viguerie, L. (2021). Artificial Intelligence for Pigment Classification Task in the Short-Wave Infrared Range. Sensors, 21.","DOI":"10.3390\/s21186150"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2070","DOI":"10.1021\/acs.accounts.6b00048","article-title":"Reflectance Hyperspectral Imaging for Investigation of Works of Art: Old Master Paintings and Illuminated Manuscripts","volume":"49","author":"Cucci","year":"2016","journal-title":"Acc. Chem. Res."},{"key":"ref_11","first-page":"3","article-title":"Introduction to Hyperspectral Image Analysis","volume":"2","author":"Shippert","year":"2003","journal-title":"Online J. Space Commun."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1179\/sic.2006.51.Supplement-1.3","article-title":"Multispectral and Hyperspectral Imaging Technologies in Conservation: Current Research and Potential Applications","volume":"51","author":"Fischer","year":"2006","journal-title":"Stud. Conserv."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Bonifazi, G., Capobianco, G., Pelosi, C., and Serranti, S. (2019). Hyperspectral Imaging as Powerful Technique for Investigating the Stability of Painting Samples. J. Imaging, 5.","DOI":"10.3390\/jimaging5010008"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.culher.2017.02.017","article-title":"Extracting Faded Mural Patterns Based on the Combination of Spatial-Spectral Feature of Hyperspectral Image","volume":"27","author":"Pan","year":"2017","journal-title":"J. Cult. Herit."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/j.culher.2018.09.008","article-title":"Mining Painted Cultural Relic Patterns Based on Principal Component Images Selection and Image Fusion of Hyperspectral Images","volume":"36","author":"Peng","year":"2019","journal-title":"J. Cult. Herit."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1016\/j.culher.2018.04.004","article-title":"Virtual Restoration of Stains on Ancient Paintings with Maximum Noise Fraction Transformation Based on the Hyperspectral Imaging","volume":"34","author":"Hou","year":"2018","journal-title":"J. Cult. Herit."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zhou, P., Hou, M., Lv, S., Zhao, X., and Wu, W. (2019). Virtual Restoration of Stained Chinese Paintings Using Patch-Based Color Constrained Poisson Editing with Selected Hyperspectral Feature Bands. Remote Sens., 11.","DOI":"10.3390\/rs11111384"},{"key":"ref_18","first-page":"102773","article-title":"DsTer: A Dense Spectral Transformer for Remote Sensing Spectral","volume":"109","author":"He","year":"2022","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"171","DOI":"10.5721\/EuJRS20164910","article-title":"A Novel Approach to Produce NDVI Image Series with Enhanced Spatial Properties","volume":"49","author":"Maselli","year":"2016","journal-title":"Eur. J. Remote Sens."},{"key":"ref_20","first-page":"102570","article-title":"Fusion of Hyperspectral-Multispectral Images Joining Spatial-Spectral Dual-Dictionary and Structured Sparse Low-Rank Representation","volume":"104","author":"Chen","year":"2021","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Li, Y., Zhang, L., Dingl, C., Wei, W., and Zhang, Y. (2018, January 13\u201316). Single Hyperspectral Image Super-Resolution with Grouped Deep Recursive Residual Network. Proceedings of the 2018 IEEE 4th International Conference on Multimedia Big Data (BigMM), Xi\u2019an, China.","DOI":"10.1109\/BigMM.2018.8499097"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zhao, J., Kechasov, D., Rewald, B., Bodner, G., Verheul, M., Clarke, N., and Clarke, J.L. (2020). Deep Learning in Hyperspectral Image Reconstruction from Single Rgb Images\u2014A Case Study on Tomato Quality Parameters. Remote Sens., 12.","DOI":"10.3390\/rs12193258"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1153","DOI":"10.1109\/TASSP.1981.1163711","article-title":"Cubic Convolution Interpolation for Digital Image Processing","volume":"29","author":"Keys","year":"1981","journal-title":"IEEE Trans. Acoust."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Jo, Y., and Kim, S.J. (2021, January 20\u201325). Practical Single-Image Super-Resolution Using Look-Up Table. Proceedings of the 2021 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00075"},{"key":"ref_25","unstructured":"Morse, B.S., and Schwartzwald, D. (2001, January 8\u201314). Image Magnification Using Level-Set Reconstruction. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001, Kauai, HI, USA."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2017","DOI":"10.1109\/TIP.2010.2045707","article-title":"Robust Web Image Video Super-Resolution","volume":"19","author":"Xiong","year":"2010","journal-title":"IEEE Trans. Image Process."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Dong, C., Loy, C.C., He, K., and Tang, X. (2014, January 6\u201312). Learning a Deep Convolutional Network for Image Super-Resolution. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioin-Formatics). Proceedings of the 13th European Conference, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10593-2_13"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Dong, C., Loy, C.C., and Tang, X. (2016, January 11\u201314). Accelerating the Super-Resolution Convolutional Neural Network. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioin-Formatics). Proceedings of the European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46475-6_25"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Kim, J., Lee, J.K., and Lee, K.M. (2016, January 27\u201330). Deeply-Recursive Convolutional Network for Image Super-Resolution. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.181"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Ledig, C., Theis, L., Husz\u00e1r, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A.P., Tejani, A., Totz, J., and Wang, Z. (2017, January 21\u201326). Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.19"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2463","DOI":"10.1080\/01431161.2018.1425561","article-title":"Single-Frame Super Resolution of Remote-Sensing Images by Convolutional Neural Networks","volume":"39","author":"Tuna","year":"2018","journal-title":"Int. J. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"9565","DOI":"10.1080\/01431161.2020.1800129","article-title":"Inception Residual Attention Network for Remote Sensing Image Super-Resolution","volume":"41","author":"Lei","year":"2020","journal-title":"Int. J. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"6050","DOI":"10.1080\/01431161.2021.1934598","article-title":"Super-Resolution of Remotely Sensed Data Using Channel Attention Based Deep Learning Approach","volume":"42","author":"Wang","year":"2021","journal-title":"Int. J. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"5624715","DOI":"10.1109\/TGRS.2022.3180068","article-title":"Multiattention Generative Adversarial Network for Remote Sensing Image Super-Resolution","volume":"60","author":"Jia","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Hu, X., Cai, Y., Lin, J., Wang, H., Yuan, X., Zhang, Y., Timofte, R., and Van Gool, L. (2022). HDNet: High-Resolution Dual-Domain Learning for Spectral Compressive Imaging, Computer Vision Fundation.","DOI":"10.1109\/CVPR52688.2022.01702"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Cai, Y., Lin, J., Hu, X., Wang, H., Yuan, X., Zhang, Y., Timofte, R., and Van Gool, L. (2021). Mask-Guided Spectral-Wise Transformer for Efficient Hyperspectral Image Reconstruction, Computer Vision Fundation.","DOI":"10.1109\/CVPR52688.2022.01698"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Xie, W., Song, D., Xu, C., Xu, C., Zhang, H., and Wang, Y. (2021, January 10\u201317). Learning Frequency-Aware Dynamic Network for Efficient Super-Resolution. Proceedings of the 2021 IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00427"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Xiong, Z., Shi, Z., Li, H., Wang, L., Liu, D., and Wu, F. (2017, January 22\u201329). HSCNN: CNN-Based Hyperspectral Image Recovery from Spectrally Undersampled Projections. Proceedings of the 2017 IEEE International Conference on Computer Vision Workshops, ICCVW 2017, Venice, Italy.","DOI":"10.1109\/ICCVW.2017.68"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Shi, Z., Chen, C., Xiong, Z., Liu, D., and Wu, F. (2018, January 18\u201322). HSCNN+: Advanced CNN-Based Hyperspectral Recovery from RGB Images. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00139"},{"key":"ref_40","unstructured":"Wang, H., Liao, K., Yan, B., and Ye, R. (2019). ACM International Conference Proceeding Series, Association for Computing Machinery (ACM)."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Chen, L., Lu, X., Zhang, J., Chu, X., and Chen, C. (2021, January 19\u201325). HINet: Half Instance Normalization Network for Image Restoration. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Nashville, TN, USA.","DOI":"10.1109\/CVPRW53098.2021.00027"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Zamir, S.W., Arora, A., Khan, S., Hayat, M., Khan, F.S., and Yang, M.H. (2022, January 18\u201324). Restormer: Efficient Transformer for High-Resolution Image Restoration. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00564"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1109\/97.995823","article-title":"A Universal Image Quality Index","volume":"9","author":"Wang","year":"2002","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1002\/j.1538-7305.1982.tb03410.x","article-title":"Peak Signal-to-Noise Ratio Formulas for Multistage Delta Modulation with RC-Shaped Gaussian Input Signals","volume":"61","author":"Steele","year":"1982","journal-title":"Bell Syst. Tech. J."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image Quality Assessment: From Error Visibility to Structural Similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1145\/3422622","article-title":"Generative Adversarial Networks","volume":"63","author":"Goodfellow","year":"2014","journal-title":"Commun. ACM"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22\u201329). Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.244"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/14\/3603\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:14:53Z","timestamp":1760127293000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/14\/3603"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,19]]},"references-count":47,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2023,7]]}},"alternative-id":["rs15143603"],"URL":"https:\/\/doi.org\/10.3390\/rs15143603","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,19]]}}}