{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,12]],"date-time":"2026-02-12T11:50:16Z","timestamp":1770897016870,"version":"3.50.1"},"reference-count":34,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2022,12,13]],"date-time":"2022-12-13T00:00:00Z","timestamp":1670889600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["42171356"],"award-info":[{"award-number":["42171356"]}]},{"name":"National Natural Science Foundation of China","award":["CIT&TCD20180322"],"award-info":[{"award-number":["CIT&TCD20180322"]}]},{"name":"National Natural Science Foundation of China","award":["42171444"],"award-info":[{"award-number":["42171444"]}]},{"name":"Great Wall Scholars Training Program Project of Beijing Municipality Universities","award":["42171356"],"award-info":[{"award-number":["42171356"]}]},{"name":"Great Wall Scholars Training Program Project of Beijing Municipality Universities","award":["CIT&TCD20180322"],"award-info":[{"award-number":["CIT&TCD20180322"]}]},{"name":"Great Wall Scholars Training Program Project of Beijing Municipality Universities","award":["42171444"],"award-info":[{"award-number":["42171444"]}]},{"name":"Research on the basic problems of knowledge modeling of large and complex cultural relics for virtual restoration","award":["42171356"],"award-info":[{"award-number":["42171356"]}]},{"name":"Research on the basic problems of knowledge modeling of large and complex cultural relics for virtual restoration","award":["CIT&TCD20180322"],"award-info":[{"award-number":["CIT&TCD20180322"]}]},{"name":"Research on the basic problems of knowledge modeling of large and complex cultural relics for virtual restoration","award":["42171444"],"award-info":[{"award-number":["42171444"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Environmental changes and human activities have caused serious degradation of murals around the world. Scratches are one of the most common issues in these damaged murals. We propose a new method for virtually enhancing and removing scratches from murals; which can provide an auxiliary reference and support for actual restoration. First, principal component analysis (PCA) was performed on the hyperspectral data of a mural after reflectance correction, and high-pass filtering was performed on the selected first principal component image. Principal component fusion was used to replace the original first principal component with a high-pass filtered first principal component image, which was then inverse PCA transformed with the other original principal component images to obtain an enhanced hyperspectral image. The linear information in the mural was therefore enhanced, and the differences between the scratches and background improved. Second, the enhanced hyperspectral image of the mural was synthesized as a true colour image and converted to the HSV colour space. The light brightness component of the image was estimated using the multi-scale Gaussian function and corrected with a 2D gamma function, thus solving the problem of localised darkness in the murals. Finally, the enhanced mural images were applied as input to the triplet domain translation network pretrained model. The local branches in the translation network perform overall noise smoothing and colour recovery of the mural, while the partial nonlocal block is used to extract the information from the scratches. The mapping process was learned in the hidden space for virtual removal of the scratches. In addition, we added a Butterworth high-pass filter at the end of the network to generate the final restoration result of the mural with a clearer visual effect and richer high-frequency information. We verified and validated these methods for murals in the Baoguang Hall of Qutan Temple. The results show that the proposed method outperforms the restoration results of the total variation (TV) model, curvature-driven diffusion (CDD) model, and Criminisi algorithm. Moreover, the proposed combined method produces better recovery results and improves the visual richness, readability, and artistic expression of the murals compared with direct recovery using a triple domain translation network.<\/jats:p>","DOI":"10.3390\/s22249780","type":"journal-article","created":{"date-parts":[[2022,12,14]],"date-time":"2022-12-14T03:21:52Z","timestamp":1670988112000},"page":"9780","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Enhancement and Restoration of Scratched Murals Based on Hyperspectral Imaging\u2014A Case Study of Murals in the Baoguang Hall of Qutan Temple, Qinghai, China"],"prefix":"10.3390","volume":"22","author":[{"given":"Pengyu","family":"Sun","sequence":"first","affiliation":[{"name":"School of Geomatics and Urban Spatial Informatics, Beijing University of Civil Engineering and Architecture, No. 15 Yongyuan Road, Beijing 102616, China"},{"name":"Beijing Key Laboratory for Architectural Heritage Fine Reconstruction & Health Monitoring, No. 15 Yongyuan Road, Beijing 102616, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0942-629X","authenticated-orcid":false,"given":"Miaole","family":"Hou","sequence":"additional","affiliation":[{"name":"School of Geomatics and Urban Spatial Informatics, Beijing University of Civil Engineering and Architecture, No. 15 Yongyuan Road, Beijing 102616, China"},{"name":"Beijing Key Laboratory for Architectural Heritage Fine Reconstruction & Health Monitoring, No. 15 Yongyuan Road, Beijing 102616, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shuqiang","family":"Lyu","sequence":"additional","affiliation":[{"name":"School of Geomatics and Urban Spatial Informatics, Beijing University of Civil Engineering and Architecture, No. 15 Yongyuan Road, Beijing 102616, China"},{"name":"Beijing Key Laboratory for Architectural Heritage Fine Reconstruction & Health Monitoring, No. 15 Yongyuan Road, Beijing 102616, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wanfu","family":"Wang","sequence":"additional","affiliation":[{"name":"The Dunhuang Academy, Dunhuang 736200, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shuyang","family":"Li","sequence":"additional","affiliation":[{"name":"School of Geomatics and Urban Spatial Informatics, Beijing University of Civil Engineering and Architecture, No. 15 Yongyuan Road, Beijing 102616, China"},{"name":"Beijing Key Laboratory for Architectural Heritage Fine Reconstruction & Health Monitoring, No. 15 Yongyuan Road, Beijing 102616, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jincheng","family":"Mao","sequence":"additional","affiliation":[{"name":"School of Geomatics and Urban Spatial Informatics, Beijing University of Civil Engineering and Architecture, No. 15 Yongyuan Road, Beijing 102616, China"},{"name":"Beijing Key Laboratory for Architectural Heritage Fine Reconstruction & Health Monitoring, No. 15 Yongyuan Road, Beijing 102616, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8244-5681","authenticated-orcid":false,"given":"Songnian","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Civil Engineering, Toronto Metropolitan University, 350 Victoria Street, Toronto, ON M5B 2K3, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1038\/d41586-019-01816-0","article-title":"Restore world\u2019s cultural heritage with the latest science","volume":"570","author":"Bertrand","year":"2019","journal-title":"Nature"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Pietroni, E., and Ferdani, D. (2021). Virtual Restoration and Virtual Reconstruction in Cultural Heritage: Terminology, Methodologies, Visual Representation Techniques and Cognitive Models. Information, 12.","DOI":"10.3390\/info12040167"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"416","DOI":"10.1109\/TIP.2003.821347","article-title":"Virtual Restoration of Ancient Chinese Paintings Using Color Contrast Enhancement and Lacuna Texture Synthesis","volume":"13","author":"Pei","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_4","unstructured":"Baatz, W., Fornasier, M., Markowich, P.A., and Sch\u00f6nlieb, C.B. (2008). Inpainting of ancient Austrian frescoes. Bridges Leeuwarden: Mathematics, Music, Art, Architecture, Culture, The Bridges Organization."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"605","DOI":"10.1016\/j.sigpro.2012.07.022","article-title":"Crack detection and inpainting for virtual restoration of paintings: The case of the Ghent Altarpiece","volume":"93","author":"Cornelis","year":"2013","journal-title":"Signal Process."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1016\/j.culher.2018.04.004","article-title":"Virtual restoration of stains on ancient paintings with maximum noise fraction transformation based on the hyperspectral imaging","volume":"34","author":"Hou","year":"2018","journal-title":"J. Cult. Herit."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Purkait, P., Ghorai, M., Samanta, S., and Chanda, B. (2017). A Patch-Based Constrained Inpainting for Damaged Mural Images, Digital Hampi: Preserving Indian Cultural Heritage, Springer.","DOI":"10.1007\/978-981-10-5738-0_13"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1186\/s40494-021-00604-2","article-title":"The digital reconstruction of degraded ancient temple murals using dynamic mask generation and an extended exemplar-based region-filling algorithm","volume":"9","author":"Mol","year":"2021","journal-title":"Herit. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1197","DOI":"10.1007\/s13042-019-01032-2","article-title":"A global and local feature weighted method for ancient murals inpainting","volume":"11","author":"Wang","year":"2019","journal-title":"Int. J. Mach. Learn. Cybern."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1186\/s40494-021-00504-5","article-title":"Restoration method of sootiness mural images based on dark channel prior and Retinex by bilateral filter","volume":"9","author":"Cao","year":"2021","journal-title":"Herit. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., and Efros, A.A. (2016, January 27\u201330). Context Encoders: Feature Learning by Inpainting. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.278"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"115092","DOI":"10.1016\/j.eswa.2021.115092","article-title":"ARQGAN: An evaluation of generative adversarial network approaches for automatic virtual inpainting restoration of Greek temples","volume":"180","author":"Nogales","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1007\/s12530-019-09303-7","article-title":"Restoration of artwork using deep neural networks","volume":"12","author":"Gupta","year":"2021","journal-title":"Evol. Syst."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3101","DOI":"10.1007\/s12652-017-0656-4","article-title":"Learning multi-path CNN for mural deterioration detection","volume":"11","author":"Huang","year":"2020","journal-title":"J. Ambient Intell. Humaniz. Comput."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3720","DOI":"10.1109\/TIP.2021.3064268","article-title":"Thanka Mural Inpainting Based on Multi-Scale Adaptive Partial Convolution and Stroke-Like Mask","volume":"30","author":"Wang","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1186\/s40494-020-00478-w","article-title":"Restoration of non-structural damaged murals in Shenzhen Bao\u2019an based on a generator\u2013discriminator network","volume":"9","author":"Li","year":"2021","journal-title":"Herit. Sci."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wan, Z., Zhang, B., Chen, D., Zhang, P., Chen, D., Liao, J., and Wen, F. (2020, January 14\u201319). Bringing Old Photos Back to Life. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00282"},{"key":"ref_18","unstructured":"(2008). Ancient Wall Painting Deterioration and Legends. Chinese National Standard for the Protection of Cultural Relics (Standard No. GB\/T 30237-2013)."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"5966","DOI":"10.1109\/TGRS.2017.2718547","article-title":"Spectral-Density-Based Graph Construction Techniques for Hyperspectral Image Analysis","volume":"55","author":"Stevens","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/j.sysarc.2017.05.001","article-title":"Porting a PCA-based hyperspectral image dimensionality reduction algorithm for brain cancer detection on a manycore architecture","volume":"77","author":"Lazcano","year":"2017","journal-title":"J. Syst. Arch."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"163246","DOI":"10.1016\/j.ijleo.2019.163246","article-title":"Graphene-based high pass filter in terahertz band","volume":"198","author":"Azimbeik","year":"2019","journal-title":"Optik"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1115","DOI":"10.1049\/el:20000839","article-title":"Sensor fusion of multispectral imagery","volume":"36","author":"Das","year":"2000","journal-title":"Electron. Lett."},{"key":"ref_23","first-page":"191","article-title":"Adaptive correction algorithm for illumination inhomogeneousimages based on 2D gamma function","volume":"36","author":"Liu","year":"2016","journal-title":"J. Beijing Univ. Technol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"3078","DOI":"10.1073\/pnas.83.10.3078","article-title":"An alternative technique for the computation of the designator in the retinex theory of color vision","volume":"83","author":"Land","year":"1986","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_25","first-page":"947","article-title":"Global color image enhancement algorithm based on Retinex model","volume":"8","author":"Fuwen","year":"2010","journal-title":"J. Beijing Univ. Technol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1240","DOI":"10.1109\/LSP.2013.2285960","article-title":"Light Random Sprays Retinex: Exploiting the Noisy Illumination Estimation","volume":"20","author":"Banic","year":"2013","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2636","DOI":"10.1109\/TCE.2010.5681151","article-title":"A Space-Variant Luminance Map based Color Image Enhancement","volume":"56","author":"Lee","year":"2010","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Johnson, J., Alahi, A., and Fei-Fei, L. (2016, January 8\u201316). Perceptual losses for real-time style transfer and super-resolution. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherland.","DOI":"10.1007\/978-3-319-46475-6_43"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1007\/s11263-014-0733-5","article-title":"The Pascal Visual Object Classes Challenge: A Retrospective","volume":"111","author":"Everingham","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_30","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. Comput. Sci."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Navab, N., Hornegger, J., Wells, W.M., and Frangi, A.F. (2015). U-Net: Convolutional networks for biomedical image segmentation. Medical Image Computing and Computer-Assisted Intervention 2015, Springer International Publishing.","DOI":"10.1007\/978-3-319-24553-9"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1019","DOI":"10.1137\/S0036139900368844","article-title":"Mathematical Models for Local Nontexture Inpaintings","volume":"62","author":"Shen","year":"2001","journal-title":"SIAM J. Appl. Math."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1006\/jvci.2001.0487","article-title":"Nontexture Inpainting by Curvature-Driven Diffusions","volume":"12","author":"Chan","year":"2001","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_34","unstructured":"Criminisi, A., Perez, P., and Toyama, K. (2003, January 18\u201320). Object removal by exemplar-based inpainting. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Madison, WI, USA."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/24\/9780\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:40:33Z","timestamp":1760146833000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/24\/9780"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,13]]},"references-count":34,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["s22249780"],"URL":"https:\/\/doi.org\/10.3390\/s22249780","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,13]]}}}