{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T18:32:24Z","timestamp":1776882744507,"version":"3.51.2"},"reference-count":36,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2019,6,10]],"date-time":"2019-06-10T00:00:00Z","timestamp":1560124800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the National key research and development program","award":["No.2017YFB1402105"],"award-info":[{"award-number":["No.2017YFB1402105"]}]},{"DOI":"10.13039\/501100001809","name":"the National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["No. 41171304"],"award-info":[{"award-number":["No. 41171304"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"the Fundamental Research Funds for Beijing University of Civil Engineering and Architecture","award":["No. X18024"],"award-info":[{"award-number":["No. X18024"]}]},{"name":"the Beijing Advanced Innovation Center for Future Urban Design","award":["No. UDC2016030200"],"award-info":[{"award-number":["No. UDC2016030200"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Stains, as one of most common degradations of paper cultural relics, not only affect paintings\u2019 appearance, but sometimes even cover the text, patterns, and colors contained in the relics. Virtual restorations based on common red\u2013green\u2013blue images (RGB) which remove the degradations and then fill the lacuna regions with the image\u2019s known parts with the inpainting technology could produce a visually plausible result. However, due to the lack of information inside the degradations, they always yield inconsistent structures when stains cover several color materials. To effectively remove the stains and restore the covered original contents of Chinese paintings, a novel method based on Poisson editing is proposed by exploiting the information inside the degradations of selected three feature bands as the auxiliary information to guide the restoration since the selected feature bands captured fewer stains and could expose the covered information. To make the Poisson editing suitable for stain removal, the feature bands were also exploited to search for the optimal patch for the pixels in the stain region, and the searched patch was used to construct the color constraint on the original Poisson editing to ensure the restoration of the original color of paintings. Specifically, this method mainly consists of two steps: feature band selection from hyperspectral data by establishing rules and reconstruction of stain contaminated regions of RGB image with color constrained Poisson editing. Four Chinese paintings (\u2018Fishing\u2019, \u2018Crane and Banana\u2019, \u2018the Hui Nationality Painting\u2019, and \u2018Lotus Pond and Wild Goose\u2019) with different color materials were used to test the performance of the proposed method. Visual results show that this method can effectively remove or dilute the stains while restoring a painting\u2019s original colors. By comparing values of restored pixels with nonstained pixels (reference of their same color materials), images processed by the proposed method had the lowest average root mean square error (RMSE), normalized absolute error (NAE), and average differences (AD), which indicates that it is an effective method to restore the stains of Chinese paintings.<\/jats:p>","DOI":"10.3390\/rs11111384","type":"journal-article","created":{"date-parts":[[2019,6,11]],"date-time":"2019-06-11T10:55:44Z","timestamp":1560250544000},"page":"1384","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Virtual Restoration of Stained Chinese Paintings Using Patch-Based Color Constrained Poisson Editing with Selected Hyperspectral Feature Bands"],"prefix":"10.3390","volume":"11","author":[{"given":"Pingping","family":"Zhou","sequence":"first","affiliation":[{"name":"College of Geoscience and Surveying Engineering, China University of Mining and Technology, Beijing, Beijing 100083, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0942-629X","authenticated-orcid":false,"given":"Miaole","family":"Hou","sequence":"additional","affiliation":[{"name":"School of Geomatics and Urban Spatial Informatics, Beijing University of Civil Engineering and Architecture, Beijing 100044, China"},{"name":"Beijing Key Laboratory for Architectural Heritage Fine Reconstruction &amp; Health Monitoring, Beijing University of Civil Engineering and Architecture, Beijing 102616, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shuqiang","family":"Lv","sequence":"additional","affiliation":[{"name":"School of Geomatics and Urban Spatial Informatics, Beijing University of Civil Engineering and Architecture, Beijing 100044, China"},{"name":"Beijing Key Laboratory for Architectural Heritage Fine Reconstruction &amp; Health Monitoring, Beijing University of Civil Engineering and Architecture, Beijing 102616, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4780-9723","authenticated-orcid":false,"given":"Xuesheng","family":"Zhao","sequence":"additional","affiliation":[{"name":"College of Geoscience and Surveying Engineering, China University of Mining and Technology, Beijing, Beijing 100083, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wangting","family":"Wu","sequence":"additional","affiliation":[{"name":"Capital Museum, Beijing 100045, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,6,10]]},"reference":[{"key":"ref_1","unstructured":"Jin, H. (2015). The Investigation and Research of Preservation and Protection of Paper Cultural Relics of Zhengzhou Museum, Zhengzhou University."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1016\/j.culher.2018.04.004","article-title":"Virtual restoration of stains on ancient paintings with maximum noise fraction transformation based on the hyperspectral imaging","volume":"34","author":"Hou","year":"2018","journal-title":"J. Cult. Herit."},{"key":"ref_3","first-page":"56","article-title":"Technology for cleaning and restoration of painting and calligraphy relics-the application of minimum intervention principle in paper conservation","volume":"29","author":"Chen","year":"2017","journal-title":"Sci. Conserv. Archaeol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"99","DOI":"10.5194\/isprs-annals-IV-2-W2-99-2017","article-title":"Line-drawing enhanced interactive mural restoration for Dunhuang Mogao Grottoes","volume":"IV-2\/W2","author":"Fu","year":"2017","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1109\/MSP.2015.2411753","article-title":"Digital Image Processing of The Ghent Altarpiece: Supporting the painting\u2019s study and conservation treatment","volume":"32","author":"Pizurica","year":"2015","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2297","DOI":"10.1016\/j.patcog.2012.12.015","article-title":"Historical document image restoration using multispectral imaging system","volume":"46","author":"Hedjam","year":"2013","journal-title":"Pattern Recogn."},{"key":"ref_7","first-page":"169","article-title":"Research on multi-scale detection and image inpainting of Tang dynasty tomb murals","volume":"52","author":"Wu","year":"2016","journal-title":"Comput. Eng. Appl."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Hanif, M., Tonazzini, A., Savino, P., and Salerno, E. (2018). Non-Local Sparse Image Inpainting for Document Bleed-Through Removal. J. Imag., 4.","DOI":"10.3390\/jimaging4050068"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"416","DOI":"10.1109\/TIP.2003.821347","article-title":"Virtual restoration of ancient Chinese paintings using color contrast enhancement and lacuna texture synthesis","volume":"13","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"937","DOI":"10.1007\/s11760-016-1042-y","article-title":"Digital restoration of damaged color documents based on hyperspectral imaging and lattice associative memories","volume":"11","author":"Urcid","year":"2017","journal-title":"Signal Image Video Process."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1461","DOI":"10.1016\/j.patcog.2010.12.019","article-title":"Visual enhancement of old documents with hyperspectral imaging","volume":"44","author":"Kim","year":"2011","journal-title":"Pattern Recogn."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1109\/MSP.2013.2273004","article-title":"Image Inpainting: Overview and Recent Advances","volume":"31","author":"Guillemot","year":"2013","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1705","DOI":"10.1109\/TIP.2018.2880681","article-title":"Image Inpainting Using Nonlocal Texture Matching and Nonlinear Filtering","volume":"28","author":"Ding","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_14","first-page":"178","article-title":"Digital image processing techniques for the detection and removal of cracks in digitized paintings","volume":"15","author":"Ioannis","year":"2005","journal-title":"IEEE Trans. Image Process."},{"key":"ref_15","unstructured":"Liu, J. (2010). Intelligent Image Processing and Inpainting for Ancient Fresco Preservation, Zhejiang University."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"605","DOI":"10.1016\/j.sigpro.2012.07.022","article-title":"Crack detection and inpainting for virtual restoration of paintings: The case of the Ghent Altarpiece","volume":"93","author":"Cornelis","year":"2013","journal-title":"Signal Process."},{"key":"ref_17","first-page":"233","article-title":"Automatic recognition and virtual restoration of mud spot disease of Tang dynasty tomb murals image","volume":"52","author":"Li","year":"2016","journal-title":"Comput. Eng. Appl."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"326","DOI":"10.1016\/j.patcog.2017.09.031","article-title":"A Knowledge Based Architecture for the Virtual Restoration of Ancient Photos","volume":"74","author":"Ardizzone","year":"2018","journal-title":"Pattern Recogn."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Liu, H., Lu, G., Bi, X., and Wang, W. (2018). Hierarchical Guidance Strategy and Exemplar-Based Image Inpainting. Information, 9.","DOI":"10.3390\/info9040096"},{"key":"ref_20","unstructured":"Criminisi, A., P\u00e9rez, P., and Toyama, K. (2003, January 18\u201320). Object Removal by Exemplar-Based Inpainting. Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Madison, WI, USA."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1153","DOI":"10.1109\/TIP.2010.2042098","article-title":"Image inpainting by patch propagation using patch sparsity","volume":"19","author":"Zongben","year":"2010","journal-title":"IEEE Trans. Image Process."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/j.jare.2019.01.003","article-title":"Analytical and mathematical methods for revealing hidden details in ancient manuscripts and paintings: A review","volume":"17","author":"Tonazzini","year":"2019","journal-title":"J. Adv. Res."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.culher.2017.02.017","article-title":"Extracting faded mural patterns based on the combination of spatial-spectral feature of hyperspectral image","volume":"27","author":"Pan","year":"2017","journal-title":"J. Cult. Herit."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Herens, E., Defeyt, C., Walter, P., and Strivay, D. (2017). Discovery of a woman portrait behind La Violoniste by Kees van Dongen through hyperspectral imaging. Herit. Sci., 5.","DOI":"10.1186\/s40494-017-0127-4"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Delaney, J.K., Zeibel, J.G., Thoury, M., Littleton, R., Morales, K.M., Palmer, M., and Rie, E.R.D.L. (2009, January 7). Visible and infrared reflectance imaging spectroscopy of paintings: pigment mapping and improved infrared reflectography. Proceedings of the O3A: Optics for Arts, Architecture, & Archaeology II, Munich, Germany.","DOI":"10.1117\/12.827493"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1016\/j.culher.2009.11.003","article-title":"Assessing stains on historical documents using hyperspectral imaging","volume":"11","author":"Goltz","year":"2010","journal-title":"J. Cult. Herit."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1109\/36.3001","article-title":"A transformation for ordering multispectral data in terms of image quality with implications for noise removal","volume":"26","author":"Green","year":"1988","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_28","first-page":"1830","article-title":"Research on Crop-Weed Discrimination Using a Field ImagingSpectrometer","volume":"30","author":"Liu","year":"2010","journal-title":"Spectrosc. Spectr. Anal."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1145\/882262.882269","article-title":"Poisson image editing","volume":"22","author":"Rez","year":"2003","journal-title":"ACM Trans. Graph."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1109\/TGRS.2012.2197682","article-title":"Cloud Removal From Multitemporal Satellite Images Using Information Cloning","volume":"51","author":"Lin","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1109\/TGRS.2012.2237408","article-title":"Patch-Based Information Reconstruction of Cloud-Contaminated Multitemporal Images","volume":"52","author":"Lin","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1011","DOI":"10.1007\/s11390-011-1197-5","article-title":"Free Appearance-Editing with Improved Poisson Image Cloning","volume":"26","author":"Bie","year":"2011","journal-title":"J. Comput. Sci. Technol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1531326.1531330","article-title":"PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing","volume":"28","author":"Barnes","year":"2009","journal-title":"Acm Trans. Graph."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1109\/TGRS.2013.2239651","article-title":"Restoration of Information Obscured by Mountainous Shadows Through Landsat TM\/ETM+ Images Without the Use of DEM Data: A New Method","volume":"52","author":"Zhou","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"2568","DOI":"10.1109\/JSTARS.2016.2570234","article-title":"Shadow Detection and Removal for Occluded Object Information Recovery in Urban High-Resolution Panchromatic Satellite Images","volume":"9","author":"Nan","year":"2016","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Kahaki, S.M.M., Arshad, H., Nordin, M.J., and Ismail, W. (2018). Geometric Feature Descriptor and Dissimilarity-based Registration of Remotely Sensed Imagery. PLoS ONE, 13.","DOI":"10.1371\/journal.pone.0200676"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/11\/1384\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:57:23Z","timestamp":1760187443000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/11\/1384"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,6,10]]},"references-count":36,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2019,6]]}},"alternative-id":["rs11111384"],"URL":"https:\/\/doi.org\/10.3390\/rs11111384","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,6,10]]}}}