{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T12:21:38Z","timestamp":1781094098425,"version":"3.54.1"},"reference-count":53,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2022,12,6]],"date-time":"2022-12-06T00:00:00Z","timestamp":1670284800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"crossref","award":["2018YFC0309400"],"award-info":[{"award-number":["2018YFC0309400"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61871188, 61801133, and 61901160"],"award-info":[{"award-number":["61871188, 61801133, and 61901160"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Guangdong Provincial Key Laboratory of Human Digital Twin","award":["2022B1212010004"],"award-info":[{"award-number":["2022B1212010004"]}]},{"name":"Guangzhou city science and technology research projects","award":["201902020008"],"award-info":[{"award-number":["201902020008"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Comput. Cult. Herit."],"published-print":{"date-parts":[[2022,12,31]]},"abstract":"<jats:p>Inpainting deteriorated regions in digital Dunhuang murals is important for Dunhuang mural content preservation. Algorithms of mural image inpainting help simplify the digital restoration process of the deteriorated murals. Most of the existing algorithms can restore plausible content for homogeneous missing regions in Dunhuang mural images. However, they often fail to fill accurate color in missing regions that contain complex structures, which is mainly due to the neglect of color relevance between positions in the missing structural region and the non-missing color regions. In this article, we propose a deep learning\u2013based, structure-guided inpainting method for the Dunhuang mural image, which utilizes relevant color information in deep features to improve the color inpainting quality for structural regions. Specifically, we design a structure-guided feature refinement module, which explicitly leverages color relevance implied in structure information to select relevant features for refining features in the missing region. In addition, we propose a multi-step scheme for feature refinement to better propagate non-missing region feature information to the missing region. We conduct experiments on Dunhuang660 and Dunhuang No. 7 Grotto datasets. The results demonstrate that our proposed method can achieve improved color inpainting quality for missing structural regions in Dunhuang mural images.<\/jats:p>\n          <jats:p\/>","DOI":"10.1145\/3532867","type":"journal-article","created":{"date-parts":[[2022,7,25]],"date-time":"2022-07-25T12:16:39Z","timestamp":1658751399000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":30,"title":["Inpainting Digital Dunhuang Murals with Structure-Guided Deep Network"],"prefix":"10.1145","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4040-0175","authenticated-orcid":false,"given":"Zhiheng","family":"Zhou","sequence":"first","affiliation":[{"name":"School of Electronic and Information Engineering, South China University of Technology, China and Key Laboratory of Big Data and Intelligent Robot, South China University of Technology, Ministry of Education, Guangzhou City, Guangdong Province, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3744-3393","authenticated-orcid":false,"given":"Xinran","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Electronic and Information Engineering, South China University of Technology, China and Key Laboratory of Big Data and Intelligent Robot, South China University of Technology, Ministry of Education, Guangzhou City, Guangdong Province, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4301-750X","authenticated-orcid":false,"given":"Junyuan","family":"Shang","sequence":"additional","affiliation":[{"name":"School of Electronic and Information Engineering, South China University of Technology, China and Key Laboratory of Big Data and Intelligent Robot, South China University of Technology, Ministry of Education, Guangzhou City, Guangdong Province, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6580-358X","authenticated-orcid":false,"given":"Junchu","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Electronic and Information Engineering, South China University of Technology, China and Key Laboratory of Big Data and Intelligent Robot, South China University of Technology, Ministry of Education, Guangzhou City, Guangdong Province, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2327-5624","authenticated-orcid":false,"given":"Zhihao","family":"Li","sequence":"additional","affiliation":[{"name":"School of Electronic and Information Engineering, South China University of Technology, China and Key Laboratory of Big Data and Intelligent Robot, South China University of Technology, Ministry of Education, Guangzhou City, Guangdong Province, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1359-8390","authenticated-orcid":false,"given":"Haiping","family":"Jia","sequence":"additional","affiliation":[{"name":"School of Foreign Languages, South China University of Technology, Guangzhou, Guangdong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,12,6]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"Dunhuang Academy. 2021. Digital Dunhuang. Retrieved November 15 2021 from https:\/\/www.e-dunhuang.com\/."},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2001.990497"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344972"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10851-007-0017-6"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1186\/s40494-019-0281-y"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1186\/s40494-020-0355-x"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1006\/jvci.2001.0487"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/3003435"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1088\/1742-6596\/1302\/3\/032040"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.3390\/s21062091"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2004.833105"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.5194\/isprs-annals-IV-2-W2-99-2017"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/3422622"},{"key":"e_1_3_2_15_2","first-page":"52","article-title":"Reborn in paradise: A case study of Dunhuang sutra painting and its religious, ritual and artistic context","volume":"23","author":"Hung Wu","year":"1992","unstructured":"Wu Hung. 1992. Reborn in paradise: A case study of Dunhuang sutra painting and its religious, ritual and artistic context. Orientations 23 (1992), 52\u201360.","journal-title":"Orientations"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073659"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIVC.2018.8492735"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46475-6_43"},{"key":"e_1_3_2_19_2","unstructured":"Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. ICLR. 2015. San Diego CA USA."},{"key":"e_1_3_2_20_2","first-page":"1097","article-title":"ImageNet classification with deep convolutional neural networks","volume":"25","author":"Krizhevsky Alex","year":"2012","unstructured":"Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. ImageNet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems 25 (2012), 1097\u20131105.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature14539"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1186\/s40494-020-00478-w"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1186\/2050-7445-1-31"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/TGRS.2014.2307354"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01252-6_6"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00925"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2019.00408"},{"key":"e_1_3_2_29_2","first-page":"8026","article-title":"Pytorch: An imperative style, high-performance deep learning library","volume":"32","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et\u00a0al. 2019. Pytorch: An imperative style, high-performance deep learning library. Advances in Neural Information Processing Systems 32 (2019), 8026\u20138037.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.278"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.01063"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/2425333.2425382"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3144789.3144816"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.160"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3131778"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1137\/s0036139900368844"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.5555\/905376"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00248"},{"issue":"1","key":"e_1_3_2_39_2","first-page":"1","article-title":"What\u2019s wrong with the murals at the Mogao Grottoes: a near-infrared hyperspectral imaging method","volume":"5","author":"Sun Meijun","year":"2015","unstructured":"Meijun Sun, Dong Zhang, Zheng Wang, Jinchang Ren, Bolong Chai, and Jizhou Sun. 2015. What\u2019s wrong with the murals at the Mogao Grottoes: a near-infrared hyperspectral imaging method. Scientific Reports 5, 1 (2015), 1\u201310.","journal-title":"Scientific Reports"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.1998.710815"},{"key":"e_1_3_2_41_2","first-page":"9446","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Ulyanov Dmitry","year":"2018","unstructured":"Dmitry Ulyanov, Andrea Vedaldi, and Victor Lempitsky. 2018. Deep image prior. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, Utah, USA. IEEE, 9446\u20139454."},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1007\/s13042-019-01032-2"},{"issue":"3","key":"e_1_3_2_43_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3280790","article-title":"Inpainting of Dunhuang murals by sparsely modeling the texture similarity and structure continuity","volume":"12","author":"Wang Huan","year":"2019","unstructured":"Huan Wang, Qingquan Li, and Qin Zou. 2019. Inpainting of Dunhuang murals by sparsely modeling the texture similarity and structure continuity. Journal on Computing and Cultural Heritage 12, 3 (2019), 1\u201321.","journal-title":"Journal on Computing and Cultural Heritage"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2021.3064268"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1108\/JD-03-2017-0033"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/tip.2003.819861"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/3377325.3377509"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCSIT.2010.5564944"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2019.00182"},{"key":"e_1_3_2_50_2","article-title":"Dunhuang grottoes painting dataset and benchmark","volume":"1907","author":"Yu Tianxiu","year":"2019","unstructured":"Tianxiu Yu, Shijie Zhang, Cong Lin, Shaodi You, Jian Wu, Jiawan Zhang, Xiaohong Ding, and Huili An. 2019. Dunhuang grottoes painting dataset and benchmark. CoRR abs\/1907.04589 (2019). arXiv:1907.04589http:\/\/arxiv.org\/abs\/1907.04589.","journal-title":"CoRR"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.01385"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDSP.2018.8631553"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2017.2723009"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2014.07.002"}],"container-title":["Journal on Computing and Cultural Heritage"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3532867","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3532867","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:00:37Z","timestamp":1750186837000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3532867"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,6]]},"references-count":53,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,12,31]]}},"alternative-id":["10.1145\/3532867"],"URL":"https:\/\/doi.org\/10.1145\/3532867","relation":{},"ISSN":["1556-4673","1556-4711"],"issn-type":[{"value":"1556-4673","type":"print"},{"value":"1556-4711","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,6]]},"assertion":[{"value":"2021-11-19","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-04-19","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-12-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}