{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T19:44:16Z","timestamp":1776109456306,"version":"3.50.1"},"reference-count":44,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2024,6,14]],"date-time":"2024-06-14T00:00:00Z","timestamp":1718323200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61772440"],"award-info":[{"award-number":["61772440"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Collaborative Innovation Platform Project for Fuzhou-Xiamen Quanzhou National Independent Innovation Demonstration Zone","award":["2022-P-028"],"award-info":[{"award-number":["2022-P-028"]}]},{"name":"2022 Hulunbuir City\u2019s Special Key Project for Revitalizing City by Science and Technology","award":["2022HZZX002"],"award-info":[{"award-number":["2022HZZX002"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Appl. Percept."],"published-print":{"date-parts":[[2024,7,31]]},"abstract":"<jats:p>We propose an end-to-end generative adversarial network that allows for controllable ink wash painting generation from sketches by specifying the colors via color hints. To the best of our knowledge, this is the first study for interactive Chinese ink wash painting colorization from sketches. To help our network understand the ink style and artistic conception, we introduced an ink style prediction mechanism for our discriminator, which enables the discriminator to accurately predict the style with the help of a pre-trained style encoder. We also designed our generator to receive multi-scale feature information from the feature pyramid network for detail reconstruction of ink wash painting. Experimental results and user study show that ink wash paintings generated by our network have higher realism and richer artistic conception than existing image generation methods.<\/jats:p>","DOI":"10.1145\/3657637","type":"journal-article","created":{"date-parts":[[2024,4,11]],"date-time":"2024-04-11T09:55:27Z","timestamp":1712829327000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Color Hint-guided Ink Wash Painting Colorization with Ink Style Prediction Mechanism"],"prefix":"10.1145","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-6358-8561","authenticated-orcid":false,"given":"Yao","family":"Zeng","sequence":"first","affiliation":[{"name":"Department of Artificial Intelligence, Xiamen University, Xiamen, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6785-5933","authenticated-orcid":false,"given":"Xiaoyu","family":"Liu","sequence":"additional","affiliation":[{"name":"National Engineering Research Center for E-Learning, Central China Normal University, Wuhan, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1810-3994","authenticated-orcid":false,"given":"Yijun","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence, Xiamen University, Xiamen, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7715-5006","authenticated-orcid":false,"given":"Junsong","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence, Xiamen University, Xiamen, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,6,14]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3092919.3092926"},{"key":"e_1_3_2_3_2","unstructured":"Miko\u0142aj Bi\u0144kowski Danica J. Sutherland Michael Arbel and Arthur Gretton. 2018. Demystifying mmd GANs. Retrieved from https:\/\/arXiv:1801.01401. 13\u201328."},{"key":"e_1_3_2_4_2","doi-asserted-by":"crossref","unstructured":"Caroline Chan Durand Fredo and Isola Phillip. 2022. Learning to generate line drawings that convey geometry and semantics. Retrieved from https:\/\/arXiv:2203.12691. 2054\u20132068.","DOI":"10.1109\/CVPR52688.2022.00776"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073221"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-012-1126-9"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2021.3104190"},{"issue":"3","key":"e_1_3_2_9_2","doi-asserted-by":"crossref","first-page":"746","DOI":"10.1049\/ipr2.12059","article-title":"Multi-style Chinese art painting generation of flowers","volume":"15","author":"Fu Feifei","year":"2021","unstructured":"Feifei Fu, Jiancheng Lv, Chenwei Tang, and Mao Li. 2021. Multi-style Chinese art painting generation of flowers. IET Image Process. 15, 3 (2021), 746\u2013762.","journal-title":"IET Image Process."},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00522"},{"key":"e_1_3_2_11_2","first-page":"1172","volume-title":"Proceedings of the 26th ACM International Conference on Multimedia","author":"He Bin","year":"2018","unstructured":"Bin He, Feng Gao, Daiqian Ma, Boxin Shi, and Lingyu Duan. 2018. ChipGAN: A generative adversarial network for Chinese ink wash painting style transfer. In Proceedings of the 26th ACM International Conference on Multimedia. 1172\u20131180."},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01219-9_11"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.167"},{"key":"e_1_3_2_14_2","first-page":"694","volume-title":"Proceedings of the European Conference on Computer Vision","author":"Justin Johnson","year":"2016","unstructured":"Johnson Justin, Alahi Alexandre, and Feifei Li. 2016. Perceptual losses for real-time style transfer and super-resolution. In Proceedings of the European Conference on Computer Vision. Springer, 694\u2013711."},{"key":"e_1_3_2_15_2","unstructured":"Simonyanb Karen and Zisserman Andrew. 2014. Very deep convolutional networks for large-scale image recognition. Retrieved from https:\/\/arXiv:1409.1556."},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0097-8493(00)00132-1"},{"key":"e_1_3_2_17_2","first-page":"5801","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Lee Junsoo","year":"2020","unstructured":"Junsoo Lee, Eungyeup Kim, Yunsung Lee, Dongjun Kim, Jaehyuk Chang, and Jaegul Choo. 2020. Reference-based sketch image colorization using augmented-self reference and dense semantic correspondence. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 5801\u20135810."},{"key":"e_1_3_2_18_2","first-page":"212","volume-title":"Proceedings of the Asian Conference on Computer Vision","author":"Li Bo","year":"2018","unstructured":"Bo Li, Caiming Xiong, Tianfu Wu, Yu Zhou, Lun Zhang, and Rufeng Chu. 2018. Neural abstract style transfer for Chinese traditional painting. In Proceedings of the Asian Conference on Computer Vision. Springer, 212\u2013227."},{"issue":"4","key":"e_1_3_2_19_2","first-page":"1","article-title":"Deep extraction of manga structural lines","volume":"36","author":"Li Chengze","year":"2017","unstructured":"Chengze Li, Xueting Liu, and Tientsin Wong. 2017. Deep extraction of manga structural lines. ACM Trans. Graph. 36, 4 (2017), 1\u201312.","journal-title":"ACM Trans. Graph."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.3390\/a11010004"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.106"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.2312\/vmv.20181263"},{"key":"e_1_3_2_23_2","first-page":"125","volume-title":"Proceedings of the Asian Conference on Computer Vision","author":"Liu Bingchen","year":"2020","unstructured":"Bingchen Liu, Kunpeng Song, Yizhe Zhu, and Elgammal Ahmed. 2020. Sketch-to-art: Synthesizing stylized art images from sketches. In Proceedings of the Asian Conference on Computer Vision. 125\u2013149."},{"key":"e_1_3_2_24_2","first-page":"678","article-title":"Gans trained by a two time-scale update rule converge to a local nash equilibrium","volume":"30","author":"Martin Heusel","year":"2017","unstructured":"Heusel Martin, Ramsauer Hubert, Unterthiner Thomas, Nessler Bernhard, and Hochreiter Sepp. 2017. Gans trained by a two time-scale update rule converge to a local nash equilibrium. Adv. Neural Info. Process. Syst. 30 (2017), 678\u2013689.","journal-title":"Adv. Neural Info. Process. Syst."},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00244"},{"key":"e_1_3_2_26_2","first-page":"1125","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Phillip Isola","year":"2017","unstructured":"Isola Phillip, Junyan Zhu, Tinghui Zhou, and Alexei A. Efros. 2017. Image-to-image translation with conditional adversarial networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1125\u20131134."},{"key":"e_1_3_2_27_2","first-page":"14882","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Rott Shaham Tamar","year":"2021","unstructured":"Shaham Tamar Rott, Gharbi Micha\u00ebl, Richard Zhang, Shechtman Eli, and Michaeli Tomer. 2021. Spatially-adaptive pixelwise networks for fast image translation. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 14882\u201314891."},{"key":"e_1_3_2_28_2","first-page":"2403","volume-title":"Proceedings of the IEEE International Conference on Image Processing (ICIP\u201921)","author":"Samet Hicsonmez","year":"2021","unstructured":"Hicsonmez Samet, Samet Nermin, Akbas Emre, and Duygulu Pinar. 2021. Adversarial segmentation loss for sketch colorization. In Proceedings of the IEEE International Conference on Image Processing (ICIP\u201921). IEEE, 2403\u20132407."},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/CGIV.2005.59"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2007.41"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00917"},{"key":"e_1_3_2_32_2","first-page":"5","volume-title":"Proceedings of the SIGGRAPH Asia","author":"Wang Yuan","year":"2019","unstructured":"Yuan Wang, Weibo Zhang, and Peng Chen. 2019. Chinastyle: A mask-aware generative adversarial network for Chinese traditional image translation. In Proceedings of the SIGGRAPH Asia. 5\u20138."},{"key":"e_1_3_2_33_2","first-page":"215","volume-title":"Proceedings of the 11th International Conference in Central Europe on. Computer Graphics, Visualization and Computer Vision (WSCG\u201903)","author":"Way Der-Lor","year":"2003","unstructured":"Der-Lor Way, Shengwen Huang, and Zenchung Shih. 2003. Physical-based model of ink diffusion in Chinese paintings. In Proceedings of the 11th International Conference in Central Europe on. Computer Graphics, Visualization and Computer Vision (WSCG\u201903). 215\u2013226."},{"key":"e_1_3_2_34_2","first-page":"63","volume-title":"Proceedings of the 8th International Symposium on Non-photorealistic Animation and Rendering","author":"Xie Ning","year":"2010","unstructured":"Ning Xie, Laga Hamid, Saito Sugru, and Nakajima Masayuki. 2010. IR2s: Interactive real photo to Sumi-e. In Proceedings of the 8th International Symposium on Non-photorealistic Animation and Rendering. 63\u201371."},{"key":"e_1_3_2_35_2","first-page":"1","volume-title":"Proceedings of the SIGGRAPH Asia","author":"Xu Tianchen","year":"2012","unstructured":"Tianchen Xu, Lijie Yang, and Enhua Wu. 2012. Stroke-based real-time ink wash painting style rendering for geometric models. In Proceedings of the SIGGRAPH Asia. 1\u20134."},{"key":"e_1_3_2_36_2","first-page":"3863","volume-title":"Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision","author":"Xue Alice","year":"2021","unstructured":"Alice Xue. 2021. End-to-end Chinese landscape painting creation using generative adversarial networks. In Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision. 3863\u20133871."},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF02946647"},{"issue":"9","key":"e_1_3_2_38_2","first-page":"16","article-title":"Self-adaptive computational aesthetic evaluation of Chinese ink paintings based on deep learning","volume":"33","author":"Zhang Jiajing","year":"2021","unstructured":"Jiajing Zhang, Jinhui Yu, Yongwei Miu, and Ren Peng. 2021. Self-adaptive computational aesthetic evaluation of Chinese ink paintings based on deep learning. J. Comput.-Aided Design Comput. Graph.\/Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao 33, 9 (2021), 16\u201325(in Chinese).","journal-title":"J. Comput.-Aided Design Comput. Graph.\/Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao"},{"key":"e_1_3_2_39_2","first-page":"506","volume-title":"Proceedings of the 4th IAPR Asian Conference on Pattern Recognition (ACPR\u201917)","author":"Zhang Lvmin","year":"2017","unstructured":"Lvmin Zhang, Yi Ji, Xin Lin, and Chunping Liu. 2017. Style transfer for anime sketches with enhanced residual u-net and auxiliary classifier gan. In Proceedings of the 4th IAPR Asian Conference on Pattern Recognition (ACPR\u201917). IEEE, 506\u2013511."},{"key":"e_1_3_2_40_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3272127.3275090","article-title":"Two-stage sketch colorization","author":"Zhang Lvmin","year":"2018","unstructured":"Lvmin Zhang, Chengze Li, Tientsin Wong, Yi Ji, and Chunping Liu. 2018. Two-stage sketch colorization. ACM Trans. Graph. (2018), 1\u201314.","journal-title":"ACM Trans. Graph."},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00068"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/2422105.2422110"},{"key":"e_1_3_2_43_2","first-page":"193","volume-title":"Proceedings of the 15th International Symposium on Pervasive Systems, Algorithms and Networks (I-SPAN\u201918)","author":"Zheng Chengyu","year":"2018","unstructured":"Chengyu Zheng and Yuan Zhang. 2018. Two-stage color ink painting style transfer via convolution neural network. In Proceedings of the 15th International Symposium on Pervasive Systems, Algorithms and Networks (I-SPAN\u201918). IEEE, 193\u2013200."},{"key":"e_1_3_2_44_2","first-page":"819","volume-title":"Proceedings of the International Conference on Document Analysis and Recognition (ICDAR\u201919)","author":"Zhou Le","year":"2019","unstructured":"Le Zhou, Qiufeng Wang, Kaizhu Huang, and Chenghung Lo. 2019. An interactive and generative approach for Chinese shanshui painting document. In Proceedings of the International Conference on Document Analysis and Recognition (ICDAR\u201919). IEEE, 819\u2013824."},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.244"}],"container-title":["ACM Transactions on Applied Perception"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3657637","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3657637","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:05:53Z","timestamp":1750291553000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3657637"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,14]]},"references-count":44,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,7,31]]}},"alternative-id":["10.1145\/3657637"],"URL":"https:\/\/doi.org\/10.1145\/3657637","relation":{},"ISSN":["1544-3558","1544-3965"],"issn-type":[{"value":"1544-3558","type":"print"},{"value":"1544-3965","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,14]]},"assertion":[{"value":"2023-05-26","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-03-31","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-06-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}