{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T06:30:22Z","timestamp":1782282622289,"version":"3.54.5"},"reference-count":47,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2020,11,27]],"date-time":"2020-11-27T00:00:00Z","timestamp":1606435200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Research Grants Council of the Hong Kong Special Administrative Region, under RGC General Research Fund","award":["Project No. CUHK14217516"],"award-info":[{"award-number":["Project No. CUHK14217516"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2020,12,31]]},"abstract":"<jats:p>Western color comics and Japanese-style screened manga are two popular comic styles. They mainly differ in the style of region-filling. However, the conversion between the two region-filling styles is very challenging, and manually done currently. In this paper, we identify that the major obstacle in the conversion between the two filling styles stems from the difference between the fundamental properties of screened region-filling and colored region-filling. To resolve this obstacle, we propose a screentone variational autoencoder, ScreenVAE, to map the screened manga to an intermediate domain. This intermediate domain can summarize local texture characteristics and is interpolative. With this domain, we effectively unify the properties of screening and color-filling, and ease the learning for bidirectional translation between screened manga and color comics. To carry out the bidirectional translation, we further propose a network to learn the translation between the intermediate domain and color comics. Our model can generate quality screened manga given a color comic, and generate color comic that retains the original screening intention by the bitonal manga artist. Several results are shown to demonstrate the effectiveness and convenience of the proposed method. We also demonstrate how the intermediate domain can assist other applications such as manga inpainting and photo-to-comic conversion.<\/jats:p>","DOI":"10.1145\/3414685.3417873","type":"journal-article","created":{"date-parts":[[2020,11,27]],"date-time":"2020-11-27T21:51:05Z","timestamp":1606513865000},"page":"1-15","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":24,"title":["Manga filling style conversion with screentone variational autoencoder"],"prefix":"10.1145","volume":"39","author":[{"given":"Minshan","family":"Xie","sequence":"first","affiliation":[{"name":"The Chinese University of Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chengze","family":"Li","sequence":"additional","affiliation":[{"name":"The Chinese University of Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xueting","family":"Liu","sequence":"additional","affiliation":[{"name":"Caritas Institute of Higher Education"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tien-Tsin","family":"Wong","sequence":"additional","affiliation":[{"name":"The Chinese University of Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,11,27]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.120"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2016.08.016"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.461"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-015-0872-3"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7299007"},{"key":"e_1_2_2_6_1","doi-asserted-by":"crossref","unstructured":"Chie Furusawa Kazuyuki Hiroshiba Keisuke Ogaki and Yuri Odagiri. 2017. Comicolorization: semi-automatic manga colorization. In SIGGRAPH Asia 2017 Technical Briefs. ACM 12.  Chie Furusawa Kazuyuki Hiroshiba Keisuke Ogaki and Yuri Odagiri. 2017. Comicolorization: semi-automatic manga colorization. In SIGGRAPH Asia 2017 Technical Briefs. ACM 12.","DOI":"10.1145\/3145749.3149430"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.265"},{"key":"e_1_2_2_8_1","unstructured":"Ishaan Gulrajani Faruk Ahmed Martin Arjovsky Vincent Dumoulin and Aaron C Courville. 2017. Improved training of wasserstein gans. In Advances in neural information processing systems. 5767--5777.  Ishaan Gulrajani Faruk Ahmed Martin Arjovsky Vincent Dumoulin and Aaron C Courville. 2017. Improved training of wasserstein gans. In Advances in neural information processing systems. 5767--5777."},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.123"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDAR.2017.295"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.167"},{"key":"e_1_2_2_13_1","doi-asserted-by":"crossref","unstructured":"Xun Huang Ming-Yu Liu Serge Belongie and Jan Kautz. 2018. Multimodal Unsupervised Image-to-image Translation. In ECCV.  Xun Huang Ming-Yu Liu Serge Belongie and Jan Kautz. 2018. Multimodal Unsupervised Image-to-image Translation. In ECCV.","DOI":"10.1007\/978-3-030-01219-9_11"},{"key":"e_1_2_2_14_1","volume-title":"Image-to-Image Translation with Conditional Adversarial Networks. CVPR","author":"Isola Phillip","year":"2017","unstructured":"Phillip Isola , Jun-Yan Zhu , Tinghui Zhou , and Alexei A Efros . 2017. Image-to-Image Translation with Conditional Adversarial Networks. CVPR ( 2017 ). Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A Efros. 2017. Image-to-Image Translation with Conditional Adversarial Networks. CVPR (2017)."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSMC.1990.142050"},{"key":"e_1_2_2_16_1","volume-title":"A survey of techniques for the display of continuous tone pictures on bilevel displays. Computer graphics and image processing 5, 1","author":"Jarvis John F","year":"1976","unstructured":"John F Jarvis , C Ni Judice , and WH Ninke . 1976. A survey of techniques for the display of continuous tone pictures on bilevel displays. Computer graphics and image processing 5, 1 ( 1976 ), 13--40. John F Jarvis, C Ni Judice, and WH Ninke. 1976. A survey of techniques for the display of continuous tone pictures on bilevel displays. Computer graphics and image processing 5, 1 (1976), 13--40."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46475-6_43"},{"key":"e_1_2_2_18_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma and Jimmy Ba . 2014 . Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_2_2_19_1","volume-title":"Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114","author":"Kingma Diederik P","year":"2013","unstructured":"Diederik P Kingma and Max Welling . 2013. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114 ( 2013 ). Diederik P Kingma and Max Welling. 2013. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114 (2013)."},{"key":"e_1_2_2_20_1","volume-title":"On information and sufficiency. The annals of mathematical statistics 22, 1","author":"Kullback Solomon","year":"1951","unstructured":"Solomon Kullback and Richard A Leibler . 1951. On information and sufficiency. The annals of mathematical statistics 22, 1 ( 1951 ), 79--86. Solomon Kullback and Richard A Leibler. 1951. On information and sufficiency. The annals of mathematical statistics 22, 1 (1951), 79--86."},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/3298023.3298165"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01246-5_3"},{"key":"e_1_2_2_23_1","volume-title":"ACM transactions on graphics (tog)","author":"Levin Anat","unstructured":"Anat Levin , Dani Lischinski , and Yair Weiss . 2004. Colorization using optimization . In ACM transactions on graphics (tog) , Vol. 23 . ACM , 689--694. Anat Levin, Dani Lischinski, and Yair Weiss. 2004. Colorization using optimization. In ACM transactions on graphics (tog), Vol. 23. ACM, 689--694."},{"key":"e_1_2_2_24_1","volume-title":"Deep Extraction of Manga Structural Lines. ACM Transactions on Graphics (SIGGRAPH 2017 issue) 36, 4 (July","author":"Li Chengze","year":"2017","unstructured":"Chengze Li , Xueting Liu , and Tien-Tsin Wong . 2017a. Deep Extraction of Manga Structural Lines. ACM Transactions on Graphics (SIGGRAPH 2017 issue) 36, 4 (July 2017 ), 117:1--117:12. Chengze Li, Xueting Liu, and Tien-Tsin Wong. 2017a. Deep Extraction of Manga Structural Lines. ACM Transactions on Graphics (SIGGRAPH 2017 issue) 36, 4 (July 2017), 117:1--117:12."},{"key":"e_1_2_2_25_1","volume-title":"Demystifying neural style transfer. arXiv preprint arXiv:1701.01036","author":"Li Yanghao","year":"2017","unstructured":"Yanghao Li , Naiyan Wang , Jiaying Liu , and Xiaodi Hou . 2017b. Demystifying neural style transfer. arXiv preprint arXiv:1701.01036 ( 2017 ). Yanghao Li, Naiyan Wang, Jiaying Liu, and Xiaodi Hou. 2017b. Demystifying neural style transfer. arXiv preprint arXiv:1701.01036 (2017)."},{"key":"e_1_2_2_26_1","volume-title":"Image Inpainting for Irregular Holes Using Partial Convolutions. In The European Conference on Computer Vision (ECCV).","author":"Liu Guilin","year":"2018","unstructured":"Guilin Liu , Fitsum A. Reda , Kevin J. Shih , Ting-Chun Wang , Andrew Tao , and Bryan Catanzaro . 2018 . Image Inpainting for Irregular Holes Using Partial Convolutions. In The European Conference on Computer Vision (ECCV). Guilin Liu, Fitsum A. Reda, Kevin J. Shih, Ting-Chun Wang, Andrew Tao, and Bryan Catanzaro. 2018. Image Inpainting for Irregular Holes Using Partial Convolutions. In The European Conference on Computer Vision (ECCV)."},{"key":"e_1_2_2_27_1","unstructured":"Ming-Yu Liu Thomas Breuel and Jan Kautz. 2017. Unsupervised image-to-image translation networks. In Advances in Neural Information Processing Systems. 700--708.  Ming-Yu Liu Thomas Breuel and Jan Kautz. 2017. Unsupervised image-to-image translation networks. In Advances in Neural Information Processing Systems. 700--708."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2006.877511"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.531803"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-016-4020-z"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1399504.1360688"},{"key":"e_1_2_2_32_1","unstructured":"Adam Paszke Sam Gross Soumith Chintala Gregory Chanan Edward Yang Zachary DeVito Zeming Lin Alban Desmaison Luca Antiga and Adam Lerer. 2017. Automatic differentiation in PyTorch. (2017).  Adam Paszke Sam Gross Soumith Chintala Gregory Chanan Edward Yang Zachary DeVito Zeming Lin Alban Desmaison Luca Antiga and Adam Lerer. 2017. Automatic differentiation in PyTorch. (2017)."},{"key":"e_1_2_2_33_1","volume-title":"Richness-Preserving Manga Screening. ACM Transactions on Graphics (SIGGRAPH Asia 2008 issue) 27, 5 (December","author":"Qu Yingge","year":"2008","unstructured":"Yingge Qu , Wai-Man Pang , Tien-Tsin Wong , and Pheng-Ann Heng . 2008. Richness-Preserving Manga Screening. ACM Transactions on Graphics (SIGGRAPH Asia 2008 issue) 27, 5 (December 2008 ), 155:1--155:8. Yingge Qu, Wai-Man Pang, Tien-Tsin Wong, and Pheng-Ann Heng. 2008. Richness-Preserving Manga Screening. ACM Transactions on Graphics (SIGGRAPH Asia 2008 issue) 27, 5 (December 2008), 155:1--155:8."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1179352.1142017"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.761261"},{"key":"e_1_2_2_36_1","volume-title":"Stochastic back-propagation and approximate inference in deep generative models. arXiv preprint arXiv:1401.4082","author":"Rezende Danilo Jimenez","year":"2014","unstructured":"Danilo Jimenez Rezende , Shakir Mohamed , and Daan Wierstra . 2014. Stochastic back-propagation and approximate inference in deep generative models. arXiv preprint arXiv:1401.4082 ( 2014 ). Danilo Jimenez Rezende, Shakir Mohamed, and Daan Wierstra. 2014. Stochastic back-propagation and approximate inference in deep generative models. arXiv preprint arXiv:1401.4082 (2014)."},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"e_1_2_2_38_1","doi-asserted-by":"crossref","unstructured":"Masaki Saito and Yusuke Matsui. 2015. Illustration2vec: a semantic vector representation of illustrations. In SIGGRAPH Asia 2015 Technical Briefs. ACM 5.  Masaki Saito and Yusuke Matsui. 2015. Illustration2vec: a semantic vector representation of illustrations. In SIGGRAPH Asia 2015 Technical Briefs. ACM 5.","DOI":"10.1145\/2820903.2820907"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/987657.987677"},{"key":"e_1_2_2_40_1","volume-title":"Digital halftoning","author":"Ulichney Robert","unstructured":"Robert Ulichney . 1987. Digital halftoning . MIT press . Robert Ulichney. 1987. Digital halftoning. MIT press."},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/192161.192184"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024208"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.310"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2019\/584"},{"key":"e_1_2_2_45_1","unstructured":"Lvmin Zhang Chengze Li Tien-Tsin Wong Yi Ji and Chunping Liu. 2018. Two-stage sketch colorization. In SIGGRAPH Asia 2018 Technical Papers. ACM 261.  Lvmin Zhang Chengze Li Tien-Tsin Wong Yi Ji and Chunping Liu. 2018. Two-stage sketch colorization. In SIGGRAPH Asia 2018 Technical Papers. ACM 261."},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.244"},{"key":"e_1_2_2_47_1","first-page":"I","article-title":"Toward Multimodal Image-to-Image Translation","volume":"30","author":"Zhu Jun-Yan","year":"2017","unstructured":"Jun-Yan Zhu , Richard Zhang , Deepak Pathak , Trevor Darrell , Alexei A Efros , Oliver Wang , and Eli Shechtman . 2017 b. Toward Multimodal Image-to-Image Translation . In Advances in Neural Information Processing Systems 30 , I . Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.). Curran Associates, Inc., 465--476. http:\/\/papers.nips.cc\/paper\/6650-toward-multimodal-image-to-image-translation.pdf Jun-Yan Zhu, Richard Zhang, Deepak Pathak, Trevor Darrell, Alexei A Efros, Oliver Wang, and Eli Shechtman. 2017b. Toward Multimodal Image-to-Image Translation. In Advances in Neural Information Processing Systems 30, I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.). Curran Associates, Inc., 465--476. http:\/\/papers.nips.cc\/paper\/6650-toward-multimodal-image-to-image-translation.pdf","journal-title":"Advances in Neural Information Processing Systems"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3414685.3417873","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3414685.3417873","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:03:17Z","timestamp":1750197797000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3414685.3417873"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,27]]},"references-count":47,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2020,12,31]]}},"alternative-id":["10.1145\/3414685.3417873"],"URL":"https:\/\/doi.org\/10.1145\/3414685.3417873","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,27]]},"assertion":[{"value":"2020-11-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}