{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T08:38:17Z","timestamp":1774600697829,"version":"3.50.1"},"reference-count":59,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2017,7,20]],"date-time":"2017-07-20T00:00:00Z","timestamp":1500508800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"BAIR"},{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["SMA-1514512"],"award-info":[{"award-number":["SMA-1514512"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006785","name":"Google","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100006785","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2017,8,31]]},"abstract":"<jats:p>\n            We propose a deep learning approach for user-guided image colorization. The system directly maps a grayscale image, along with sparse, local user \"hints\" to an output colorization with a Convolutional Neural Network (CNN). Rather than using hand-defined rules, the network propagates user edits by fusing low-level cues along with high-level semantic information,\n            <jats:italic>learned from large-scale data.<\/jats:italic>\n            We train on a million images, with simulated user inputs. To guide the user towards efficient input selection, the system recommends likely colors based on the input image and current user inputs. The colorization is performed in a single feed-forward pass, enabling real-time use. Even with randomly simulated user inputs, we show that the proposed system helps novice users quickly create realistic colorizations, and offers large improvements in colorization quality with just a minute of use. In addition, we demonstrate that the framework can incorporate other user \"hints\" to the desired colorization, showing an application to color histogram transfer.\n          <\/jats:p>","DOI":"10.1145\/3072959.3073703","type":"journal-article","created":{"date-parts":[[2017,7,21]],"date-time":"2017-07-21T12:24:07Z","timestamp":1500639847000},"page":"1-11","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":364,"title":["Real-time user-guided image colorization with learned deep priors"],"prefix":"10.1145","volume":"36","author":[{"given":"Richard","family":"Zhang","sequence":"first","affiliation":[{"name":"University of California"}]},{"given":"Jun-Yan","family":"Zhu","sequence":"additional","affiliation":[{"name":"University of California"}]},{"given":"Phillip","family":"Isola","sequence":"additional","affiliation":[{"name":"University of California"}]},{"given":"Xinyang","family":"Geng","sequence":"additional","affiliation":[{"name":"University of California"}]},{"given":"Angela S.","family":"Lin","sequence":"additional","affiliation":[{"name":"University of California"}]},{"given":"Tianhe","family":"Yu","sequence":"additional","affiliation":[{"name":"University of California"}]},{"given":"Alexei A.","family":"Efros","sequence":"additional","affiliation":[{"name":"University of California"}]}],"member":"320","published-online":{"date-parts":[[2017,7,20]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"AppProp: all-pairs appearance-space edit propagation. 27, 3","author":"An Xiaobo","year":"2008"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1531326.1531330"},{"key":"e_1_2_2_3_1","doi-asserted-by":"crossref","unstructured":"Jonathan T Barron and Ben Poole. 2016. The Fast Bilateral Solver. ECCV.  Jonathan T Barron and Ben Poole. 2016. The Fast Bilateral Solver. ECCV.","DOI":"10.1007\/978-3-319-46487-9_38"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298970"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766978"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-88690-7_10"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366151"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1273496.1273517"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.55"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2024156.2024190"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.72"},{"key":"e_1_2_2_12_1","volume-title":"Computer Graphics Forum","author":"Endo Yuki"},{"key":"e_1_2_2_13_1","unstructured":"Kevin Frans. 2017. Outline Colorization through Tandem Adversarial Networks. In arXiv:1704.08834.  Kevin Frans. 2017. Outline Colorization through Tandem Adversarial Networks. In arXiv:1704.08834."},{"key":"e_1_2_2_14_1","doi-asserted-by":"crossref","unstructured":"Leon A Gatys Alexander S Ecker and Matthias Bethge. 2016. Image style transfer using convolutional neural networks. In CVPR. 2414--2423.  Leon A Gatys Alexander S Ecker and Matthias Bethge. 2016. Image style transfer using convolutional neural networks. In CVPR. 2414--2423.","DOI":"10.1109\/CVPR.2016.265"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2982399"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.81"},{"key":"e_1_2_2_17_1","unstructured":"Ian Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2014. Generative adversarial nets. In NIPS. 2672--2680.  Ian Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2014. Generative adversarial nets. In NIPS. 2672--2680."},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2393347.2393402"},{"key":"e_1_2_2_19_1","doi-asserted-by":"crossref","unstructured":"Bharath Hariharan Pablo Arbel\u00e1ez Ross Girshick and Jitendra Malik. 2015. Hyper-columns for object segmentation and fine-grained localization. In CVPR. 447--456.  Bharath Hariharan Pablo Arbel\u00e1ez Ross Girshick and Jitendra Malik. 2015. Hyper-columns for object segmentation and fine-grained localization. In CVPR. 447--456.","DOI":"10.1109\/CVPR.2015.7298642"},{"key":"e_1_2_2_20_1","doi-asserted-by":"crossref","volume-title":"A unified active and semi-supervised learning framework for image compression","author":"He Xiaofei","DOI":"10.1109\/CVPR.2009.5206835"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383295"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1101149.1101223"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177703732"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925974"},{"key":"e_1_2_2_25_1","volume-title":"https:\/\/github.com\/pfnet\/PaintsChainer","author":"Preferred Networks Inc. 2017. Paints Chainer.","year":"2017"},{"key":"e_1_2_2_26_1","volume-title":"Eurographics Symp. on Rendering","volume":"2","author":"Irony Revital","year":"2005"},{"key":"e_1_2_2_27_1","volume-title":"Image-to-image translation with conditional adversarial networks. CVPR","author":"Isola Phillip","year":"2017"},{"key":"e_1_2_2_28_1","unstructured":"Alex Krizhevsky Ilya Sutskever and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In NIPS. 1097--1105.  Alex Krizhevsky Ilya Sutskever and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In NIPS. 1097--1105."},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46493-0_35"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186562.1015780"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/s41095-015-0013-5"},{"key":"e_1_2_2_33_1","volume-title":"Computer Graphics Forum","author":"Li Yuanzhen"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1457515.1409105"},{"key":"e_1_2_2_35_1","volume-title":"Computer Graphics Forum","author":"Liu Yiming"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.5555\/2383847.2383887"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1599301.1599333"},{"key":"e_1_2_2_38_1","volume-title":"Context Encoders: Feature Learning by Inpainting. In CVPR.","author":"Pathak Deepak","year":"2016"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1179352.1142017"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/38.946629"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-015-0816-y"},{"key":"e_1_2_2_43_1","volume-title":"Scribbler: Controlling Deep Image Synthesis with Sketch and Color. CVPR","author":"Sangkloy Patsorn","year":"2017"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925968"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925972"},{"key":"e_1_2_2_46_1","volume-title":"Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556","author":"Simonyan Karen","year":"2014"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1882261.1866172"},{"key":"e_1_2_2_48_1","volume-title":"A 4D light-field dataset and CNN architectures for material recognition","author":"Wang Ting-Chun"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566576"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.164"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/1618452.1618464"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508404"},{"key":"e_1_2_2_53_1","unstructured":"Ning Xu Brian Price Scott Cohen Jimei Yang and Thomas S Huang. 2016. Deep interactive object selection. In CVPR.  Ning Xu Brian Price Scott Cohen Jimei Yang and Thomas S Huang. 2016. Deep interactive object selection. In CVPR."},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2790296"},{"key":"e_1_2_2_55_1","volume-title":"International Conference on Learning Representations","author":"Yu Fisher","year":"2016"},{"key":"e_1_2_2_56_1","volume-title":"Colorful Image Colorization. ECCV","author":"Zhang Richard","year":"2016"},{"key":"e_1_2_2_57_1","unstructured":"Bolei Zhou Agata Lapedriza Jianxiong Xiao Antonio Torralba and Aude Oliva. 2014. Learning deep features for scene recognition using places database. In NIPS.  Bolei Zhou Agata Lapedriza Jianxiong Xiao Antonio Torralba and Aude Oliva. 2014. Learning deep features for scene recognition using places database. In NIPS."},{"key":"e_1_2_2_58_1","unstructured":"Jun-Yan Zhu Philipp Krahenbuhl Eli Shechtman and Alexei A Efros. 2015. Learning a discriminative model for the perception of realism in composite images. In CVPR.  Jun-Yan Zhu Philipp Krahenbuhl Eli Shechtman and Alexei A Efros. 2015. Learning a discriminative model for the perception of realism in composite images. In CVPR."},{"key":"e_1_2_2_59_1","doi-asserted-by":"crossref","unstructured":"Jun-Yan Zhu Philipp Kr\u00e4henb\u00fchl Eli Shechtman and Alexei A Efros. 2016. Generative visual manipulation on the natural image manifold. (2016) 597--613.  Jun-Yan Zhu Philipp Kr\u00e4henb\u00fchl Eli Shechtman and Alexei A Efros. 2016. Generative visual manipulation on the natural image manifold. (2016) 597--613.","DOI":"10.1007\/978-3-319-46454-1_36"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3072959.3073703","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3072959.3073703","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3072959.3073703","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:30:23Z","timestamp":1750217423000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3072959.3073703"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,7,20]]},"references-count":59,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2017,8,31]]}},"alternative-id":["10.1145\/3072959.3073703"],"URL":"https:\/\/doi.org\/10.1145\/3072959.3073703","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,7,20]]},"assertion":[{"value":"2017-07-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}