{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,27]],"date-time":"2026-10-27T15:19:55Z","timestamp":1793114395263,"version":"4.5.0"},"reference-count":41,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2016,7,11]],"date-time":"2016-07-11T00:00:00Z","timestamp":1468195200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2016,7,11]]},"abstract":"<jats:p>We present a novel technique to automatically colorize grayscale images that combines both global priors and local image features. Based on Convolutional Neural Networks, our deep network features a fusion layer that allows us to elegantly merge local information dependent on small image patches with global priors computed using the entire image. The entire framework, including the global and local priors as well as the colorization model, is trained in an end-to-end fashion. Furthermore, our architecture can process images of any resolution, unlike most existing approaches based on CNN. We leverage an existing large-scale scene classification database to train our model, exploiting the class labels of the dataset to more efficiently and discriminatively learn the global priors. We validate our approach with a user study and compare against the state of the art, where we show significant improvements. Furthermore, we demonstrate our method extensively on many different types of images, including black-and-white photography from over a hundred years ago, and show realistic colorizations.<\/jats:p>","DOI":"10.1145\/2897824.2925974","type":"journal-article","created":{"date-parts":[[2016,7,11]],"date-time":"2016-07-11T12:04:33Z","timestamp":1468238673000},"page":"1-11","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":689,"title":["Let there be color!"],"prefix":"10.1145","volume":"35","author":[{"given":"Satoshi","family":"Iizuka","sequence":"first","affiliation":[{"name":"Waseda University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Edgar","family":"Simo-Serra","sequence":"additional","affiliation":[{"name":"Waseda University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hiroshi","family":"Ishikawa","sequence":"additional","affiliation":[{"name":"Waseda University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2016,7,11]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360639"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766959"},{"key":"e_1_2_2_3_1","doi-asserted-by":"crossref","unstructured":"Bromley J. Guyon I. Lecun Y. S\u00e4ckinger E. and Shah R. 1994. Signature verification using a \"siamese\" time delay neural network. In NIPS.  Bromley J. Guyon I. Lecun Y. S\u00e4ckinger E. and Shah R. 1994. Signature verification using a \"siamese\" time delay neural network. In NIPS .","DOI":"10.1142\/9789812797926_0003"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-88690-7_10"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366151"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.55"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024190"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2015.2439281"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.304"},{"key":"e_1_2_2_10_1","volume-title":"Flownet: Learning optical flow with convolutional networks.","author":"Fischer P.","year":"2015"},{"key":"e_1_2_2_11_1","volume-title":"Neocognitron: A hierarchical neural network capable of visual pattern recognition. Neural networks 1, 2, 119--130.","author":"Fukushima K.","year":"1988"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2393347.2393402"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1101149.1101223"},{"key":"e_1_2_2_14_1","unstructured":"Ioffe S. and Szegedy C. 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In ICML.  Ioffe S. and Szegedy C. 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In ICML ."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.5555\/2383654.2383683"},{"key":"e_1_2_2_16_1","unstructured":"Krizhevsky A. Sutskever I. and Hinton G. E. 2012. Imagenet classification with deep convolutional neural networks. In NIPS.  Krizhevsky A. Sutskever I. and Hinton G. E. 2012. Imagenet classification with deep convolutional neural networks. In NIPS ."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015780"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2010.01791.x"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409060.1409105"},{"key":"e_1_2_2_21_1","doi-asserted-by":"crossref","unstructured":"Long J. Shelhamer E. and Darrell T. 2015. Fully convolutional networks for semantic segmentation. In CVPR.  Long J. Shelhamer E. and Darrell T. 2015. Fully convolutional networks for semantic segmentation. In CVPR .","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.5555\/2383847.2383887"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2006.11.011"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1142017"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/38.946629"},{"key":"e_1_2_2_26_1","doi-asserted-by":"crossref","unstructured":"Rumelhart D. Hinton G. and Williams R. 1986. Learning representations by back-propagating errors. In Nature.  Rumelhart D. Hinton G. and Williams R. 1986. Learning representations by back-propagating errors. In Nature .","DOI":"10.1038\/323533a0"},{"key":"e_1_2_2_27_1","volume-title":"Deepcontour: A deep convolutional feature learned by positive-sharing loss for contour detection. In CVPR.","author":"Shen W.","year":"2015"},{"key":"e_1_2_2_28_1","unstructured":"Simonyan K. and Zisserman A. 2015. Very deep convolutional networks for large-scale image recognition. In ICLR.  Simonyan K. and Zisserman A. 2015. Very deep convolutional networks for large-scale image recognition. In ICLR ."},{"key":"e_1_2_2_29_1","volume-title":"ICLR Workshop Track.","author":"Springenberg J. T."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2009.01400.x"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.215"},{"key":"e_1_2_2_32_1","unstructured":"Wang L. Guo S. Huang W. and Qiao Y. 2015. Places205-vggnet models for scene recognition. CoRR abs\/1508.01667.  Wang L. Guo S. Huang W. and Qiao Y. 2015. Places205-vggnet models for scene recognition. CoRR abs\/1508.01667."},{"key":"e_1_2_2_33_1","unstructured":"Wang L. Lee C. Tu Z. and Lazebnik S. 2015. Training deeper convolutional networks with deep supervision. CoRR abs\/1505.02496.  Wang L. Lee C. Tu Z. and Lazebnik S. 2015. Training deeper convolutional networks with deep supervision. CoRR abs\/1505.02496."},{"key":"e_1_2_2_34_1","doi-asserted-by":"crossref","unstructured":"Wang X. Fouhey D. F. and Gupta A. 2015. Designing deep networks for surface normal estimation. In CVPR.  Wang X. Fouhey D. F. and Gupta A. 2015. Designing deep networks for surface normal estimation. In CVPR .","DOI":"10.1109\/CVPR.2015.7298652"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566576"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12008"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1618452.1618464"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508404"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2005.864231"},{"key":"e_1_2_2_40_1","unstructured":"Zeiler M. D. 2012. ADADELTA: an adaptive learning rate method. CoRR abs\/1212.5701.  Zeiler M. D. 2012. ADADELTA: an adaptive learning rate method. CoRR abs\/1212.5701."},{"key":"e_1_2_2_41_1","unstructured":"Zhou B. Lapedriza A. Xiao J. Torralba A. and Oliva A. 2014. Learning deep features for scene recognition using places database. In NIPS.   Zhou B. Lapedriza A. Xiao J. Torralba A. and Oliva A. 2014. Learning deep features for scene recognition using places database. In NIPS ."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2897824.2925974","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2897824.2925974","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:55:05Z","timestamp":1750208105000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2897824.2925974"}},"subtitle":["joint end-to-end learning of global and local image priors for automatic image colorization with simultaneous classification"],"short-title":[],"issued":{"date-parts":[[2016,7,11]]},"references-count":41,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2016,7,11]]}},"alternative-id":["10.1145\/2897824.2925974"],"URL":"https:\/\/doi.org\/10.1145\/2897824.2925974","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,7,11]]},"assertion":[{"value":"2016-07-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}