{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T00:17:01Z","timestamp":1780445821044,"version":"3.54.1"},"reference-count":38,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2018,7,25]],"date-time":"2018-07-25T00:00:00Z","timestamp":1532476800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["91748104, 61303147"],"award-info":[{"award-number":["91748104, 61303147"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"RGC of Hong Kong SAR","award":["CityU11204014, CityU11200418"],"award-info":[{"award-number":["CityU11204014, CityU11200418"]}]},{"name":"Science Foundation of Hunan Province","award":["2018JJ3064"],"award-info":[{"award-number":["2018JJ3064"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Comput. Graph. Interact. Tech."],"published-print":{"date-parts":[[2018,7,25]]},"abstract":"<jats:p>High-quality normal maps are important intermediates for representing complex shapes. In this paper, we propose an interactive system for generating normal maps with the help of deep learning techniques. Utilizing the Generative Adversarial Network (GAN) framework, our method produces high quality normal maps with sketch inputs. In addition, we further enhance the interactivity of our system by incorporating user-specified normals at selected points. Our method generates high quality normal maps in real time. Through comprehensive experiments, we show the effectiveness and robustness of our method. A thorough user study indicates the normal maps generated by our method achieve a lower perceptual difference from the ground truth compared to the alternative methods.<\/jats:p>","DOI":"10.1145\/3203186","type":"journal-article","created":{"date-parts":[[2018,7,26]],"date-time":"2018-07-26T11:58:04Z","timestamp":1532606284000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":49,"title":["Interactive Sketch-Based Normal Map Generation with Deep Neural Networks"],"prefix":"10.1145","volume":"1","author":[{"given":"Wanchao","family":"Su","sequence":"first","affiliation":[{"name":"City University of Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dong","family":"Du","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China and City University of Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xin","family":"Yang","sequence":"additional","affiliation":[{"name":"Dalian University of Technology and City University of Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shizhe","family":"Zhou","sequence":"additional","affiliation":[{"name":"Hunan University and City University of Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongbo","family":"Fu","sequence":"additional","affiliation":[{"name":"City University of Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2018,7,25]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"M. Arjovsky and L. Bottou. 2017. Towards Principled Methods for Training Generative Adversarial Networks. ArXiv e-prints (Jan. 2017). arXiv:1701.04862  M. Arjovsky and L. Bottou. 2017. Towards Principled Methods for Training Generative Adversarial Networks. ArXiv e-prints (Jan. 2017). arXiv:1701.04862"},{"key":"e_1_2_1_2_1","unstructured":"M. Arjovsky S. Chintala and L. Bottou. 2017. Wasserstein GAN. ArXiv e-prints (Jan. 2017). arXiv:1701.07875  M. Arjovsky S. Chintala and L. Bottou. 2017. Wasserstein GAN. ArXiv e-prints (Jan. 2017). arXiv:1701.07875"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.38"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46484-8_38"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882354"},{"key":"e_1_2_1_6_1","unstructured":"Emily L Denton Soumith Chintala arthur szlam and Rob Fergus. 2015. Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks. In Advances in Neural Information Processing Systems 28. 1486--1494.   Emily L Denton Soumith Chintala arthur szlam and Rob Fergus. 2015. Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks. In Advances in Neural Information Processing Systems 28. 1486--1494."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383296"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.304"},{"key":"e_1_2_1_9_1","unstructured":"Ian Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2014. Generative Adversarial Nets. In Advances in Neural Information Processing Systems 27 Z. Ghahramani M. Welling C. Cortes N. D. Lawrence and K. Q. Weinberger (Eds.). 2672--2680.   Ian Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2014. Generative Adversarial Nets. In Advances in Neural Information Processing Systems 27 Z. Ghahramani M. Welling C. Cortes N. D. Lawrence and K. Q. Weinberger (Eds.). 2672--2680."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073629"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383295"},{"key":"e_1_2_1_12_1","doi-asserted-by":"crossref","unstructured":"G. E. Hinton and R. R. Salakhutdinov. 2006. Reducing the Dimensionality of Data with Neural Networks. Science 313 5786 (2006) 504--507.  G. E. Hinton and R. R. Salakhutdinov. 2006. Reducing the Dimensionality of Data with Neural Networks. Science 313 5786 (2006) 504--507.","DOI":"10.1126\/science.1127647"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073659"},{"key":"e_1_2_1_14_1","volume-title":"Image-to-Image Translation with Conditional Adversarial Networks. In CVPR '17","author":"Isola Phillip","year":"2017"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/508530.508538"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778839"},{"key":"e_1_2_1_17_1","unstructured":"T. Kim M. Cha H. Kim J. K. Lee and J. Kim. 2017. Learning to Discover Cross-Domain Relations with Generative Adversarial Networks. ArXiv e-prints (March 2017). arXiv:1703.05192  T. Kim M. Cha H. Kim J. K. Lee and J. Kim. 2017. Learning to Discover Cross-Domain Relations with Generative Adversarial Networks. ArXiv e-prints (March 2017). arXiv:1703.05192"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073632"},{"key":"e_1_2_1_19_1","unstructured":"Zhaoliang Lun Matheus Gadelha Evangelos Kalogerakis Subhransu Maji and Rui Wang. 2017. 3D Shape Reconstruction from Sketches via Multi-view Convolutional Networks. CoRR abs\/1707.06375 (2017). arXiv:1707.06375  Zhaoliang Lun Matheus Gadelha Evangelos Kalogerakis Subhransu Maji and Rui Wang. 2017. 3D Shape Reconstruction from Sketches via Multi-view Convolutional Networks. CoRR abs\/1707.06375 (2017). arXiv:1707.06375"},{"key":"e_1_2_1_20_1","unstructured":"M. Mirza and S. Osindero. 2014. Conditional Generative Adversarial Nets. ArXiv e-prints (nov 2014). arXiv:1411.1784  M. Mirza and S. Osindero. 2014. Conditional Generative Adversarial Nets. ArXiv e-prints (nov 2014). arXiv:1411.1784"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2008.09.013"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766990"},{"key":"e_1_2_1_23_1","volume-title":"CVPR '16","author":"Pathak Deepak"},{"key":"e_1_2_1_24_1","volume-title":"U-Net: Convolutional Networks for Biomedical Image Segmentation. In MICCAI '15","author":"Ronneberger Olaf","year":"2015"},{"key":"e_1_2_1_25_1","unstructured":"T. Salimans I. Goodfellow W. Zaremba V. Cheung A. Radford and X. Chen. 2016. Improved Techniques for Training GANs. ArXiv e-prints (June 2016). arXiv:1606.03498  T. Salimans I. Goodfellow W. Zaremba V. Cheung A. Radford and X. Chen. 2016. Improved Techniques for Training GANs. ArXiv e-prints (June 2016). arXiv:1606.03498"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1618452.1618495"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185541"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2591011"},{"key":"e_1_2_1_29_1","volume-title":"Designing Deep Networks for Surface Normal Estimation. In CVPR '15","author":"Wang Xiaolong","year":"2015"},{"key":"e_1_2_1_30_1","volume-title":"NIPS '16","author":"Wu Jiajun","year":"2016"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276432"},{"key":"e_1_2_1_32_1","volume-title":"Inverse Toon Shading: Interactive Normal Field Modeling with Isophotes. In SBIM '15","author":"Xu Q."},{"key":"e_1_2_1_33_1","unstructured":"Xinchen Yan Jimei Yang Ersin Yumer Yijie Guo and Honglak Lee. 2016. Perspective Transformer Nets: Learning Single-View 3D Object Reconstruction without 3D Supervision. (12 2016).  Xinchen Yan Jimei Yang Ersin Yumer Yijie Guo and Honglak Lee. 2016. Perspective Transformer Nets: Learning Single-View 3D Object Reconstruction without 3D Supervision. (12 2016)."},{"key":"e_1_2_1_34_1","doi-asserted-by":"crossref","unstructured":"Z. Yi H. Zhang P. Tan and M. Gong. 2017. DualGAN: Unsupervised Dual Learning for Image-to-Image Translation. ArXiv e-prints (April 2017). arXiv:1704.02510  Z. Yi H. Zhang P. Tan and M. Gong. 2017. DualGAN: Unsupervised Dual Learning for Image-to-Image Translation. ArXiv e-prints (April 2017). arXiv:1704.02510","DOI":"10.1109\/ICCV.2017.310"},{"key":"e_1_2_1_35_1","doi-asserted-by":"crossref","unstructured":"H. Zhang T. Xu H. Li S. Zhang X. Wang X. Huang and D. Metaxas. 2016b. StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networks. ArXiv e-prints (Dec. 2016). arXiv:1612.03242  H. Zhang T. Xu H. Li S. Zhang X. Wang X. Huang and D. Metaxas. 2016b. StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networks. ArXiv e-prints (Dec. 2016). arXiv:1612.03242","DOI":"10.1109\/ICCV.2017.629"},{"key":"e_1_2_1_36_1","volume-title":"Colorful Image Colorization. In ECCV '16","author":"Zhang Richard"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073703"},{"key":"e_1_2_1_38_1","doi-asserted-by":"crossref","unstructured":"J.-Y. Zhu T. Park P. Isola and A. A. Efros. 2017. Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks. ArXiv e-prints (March 2017). arXiv:1703.10593  J.-Y. Zhu T. Park P. Isola and A. A. Efros. 2017. Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks. ArXiv e-prints (March 2017). arXiv:1703.10593","DOI":"10.1109\/ICCV.2017.244"}],"container-title":["Proceedings of the ACM on Computer Graphics and Interactive Techniques"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3203186","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3203186","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:08:23Z","timestamp":1750208903000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3203186"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,7,25]]},"references-count":38,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2018,7,25]]}},"alternative-id":["10.1145\/3203186"],"URL":"https:\/\/doi.org\/10.1145\/3203186","relation":{},"ISSN":["2577-6193"],"issn-type":[{"value":"2577-6193","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,7,25]]},"assertion":[{"value":"2018-07-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}