{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T21:58:22Z","timestamp":1783115902439,"version":"3.54.6"},"reference-count":47,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2018,12,4]],"date-time":"2018-12-04T00:00:00Z","timestamp":1543881600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2018,12,31]]},"abstract":"<jats:p>\n            Relighting of human images has various applications in image synthesis. For relighting, we must infer albedo, shape, and illumination from a human portrait. Previous techniques rely on human faces for this inference, based on spherical harmonics (SH) lighting. However, because they often ignore light occlusion, inferred shapes are biased and relit images are unnaturally bright particularly at hollowed regions such as armpits, crotches, or garment wrinkles. This paper introduces the first attempt to infer light occlusion in the SH formulation directly. Based on supervised learning using convolutional neural networks (CNNs), we infer not only an albedo map, illumination but also a\n            <jats:italic>light transport map<\/jats:italic>\n            that encodes occlusion as nine SH coefficients per pixel. The main difficulty in this inference is the lack of training datasets compared to unlimited variations of human portraits. Surprisingly, geometric information including occlusion can be inferred plausibly even with a small dataset of synthesized human figures, by carefully preparing the dataset so that the CNNs can exploit the data coherency. Our method accomplishes more realistic relighting than the occlusion-ignored formulation.\n          <\/jats:p>","DOI":"10.1145\/3272127.3275104","type":"journal-article","created":{"date-parts":[[2018,11,28]],"date-time":"2018-11-28T19:16:10Z","timestamp":1543432570000},"page":"1-11","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":66,"title":["Relighting humans"],"prefix":"10.1145","volume":"37","author":[{"given":"Yoshihiro","family":"Kanamori","sequence":"first","affiliation":[{"name":"University of Tsukuba"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuki","family":"Endo","sequence":"additional","affiliation":[{"name":"University of Tsukuba &amp; Toyohashi University of Technology"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2018,12,4]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925917"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073207"},{"key":"e_1_2_2_3_1","volume-title":"2007 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR","author":"Balan Alexandru O.","year":"2007","unstructured":"Alexandru O. Balan , Leonid Sigal , Michael J. Black , James E. Davis , and Horst W. Haussecker . 2007. Detailed Human Shape and Pose from Images . In 2007 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2007 ). Alexandru O. Balan, Leonid Sigal, Michael J. Black, James E. Davis, and Horst W. Haussecker. 2007. Detailed Human Shape and Pose from Images. In 2007 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2007)."},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2014.2377712"},{"key":"e_1_2_2_5_1","unstructured":"H. G. Barrow and J. M. Tenenbaum. 1978. Recovering intrinsic scene characteristics from images. Comp. Vis. Sys. (1978).  H. G. Barrow and J. M. Tenenbaum. 1978. Recovering intrinsic scene characteristics from images. Comp. Vis. Sys. (1978)."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00698"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2003.1177153"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601206"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311556"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.5555\/3128975.3129027"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818112"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126354"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13125"},{"key":"e_1_2_2_14_1","unstructured":"Paul Debevec. 2004. Light Probe Image Gallery. (2004). http:\/\/www.pauldebevec.com\/Probes\/.  Paul Debevec. 2004. Light Probe Image Gallery. (2004). http:\/\/www.pauldebevec.com\/Probes\/."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344855"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130834"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130891"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508380"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2017.2742999"},{"key":"e_1_2_2_20_1","volume-title":"IEEE 12th International Conference on Computer Vision (ICCV","author":"Guan Peng","year":"2009","unstructured":"Peng Guan , Alexander Weiss , Alexandru O. Balan , and Michael J. Black . 2009. Estimating human shape and pose from a single image . In IEEE 12th International Conference on Computer Vision (ICCV 2009 ). 1381--1388. Peng Guan, Alexander Weiss, Alexandru O. Balan, and Michael J. Black. 2009. Estimating human shape and pose from a single image. In IEEE 12th International Conference on Computer Vision (ICCV 2009). 1381--1388."},{"key":"e_1_2_2_21_1","volume-title":"Deep Outdoor Illumination Estimation. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR","author":"Hold-Geoffroy Yannick","year":"2017","unstructured":"Yannick Hold-Geoffroy , Kalyan Sunkavalli , Sunil Hadap , Emiliano Gambaretto , and Jean-Fran\u00e7ois Lalonde . 2017 . Deep Outdoor Illumination Estimation. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017). 2373--2382. Yannick Hold-Geoffroy, Kalyan Sunkavalli, Sunil Hadap, Emiliano Gambaretto, and Jean-Fran\u00e7ois Lalonde. 2017. Deep Outdoor Illumination Estimation. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017). 2373--2382."},{"key":"e_1_2_2_22_1","volume-title":"Shape from Shading","author":"Horn Berthold K. P.","unstructured":"Berthold K. P. Horn . 1989. Shape from Shading . MIT Press , Chapter Obtaining Shape from Shading Information, 123--171. Berthold K. P. Horn. 1989. Shape from Shading. MIT Press, Chapter Obtaining Shape from Shading Information, 123--171."},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13220"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995510"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.63"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601209"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSA.61.000001"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12047"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073641"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12195"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DV.2017.00018"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.342"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33718-5_38"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/AVSS.2009.58"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383317"},{"key":"e_1_2_2_36_1","volume-title":"Efficient Global Illumination for Morphable Models. In IEEE International Conference on Computer Vision (ICCV","author":"Schneider Andreas","year":"2017","unstructured":"Andreas Schneider , Sandro Sch\u00f6nborn , Bernhard Egger , Lavrenti Frobeen , and Thomas Vetter . 2017 . Efficient Global Illumination for Morphable Models. In IEEE International Conference on Computer Vision (ICCV 2017). 3885--3893. Andreas Schneider, Sandro Sch\u00f6nborn, Bernhard Egger, Lavrenti Frobeen, and Thomas Vetter. 2017. Efficient Global Illumination for Morphable Models. In IEEE International Conference on Computer Vision (ICCV 2017). 3885--3893."},{"key":"e_1_2_2_37_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR","author":"Sengupta Soumyadip","year":"2018","unstructured":"Soumyadip Sengupta , Angjoo Kanazawa , Carlos D. Castillo , and David W. Jacobs . 2018. SfSNet: Learning Shape, Reflectance and Illuminance of Faces 'in the Wild '. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018 ). Soumyadip Sengupta, Angjoo Kanazawa, Carlos D. Castillo, and David W. Jacobs. 2018. SfSNet: Learning Shape, Reflectance and Illuminance of Faces 'in the Wild'. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018)."},{"key":"e_1_2_2_38_1","volume-title":"Learning Non-Lambertian Object Intrinsics Across ShapeNet Categories. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR","author":"Shi Jian","year":"2017","unstructured":"Jian Shi , Yue Dong , Hao Su , and Stella X. Yu . 2017 . Learning Non-Lambertian Object Intrinsics Across ShapeNet Categories. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017 ). 5844--5853. Jian Shi, Yue Dong, Hao Su, and Stella X. Yu. 2017. Learning Non-Lambertian Object Intrinsics Across ShapeNet Categories. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017). 5844--5853."},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3095816"},{"key":"e_1_2_2_40_1","volume-title":"Neural Face Editing with Intrinsic Image Disentangling. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR","author":"Shu Zhixin","year":"2017","unstructured":"Zhixin Shu , Ersin Yumer , Sunil Hadap , Kalyan Sunkavalli , Eli Shechtman , and Dimitris Samaras . 2017 b. Neural Face Editing with Intrinsic Image Disentangling. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017). 5444--5453. Zhixin Shu, Ersin Yumer, Sunil Hadap, Kalyan Sunkavalli, Eli Shechtman, and Dimitris Samaras. 2017b. Neural Face Editing with Intrinsic Image Disentangling. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017). 5444--5453."},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566612"},{"key":"e_1_2_2_42_1","volume-title":"MoFA: Model-Based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstruction. In IEEE International Conference on Computer Vision (ICCV","author":"Tewari Ayush","year":"2017","unstructured":"Ayush Tewari , Michael Zollh\u00f6fer , Hyeongwoo Kim , Pablo Garrido , Florian Bernard , Patrick P\u00e9rez , and Christian Theobalt . 2017 . MoFA: Model-Based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstruction. In IEEE International Conference on Computer Vision (ICCV 2017). 3735--3744. Ayush Tewari, Michael Zollh\u00f6fer, Hyeongwoo Kim, Pablo Garrido, Florian Bernard, Patrick P\u00e9rez, and Christian Theobalt. 2017. MoFA: Model-Based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstruction. In IEEE International Conference on Computer Vision (ICCV 2017). 3735--3744."},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185580"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201364"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.582"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12215"},{"key":"e_1_2_2_47_1","volume-title":"An Ambient Light Illumination Model. In Rendering Techniques '98, Proceedings of the Eurographics Workshop. 45--56","author":"Zhukov Sergey","year":"1998","unstructured":"Sergey Zhukov , Andrei Iones , and Grigorij Kronin . 1998 . An Ambient Light Illumination Model. In Rendering Techniques '98, Proceedings of the Eurographics Workshop. 45--56 . Sergey Zhukov, Andrei Iones, and Grigorij Kronin. 1998. An Ambient Light Illumination Model. In Rendering Techniques '98, Proceedings of the Eurographics Workshop. 45--56."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3272127.3275104","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3272127.3275104","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:44:26Z","timestamp":1750207466000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3272127.3275104"}},"subtitle":["occlusion-aware inverse rendering for full-body human images"],"short-title":[],"issued":{"date-parts":[[2018,12,4]]},"references-count":47,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2018,12,31]]}},"alternative-id":["10.1145\/3272127.3275104"],"URL":"https:\/\/doi.org\/10.1145\/3272127.3275104","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,12,4]]},"assertion":[{"value":"2018-12-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}