{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T16:57:26Z","timestamp":1777568246719,"version":"3.51.4"},"reference-count":94,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T00:00:00Z","timestamp":1731974400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2024,12,19]]},"abstract":"<jats:p>\n            We introduce a high-fidelity portrait shadow removal model that can effectively enhance the image of a portrait by predicting its appearance under disturbing shadows and highlights. Portrait shadow removal is a highly ill-posed problem where multiple plausible solutions can be found based on a single image. For example, disentangling complex environmental lighting from original skin color is a non-trivial problem. While existing works have solved this problem by predicting the appearance residuals that can propagate local shadow distribution, such methods are often incomplete and lead to unnatural predictions, especially for portraits with hard shadows. We overcome the limitations of existing local propagation methods by formulating the removal problem as a generation task where a diffusion model learns to globally rebuild the human appearance from scratch as a condition of an input portrait image. For robust and natural shadow removal, we propose to train the diffusion model with a compositional repurposing framework: a pre-trained text-guided image generation model is first fine-tuned to harmonize the lighting and color of the foreground with a background scene by using a background harmonization dataset; and then the model is further fine-tuned to generate a shadow-free portrait image via a shadow-paired dataset. To overcome the limitation of losing fine details in the latent diffusion model, we propose a guided-upsampling network to restore the original high-frequency details\n            <jats:italic>(e.g.<\/jats:italic>\n            , wrinkles and dots) from the input image. To enable our compositional training framework, we construct a high-fidelity and large-scale dataset using a lightstage capturing system and synthetic graphics simulation. Our generative framework effectively removes shadows caused by both self and external occlusions while maintaining original lighting distribution and high-frequency details. Our method also demonstrates robustness to diverse subjects captured in real environments.\n          <\/jats:p>","DOI":"10.1145\/3687903","type":"journal-article","created":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T15:46:04Z","timestamp":1732031164000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Generative Portrait Shadow Removal"],"prefix":"10.1145","volume":"43","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0181-4869","authenticated-orcid":false,"given":"Jae Shin","family":"Yoon","sequence":"first","affiliation":[{"name":"Adobe Inc., San Jose, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-3878-4805","authenticated-orcid":false,"given":"Zhixin","family":"Shu","sequence":"additional","affiliation":[{"name":"Adobe Inc., San Jose, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7552-1279","authenticated-orcid":false,"given":"Mengwei","family":"Ren","sequence":"additional","affiliation":[{"name":"Adobe Inc., San Jose, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7679-800X","authenticated-orcid":false,"given":"Cecilia","family":"Zhang","sequence":"additional","affiliation":[{"name":"Adobe Inc., San Jose, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1060-6941","authenticated-orcid":false,"given":"Yannick","family":"Hold-Geoffroy","sequence":"additional","affiliation":[{"name":"Adobe Inc., QC, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8066-6835","authenticated-orcid":false,"given":"Krishna kumar","family":"Singh","sequence":"additional","affiliation":[{"name":"Adobe Inc., San Jose, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7036-6820","authenticated-orcid":false,"given":"He","family":"Zhang","sequence":"additional","affiliation":[{"name":"Adobe Inc., San Jose, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,11,19]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Shadow removal using intensity surfaces and texture anchor points","author":"Arbel Eli","year":"2010","unstructured":"Eli Arbel and Hagit Hel-Or. 2010. Shadow removal using intensity surfaces and texture anchor points. IEEE transactions on pattern analysis and machine intelligence 33, 6 (2010), 1202--1216."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601206"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766946"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1618452.1618476"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.01764"},{"key":"e_1_2_1_6_1","unstructured":"Tim Brooks Bill Peebles Connor Holmes Will DePue Yufei Guo Li Jing David Schnurr Joe Taylor Troy Luhman Eric Luhman Clarence Ng Ricky Wang and Aditya Ramesh. 2024. Video generation models as world simulators. (2024). https:\/\/openai.com\/research\/video-generation-models-as-world-simulators"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00951"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 1436--1446","author":"Chang Hua-En","year":"2023","unstructured":"Hua-En Chang, Chia-Hsuan Hsieh, Hao-Hsiang Yang, I Chen, Yi-Chung Chen, Yuan-Chun Chiang, Zhi-Kai Huang, Wei-Ting Chen, Sy-Yen Kuo, et al. 2023. TSRFormer: Transformer based two-stage refinement for single image shadow removal. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 1436--1446."},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the IEEE international conference on computer vision. 241--248","author":"Chen Qifeng","year":"2013","unstructured":"Qifeng Chen and Vladlen Koltun. 2013. A simple model for intrinsic image decomposition with depth cues. In Proceedings of the IEEE international conference on computer vision. 241--248."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.02142"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00470"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344855"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.01031"},{"key":"e_1_2_1_14_1","doi-asserted-by":"crossref","unstructured":"Qingnan Fan Jiaolong Yang Gang Hua Baoquan Chen and David Wipf. 2018. Revisiting deep intrinsic image decompositions. In CVPR. 8944--8952.","DOI":"10.1109\/CVPR.2018.00932"},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 8412--8421","author":"Futschik David","year":"2023","unstructured":"David Futschik, Kelvin Ritland, James Vecore, Sean Fanello, Sergio Orts-Escolano, Brian Curless, Daniel S\u1ef3kora, and Rohit Pandey. 2023. Controllable light diffusion for portraits. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 8412--8421."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2012.03137.x"},{"key":"e_1_2_1_17_1","volume-title":"Learning to predict indoor illumination from a single image. arXiv preprint arXiv:1704.00090","author":"Gardner Marc-Andr\u00e9","year":"2017","unstructured":"Marc-Andr\u00e9 Gardner, Kalyan Sunkavalli, Ersin Yumer, Xiaohui Shen, Emiliano Gambaretto, Christian Gagn\u00e9, and Jean-Fran\u00e7ois Lalonde. 2017. Learning to predict indoor illumination from a single image. arXiv preprint arXiv:1704.00090 (2017)."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.265"},{"key":"e_1_2_1_19_1","doi-asserted-by":"crossref","unstructured":"Roger Grosse Micah K Johnson Edward H Adelson and William T Freeman. 2009. Ground truth dataset and baseline evaluations for intrinsic image algorithms. In ICCV. 2335--2342.","DOI":"10.1109\/ICCV.2009.5459428"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2732407"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"37","author":"Guo Lanqing","year":"2023","unstructured":"Lanqing Guo, Siyu Huang, Ding Liu, Hao Cheng, and Bihan Wen. 2023. ShadowFormer: global context helps shadow removal. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 37. 710--718."},{"key":"e_1_2_1_22_1","doi-asserted-by":"crossref","unstructured":"Mohammed Hachama Bernard Ghanem and Peter Wonka. 2015. Intrinsic scene decomposition from RGB-D images. In ICCV. 810--818.","DOI":"10.1109\/ICCV.2015.99"},{"key":"e_1_2_1_23_1","volume-title":"Computer Graphics Forum","author":"Han Fangzhou","unstructured":"Fangzhou Han, Can Wang, Hao Du, and Jing Liao. 2021. Deep Portrait Lighting Enhancement with 3D Guidance. In Computer Graphics Forum, Vol. 40. Wiley Online Library, 177--188."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_2_1_25_1","volume-title":"ACM International Conference on Multimedia (ACM MM).","author":"He Yingqing","year":"2021","unstructured":"Yingqing He, Yazhou Xing, Tianjia Zhang, and Qifeng Chen. 2021. Unsupervised Portrait Shadow Removal via Generative Priors. In ACM International Conference on Multimedia (ACM MM)."},{"key":"e_1_2_1_26_1","unstructured":"Jonathan Ho Ajay Jain and Pieter Abbeel. 2020. Denoising diffusion probabilistic models. 6840--6851."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00709"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition. 4217--4226","author":"Hou Andrew","year":"2022","unstructured":"Andrew Hou, Michel Sarkis, Ning Bi, Yiying Tong, and Xiaoming Liu. 2022. Face relighting with geometrically consistent shadows. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition. 4217--4226."},{"key":"e_1_2_1_29_1","volume-title":"Jae Shin Yoon, and Xiaoming Liu","author":"Hou Andrew","year":"2024","unstructured":"Andrew Hou, Zhixin Shu, Xuaner Zhang, He Zhang, Yannick Hold-Geoffroy, Jae Shin Yoon, and Xiaoming Liu. 2024. COMPOSE: Comprehensive Portrait Shadow Editing. arXiv preprint arXiv:2408.13922 (2024)."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.01448"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2019.2919616"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.632"},{"key":"e_1_2_1_33_1","volume-title":"European Conference on Computer Vision. Springer, 388--405","author":"Ji Chaonan","year":"2022","unstructured":"Chaonan Ji, Tao Yu, Kaiwen Guo, Jingxin Liu, and Yebin Liu. 2022. Geometry-aware single-image full-body human relighting. In European Conference on Computer Vision. Springer, 388--405."},{"key":"e_1_2_1_34_1","unstructured":"Yeying Jin Ruoteng Li Wenhan Yang and Robby T Tan. 2023. Estimating Reflectance Layer from A Single Image: Integrating Reflectance Guidance and Shadow\/Specular Aware Learning. In AAAI."},{"key":"e_1_2_1_35_1","first-page":"23593","article-title":"Denoising diffusion restoration models","volume":"35","author":"Kawar Bahjat","year":"2022","unstructured":"Bahjat Kawar, Michael Elad, Stefano Ermon, and Jiaming Song. 2022. Denoising diffusion restoration models. Advances in Neural Information Processing Systems 35 (2022), 23593--23606.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_36_1","volume-title":"Automatic shadow detection and removal from a single image","author":"Khan Salman H","year":"2015","unstructured":"Salman H Khan, Mohammed Bennamoun, Ferdous Sohel, and Roberto Togneri. 2015. Automatic shadow detection and removal from a single image. IEEE transactions on pattern analysis and machine intelligence 38, 3 (2015), 431--446."},{"key":"e_1_2_1_37_1","volume-title":"SwitchLight: Co-design of Physics-driven Architecture and Pre-training Framework for Human Portrait Relighting. arXiv preprint arXiv:2402.18848","author":"Kim Hoon","year":"2024","unstructured":"Hoon Kim, Minje Jang, Wonjun Yoon, Jisoo Lee, Donghyun Na, and Sanghyun Woo. 2024. SwitchLight: Co-design of Physics-driven Architecture and Pre-training Framework for Human Portrait Relighting. arXiv preprint arXiv:2402.18848 (2024)."},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition.","author":"Kim Minchul","year":"2022","unstructured":"Minchul Kim, Anil K Jain, and Xiaoming Liu. 2022. AdaFace: Quality Adaptive Margin for Face Recognition. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_2_1_39_1","doi-asserted-by":"crossref","unstructured":"Seungryong Kim Kihong Park Kwanghoon Sohn and Stephen Lin. 2016. Unified depth prediction and intrinsic image decomposition from a single image via joint convolutional neural fields. In ECCV. 143--159.","DOI":"10.1007\/978-3-319-46484-8_9"},{"key":"e_1_2_1_40_1","volume-title":"S3R-Net: A Single-Stage Approach to Self-Supervised Shadow Removal. arXiv preprint arXiv:2404.12103","author":"Kubiak Nikolina","year":"2024","unstructured":"Nikolina Kubiak, Armin Mustafa, Graeme Phillipson, Stephen Jolly, and Simon Hadfield. 2024. S3R-Net: A Single-Stage Approach to Self-Supervised Shadow Removal. arXiv preprint arXiv:2404.12103 (2024)."},{"key":"e_1_2_1_41_1","volume-title":"Single-image full-body human relighting. arXiv preprint arXiv:2107.07259","author":"Lagunas Manuel","year":"2021","unstructured":"Manuel Lagunas, Xin Sun, Jimei Yang, Ruben Villegas, Jianming Zhang, Zhixin Shu, Belen Masia, and Diego Gutierrez. 2021. Single-image full-body human relighting. arXiv preprint arXiv:2107.07259 (2021)."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.19"},{"key":"e_1_2_1_43_1","unstructured":"Zhengqi Li and Noah Snavely. 2018. CGIntrinsics: Better Intrinsic Image Decomposition Through Physically-Based Rendering. In ECCV."},{"key":"e_1_2_1_44_1","volume-title":"A shadow imaging bilinear model and three-branch residual network for shadow removal","author":"Liu Jiawei","year":"2023","unstructured":"Jiawei Liu, Qiang Wang, Huijie Fan, Jiandong Tian, and Yandong Tang. 2023. A shadow imaging bilinear model and three-branch residual network for shadow removal. IEEE Transactions on Neural Networks and Learning Systems (2023)."},{"key":"e_1_2_1_45_1","unstructured":"Yaojie Liu Andrew Z Hou Xinyu Huang Liu Ren and Xiaoming Liu. 2022. Blind Removal of Facial Foreign Shadows.. In BMVC. 88."},{"key":"e_1_2_1_46_1","unstructured":"Yunfei Liu Yu Li Shaodi You and Feng Lu. 2020. Unsupervised learning for intrinsic image decomposition from a single image. In CVPR."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2020.3023565"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2023.3337870"},{"key":"e_1_2_1_49_1","volume-title":"Computer Graphics Forum","author":"Ma Li-Qian","unstructured":"Li-Qian Ma, Jue Wang, Eli Shechtman, Kalyan Sunkavalli, and Shi-Min Hu. 2016. Appearance harmonization for single image shadow removal. In Computer Graphics Forum, Vol. 35. Wiley Online Library, 189--197."},{"key":"e_1_2_1_50_1","volume-title":"Psychology of learning and motivation.","author":"McCloskey Michael","unstructured":"Michael McCloskey and Neal J Cohen. 1989. Catastrophic interference in connectionist networks: The sequential learning problem. In Psychology of learning and motivation. Vol. 24. Elsevier, 109--165."},{"key":"e_1_2_1_51_1","volume-title":"Holo-Relighting: Controllable Volumetric Portrait Relighting from a Single Image. arXiv preprint arXiv:2403.09632","author":"Mei Yiqun","year":"2024","unstructured":"Yiqun Mei, Yu Zeng, He Zhang, Zhixin Shu, Xuaner Zhang, Sai Bi, Jianming Zhang, HyunJoon Jung, and Vishal M Patel. 2024. Holo-Relighting: Controllable Volumetric Portrait Relighting from a Single Image. arXiv preprint arXiv:2403.09632 (2024)."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.00027"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2734425"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3374753"},{"key":"e_1_2_1_55_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 5124--5133","author":"Nestmeyer Thomas","year":"2020","unstructured":"Thomas Nestmeyer, Jean-Fran\u00e7ois Lalonde, Iain Matthews, and Andreas Lehrmann. 2020. Learning physics-guided face relighting under directional light. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 5124--5133."},{"key":"e_1_2_1_56_1","unstructured":"Maxime Oquab Timoth\u00e9e Darcet Th\u00e9o Moutakanni Huy Vo Marc Szafraniec Vasil Khalidov Pierre Fernandez Daniel Haziza Francisco Massa Alaaeldin El-Nouby et al. 2023. Dinov2: Learning robust visual features without supervision. arXiv preprint arXiv:2304.07193 (2023)."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459872"},{"key":"e_1_2_1_58_1","volume-title":"Eduardo Ant\u00fanio Barros da Silva, and S\u00e9rgio Lima Netto.","author":"Cinelli Lucas Pinheiro","year":"2021","unstructured":"Lucas Pinheiro Cinelli, Matheus Ara\u00fajo Marins, Eduardo Ant\u00fanio Barros da Silva, and S\u00e9rgio Lima Netto. 2021. Variational autoencoder. In Variational Methods for Machine Learning with Applications to Deep Networks. Springer, 111--149."},{"key":"e_1_2_1_59_1","volume-title":"Poly Haven: The public 3D asset library.","author":"PolyHaven A","year":"2024","unstructured":"A PolyHaven. 2024. Poly Haven: The public 3D asset library. (2024)."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.02070"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.248"},{"key":"e_1_2_1_62_1","volume-title":"International conference on machine learning. PMLR, 8748--8763","author":"Radford Alec","year":"2021","unstructured":"Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. 2021. Learning transferable visual models from natural language supervision. In International conference on machine learning. PMLR, 8748--8763."},{"key":"e_1_2_1_63_1","volume-title":"Towards robust monocular depth estimation: Mixing datasets for zero-shot cross-dataset transfer","author":"Ranftl Ren\u00e9","year":"2020","unstructured":"Ren\u00e9 Ranftl, Katrin Lasinger, David Hafner, Konrad Schindler, and Vladlen Koltun. 2020. Towards robust monocular depth estimation: Mixing datasets for zero-shot cross-dataset transfer. IEEE transactions on pattern analysis and machine intelligence 44, 3 (2020), 1623--1637."},{"key":"e_1_2_1_64_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 8619--8628","author":"Ranjan Anurag","year":"2023","unstructured":"Anurag Ranjan, Kwang Moo Yi, Jen-Hao Rick Chang, and Oncel Tuzel. 2023. Facelit: Neural 3d relightable faces. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 8619--8628."},{"key":"e_1_2_1_65_1","volume-title":"Zhixin Shu, Jianming Zhang, HyunJoon Jung, Guido Gerig, and He Zhang.","author":"Ren Mengwei","year":"2023","unstructured":"Mengwei Ren, Wei Xiong, Jae Shin Yoon, Zhixin Shu, Jianming Zhang, HyunJoon Jung, Guido Gerig, and He Zhang. 2023. Relightful Harmonization: Lighting-aware Portrait Background Replacement. arXiv preprint arXiv:2312.06886 (2023)."},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01042"},{"key":"e_1_2_1_67_1","volume-title":"U-net: Convolutional networks for biomedical image segmentation. In Medical image computing and computer-assisted intervention-MICCAI 2015: 18th international conference","author":"Ronneberger Olaf","year":"2015","unstructured":"Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. In Medical image computing and computer-assisted intervention-MICCAI 2015: 18th international conference, Munich, Germany, October 5--9, 2015, proceedings, part III 18. Springer, 234--241."},{"key":"e_1_2_1_68_1","volume-title":"Shadow detection: A survey and comparative evaluation of recent methods. Pattern recognition 45, 4","author":"Sanin Andres","year":"2012","unstructured":"Andres Sanin, Conrad Sanderson, and Brian C Lovell. 2012. Shadow detection: A survey and comparative evaluation of recent methods. Pattern recognition 45, 4 (2012), 1684--1695."},{"key":"e_1_2_1_69_1","volume-title":"Jacobs","author":"Sengupta Soumyadip","year":"2018","unstructured":"Soumyadip Sengupta, Angjoo Kanazawa, Carlos D. Castillo, and David W. Jacobs. 2018. SfSNet: Learning Shape, Refectance and Illuminance of Faces in the Wild. In Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_1_70_1","doi-asserted-by":"crossref","unstructured":"Jianbing Shen Xiaoshan Yang Yunde Jia and Xuelong Li. 2011. Intrinsic images using optimization. In CVPR. 3481--3487.","DOI":"10.1109\/CVPR.2011.5995507"},{"key":"e_1_2_1_71_1","volume-title":"Computer Graphics Forum","author":"Song Guoxian","unstructured":"Guoxian Song, Tat-Jen Cham, Jianfei Cai, and Jianmin Zheng. 2021. Half-body Portrait Relighting with Overcomplete Lighting Representation. In Computer Graphics Forum, Vol. 40. Wiley Online Library, 371--381."},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356529"},{"key":"e_1_2_1_73_1","volume-title":"Computer Graphics Forum","author":"Tajima Daichi","unstructured":"Daichi Tajima, Yoshihiro Kanamori, and Yuki Endo. 2021. Relighting Humans in the Wild: Monocular Full-Body Human Relighting with Domain Adaptation. In Computer Graphics Forum, Vol. 40. Wiley Online Library, 205--216."},{"key":"e_1_2_1_74_1","volume-title":"Attention is all you need. Advances in neural information processing systems 30","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems 30 (2017)."},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00192"},{"key":"e_1_2_1_76_1","volume-title":"A survey of deep face restoration: Denoise, super-resolution, deblur, artifact removal. arXiv preprint arXiv:2211.02831","author":"Wang Tao","year":"2022","unstructured":"Tao Wang, Kaihao Zhang, Xuanxi Chen, Wenhan Luo, Jiankang Deng, Tong Lu, Xiaochun Cao, Wei Liu, Hongdong Li, and Stefanos Zafeiriou. 2022. A survey of deep face restoration: Denoise, super-resolution, deblur, artifact removal. arXiv preprint arXiv:2211.02831 (2022)."},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00061"},{"key":"e_1_2_1_78_1","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 20792--20802","author":"Wang Yifan","year":"2023","unstructured":"Yifan Wang, Aleksander Holynski, Xiuming Zhang, and Xuaner Zhang. 2023. Sunstage: Portrait reconstruction and relighting using the sun as a light stage. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 20792--20802."},{"key":"e_1_2_1_79_1","volume-title":"Image quality assessment: from error visibility to structural similarity","author":"Wang Zhou","year":"2004","unstructured":"Zhou Wang, Alan C Bovik, Hamid R Sheikh, and Eero P Simoncelli. 2004. Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing 13, 4 (2004), 600--612."},{"key":"e_1_2_1_80_1","volume-title":"European Conference on Computer Vision. Springer, 423--439","author":"Weir Joshua","year":"2022","unstructured":"Joshua Weir, Junhong Zhao, Andrew Chalmers, and Taehyun Rhee. 2022. Deep portrait delighting. In European Conference on Computer Vision. Springer, 423--439."},{"key":"e_1_2_1_81_1","volume-title":"De-lighting Human Images Using Region-Specific Data Augmentation. In 2023 38th International Conference on Image and Vision Computing New Zealand (IVCNZ). IEEE, 1--6.","author":"Weir Joshua","year":"2023","unstructured":"Joshua Weir, Junhong Zhao, Andrew Chalmers, and Taehyun Rhee. 2023. De-lighting Human Images Using Region-Specific Data Augmentation. In 2023 38th International Conference on Image and Vision Computing New Zealand (IVCNZ). IEEE, 1--6."},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661232"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.00038"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/3550454.3555442"},{"key":"e_1_2_1_85_1","doi-asserted-by":"crossref","unstructured":"Lap-Fai Yu Sai-Kit Yeung Yu-Wing Tai and Stephen Lin. 2013. Shading-based shape refinement of RGB-D images. In CVPR. 1415--1422.","DOI":"10.1109\/CVPR.2013.186"},{"key":"e_1_2_1_86_1","unstructured":"Lvmin Zhang Anyi Rao and Maneesh Agrawala. 2024. IC-Light GitHub Page."},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-019-01685-8"},{"key":"e_1_2_1_88_1","doi-asserted-by":"crossref","unstructured":"Richard Zhang Phillip Isola Alexei A Efros Eli Shechtman and Oliver Wang. 2018. The Unreasonable Effectiveness of Deep Features as a Perceptual Metric. In CVPR.","DOI":"10.1109\/CVPR.2018.00068"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392390"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.77"},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00729"},{"key":"e_1_2_1_92_1","doi-asserted-by":"crossref","unstructured":"Hao Zhou Xiang Yu and David W Jacobs. 2019b. GLoSH: Global-Local Spherical Harmonics for Intrinsic Image Decomposition. In ICCV. 7820--7829.","DOI":"10.1109\/ICCV.2019.00791"},{"key":"e_1_2_1_93_1","first-page":"30599","article-title":"Towards robust blind face restoration with codebook lookup transformer","volume":"35","author":"Zhou Shangchen","year":"2022","unstructured":"Shangchen Zhou, Kelvin Chan, Chongyi Li, and Chen Change Loy. 2022. Towards robust blind face restoration with codebook lookup transformer. Advances in Neural Information Processing Systems 35 (2022), 30599--30611.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766887"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3687903","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3687903","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:09:57Z","timestamp":1750295397000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3687903"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,19]]},"references-count":94,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2024,12,19]]}},"alternative-id":["10.1145\/3687903"],"URL":"https:\/\/doi.org\/10.1145\/3687903","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,19]]},"assertion":[{"value":"2024-11-19","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}