{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:14:43Z","timestamp":1750220083776,"version":"3.41.0"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2022,5,4]],"date-time":"2022-05-04T00:00:00Z","timestamp":1651622400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100010661","name":"Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["765121"],"award-info":[{"award-number":["765121"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Comput. Graph. Interact. Tech."],"published-print":{"date-parts":[[2022,5,4]]},"abstract":"<jats:p>Video-streaming services usually feature post-processing effects to replace the background. However, these often yield inconsistent lighting. Machine-learning-based relighting methods can address this problem, but, at real-time rates, are restricted to a low resolution and can result in an unrealistic skin appearance. Physically-based rendering techniques require complex skin models that can only be acquired using specialised equipment. Our method is lightweight and uses only a standard smartphone. By correcting imperfections during capture, we extract a convincing physically-based skin model. In combination with suitable acceleration techniques, we achieve real-time rates on commodity hardware.<\/jats:p>","DOI":"10.1145\/3522626","type":"journal-article","created":{"date-parts":[[2022,5,4]],"date-time":"2022-05-04T17:31:08Z","timestamp":1651685468000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Real-Time Relighting of Human Faces with a Low-Cost Setup"],"prefix":"10.1145","volume":"5","author":[{"given":"Nejc","family":"Ma\u010dek","sequence":"first","affiliation":[{"name":"Delft University of Technology, Delft, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Baran","family":"Usta","sequence":"additional","affiliation":[{"name":"Delft University of Technology, Delft, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Elmar","family":"Eisemann","sequence":"additional","affiliation":[{"name":"Delft University of Technology, Delft, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ricardo","family":"Marroquim","sequence":"additional","affiliation":[{"name":"Delft University of Technology, Delft, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,5,4]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Jean-Yves Bouguet etal 2001. Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm. Intel corporation 5 1--10 (2001) 4.  Jean-Yves Bouguet et al. 2001. Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm. Intel corporation 5 1--10 (2001) 4."},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311553"},{"volume-title":"SIGGRAPH Asia.","author":"Debevec Paul","key":"e_1_2_2_3_1","unstructured":"Paul Debevec . 2012. The Light Stages and Their Applications to Photoreal Digital Actors . In SIGGRAPH Asia. Singapore . Paul Debevec. 2012. The Light Stages and Their Applications to Photoreal Digital Actors. In SIGGRAPH Asia. Singapore."},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344855"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/2383894.2383917"},{"key":"e_1_2_2_6_1","volume-title":"Volker Blanz, and Hans-Peter Seidel.","author":"Fuchs Martin","year":"2007","unstructured":"Martin Fuchs , Hendrik PA Lensch , Volker Blanz, and Hans-Peter Seidel. 2007 . Superresolution reflectance fields: Synthesizing images for intermediate light directions. In Computer Graphics Forum, Vol. 26 . Wiley Online Library , 447--456. Martin Fuchs, Hendrik PA Lensch, Volker Blanz, and Hans-Peter Seidel. 2007. Superresolution reflectance fields: Synthesizing images for intermediate light directions. In Computer Graphics Forum, Vol. 26. Wiley Online Library, 447--456."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCPHOT.2015.7168375"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12837"},{"key":"e_1_2_2_9_1","volume-title":"Symmetric Photography: Exploiting Data-sparseness in Reflectance Fields. Eurographics Symposium on Rendering (EGSR)","author":"Garg Gaurav","year":"2006","unstructured":"Gaurav Garg , Eino-Ville Talvala , Marc Levoy , and Hendrik P Lensch . 2006 . Symmetric Photography: Exploiting Data-sparseness in Reflectance Fields. Eurographics Symposium on Rendering (EGSR) (2006), 251--262. Gaurav Garg, Eino-Ville Talvala, Marc Levoy, and Hendrik P Lensch. 2006. Symmetric Photography: Exploiting Data-sparseness in Reflectance Fields. Eurographics Symposium on Rendering (EGSR) (2006), 251--262."},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11432-020-3236-2"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2024156.2024163"},{"key":"e_1_2_2_12_1","volume-title":"SIGGRAPH Asia 2018 37, 6","author":"Gotardo Paulo","year":"2018","unstructured":"Paulo Gotardo , J\u00e9r\u00e9my Riviere , Derek Bradley , Abhijeet Ghosh , and Thabo Beeler . 2018. Practical dynamic facial appearance modeling and acquisition. SIGGRAPH Asia 2018 Technical Papers , SIGGRAPH Asia 2018 37, 6 ( 2018 ). https:\/\/doi.org\/10.1145\/3272127.3275073 Paulo Gotardo, J\u00e9r\u00e9my Riviere, Derek Bradley, Abhijeet Ghosh, and Thabo Beeler. 2018. Practical dynamic facial appearance modeling and acquisition. SIGGRAPH Asia 2018 Technical Papers, SIGGRAPH Asia 2018 37, 6 (2018). https:\/\/doi.org\/10.1145\/3272127.3275073"},{"key":"e_1_2_2_13_1","unstructured":"Jianzhu Guo Xiangyu Zhu and Zhen Lei. 2018. 3DDFA. https:\/\/github.com\/cleardusk\/3DDFA.  Jianzhu Guo Xiangyu Zhu and Zhen Lei. 2018. 3DDFA. https:\/\/github.com\/cleardusk\/3DDFA."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58529-7_10"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/584993.585053"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.5555\/2383533.2383575"},{"key":"e_1_2_2_17_1","volume-title":"SA 2020 (2020","author":"Legendre Chloe","year":"2020","unstructured":"Chloe Legendre , Wan Chun Ma , Rohit Pandey , Sean Fanello , Christoph Rhemann , Jason Dourgarian , Jay Busch , and Paul Debevec . 2020 . Learning Illumination from Diverse Portraits. SIGGRAPH Asia 2020 Technical Communications , SA 2020 (2020 ). https:\/\/doi.org\/10.1145\/3410700.3425432 arXiv:2008.02396 Chloe Legendre, Wan Chun Ma, Rohit Pandey, Sean Fanello, Christoph Rhemann, Jason Dourgarian, Jay Busch, and Paul Debevec. 2020. Learning Illumination from Diverse Portraits. SIGGRAPH Asia 2020 Technical Communications, SA 2020 (2020). https:\/\/doi.org\/10.1145\/3410700.3425432 arXiv:2008.02396"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2016.2636661"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.5555\/2383847.2383873"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383320"},{"key":"e_1_2_2_21_1","unstructured":"Morgan McGuire. 2017. Computer Graphics Archive. https:\/\/casual-effects.com\/data  Morgan McGuire. 2017. Computer Graphics Archive. https:\/\/casual-effects.com\/data"},{"key":"e_1_2_2_22_1","first-page":"4","article-title":"Deep Reflectance Fields - High-Quality Facial Reflectance Field Inference From Color Gradient Illumination","volume":"38","author":"Meka Abhimitra","year":"2019","unstructured":"Abhimitra Meka , Christian Haene , Rohit Pandey , Michael Zollhoefer , Sean Fanello , Graham Fyffe , Adarsh Kowdle , Xueming Yu , Jay Busch , Jason Dourgarian , Peter Denny , Sofien Bouaziz , Peter Lincoln , Matt Whalen , Geoff Harvey , Jonathan Taylor , Shahram Izadi , Andrea Tagliasacchi , Paul Debevec , Christian Theobalt , Julien Valentin , and Christoph Rhemann . 2019 . Deep Reflectance Fields - High-Quality Facial Reflectance Field Inference From Color Gradient Illumination . ACM Transactions on Graphics (Proceedings SIGGRAPH) 38 , 4 . https:\/\/doi.org\/10.1145\/3306346.3323027 Abhimitra Meka, Christian Haene, Rohit Pandey, Michael Zollhoefer, Sean Fanello, Graham Fyffe, Adarsh Kowdle, Xueming Yu, Jay Busch, Jason Dourgarian, Peter Denny, Sofien Bouaziz, Peter Lincoln, Matt Whalen, Geoff Harvey, Jonathan Taylor, Shahram Izadi, Andrea Tagliasacchi, Paul Debevec, Christian Theobalt, Julien Valentin, and Christoph Rhemann. 2019. Deep Reflectance Fields - High-Quality Facial Reflectance Field Inference From Color Gradient Illumination. ACM Transactions on Graphics (Proceedings SIGGRAPH) 38, 4. https:\/\/doi.org\/10.1145\/3306346.3323027","journal-title":"ACM Transactions on Graphics (Proceedings SIGGRAPH)"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00517"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459872"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276442"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392464"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00659"},{"volume-title":"1994 Proceedings of IEEE conference on computer vision and pattern recognition. IEEE, 593--600","author":"Jianbo","key":"e_1_2_2_28_1","unstructured":"Jianbo Shi et al. 1994. Good features to track . In 1994 Proceedings of IEEE conference on computer vision and pattern recognition. IEEE, 593--600 . Jianbo Shi et al. 1994. Good features to track. In 1994 Proceedings of IEEE conference on computer vision and pattern recognition. IEEE, 593--600."},{"key":"e_1_2_2_29_1","article-title":"Portrait Lighting Transfer Using a Mass Transport Approach","volume":"37","author":"Shu Zhixin","year":"2017","unstructured":"Zhixin Shu , Sunil Hadap , Eli Shechtman , Kalyan Sunkavalli , Sylvain Paris , and Dimitris Samaras . 2017 . Portrait Lighting Transfer Using a Mass Transport Approach . ACM Trans. Graph. 37 , 1, Article 2 (Oct. 2017), 15 pages. https:\/\/doi.org\/10.1145\/3095816 Zhixin Shu, Sunil Hadap, Eli Shechtman, Kalyan Sunkavalli, Sylvain Paris, and Dimitris Samaras. 2017. Portrait Lighting Transfer Using a Mass Transport Approach. ACM Trans. Graph. 37, 1, Article 2 (Oct. 2017), 15 pages. https:\/\/doi.org\/10.1145\/3095816","journal-title":"ACM Trans. Graph."},{"key":"e_1_2_2_30_1","volume-title":"First Order Motion Model for Image Animation. In Conference on Neural Information Processing Systems (NeurIPS).","author":"Siarohin Aliaksandr","year":"2019","unstructured":"Aliaksandr Siarohin , St\u00e9phane Lathuili\u00e8re , Sergey Tulyakov , Elisa Ricci , and Nicu Sebe . 2019 . First Order Motion Model for Image Animation. In Conference on Neural Information Processing Systems (NeurIPS). Aliaksandr Siarohin, St\u00e9phane Lathuili\u00e8re, Sergey Tulyakov, Elisa Ricci, and Nicu Sebe. 2019. First Order Motion Model for Image Animation. In Conference on Neural Information Processing Systems (NeurIPS)."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2016.05.255"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323008"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417821"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000013087.49260.fb"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417824"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1179352.1141987"},{"key":"e_1_2_2_37_1","first-page":"1","article-title":"Deep image-based relighting from optimal sparse samples","volume":"37","author":"Xu Zexiang","year":"2018","unstructured":"Zexiang Xu , Kalyan Sunkavalli , Sunil Hadap , and Ravi Ramamoorthi . 2018 . Deep image-based relighting from optimal sparse samples . ACM Transactions on Graphics 37 , 4 (2018), 1 -- 13 . https:\/\/doi.org\/10.1145\/3197517.3201313 Zexiang Xu, Kalyan Sunkavalli, Sunil Hadap, and Ravi Ramamoorthi. 2018. Deep image-based relighting from optimal sparse samples. ACM Transactions on Graphics 37, 4 (2018), 1--13. https:\/\/doi.org\/10.1145\/3197517.3201313","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201364"},{"key":"e_1_2_2_39_1","article-title":"Neural Light Transport for Relighting and View Synthesis","volume":"40","author":"Zhang Xiuming","year":"2021","unstructured":"Xiuming Zhang , Sean Fanello , Yun Ta Tsai , Tiancheng Sun , Tianfan Xue , Rohit Pandey , Sergio Orts-Escolano , Philip Davidson , Christoph Rhemann , Paul Debevec , Jonathan T. Barron , Ravi Ramamoorthi , and William T. Freeman . 2021 . Neural Light Transport for Relighting and View Synthesis . ACM Transactions on Graphics 40 , 1 (2021). https:\/\/doi.org\/10.1145\/3446328 arXiv:2008.03806 Xiuming Zhang, Sean Fanello, Yun Ta Tsai, Tiancheng Sun, Tianfan Xue, Rohit Pandey, Sergio Orts-Escolano, Philip Davidson, Christoph Rhemann, Paul Debevec, Jonathan T. Barron, Ravi Ramamoorthi, and William T. Freeman. 2021. Neural Light Transport for Relighting and View Synthesis. ACM Transactions on Graphics 40, 1 (2021). https:\/\/doi.org\/10.1145\/3446328 arXiv:2008.03806","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00729"}],"container-title":["Proceedings of the ACM on Computer Graphics and Interactive Techniques"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3522626","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3522626","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:09:34Z","timestamp":1750183774000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3522626"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,4]]},"references-count":40,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,5,4]]}},"alternative-id":["10.1145\/3522626"],"URL":"https:\/\/doi.org\/10.1145\/3522626","relation":{},"ISSN":["2577-6193"],"issn-type":[{"type":"electronic","value":"2577-6193"}],"subject":[],"published":{"date-parts":[[2022,5,4]]},"assertion":[{"value":"2022-05-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}