{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T15:32:51Z","timestamp":1778081571687,"version":"3.51.4"},"reference-count":42,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2019,7,12]],"date-time":"2019-07-12T00:00:00Z","timestamp":1562889600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2019,8,31]]},"abstract":"<jats:p>\n            Lighting plays a central role in conveying the essence and depth of the subject in a portrait photograph. Professional photographers will carefully control the lighting in their studio to manipulate the appearance of their subject, while consumer photographers are usually constrained to the illumination of their environment. Though prior works have explored techniques for relighting an image, their utility is usually limited due to requirements of specialized hardware, multiple images of the subject under controlled or known illuminations, or accurate models of geometry and reflectance. To this end, we present a system for\n            <jats:italic>portrait relighting<\/jats:italic>\n            : a neural network that takes as input a\n            <jats:italic>single<\/jats:italic>\n            RGB image of a portrait taken with a standard cellphone camera in an unconstrained environment, and from that image produces a relit image of that subject as though it were illuminated according to any provided environment map. Our method is trained on a small database of 18 individuals captured under different directional light sources in a controlled light stage setup consisting of a densely sampled sphere of lights. Our proposed technique produces quantitatively superior results on our dataset's validation set compared to prior works, and produces convincing qualitative relighting results on a dataset of hundreds of real-world cellphone portraits. Because our technique can produce a 640 \u00d7 640 image in only 160 milliseconds, it may enable interactive user-facing photographic applications in the future.\n          <\/jats:p>","DOI":"10.1145\/3306346.3323008","type":"journal-article","created":{"date-parts":[[2019,7,12]],"date-time":"2019-07-12T19:04:08Z","timestamp":1562958248000},"page":"1-12","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":200,"title":["Single image portrait relighting"],"prefix":"10.1145","volume":"38","author":[{"given":"Tiancheng","family":"Sun","sequence":"first","affiliation":[{"name":"University of California"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jonathan T.","family":"Barron","sequence":"additional","affiliation":[{"name":"Google Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yun-Ta","family":"Tsai","sequence":"additional","affiliation":[{"name":"Google Research"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zexiang","family":"Xu","sequence":"additional","affiliation":[{"name":"University of California"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xueming","family":"Yu","sequence":"additional","affiliation":[{"name":"Google"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Graham","family":"Fyffe","sequence":"additional","affiliation":[{"name":"Google"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christoph","family":"Rhemann","sequence":"additional","affiliation":[{"name":"Google"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jay","family":"Busch","sequence":"additional","affiliation":[{"name":"Google"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paul","family":"Debevec","sequence":"additional","affiliation":[{"name":"Google"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ravi","family":"Ramamoorthi","sequence":"additional","affiliation":[{"name":"University of California"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,7,12]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Martin Abadi Paul Barham Jianmin Chen Zhifeng Chen Andy Davis Jeffrey Dean etal 2016. TensorFlow: A system for large-scale machine learning. OSDI (2016).   Martin Abadi Paul Barham Jianmin Chen Zhifeng Chen Andy Davis Jeffrey Dean et al. 2016. TensorFlow: A system for large-scale machine learning. OSDI (2016)."},{"key":"e_1_2_2_2_1","unstructured":"Apple. 2017. Use Portrait mode on your iPhone. https:\/\/support.apple.com\/en-us\/HT208118.  Apple. 2017. Use Portrait mode on your iPhone. https:\/\/support.apple.com\/en-us\/HT208118."},{"key":"e_1_2_2_3_1","volume-title":"Fast Bilateral-Space Stereo for Synthetic Defocus. CVPR","author":"Barron Jonathan T.","year":"2015","unstructured":"Jonathan T. Barron , Andrew Adams , YiChang Shih , and Carlos Hern\u00e1ndez . 2015. Fast Bilateral-Space Stereo for Synthetic Defocus. CVPR ( 2015 ). Jonathan T. Barron, Andrew Adams, YiChang Shih, and Carlos Hern\u00e1ndez. 2015. Fast Bilateral-Space Stereo for Synthetic Defocus. CVPR (2015)."},{"key":"e_1_2_2_4_1","volume-title":"Barron and Jitendra Malik","author":"Jonathan","year":"2015","unstructured":"Jonathan T. Barron and Jitendra Malik . 2015 . Shape, Illumination , and Reflectance from Shading. TPAMI ( 2015). Jonathan T. Barron and Jitendra Malik. 2015. Shape, Illumination, and Reflectance from Shading. TPAMI (2015)."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008154927611"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311556"},{"key":"e_1_2_2_7_1","volume-title":"From Faces to Outdoor Light Probes. Computer Graphics Forum","author":"Calian Dan Andrei","year":"2018","unstructured":"Dan Andrei Calian , Jean-Fran\u00e7ois Lalonde , Paulo F. U. Gotardo , Tomas Simon , Iain A. Matthews , and Kenny Mitchell . 2018. From Faces to Outdoor Light Probes. Computer Graphics Forum ( 2018 ). Dan Andrei Calian, Jean-Fran\u00e7ois Lalonde, Paulo F. U. Gotardo, Tomas Simon, Iain A. Matthews, and Kenny Mitchell. 2018. From Faces to Outdoor Light Probes. Computer Graphics Forum (2018)."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344855"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1457515.1409093"},{"key":"e_1_2_2_10_1","volume-title":"Incorporating Second-order Functional Knowledge for Better Option Pricing. NIPS","author":"Dugas Charles","year":"2000","unstructured":"Charles Dugas , Yoshua Bengio , Fran\u00e7ois B\u00e9lisle , Claude Nadeau , and Ren\u00e9 Garcia . 2000. Incorporating Second-order Functional Knowledge for Better Option Pricing. NIPS ( 2000 ). Charles Dugas, Yoshua Bengio, Fran\u00e7ois B\u00e9lisle, Claude Nadeau, and Ren\u00e9 Garcia. 2000. Incorporating Second-order Functional Knowledge for Better Option Pricing. NIPS (2000)."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1399504.1360666"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130891"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073592"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980254"},{"key":"e_1_2_2_15_1","volume-title":"Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. CVPR","author":"He Kaiming","year":"2015","unstructured":"Kaiming He , Xiangyu Zhang , Shaoqing Ren , and Jian Sun . 2015. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. CVPR ( 2015 ). Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2015. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. CVPR (2015)."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-006-0031-y"},{"key":"e_1_2_2_17_1","volume-title":"Deep Outdoor Illumination Estimation. CVPR","author":"Hold-Geoffroy Yannick","year":"2017","unstructured":"Yannick Hold-Geoffroy , Kalyan Sunkavalli , Sunil Hadap , Emiliano Gambaretto , and Jean-Fran\u00e7ois Lalonde . 2017. Deep Outdoor Illumination Estimation. CVPR ( 2017 ). Yannick Hold-Geoffroy, Kalyan Sunkavalli, Sunil Hadap, Emiliano Gambaretto, and Jean-Fran\u00e7ois Lalonde. 2017. Deep Outdoor Illumination Estimation. CVPR (2017)."},{"key":"e_1_2_2_19_1","volume-title":"FC4: Fully convolutional color constancy with confidence-weighted pooling. CVPR","author":"Hu Yuanming","year":"2017","unstructured":"Yuanming Hu , Baoyuan Wang , and Stephen Lin . 2017. FC4: Fully convolutional color constancy with confidence-weighted pooling. CVPR ( 2017 ). Yuanming Hu, Baoyuan Wang, and Stephen Lin. 2017. FC4: Fully convolutional color constancy with confidence-weighted pooling. CVPR (2017)."},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275104"},{"key":"e_1_2_2_21_1","volume-title":"Kingma and Jimmy Ba","author":"Diederik","year":"2014","unstructured":"Diederik P. Kingma and Jimmy Ba . 2014 . Adam : A Method for Stochastic Optimization. CoRR ( 2014). Diederik P. Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization. CoRR (2014)."},{"key":"e_1_2_2_22_1","volume-title":"Hinton","author":"Krizhevsky Alex","year":"2012","unstructured":"Alex Krizhevsky , Ilya Sutskever , and Geoffrey E . Hinton . 2012 . Imagenet classification with deep convolutional neural networks. NIPS ( 2012). Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. Imagenet classification with deep convolutional neural networks. NIPS (2012)."},{"key":"e_1_2_2_23_1","volume-title":"Narasimhan","author":"Lalonde Jean-Fran\u00e7ois","year":"2009","unstructured":"Jean-Fran\u00e7ois Lalonde , Alexei A. Efros , and Srinivasa G . Narasimhan . 2009 . Estimating Natural Illumination from a Single Outdoor Image. ICCV ( 2009). Jean-Fran\u00e7ois Lalonde, Alexei A. Efros, and Srinivasa G. Narasimhan. 2009. Estimating Natural Illumination from a Single Outdoor Image. ICCV (2009)."},{"key":"e_1_2_2_24_1","volume":"197","author":"Land Edwin H.","unstructured":"Edwin H. Land and John J. McCann. 197 1. Lightness and Retinex Theory. Journal of the Optical Society of America (1971). Edwin H. Land and John J. McCann. 1971. Lightness and Retinex Theory. Journal of the Optical Society of America (1971).","journal-title":"John J. McCann."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1989.1.4.541"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275055"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766894"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1964921.1964963"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1275808.1276442"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186562.1015777"},{"key":"e_1_2_2_31_1","volume-title":"U-net: Convolutional networks for biomedical image segmentation. MICCAI","author":"Ronneberger Olaf","year":"2015","unstructured":"Olaf Ronneberger , Philipp Fischer , and Thomas Brox . 2015 . U-net: Convolutional networks for biomedical image segmentation. MICCAI (2015). Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. MICCAI (2015)."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.132"},{"key":"e_1_2_2_33_1","unstructured":"J.B. Schriever. 1909. Complete Self-instructing Library of Practical Photography. American school of art and photography.  J.B. Schriever. 1909. Complete Self-instructing Library of Practical Photography. American school of art and photography."},{"key":"e_1_2_2_34_1","volume-title":"Caravaggio: The Complete Works. Taschen.","author":"Sch\u00fctze Sebastian","year":"2015","unstructured":"Sebastian Sch\u00fctze . 2015 . Caravaggio: The Complete Works. Taschen. Sebastian Sch\u00fctze. 2015. Caravaggio: The Complete Works. Taschen."},{"key":"e_1_2_2_35_1","volume-title":"Jacobs","author":"Sengupta Soumyadip","year":"2018","unstructured":"Soumyadip Sengupta , Angjoo Kanazawa , Carlos D. Castillo , and David W . Jacobs . 2018 . SfSNet: Learning Shape , Reflectance and Illuminance of Faces in the Wild. CVPR ( 2018). Soumyadip Sengupta, Angjoo Kanazawa, Carlos D. Castillo, and David W. Jacobs. 2018. SfSNet: Learning Shape, Reflectance and Illuminance of Faces in the Wild. CVPR (2018)."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601137"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3095816"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201329"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2003.819861"},{"key":"e_1_2_2_40_1","volume-title":"Learning to Estimate Indoor Lighting from 3D Objects. 3DV","author":"Weber Henrique","year":"2018","unstructured":"Henrique Weber , Donald Pr\u00e9vost , and Jean-Fran\u00e7ois Lalonde . 2018. Learning to Estimate Indoor Lighting from 3D Objects. 3DV ( 2018 ). Henrique Weber, Donald Pr\u00e9vost, and Jean-Fran\u00e7ois Lalonde. 2018. Learning to Estimate Indoor Lighting from 3D Objects. 3DV (2018)."},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073258"},{"key":"e_1_2_2_42_1","unstructured":"Yuxin Wu and Kaiming He. 2018. Group Normalization. ECCV (2018).  Yuxin Wu and Kaiming He. 2018. Group Normalization. ECCV (2018)."},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201313"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3306346.3323008","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3306346.3323008","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:25:52Z","timestamp":1750206352000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3306346.3323008"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,12]]},"references-count":42,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2019,8,31]]}},"alternative-id":["10.1145\/3306346.3323008"],"URL":"https:\/\/doi.org\/10.1145\/3306346.3323008","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,7,12]]},"assertion":[{"value":"2019-07-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}