{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,14]],"date-time":"2026-07-14T20:16:33Z","timestamp":1784060193731,"version":"3.55.0"},"reference-count":58,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2015,11,3]],"date-time":"2015-11-03T00:00:00Z","timestamp":1446508800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["VERVE (www.verveconsortium.eu) and CR-PLAY (www.cr-play.eu)"],"award-info":[{"award-number":["VERVE (www.verveconsortium.eu) and CR-PLAY (www.cr-play.eu)"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2015,11,3]]},"abstract":"<jats:p>We introduce a method to compute intrinsic images for a multiview set of outdoor photos with cast shadows, taken under the same lighting. We use an automatic 3D reconstruction from these photos and the sun direction as input and decompose each image into reflectance and shading layers, despite the inaccuracies and missing data of the 3D model. Our approach is based on two key ideas. First, we progressively improve the accuracy of the parameters of our image formation model by performing iterative estimation and combining 3D lighting simulation with 2D image optimization methods. Second, we use the image formation model to express reflectance as a function of discrete visibility values for shadow and light, which allows to introduce a robust visibility classifier for pairs of points in a scene. This classifier is used for shadow labeling, allowing to compute high-quality reflectance and shading layers. Our multiview intrinsic decomposition is of sufficient quality to allow relighting of the input images. We create shadow-caster geometry which preserves shadow silhouettes and, using the intrinsic layers, we can perform multiview relighting with moving cast shadows. We present results on several multiview datasets, and show how it is now possible to perform image-based rendering with changing illumination conditions.<\/jats:p>","DOI":"10.1145\/2756549","type":"journal-article","created":{"date-parts":[[2015,10,30]],"date-time":"2015-10-30T12:58:59Z","timestamp":1446209939000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":55,"title":["Multiview Intrinsic Images of Outdoors Scenes with an Application to Relighting"],"prefix":"10.1145","volume":"34","author":[{"given":"Sylvain","family":"Duch\u00eane","sequence":"first","affiliation":[{"name":"INRIA, Sophia-Antipolis France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Clement","family":"Riant","sequence":"additional","affiliation":[{"name":"INRIA, Sophia-Antipolis France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gaurav","family":"Chaurasia","sequence":"additional","affiliation":[{"name":"INRIA, Sophia-Antipolis France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jorge Lopez","family":"Moreno","sequence":"additional","affiliation":[{"name":"INRIA, Sophia-Antipolis France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pierre-Yves","family":"Laffont","sequence":"additional","affiliation":[{"name":"INRIA, Sophia-Antipolis France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stefan","family":"Popov","sequence":"additional","affiliation":[{"name":"INRIA, Sophia-Antipolis France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adrien","family":"Bousseau","sequence":"additional","affiliation":[{"name":"INRIA, Sophia-Antipolis France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"George","family":"Drettakis","sequence":"additional","affiliation":[{"name":"INRIA, Sophia-Antipolis France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2015,11,3]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"crossref","unstructured":"J. Barron and J. Malik. 2013a. Shape illumination and reflectance from shading. Tech. rep. Berkeley. http:\/\/www.eecs.berkeley.edu\/Pubs\/TechRpts\/2013\/EECS-2013-117.pdf.  J. Barron and J. Malik. 2013a. Shape illumination and reflectance from shading. Tech. rep. Berkeley. http:\/\/www.eecs.berkeley.edu\/Pubs\/TechRpts\/2013\/EECS-2013-117.pdf.","DOI":"10.21236\/ADA586648"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.10"},{"key":"e_1_2_2_3_1","first-page":"3","article-title":"Recovering intrinsic scene characteristics from images","volume":"3","author":"Barrow H. G.","year":"1978","unstructured":"H. G. Barrow and J. M. Tenenbaum . 1978 . Recovering intrinsic scene characteristics from images . Comput. Vis. Syst. 3 , 3 -- 26 . H. G. Barrow and J. M. Tenenbaum. 1978. Recovering intrinsic scene characteristics from images. Comput. Vis. Syst. 3, 3--26.","journal-title":"Comput. Vis. Syst."},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601206"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1618452.1618476"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487228.2487238"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.37"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.1000236"},{"key":"e_1_2_2_9_1","unstructured":"P. Debevec C. Tchou A. Gardner T. Hawkins C. Poullis J. Stumpfel A. Jones N. Yun P. Einarsson T. Lundgren M. Fajardo and P. Martinez. 2004. Estimating surface reflectance properties of a complex scene under captured natural illumination. Tech. rep. USC Institute for Creative Technologies. http:\/\/ict.usc.edu\/pubs\/ICT-TR-06.2004.pdf.  P. Debevec C. Tchou A. Gardner T. Hawkins C. Poullis J. Stumpfel A. Jones N. Yun P. Einarsson T. Lundgren M. Fajardo and P. Martinez. 2004. Estimating surface reflectance properties of a complex scene under captured natural illumination. Tech. rep. USC Institute for Creative Technologies. http:\/\/ict.usc.edu\/pubs\/ICT-TR-06.2004.pdf."},{"key":"e_1_2_2_10_1","volume-title":"Proceedings of the 8th European Conference on Computer Vision (ECCV'04)","author":"Finlayson G. D.","unstructured":"G. D. Finlayson , M. S. Drew , and C. Lu . 2004. Intrinsic images by entropy minimization . In Proceedings of the 8th European Conference on Computer Vision (ECCV'04) . 582--595. G. D. Finlayson, M. S. Drew, and C. Lu. 2004. Intrinsic images by entropy minimization. In Proceedings of the 8th European Conference on Computer Vision (ECCV'04). 582--595."},{"key":"e_1_2_2_11_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'07)","author":"Furukawa Y.","unstructured":"Y. Furukawa and J. Ponce . 2007. Accurate, dense, and robust multiview stereopsis . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'07) . 1--8. Y. Furukawa and J. Ponce. 2007. Accurate, dense, and robust multiview stereopsis. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'07). 1--8."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2012.03137.x"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778832"},{"key":"e_1_2_2_14_1","volume-title":"Proceedings of the 11th International Conference on Computer Vision (ICCV'07)","author":"Goesele M.","unstructured":"M. Goesele , N. Snavely , B. Curless , H. Hoppe , and S. M. Seitz . 2007. Multi-view stereo for community photo collections . In Proceedings of the 11th International Conference on Computer Vision (ICCV'07) . 1--8. M. Goesele, N. Snavely, B. Curless, H. Hoppe, and S. M. Seitz. 2007. Multi-view stereo for community photo collections. In Proceedings of the 11th International Conference on Computer Vision (ICCV'07). 1--8."},{"key":"e_1_2_2_15_1","volume-title":"Proceedings of the 11th International Conference on Compter Vision (ICCV'07)","author":"Grosse R.","unstructured":"R. Grosse , M. K. Johnson , E. H. Adelson , and W. T. Freeman . 2009. Ground-truth dataset and baseline evaluations for intrinsic image algorithms . In Proceedings of the 11th International Conference on Compter Vision (ICCV'07) . R. Grosse, M. K. Johnson, E. H. Adelson, and W. T. Freeman. 2009. Ground-truth dataset and baseline evaluations for intrinsic image algorithms. In Proceedings of the 11th International Conference on Compter Vision (ICCV'07)."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995725"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.214"},{"key":"e_1_2_2_18_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'09)","author":"Haber T.","unstructured":"T. Haber , C. Fuchs , P. Bekaer , H.-P. Seidel , M. Goesele , and H. Lensch . 2009. Relighting objects from image collections . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'09) . 627--634. T. Haber, C. Fuchs, P. Bekaer, H.-P. Seidel, M. Goesele, and H. Lensch. 2009. Relighting objects from image collections. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'09). 627--634."},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2006.00816.x"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024191"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2006.200"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.112"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366221"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1618452.1618477"},{"key":"e_1_2_2_26_1","volume-title":"Proceedings of the 11th European Conference on Computer Vision (ECCV'10)","author":"Lalonde J.-F.","unstructured":"J.-F. Lalonde , A. A. Efros , and S. G. Narasimhan . 2010. Detecting ground shadows in outdoor consumer photographs . In Proceedings of the 11th European Conference on Computer Vision (ECCV'10) . 322--335. J.-F. Lalonde, A. A. Efros, and S. G. Narasimhan. 2010. Detecting ground shadows in outdoor consumer photographs. In Proceedings of the 11th European Conference on Computer Vision (ECCV'10). 322--335."},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-011-0501-8"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSA.61.000001"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33783-3_24"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1177"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409060.1409105"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.5555\/2383815.2383845"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508374"},{"key":"e_1_2_2_34_1","volume-title":"Proceedings of Pacific Graphics Conference (PG'06)","author":"Okabe M.","unstructured":"M. Okabe , G. Zeng , Y. Matsushita , T. Igarashi , L. Quan , and H. Yeung Shum . 2006. Single-view relighting with normal map painting . In Proceedings of Pacific Graphics Conference (PG'06) . 27--34. M. Okabe, G. Zeng, Y. Matsushita, T. Igarashi, L. Quan, and H. Yeung Shum. 2006. Single-view relighting with normal map painting. In Proceedings of Pacific Graphics Conference (PG'06). 27--34."},{"key":"e_1_2_2_35_1","volume-title":"Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'04)","author":"Omer I.","unstructured":"I. Omer and M. Werman . 2004. Color lines: Image specific color representation . In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'04) . 946--953. I. Omer and M. Werman. 2004. Color lines: Image specific color representation. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'04). 946--953."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.110"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/0038-092X(93)90017-I"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-006-8671-5"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311545"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2011.10.001"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-006-8323-9"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DV.2013.12"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995507"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995738"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508419"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2008.01155.x"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141964"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276504"},{"key":"e_1_2_2_49_1","volume-title":"Computer Vision: Algorithms and Applications","author":"Szeliski R.","unstructured":"R. Szeliski . 2010. Computer Vision: Algorithms and Applications , 1 st ed. Springer . R. Szeliski. 2010. Computer Vision: Algorithms and Applications, 1st ed. Springer.","edition":"1"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/1531326.1531374"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-007-0100-x"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2001.937606"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/1243980.1243982"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12217"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601135"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311559"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/280814.280874"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.77"},{"key":"e_1_2_2_59_1","volume-title":"Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'10)","author":"Zhu J.","unstructured":"J. Zhu , K. G. G. Samuel , S. Masood , and M. F. Tappen . 2010. Learning to recognize shadows in monochromatic natural images . In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'10) . 223--230. J. Zhu, K. G. G. Samuel, S. Masood, and M. F. Tappen. 2010. Learning to recognize shadows in monochromatic natural images. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'10). 223--230."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2756549","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2756549","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T06:12:26Z","timestamp":1750227146000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2756549"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,11,3]]},"references-count":58,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2015,11,3]]}},"alternative-id":["10.1145\/2756549"],"URL":"https:\/\/doi.org\/10.1145\/2756549","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,11,3]]},"assertion":[{"value":"2014-05-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-11-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}