{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T20:12:28Z","timestamp":1772914348140,"version":"3.50.1"},"reference-count":48,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2011,12,1]],"date-time":"2011-12-01T00:00:00Z","timestamp":1322697600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2011,12]]},"abstract":"<jats:p>We propose a method to realistically insert synthetic objects into existing photographs without requiring access to the scene or any additional scene measurements. With a single image and a small amount of annotation, our method creates a physical model of the scene that is suitable for realistically rendering synthetic objects with diffuse, specular, and even glowing materials while accounting for lighting interactions between the objects and the scene. We demonstrate in a user study that synthetic images produced by our method are confusable with real scenes, even for people who believe they are good at telling the difference. Further, our study shows that our method is competitive with other insertion methods while requiring less scene information. We also collected new illumination and reflectance datasets; renderings produced by our system compare well to ground truth. Our system has applications in the movie and gaming industry, as well as home decorating and user content creation, among others.<\/jats:p>","DOI":"10.1145\/2070781.2024191","type":"journal-article","created":{"date-parts":[[2011,11,30]],"date-time":"2011-11-30T13:58:46Z","timestamp":1322661526000},"page":"1-12","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":192,"title":["Rendering synthetic objects into legacy photographs"],"prefix":"10.1145","volume":"30","author":[{"given":"Kevin","family":"Karsch","sequence":"first","affiliation":[{"name":"University of Illinois at Urbana-Champaign"}]},{"given":"Varsha","family":"Hedau","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign"}]},{"given":"David","family":"Forsyth","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign"}]},{"given":"Derek","family":"Hoiem","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign"}]}],"member":"320","published-online":{"date-parts":[[2011,12,12]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2006.692"},{"key":"e_1_2_2_2_1","unstructured":"Barrow H. and Tenenbaum J. 1978. Recovering intrinsic scene characteristics from images. In Comp. Vision Sys. 3--26.  Barrow H. and Tenenbaum J. 1978. Recovering intrinsic scene characteristics from images. In Comp. Vision Sys . 3--26."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/0734-189X(85)90054-4"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383270"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/0167-8655(87)90034-1"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964938"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360656"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1026598000963"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/280814.280864"},{"key":"e_1_2_2_10_1","doi-asserted-by":"crossref","unstructured":"Farenzena M. and Fusiello A. 2007. Recovering intrinsic images using an illumination invariant image. In ICIP 485--488.  Farenzena M. and Fusiello A. 2007. Recovering intrinsic images using an illumination invariant image. In ICIP 485--488.","DOI":"10.1109\/ICIP.2007.4379352"},{"key":"e_1_2_2_11_1","volume-title":"Proceedings of Graphics Interface '93","author":"Fournier A.","unstructured":"Fournier , A. , Gunawan , A. S. , and Romanzin , C . 1993. Common illumination between real and computer generated scenes . In Proceedings of Graphics Interface '93 , 254--262. Fournier, A., Gunawan, A. S., and Romanzin, C. 1993. Common illumination between real and computer generated scenes. In Proceedings of Graphics Interface '93, 254--262."},{"key":"e_1_2_2_12_1","doi-asserted-by":"crossref","unstructured":"Funt B. V. Drew M. S. and Brockington M. 1992. Recovering shading from color images. In ECCV 124--132.   Funt B. V. Drew M. S. and Brockington M. 1992. Recovering shading from color images. In ECCV 124--132.","DOI":"10.1007\/3-540-55426-2_15"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2009.161"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/38.656788"},{"key":"e_1_2_2_15_1","doi-asserted-by":"crossref","unstructured":"Grosse R. Johnson M. K. Adelson E. H. and Freeman W. T. 2009. Ground-truth dataset and baseline evaluations for intrinsic image algorithms. In ICCV 2335--2342.  Grosse R. Johnson M. K. Adelson E. H. and Freeman W. T. 2009. Ground-truth dataset and baseline evaluations for intrinsic image algorithms. In ICCV 2335--2342.","DOI":"10.1109\/ICCV.2009.5459428"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995725"},{"key":"e_1_2_2_17_1","doi-asserted-by":"crossref","unstructured":"Hartley R. and Zisserman A. 2003. Multiple View Geometry in Computer Vision 2 ed. Cambridge University Press New York NY USA.   Hartley R. and Zisserman A. 2003. Multiple View Geometry in Computer Vision 2 ed. Cambridge University Press New York NY USA.","DOI":"10.1017\/CBO9780511811685"},{"key":"e_1_2_2_18_1","volume-title":"ICCV","author":"Hedau V.","unstructured":"Hedau , V. , Hoiem , D. , and Forsyth , D . 2009. Recovering the spatial layout of cluttered rooms . In ICCV , 1849--1856. Hedau, V., Hoiem, D., and Forsyth, D. 2009. Recovering the spatial layout of cluttered rooms. In ICCV, 1849--1856."},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073232"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/0146-664X(74)90022-7"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/258734.258854"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-8659.00506"},{"key":"e_1_2_2_23_1","doi-asserted-by":"crossref","unstructured":"Kee E. and Farid H. 2010. Exposing digital forgeries from 3-d lighting environments. In WIFS 1--6.  Kee E. and Farid H. 2010. Exposing digital forgeries from 3-d lighting environments. In WIFS 1--6.","DOI":"10.1109\/WIFS.2010.5711437"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141937"},{"key":"e_1_2_2_25_1","doi-asserted-by":"crossref","unstructured":"Lalonde J.-F. and Efros A. A. 2007. Using color compatibility for assessing image realism. In ICCV 1--8.  Lalonde J.-F. and Efros A. A. 2007. Using color compatibility for assessing image realism. In ICCV 1--8.","DOI":"10.1109\/ICCV.2007.4409107"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276381"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1618452.1618477"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSA.61.000001"},{"key":"e_1_2_2_29_1","doi-asserted-by":"crossref","unstructured":"Lee D. C. Hebert M. and Kanade T. 2009. Geometric reasoning for single image structure recovery. In CVPR 2136--2143.  Lee D. C. Hebert M. and Kanade T. 2009. Geometric reasoning for single image structure recovery. In CVPR 2136--2143.","DOI":"10.1109\/CVPR.2009.5206872"},{"key":"e_1_2_2_30_1","first-page":"1288","article-title":"Estimating spatial layout of rooms using volumetric reasoning about objects and surfaces","volume":"24","author":"Lee D. C.","year":"2010","unstructured":"Lee , D. C. , Gupta , A. , Hebert , M. , and Kanade , T. 2010 . Estimating spatial layout of rooms using volumetric reasoning about objects and surfaces . Advances in Neural Information Processing Systems (NIPS) 24 ( November ), 1288 -- 1296 . Lee, D. C., Gupta, A., Hebert, M., and Kanade, T. 2010. Estimating spatial layout of rooms using volumetric reasoning about objects and surfaces. Advances in Neural Information Processing Systems (NIPS) 24 (November), 1288--1296.","journal-title":"Advances in Neural Information Processing Systems (NIPS)"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.168"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-8659.00326"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2010.08.004"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964982"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1364\/AO.48.000450"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383310"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0262-8856(02)00054-9"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2003.1182093"},{"key":"e_1_2_2_39_1","volume-title":"Proceedings of the 23rd national conference on Artificial intelligence -","volume":"3","author":"Saxena A.","unstructured":"Saxena , A. , Sun , M. , and Ng , A. Y . 2008. Make3d: depth perception from a single still image . In Proceedings of the 23rd national conference on Artificial intelligence - Volume 3 , AAAI Press, 1571--1576. Saxena, A., Sun, M., and Ng, A. Y. 2008. Make3d: depth perception from a single still image. In Proceedings of the 23rd national conference on Artificial intelligence - Volume 3, AAAI Press, 1571--1576."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409060.1409112"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2005.185"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.114"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1524-0703(03)00043-2"},{"key":"e_1_2_2_44_1","first-page":"68","article-title":"Deriving intrinsic images from image sequences","author":"Weiss Y.","year":"2001","unstructured":"Weiss , Y. 2001 . Deriving intrinsic images from image sequences . In ICCV , II : 68 -- 75 . Weiss, Y. 2001. Deriving intrinsic images from image sequences. In ICCV, II: 68--75.","journal-title":"ICCV"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/1899404.1899406"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311559"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964981"},{"key":"e_1_2_2_48_1","unstructured":"Zhang L. Dugas-Phocion G. Samson J. and Seitz S. 2001. Single view modeling of free-form scenes. In CVPR 990--997.  Zhang L. Dugas-Phocion G. Samson J. and Seitz S. 2001. Single view modeling of free-form scenes. In CVPR 990--997."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2070781.2024191","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2070781.2024191","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T10:06:03Z","timestamp":1750241163000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2070781.2024191"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,12]]},"references-count":48,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2011,12]]}},"alternative-id":["10.1145\/2070781.2024191"],"URL":"https:\/\/doi.org\/10.1145\/2070781.2024191","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,12]]},"assertion":[{"value":"2011-12-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}