{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T03:18:01Z","timestamp":1783048681244,"version":"3.54.6"},"reference-count":43,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2008,12,1]],"date-time":"2008-12-01T00:00:00Z","timestamp":1228089600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2008,12]]},"abstract":"<jats:p>In this paper, we introduce a novel system for browsing, enhancing, and manipulating casual outdoor photographs by combining them with already existing georeferenced digital terrain and urban models. A simple interactive registration process is used to align a photograph with such a model. Once the photograph and the model have been registered, an abundance of information, such as depth, texture, and GIS data, becomes immediately available to our system. This information, in turn, enables a variety of operations, ranging from dehazing and relighting the photograph, to novel view synthesis, and overlaying with geographic information. We describe the implementation of a number of these applications and discuss possible extensions. Our results show that augmenting photographs with already available 3D models of the world supports a wide variety of new ways for us to experience and interact with our everyday snapshots.<\/jats:p>","DOI":"10.1145\/1409060.1409069","type":"journal-article","created":{"date-parts":[[2008,12,3]],"date-time":"2008-12-03T21:56:04Z","timestamp":1228341364000},"page":"1-10","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":495,"title":["Deep photo"],"prefix":"10.1145","volume":"27","author":[{"given":"Johannes","family":"Kopf","sequence":"first","affiliation":[{"name":"University of Konstanz"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Boris","family":"Neubert","sequence":"additional","affiliation":[{"name":"University of Konstanz"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Billy","family":"Chen","sequence":"additional","affiliation":[{"name":"Microsoft"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Cohen","sequence":"additional","affiliation":[{"name":"Microsoft Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Cohen-Or","sequence":"additional","affiliation":[{"name":"Tel Aviv University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Oliver","family":"Deussen","sequence":"additional","affiliation":[{"name":"University of Konstanz"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matt","family":"Uyttendaele","sequence":"additional","affiliation":[{"name":"Microsoft Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dani","family":"Lischinski","sequence":"additional","affiliation":[{"name":"The Hebrew University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2008,12]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Proceedings of the 2001 symposium on Interactive 3D graphics (I3D), 217--226","author":"Ashikhmin M.","year":"2001","unstructured":"Ashikhmin , M. 2001 . Synthesizing natural textures . Proceedings of the 2001 symposium on Interactive 3D graphics (I3D), 217--226 . 10.1145\/364338.364405 Ashikhmin, M. 2001. Synthesizing natural textures. Proceedings of the 2001 symposium on Interactive 3D graphics (I3D), 217--226. 10.1145\/364338.364405"},{"key":"e_1_2_2_2_1","unstructured":"Chen B. Ramos G. Ofek E. Cohen M. Drucker S. and Nister D. 2008. Interactive techniques for registering images to digital terrain and building models. Microsoft Research Technical Report MSR-TR-2008-115.  Chen B. Ramos G. Ofek E. Cohen M. Drucker S. and Nister D. 2008. Interactive techniques for registering images to digital terrain and building models. Microsoft Research Technical Report MSR-TR-2008-115 ."},{"key":"e_1_2_2_3_1","volume-title":"Proceedings of the 36th Applied Imagery Pattern Recognition Workshop, 3--8. 10","author":"Cho P. L.","year":"2007","unstructured":"Cho , P. L. 2007 . 3D organization of 2D urban imagery . Proceedings of the 36th Applied Imagery Pattern Recognition Workshop, 3--8. 10 .1109\/AIPR.2007.12 Cho, P. L. 2007. 3D organization of 2D urban imagery. Proceedings of the 36th Applied Imagery Pattern Recognition Workshop, 3--8. 10.1109\/AIPR.2007.12"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1026598000963"},{"key":"e_1_2_2_5_1","volume-title":"Proceedings of SIGGRAPH '96","author":"Debevec P. E.","unstructured":"Debevec , P. E. , Taylor , C. J. , and Malik , J . 1996. Modeling and rendering architecture from photographs: A hybrid geometry-and image-based approach . Proceedings of SIGGRAPH '96 , 11--20. 10.1145\/237170.237191 Debevec, P. E., Taylor, C. J., and Malik, J. 1996. Modeling and rendering architecture from photographs: A hybrid geometry-and image-based approach. Proceedings of SIGGRAPH '96, 11--20. 10.1145\/237170.237191"},{"key":"e_1_2_2_6_1","volume-title":"Proceedings of SIGGRAPH","author":"Debevec P.","year":"2000","unstructured":"Debevec , P. , Hawkins , T. , Tchou , C. , Duiker , H.-P. , Sarokin , W. , and Sagar , M . 2000. Acquiring the reflectance field of a human face . Proceedings of SIGGRAPH 2000 , 145--156. 10.1145\/344779.344855 Debevec, P., Hawkins, T., Tchou, C., Duiker, H.-P., Sarokin, W., and Sagar, M. 2000. Acquiring the reflectance field of a human face. Proceedings of SIGGRAPH 2000, 145--156. 10.1145\/344779.344855"},{"key":"e_1_2_2_7_1","volume-title":"ACM Transactions on Graphics (Proceedings of SIGGRAPH 2003)","author":"Drori I.","unstructured":"Drori , I. , Cohen-Or , D. , and Yeshurun , H . 2003. Fragment-based image completion . ACM Transactions on Graphics (Proceedings of SIGGRAPH 2003) 22, 3, 303--312. 10.1145\/882262.882267 Drori, I., Cohen-Or, D., and Yeshurun, H. 2003. Fragment-based image completion. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2003) 22, 3, 303--312. 10.1145\/882262.882267"},{"key":"e_1_2_2_8_1","unstructured":"E-on Software 2008. Vue 6 Infinite. http:\/\/www.e-onsoftware.com\/products\/vue\/vue_6_infinite.  E-on Software 2008. Vue 6 Infinite. http:\/\/www.e-onsoftware.com\/products\/vue\/vue_6_infinite."},{"key":"e_1_2_2_9_1","volume-title":"Proceedings of IEEE International Conference on Computer Vision (ICCV) '99 2, 1033--1038","author":"Efros A. A.","unstructured":"Efros , A. A. , and Leung , T. K . 1999. Texture synthesis by non-parametric sampling . Proceedings of IEEE International Conference on Computer Vision (ICCV) '99 2, 1033--1038 . Efros, A. A., and Leung, T. K. 1999. Texture synthesis by non-parametric sampling. Proceedings of IEEE International Conference on Computer Vision (ICCV) '99 2, 1033--1038."},{"key":"e_1_2_2_10_1","volume-title":"ACM Transactions on Graphics (Proceedings of SIGGRAPH 2008)","author":"Fattal R.","year":"2008","unstructured":"Fattal , R. 2008 . Single image dehazing . ACM Transactions on Graphics (Proceedings of SIGGRAPH 2008) 27, 3, 73. 10.1145\/1360612.1360671 Fattal, R. 2008. Single image dehazing. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2008) 27, 3, 73. 10.1145\/1360612.1360671"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2003.1242382"},{"key":"e_1_2_2_12_1","doi-asserted-by":"crossref","unstructured":"Gruen A. and Huang T. S. 2001. Calibration and Orientation of Cameras in Computer Vision. Springer-Verlag Secaucus NJ USA.   Gruen A. and Huang T. S. 2001. Calibration and Orientation of Cameras in Computer Vision. Springer-Verlag Secaucus NJ USA.","DOI":"10.1007\/978-3-662-04567-1"},{"key":"e_1_2_2_13_1","volume-title":"ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007)","author":"Hays J.","unstructured":"Hays , J. , and Efros , A. A . 2007. Scene completion using millions of photographs . ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007) 26, 3, 4. 10.1145\/1276377.1276382 Hays, J., and Efros, A. A. 2007. Scene completion using millions of photographs. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007) 26, 3, 4. 10.1145\/1276377.1276382"},{"key":"e_1_2_2_14_1","volume-title":"Proceedings of SIGGRAPH","author":"Hertzmann A.","year":"2001","unstructured":"Hertzmann , A. , Jacobs , C. E. , Oliver , N. , Curless , B. , and Salesin , D. H . 2001. Image analogies . Proceedings of SIGGRAPH 2001 , 327--340. 10.1145\/383259.383295 Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., and Salesin, D. H. 2001. Image analogies. Proceedings of SIGGRAPH 2001, 327--340. 10.1145\/383259.383295"},{"key":"e_1_2_2_15_1","volume-title":"ACM Transactions on Graphics (Proceedings of SIGGRAPH 2005)","author":"Hoiem D.","unstructured":"Hoiem , D. , Efros , A. A. , and Hebert , M . 2005. Automatic photo pop-up . ACM Transactions on Graphics (Proceedings of SIGGRAPH 2005) 24, 3, 577--584. 10.1145\/1073204.1073232 Hoiem, D., Efros, A. A., and Hebert, M. 2005. Automatic photo pop-up. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2005) 24, 3, 577--584. 10.1145\/1073204.1073232"},{"key":"e_1_2_2_16_1","volume-title":"Proceedings of SIGGRAPH '97","author":"Horry Y.","unstructured":"Horry , Y. , Anjyo , K.-I. , and Arai , K . 1997. Tour into the picture: using a spidery mesh interface to make animation from a single image . Proceedings of SIGGRAPH '97 , 225--232. 10.1145\/258734.258854 Horry, Y., Anjyo, K.-I., and Arai, K. 1997. Tour into the picture: using a spidery mesh interface to make animation from a single image. Proceedings of SIGGRAPH '97, 225--232. 10.1145\/258734.258854"},{"key":"e_1_2_2_17_1","volume-title":"Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Kaftory R.","year":"2007","unstructured":"Kaftory , R. , Schechner , Y. Y. , and Zeevi , Y. Y . 2007. Variational distance-dependent image restoration . Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2007 , 1--8. Kaftory, R., Schechner, Y. Y., and Zeevi, Y. Y. 2007. Variational distance-dependent image restoration. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2007, 1--8."},{"key":"e_1_2_2_18_1","volume-title":"Depth painting for image-based rendering applications. Tech. rep","author":"Kang S. B.","unstructured":"Kang , S. B. 1998. Depth painting for image-based rendering applications. Tech. rep ., Compaq Cambridge Research Lab . Kang, S. B. 1998. Depth painting for image-based rendering applications. Tech. rep., Compaq Cambridge Research Lab."},{"key":"e_1_2_2_19_1","volume-title":"ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007)","author":"Lalonde J.-F.","unstructured":"Lalonde , J.-F. , Hoiem , D. , Efros , A. A. , Rother , C. , Winn , J. , and Criminisi , A . 2007. Photo clip art . ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007) 26, 3, 3. 10.1145\/1276377.1276381 Lalonde, J.-F., Hoiem, D., Efros, A. A., Rother, C., Winn, J., and Criminisi, A. 2007. Photo clip art. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007) 26, 3, 3. 10.1145\/1276377.1276381"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/2945.895874"},{"key":"e_1_2_2_21_1","volume-title":"Optics of the Atmosphere: Scattering by Molecules and Particles","author":"McCartney E. J.","unstructured":"McCartney , E. J. 1976. Optics of the Atmosphere: Scattering by Molecules and Particles . John Wiley and Sons , New York, NY, USA . McCartney, E. J. 1976. Optics of the Atmosphere: Scattering by Molecules and Particles. John Wiley and Sons, New York, NY, USA."},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2003.1201821"},{"key":"e_1_2_2_23_1","volume-title":"IEEE Workshop on Color and Photometric Methods in Computer Vision.","author":"Narasimhan S. G.","unstructured":"Narasimhan , S. G. , and Nayar , S. K . 2003. Interactive (de)weathering of an image using physical models . IEEE Workshop on Color and Photometric Methods in Computer Vision. Narasimhan, S. G., and Nayar, S. K. 2003. Interactive (de)weathering of an image using physical models. IEEE Workshop on Color and Photometric Methods in Computer Vision."},{"key":"e_1_2_2_24_1","unstructured":"NASA 2008. The landsat program. http:\/\/landsat.gsfc.nasa.gov\/.  NASA 2008. The landsat program. http:\/\/landsat.gsfc.nasa.gov\/."},{"key":"e_1_2_2_25_1","unstructured":"NASA 2008. Shuttle radar topography mission. http:\/\/www2.jpl.nasa.gov\/srtm\/.  NASA 2008. Shuttle radar topography mission. http:\/\/www2.jpl.nasa.gov\/srtm\/."},{"key":"e_1_2_2_26_1","volume-title":"Proceedings of IEEE International Conference on Computer Vision (ICCV) '99","author":"Nayar S. K.","unstructured":"Nayar , S. K. , and Narasimhan , S. G . 1999. Vision in bad weather . Proceedings of IEEE International Conference on Computer Vision (ICCV) '99 , 820--827. Nayar, S. K., and Narasimhan, S. G. 1999. Vision in bad weather. Proceedings of IEEE International Conference on Computer Vision (ICCV) '99, 820--827."},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10851-006-0450-y"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/83.660994"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383310"},{"key":"e_1_2_2_30_1","unstructured":"Reichmann M. 2001. The art of photography. http:\/\/www.luminous-landscape.com\/essays\/theartof.shtml.  Reichmann M. 2001. The art of photography. http:\/\/www.luminous-landscape.com\/essays\/theartof.shtml."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1141"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1364\/AO.42.000511"},{"key":"e_1_2_2_33_1","volume-title":"Proceedings of SIGGRAPH '98","author":"Shade J.","unstructured":"Shade , J. , Gortler , S. , He , L.-W. , and Szeliski , R . 1998. Layered depth images . Proceedings of SIGGRAPH '98 , 231--242. 10.1145\/280814.280882 Shade, J., Gortler, S., He, L.-W., and Szeliski, R. 1998. Layered depth images. Proceedings of SIGGRAPH '98, 231--242. 10.1145\/280814.280882"},{"key":"e_1_2_2_34_1","volume-title":"Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Shum H.-Y.","year":"1998","unstructured":"Shum , H.-Y. , Han , M. , and Szeliski , R . 1998. Interactive construction of 3-d models from panoramic mosaics . Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 1998 , 427--433. Shum, H.-Y., Han, M., and Szeliski, R. 1998. Interactive construction of 3-d models from panoramic mosaics. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 1998, 427--433."},{"key":"e_1_2_2_35_1","volume-title":"ACM Transactions on Graphics (Proceedings of SIGGRAPH 2006)","author":"Snavely N.","year":"1911","unstructured":"Snavely , N. , Seitz , S. M. , and Szeliski , R . 2006. Photo tourism: exploring photo collections in 3d . ACM Transactions on Graphics (Proceedings of SIGGRAPH 2006) 25, 3, 835--846. 10.1145\/114 1911 .1141964 Snavely, N., Seitz, S. M., and Szeliski, R. 2006. Photo tourism: exploring photo collections in 3d. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2006) 25, 3, 835--846. 10.1145\/1141911.1141964"},{"key":"e_1_2_2_36_1","volume-title":"Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Stamos I.","year":"1998","unstructured":"Stamos , I. , and Allen , P. K . 2000. 3-D model construction using range and image data . Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 1998 , 531--536. Stamos, I., and Allen, P. K. 2000. 3-D model construction using range and image data. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 1998, 531--536."},{"key":"e_1_2_2_37_1","volume-title":"ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007)","author":"Sunkavalli K.","unstructured":"Sunkavalli , K. , Matusik , W. , Pfister , H. , and Rusinkiewicz , S . 2007. Factored time-lapse video . ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007) 26, 3, 101. 10.1145\/1276377.1276504 Sunkavalli, K., Matusik, W., Pfister, H., and Rusinkiewicz, S. 2007. Factored time-lapse video. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007) 26, 3, 101. 10.1145\/1276377.1276504"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2008.4587643"},{"key":"e_1_2_2_39_1","volume-title":"Proceedings of the 11th ACM international conference on Multimedia, 156--166","author":"Toyama K.","unstructured":"Toyama , K. , Logan , R. , and Roseway , A . 2003. Geographic location tags on digital images . Proceedings of the 11th ACM international conference on Multimedia, 156--166 . 10.1145\/957013.957046 Toyama, K., Logan, R., and Roseway, A. 2003. Geographic location tags on digital images. Proceedings of the 11th ACM international conference on Multimedia, 156--166. 10.1145\/957013.957046"},{"key":"e_1_2_2_40_1","volume-title":"ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007)","author":"Wang J.","unstructured":"Wang , J. , Agrawala , M. , and Cohen , M. F . 2007. Soft scissors: an interactive tool for realtime high quality matting . ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007) 26, 3. 10.1145\/1276377.1276389 Wang, J., Agrawala, M., and Cohen, M. F. 2007. Soft scissors: an interactive tool for realtime high quality matting. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007) 26, 3. 10.1145\/1276377.1276389"},{"key":"e_1_2_2_41_1","volume-title":"Proceedings of SIGGRAPH '98","author":"Yu Y.","unstructured":"Yu , Y. , and Malik , J . 1998. Recovering photometric properties of architectural scenes from photographs . Proceedings of SIGGRAPH '98 , 207--217. 10.1145\/280814.280874 Yu, Y., and Malik, J. 1998. Recovering photometric properties of architectural scenes from photographs. Proceedings of SIGGRAPH '98, 207--217. 10.1145\/280814.280874"},{"key":"e_1_2_2_42_1","volume-title":"Proceedings of SIGGRAPH '99","author":"Yu Y.","unstructured":"Yu , Y. , Debevec , P. , Malik , J. , and Hawkins , T . 1999. Inverse global illumination: recovering reflectance models of real scenes from photographs . Proceedings of SIGGRAPH '99 , 215--224. 10.1145\/311535.311559 Yu, Y., Debevec, P., Malik, J., and Hawkins, T. 1999. Inverse global illumination: recovering reflectance models of real scenes from photographs. Proceedings of SIGGRAPH '99, 215--224. 10.1145\/311535.311559"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1002\/vis.291"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1409060.1409069","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1409060.1409069","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T22:29:49Z","timestamp":1750285789000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1409060.1409069"}},"subtitle":["model-based photograph enhancement and viewing"],"short-title":[],"issued":{"date-parts":[[2008,12]]},"references-count":43,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2008,12]]}},"alternative-id":["10.1145\/1409060.1409069"],"URL":"https:\/\/doi.org\/10.1145\/1409060.1409069","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2008,12]]},"assertion":[{"value":"2008-12-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}