{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,5]],"date-time":"2025-12-05T12:14:44Z","timestamp":1764936884279,"version":"3.41.0"},"reference-count":50,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2017,1,6]],"date-time":"2017-01-06T00:00:00Z","timestamp":1483660800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100010976","name":"Intel Visual Computing Institute","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100010976","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100006112","name":"Microsoft Research","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100006112","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2017,2,28]]},"abstract":"<jats:p>\n            The ultimate goal of many image-based modeling systems is to render photo-realistic novel views of a scene without visible artifacts. Existing evaluation metrics and benchmarks focus mainly on the geometric accuracy of the reconstructed model, which is, however, a poor predictor of visual accuracy. Furthermore, using only geometric accuracy by itself does not allow evaluating systems that either lack a geometric scene representation or utilize coarse proxy geometry. Examples include a light field and most image-based rendering systems. We propose a unified evaluation approach based on novel view prediction error that is able to analyze the visual quality of\n            <jats:italic>any<\/jats:italic>\n            method that can render novel views from input images. One key advantage of this approach is that it does not require ground truth geometry. This dramatically simplifies the creation of test datasets and benchmarks. It also allows us to evaluate the quality of an unknown scene during the acquisition and reconstruction process, which is useful for acquisition planning. We evaluate our approach on a range of methods, including standard geometry-plus-texture pipelines as well as image-based rendering techniques, compare it to existing geometry-based benchmarks, demonstrate its utility for a range of use cases, and present a new virtual rephotography-based benchmark for image-based modeling and rendering systems.\n          <\/jats:p>","DOI":"10.1145\/2999533","type":"journal-article","created":{"date-parts":[[2017,1,9]],"date-time":"2017-01-09T13:19:08Z","timestamp":1483967948000},"page":"1-11","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":31,"title":["Virtual Rephotography"],"prefix":"10.1145","volume":"36","author":[{"given":"Michael","family":"Waechter","sequence":"first","affiliation":[{"name":"Technische Universit\u00e4t Darmstadt, Darmstadt, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mate","family":"Beljan","sequence":"additional","affiliation":[{"name":"Technische Universit\u00e4t Darmstadt, Darmstadt, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Simon","family":"Fuhrmann","sequence":"additional","affiliation":[{"name":"Technische Universit\u00e4t Darmstadt, Darmstadt, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nils","family":"Moehrle","sequence":"additional","affiliation":[{"name":"Technische Universit\u00e4t Darmstadt, Darmstadt, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Johannes","family":"Kopf","sequence":"additional","affiliation":[{"name":"Facebook"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Goesele","sequence":"additional","affiliation":[{"name":"Technische Universit\u00e4t Darmstadt, Darmstadt, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,1,6]]},"reference":[{"doi-asserted-by":"publisher","key":"e_1_2_2_1_1","DOI":"10.1007\/s11263-016-0902-9"},{"doi-asserted-by":"publisher","key":"e_1_2_2_2_1","DOI":"10.1145\/1399504.1360668"},{"doi-asserted-by":"publisher","key":"e_1_2_2_3_1","DOI":"10.1145\/1805964.1805968"},{"doi-asserted-by":"publisher","key":"e_1_2_2_4_1","DOI":"10.1007\/s11263-010-0390-2"},{"doi-asserted-by":"publisher","key":"e_1_2_2_5_1","DOI":"10.1109\/ISCE.2010.5523697"},{"doi-asserted-by":"publisher","key":"e_1_2_2_6_1","DOI":"10.1145\/383259.383309"},{"key":"e_1_2_2_7_1","volume-title":"Mundy","author":"Calakli Fatih","year":"2012","unstructured":"Fatih Calakli , Ali O. Ulusoy , Maria I. Restrepo , Gabriel Taubin , and Joseph L . Mundy . 2012 . High resolution surface reconstruction from multi-view aerial imagery. In 3DIMPVT. Fatih Calakli, Ali O. Ulusoy, Maria I. Restrepo, Gabriel Taubin, and Joseph L. Mundy. 2012. High resolution surface reconstruction from multi-view aerial imagery. In 3DIMPVT."},{"doi-asserted-by":"publisher","key":"e_1_2_2_8_1","DOI":"10.1007\/978-3-540-88682-2_58"},{"doi-asserted-by":"crossref","unstructured":"Scott Daly. 1993. The visible differences predictor: An algorithm for the assessment of image fidelity. In Digital Images and Human Vision.  Scott Daly. 1993. The visible differences predictor: An algorithm for the assessment of image fidelity. In Digital Images and Human Vision.","key":"e_1_2_2_9_1","DOI":"10.1117\/12.135952"},{"doi-asserted-by":"publisher","key":"e_1_2_2_10_1","DOI":"10.1007\/s11263-005-6643-9"},{"key":"e_1_2_2_11_1","volume-title":"Workshop on Performance Characteristics of Vision Algorithms.","author":"F\u00f6rstner Wolfgang","year":"1996","unstructured":"Wolfgang F\u00f6rstner . 1996 . 10 pros and cons against performance characterization of vision algorithms . In Workshop on Performance Characteristics of Vision Algorithms. Wolfgang F\u00f6rstner. 1996. 10 pros and cons against performance characterization of vision algorithms. In Workshop on Performance Characteristics of Vision Algorithms."},{"doi-asserted-by":"publisher","key":"e_1_2_2_12_1","DOI":"10.1145\/2024156.2024182"},{"key":"e_1_2_2_13_1","volume-title":"MVE -- An image-based reconstruction environment. Computers 8 Graphics 53, Part A","author":"Fuhrmann Simon","year":"2015","unstructured":"Simon Fuhrmann , Fabian Langguth , Nils Moehrle , Michael Waechter , and Michael Goesele . 2015. MVE -- An image-based reconstruction environment. Computers 8 Graphics 53, Part A ( 2015 ). Simon Fuhrmann, Fabian Langguth, Nils Moehrle, Michael Waechter, and Michael Goesele. 2015. MVE -- An image-based reconstruction environment. Computers 8 Graphics 53, Part A (2015)."},{"doi-asserted-by":"publisher","key":"e_1_2_2_14_1","DOI":"10.1109\/CVPR.2010.5539802"},{"doi-asserted-by":"publisher","key":"e_1_2_2_15_1","DOI":"10.1109\/TPAMI.2009.161"},{"doi-asserted-by":"publisher","key":"e_1_2_2_16_1","DOI":"10.1109\/ICCV.2007.4408933"},{"doi-asserted-by":"publisher","key":"e_1_2_2_17_1","DOI":"10.1145\/237170.237200"},{"doi-asserted-by":"publisher","key":"e_1_2_2_18_1","DOI":"10.1109\/3DTV.2016.7548891"},{"doi-asserted-by":"publisher","key":"e_1_2_2_19_1","DOI":"10.1109\/CVPR.2009.5206753"},{"doi-asserted-by":"publisher","key":"e_1_2_2_20_1","DOI":"10.1109\/MCG.2004.8"},{"key":"e_1_2_2_21_1","volume-title":"Multi-view reconstruction using band graph-cuts. Journal of Computer-Aided Design 8 Computer Graphics 4","author":"Hongxing Yuan","year":"2010","unstructured":"Yuan Hongxing , Guo Li , Yu Li , and Cheng Long . 2010. Multi-view reconstruction using band graph-cuts. Journal of Computer-Aided Design 8 Computer Graphics 4 ( 2010 ). Yuan Hongxing, Guo Li, Yu Li, and Cheng Long. 2010. Multi-view reconstruction using band graph-cuts. Journal of Computer-Aided Design 8 Computer Graphics 4 (2010)."},{"doi-asserted-by":"publisher","key":"e_1_2_2_22_1","DOI":"10.5244\/C.26.70"},{"key":"e_1_2_2_23_1","volume-title":"Computer Vision Winter Workshop.","author":"Hoppe Christof","year":"2012","unstructured":"Christof Hoppe , Andreas Wendel , Stefanie Zollmann , Katrin Pirker , Arnold Irschara , Horst Bischof , and Stefan Kluckner . 2012 b. Photogrammetric camera network design for micro aerial vehicles . In Computer Vision Winter Workshop. Christof Hoppe, Andreas Wendel, Stefanie Zollmann, Katrin Pirker, Arnold Irschara, Horst Bischof, and Stefan Kluckner. 2012b. Photogrammetric camera network design for micro aerial vehicles. In Computer Vision Winter Workshop."},{"unstructured":"Michael Kazhdan Matthew Bolitho and Hugues Hoppe. 2006. Poisson surface reconstruction. In SGP.  Michael Kazhdan Matthew Bolitho and Hugues Hoppe. 2006. Poisson surface reconstruction. In SGP.","key":"e_1_2_2_24_1"},{"doi-asserted-by":"publisher","key":"e_1_2_2_25_1","DOI":"10.1145\/2601097.2601195"},{"doi-asserted-by":"publisher","key":"e_1_2_2_26_1","DOI":"10.1007\/3-540-45054-8_19"},{"doi-asserted-by":"publisher","key":"e_1_2_2_27_1","DOI":"10.1145\/237170.237199"},{"doi-asserted-by":"publisher","key":"e_1_2_2_28_1","DOI":"10.1117\/12.2008369"},{"key":"e_1_2_2_29_1","volume-title":"Allan G. Rempel, and Wolfgang Heidrich.","author":"Mantiuk Rafa\u0142","year":"2011","unstructured":"Rafa\u0142 Mantiuk , Kil Joong Kim , Allan G. Rempel, and Wolfgang Heidrich. 2011 . HDR-VDP-2: A calibrated visual metric for visibility and quality predictions in all luminance conditions. In SIGGRAPH. Rafa\u0142 Mantiuk, Kil Joong Kim, Allan G. Rempel, and Wolfgang Heidrich. 2011. HDR-VDP-2: A calibrated visual metric for visibility and quality predictions in all luminance conditions. In SIGGRAPH."},{"doi-asserted-by":"publisher","key":"e_1_2_2_30_1","DOI":"10.1109\/ICCV.2007.4408984"},{"doi-asserted-by":"publisher","key":"e_1_2_2_31_1","DOI":"10.1145\/566570.566636"},{"doi-asserted-by":"publisher","key":"e_1_2_2_32_1","DOI":"10.1109\/TIP.2014.2302684"},{"doi-asserted-by":"crossref","unstructured":"Ganesh Ramanarayanan James Ferwerda Bruce Walter and Kavita Bala. 2007. Visual equivalence: Towards a new standard for image fidelity. In SIGGRAPH.  Ganesh Ramanarayanan James Ferwerda Bruce Walter and Kavita Bala. 2007. Visual equivalence: Towards a new standard for image fidelity. In SIGGRAPH.","key":"e_1_2_2_33_1","DOI":"10.1145\/1275808.1276472"},{"doi-asserted-by":"publisher","key":"e_1_2_2_34_1","DOI":"10.1145\/1620993.1621012"},{"doi-asserted-by":"publisher","key":"e_1_2_2_35_1","DOI":"10.1109\/CVPR.2006.19"},{"key":"e_1_2_2_36_1","volume-title":"Seitz","author":"Shan Qi","year":"2013","unstructured":"Qi Shan , Riley Adams , Brian Curless , Yasutaka Furukawa , and Steven M . Seitz . 2013 . The visual Turing test for scene reconstruction. In 3DV. Qi Shan, Riley Adams, Brian Curless, Yasutaka Furukawa, and Steven M. Seitz. 2013. The visual Turing test for scene reconstruction. In 3DV."},{"doi-asserted-by":"crossref","unstructured":"Noah Snavely Steven M. Seitz and Richard Szeliski. 2006. Photo tourism: Exploring photo collections in 3D. In SIGGRAPH.  Noah Snavely Steven M. Seitz and Richard Szeliski. 2006. Photo tourism: Exploring photo collections in 3D. In SIGGRAPH.","key":"e_1_2_2_37_1","DOI":"10.1145\/1179352.1141964"},{"doi-asserted-by":"publisher","key":"e_1_2_2_38_1","DOI":"10.1109\/CVPR.2008.4587706"},{"doi-asserted-by":"publisher","key":"e_1_2_2_39_1","DOI":"10.1109\/ICCV.1999.790301"},{"doi-asserted-by":"publisher","key":"e_1_2_2_40_1","DOI":"10.1145\/2506206.2501601"},{"doi-asserted-by":"crossref","unstructured":"Kathleen Tuite Noah Snavely Dun-yu Hsiao Nadine Tabing and Zoran Popovi\u0107. 2011. PhotoCity: Training experts at large-scale image acquisition through a competitive game. In SIGCHI.  Kathleen Tuite Noah Snavely Dun-yu Hsiao Nadine Tabing and Zoran Popovi\u0107. 2011. PhotoCity: Training experts at large-scale image acquisition through a competitive game. In SIGCHI.","key":"e_1_2_2_41_1","DOI":"10.1145\/1978942.1979146"},{"doi-asserted-by":"publisher","key":"e_1_2_2_42_1","DOI":"10.1111\/j.1467-8659.2011.01983.x"},{"doi-asserted-by":"publisher","key":"e_1_2_2_43_1","DOI":"10.1145\/2461912.2461971"},{"doi-asserted-by":"publisher","key":"e_1_2_2_44_1","DOI":"10.1007\/s00371-015-1124-9"},{"doi-asserted-by":"crossref","unstructured":"Michael Waechter Nils Moehrle and Michael Goesele. 2014. Let there be color! Large-scale texturing of 3D reconstructions. In ECCV.  Michael Waechter Nils Moehrle and Michael Goesele. 2014. Let there be color! Large-scale texturing of 3D reconstructions. In ECCV.","key":"e_1_2_2_45_1","DOI":"10.1007\/978-3-319-10602-1_54"},{"doi-asserted-by":"publisher","key":"e_1_2_2_46_1","DOI":"10.1109\/TIP.2003.819861"},{"key":"e_1_2_2_47_1","volume-title":"Turner","author":"Webb Robert H.","year":"2010","unstructured":"Robert H. Webb , Diane E. Boyer , and Raymond M . Turner . 2010 . Repeat Photography. Island Press . Robert H. Webb, Diane E. Boyer, and Raymond M. Turner. 2010. Repeat Photography. Island Press."},{"unstructured":"Yizhou Yu Paul Debevec Jitendra Malik and Tim Hawkins. 1999. Inverse global illumination: Recovering reflectance models of real scenes from photographs. In SIGGRAPH.  Yizhou Yu Paul Debevec Jitendra Malik and Tim Hawkins. 1999. Inverse global illumination: Recovering reflectance models of real scenes from photographs. In SIGGRAPH.","key":"e_1_2_2_48_1"},{"doi-asserted-by":"publisher","key":"e_1_2_2_49_1","DOI":"10.1007\/BFb0028345"},{"doi-asserted-by":"publisher","key":"e_1_2_2_50_1","DOI":"10.1145\/383259.383300"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2999533","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2999533","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:38:41Z","timestamp":1750221521000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2999533"}},"subtitle":["Novel View Prediction Error for 3D Reconstruction"],"short-title":[],"issued":{"date-parts":[[2017,1,6]]},"references-count":50,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2017,2,28]]}},"alternative-id":["10.1145\/2999533"],"URL":"https:\/\/doi.org\/10.1145\/2999533","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"type":"print","value":"0730-0301"},{"type":"electronic","value":"1557-7368"}],"subject":[],"published":{"date-parts":[[2017,1,6]]},"assertion":[{"value":"2015-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-09-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-01-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}