{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T08:43:10Z","timestamp":1774428190397,"version":"3.50.1"},"reference-count":68,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2017,11,20]],"date-time":"2017-11-20T00:00:00Z","timestamp":1511136000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2017,12,31]]},"abstract":"<jats:p>\n            We present an algorithm that enables casual 3D photography. Given a set of input photos captured with a hand-held cell phone or DSLR camera, our algorithm reconstructs a\n            <jats:italic>3D photo<\/jats:italic>\n            , a central panoramic, textured, normal mapped, multi-layered geometric mesh representation. 3D photos can be stored compactly and are optimized for being rendered from viewpoints that are near the capture viewpoints. They can be rendered using a standard rasterization pipeline to produce perspective views with motion parallax. When viewed in VR, 3D photos provide geometrically consistent views for both eyes. Our geometric representation also allows interacting with the scene using 3D geometry-aware effects, such as adding new objects to the scene and artistic lighting effects.\n          <\/jats:p>\n          <jats:p>Our 3D photo reconstruction algorithm starts with a standard structure from motion and multi-view stereo reconstruction of the scene. The dense stereo reconstruction is made robust to the imperfect capture conditions using a novel near envelope cost volume prior that discards erroneous near depth hypotheses. We propose a novel parallax-tolerant stitching algorithm that warps the depth maps into the central panorama and stitches two color-and-depth panoramas for the front and back scene surfaces. The two panoramas are fused into a single non-redundant, well-connected geometric mesh. We provide videos demonstrating users interactively viewing and manipulating our 3D photos.<\/jats:p>","DOI":"10.1145\/3130800.3130828","type":"journal-article","created":{"date-parts":[[2017,11,22]],"date-time":"2017-11-22T16:25:08Z","timestamp":1511367908000},"page":"1-15","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":102,"title":["Casual 3D photography"],"prefix":"10.1145","volume":"36","author":[{"given":"Peter","family":"Hedman","sequence":"first","affiliation":[{"name":"University College London"}]},{"given":"Suhib","family":"Alsisan","sequence":"additional","affiliation":[{"name":"Facebook"}]},{"given":"Richard","family":"Szeliski","sequence":"additional","affiliation":[{"name":"Facebook"}]},{"given":"Johannes","family":"Kopf","sequence":"additional","affiliation":[{"name":"Facebook"}]}],"member":"320","published-online":{"date-parts":[[2017,11,20]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980257"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2014.2377712"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-013-0653-9"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008150329890"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383309"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487228.2487238"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/794190.794659"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237191"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2756549"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the 27th International Conference on Neural Information Processing Systems (NIPS)","author":"Eigen David","year":"2014"},{"key":"e_1_2_1_12_1","unstructured":"Jakob Engel Vladlen Koltun and Daniel Cremers. 2016. Direct Sparse Odometry. arXiv:1607.02565 (2016).  Jakob Engel Vladlen Koltun and Daniel Cremers. 2016. Direct Sparse Odometry. arXiv:1607.02565 (2016)."},{"key":"e_1_2_1_13_1","unstructured":"Facebook. 2016. Facebook Surround 360. https:\/\/facebook360.fb.com\/facebook-surround-360\/. (2016). Accessed: 2016-12-26.  Facebook. 2016. Facebook Surround 360. https:\/\/facebook360.fb.com\/facebook-surround-360\/. (2016). Accessed: 2016-12-26."},{"key":"e_1_2_1_14_1","volume-title":"The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Flynn John","year":"2016"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601163"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.5555\/2854922.2854925"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1561\/0600000052"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2009.161"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.106"},{"key":"e_1_2_1_20_1","doi-asserted-by":"crossref","unstructured":"Cl\u00e9ment Godard Oisin Mac Aodha and Gabriel J. Brostow. 2017. Unsupervised Monocular Depth Estimation with Left-Right Consistency. CVPR (2017).  Cl\u00e9ment Godard Oisin Mac Aodha and Gabriel J. Brostow. 2017. Unsupervised Monocular Depth Estimation with Left-Right Consistency. CVPR (2017).","DOI":"10.1109\/CVPR.2017.699"},{"key":"e_1_2_1_21_1","doi-asserted-by":"crossref","unstructured":"M. Goesele N. Snavely B. Curless H. Hoppe and S.M. Seitz. 2007. Multi-View Stereo for Community Photo Collections. (2007) 1--8.  M. Goesele N. Snavely B. Curless H. Hoppe and S.M. Seitz. 2007. Multi-View Stereo for Community Photo Collections. (2007) 1--8.","DOI":"10.1109\/ICCV.2007.4408933"},{"key":"e_1_2_1_22_1","unstructured":"Google. 2015. Carboard Camera. https:\/\/googleblog.blogspot.com\/2015\/12\/step-inside-your-photos-with-cardboard.html\/. (2015). Accessed: 2016-12-26.  Google. 2015. Carboard Camera. https:\/\/googleblog.blogspot.com\/2015\/12\/step-inside-your-photos-with-cardboard.html\/. (2015). Accessed: 2016-12-26."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2982420"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46487-9_10"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.1990.139591"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2047196.2047270"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995693"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024191"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487228.2487237"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141937"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2004.1262177"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1061"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276497"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508369"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882264"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46487-9_29"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015780"},{"key":"e_1_2_1_38_1","volume-title":"SEAGULL: Seam-Guided Local Alignment for Parallax-Tolerant Image Stitching. 14th European Conference on Computer Vision (ECCV)","author":"Lin Kaimo","year":"2016"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366201"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.13"},{"key":"e_1_2_1_41_1","unstructured":"Ra\u00fal Mur-Artal and Juan D. Tard\u00f3s. 2016. ORB-SLAM2: an Open-Source SLAM System for Monocular Stereo and RGB-D Cameras. arXiv preprint arXiv:1610.06475 (2016).  Ra\u00fal Mur-Artal and Juan D. Tard\u00f3s. 2016. ORB-SLAM2: an Open-Source SLAM System for Monocular Stereo and RGB-D Cameras. arXiv preprint arXiv:1610.06475 (2016)."},{"key":"e_1_2_1_42_1","unstructured":"OpenMVS. 2016. OpenMVS: open Multi-View Stereo reconstruction library. https:\/\/github.com\/cdcseacave\/openMVS. (2016). Accessed: 2016-12-26.  OpenMVS. 2016. OpenMVS: open Multi-View Stereo reconstruction library. https:\/\/github.com\/cdcseacave\/openMVS. (2016). Accessed: 2016-12-26."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.1999.786969"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.910880"},{"key":"e_1_2_1_45_1","unstructured":"Realities. 2017. realities.io | Go Places. http:\/\/realities.io\/. (2017). Accessed: 2017-1-12.  Realities. 2017. realities.io | Go Places. http:\/\/realities.io\/. (2017). Accessed: 2017-1-12."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995372"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.166"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1014573219977"},{"key":"e_1_2_1_49_1","volume-title":"International Conference on Computer Vision Theory and Applications (VISAPP 2009)","author":"Schmitt Frank","year":"2009"},{"key":"e_1_2_1_50_1","volume-title":"Pixelwise View Selection for Unstructured Multi-View Stereo. European Conference on Computer Vision (ECCV)","author":"Sch\u00f6nberger Johannes Lutz","year":"2016"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.19"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/280814.280882"},{"key":"e_1_2_1_53_1","volume-title":"Sixth International Conference on Computer Vision (ICCV '98)","author":"RickSzeliski Harry Shumand","year":"1998"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1561\/0600000009"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICME.2016.7552858"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.158"},{"key":"e_1_2_1_57_1","volume-title":"DeMoN:Depth and Motion Network for Learning Monocular Stereo. IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Ummenhofer Benjamin","year":"2017"},{"key":"e_1_2_1_58_1","unstructured":"Valve. 2016. Valve Developer Community: Advanced Outdoors Photogrammetry. https:\/\/developer.valvesoftware.com\/wiki\/Destinations\/Advanced_Outdoors_Photogrammetry. (2016). Accessed: 2016-11-3.  Valve. 2016. Valve Developer Community: Advanced Outdoors Photogrammetry. https:\/\/developer.valvesoftware.com\/wiki\/Destinations\/Advanced_Outdoors_Photogrammetry. (2016). Accessed: 2016-11-3."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.70712"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2999533"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10602-1_54"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DV.2016.20"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995388"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.218"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.303"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.423"},{"key":"e_1_2_1_67_1","volume-title":"Casual Stereoscopic Panorama Stitching. IEEE Conference on Computer Vision and Pattern Recognition (CVPR '15)","author":"Zhang Fan","year":"2015"},{"key":"e_1_2_1_68_1","volume-title":"Layered Depth Panoramas. IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2007)","author":"Zheng Ke Colin","year":"2007"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015766"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3130800.3130828","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3130800.3130828","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:26:17Z","timestamp":1750213577000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3130800.3130828"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,11,20]]},"references-count":68,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2017,12,31]]}},"alternative-id":["10.1145\/3130800.3130828"],"URL":"https:\/\/doi.org\/10.1145\/3130800.3130828","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,11,20]]},"assertion":[{"value":"2017-11-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}