{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,18]],"date-time":"2026-02-18T23:48:28Z","timestamp":1771458508623,"version":"3.50.1"},"reference-count":68,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2019,11,8]],"date-time":"2019-11-08T00:00:00Z","timestamp":1573171200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2019,12,31]]},"abstract":"<jats:p>\n            Designing a fully integrated 360\u00b0 video camera supporting 6DoF head motion parallax requires overcoming many technical hurdles, including camera placement, optical design, sensor resolution, system calibration, real-time video capture, depth reconstruction, and real-time novel view synthesis. While there is a large body of work describing various system components, such as multi-view depth estimation, our paper is the first to describe a complete, reproducible system that considers the challenges arising when designing, building, and deploying a full end-to-end 6DoF video camera and playback environment. Our system includes a computational imaging software pipeline supporting online markerless calibration, high-quality reconstruction, and real-time streaming and rendering. Most of our exposition is based on a professional 16-camera configuration, which will be commercially available to film producers. However, our software pipeline is generic and can handle a variety of camera geometries and configurations. The entire calibration and reconstruction software pipeline along with example datasets is open sourced to encourage follow-up research in high-quality 6DoF video reconstruction and rendering\n            <jats:sup>1<\/jats:sup>\n            .\n          <\/jats:p>","DOI":"10.1145\/3355089.3356555","type":"journal-article","created":{"date-parts":[[2019,11,8]],"date-time":"2019-11-08T20:27:58Z","timestamp":1573244878000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":51,"title":["An integrated 6DoF video camera and system design"],"prefix":"10.1145","volume":"38","author":[{"given":"Albert Parra","family":"Pozo","sequence":"first","affiliation":[{"name":"Facebook Inc."}]},{"given":"Michael","family":"Toksvig","sequence":"additional","affiliation":[{"name":"Facebook Inc."}]},{"given":"Terry Filiba","family":"Schrager","sequence":"additional","affiliation":[{"name":"Facebook Inc."}]},{"given":"Joyce","family":"Hsu","sequence":"additional","affiliation":[{"name":"Facebook Inc."}]},{"given":"Uday","family":"Mathur","sequence":"additional","affiliation":[{"name":"RED Digital Cinema"}]},{"given":"Alexander","family":"Sorkine-Hornung","sequence":"additional","affiliation":[{"name":"Facebook Inc."}]},{"given":"Rick","family":"Szeliski","sequence":"additional","affiliation":[{"name":"Facebook Inc."}]},{"given":"Brian","family":"Cabral","sequence":"additional","affiliation":[{"name":"Facebook Inc."}]}],"member":"320","published-online":{"date-parts":[[2019,11,8]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11265-012-0668-4"},{"key":"e_1_2_2_2_1","unstructured":"Sameer Agarwal Keir Mierle et al. 2012. Ceres solver. (2012)."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980257"},{"key":"e_1_2_2_4_1","volume-title":"Motion parallax from microscopic head movements during visual fixation. Vision research 70","author":"Aytekin Murat","year":"2012","unstructured":"Murat Aytekin and Michele Rucci. 2012. Motion parallax from microscopic head movements during visual fixation. Vision research 70 (2012), 7--17."},{"key":"e_1_2_2_5_1","volume-title":"International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences 38, 5\/W16","author":"Barazzetti Luigi","year":"2011","unstructured":"Luigi Barazzetti, Luigi Mussio, Fabio Remondino, and Marco Scaioni. 2011. Targetless camera calibration. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences 38, 5\/W16 (2011), 8."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1576246.1531330"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073272"},{"key":"e_1_2_2_8_1","volume-title":"Neill DF Campbell, and Christian Richardt","author":"Bertel Tobias","year":"2019","unstructured":"Tobias Bertel, Neill DF Campbell, and Christian Richardt. 2019. MegaParallax: Casual 360\u00b0 Panoramas with Motion Parallax. IEEE transactions on visualization and computer graphics 25, 5 (2019), 1828--1835."},{"key":"e_1_2_2_9_1","first-page":"1","article-title":"PatchMatch Stereo-Stereo Matching with Slanted Support Windows","volume":"11","author":"Bleyer Michael","year":"2011","unstructured":"Michael Bleyer, Christoph Rhemann, and Carsten Rother. 2011. PatchMatch Stereo-Stereo Matching with Slanted Support Windows. In Bmvc, Vol. 11. 1--11.","journal-title":"Bmvc"},{"key":"e_1_2_2_10_1","volume-title":"2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE, 1570--1577","author":"Bleyer Michael","year":"2010","unstructured":"Michael Bleyer, Carsten Rother, and Pushmeet Kohli. 2010. Surface stereo with soft segmentation. In 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE, 1570--1577."},{"key":"e_1_2_2_11_1","volume-title":"The OpenCV Library. Dr. Dobb's Journal of Software Tools","author":"Bradski Gary","year":"2000","unstructured":"Gary Bradski. 2000. The OpenCV Library. Dr. Dobb's Journal of Software Tools (2000)."},{"key":"e_1_2_2_12_1","volume-title":"Cohen","author":"Buehler Chris","year":"2001","unstructured":"Chris Buehler, Michael Bosse, Leonard McMillan, Steven J. Gortler, and Michael F. Cohen. 2001. Unstructured Lumigraph Rendering. In ACM SIGGRAPH 2001 Conference Proceedings, Eugene Fiume (Ed.). ACM Press \/ ACM SIGGRAPH, 425--432."},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2015.2389617"},{"key":"e_1_2_2_14_1","volume-title":"StereoDRNet: Dilated Residual StereoNet. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Chabra Rohan","year":"2019","unstructured":"Rohan Chabra, Julian Straub, Christopher Sweeney, Richard Newcombe, and Henry Fuchs. 2019. StereoDRNet: Dilated Residual StereoNet. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_15_1","unstructured":"VR Circle. 2018. VR Movies in 360 Degree Virtual Reality. https:\/\/www.vrcircle.com\/virtual-reality-360-degree-movies\/. (2018). Accessed: 2019-05-18."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766945"},{"key":"e_1_2_2_17_1","volume-title":"2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06)","volume":"1","author":"Criminisi Antonio","year":"2006","unstructured":"Antonio Criminisi, Geoffrey Cross, Andrew Blake, and Vladimir Kolmogorov. 2006. Bilayer segmentation of live video. In 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06), Vol. 1. IEEE, 53--60."},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-019-01183-3"},{"key":"e_1_2_2_19_1","unstructured":"Disney. 2008. Circle-Vision 360\u00b0. https:\/\/disney.fandom.com\/wiki\/Circle-Vision_360. (2008). Accessed: 2019-05-18."},{"key":"e_1_2_2_20_1","volume-title":"Disney Movies VR","unstructured":"Disney. 2016. Disney Movies VR. http:\/\/www.disneymoviesvr.com\/. (2016). Accessed: 2019-05-18."},{"key":"e_1_2_2_21_1","volume-title":"Learning Non-Volumetric Depth Fusion Using Successive Reprojections. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Donne Simon","year":"2019","unstructured":"Simon Donne and Andreas Geiger. 2019. Learning Non-Volumetric Depth Fusion Using Successive Reprojections. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.228"},{"key":"e_1_2_2_23_1","doi-asserted-by":"crossref","unstructured":"Facebook. 2016. Facebook Surround 360. https:\/\/facebook360.fb.com\/. (2016). Accessed: 2016-12-26.","DOI":"10.1016\/S0969-4765(16)30020-0"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237200"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.213"},{"key":"e_1_2_2_26_1","unstructured":"Eugene Hecht et al. 2002. Optics. Reading Mass.: Addison-Wesley ."},{"key":"e_1_2_2_27_1","volume-title":"ACM Transactions on Graphics (Proc. SIGGRAPH Asia) 36, 6","author":"Hedman Peter","year":"2017","unstructured":"Peter Hedman, Suhib Alsisan, Richard Szeliski, and Johannes Kopf. 2017. Casual 3D Photography. ACM Transactions on Graphics (Proc. SIGGRAPH Asia) 36, 6 (2017), 234:1--234:15."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2982420"},{"key":"e_1_2_2_29_1","unstructured":"Carlos Hernandez. 2016. Capture and share VR photos with Cardboard Camera now on iOS. https:\/\/www.blog.google\/products\/cardboard\/cardboard-camera-ios\/. (2016)."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.1990.139591"},{"key":"e_1_2_2_31_1","volume-title":"Modelling and automated calibration of a general multi-projective camera. The Photogrammetric Record (Mar","author":"Khoramshahi Ehsan","year":"2018","unstructured":"Ehsan Khoramshahi and Eija Honkavaara. 2018. Modelling and automated calibration of a general multi-projective camera. The Photogrammetric Record (Mar 2018), 86--112."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.5555\/645317.756415"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130836"},{"key":"e_1_2_2_34_1","volume-title":"First-person Hyperlapse Videos. ACM Transactions on Graphics (Proc. SIGGRAPH 2014)","author":"Kopf Johannes","year":"2014","unstructured":"Johannes Kopf, Michael Cohen, and Richard Szeliski. 2014. First-person Hyperlapse Videos. ACM Transactions on Graphics (Proc. SIGGRAPH 2014) 33, 4 (August 2014)."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237199"},{"key":"e_1_2_2_36_1","volume-title":"Video object segmentation without temporal information","author":"Maninis K-K","year":"2018","unstructured":"K-K Maninis, Sergi Caelles, Yuhua Chen, Jordi Pont-Tuset, Laura Leal-Taix\u00e9, Daniel Cremers, and Luc Van Gool. 2018. Video object segmentation without temporal information. IEEE transactions on pattern analysis and machine intelligence 41, 6 (2018), 1515--1530."},{"key":"e_1_2_2_37_1","unstructured":"Kevin Matzen Michael F. Cohen Bryce Evans Johannes Kopf and Richard Szeliski."},{"key":"e_1_2_2_38_1","doi-asserted-by":"crossref","unstructured":"2017. Low-cost 360 Stereo Photography and Video Capture. ACM Trans. Graph. 36 4 Article 148 (July 2017) 12 pages.","DOI":"10.1145\/3072959.3073645"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3322980"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3089269.3089283"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275031"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.910880"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130855"},{"key":"e_1_2_2_44_1","volume-title":"Megastereo: Constructing High-Resolution Stereo Panoramas. IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2013)","author":"Richardt Christian","year":"2013","unstructured":"Christian Richardt, Yael Pritch, Henning Zimmer, and Alexander Sorkine-Hornung. 2013. Megastereo: Constructing High-Resolution Stereo Panoramas. IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2013) (2013), 1256--1263."},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cpc.2018.03.029"},{"key":"e_1_2_2_46_1","volume-title":"A Comparative Analysis Of Cross-Correlation Matching Algorithms Using a Pyramidal Resolution Approach. (05","author":"Roma Nuno","year":"2002","unstructured":"Nuno Roma, Jos\u00e9 Santos-Victor, and Jos\u00e9 Tom\u00e9. 2002. A Comparative Analysis Of Cross-Correlation Matching Algorithms Using a Pyramidal Resolution Approach. (05 2002)."},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46487-9_31"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3225150"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311573"},{"key":"e_1_2_2_51_1","volume-title":"Pushing the Boundaries of View Extrapolation With Multi-plane Images. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Srinivasan Pratul P.","year":"2019","unstructured":"Pratul P. Srinivasan, Richard Tucker, Jonathan T. Barron, Ravi Ramamoorthi, Ren Ng, and Noah Snavely. 2019. Pushing the Boundaries of View Extrapolation With Multi-plane Images. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICME.2016.7552858"},{"key":"e_1_2_2_53_1","volume-title":"Real-Time Self-Adaptive Deep Stereo. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Tonioni Alessio","year":"2019","unstructured":"Alessio Tonioni, Fabio Tosi, Matteo Poggi, Stefano Mattoccia, and Luigi Di Stefano. 2019. Real-Time Self-Adaptive Deep Stereo. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_54_1","volume-title":"Wallflower: Principles and Practice of Background Maintenance. In Seventh International Conference on Computer Vision (ICCV'99)","author":"Toyama Kentaro","year":"1999","unstructured":"Kentaro Toyama, John Krumm, Barry Brumitt, and Brian Meyers. 1999. Wallflower: Principles and Practice of Background Maintenance. In Seventh International Conference on Computer Vision (ICCV'99). 255--261."},{"key":"e_1_2_2_55_1","volume-title":"Fitzgibbon","author":"Triggs Bill","year":"1999","unstructured":"Bill Triggs, Philip F. McLauchlan, Richard I. Hartley, and Andrew W. Fitzgibbon. 1999. Bundle Adjustment --- A Modern Synthesis. In International Workshop on Vision Algorithms. Springer, 298--372."},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2004.1297011"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2999533"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2003.819861"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-27355-1_72"},{"key":"e_1_2_2_60_1","unstructured":"Eric W. Weisstein. 1998. Thomson Problem. (1998). http:\/\/mathworld.wolfram.com\/ThomsonProblem.html Visited on 19\/05\/16."},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2009.131"},{"key":"e_1_2_2_62_1","volume-title":"2008 IEEE Conference on Computer Vision and Pattern Recognition. 1--8.","author":"Wu Changchang","unstructured":"Changchang Wu, B. Clipp, Xiaowei Li, J. Frahm, and M. Pollefeys. 2008. 3D model matching with Viewpoint-Invariant Patches (VIP). In 2008 IEEE Conference on Computer Vision and Pattern Recognition. 1--8."},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323007"},{"key":"e_1_2_2_64_1","volume-title":"Hierarchical Deep Stereo Matching on High-Resolution Images. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Yang Gengshan","year":"2019","unstructured":"Gengshan Yang, Joshua Manela, Michael Happold, and Deva Ramanan. 2019. Hierarchical Deep Stereo Matching on High-Resolution Images. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_65_1","volume-title":"Video Object Segmentation and Tracking: A Survey. arXiv preprint arXiv:1904.09172","author":"Yao Rui","year":"2019","unstructured":"Rui Yao, Guosheng Lin, Shixiong Xia, Jiaqi Zhao, and Yong Zhou. 2019a. Video Object Segmentation and Tracking: A Survey. arXiv preprint arXiv:1904.09172 (2019)."},{"key":"e_1_2_2_66_1","volume-title":"Recurrent MVSNet for High-Resolution Multi-View Stereo Depth Inference. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Yao Yao","year":"2019","unstructured":"Yao Yao, Zixin Luo, Shiwei Li, Tianwei Shen, Tian Fang, and Long Quan. 2019b. Recurrent MVSNet for High-Resolution Multi-View Stereo Depth Inference. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_67_1","volume-title":"GA-Net: Guided Aggregation Net for End-To-End Stereo Matching. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Zhang Feihu","unstructured":"Feihu Zhang, Victor Prisacariu, Ruigang Yang, and Philip H.S. Torr. 2019. GA-Net: Guided Aggregation Net for End-To-End Stereo Matching. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.196"},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186562.1015766"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3355089.3356555","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3355089.3356555","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:41Z","timestamp":1750203881000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3355089.3356555"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,8]]},"references-count":68,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2019,12,31]]}},"alternative-id":["10.1145\/3355089.3356555"],"URL":"https:\/\/doi.org\/10.1145\/3355089.3356555","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,8]]},"assertion":[{"value":"2019-11-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}