{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,25]],"date-time":"2026-01-25T22:27:16Z","timestamp":1769380036128,"version":"3.49.0"},"reference-count":39,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2018,6,30]],"date-time":"2018-06-30T00:00:00Z","timestamp":1530316800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2018,6,30]]},"abstract":"<jats:p>In this article, we describe a complete pipeline for the capture and display of real-world Virtual Reality video content, based on the concept of omnistereoscopic panoramas. We address important practical and theoretical issues that have remained undiscussed in previous works. On the capture side, we show how high-quality omnistereo video can be generated from a sparse set of cameras (16 in our prototype array) instead of the hundreds of input views previously required. Despite the sparse number of input views, our approach allows for high quality, real-time virtual head motion, thereby providing an important additional cue for immersive depth perception compared to static stereoscopic video. We also provide an in-depth analysis of the required camera array geometry in order to meet specific stereoscopic output constraints, which is fundamental for achieving a plausible and fully controlled VR viewing experience. Finally, we describe additional insights on how to integrate omnistereo video panoramas with rendered CG content. We provide qualitative comparisons to alternative solutions, including depth-based view synthesis and the Facebook Surround 360 system. In summary, this article provides a first complete guide and analysis for reimplementing a system for capturing and displaying real-world VR, which we demonstrate on several real-world examples captured with our prototype.<\/jats:p>","DOI":"10.1145\/3225150","type":"journal-article","created":{"date-parts":[[2018,8,1]],"date-time":"2018-08-01T18:47:07Z","timestamp":1533149227000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":26,"title":["An Omnistereoscopic Video Pipeline for Capture and Display of Real-World VR"],"prefix":"10.1145","volume":"37","author":[{"given":"Christopher","family":"Schroers","sequence":"first","affiliation":[{"name":"Disney Research, Z\u00fcrich, Schweiz"}]},{"given":"Jean-Charles","family":"Bazin","sequence":"additional","affiliation":[{"name":"KAIST, Daejeon, South Korea"}]},{"given":"Alexander","family":"Sorkine-Hornung","sequence":"additional","affiliation":[{"name":"Disney Research, Z\u00fcrich, Schweiz"}]}],"member":"320","published-online":{"date-parts":[[2018,8]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141966"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980257"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12289"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-006-0002-3"},{"key":"e_1_2_1_5_1","doi-asserted-by":"crossref","unstructured":"Thomas Brox Andr\u00e9s Bruhn Nils Papenberg and Joachim Weickert. 2004. High accuracy optical flow estimation based on a theory for warping. In ECCV. 25--36.  Thomas Brox Andr\u00e9s Bruhn Nils Papenberg and Joachim Weickert. 2004. High accuracy optical flow estimation based on a theory for warping. In ECCV. 25--36.","DOI":"10.1007\/978-3-540-24673-2_3"},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Vincent Chapdelaine-Couture and S\u00e9bastien Roy. 2013. The omnipolar camera: A new approach to stereo immersive capture. In ICCP. 1--9.  Vincent Chapdelaine-Couture and S\u00e9bastien Roy. 2013. The omnipolar camera: A new approach to stereo immersive capture. In ICCP. 1--9.","DOI":"10.1109\/ICCPhot.2013.6528311"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126376"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383296"},{"key":"e_1_2_1_9_1","volume-title":"Eurographics Workshop on Graphics and Cultural Heritage.","author":"Fuhrmann Simon","year":"2014","unstructured":"Simon Fuhrmann , Fabian Langguth , and Michael Goesele . 2014 . MVE -- A multi-view reconstruction environment . In Eurographics Workshop on Graphics and Cultural Heritage. Simon Fuhrmann, Fabian Langguth, and Michael Goesele. 2014. MVE -- A multi-view reconstruction environment. In Eurographics Workshop on Graphics and Cultural Heritage."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2009.161"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.106"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.615446"},{"key":"e_1_2_1_13_1","volume-title":"Multiple View Geometry in Computer Vision","author":"Hartley Richard","unstructured":"Richard Hartley and Andrew Zisserman . 2004. Multiple View Geometry in Computer Vision . Cambridge University Press . Richard Hartley and Andrew Zisserman. 2004. Multiple View Geometry in Computer Vision. Cambridge University Press."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130828"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1166"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.121792"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.70729"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778833"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276494"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925983"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073645"},{"key":"e_1_2_1_23_1","unstructured":"Shmuel Peleg and Moshe Ben-Ezra. 1999. Stereo panorama with a single camera. In CVPR. 1395--1401.  Shmuel Peleg and Moshe Ben-Ezra. 1999. Stereo panorama with a single camera. In CVPR. 1395--1401."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.910880"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12541"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-007-0101-9"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.166"},{"key":"e_1_2_1_28_1","volume-title":"Eurographics Symposium on Rendering Techniques (EGSR). 83--92","author":"Rom\u00e1n Augusto","unstructured":"Augusto Rom\u00e1n and Hendrik P. A. Lensch . 2006. Automatic multiperspective images . In Eurographics Symposium on Rendering Techniques (EGSR). 83--92 . Augusto Rom\u00e1n and Hendrik P. A. Lensch. 2006. Automatic multiperspective images. In Eurographics Symposium on Rendering Techniques (EGSR). 83--92."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1014851111084"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311573"},{"key":"e_1_2_1_31_1","doi-asserted-by":"crossref","unstructured":"Harry Shum and Sing Bing Kang. 2000. Review of image-based rendering techniques. In Visual Communications and Image Processing. 2--13.  Harry Shum and Sing Bing Kang. 2000. Review of image-based rendering techniques. In Visual Communications and Image Processing. 2--13.","DOI":"10.1117\/12.386541"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2004.840591"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008195814169"},{"key":"e_1_2_1_34_1","volume-title":"Pawlicki","author":"Simon Andreas","year":"2004","unstructured":"Andreas Simon , Randall C. Smith , and Richard R . Pawlicki . 2004 . Omnistereo for panoramic virtual environment display systems. In IEEE VR. 67--74. Andreas Simon, Randall C. Smith, and Richard R. Pawlicki. 2004. Omnistereo for panoramic virtual environment display systems. In IEEE VR. 67--74."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1561\/0600000009"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.423"},{"key":"e_1_2_1_37_1","doi-asserted-by":"crossref","unstructured":"Fan Zhang and Feng Liu. 2015. Casual stereoscopic panorama stitching. In CVPR. 2002--2010.  Fan Zhang and Feng Liu. 2015. Casual stereoscopic panorama stitching. In CVPR. 2002--2010.","DOI":"10.1109\/CVPR.2015.7298811"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2009.52"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.888718"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DIMPVT.2011.60"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3225150","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3225150","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:39:50Z","timestamp":1750210790000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3225150"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,6,30]]},"references-count":39,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2018,6,30]]}},"alternative-id":["10.1145\/3225150"],"URL":"https:\/\/doi.org\/10.1145\/3225150","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,6,30]]},"assertion":[{"value":"2016-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-02-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-08-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}