{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T19:48:20Z","timestamp":1767988100976,"version":"3.49.0"},"reference-count":38,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2004,8,1]],"date-time":"2004-08-01T00:00:00Z","timestamp":1091318400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2004,8]]},"abstract":"<jats:p>The ability to interactively control viewpoint while watching a video is an exciting application of image-based rendering. The goal of our work is to render dynamic scenes with interactive viewpoint control using a relatively small number of video cameras. In this paper, we show how high-quality video-based rendering of dynamic scenes can be accomplished using multiple synchronized video streams combined with novel image-based modeling and rendering algorithms. Once these video streams have been processed, we can synthesize any intermediate view between cameras at any time, with the potential for space-time manipulation.In our approach, we first use a novel color segmentation-based stereo algorithm to generate high-quality photoconsistent correspondences across all camera views. Mattes for areas near depth discontinuities are then automatically extracted to reduce artifacts during view synthesis. Finally, a novel temporal two-layer compressed representation that handles matting is developed for rendering at interactive rates.<\/jats:p>","DOI":"10.1145\/1015706.1015766","type":"journal-article","created":{"date-parts":[[2004,10,7]],"date-time":"2004-10-07T17:38:56Z","timestamp":1097170736000},"page":"600-608","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":798,"title":["High-quality video view interpolation using a layered representation"],"prefix":"10.1145","volume":"23","author":[{"given":"C. Lawrence","family":"Zitnick","sequence":"first","affiliation":[{"name":"Microsoft Research, Redmond, WA"}]},{"given":"Sing Bing","family":"Kang","sequence":"additional","affiliation":[{"name":"Microsoft Research, Redmond, WA"}]},{"given":"Matthew","family":"Uyttendaele","sequence":"additional","affiliation":[{"name":"Microsoft Research, Redmond, WA"}]},{"given":"Simon","family":"Winder","sequence":"additional","affiliation":[{"name":"Microsoft Research, Redmond, WA"}]},{"given":"Richard","family":"Szeliski","sequence":"additional","affiliation":[{"name":"Microsoft Research, Redmond, WA"}]}],"member":"320","published-online":{"date-parts":[[2004,8]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/794191.794727"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383309"},{"key":"e_1_2_2_3_1","volume-title":"International Conference on Computer Vision (ICCV)","author":"Carceroni R. L.","unstructured":"Carceroni, R. L., and Kutulakos, K. N. 2001. Multi-view scene capture by surfel sampling: From video streams to non-rigid 3D motion, shape and reflectance. In International Conference on Computer Vision (ICCV), vol. II, 60--67."},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882309"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.509883"},{"key":"e_1_2_2_6_1","volume-title":"Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Chuang Y.-Y.","year":"2001","unstructured":"Chuang, Y.-Y., et al. 2001. A Bayesian approach to digital matting. In Conference on Computer Vision and Pattern Recognition (CVPR), vol. II, 264--271."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566572"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","unstructured":"Debevec P. E. Taylor C. J. and Malik J. 1996. Modeling and rendering architecture from photographs: A hybrid geometry-and image-based approach. Computer Graphics (SIGGRAPH'96) 11--20. 10.1145\/237170.237191","DOI":"10.1145\/237170.237191"},{"key":"e_1_2_2_9_1","volume-title":"Eurographics Rendering Workshop","author":"Debevec P. E.","year":"1998","unstructured":"Debevec, P. E., Yu, Y., and Borshukov, G. D. 1998. Efficient view-dependent image-based rendering with projective texture-mapping. Eurographics Rendering Workshop 1998, 105--116."},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.5555\/946247.946764"},{"key":"e_1_2_2_11_1","first-page":"455","article-title":"Hardware-accelerated dynamic light field rendering","volume":"2002","author":"Goldl\u00fccke B.","year":"2002","unstructured":"Goldl\u00fccke, B., Magnor, M., and Wilburn, B. 2002. Hardware-accelerated dynamic light field rendering. In Proceedings Vision, Modeling and Visualization VMV 2002, 455--462.","journal-title":"Proceedings Vision, Modeling and Visualization VMV"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","unstructured":"Gortler S. J. Grzeszczuk R. Szeliski R. and Cohen M. F. 1996. The Lumigraph. In Computer Graphics (SIGGRAPH'96) Proceedings ACM SIGGRAPH 43--54. 10.1145\/237170.237200","DOI":"10.1145\/237170.237200"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882350"},{"key":"e_1_2_2_14_1","volume-title":"International Conference on Computer Vision (ICCV)","author":"Hall-Holt O.","unstructured":"Hall-Holt, O., and Rusinkiewicz, S. 2001. Stripe boundary codes for real-time structured-light range scanning of moving objects. In International Conference on Computer Vision (ICCV), vol. II, 359--366."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.5555\/648284.755760"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/93.580394"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","unstructured":"Levoy M. and Hanrahan P. 1996. Light field rendering. In Computer Graphics (SIGGRAPH'96) Proceedings ACM SIGGRAPH 31--42. 10.1145\/237170.237199","DOI":"10.1145\/237170.237199"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344951"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.910886"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.56205"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/647651.732115"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1014573219977"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-8659.00509"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/794189.794361"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","unstructured":"Shade J. Gortler S. He L.-W. and Szeliski R. 1998. Layered depth images. In Computer Graphics (SIGGRAPH'98) Proceedings ACM SIGGRAPH 231--242. 10.1145\/280814.280882","DOI":"10.1145\/280814.280882"},{"key":"e_1_2_2_26_1","unstructured":"Smolic A. and Kimata H. 2003. AHG on 3DAV Coding. ISO\/IEC JTC1\/SC29\/WG11 MPEG03\/M9635."},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008192912624"},{"key":"e_1_2_2_28_1","volume-title":"International Conference on Computer Vision (ICCV)","author":"Tao H.","unstructured":"Tao, H., Sawhney, H., and Kumar, R. 2001. A global matching framework for stereo computation. In International Conference on Computer Vision (ICCV), vol. I, 532--539."},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.5555\/1965841.1965933"},{"key":"e_1_2_2_30_1","volume-title":"Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Vedula S.","unstructured":"Vedula, S., Baker, S., Seitz, S., and Kanade, T. 2000. Shape and motion carving in 6D. In Conference on Computer Vision and Pattern Recognition (CVPR), vol. II, 592--598."},{"key":"e_1_2_2_31_1","volume-title":"Conference on Computer Vision and Pattern Recognition (CVPR), 361--366","author":"Wang J. Y. A.","unstructured":"Wang, J. Y. A., and Adelson, E. H. 1993. Layered representation for motion analysis. In Conference on Computer Vision and Pattern Recognition (CVPR), 361--366."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.5555\/645317.649317"},{"key":"e_1_2_2_33_1","first-page":"29","article-title":"The light field video camera","volume":"4674","author":"Wilburn B.","year":"2002","unstructured":"Wilburn, B., Smulski, M., Lee, H. H. K., and Horowitz, M. 2002. The light field video camera. In SPIE Electonic Imaging: Media Processors, vol. 4674, 29--36.","journal-title":"SPIE Electonic Imaging: Media Processors"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.5555\/581896.581907"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.5555\/826030.826631"},{"key":"e_1_2_2_36_1","volume-title":"Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Zhang Y.","unstructured":"Zhang, Y., and Kambhamettu, C. 2001. On 3D scene flow and structure estimation. In Conference on Computer Vision and Pattern Recognition (CVPR), vol. II, 778--785."},{"key":"e_1_2_2_37_1","volume-title":"Conference on Computer Vision and Pattern Recognition, 367--374","author":"Zhang L.","unstructured":"Zhang, L., Curless, B., and Seitz, S. M. 2003. Spacetime stereo: Shape recovery for dynamic scenes. In Conference on Computer Vision and Pattern Recognition, 367--374."},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.888718"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1015706.1015766","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1015706.1015766","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T21:26:23Z","timestamp":1750281983000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1015706.1015766"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2004,8]]},"references-count":38,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2004,8]]}},"alternative-id":["10.1145\/1015706.1015766"],"URL":"https:\/\/doi.org\/10.1145\/1015706.1015766","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2004,8]]},"assertion":[{"value":"2004-08-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}