{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T17:50:03Z","timestamp":1791913803972,"version":"4.3.4"},"reference-count":65,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2015,7,27]],"date-time":"2015-07-27T00:00:00Z","timestamp":1437955200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2015,7,27]]},"abstract":"<jats:p>We present the first end-to-end solution to create high-quality free-viewpoint video encoded as a compact data stream. Our system records performances using a dense set of RGB and IR video cameras, generates dynamic textured surfaces, and compresses these to a streamable 3D video format. Four technical advances contribute to high fidelity and robustness: multimodal multi-view stereo fusing RGB, IR, and silhouette information; adaptive meshing guided by automatic detection of perceptually salient areas; mesh tracking to create temporally coherent subsequences; and encoding of tracked textured meshes as an MPEG video stream. Quantitative experiments demonstrate geometric accuracy, texture fidelity, and encoding efficiency. We release several datasets with calibrated inputs and processed results to foster future research.<\/jats:p>","DOI":"10.1145\/2766945","type":"journal-article","created":{"date-parts":[[2015,7,28]],"date-time":"2015-07-28T08:26:38Z","timestamp":1438071998000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":542,"title":["High-quality streamable free-viewpoint video"],"prefix":"10.1145","volume":"34","author":[{"given":"Alvaro","family":"Collet","sequence":"first","affiliation":[{"name":"Microsoft Corporation"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ming","family":"Chuang","sequence":"additional","affiliation":[{"name":"Microsoft Corporation"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pat","family":"Sweeney","sequence":"additional","affiliation":[{"name":"Microsoft Corporation"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Don","family":"Gillett","sequence":"additional","affiliation":[{"name":"Microsoft Corporation"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dennis","family":"Evseev","sequence":"additional","affiliation":[{"name":"Microsoft Corporation"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Calabrese","sequence":"additional","affiliation":[{"name":"Microsoft Corporation"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hugues","family":"Hoppe","sequence":"additional","affiliation":[{"name":"Microsoft Corporation"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adam","family":"Kirk","sequence":"additional","affiliation":[{"name":"Microsoft Corporation"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Steve","family":"Sullivan","sequence":"additional","affiliation":[{"name":"Microsoft Corporation"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2015,7,27]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"4D View Solutions 2007. http:\/\/www.4dviews.com.  4D View Solutions 2007. http:\/\/www.4dviews.com."},{"key":"e_1_2_2_2_1","volume-title":"Proc. CVPR.","author":"Ahmed N.","unstructured":"Ahmed , N. , Theobalt , C. , Dobrev , P. , and Seidel , H . 2008. Robust fusion of dynamic shape and normal capture for high-quality reconstruction of time-varying geometry . In Proc. CVPR. Ahmed, N., Theobalt, C., Dobrev, P., and Seidel, H. 2008. Robust fusion of dynamic shape and normal capture for high-quality reconstruction of time-varying geometry. In Proc. CVPR."},{"key":"e_1_2_2_3_1","volume-title":"Proc. CVPR.","author":"Ahmed N.","unstructured":"Ahmed , N. , Theobalt , C. , Rossl , C. , Thrun , S. , and Seidel , H . 2008. Dense correspondence finding for parameterization-free animation reconstruction from video . In Proc. CVPR. Ahmed, N., Theobalt, C., Rossl, C., Thrun, S., and Seidel, H. 2008. Dense correspondence finding for parameterization-free animation reconstruction from video. In Proc. CVPR."},{"key":"e_1_2_2_4_1","volume-title":"Proc. Conf. on Visualization.","author":"Alexa M.","unstructured":"Alexa , M. , Behr , J. , Cohen-Or , D. , Fleishman , S. , Levin , D. , and Silva , C. T . 2001. Point set surfaces . In Proc. Conf. on Visualization. Alexa, M., Behr, J., Cohen-Or, D., Fleishman, S., Levin, D., and Silva, C. T. 2001. Point set surfaces. In Proc. Conf. on Visualization."},{"key":"e_1_2_2_5_1","volume-title":"Proc. ICME.","author":"Aspert N.","unstructured":"Aspert , N. , Santa -cruz, D., and Ebrahimi , T . 2002. MESH: Measuring errors between surfaces using the Hausdorff distance . In Proc. ICME. Aspert, N., Santa-cruz, D., and Ebrahimi, T. 2002. MESH: Measuring errors between surfaces using the Hausdorff distance. In Proc. ICME."},{"key":"e_1_2_2_6_1","volume-title":"Proc. BMVC.","author":"Bleyer M.","unstructured":"Bleyer , M. , Rhemann , C. , and Rother , C . 2011. PatchMatch stereo - stereo matching with slanted support windows . In Proc. BMVC. Bleyer, M., Rhemann, C., and Rother, C. 2011. PatchMatch stereo - stereo matching with slanted support windows. In Proc. BMVC."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185549"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1198555.1198596"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-012-0553-4"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-88682-2_58"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882309"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12296"},{"key":"e_1_2_2_13_1","volume-title":"Symposium on Geometry Processing.","author":"Chuang M.","unstructured":"Chuang , M. , Luo , L. , Brown , B. , Rusinkiewicz , S. , and Kazhdan , M . 2009. Estimating the Laplace-Beltrami operator by restricting 3D functions . Symposium on Geometry Processing. Chuang, M., Luo, L., Brown, B., Rusinkiewicz, S., and Kazhdan, M. 2009. Estimating the Laplace-Beltrami operator by restricting 3D functions. Symposium on Geometry Processing."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360697"},{"key":"e_1_2_2_15_1","unstructured":"DoubleMe 2014. https:\/\/www.doubleme.me.  DoubleMe 2014. https:\/\/www.doubleme.me."},{"key":"e_1_2_2_16_1","volume-title":"Proc. ACM-SIAM Symposium on Discrete algorithms.","author":"Erickson J.","unstructured":"Erickson , J. , and Whittlesey , K . 2005. Greedy optimal homotopy and homology generators . In Proc. ACM-SIAM Symposium on Discrete algorithms. Erickson, J., and Whittlesey, K. 2005. Greedy optimal homotopy and homology generators. In Proc. ACM-SIAM Symposium on Discrete algorithms."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DPVT.2006.148"},{"key":"e_1_2_2_18_1","unstructured":"FreeD 2014. http:\/\/replay-technologies.com.  FreeD 2014. http:\/\/replay-technologies.com."},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2009.161"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2009.01617.x"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206755"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/258734.258849"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.199"},{"key":"e_1_2_2_24_1","volume-title":"Proc. CVPR.","author":"Goldluecke B.","unstructured":"Goldluecke , B. , and Magnor , M . 2004. Space-time isosurface evolution for temporally coherent 3D reconstruction . In Proc. CVPR. Goldluecke, B., and Magnor, M. 2004. Space-time isosurface evolution for temporally coherent 3D reconstruction. In Proc. CVPR."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.1966.1053907"},{"key":"e_1_2_2_26_1","unstructured":"Guennebaud G. Jacob B. etal 2010. Eigen v3. http:\/\/eigen.tuxfamily.org.  Guennebaud G. Jacob B. et al. 2010. Eigen v3. http:\/\/eigen.tuxfamily.org."},{"key":"e_1_2_2_27_1","volume-title":"Proc. Graphics Interface.","author":"Guskov I.","unstructured":"Guskov , I. , and Wood , Z. J . 2001. Topological noise removal . In Proc. Graphics Interface. Guskov, I., and Wood, Z. J. 2001. Topological noise removal. In Proc. Graphics Interface."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2004.03.016"},{"key":"e_1_2_2_29_1","volume-title":"-P","author":"Hiep V. H.","year":"2009","unstructured":"Hiep , V. H. , Keriven , R. , Labatut , P. , and Pons , J . -P . 2009 . Towards high-resolution large-scale multi-view stereo. In Proc. CVPR. Hiep, V. H., Keriven, R., Labatut, P., and Pons, J.-P. 2009. Towards high-resolution large-scale multi-view stereo. In Proc. CVPR."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.46"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.440"},{"key":"e_1_2_2_32_1","unstructured":"ISO\/IEC 23009-1 2014. Information technology -- dynamic adaptive streaming over HTTP (DASH) -- Part 1: Media presentation description and segment formats.  ISO\/IEC 23009-1 2014. Information technology -- dynamic adaptive streaming over HTTP (DASH) -- Part 1: Media presentation description and segment formats."},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/93.580394"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487228.2487237"},{"key":"e_1_2_2_35_1","volume-title":"Symposium on Geometry Processing.","author":"Kazhdan M.","unstructured":"Kazhdan , M. , Bolitho , M. , and Hoppe , H . 2006. Poisson surface reconstruction . In Symposium on Geometry Processing. Kazhdan, M., Bolitho, M., and Hoppe, H. 2006. Poisson surface reconstruction. In Symposium on Geometry Processing."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33765-9_53"},{"key":"e_1_2_2_37_1","volume-title":"Proc. ICCV.","author":"Labatut P.","unstructured":"Labatut , P. , Pons , J.-P. , and Keriven , R . 2007. Efficient multi-view reconstruction of large-scale scenes using interest points, delaunay triangulation and graph cuts . In Proc. ICCV. Labatut, P., Pons, J.-P., and Keriven, R. 2007. Efficient multi-view reconstruction of large-scale scenes using interest points, delaunay triangulation and graph cuts. In Proc. ICCV."},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073244"},{"key":"e_1_2_2_39_1","volume-title":"Proc. CVPR.","author":"Lempitsky V. S.","unstructured":"Lempitsky , V. S. , and Ivanov , D. V . 2007. Seamless mosaicing of image-based texture maps . In Proc. CVPR. Lempitsky, V. S., and Ivanov, D. V. 2007. Seamless mosaicing of image-based texture maps. In Proc. CVPR."},{"key":"e_1_2_2_40_1","volume-title":"Proc. CVPR.","author":"Letouzey A.","unstructured":"Letouzey , A. , and Boyer , E . 2012. Progressive shape models . In Proc. CVPR. Letouzey, A., and Boyer, E. 2012. Progressive shape models. In Proc. CVPR."},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1618452.1618521"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/353981.353995"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2009.88"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344951"},{"key":"e_1_2_2_45_1","unstructured":"Microsoft 2011. UVAtlas. http:\/\/uvatlas.codeplex.com.  Microsoft 2011. UVAtlas. http:\/\/uvatlas.codeplex.com."},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/93.580392"},{"key":"e_1_2_2_47_1","volume-title":"Proc. ICCV.","author":"Narayanan P.","unstructured":"Narayanan , P. , Rander , P. , and Kanade , T . 1998. Constructing virtual worlds using dense stereo . In Proc. ICCV. Narayanan, P., Rander, P., and Kanade, T. 1998. Constructing virtual worlds using dense stereo. In Proc. ICCV."},{"key":"e_1_2_2_48_1","volume-title":"Proc. ECCV.","author":"Shan Q.","unstructured":"Shan , Q. , Curless , B. , Furukawa , Y. , Hernandez , C. , and Seitz , S. M . 2014. Occluding contours for multi-view stereo . In Proc. ECCV. Shan, Q., Curless, B., Furukawa, Y., Hernandez, C., and Seitz, S. M. 2014. Occluding contours for multi-view stereo. In Proc. ECCV."},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2005.159"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-010-0429-y"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2007.68"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276478"},{"key":"e_1_2_2_53_1","volume-title":"Proc. 3DTV.","author":"Vasa L.","unstructured":"Vasa , L. , and Skala , V . 2007. CoDDyaC: Connectivity Driven Dynamic Mesh Compression . In Proc. 3DTV. Vasa, L., and Skala, V. 2007. CoDDyaC: Connectivity Driven Dynamic Mesh Compression. In Proc. 3DTV."},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360696"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/1618452.1618520"},{"key":"e_1_2_2_56_1","volume-title":"Proc. BMVC.","author":"Volino M.","unstructured":"Volino , M. , Casas , D. , Collomosse , J. P. , and Hilton , A . 2014. Optimal representation of multiple view video . In Proc. BMVC. Volino, M., Casas, D., Collomosse, J. P., and Hilton, A. 2014. Optimal representation of multiple view video. In Proc. BMVC."},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/1516522.1516526"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2003.819861"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/990002.990007"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126358"},{"key":"e_1_2_2_61_1","first-page":"5","article-title":"Free-viewpoint video of human actors using multiple handheld Kinects","volume":"43","author":"Ye G.","year":"2013","unstructured":"Ye , G. , Liu , Y. , Deng , Y. , Hasler , N. , Ji , X. , Dai , Q. , and Theobalt , C. 2013 . Free-viewpoint video of human actors using multiple handheld Kinects . IEEE Trans. on System, Man & Cybernetics 43 , 5 . Ye, G., Liu, Y., Deng, Y., Hasler, N., Ji, X., Dai, Q., and Theobalt, C. 2013. Free-viewpoint video of human actors using multiple handheld Kinects. IEEE Trans. on System, Man & Cybernetics 43, 5.","journal-title":"IEEE Trans. on System, Man & Cybernetics"},{"key":"e_1_2_2_62_1","doi-asserted-by":"crossref","unstructured":"Yu F. Luo H. Lu Z. and Wang P. 2010. 3D mesh compression. Three-Dimensional Model Analysis and Processing.  Yu F. Luo H. Lu Z. and Wang P. 2010. 3D mesh compression. Three-Dimensional Model Analysis and Processing.","DOI":"10.1007\/978-3-642-12651-2_2"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601134"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015766"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601165"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2766945","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2766945","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:43:01Z","timestamp":1750210981000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2766945"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,7,27]]},"references-count":65,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2015,7,27]]}},"alternative-id":["10.1145\/2766945"],"URL":"https:\/\/doi.org\/10.1145\/2766945","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,7,27]]},"assertion":[{"value":"2015-07-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}