{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T03:04:41Z","timestamp":1740107081781,"version":"3.37.3"},"reference-count":27,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2020,3,7]],"date-time":"2020-03-07T00:00:00Z","timestamp":1583539200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,3,7]],"date-time":"2020-03-07T00:00:00Z","timestamp":1583539200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004359","name":"Vetenskapsr\u00e5det","doi-asserted-by":"publisher","award":["2014-4559"],"award-info":[{"award-number":["2014-4559"]}],"id":[{"id":"10.13039\/501100004359","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Vis Comput"],"published-print":{"date-parts":[[2021,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We present a semiautomatic real-time pipeline for capturing and rendering free-viewpoint video using passive stereo matching. The pipeline is simple and achieves agreeable quality in real time on a system of commodity web cameras and a single desktop computer. We suggest an automatic algorithm to compute a constrained search space for an efficient and robust hierarchical stereo reconstruction algorithm. Due to our fast reconstruction times, we can eliminate the need for an expensive global surface reconstruction with a combination of high coverage and aggressive filtering. Finally, we employ a novel color weighting scheme that generates credible new viewpoints without noticeable seams, while keeping the computational complexity low. The simplicity and low cost of the system make it an accessible and more practical alternative for many applications compared to previous methods.\n<\/jats:p>","DOI":"10.1007\/s00371-020-01823-7","type":"journal-article","created":{"date-parts":[[2020,3,7]],"date-time":"2020-03-07T04:52:43Z","timestamp":1583556763000},"page":"553-565","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["A low-cost, practical acquisition and rendering pipeline for real-time free-viewpoint video communication"],"prefix":"10.1007","volume":"37","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4623-5115","authenticated-orcid":false,"given":"Sverker","family":"Rasmuson","sequence":"first","affiliation":[]},{"given":"Erik","family":"Sintorn","sequence":"additional","affiliation":[]},{"given":"Ulf","family":"Assarsson","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,3,7]]},"reference":[{"key":"1823_CR1","doi-asserted-by":"publisher","unstructured":"libfreenect2. https:\/\/doi.org\/10.5281\/zenodo.50641","DOI":"10.5281\/zenodo.50641"},{"key":"1823_CR2","unstructured":"Agarwal, S., Mierle, K.: Others: Ceres solver. http:\/\/ceres-solver.org"},{"issue":"4","key":"1823_CR3","doi-asserted-by":"publisher","first-page":"40:1","DOI":"10.1145\/1778765.1778777","volume":"29","author":"T Beeler","year":"2010","unstructured":"Beeler, T., Bickel, B., Beardsley, P., Sumner, B., Gross, M.: High-quality single-shot capture of facial geometry. ACM Trans. Graph. 29(4), 40:1\u201340:9 (2010). https:\/\/doi.org\/10.1145\/1778765.1778777","journal-title":"ACM Trans. Graph."},{"issue":"1","key":"1823_CR4","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1111\/cgf.12802","volume":"36","author":"M Berger","year":"2017","unstructured":"Berger, M., Tagliasacchi, A., Seversky, L.M., Alliez, P., Guennebaud, G., Levine, J.A., Sharf, A., Silva, C.T.: A survey of surface reconstruction from point clouds. Comput. Graph. Forum 36(1), 301\u2013329 (2017). https:\/\/doi.org\/10.1111\/cgf.12802","journal-title":"Comput. Graph. Forum"},{"key":"1823_CR5","doi-asserted-by":"crossref","unstructured":"Bleyer, M., Rhemann, C., Rother, C.: Patchmatch stereo\u2013stereo matching with slanted support windows. In: BMVC (2011). https:\/\/www.microsoft.com\/en-us\/research\/publication\/patchmatch-stereo-stereo-matching-with-slanted-support-windows\/","DOI":"10.5244\/C.25.14"},{"key":"1823_CR6","unstructured":"Bradski, G.: The OpenCV Library. Dr. Dobb\u2019s Journal of Software Tools (2000)"},{"key":"1823_CR7","unstructured":"Cannon, E.: Greenscreen code and hints. http:\/\/gc-films.com\/chromakey.html"},{"issue":"4","key":"1823_CR8","doi-asserted-by":"publisher","first-page":"69:1","DOI":"10.1145\/2766945","volume":"34","author":"A Collet","year":"2015","unstructured":"Collet, A., Chuang, M., Sweeney, P., Gillett, D., Evseev, D., Calabrese, D., Hoppe, H., Kirk, A., Sullivan, S.: High-quality streamable free-viewpoint video. ACM Trans. Graph. 34(4), 69:1\u201369:13 (2015). https:\/\/doi.org\/10.1145\/2766945","journal-title":"ACM Trans. Graph."},{"issue":"4","key":"1823_CR9","doi-asserted-by":"publisher","first-page":"114:1","DOI":"10.1145\/2897824.2925969","volume":"35","author":"M Dou","year":"2016","unstructured":"Dou, M., Khamis, S., Degtyarev, Y., Davidson, P., Fanello, S.R., Kowdle, A., Escolano, S.O., Rhemann, C., Kim, D., Taylor, J., Kohli, P., Tankovich, V., Izadi, S.: Fusion4D: real-time performance capture of challenging scenes. ACM Trans. Graph. 35(4), 114:1\u2013114:13 (2016). https:\/\/doi.org\/10.1145\/2897824.2925969","journal-title":"ACM Trans. Graph."},{"key":"1823_CR10","doi-asserted-by":"crossref","unstructured":"Feng, Y., Wu, F., Shao, X., Wang, Y., Zhou, X.: Joint 3D face reconstruction and dense alignment with position map regression network. CoRR arXiv:1803.07835 (2018)","DOI":"10.1007\/978-3-030-01264-9_33"},{"key":"1823_CR11","volume-title":"Time-of-Flight Cameras: Principles. Methods and Applications","author":"M Hansard","year":"2012","unstructured":"Hansard, M., Lee, S., Choi, O., Horaud, R.: Time-of-Flight Cameras: Principles. Methods and Applications. Springer, Incorporated (2012)"},{"key":"1823_CR12","doi-asserted-by":"publisher","unstructured":"Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., Fitzgibbon, A.: Kinectfusion: Real-time 3D reconstruction and interaction using a moving depth camera. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, UIST \u201911, pp. 559\u2013568. ACM, New York, NY, USA (2011). https:\/\/doi.org\/10.1145\/2047196.2047270","DOI":"10.1145\/2047196.2047270"},{"key":"1823_CR13","doi-asserted-by":"crossref","unstructured":"Kazemi, V., Keskin, C., Taylor, J., Kohli, P., Izadi, S.: Real-time face reconstruction from a single depth image. In: 2014 2nd International Conference on 3D Vision, vol. 1, pp. 369\u2013376 (2014)","DOI":"10.1109\/3DV.2014.93"},{"key":"1823_CR14","unstructured":"Kazhdan, M., Bolitho, M., Hoppe, H.: Poisson surface reconstruction. In: Proceedings of the Fourth Eurographics Symposium on Geometry Processing, SGP \u201906, pp. 61\u201370. Eurographics Association, Aire-la-Ville, Switzerland, Switzerland (2006). http:\/\/dl.acm.org\/citation.cfm?id=1281957.1281965"},{"issue":"1","key":"1823_CR15","doi-asserted-by":"publisher","first-page":"94","DOI":"10.1109\/TCSVT.2012.2203200","volume":"23","author":"J Kowalczuk","year":"2013","unstructured":"Kowalczuk, J., Psota, E.T., Perez, L.C.: Real-time stereo matching on cuda using an iterative refinement method for adaptive support-weight correspondences. IEEE Trans. Circuits Syst. Video Technol. 23(1), 94\u2013104 (2013). https:\/\/doi.org\/10.1109\/TCSVT.2012.2203200","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"issue":"2","key":"1823_CR16","doi-asserted-by":"publisher","first-page":"150","DOI":"10.1109\/34.273735","volume":"16","author":"A Laurentini","year":"1994","unstructured":"Laurentini, A.: The visual hull concept for silhouette-based image understanding. IEEE Trans. Pattern Anal. Mach. Intell. 16(2), 150\u2013162 (1994). https:\/\/doi.org\/10.1109\/34.273735","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"1823_CR17","doi-asserted-by":"publisher","unstructured":"Maimone, A., Fuchs, H.: Encumbrance-free telepresence system with real-time 3D capture and display using commodity depth cameras. In: Proceedings of the 2011 10th IEEE International Symposium on Mixed and Augmented Reality, ISMAR \u201911, pp. 137\u2013146. IEEE Computer Society, Washington, DC, USA (2011). https:\/\/doi.org\/10.1109\/ISMAR.2011.6092379","DOI":"10.1109\/ISMAR.2011.6092379"},{"key":"1823_CR18","doi-asserted-by":"crossref","unstructured":"Newcombe, R.A., Fox, D., Seitz, S.M.: Dynamicfusion: Reconstruction and tracking of non-rigid scenes in real-time. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2015)","DOI":"10.1109\/CVPR.2015.7298631"},{"key":"1823_CR19","doi-asserted-by":"publisher","unstructured":"Orts-Escolano, S., Rhemann, C., Fanello, S., Chang, W., Kowdle, A., Degtyarev, Y., Kim, D., Davidson, P.L., Khamis, S., Dou, M., Tankovich, V., Loop, C., Cai, Q., Chou, P.A., Mennicken, S., Valentin, J., Pradeep, V., Wang, S., Kang, S.B., Kohli, P., Lutchyn, Y., Keskin, C., Izadi, S.: Holoportation: Virtual 3D teleportation in real-time. In: Proceedings of the 29th Annual Symposium on User Interface Software and Technology, UIST \u201916, pp. 741\u2013754. ACM, New York, NY, USA (2016). https:\/\/doi.org\/10.1145\/2984511.2984517","DOI":"10.1145\/2984511.2984517"},{"key":"1823_CR20","first-page":"247108:1","volume":"2010","author":"B Petit","year":"2010","unstructured":"Petit, B., Lesage, J.D., M\u00e9nier, C., Allard, J., Franco, J.S., Raffin, B., Boyer, E., Faure, F.: Multicamera real-time 3D modeling for telepresence and remote collaboration. Int. J. Digit. Multimed. Broadcasting 2010, 247108:1\u2013247108:12 (2010)","journal-title":"Int. J. Digit. Multimed. Broadcasting"},{"issue":"4","key":"1823_CR21","doi-asserted-by":"publisher","first-page":"47:1","DOI":"10.1145\/2601097.2601172","volume":"33","author":"R Preiner","year":"2014","unstructured":"Preiner, R., Mattausch, O., Arikan, M., Pajarola, R., Wimmer, M.: Continuous projection for fast l1 reconstruction. ACM Trans. Graph. 33(4), 47:1\u201347:13 (2014). https:\/\/doi.org\/10.1145\/2601097.2601172","journal-title":"ACM Trans. Graph."},{"key":"1823_CR22","unstructured":"Richardson, E., Sela, M., Or-El, R., Kimmel, R.: Learning detailed face reconstruction from a single image. CoRR (2016). arXiv:1611.05053"},{"key":"1823_CR23","doi-asserted-by":"publisher","unstructured":"Rong, G., Tan, T.S.: Jump flooding in GPU with applications to voronoi diagram and distance transform. In: Proceedings of the 2006 Symposium on Interactive 3D Graphics and Games, I3D \u201906, pp. 109\u2013116. ACM, New York, NY, USA (2006). https:\/\/doi.org\/10.1145\/1111411.1111431","DOI":"10.1145\/1111411.1111431"},{"key":"1823_CR24","doi-asserted-by":"publisher","unstructured":"Tan, F., Fu, C.W., Deng, T., Cai, J., Cham, T.J.: Facecollage: A rapidly deployable system for real-time head reconstruction for on-the-go 3D telepresence. In: Proceedings of the 25th ACM International Conference on Multimedia, MM \u201917, pp. 64\u201372. ACM, New York, NY, USA (2017). https:\/\/doi.org\/10.1145\/3123266.3123281","DOI":"10.1145\/3123266.3123281"},{"key":"1823_CR25","unstructured":"Tewari, A., Zollh\u00f6fer, M., Garrido, P., Bernard, F., Kim, H., P\u00e9rez, P., Theobalt, C.: Self-supervised multi-level face model learning for monocular reconstruction at over 250 Hz. CoRR (2017). arXiv:1712.02859"},{"key":"1823_CR26","unstructured":"Tewari, A., Zollh\u00f6fer, M., Kim, H., Garrido, P., Bernard, F., P\u00e9rez, P., Theobalt, C.: Mofa: Model-based deep convolutional face autoencoder for unsupervised monocular reconstruction. CoRR (2017). arXiv:1703.10580"},{"key":"1823_CR27","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601165","author":"M Zollh\u00f6fer","year":"2014","unstructured":"Zollh\u00f6fer, M., Nie\u00dfner, M., Izadi, S., Rehmann, C., Zach, C., Fisher, M., Wu, C., Fitzgibbon, A., Loop, C., Theobalt, C., Stamminger, M.: Real-time non-rigid reconstruction using an rgb-d camera. ACM Trans. Graph. (2014). https:\/\/doi.org\/10.1145\/2601097.2601165","journal-title":"ACM Trans. Graph."}],"container-title":["The Visual Computer"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s00371-020-01823-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s00371-020-01823-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s00371-020-01823-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,17]],"date-time":"2021-03-17T09:59:30Z","timestamp":1615975170000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s00371-020-01823-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,7]]},"references-count":27,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,3]]}},"alternative-id":["1823"],"URL":"https:\/\/doi.org\/10.1007\/s00371-020-01823-7","relation":{},"ISSN":["0178-2789","1432-2315"],"issn-type":[{"type":"print","value":"0178-2789"},{"type":"electronic","value":"1432-2315"}],"subject":[],"published":{"date-parts":[[2020,3,7]]},"assertion":[{"value":"7 March 2020","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}},{"value":"All authors have declare that they have no conflict of interest","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}