{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T06:06:59Z","timestamp":1784268419910,"version":"3.55.0"},"reference-count":41,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2018,12,4]],"date-time":"2018-12-04T00:00:00Z","timestamp":1543881600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-sa\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2018,12,31]]},"abstract":"<jats:p>\n            We introduce a realtime compression architecture for 4D performance capture that is two orders of magnitude faster than current state-of-the-art techniques, yet achieves comparable visual quality and bitrate. We note how much of the algorithmic complexity in traditional 4D compression arises from the necessity to encode geometry using an\n            <jats:italic>explicit<\/jats:italic>\n            model (i.e. a triangle mesh). In contrast, we propose an encoder that leverages an\n            <jats:italic>implicit<\/jats:italic>\n            representation (namely a Signed Distance Function) to represent the observed geometry, as well as its changes through time. We demonstrate how SDFs, when defined over a small local region (i.e. a block), admit a low-dimensional embedding due to the innate geometric redundancies in their representation. We then propose an optimization that takes a Truncated SDF (i.e. a TSDF), such as those found in most rigid\/non-rigid reconstruction pipelines, and efficiently projects each TSDF block onto the SDF latent space. This results in a collection of low entropy tuples that can be effectively quantized and symbolically encoded. On the decoder side, to avoid the typical artifacts of block-based coding, we also propose a variational optimization that compensates for quantization residuals in order to penalize unsightly discontinuities in the decompressed signal. This optimization is expressed in the SDF latent embedding, and hence can also be performed efficiently. We demonstrate our compression\/decompression architecture by realizing, to the best of our knowledge, the first system for streaming a real-time captured 4D performance on consumer-level networks.\n          <\/jats:p>","DOI":"10.1145\/3272127.3275096","type":"journal-article","created":{"date-parts":[[2018,11,28]],"date-time":"2018-11-28T19:16:10Z","timestamp":1543432570000},"page":"1-11","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":27,"title":["Real-time compression and streaming of 4D performances"],"prefix":"10.1145","volume":"37","author":[{"given":"Danhang","family":"Tang","sequence":"first","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mingsong","family":"Dou","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"Lincoln","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Philip","family":"Davidson","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kaiwen","family":"Guo","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonathan","family":"Taylor","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sean","family":"Fanello","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cem","family":"Keskin","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adarsh","family":"Kowdle","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sofien","family":"Bouaziz","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shahram","family":"Izadi","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrea","family":"Tagliasacchi","sequence":"additional","affiliation":[{"name":"Google Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2018,12,4]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12178"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073714"},{"key":"e_1_2_2_3_1","volume-title":"Compressed Voxel-Based Mapping Using Unsupervised Learning. Robotics","author":"Canelhas Daniel-Ricao","year":"2017","unstructured":"Daniel-Ricao Canelhas , Erik Schaffernicht , Todor Stoyanov , Achim J Lilienthal , and Andrew J Davison . 2017. Compressed Voxel-Based Mapping Using Unsupervised Learning. Robotics ( 2017 ). Daniel-Ricao Canelhas, Erik Schaffernicht, Todor Stoyanov, Achim J Lilienthal, and Andrew J Davison. 2017. Compressed Voxel-Based Mapping Using Unsupervised Learning. Robotics (2017)."},{"key":"e_1_2_2_4_1","volume-title":"Metro: Measuring error on simplified surfaces.","author":"Cignoni Paolo","year":"1998","unstructured":"Paolo Cignoni , Claudio Rocchini , and Roberto Scopigno . 1998 . Metro: Measuring error on simplified surfaces. (1998). Paolo Cignoni, Claudio Rocchini, and Roberto Scopigno. 1998. Metro: Measuring error on simplified surfaces. (1998)."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015817"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766945"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237269"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2732197"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130801"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925969"},{"key":"e_1_2_2_11_1","unstructured":"Frank Galligan Michael Hemmer Ondrej Stava Fan Zhang and Jamieson Brettle. 2018. Google\/Draco: a library for compressing and decompressing 3D geometric meshes and point clouds. https:\/\/github.com\/google\/draco. (2018).  Frank Galligan Michael Hemmer Ondrej Stava Fan Zhang and Jamieson Brettle. 2018. Google\/Draco: a library for compressing and decompressing 3D geometric meshes and point clouds. https:\/\/github.com\/google\/draco. (2018)."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/258734.258849"},{"key":"e_1_2_2_13_1","volume-title":"Alexander Mathiasen, Jesper Sindahl Nielsen, Stefan Schneider, and Mingzhou Song.","author":"Gr\u00f8nlund Allan","year":"2017","unstructured":"Allan Gr\u00f8nlund , Kasper Green Larsen , Alexander Mathiasen, Jesper Sindahl Nielsen, Stefan Schneider, and Mingzhou Song. 2017 . Fast exact k-means, k-medians and bregman divergence clustering in 1d. arXiv preprint arXiv:1701.07204 (2017). Allan Gr\u00f8nlund, Kasper Green Larsen, Alexander Mathiasen, Jesper Sindahl Nielsen, Stefan Schneider, and Mingzhou Song. 2017. Fast exact k-means, k-medians and bregman divergence clustering in 1d. arXiv preprint arXiv:1701.07204 (2017)."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237216"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46484-8_22"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1063\/1.2793569"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344924"},{"key":"e_1_2_2_18_1","volume-title":"Compression of soft-body animation sequences. Computers & Graphics","author":"Karni Zachi","year":"2004","unstructured":"Zachi Karni and Craig Gotsman . 2004. Compression of soft-body animation sequences. Computers & Graphics ( 2004 ). Zachi Karni and Craig Gotsman. 2004. Compression of soft-body animation sequences. Computers & Graphics (2004)."},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487228.2487237"},{"key":"e_1_2_2_20_1","doi-asserted-by":"crossref","unstructured":"Adarsh Kowdle Christoph Rhemann Sean Fanello Andrea Tagliasacchi Jonathan Taylor Philip Davidson Mingsong Dou Kaiwen Guo Cem Keskin Sameh Khamis David Kim Danhang Tang Vladimir Tankovich Julien Valentin and Shahram Izadi. 2018. The Need 4 Speed in Real-Time Dense Visual Tracking. (2018).  Adarsh Kowdle Christoph Rhemann Sean Fanello Andrea Tagliasacchi Jonathan Taylor Philip Davidson Mingsong Dou Kaiwen Guo Cem Keskin Sameh Khamis David Kim Danhang Tang Vladimir Tankovich Julien Valentin and Shahram Izadi. 2018. The Need 4 Speed in Real-Time Dense Visual Tracking. (2018).","DOI":"10.1145\/3272127.3275062"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1837101.1837109"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/37401.37422"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2693443"},{"key":"e_1_2_2_24_1","volume-title":"Proc. IERE Video & Data Recording Conf.","author":"Martin G Nigel N","year":"1979","unstructured":"G Nigel N Martin . 1979 . Range encoding: an algorithm for removing redundancy from a digitised message . In Proc. IERE Video & Data Recording Conf. , 1979. G Nigel N Martin. 1979. Range encoding: an algorithm for removing redundancy from a digitised message. In Proc. IERE Video & Data Recording Conf., 1979."},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298631"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2984511.2984517"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvcir.2005.03.001"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073679"},{"key":"e_1_2_2_30_1","volume-title":"The H. 264 advanced video compression standard","author":"Richardson Iain E","unstructured":"Iain E Richardson . 2011. The H. 264 advanced video compression standard . John Wiley & Sons . Iain E Richardson. 2011. The H. 264 advanced video compression standard. John Wiley & Sons."},{"key":"e_1_2_2_31_1","volume-title":"Real-time adaptive image compression. arXiv preprint arXiv:1705.05823","author":"Rippel Oren","year":"2017","unstructured":"Oren Rippel and Lubomir Bourdev . 2017. Real-time adaptive image compression. arXiv preprint arXiv:1705.05823 ( 2017 ). Oren Rippel and Lubomir Bourdev. 2017. Real-time adaptive image compression. arXiv preprint arXiv:1705.05823 (2017)."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/2945.764870"},{"key":"e_1_2_2_33_1","doi-asserted-by":"crossref","unstructured":"Michael Ruhnke Liefeng Bo Dieter Fox and Wolfram Burgard. 2013. Compact RGBD Surface Models Based on Sparse Coding. (2013).  Michael Ruhnke Liefeng Bo Dieter Fox and Wolfram Burgard. 2013. Compact RGBD Surface Models Based on Sparse Coding. (2013).","DOI":"10.1609\/aaai.v27i1.8549"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.2003.809582"},{"key":"e_1_2_2_35_1","volume-title":"Brislawn","author":"Schelkens Peter","year":"2006","unstructured":"Peter Schelkens , Adrian Munteanu , Alexis Tzannes , and Christopher M . Brislawn . 2006 . JPEG2000 Part 10 - Volumetric data encoding. (2006). Peter Schelkens, Adrian Munteanu, Alexis Tzannes, and Christopher M. Brislawn. 2006. JPEG2000 Part 10 - Volumetric data encoding. (2006)."},{"key":"e_1_2_2_36_1","volume-title":"Proc. of the Symposium on Geometry Processing.","author":"Sorkine Olga","year":"2003","unstructured":"Olga Sorkine , Daniel Cohen-Or , and Sivan Toledo . 2003 . High-Pass Quantization for Mesh Encoding .. In Proc. of the Symposium on Geometry Processing. Olga Sorkine, Daniel Cohen-Or, and Sivan Toledo. 2003. High-Pass Quantization for Mesh Encoding.. In Proc. of the Symposium on Geometry Processing."},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276478"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508384"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2898350"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980226"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2004.1260764"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2010.38"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3272127.3275096","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3272127.3275096","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:44:26Z","timestamp":1750207466000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3272127.3275096"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,12,4]]},"references-count":41,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2018,12,31]]}},"alternative-id":["10.1145\/3272127.3275096"],"URL":"https:\/\/doi.org\/10.1145\/3272127.3275096","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,12,4]]},"assertion":[{"value":"2018-12-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}