{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,1,11]],"date-time":"2023-01-11T02:27:05Z","timestamp":1673404025982},"reference-count":24,"publisher":"Association for Computing Machinery (ACM)","issue":"2","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2005,5]]},"abstract":"<jats:p>The goal of tele-immersion has long been to enable people at remote locations to share a sense of presence. A tele-immersion system acquires the 3D representation of a collaborator's environment remotely and sends it over the network where it is rendered in the user's environment. Acquisition, reconstruction, transmission, and rendering all have to be done in real-time to create a sense of presence. With added commodity hardware resources, parallelism can increase the acquisition volume and reconstruction data quality while maintaining real-time performance. However, this is not as easy for rendering since all of the data need to be combined into a single display.In this article, we present an algorithm to compress data from such 3D environments in real-time to solve this imbalance. We present a compression algorithm which scales comparably to the acquisition and reconstruction, reduces network transmission bandwidth, and reduces the rendering requirement for real-time performance. This is achieved by exploiting the coherence in the 3D environment data and removing them in real-time. We have tested the algorithm using a static office data set as well as a dynamic scene, the results of which are presented in the article.<\/jats:p>","DOI":"10.1145\/1062253.1062255","type":"journal-article","created":{"date-parts":[[2005,8,1]],"date-time":"2005-08-01T15:53:11Z","timestamp":1122911591000},"page":"128-150","update-policy":"http:\/\/dx.doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Real-time multidepth stream compression"],"prefix":"10.1145","volume":"1","author":[{"given":"Sang-Uok","family":"Kum","sequence":"first","affiliation":[{"name":"University of North Carolina, Chapel Hill, NC"}]},{"given":"Ketan","family":"Mayer-Patel","sequence":"additional","affiliation":[{"name":"University of North Carolina, Chapel Hill, NC"}]}],"member":"320","published-online":{"date-parts":[[2005,5]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Advanced Network and Services Inc. http:\/\/www.advanced.org.  Advanced Network and Services Inc. http:\/\/www.advanced.org."},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the International Workshop on Immersive Telepresence 2002 (Juan Les Pins, France).","author":"Baker H. H.","unstructured":"Baker , H. H. , Tanguaya , D. , Sobel , I. , Gelb , D. , Goss , M. E. , Culbertson , W. B. , and Malzbender , T . 2002. The Coliseum immersive teleconferencing system . In Proceedings of the International Workshop on Immersive Telepresence 2002 (Juan Les Pins, France). Baker, H. H., Tanguaya, D., Sobel, I., Gelb, D., Goss, M. E., Culbertson, W. B., and Malzbender, T. 2002. The Coliseum immersive teleconferencing system. In Proceedings of the International Workshop on Immersive Telepresence 2002 (Juan Les Pins, France)."},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques. ACM Press\/Addison-Wesley Publishing Co.","author":"Chang C.-F.","unstructured":"Chang , C.-F. , Bishop , G. , and Lastra , A . 1999. LDI tree: A hierarchical representation for image-based rendering . In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques. ACM Press\/Addison-Wesley Publishing Co. , Los Angeles, CA. 291--298. 10.1145\/311535.311571 Chang, C.-F., Bishop, G., and Lastra, A. 1999. LDI tree: A hierarchical representation for image-based rendering. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques. ACM Press\/Addison-Wesley Publishing Co., Los Angeles, CA. 291--298. 10.1145\/311535.311571"},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the 11th IEEE Visualization Conference","author":"Chen W.-C.","unstructured":"Chen , W.-C. , Towles , H. , Nyland , L. , Welch , G. , and Fuchs , H . 2000. Toward a compelling sensation of telepresence: Demonstrating a portal to a distant (static) office . In Proceedings of the 11th IEEE Visualization Conference ( Salt Lake City, Utah). 327--333. Chen, W.-C., Towles, H., Nyland, L., Welch, G., and Fuchs, H. 2000. Toward a compelling sensation of telepresence: Demonstrating a portal to a distant (static) office. In Proceedings of the 11th IEEE Visualization Conference (Salt Lake City, Utah). 327--333."},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques (Anaheim, Calif.). ACM","author":"Cruz-Neira C.","year":"1993","unstructured":"Cruz-Neira , C. , Sandin , D. J. , and DeFanti , T. A. 1993 . Surround-screen projection-based virtual reality: The design and implementation of the cave . In Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques (Anaheim, Calif.). ACM , New York, 135--142. 10.1145\/166117.166134 Cruz-Neira, C., Sandin, D. J., and DeFanti, T. A. 1993. Surround-screen projection-based virtual reality: The design and implementation of the cave. In Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques (Anaheim, Calif.). ACM, New York, 135--142. 10.1145\/166117.166134"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882350"},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the 9th Eurographics Workshop on Rendering Techniques","author":"Grossman J.","unstructured":"Grossman , J. and Dally , W. J . 1998. Point sample rendering . In Proceedings of the 9th Eurographics Workshop on Rendering Techniques ( Vienna, Austria). Springer-Verlag, New York, 181--192. Grossman, J. and Dally, W. J. 1998. Point sample rendering. In Proceedings of the 9th Eurographics Workshop on Rendering Techniques (Vienna, Austria). Springer-Verlag, New York, 181--192."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/331499.331504"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the 4th ACM International Conference on Collaborative Virtual Environments","author":"Kauff P.","year":"1878","unstructured":"Kauff , P. and Schreer , O . 2002. An immersive 3D video-conferencing system using shared virtual team user environments . In Proceedings of the 4th ACM International Conference on Collaborative Virtual Environments ( Bonn, Germany). ACM, New York, 105--112. 10.1145\/57 1878 .571895 Kauff, P. and Schreer, O. 2002. An immersive 3D video-conferencing system using shared virtual team user environments. In Proceedings of the 4th ACM International Conference on Collaborative Virtual Environments (Bonn, Germany). ACM, New York, 105--112. 10.1145\/571878.571895"},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the the Terascale Performance Analysis Workshop at International Conference on Computational Science","author":"Kelshikar N.","unstructured":"Kelshikar , N. , Zabulis , X. , Mulligan , J. , Daniilidis , K. , Sawant , V. , Sinha , S. , Sparks , T. , Larsen , S. , Towles , H. , Mayer-Patel , K. , Fuchs , H. , Urbanic , J. , Benninger , K. , Reddy , R. , and Huntoon , G . 2003. Real-time terascale implementation of tele-immersion . In Proceedings of the the Terascale Performance Analysis Workshop at International Conference on Computational Science ( Melbourne, Australia). Kelshikar, N., Zabulis, X., Mulligan, J., Daniilidis, K., Sawant, V., Sinha, S., Sparks, T., Larsen, S., Towles, H., Mayer-Patel, K., Fuchs, H., Urbanic, J., Benninger, K., Reddy, R., and Huntoon, G. 2003. Real-time terascale implementation of tele-immersion. In Proceedings of the the Terascale Performance Analysis Workshop at International Conference on Computational Science (Melbourne, Australia)."},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the 11th ACM International Conference on Multimedia","author":"Kum S.-U.","unstructured":"Kum , S.-U. , Mayer-Patel , K. , and Fuchs , H . 2003. Real-time compression for dynamic 3D environments . In Proceedings of the 11th ACM International Conference on Multimedia ( Berkeley, Calif.). ACM, New York, 185--194. 10.1145\/957013.957050 Kum, S.-U., Mayer-Patel, K., and Fuchs, H. 2003. Real-time compression for dynamic 3D environments. In Proceedings of the 11th ACM International Conference on Multimedia (Berkeley, Calif.). ACM, New York, 185--194. 10.1145\/957013.957050"},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (New Orleans, La.). ACM Press\/Addison-Wesley Publishing Co., 369--374","author":"Matusik W.","year":"2000","unstructured":"Matusik , W. , Buehler , C. , Raskar , R. , Gortler , S. J. , and McMillan , L. 2000 . Image-based visual hulls . In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (New Orleans, La.). ACM Press\/Addison-Wesley Publishing Co., 369--374 . 10.1145\/344779.344951 Matusik, W., Buehler, C., Raskar, R., Gortler, S. J., and McMillan, L. 2000. Image-based visual hulls. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (New Orleans, La.). ACM Press\/Addison-Wesley Publishing Co., 369--374. 10.1145\/344779.344951"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques","author":"McMillan L.","year":"1838","unstructured":"McMillan , L. and Bishop , G . 1995. Plenoptic modeling: An image-based rendering system . In Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques ( Los Angeles, Calif.). ACM, New York, 39--46. 10.1145\/2 1838 0.218398 McMillan, L. and Bishop, G. 1995. Plenoptic modeling: An image-based rendering system. In Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques (Los Angeles, Calif.). ACM, New York, 39--46. 10.1145\/218380.218398"},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the 19th Annual Conference on Computer Graphics and Interactive Techniques","author":"Molnar S.","unstructured":"Molnar , S. , Eyles , J. , and Poulton , J . 1992. PixelFlow: High-speed rendering using image composition . In Proceedings of the 19th Annual Conference on Computer Graphics and Interactive Techniques ( Chicago, Ill.). ACM, New York, 231--240. 10.1145\/133994.134067 Molnar, S., Eyles, J., and Poulton, J. 1992. PixelFlow: High-speed rendering using image composition. In Proceedings of the 19th Annual Conference on Computer Graphics and Interactive Techniques (Chicago, Ill.). ACM, New York, 231--240. 10.1145\/133994.134067"},{"key":"e_1_2_1_15_1","unstructured":"Office of the Future Project. http:\/\/www.cs.unc.edu\/~ootf.  Office of the Future Project. http:\/\/www.cs.unc.edu\/~ootf."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8655(99)00069-0"},{"key":"e_1_2_1_17_1","unstructured":"Pittsburgh Supercomputing Center. http:\/\/www.psc.edu.  Pittsburgh Supercomputing Center. http:\/\/www.psc.edu."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000025798.50602.3a"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (New Orleans, La.) ACM Press\/Addison-Wesley Publishing Co., 343--352","author":"Rusinkiewicz S.","unstructured":"Rusinkiewicz , S. and Levoy , M . 2000. QSplat: A multiresolution point rendering system for large meshes . In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (New Orleans, La.) ACM Press\/Addison-Wesley Publishing Co., 343--352 . 10.1145\/344779.344940 Rusinkiewicz, S. and Levoy, M. 2000. QSplat: A multiresolution point rendering system for large meshes. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (New Orleans, La.) ACM Press\/Addison-Wesley Publishing Co., 343--352. 10.1145\/344779.344940"},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques (Orlando, Fla.). ACM","author":"Shade J.","unstructured":"Shade , J. , Gortler , S. , He , L. , and Szeliski , R . 1998. Layered depth images . In Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques (Orlando, Fla.). ACM , New York, 231--242. 10.1145\/280814.280882 Shade, J., Gortler, S., He, L., and Szeliski, R. 1998. Layered depth images. In Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques (Orlando, Fla.). ACM, New York, 231--242. 10.1145\/280814.280882"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques","author":"Stoll G.","unstructured":"Stoll , G. , Eldridge , M. , Patterson , D. , Webb , A. , Berman , S. , Levy , R. , Caywood , C. , Taveira , M. , Hunt , S. , and Hanrahan , P . 2001. Lightning-2: A high performance display subsystem for PC clusters . In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques ( Los Angeles, Calif.). ACM, New York, 141--148. 10.1145\/383259.383273 Stoll, G., Eldridge, M., Patterson, D., Webb, A., Berman, S., Levy, R., Caywood, C., Taveira, M., Hunt, S., and Hanrahan, P. 2001. Lightning-2: A high performance display subsystem for PC clusters. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (Los Angeles, Calif.). ACM, New York, 141--148. 10.1145\/383259.383273"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the International Workshop on Immersive Telepresence 2002 (Juan Les Pins, France).","author":"Towles H.","unstructured":"Towles , H. , Chen , W.-C. , Yang , R. , Kum , S.-U. , Fuchs , H. , Kelshikar , N. , Mulligan , J. , Daniilidis , K. , Holden , L. , Zeleznik , B. , Sadagic , A. , and Lanier , J . 2002. 3D tele-immersion over internet2 . In Proceedings of the International Workshop on Immersive Telepresence 2002 (Juan Les Pins, France). Towles, H., Chen, W.-C., Yang, R., Kum, S.-U., Fuchs, H., Kelshikar, N., Mulligan, J., Daniilidis, K., Holden, L., Zeleznik, B., Sadagic, A., and Lanier, J. 2002. 3D tele-immersion over internet2. In Proceedings of the International Workshop on Immersive Telepresence 2002 (Juan Les Pins, France)."},{"key":"e_1_2_1_23_1","unstructured":"University of Pennsylvania GRASP Lab. http:\/\/www.grasp.upenn.edu.  University of Pennsylvania GRASP Lab. http:\/\/www.grasp.upenn.edu."},{"key":"e_1_2_1_24_1","doi-asserted-by":"crossref","unstructured":"W&uurl;rmlin S. Lamboray E. and Gross M. 2004. 3D video fragments: Dynamic point samples for real-time free-viewpoint video. Computers & Graphics Special Issue on Coding Compression and Streaming Techniques for 3D and Multimedia Data 28 1 (Feb.) 3--14.  W&uurl;rmlin S. Lamboray E. and Gross M. 2004. 3D video fragments: Dynamic point samples for real-time free-viewpoint video. Computers & Graphics Special Issue on Coding Compression and Streaming Techniques for 3D and Multimedia Data 28 1 (Feb.) 3--14.","DOI":"10.1016\/j.cag.2003.10.015"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1062253.1062255","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T15:13:34Z","timestamp":1672240414000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1062253.1062255"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2005,5]]},"references-count":24,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2005,5]]}},"alternative-id":["10.1145\/1062253.1062255"],"URL":"https:\/\/doi.org\/10.1145\/1062253.1062255","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2005,5]]},"assertion":[{"value":"2005-05-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}