{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,7]],"date-time":"2026-04-07T03:36:41Z","timestamp":1775533001177,"version":"3.50.1"},"reference-count":49,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2023,2,6]],"date-time":"2023-02-06T00:00:00Z","timestamp":1675641600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Science Foundation","award":["CCF-2031881, ECCS-2032387, CNS-2040088, CNS-2032033, and CNS-2106150"],"award-info":[{"award-number":["CCF-2031881, ECCS-2032387, CNS-2040088, CNS-2032033, and CNS-2106150"]}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"crossref","award":["R01EY030470"],"award-info":[{"award-number":["R01EY030470"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Panasonic Chair of Sustainability at the New Jersey Institute for Technology"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2023,5,31]]},"abstract":"<jats:p>Dual-connectivity streaming is a key enabler of next-generation six Degrees Of Freedom (6DOF) Virtual Reality (VR) scene immersion. Indeed, using conventional sub-6 GHz WiFi only allows to reliably stream a low-quality baseline representation of the VR content, while emerging high-frequency communication technologies allow to stream in parallel a high-quality user viewport-specific enhancement representation that synergistically integrates with the baseline representation to deliver high-quality VR immersion. We investigate holistically as part of an entire future VR streaming system two such candidate emerging technologies, Free Space Optics (FSO) and millimeter-Wave (mmWave), that benefit from a large available spectrum to deliver unprecedented data rates. We analytically characterize the key components of the envisioned dual-connectivity 6DOF VR streaming system that integrates in addition edge computing and scalable 360\u00b0 video tiling, and we formulate an optimization problem to maximize the immersion fidelity delivered by the system, given the WiFi and mmWave\/FSO link rates, and the computing capabilities of the edge server and the users\u2019 VR headsets. This optimization problem is mixed integer programming of high complexity and we formulate a geometric programming framework to compute the optimal solution at low complexity. We carry out simulation experiments to assess the performance of the proposed system using actual 6DOF navigation traces from multiple mobile VR users that we collected. Our results demonstrate that our system considerably advances the traditional state of the art and enables streaming of 8K-120 frames-per-second (fps) 6DOF content at high fidelity.<\/jats:p>","DOI":"10.1145\/3544494","type":"journal-article","created":{"date-parts":[[2022,6,16]],"date-time":"2022-06-16T10:07:26Z","timestamp":1655374046000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":21,"title":["Millimeter Wave and Free-space-optics for Future Dual-connectivity 6DOF Mobile Multi-user VR Streaming"],"prefix":"10.1145","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2428-9518","authenticated-orcid":false,"given":"Jacob","family":"Chakareski","sequence":"first","affiliation":[{"name":"New Jersey Institute of Technology, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7679-3997","authenticated-orcid":false,"given":"Mahmudur","family":"Khan","sequence":"additional","affiliation":[{"name":"York College of Pennsylvania, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3177-8715","authenticated-orcid":false,"given":"Tanguy","family":"Ropitault","sequence":"additional","affiliation":[{"name":"Wireless Networks Division, National Institute of Standards and Technology, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0250-8337","authenticated-orcid":false,"given":"Steve","family":"Blandino","sequence":"additional","affiliation":[{"name":"Wireless Networks Division, National Institute of Standards and Technology, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,2,6]]},"reference":[{"key":"e_1_3_1_2_2","first-page":"21","volume-title":"Proc. ACM Workshop on Micro Aerial Vehicle Networks, Systems, and Applications","author":"Chakareski Jacob","year":"2017","unstructured":"Jacob Chakareski. 2017. Drone networks for virtual human teleportation. In Proc. ACM Workshop on Micro Aerial Vehicle Networks, Systems, and Applications. 21\u201326."},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2011.2182069"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2019.2921869"},{"key":"e_1_3_1_5_2","volume-title":"Proc. 116th MPEG Meeting of ISO\/IEC JTC1\/SC29\/WG11","author":"Champel T. Stockhammer","year":"2016","unstructured":"T. Stockhammer Champel, T. Fautier, E. Thomas, and R. Koenen. 2016. Quality requirements for VR. In Proc. 116th MPEG Meeting of ISO\/IEC JTC1\/SC29\/WG11 MPEG, vol. 116, p. m39532."},{"key":"e_1_3_1_6_2","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781107278929","volume-title":"Principles of LED Light Communications: Towards Networked Li-Fi","author":"Dimitrov Svilen","year":"2015","unstructured":"Svilen Dimitrov and Harald Haas. 2015. Principles of LED Light Communications: Towards Networked Li-Fi. Cambridge University Press."},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/MVT.2019.2921162"},{"key":"e_1_3_1_8_2","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1145\/3211960.3211971","volume-title":"Proc. ACM Workshop on Wearable Systems and Applications","author":"Rahman Md Shaifur","year":"2018","unstructured":"Md Shaifur Rahman, Kai Zheng, and Himanshu Gupta. 2018. FSO-VR: Steerable free space optics link for virtual reality headsets. In Proc. ACM Workshop on Wearable Systems and Applications. 11\u201315."},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2020.2966322"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSI.2018.2866933"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2008.921846"},{"key":"e_1_3_1_12_2","article-title":"Why the Internet pipes will burst when virtual reality takes off","author":"Begole Bo","year":"2016","unstructured":"Bo Begole. 2016. Why the Internet pipes will burst when virtual reality takes off. Forbes Magazine.","journal-title":"Forbes Magazine"},{"key":"e_1_3_1_13_2","volume-title":"Proc. IEEE Int\u2019l Conf. Communications","author":"Chakareski J.","year":"2018","unstructured":"J. Chakareski, R. Aksu, X. Corbillon, G. Simon, and V. Swaminathan. 2018. Viewport-driven rate-distortion optimized 360 \\(^\\circ\\) video streaming. In Proc. IEEE Int\u2019l Conf. Communications."},{"key":"e_1_3_1_14_2","volume-title":"Proc. Int\u2019l Conf. Communications","author":"Corbillon X.","year":"2017","unstructured":"X. Corbillon, A. Devlic, G. Simon, and J. Chakareski. 2017. Viewport-adaptive navigable 360-degree video delivery. In Proc. Int\u2019l Conf. Communications. IEEE."},{"key":"e_1_3_1_15_2","volume-title":"Proc. IEEE Int\u2019l Symp. Multimedia","author":"Hosseini Mohammad","year":"2016","unstructured":"Mohammad Hosseini and Viswanathan Swaminathan. 2016. Adaptive 360 VR video streaming: Divide and conquer! In Proc. IEEE Int\u2019l Symp. Multimedia."},{"key":"e_1_3_1_16_2","first-page":"7","volume-title":"Proc. HotMobile","author":"Cuervo Eduardo","year":"2018","unstructured":"Eduardo Cuervo, Krishna Chintalapudi, and Manikanta Kotaru. 2018. Creating the perfect illusion: What will it take to create life-like virtual reality headsets? In Proc. HotMobile. ACM, 7\u201312."},{"key":"e_1_3_1_17_2","first-page":"7","volume-title":"Proceedings of the 8th Asia-Pacific Workshop on Systems","author":"Zhong Ruiguang","year":"2017","unstructured":"Ruiguang Zhong, Manni Wang, Zijian Chen, Luyang Liu, Yunxin Liu, Jiansong Zhang, Lintao Zhang, and Thomas Moscibroda. 2017. On building a programmable wireless high-quality virtual reality system using commodity hardware. In Proceedings of the 8th Asia-Pacific Workshop on Systems. ACM, 7."},{"key":"e_1_3_1_18_2","first-page":"531","volume-title":"Proc. Symposium on Networked Systems Design and Implementation","author":"Abari Omid","year":"2017","unstructured":"Omid Abari, Dinesh Bharadia, Austin Duffield, and Dina Katabi. 2017. Enabling high-quality untethered virtual reality. In Proc. Symposium on Networked Systems Design and Implementation. 531\u2013544."},{"key":"e_1_3_1_19_2","first-page":"1","volume-title":"Proc. IEEE International Conference on Communications Workshops","author":"Khan Mahmudur","year":"2019","unstructured":"Mahmudur Khan and Jacob Chakareski. 2019. Visible light communication for next generation untethered virtual reality systems. In Proc. IEEE International Conference on Communications Workshops. 1\u20136."},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.001.1900272"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/MNET.101.2000364"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2005.864284"},{"key":"e_1_3_1_23_2","volume-title":"Proc. IEEE INFOCOM Int\u2019l Workshop on Carrier-grade Wireless Mesh Networks","author":"Reis A. B.","year":"2010","unstructured":"A. B. Reis, J. Chakareski, A. Kassler, and S. Sargento. 2010. Distortion optimized multi-service scheduling for next generation wireless mesh networks. In Proc. IEEE INFOCOM Int\u2019l Workshop on Carrier-grade Wireless Mesh Networks. USA."},{"key":"e_1_3_1_24_2","first-page":"1001","volume-title":"Proc. Int\u2019l Conf. Acoustics, Speech, and Signal Processing","author":"Chakareski J.","year":"2004","unstructured":"J. Chakareski, J. Apostolopoulos, W.-T. Tan, S. Wee, and B. Girod. 2004. Distortion chains for predicting the video distortion for general packet loss patterns. In Proc. Int\u2019l Conf. Acoustics, Speech, and Signal Processing, Vol. 5. IEEE, 1001\u20131004."},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2005.854227"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2006.886299"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCOMM.2004.836436"},{"issue":"8","key":"e_1_3_1_28_2","doi-asserted-by":"crossref","first-page":"718","DOI":"10.1364\/JOCN.7.000718","article-title":"10 Gbps mobile visible light communication system employing angle diversity, imaging receivers, and relay nodes","volume":"7","author":"Hussein Ahmed Taha","year":"2015","unstructured":"Ahmed Taha Hussein and Jaafar M. H. Elmirghani. 2015. 10 Gbps mobile visible light communication system employing angle diversity, imaging receivers, and relay nodes. OSA Journal of Optical Communications and Networking 7, 8 (2015), 718\u2013735.","journal-title":"OSA Journal of Optical Communications and Networking"},{"key":"e_1_3_1_29_2","unstructured":"NVIDIA GeForce GTX 980. n.d. https:\/\/www.techpowerup.com\/gpu-specs\/geforce-gtx-980.c2621."},{"key":"e_1_3_1_30_2","unstructured":"GPU Systems. n.d. https:\/\/www.supermicro.com\/en\/products\/GPU\/."},{"key":"e_1_3_1_31_2","unstructured":"NVIDIA Video Encode and Decode GPU Support Matrix. n.d. https:\/\/developer.nvidia.com\/video-encode-and-decode-gpu-support-matrix-new."},{"issue":"1","key":"e_1_3_1_32_2","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1109\/TCSVT.2015.2461951","article-title":"Overview of SHVC: Scalable extensions of the high efficiency video coding standard","volume":"26","author":"Boyce Jill M.","year":"2015","unstructured":"Jill M. Boyce, Yan Ye, Jianle Chen, and Adarsh K. Ramasubramonian. 2015. Overview of SHVC: Scalable extensions of the high efficiency video coding standard. IEEE Transactions on Circuits and Systems for Video Technology 26, 1 (2015), 20\u201334.","journal-title":"IEEE Transactions on Circuits and Systems for Video Technology"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2020.2986547"},{"key":"e_1_3_1_34_2","unstructured":"QualComm Adreno 650 GPU. n.d. https:\/\/www.qualcomm.com\/snapdragon\/processors\/comparison."},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2013.10.016"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.5555\/993483"},{"key":"e_1_3_1_37_2","volume-title":"Free Space Optics: Enabling Optical Connectivity in Today\u2019s Networks","author":"Willebrand Heinz","year":"2002","unstructured":"Heinz Willebrand and Baksheesh S. Ghuman. 2002. Free Space Optics: Enabling Optical Connectivity in Today\u2019s Networks. SAMS Publishing."},{"key":"e_1_3_1_38_2","first-page":"1","volume-title":"Proc. IEEE International Conference on Communications","author":"Zeng Zhihong","year":"2019","unstructured":"Zhihong Zeng, Mohammad Dehghani Soltani, Majid Safari, and Harald Haas. May 2019. Angle diversity receiver in LiFi cellular networks. In Proc. IEEE International Conference on Communications. 1\u20136."},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2002.808163"},{"key":"e_1_3_1_40_2","doi-asserted-by":"crossref","first-page":"966","DOI":"10.1109\/GLOCOMW.2014.7063558","volume-title":"2014 IEEE Globecom Workshops (GC Wkshps\u201914)","author":"Maltsev Alexander","year":"2014","unstructured":"Alexander Maltsev, Andrey Pudeyev, Ingolf Karls, Ilya Bolotin, Gregory Morozov, Richard Weiler, Michael Peter, and Wilhelm Keusgen. 2014. Quasi-deterministic approach to mmWave channel modeling in a non-stationary environment. In 2014 IEEE Globecom Workshops (GC Wkshps\u201914). IEEE, 966\u2013971."},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1016\/0166-218X(94)90039-6"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/OJVT.2021.3138697"},{"key":"e_1_3_1_43_2","unstructured":"Virtual Museum. n.d. https:\/\/assetstore.unity.com\/packages\/3d\/environments\/museum-117927."},{"key":"e_1_3_1_44_2","unstructured":"SteamVR SDK. n.d.https:\/\/github.com\/ValveSoftware\/openvr."},{"key":"e_1_3_1_45_2","unstructured":"Opentrack tracking. n.d. https:\/\/github.com\/opentrack\/opentrack."},{"key":"e_1_3_1_46_2","unstructured":"M. Khan and J. Chakareski. n.d. NJIT 6DOF VR Navigation Dataset. https:\/\/www.jakov.org."},{"key":"e_1_3_1_47_2","unstructured":"NIST and Universit\u00e0 di Padova. n.d. Q-D realization software. https:\/\/github.com\/wigig-tools\/qd-realization."},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/3321349.3321354"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3337941.3337946"},{"key":"e_1_3_1_50_2","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1145\/3083187.3083224","volume-title":"Proc. Multimedia Systems Conference","author":"Petrangeli Stefano","year":"2017","unstructured":"Stefano Petrangeli, Viswanathan Swaminathan, Mohammad Hosseini, and Filip De Turck. 2017. Improving virtual reality streaming using HTTP\/2. In Proc. Multimedia Systems Conference. ACM, 225\u2013228."}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3544494","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3544494","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:02:54Z","timestamp":1750186974000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3544494"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,6]]},"references-count":49,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,5,31]]}},"alternative-id":["10.1145\/3544494"],"URL":"https:\/\/doi.org\/10.1145\/3544494","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,6]]},"assertion":[{"value":"2022-02-09","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-05-31","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-02-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}