{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T17:29:00Z","timestamp":1790875740669,"version":"4.1.0"},"reference-count":53,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2017,4,11]],"date-time":"2017-04-11T00:00:00Z","timestamp":1491868800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2017,5,31]]},"abstract":"<jats:p>This article proposes an application-layer multiplexing scheme for teleoperation systems with multimodal feedback (video, audio, and haptics). The available transmission resources are carefully allocated to avoid delay-jitter for the haptic signal potentially caused by the size and arrival time of the video and audio data. The multiplexing scheme gives high priority to the haptic signal and applies a preemptive-resume scheduling strategy to stream the audio and video data. The proposed approach estimates the available transmission rate in real time and adapts the video bitrate, data throughput, and force buffer size accordingly. Furthermore, the proposed scheme detects sudden transmission rate drops and applies congestion control to avoid abrupt delay increases and converge promptly to the altered transmission rate. The performance of the proposed scheme is measured objectively in terms of end-to-end signal latencies, packet rates, and peak signal-to-noise ratio (PSNR) for visual quality. Moreover, peak-delay and convergence time measurements are carried out to investigate the performance of the congestion control mode of the system.<\/jats:p>","DOI":"10.1145\/3063594","type":"journal-article","created":{"date-parts":[[2017,4,12]],"date-time":"2017-04-12T12:05:49Z","timestamp":1491998749000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":47,"title":["A Multiplexing Scheme for Multimodal Teleoperation"],"prefix":"10.1145","volume":"13","author":[{"given":"Burak","family":"Cizmeci","sequence":"first","affiliation":[{"name":"Technical University of Munich, Arcisstrasse, Munich\/Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiao","family":"Xu","sequence":"additional","affiliation":[{"name":"Technical University of Munich, Arcisstrasse, Munich\/Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rahul","family":"Chaudhari","sequence":"additional","affiliation":[{"name":"Technical University of Munich, Arcisstrasse, Munich\/Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christoph","family":"Bachhuber","sequence":"additional","affiliation":[{"name":"Technical University of Munich, Arcisstrasse, Munich\/Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicolas","family":"Alt","sequence":"additional","affiliation":[{"name":"Technical University of Munich, Arcisstrasse, Munich\/Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eckehard","family":"Steinbach","sequence":"additional","affiliation":[{"name":"Technical University of Munich, Arcisstrasse, Munich\/Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2017,4,11]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"MAKO G-223 Gigabit Ethernet Industrial Machine Vision Camera. Retrieved","author":"Vision Allied","year":"2017","unstructured":"Allied Vision . 1992. MAKO G-223 Gigabit Ethernet Industrial Machine Vision Camera. Retrieved March 1, 2017 from https:\/\/www.alliedvision.com. Allied Vision. 1992. MAKO G-223 Gigabit Ethernet Industrial Machine Vision Camera. Retrieved March 1, 2017 from https:\/\/www.alliedvision.com."},{"key":"e_1_2_2_2_1","volume-title":"Netropy N60 Hardware Network Emulator. Retrieved","author":"APPOSITE-TECH.","year":"2017","unstructured":"APPOSITE-TECH. 2005. Netropy N60 Hardware Network Emulator. Retrieved March 1, 2017 from http:\/\/www.apposite-tech.com\/. APPOSITE-TECH. 2005. Netropy N60 Hardware Network Emulator. Retrieved March 1, 2017 from http:\/\/www.apposite-tech.com\/."},{"key":"e_1_2_2_3_1","volume-title":"IEEE International Conference on Image Processing (ICIP\u201916)","author":"Bachhuber C.","unstructured":"C. Bachhuber and E. Steinbach . 2016. A system for high precision glass-to-glass delay measurements in video communication . In IEEE International Conference on Image Processing (ICIP\u201916) . 2132--2136. C. Bachhuber and E. Steinbach. 2016. A system for high precision glass-to-glass delay measurements in video communication. In IEEE International Conference on Image Processing (ICIP\u201916). 2132--2136."},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/49.464716"},{"key":"e_1_2_2_5_1","volume-title":"Force and Touch Feedback for Virtual Reality","author":"Burdea G. C.","unstructured":"G. C. Burdea . 1996. Force and Touch Feedback for Virtual Reality . John Wiley 8 Sons, New York, NY. G. C. Burdea. 1996. Force and Touch Feedback for Virtual Reality. John Wiley 8 Sons, New York, NY."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2004.5"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1016590112381"},{"key":"e_1_2_2_8_1","volume-title":"IEEE International Conference on Intelligent Robots and Systems. 1630--1635","author":"Cen Z.","unstructured":"Z. Cen , M. Mutka , Y. Liu , A. Goradia , and N. Xi . 2005a. QoS management of supermedia enhanced teleoperation via overlay networks . In IEEE International Conference on Intelligent Robots and Systems. 1630--1635 . Z. Cen, M. Mutka, Y. Liu, A. Goradia, and N. Xi. 2005a. QoS management of supermedia enhanced teleoperation via overlay networks. In IEEE International Conference on Intelligent Robots and Systems. 1630--1635."},{"key":"e_1_2_2_9_1","volume-title":"IEEE International Conference on Mobile Adhoc and Sensor Systems. 340--347","author":"Cen Z.","year":"2005","unstructured":"Z. Cen , M. W. Mutka , Danyu Zhu , and Ning Xi . 2005 b. Improved transport service for remote sensing and control over wireless networks . In IEEE International Conference on Mobile Adhoc and Sensor Systems. 340--347 . Z. Cen, M. W. Mutka, Danyu Zhu, and Ning Xi. 2005b. Improved transport service for remote sensing and control over wireless networks. In IEEE International Conference on Mobile Adhoc and Sensor Systems. 340--347."},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/WHC.2007.20"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-44196-1_17"},{"key":"e_1_2_2_12_1","volume-title":"IEEE International Conference on Robotics and Automation. 3205--3210","author":"Colgate J. E.","unstructured":"J. E. Colgate and J. M. Brown . 1994. Factors affecting the z-width of a haptic display . In IEEE International Conference on Robotics and Automation. 3205--3210 . J. E. Colgate and J. M. Brown. 1994. Factors affecting the z-width of a haptic display. In IEEE International Conference on Robotics and Automation. 3205--3210."},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2008.2001383"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/MVT.2015.2410786"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIM.2010.2065530"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/THFE.1965.6591253"},{"key":"e_1_2_2_17_1","volume-title":"6-DoF Haptic Device. Retrieved","author":"FORCE DIMENSION.","year":"2017","unstructured":"FORCE DIMENSION. 2001. Omega 6 , 6-DoF Haptic Device. Retrieved March 1, 2017 from http:\/\/www.forcedimension.com\/. FORCE DIMENSION. 2001. Omega 6, 6-DoF Haptic Device. Retrieved March 1, 2017 from http:\/\/www.forcedimension.com\/."},{"key":"e_1_2_2_18_1","volume-title":"IEEE Picture Coding Symposium. 210--215","author":"Gao M.","unstructured":"M. Gao , B. Cizmeci , M. Eiler , E. Steinbach , D. Zhao , and W. Gao . 2015. Macroblock level rate control for low delay H.264\/AVC based video communication . In IEEE Picture Coding Symposium. 210--215 . M. Gao, B. Cizmeci, M. Eiler, E. Steinbach, D. Zhao, and W. Gao. 2015. Macroblock level rate control for low delay H.264\/AVC based video communication. In IEEE Picture Coding Symposium. 210--215."},{"key":"e_1_2_2_19_1","volume-title":"IEEE International Conference on Robotics and Biomimetics (ROBIO\u201912). 2018","author":"Goeller M.","year":"2023","unstructured":"M. Goeller , J. Oberlaender , K. Uhl , A. Roennau , and R. Dillmann . 2012. Modular robots for on-orbit satellite servicing . In IEEE International Conference on Robotics and Biomimetics (ROBIO\u201912). 2018 -- 2023 . M. Goeller, J. Oberlaender, K. Uhl, A. Roennau, and R. Dillmann. 2012. Modular robots for on-orbit satellite servicing. In IEEE International Conference on Robotics and Biomimetics (ROBIO\u201912). 2018--2023."},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2007.906746"},{"key":"e_1_2_2_21_1","volume-title":"IEEE International Conference on Acoustics, Speech and Signal Processing. 1097--1100","author":"Hinterseer P.","unstructured":"P. Hinterseer , E. Steinbach , S. Hirche , and M. Buss . 2005. A novel psychophysically motivated transmission approach for haptic data streams in telepresence and teleaction systems . In IEEE International Conference on Acoustics, Speech and Signal Processing. 1097--1100 . P. Hinterseer, E. Steinbach, S. Hirche, and M. Buss. 2005. A novel psychophysically motivated transmission approach for haptic data streams in telepresence and teleaction systems. In IEEE International Conference on Acoustics, Speech and Signal Processing. 1097--1100."},{"key":"e_1_2_2_22_1","volume-title":"16th IFAC World Congress. 77--82","author":"Hirche S.","unstructured":"S. Hirche , P. Hinterseer , E. Steinbach , and M. Buss . 2005. Network traffic reduction in haptic telepresence systems by deadband control . In 16th IFAC World Congress. 77--82 . S. Hirche, P. Hinterseer, E. Steinbach, and M. Buss. 2005. Network traffic reduction in haptic telepresence systems by deadband control. In 16th IFAC World Congress. 77--82."},{"key":"e_1_2_2_23_1","volume-title":"TENCON 2011 - IEEE Region 10 Conference. 1085--1089","author":"Isomura E.","unstructured":"E. Isomura , S. Tasaka , and T. Nunome . 2011. QoE enhancement in audiovisual and haptic interactive IP communications by media adaptive intra-stream synchronization . In TENCON 2011 - IEEE Region 10 Conference. 1085--1089 . E. Isomura, S. Tasaka, and T. Nunome. 2011. QoE enhancement in audiovisual and haptic interactive IP communications by media adaptive intra-stream synchronization. In TENCON 2011 - IEEE Region 10 Conference. 1085--1089."},{"key":"e_1_2_2_24_1","unstructured":"ITU-T. 1993. ITU-T JPEG Standard Digital Compression and Coding of Continuous-tone Still Images. ITU-T. 1993. ITU-T JPEG Standard Digital Compression and Coding of Continuous-tone Still Images."},{"key":"e_1_2_2_25_1","unstructured":"ITU-T. 2005. ITU-T H.264 Advanced Video Coding for Generic Audiovisual Services. ITU-T. 2005. ITU-T H.264 Advanced Video Coding for Generic Audiovisual Services."},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/CSE.2015.24"},{"key":"e_1_2_2_27_1","volume-title":"KUKA Leight Weight Robot Arm. (1898). Retrieved","author":"Robotics KUKA","year":"2017","unstructured":"KUKA Robotics . 1898. KUKA Leight Weight Robot Arm. (1898). Retrieved March 1, 2017 from http:\/\/www.kuka-robotics.com\/. KUKA Robotics. 1898. KUKA Leight Weight Robot Arm. (1898). Retrieved March 1, 2017 from http:\/\/www.kuka-robotics.com\/."},{"key":"e_1_2_2_28_1","volume-title":"IEEE International Conference on Robotics and Automation. 2933--2938","author":"Kuschel M.","unstructured":"M. Kuschel , P. Kremer , S. Hirche , and M. Buss . 2006. Lossy data reduction methods for haptic telepresence systems . In IEEE International Conference on Robotics and Automation. 2933--2938 . M. Kuschel, P. Kremer, S. Hirche, and M. Buss. 2006. Lossy data reduction methods for haptic telepresence systems. In IEEE International Conference on Robotics and Automation. 2933--2938."},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1230040.1230078"},{"key":"e_1_2_2_30_1","doi-asserted-by":"crossref","first-page":"841590","DOI":"10.1155\/2008\/841590","article-title":"Providing QoS for networked peers in distributed haptic virtual environments","volume":"2008","author":"Marshall Alan","year":"2008","unstructured":"Alan Marshall , Kian Meng Yap , and Wai Yu . 2008 . Providing QoS for networked peers in distributed haptic virtual environments . Hindawi, Journal of Advances in Multimedia 2008 , 841590 . Alan Marshall, Kian Meng Yap, and Wai Yu. 2008. Providing QoS for networked peers in distributed haptic virtual environments. Hindawi, Journal of Advances in Multimedia 2008, 841590.","journal-title":"Hindawi, Journal of Advances in Multimedia"},{"key":"e_1_2_2_31_1","unstructured":"L. Merritt and R. Vanam. 2004. x264: A High Performance H.264\/AVC Encoder. Retrieved March 1 2017 from http:\/\/www.videolan.org\/developers\/x264.html. L. Merritt and R. Vanam. 2004. x264: A High Performance H.264\/AVC Encoder. Retrieved March 1 2017 from http:\/\/www.videolan.org\/developers\/x264.html."},{"key":"e_1_2_2_32_1","volume-title":"IEEE International Workshop on Haptic, Audio and Visual Environments and Games. 96--101","author":"Osman H. A.","unstructured":"H. A. Osman , M. Eid , R. Iglesias , and A. El Saddik . 2007. ALPHAN: Application layer protocol for haptic networking . In IEEE International Workshop on Haptic, Audio and Visual Environments and Games. 96--101 . H. A. Osman, M. Eid, R. Iglesias, and A. El Saddik. 2007. ALPHAN: Application layer protocol for haptic networking. In IEEE International Workshop on Haptic, Audio and Visual Environments and Games. 96--101."},{"key":"e_1_2_2_33_1","volume-title":"IEEE Proceedings of Networking, Sensing and Control. 1049--1053","author":"Ping L.","unstructured":"L. Ping , L. Wenjuan , and S. Zengqi . 2005. Transport layer protocol reconfiguration for network-based robot control system . In IEEE Proceedings of Networking, Sensing and Control. 1049--1053 . L. Ping, L. Wenjuan, and S. Zengqi. 2005. Transport layer protocol reconfiguration for network-based robot control system. In IEEE Proceedings of Networking, Sensing and Control. 1049--1053."},{"key":"e_1_2_2_34_1","volume-title":"Portable Cross Platform Audio I\/O. Retrieved","year":"2017","unstructured":"PortAudio. 1999. Portable Cross Platform Audio I\/O. Retrieved March 1, 2017 from http:\/\/portaudio.com\/. PortAudio. 1999. Portable Cross Platform Audio I\/O. Retrieved March 1, 2017 from http:\/\/portaudio.com\/."},{"key":"e_1_2_2_35_1","volume-title":"IEEE International Conference of Engineering in Medicine and Biology Society. 3094--3097","author":"Pyke J.","unstructured":"J. Pyke , M. Hart , V. Popov , R. D. Harris , and S. McGrath . 2007. A tele-ultrasound system for real-time medical imaging in resource-limited settings . In IEEE International Conference of Engineering in Medicine and Biology Society. 3094--3097 . J. Pyke, M. Hart, V. Popov, R. D. Harris, and S. McGrath. 2007. A tele-ultrasound system for real-time medical imaging in resource-limited settings. In IEEE International Conference of Engineering in Medicine and Biology Society. 3094--3097."},{"key":"e_1_2_2_36_1","volume-title":"JR3 6-DoF Force-Torque Sensor. Retrieved","author":"Ramming John","year":"2017","unstructured":"John Ramming . 1983. JR3 6-DoF Force-Torque Sensor. Retrieved March 1, 2017 from http:\/\/www.jr3.com\/. John Ramming. 1983. JR3 6-DoF Force-Torque Sensor. Retrieved March 1, 2017 from http:\/\/www.jr3.com\/."},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1162\/pres_a_00021"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.mechatronics.2010.07.006"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/70.258052"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2457450.2457451"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/285243.285273"},{"key":"e_1_2_2_42_1","volume-title":"IEEE International Workshop on Advanced Motion Control. 63--68","author":"Uchimura Y.","unstructured":"Y. Uchimura , K. Ohnishi , and T. Yakoh . 2002. Bilateral robot system on the real time network structure . In IEEE International Workshop on Advanced Motion Control. 63--68 . Y. Uchimura, K. Ohnishi, and T. Yakoh. 2002. Bilateral robot system on the real time network structure. In IEEE International Workshop on Advanced Motion Control. 63--68."},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.5555\/2209811.2210439"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1518\/hfes.46.1.118.30394"},{"key":"e_1_2_2_46_1","unstructured":"E. Weber. 1851. Die lehre vom tastsinn und gemeingefuehl auf versuche gegruendet. Vieweg: Braunschweig Germany. E. Weber. 1851. Die lehre vom tastsinn und gemeingefuehl auf versuche gegruendet. Vieweg: Braunschweig Germany."},{"key":"e_1_2_2_47_1","volume-title":"IEEE World Haptics Conference. 512--518","author":"Xu X.","unstructured":"X. Xu , B. Cizmeci , C. Schuwerk , and E. Steinbach . 2015. Haptic data reduction for time-delayed teleoperation using the time domain passivity approach . In IEEE World Haptics Conference. 512--518 . X. Xu, B. Cizmeci, C. Schuwerk, and E. Steinbach. 2015. Haptic data reduction for time-delayed teleoperation using the time domain passivity approach. In IEEE World Haptics Conference. 512--518."},{"key":"e_1_2_2_48_1","volume-title":"IEEE International Workshop on Advanced Motion Control. 569--574","author":"Yamamoto S.","unstructured":"S. Yamamoto , D. Yashiro , K. Yubai , and S. Komada . 2014. Rate control based on queuing state observer for visual-haptic communication . In IEEE International Workshop on Advanced Motion Control. 569--574 . S. Yamamoto, D. Yashiro, K. Yubai, and S. Komada. 2014. Rate control based on queuing state observer for visual-haptic communication. In IEEE International Workshop on Advanced Motion Control. 569--574."},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1002\/ecj.11516"},{"key":"e_1_2_2_50_1","volume-title":"Combining Haptic Data Reduction with Stabilizing Control Approaches. Retrieved","year":"2017","unstructured":"Youtube. 2016a. Combining Haptic Data Reduction with Stabilizing Control Approaches. Retrieved March 1, 2017 from https:\/\/youtu.be\/0GzIm2R8ICY. Youtube. 2016a. Combining Haptic Data Reduction with Stabilizing Control Approaches. Retrieved March 1, 2017 from https:\/\/youtu.be\/0GzIm2R8ICY."},{"key":"e_1_2_2_51_1","volume-title":"Ultra-Low Delay Video Transmission. Retrieved","year":"2017","unstructured":"Youtube. 2016b. Ultra-Low Delay Video Transmission. Retrieved March 1, 2017 from https:\/\/youtu.be\/dl9Figh-ymk. Youtube. 2016b. Ultra-Low Delay Video Transmission. Retrieved March 1, 2017 from https:\/\/youtu.be\/dl9Figh-ymk."},{"key":"e_1_2_2_52_1","volume-title":"A Multiplexing Scheme for Multimodal Teleoperation. Retrieved","year":"2017","unstructured":"Youtube. 2017. A Multiplexing Scheme for Multimodal Teleoperation. Retrieved March 1, 2017 from https:\/\/youtu.be\/a1MSrvENElg. Youtube. 2017. A Multiplexing Scheme for Multimodal Teleoperation. Retrieved March 1, 2017 from https:\/\/youtu.be\/a1MSrvENElg."},{"key":"e_1_2_2_53_1","volume-title":"IEEE International Conference on Acoustics, Speech and Signal Processing. 813--816","author":"Zhang F.","unstructured":"F. Zhang and E. Steinbach . 2011. Improved &rho;-domain rate control with accurate header size estimation . In IEEE International Conference on Acoustics, Speech and Signal Processing. 813--816 . F. Zhang and E. Steinbach. 2011. Improved &rho;-domain rate control with accurate header size estimation. In IEEE International Conference on Acoustics, Speech and Signal Processing. 813--816."},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2002.804883"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3063594","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3063594","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:36:34Z","timestamp":1750217794000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3063594"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,4,11]]},"references-count":53,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2017,5,31]]}},"alternative-id":["10.1145\/3063594"],"URL":"https:\/\/doi.org\/10.1145\/3063594","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,4,11]]},"assertion":[{"value":"2016-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-04-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}