{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,20]],"date-time":"2026-07-20T13:02:56Z","timestamp":1784552576973,"version":"3.55.0"},"reference-count":53,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2025,6,24]],"date-time":"2025-06-24T00:00:00Z","timestamp":1750723200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Israel Innovation Authority","award":["77840"],"award-info":[{"award-number":["77840"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Autonomous vehicles are a promising solution to traffic congestion, air pollution, accidents, wasted time, and resources. However, remote driver intervention may be necessary in extreme situations to ensure safe roadside parking or complete remote takeover. In these cases, high-quality real-time video streaming is crucial for remote driving. In a preliminary study, we presented a region of interest (ROI) High-Efficiency Video Coding (HEVC) method where the image was segmented into two categories: ROI and background. This involved allocating more bandwidth to the ROI, which yielded an improvement in the visibility of classes essential for driving while transmitting the background at a lower quality. However, migrating the bandwidth to the large ROI portion of the image did not substantially improve the quality of traffic signs and lights. This study proposes a method that categorizes ROIs into three tiers: background, weak ROI, and strong ROI. To evaluate this approach, we utilized a photo-realistic driving scenario database created with the Cognata self-driving car simulation platform. We used semantic segmentation to categorize the compression quality of a Coding Tree Unit (CTU) according to its pixel classes. A background CTU contains only sky, trees, vegetation, or building classes. Essentials for remote driving include classes such as pedestrians, road marks, and cars. Difficult-to-recognize classes, such as traffic signs (especially textual ones) and traffic lights, are categorized as a strong ROI. We applied thresholds to determine whether the number of pixels in a CTU of a particular category was sufficient to classify it as a strong or weak ROI and then allocated bandwidth accordingly. Our results demonstrate that this multi-category ROI compression method significantly enhances the perceptual quality of traffic signs (especially textual ones) and traffic lights by up to 5.5 dB compared to a simpler two-category (background\/foreground) partition. This improvement in critical areas is achieved by reducing the fidelity of less critical background elements, while the visual quality of other essential driving-related classes (weak ROI) is at least maintained.<\/jats:p>","DOI":"10.3390\/e27070674","type":"journal-article","created":{"date-parts":[[2025,6,24]],"date-time":"2025-06-24T08:50:57Z","timestamp":1750755057000},"page":"674","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Improved Perceptual Quality of Traffic Signs and Lights for the Teleoperation of Autonomous Vehicle Remote Driving via Multi-Category Region of Interest Video Compression"],"prefix":"10.3390","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6342-5223","authenticated-orcid":false,"given":"Itai","family":"Dror","sequence":"first","affiliation":[{"name":"School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, Beer-Sheva 8410501, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6089-8401","authenticated-orcid":false,"given":"Ofer","family":"Hadar","sequence":"additional","affiliation":[{"name":"School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, Beer-Sheva 8410501, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,6,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Neumeier, S., and Facchi, C. (2019, January 27\u201330). Towards a driver support system for teleoperated driving. Proceedings of the 2019 IEEE Intelligent Transportation Systems Conference (ITSC), Auckland, New Zealand.","DOI":"10.1109\/ITSC.2019.8917244"},{"key":"ref_2","unstructured":"Ackerman, E. (2025, May 12). What Full Autonomy Means for the Waymo Driver. Available online: https:\/\/spectrum.ieee.org\/cars-that-think\/transportation\/self-driving\/full-autonomy-waymo-driver."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Gaber, A., Nassar, W., Mohamed, A.M., and Mansour, M.K. (2020, January 8\u20139). Feasibility Study of Teleoperated Vehicles Using Multi-Operator LTE Connection. Proceedings of the 2020 International Conference on Innovative Trends in Communication and Computer Engineering (ITCE), Aswan, Egypt.","DOI":"10.1109\/ITCE48509.2020.9047764"},{"key":"ref_4","unstructured":"Testouri, M., Elghazaly, G., Hawlader, F., and Frank, R. (2025). 5G-Enabled Teleoperated Driving: An Experimental Evaluation. arXiv."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Pantel, L., and Wolf, L.C. (2002, January 12\u201314). On the impact of delay on real-time multiplayer games. Proceedings of the 12th International Workshop on Network and Operating Systems Support for Digital Audio and Video, Miami, FL, USA.","DOI":"10.1145\/507671.507674"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Mody, M., Swami, P., and Shastry, P. (2014, January 6\u20137). Ultra-low latency video codec for video conferencing. Proceedings of the 2014 IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT), Bangalore, India.","DOI":"10.1109\/CONECCT.2014.6740280"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1109\/TMM.2017.2726189","article-title":"On the minimization of glass-to-glass and glass-to-algorithm delay in video communication","volume":"20","author":"Bachhuber","year":"2018","journal-title":"IEEE Trans. Multimed."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Bachhuber, C., and Steinbach, E. (2017, January 19\u201322). Are Today\u2019s Video Communication Solutions Ready for the Tactile Internet?. Proceedings of the 2017 IEEE Wireless Communications and Networking Conference Workshops (WCNCW), San Francisco, CA, USA.","DOI":"10.1109\/WCNCW.2017.7919060"},{"key":"ref_9","unstructured":"Zou, Z., Shi, Z., Guo, Y., and Ye, J. (2019). Object detection in 20 years: A survey. arXiv."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"90243","DOI":"10.1109\/ACCESS.2019.2927036","article-title":"ROI-based lidar sampling algorithm in on-road environment for autonomous driving","volume":"7","author":"Nguyen","year":"2019","journal-title":"IEEE Access"},{"key":"ref_11","unstructured":"(2025, May 12). Cognata. Available online: https:\/\/www.cognata.com\/."},{"key":"ref_12","unstructured":"SAE International (2016). Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles, SAE International. J3016_201609."},{"key":"ref_13","unstructured":"(2025, May 12). Mercedes-Benz Drive Pilot Review. Available online: https:\/\/www.caranddriver.com\/reviews\/a45326503\/mercedes-benz-drive-pilot-review\/."},{"key":"ref_14","unstructured":"Podhurst, A. (2025, May 12). The Andromeda Consortium. Available online: https:\/\/www.prnewswire.com\/il\/news-releases\/the-andromeda-consortium-led-by-driveuauto-publishes-key-deliverables-to-advance-autonomous-vehicle-teleoperation-and-remote-management-of-autonomous-robotic-fleets-301201818.html."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"11347","DOI":"10.1109\/JIOT.2020.3028766","article-title":"Toward Automated Vehicle Teleoperation: Vision, Opportunities, and Challenges","volume":"7","author":"Zhang","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Neumeier, S., Walelgne, E.A., Bajpai, V., Ott, J., and Facchi, C. (2019, January 19\u201321). Measuring the feasibility of teleoperated driving in mobile networks. Proceedings of the 2019 Network Traffic Measurement and Analysis Conference (TMA), Paris, France.","DOI":"10.23919\/TMA.2019.8784466"},{"key":"ref_17","unstructured":"Fadaie, J. (2019). The State of Modeling, Simulation, and Data Utilization within Industry: An Autonomous Vehicles Perspective. arXiv."},{"key":"ref_18","unstructured":"Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., and Schiele, B. (July, January 26). The cityscapes dataset for semantic urban scene understanding. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_19","first-page":"40","article-title":"High efficiency video coding (HEVC)","volume":"Volume 39","author":"Sze","year":"2014","journal-title":"Integrated Circuit and Systems Algorithms and Architectures"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Richardson, I.E. (2011). The H. 264 Advanced Video Compression Standard, John Wiley & Sons.","DOI":"10.1002\/9780470989418"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Grois, D., Marpe, D., Mulayoff, A., Itzhaky, B., and Hadar, O. (2013, January 8\u201311). Performance comparison of h. 265\/mpeg-hevc, vp9, and h. 264\/mpeg-avc encoders. Proceedings of the 2013 Picture Coding Symposium (PCS), San Jose, CA, USA.","DOI":"10.1109\/PCS.2013.6737766"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"44","DOI":"10.5594\/j18499","article-title":"A technical overview of vp9\u2014The latest open-source video codec","volume":"124","author":"Mukherjee","year":"2015","journal-title":"SMPTE Motion Imaging J."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Grois, D., Marpe, D., Nguyen, T., and Hadar, O. (2014, January 17\u201324). Comparative assessment of H. 265\/MPEG-HEVC, VP9, and H. 264\/MPEG-AVC encoders for low-delay video applications. Proceedings of the Applications of Digital Image Processing XXXVII, San Diego, CA, USA.","DOI":"10.1117\/12.2073323"},{"key":"ref_24","unstructured":"(2024, May 14). Versatile Video Coding (VVC). Available online: https:\/\/jvet.hhi.fraunhofer.de\/."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1435","DOI":"10.1109\/JPROC.2021.3058584","article-title":"A technical overview of AV1","volume":"109","author":"Han","year":"2021","journal-title":"Proc. IEEE"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1109\/MSP.2020.2971765","article-title":"An Overview of the MPEG-5 Essential Video Coding Standard [Standards in a Nutshell]","volume":"37","author":"Choi","year":"2020","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_27","unstructured":"Bitmovin (2024, May 14). 7th Video Developer Report 2023\u20132024. Available online: https:\/\/bitmovin.com\/video-developer-report\/#pdf."},{"key":"ref_28","unstructured":"Bolot, J.-C., and Turletti, T. (1994, January 12\u201316). A rate control mechanism for packet video in the Internet. Proceedings of the INFOCOM\u201994 Conference on Computer Communications, Toronto, ON, Canada."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1109\/76.554439","article-title":"A new rate control scheme using quadratic rate distortion model","volume":"7","author":"Chiang","year":"1997","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"3841","DOI":"10.1109\/TIP.2014.2336550","article-title":"Lambda domain Rate Control Algorithm for High Efficiency Video Coding","volume":"23","author":"Li","year":"2014","journal-title":"IEEE Trans. Image Process."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1109\/79.733495","article-title":"Rate-distortion methods for image and video compression","volume":"15","author":"Ortega","year":"1998","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Lemmetti, A., Viitanen, M., Mercat, A., and Vanne, J. (2020, January 8\u201311). Kvazaar 2.0: Fast and efficient open-source HEVC inter encoder. Proceedings of the 11th ACM Multimedia Systems Conference, Istanbul, Turkey.","DOI":"10.1145\/3339825.3394927"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2409","DOI":"10.1109\/TCSVT.2016.2589878","article-title":"Optimal bit allocation for CTU level rate control in HEVC","volume":"27","author":"Li","year":"2017","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_34","unstructured":"Li, B., Li, H., and Li, L. (2013, January 18\u201326). Adaptive Bit Allocation for R-Lambda Model Rate Control in HM. Proceedings of the JCTVC M0036, 13th Meeting of Joint Collaborative Team on Video Coding of ITU-T SG1 6WP3 and ISO\/IEC JTC1\/SC, Stockholm, Sweden."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1109\/TCSVT.2007.913754","article-title":"Region-of-interest based resource allocation for conversational video communication of H.264\/AVC","volume":"18","author":"Liu","year":"2008","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1109\/JSTSP.2014.2314864","article-title":"Region-of-interest based conversational HEVC coding with hierarchical perception model of face","volume":"8","author":"Xu","year":"2014","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Grois, D., Kaminsky, E., and Hadar, O. (2010, January 23\u201325). Dynamically adjustable and scalable ROI video coding. Proceedings of the 2010 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), Shanghai, China.","DOI":"10.1109\/ISBMSB.2010.5463115"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Wei, H., Zhou, W., Bai, R., and Duan, Z. (2018, January 12\u201315). A Rate Control Algorithm for HEVC Considering Visual Saliency. Proceedings of the 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Honolulu, HI, USA.","DOI":"10.23919\/APSIPA.2018.8659729"},{"key":"ref_39","first-page":"132","article-title":"Object-based regions of interest for image compression","volume":"1","author":"Ha","year":"2008","journal-title":"Data Compress. Conf. Proc."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1016\/j.compeleceng.2018.11.010","article-title":"Region-of-interest based image compression using the discrete Tchebichef transform in wireless visual sensor networks","volume":"73","author":"Kouadria","year":"2019","journal-title":"Comput. Electr. Eng."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"3442","DOI":"10.1109\/TIP.2019.2960869","article-title":"End-to-End Optimized ROI Image Compression","volume":"29","author":"Cai","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"794","DOI":"10.1109\/TIP.2020.3038515","article-title":"A game theory based CTU-level bit allocation scheme for HEVC region of interest coding","volume":"30","author":"Liu","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_43","first-page":"40","article-title":"High Efficiency Video Coding (HEVC) test model HM-16.12 vs. HM-16.6: Objective and subjective performance analysis","volume":"13","author":"Milicevic","year":"2017","journal-title":"WSEAS Trans. Signal Process."},{"key":"ref_44","unstructured":"Olsson, D. (2020). Techniques for Selecting Spatially Variable Video Encoder.\/Quantization for Remote Operation. [Ph.D. Thesis, Link\u00f6ping University]."},{"key":"ref_45","unstructured":"Tong, L. (2005). Region of Interest (ROI) Based Rate Control for H. 263 Compatible Video Conferencing. [Ph.D. Thesis, The University of Texas at Arlington]."},{"key":"ref_46","unstructured":"Bagwe, G.R. (2018). Video Frame Reduction in Autonomous Vehicles. [Master\u2019s Thesis, Michigan Technological University]."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Hofbauer, M., Kuhn, C.B., Khlifi, M., Petrovic, G., and Steinbach, E. (2022, January 19\u201322). Traffic-aware multi-view video stream adaptation for teleoperated driving. Proceedings of the 2022 IEEE 95th Vehicular Technology Conference:(VTC2022-Spring), Helsinki, Finland.","DOI":"10.1109\/VTC2022-Spring54318.2022.9860513"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Skupin, R., Bitterschulte, K., Sanchez, Y., Hellge, C., and Schierl, T. (2020, January 4\u20138). Rate assignment in 360-degree video tiled streaming using random forest regression. Proceedings of the ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain.","DOI":"10.1109\/ICASSP40776.2020.9053262"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Dror, I., Birman, R., Solomon, O., Zehavi, T., Taib, L., Doron, A., Ezra, R., Rengenzad, N., and Hadar, O. (2021, January 1). Content adaptive video compression for autonomous vehicle remote driving. Proceedings of the SPIE 11842, Autonomous Vehicles and Advanced Driver-Assistance Systems for Automation and Safety 2021, San Diego, CA, USA. 118420Q.","DOI":"10.1117\/12.2595863"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1649","DOI":"10.1109\/TCSVT.2012.2221191","article-title":"Overview of the high efficiency video coding (HEVC) standard","volume":"22","author":"Sullivan","year":"2012","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_51","unstructured":"(2024, May 14). FFmpeg. Available online: https:\/\/ffmpeg.org\/."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Xu, J., Xiong, Z., and Bhattacharyya, S.P. (2022). Pidnet: A real-time semantic segmentation network inspired from pid controller. arXiv.","DOI":"10.1109\/CVPR52729.2023.01871"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/27\/7\/674\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:57:46Z","timestamp":1760032666000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/27\/7\/674"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,24]]},"references-count":53,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2025,7]]}},"alternative-id":["e27070674"],"URL":"https:\/\/doi.org\/10.3390\/e27070674","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,24]]}}}