{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T18:41:17Z","timestamp":1772044877885,"version":"3.50.1"},"reference-count":29,"publisher":"Association for Computing Machinery (ACM)","license":[{"start":{"date-parts":[[2022,12,8]],"date-time":"2022-12-08T00:00:00Z","timestamp":1670457600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"abstract":"<jats:p>\n            In\n            <jats:italic>HTTP Adaptive Streaming<\/jats:italic>\n            \u00a0(HAS), videos are encoded at multiple bitrates and spatial resolutions (\n            <jats:italic>i.e.<\/jats:italic>\n            ,\n            <jats:italic>representations<\/jats:italic>\n            ) to adapt to the heterogeneity of network conditions, device attributes, and end-user preferences. Encoding the same video segment at multiple representations increases costs for content providers. State-of-the-art multi-encoding schemes improve the encoding process by utilizing encoder analysis information from already encoded representation(s) to reduce the encoding time of the remaining representations. These schemes typically use the highest bitrate representation as the reference to accelerate the encoding of the remaining representations. Nowadays, most streaming services utilize cloud-based encoding techniques, enabling a fully parallel encoding process to reduce the overall encoding time. The highest bitrate representation has the highest encoding time than the other representations. Thus, utilizing it as the reference encoding is unfavorable in a parallel encoding setup as the overall encoding time is bound by its encoding time. This paper provides a comprehensive study of various multi-rate and multi-encoding schemes in both serial and parallel encoding scenarios. Furthermore, it introduces novel heuristics to limit the\n            <jats:italic>Rate Distortion Optimization<\/jats:italic>\n            \u00a0(RDO) process across various representations. Based on these heuristics, three multi-encoding schemes are proposed, which rely on encoder analysis sharing across different representations:\n            <jats:italic>(i)<\/jats:italic>\n            optimized for the\n            <jats:italic>highest compression efficiency<\/jats:italic>\n            ,\n            <jats:italic>(ii)<\/jats:italic>\n            optimized for the\n            <jats:italic>best compression efficiency-encoding time savings trade-off<\/jats:italic>\n            , and\n            <jats:italic>(iii)<\/jats:italic>\n            optimized for the\n            <jats:italic>best encoding time savings<\/jats:italic>\n            . Experimental results demonstrate that the proposed multi-encoding schemes\n            <jats:italic>(i)<\/jats:italic>\n            ,\n            <jats:italic>(ii)<\/jats:italic>\n            , and\n            <jats:italic>(iii)<\/jats:italic>\n            reduce the overall serial encoding time by 34.71%, 45.27%, and 68.76% with a 2.3%, 3.1%, and 4.5% bitrate increase to maintain the same VMAF, respectively compared to stand-alone encodings. The overall parallel encoding time is reduced by 22.03%, 20.72%, and 76.82% compared to stand-alone encodings for schemes\n            <jats:italic>(i)<\/jats:italic>\n            ,\n            <jats:italic>(ii)<\/jats:italic>\n            , and\n            <jats:italic>(iii)<\/jats:italic>\n            , respectively.\n          <\/jats:p>","DOI":"10.1145\/3575659","type":"journal-article","created":{"date-parts":[[2022,12,8]],"date-time":"2022-12-08T14:28:46Z","timestamp":1670509726000},"update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["EMES: Efficient Multi-Encoding Schemes for HEVC-based Adaptive Bitrate Streaming"],"prefix":"10.1145","author":[{"given":"Vignesh V","family":"Menon","sequence":"first","affiliation":[{"name":"Christian Doppler Laboratory ATHENA, Alpen-Adria-Universit\u00e4t Klagenfurt, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hadi","family":"Amirpour","sequence":"additional","affiliation":[{"name":"Christian Doppler Laboratory ATHENA, Alpen-Adria-Universit\u00e4t Klagenfurt, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mohammad","family":"Ghanbari","sequence":"additional","affiliation":[{"name":"School of Computer Science and Electronic Engineering, University of Essex, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christian","family":"Timmerer","sequence":"additional","affiliation":[{"name":"Christian Doppler Laboratory ATHENA, Alpen-Adria-Universit\u00e4t Klagenfurt, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,12,8]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-67832-6_38"},{"key":"e_1_2_1_2_1","volume-title":"Fast Multi-rate Encoding for Adaptive HTTP Streaming. In 2020 Data Compression Conference (DCC). 358\u2013358","author":"Amirpour Hadi","year":"2020","unstructured":"Hadi Amirpour , Ekrem \u00c7etinkaya , Christian Timmerer , and Mohammad Ghanbari . 2020 . Fast Multi-rate Encoding for Adaptive HTTP Streaming. In 2020 Data Compression Conference (DCC). 358\u2013358 . https:\/\/doi.org\/10.1109\/DCC47342.2020.00080 10.1109\/DCC47342.2020.00080 Hadi Amirpour, Ekrem \u00c7etinkaya, Christian Timmerer, and Mohammad Ghanbari. 2020. Fast Multi-rate Encoding for Adaptive HTTP Streaming. In 2020 Data Compression Conference (DCC). 358\u2013358. https:\/\/doi.org\/10.1109\/DCC47342.2020.00080"},{"key":"e_1_2_1_3_1","volume-title":"Calculation of average PSNR differences between RD-curves. VCEG-M33","author":"Bjontegaard Gisle","year":"2001","unstructured":"Gisle Bjontegaard . 2001. Calculation of average PSNR differences between RD-curves. VCEG-M33 ( 2001 ). Gisle Bjontegaard. 2001. Calculation of average PSNR differences between RD-curves. VCEG-M33 (2001)."},{"key":"e_1_2_1_4_1","unstructured":"Jill Boyce Karsten Suehring Xiang Li and Vadim Seregin. 2018. JVET-J1010: JVET common test conditions and software reference configurations.  Jill Boyce Karsten Suehring Xiang Li and Vadim Seregin. 2018. JVET-J1010: JVET common test conditions and software reference configurations."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2017.2683504"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2016.7532605"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/MMSP.2015.7340802"},{"key":"e_1_2_1_8_1","volume-title":"Adaptive Multi-Resolution Encoding for ABR Streaming. In 2018 25th IEEE International Conference on Image Processing (ICIP). 1008\u20131012","author":"Goswami Kalyan","year":"2018","unstructured":"Kalyan Goswami , Bhavna Hariharan , Pradeep Ramachandran , Alex Giladi , Dan Grois , Kavitha Sampath , Aruna Matheswaran , Ashok\u00a0Kumar Mishra , and Kevin Pikus . 2018 . Adaptive Multi-Resolution Encoding for ABR Streaming. In 2018 25th IEEE International Conference on Image Processing (ICIP). 1008\u20131012 . https:\/\/doi.org\/10.1109\/ICIP.2018.8451485 10.1109\/ICIP.2018.8451485 Kalyan Goswami, Bhavna Hariharan, Pradeep Ramachandran, Alex Giladi, Dan Grois, Kavitha Sampath, Aruna Matheswaran, Ashok\u00a0Kumar Mishra, and Kevin Pikus. 2018. Adaptive Multi-Resolution Encoding for ABR Streaming. In 2018 25th IEEE International Conference on Image Processing (ICIP). 1008\u20131012. https:\/\/doi.org\/10.1109\/ICIP.2018.8451485"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11554-020-01063-x"},{"key":"e_1_2_1_10_1","volume-title":"Multi-Representations Encoding Framework for Adaptive Http Streaming. In 2018 25th IEEE International Conference on Image Processing (ICIP). 988\u2013992","author":"Gu Jiawen","year":"2018","unstructured":"Jiawen Gu , Jiangtao Wen , Bichuan Guo , and Yuxing Han . 2018 . Multi-Representations Encoding Framework for Adaptive Http Streaming. In 2018 25th IEEE International Conference on Image Processing (ICIP). 988\u2013992 . https:\/\/doi.org\/10.1109\/ICIP.2018.8451251 10.1109\/ICIP.2018.8451251 Jiawen Gu, Jiangtao Wen, Bichuan Guo, and Yuxing Han. 2018. Multi-Representations Encoding Framework for Adaptive Http Streaming. In 2018 25th IEEE International Conference on Image Processing (ICIP). 988\u2013992. https:\/\/doi.org\/10.1109\/ICIP.2018.8451251"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/OJSP.2021.3086691"},{"key":"e_1_2_1_12_1","volume-title":"Low-Complexity HEVC Transrating Based on Prediction Unit Mode Inheritance. In 2020 28th European Signal Processing Conference (EUSIPCO). 550\u2013554","author":"Lindino Matheus","year":"2021","unstructured":"Matheus Lindino , Thiago Bubolz , Bruno Zatt , Daniel Palomino , and Guilherme Correa . 2021 . Low-Complexity HEVC Transrating Based on Prediction Unit Mode Inheritance. In 2020 28th European Signal Processing Conference (EUSIPCO). 550\u2013554 . https:\/\/doi.org\/10.23919\/Eusipco47968.2020.9287789 10.23919\/Eusipco47968.2020.9287789 Matheus Lindino, Thiago Bubolz, Bruno Zatt, Daniel Palomino, and Guilherme Correa. 2021. Low-Complexity HEVC Transrating Based on Prediction Unit Mode Inheritance. In 2020 28th European Signal Processing Conference (EUSIPCO). 550\u2013554. https:\/\/doi.org\/10.23919\/Eusipco47968.2020.9287789"},{"key":"e_1_2_1_13_1","volume-title":"Applications of Digital Image Processing XLIII, Andrew\u00a0G","author":"Mathesawaran Aruna","unstructured":"Aruna Mathesawaran , Praveen\u00a0Kumar Karadugattu , Pradeep Ramachandran , Alex Giladi , Dan Grois , Pooja Venkatesan , and Alex Balk . 2020. Open source framework for reduced-complexity multi-rate HEVC encoding . In Applications of Digital Image Processing XLIII, Andrew\u00a0G . Tescher and Touradj Ebrahimi (Eds.), Vol.\u00a0 11510. International Society for Optics and Photonics, SPIE , 461 \u2013 471. https:\/\/doi.org\/10.1117\/12.2567877 10.1117\/12.2567877 Aruna Mathesawaran, Praveen\u00a0Kumar Karadugattu, Pradeep Ramachandran, Alex Giladi, Dan Grois, Pooja Venkatesan, and Alex Balk. 2020. Open source framework for reduced-complexity multi-rate HEVC encoding. In Applications of Digital Image Processing XLIII, Andrew\u00a0G. Tescher and Touradj Ebrahimi (Eds.), Vol.\u00a0 11510. International Society for Optics and Photonics, SPIE, 461 \u2013 471. https:\/\/doi.org\/10.1117\/12.2567877"},{"key":"e_1_2_1_14_1","volume-title":"Efficient Content-Adaptive Feature-Based Shot Detection for HTTP Adaptive Streaming. In 2021 IEEE International Conference on Image Processing (ICIP). 2174\u20132178","author":"Menon V","year":"2021","unstructured":"Vignesh\u00a0 V Menon , Hadi Amirpour , Mohammad Ghanbari , and Christian Timmerer . 2021 . Efficient Content-Adaptive Feature-Based Shot Detection for HTTP Adaptive Streaming. In 2021 IEEE International Conference on Image Processing (ICIP). 2174\u20132178 . https:\/\/doi.org\/10.1109\/ICIP42928.2021.9506092 10.1109\/ICIP42928.2021.9506092 Vignesh\u00a0V Menon, Hadi Amirpour, Mohammad Ghanbari, and Christian Timmerer. 2021. Efficient Content-Adaptive Feature-Based Shot Detection for HTTP Adaptive Streaming. In 2021 IEEE International Conference on Image Processing (ICIP). 2174\u20132178. https:\/\/doi.org\/10.1109\/ICIP42928.2021.9506092"},{"key":"e_1_2_1_15_1","volume-title":"CODA: Content-aware Frame Dropping Algorithm\u00a0for High Frame-rate Video Streaming. In 2022 Data Compression Conference (DCC). 475\u2013475","author":"Menon V","year":"2022","unstructured":"Vignesh\u00a0 V Menon , Hadi Amirpour , Mohammad Ghanbari , and Christian Timmerer . 2022 . CODA: Content-aware Frame Dropping Algorithm\u00a0for High Frame-rate Video Streaming. In 2022 Data Compression Conference (DCC). 475\u2013475 . https:\/\/doi.org\/10.1109\/DCC52660.2022.00086 10.1109\/DCC52660.2022.00086 Vignesh\u00a0V Menon, Hadi Amirpour, Mohammad Ghanbari, and Christian Timmerer. 2022. CODA: Content-aware Frame Dropping Algorithm\u00a0for High Frame-rate Video Streaming. In 2022 Data Compression Conference (DCC). 475\u2013475. https:\/\/doi.org\/10.1109\/DCC52660.2022.00086"},{"key":"e_1_2_1_16_1","volume-title":"OPTE: Online Per-Title Encoding for Live Video Streaming. In ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 1865\u20131869","author":"Menon V","year":"2022","unstructured":"Vignesh\u00a0 V Menon , Hadi Amirpour , Mohammad Ghanbari , and Christian Timmerer . 2022 . OPTE: Online Per-Title Encoding for Live Video Streaming. In ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 1865\u20131869 . https:\/\/doi.org\/10.1109\/ICASSP43922.2022.9746745 ISSN: 2379-190X. 10.1109\/ICASSP43922.2022.9746745 Vignesh\u00a0V Menon, Hadi Amirpour, Mohammad Ghanbari, and Christian Timmerer. 2022. OPTE: Online Per-Title Encoding for Live Video Streaming. In ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 1865\u20131869. https:\/\/doi.org\/10.1109\/ICASSP43922.2022.9746745 ISSN: 2379-190X."},{"key":"#cr-split#-e_1_2_1_17_1.1","doi-asserted-by":"crossref","unstructured":"Vignesh\u00a0V Menon Hadi Amirpour Christian Timmerer and Mohammad Ghanbari. 2021. Efficient Multi-Encoding Algorithms for HTTP Adaptive Bitrate Streaming. (2021) 1-5. https:\/\/doi.org\/10.1109\/PCS50896.2021.9477499 10.1109\/PCS50896.2021.9477499","DOI":"10.1109\/PCS50896.2021.9477499"},{"key":"#cr-split#-e_1_2_1_17_1.2","doi-asserted-by":"crossref","unstructured":"Vignesh\u00a0V Menon Hadi Amirpour Christian Timmerer and Mohammad Ghanbari. 2021. Efficient Multi-Encoding Algorithms for HTTP Adaptive Bitrate Streaming. (2021) 1-5. https:\/\/doi.org\/10.1109\/PCS50896.2021.9477499","DOI":"10.1109\/PCS50896.2021.9477499"},{"key":"e_1_2_1_18_1","volume-title":"INCEPT: Intra CU Depth Prediction for HEVC. In 2021 IEEE 23rd International Workshop on Multimedia Signal Processing (MMSP). 1\u20136. https:\/\/doi.org\/10","author":"Menon V","year":"2021","unstructured":"Vignesh\u00a0 V Menon , Hadi Amirpour , Christian Timmerer , and Mohammad Ghanbari . 2021 . INCEPT: Intra CU Depth Prediction for HEVC. In 2021 IEEE 23rd International Workshop on Multimedia Signal Processing (MMSP). 1\u20136. https:\/\/doi.org\/10 .1109\/MMSP53017.2021.9733517 10.1109\/MMSP53017.2021.9733517 Vignesh\u00a0V Menon, Hadi Amirpour, Christian Timmerer, and Mohammad Ghanbari. 2021. INCEPT: Intra CU Depth Prediction for HEVC. In 2021 IEEE 23rd International Workshop on Multimedia Signal Processing (MMSP). 1\u20136. https:\/\/doi.org\/10.1109\/MMSP53017.2021.9733517"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.5220\/0005018300900098"},{"key":"e_1_2_1_20_1","volume-title":"Optimal Multi-Codec Adaptive Bitrate Streaming. In 2019 IEEE International Conference on Multimedia & Expo Workshops (ICMEW). 348\u2013353","author":"Reznik A.","year":"2019","unstructured":"Yuriy\u00a0 A. Reznik , Xiangbo Li , Karl\u00a0 O. Lillevold , Abhijith Jagannath , and Justin Greer . 2019 . Optimal Multi-Codec Adaptive Bitrate Streaming. In 2019 IEEE International Conference on Multimedia & Expo Workshops (ICMEW). 348\u2013353 . https:\/\/doi.org\/10.1109\/ICMEW.2019.00066 10.1109\/ICMEW.2019.00066 Yuriy\u00a0A. Reznik, Xiangbo Li, Karl\u00a0O. Lillevold, Abhijith Jagannath, and Justin Greer. 2019. Optimal Multi-Codec Adaptive Bitrate Streaming. In 2019 IEEE International Conference on Multimedia & Expo Workshops (ICMEW). 348\u2013353. https:\/\/doi.org\/10.1109\/ICMEW.2019.00066"},{"key":"e_1_2_1_21_1","volume-title":"Applications of Digital Image Processing XLIV, Vol.\u00a0 11842","author":"Ringis J.","unstructured":"Daniel\u00a0 J. Ringis , Francois Pitie , and Anil Kokaram . 2021. Per-clip and per-bitrate adaptation of the Lagrangian multiplier in video coding . In Applications of Digital Image Processing XLIV, Vol.\u00a0 11842 . SPIE , 185\u2013194. https:\/\/doi.org\/10.1117\/12.2593238 10.1117\/12.2593238 Daniel\u00a0J. Ringis, Francois Pitie, and Anil Kokaram. 2021. Per-clip and per-bitrate adaptation of the Lagrangian multiplier in video coding. In Applications of Digital Image Processing XLIV, Vol.\u00a0 11842. SPIE, 185\u2013194. https:\/\/doi.org\/10.1117\/12.2593238"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2016.2599028"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2015.7351551"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/MMUL.2011.71"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/QoMEX.2013.6603201"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2012.2221191"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2003.815165"},{"key":"e_1_2_1_28_1","volume-title":"Object-Based Rate Adjustment for HEVC Transrating. In 2019 IEEE International Conference on Consumer Electronics - Taiwan (ICCE-TW). 1\u20132. https:\/\/doi.org\/10","author":"Yang Shih-Hsuan","year":"2019","unstructured":"Shih-Hsuan Yang , Chih-Hung Lin , and Hung-Xin Chen . 2019 . Object-Based Rate Adjustment for HEVC Transrating. In 2019 IEEE International Conference on Consumer Electronics - Taiwan (ICCE-TW). 1\u20132. https:\/\/doi.org\/10 .1109\/ICCE-TW46550.2019.8991793 10.1109\/ICCE-TW46550.2019.8991793 Shih-Hsuan Yang, Chih-Hung Lin, and Hung-Xin Chen. 2019. Object-Based Rate Adjustment for HEVC Transrating. In 2019 IEEE International Conference on Consumer Electronics - Taiwan (ICCE-TW). 1\u20132. https:\/\/doi.org\/10.1109\/ICCE-TW46550.2019.8991793"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3575659","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3575659","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T18:43:52Z","timestamp":1750272232000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3575659"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,8]]},"references-count":29,"alternative-id":["10.1145\/3575659"],"URL":"https:\/\/doi.org\/10.1145\/3575659","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,8]]},"assertion":[{"value":"2022-01-26","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-10-20","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-12-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"3575659"}}