{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,14]],"date-time":"2026-03-14T00:28:28Z","timestamp":1773448108514,"version":"3.50.1"},"reference-count":35,"publisher":"Association for Computing Machinery (ACM)","issue":"2s","license":[{"start":{"date-parts":[[2020,4,30]],"date-time":"2020-04-30T00:00:00Z","timestamp":1588204800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100004351","name":"Cisco Systems","doi-asserted-by":"crossref","award":["CG#594320"],"award-info":[{"award-number":["CG#594320"]}],"id":[{"id":"10.13039\/100004351","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2020,4,30]]},"abstract":"<jats:p>To design an optimal adaptive video streaming method, video service providers need to consider both the efficiency and the fairness of the Quality of Experience (QoE) of their users. In Reference [8], we proposed a server-side QoE-fair rate adaptation method that considers both efficiency and fairness of the QoE. The server uses Reinforcement Learning (RL) to select a bitrate for each client sharing the same bottleneck link to the server in a way that achieves fairness among concurrent DASH clients and imposes that bitrate by dynamically modifying the client\u2019s Media Presentation Description (MPD) file. In this article, we extend that work to minimize the number of actions the server needs to take to keep the system in its equilibrium state. By incorporating a Recurrent Neural Network, specifically an LSTM model, we modify the server\u2019s training algorithm to achieve improvements in both the quality and the quantity of actions the server takes to guide the client. Performance evaluation of the modified algorithm for clients running both homogeneous and heterogeneous adaptation algorithms showed that the number of server actions dropped by 14% and 22%, respectively, while QoE-fairness improved by at least 6% and 10%, respectively.<\/jats:p>","DOI":"10.1145\/3397227","type":"journal-article","created":{"date-parts":[[2020,6,22]],"date-time":"2020-06-22T02:49:20Z","timestamp":1592794160000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":33,"title":["QoE-Fair DASH Video Streaming Using Server-side Reinforcement Learning"],"prefix":"10.1145","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1517-8170","authenticated-orcid":false,"given":"Sa\u2019di","family":"Altamimi","sequence":"first","affiliation":[{"name":"University of Ottawa, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3973-4445","authenticated-orcid":false,"given":"Shervin","family":"Shirmohammadi","sequence":"additional","affiliation":[{"name":"University of Ottawa, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,6,21]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"2012. ITU-T Recommendation G.1070 Opinion Model for Video Applications.  2012. ITU-T Recommendation G.1070 Opinion Model for Video Applications."},{"key":"e_1_2_1_2_1","unstructured":"2014. ISO\/IEC 23009-1 Information Technology - Dynamic Adaptive Streaming Over HTTP (DASH) - Part 1: Media Presentation Description and Segment Formats.  2014. ISO\/IEC 23009-1 Information Technology - Dynamic Adaptive Streaming Over HTTP (DASH) - Part 1: Media Presentation Description and Segment Formats."},{"key":"e_1_2_1_3_1","volume-title":"Sandvine","year":"2019","unstructured":"2020. Global Internet Phenomena Report . Sandvine , September 2019 . Retrieved March 29, 2020 from https:\/\/www.sandvine.com\/press-releases\/sandvine-releases-2019-global-internet-phenomena-report. 2020. Global Internet Phenomena Report. Sandvine, September 2019. Retrieved March 29, 2020 from https:\/\/www.sandvine.com\/press-releases\/sandvine-releases-2019-global-internet-phenomena-report."},{"key":"e_1_2_1_4_1","volume-title":"Sandvine. Retrieved","year":"2020","unstructured":"2020. The Mobile Internet Phenomena Report . Sandvine. Retrieved March 29, 2020 from https:\/\/www.sandvine.com\/press-releases\/sandvine-releases-2020-mobile-internet-phenomena-report-youtube-is-over-25-of-all-mobile-traffic. 2020. The Mobile Internet Phenomena Report. Sandvine. Retrieved March 29, 2020 from https:\/\/www.sandvine.com\/press-releases\/sandvine-releases-2020-mobile-internet-phenomena-report-youtube-is-over-25-of-all-mobile-traffic."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2229087.2229092"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2460782.2460786"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3230543.3230558"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3304112.3325604"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219752"},{"key":"e_1_2_1_10_1","volume-title":"Learning Atari: An Exploration of the A3C Reinforcement Learning Method. Available: https:\/\/bcourses.berkeley.edu\/files\/70573736\/download?download_frd=1.","author":"Chesebro Tyler","year":"2016","unstructured":"Tyler Chesebro and Aleks Kamko . 2016 . Learning Atari: An Exploration of the A3C Reinforcement Learning Method. Available: https:\/\/bcourses.berkeley.edu\/files\/70573736\/download?download_frd=1. Tyler Chesebro and Aleks Kamko. 2016. Learning Atari: An Exploration of the A3C Reinforcement Learning Method. Available: https:\/\/bcourses.berkeley.edu\/files\/70573736\/download?download_frd=1."},{"key":"e_1_2_1_11_1","unstructured":"Federal Communications Commission. [n.d.]. Raw Data - Measuring Broadband America. Retrieved from https:\/\/www.fcc.gov\/reports-research\/reports.  Federal Communications Commission. [n.d.]. Raw Data - Measuring Broadband America. Retrieved from https:\/\/www.fcc.gov\/reports-research\/reports."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCCN.2017.2755007"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/SSCI.2015.170"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/LCOMM.2016.2616342"},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the 2019 IEEE International Conference on Multimedia and Expo (ICME\u201919)","author":"Huang T.","unstructured":"T. Huang , X. Yao , C. Wu , R. Zhang , Z. Pang , and L. Sun . 2019. Tiyuntsong: A self-play reinforcement learning approach for ABR video streaming . In Proceedings of the 2019 IEEE International Conference on Multimedia and Expo (ICME\u201919) . 1678--1683. T. Huang, X. Yao, C. Wu, R. Zhang, Z. Pang, and L. Sun. 2019. Tiyuntsong: A self-play reinforcement learning approach for ABR video streaming. In Proceedings of the 2019 IEEE International Conference on Multimedia and Expo (ICME\u201919). 1678--1683."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3343031.3351014"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2398776.2398800"},{"key":"e_1_2_1_19_1","unstructured":"R. Jain D.-M. Chiu W. R. Hawe T. Zinner T. Ho\u00dffeld and P. Tran-Gia. 1984. A quantitative measure of fairness and discrimination for resource allocation in shared computer system. Eastern Res. Lab. (1984) Hudson MA.  R. Jain D.-M. Chiu W. R. Hawe T. Zinner T. Ho\u00dffeld and P. Tran-Gia. 1984. A quantitative measure of fairness and discrimination for resource allocation in shared computer system. Eastern Res. Lab. (1984) Hudson MA."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.5555\/2591204.2591228"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1137\/S0363012901385691"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2155555.2155570"},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the 2nd Annual ACM Conference on Multimedia Systems (MMSys\u201911)","author":"Luca De Cicco","year":"2011","unstructured":"De Cicco Luca , Saverio Mascolo , and Vittorio Palmisano . 2011 . Feedback control for adaptive live video streaming . In Proceedings of the 2nd Annual ACM Conference on Multimedia Systems (MMSys\u201911) . ACM, 145--156. De Cicco Luca, Saverio Mascolo, and Vittorio Palmisano. 2011. Feedback control for adaptive live video streaming. In Proceedings of the 2nd Annual ACM Conference on Multimedia Systems (MMSys\u201911). ACM, 145--156."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3098822.3098843"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2014.2336809"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341302.3342077"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2483977.2483991"},{"key":"e_1_2_1_29_1","unstructured":"J. Padhye S. Floyd M. Handley and J. Widmer. 2008. TCP Friendly Rate Control (TFRC): Protocol Specification (Proposed Standard). Retrieved from https:\/\/tools.ietf.org\/html\/rfc5348.  J. Padhye S. Floyd M. Handley and J. Widmer. 2008. TCP Friendly Rate Control (TFRC): Protocol Specification (Proposed Standard). Retrieved from https:\/\/tools.ietf.org\/html\/rfc5348."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2014.2360940"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNSM.2019.2910380"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3052822"},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the 35th Annual IEEE International Conference on Computer Communications (INFOCOM\u201916)","author":"Spiteri Kevin","year":"2016","unstructured":"Kevin Spiteri , Rahul Urgaonkar , and Ramesh K. Sitaraman . 2016. BOLA: Near-optimal bitrate adaptation for online videos . In Proceedings of the 35th Annual IEEE International Conference on Computer Communications (INFOCOM\u201916) . 1--9. DOI:https:\/\/doi.org\/10.1109\/INFOCOM. 2016 .7524428 10.1109\/INFOCOM.2016.7524428 Kevin Spiteri, Rahul Urgaonkar, and Ramesh K. Sitaraman. 2016. BOLA: Near-optimal bitrate adaptation for online videos. In Proceedings of the 35th Annual IEEE International Conference on Computer Communications (INFOCOM\u201916). 1--9. DOI:https:\/\/doi.org\/10.1109\/INFOCOM.2016.7524428"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.5555\/551283"},{"key":"e_1_2_1_35_1","unstructured":"The PyTorch team. 2020. PyTorch Neural Network Framework. Retrieved from https:\/\/pytorch.org\/docs\/stable\/nn.html#lstm.  The PyTorch team. 2020. PyTorch Neural Network Framework. Retrieved from https:\/\/pytorch.org\/docs\/stable\/nn.html#lstm."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2785956.2787486"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3397227","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3397227","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:31:37Z","timestamp":1750195897000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3397227"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,30]]},"references-count":35,"journal-issue":{"issue":"2s","published-print":{"date-parts":[[2020,4,30]]}},"alternative-id":["10.1145\/3397227"],"URL":"https:\/\/doi.org\/10.1145\/3397227","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,4,30]]},"assertion":[{"value":"2019-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-06-21","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}