{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,2]],"date-time":"2025-11-02T03:11:46Z","timestamp":1762053106504,"version":"build-2065373602"},"reference-count":20,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2022,5,18]],"date-time":"2022-05-18T00:00:00Z","timestamp":1652832000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Science and Technology Project of Hebei Education Department","award":["ZD2022102"],"award-info":[{"award-number":["ZD2022102"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>In QoE fairness optimization of multiple video streams, a distributed video stream fairness scheduling strategy based on federated deep reinforcement learning is designed to address the problem of low bandwidth utilization due to unfair bandwidth allocation and the problematic convergence of distributed algorithms in cooperative control of multiple video streams. The proposed strategy predicts a reasonable bandwidth allocation weight for the current video stream according to its player state and the global characteristics provided by the server. Then the congestion control protocol allocates the proportion of available bandwidth, matching its bandwidth allocation weight to each video stream in the bottleneck link. The strategy trains a local predictive model on each client and periodically performs federated aggregation to generate the optimal global scheme. In addition, the proposed strategy constructs global parameters containing information about the overall state of the video system to improve the performance of the distributed scheduling algorithm. The experimental results show that the introduction of global parameters can improve the algorithm\u2019s QoE fairness and overall QoE efficiency by 10% and 8%, respectively. The QoE fairness and overall QoE efficiency are improved by 8% and 7%, respectively, compared with the latest scheme.<\/jats:p>","DOI":"10.3390\/fi14050152","type":"journal-article","created":{"date-parts":[[2022,5,18]],"date-time":"2022-05-18T11:59:37Z","timestamp":1652875177000},"page":"152","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Distributed Bandwidth Allocation Strategy for QoE Fairness of Multiple Video Streams in Bottleneck Links"],"prefix":"10.3390","volume":"14","author":[{"given":"Yazhi","family":"Liu","sequence":"first","affiliation":[{"name":"College of Artificial Intelligence, North China University of Science and Technology, Tangshan 063210, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3780-1007","authenticated-orcid":false,"given":"Dongyu","family":"Wei","sequence":"additional","affiliation":[{"name":"College of Artificial Intelligence, North China University of Science and Technology, Tangshan 063210, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chunyang","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Artificial Intelligence, North China University of Science and Technology, Tangshan 063210, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei","family":"Li","sequence":"additional","affiliation":[{"name":"College of Artificial Intelligence, North China University of Science and Technology, Tangshan 063210, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,5,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Akhshabi, S., Anantakrishnan, L., Begen, A.C., and Dovrolis, C. (2012, January 7\u20138). What happens when HTTP adaptive streaming players compete for bandwidth. Proceedings of the 22nd International Workshop on Network and Operating System Support for Digital Audio and Video, Toronto, ON, Canada.","DOI":"10.1145\/2229087.2229092"},{"key":"ref_2","unstructured":"Floyd, S., and Paxson, V. (1997, January 7\u201310). Why we don\u2019t know how to simulate the Internet. Proceedings of the 29th Conference on Winter Simulation, Atlanta, GA, USA."},{"key":"ref_3","unstructured":"Yan, F.Y., Ayers, H., and Zhu, C. (2020, January 25\u201327). Learning in situ: A randomized experiment in video streaming. Proceedings of the 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20), Santa Clara, CA, USA."},{"key":"ref_4","unstructured":"Mcmahan, H.B., Moore, E., Ramage, D., and Hampson, S. (2017, January 20\u201322). Communication-efficient learning of deep networks from decentralized data. Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, Fort Lauderdale, FL, USA."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Wang, Y., Wang, H., Shang, J., and Hu, T. (2019, January 8\u201312). RESA: A Real-Time Evaluation System for ABR. Proceedings of the 2019 IEEE International Conference on Multimedia and Expo (ICME), Shanghai, China.","DOI":"10.1109\/ICME.2019.00317"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Spiteri, K., Urgaonkar, R., and Sitaraman, R.K. (2016, January 10\u201314). BOLA: Near-optimal bitrate adaptation for online videos. Proceedings of the IEEE INFOCOM 2016\u2014The 35th Annual IEEE International Conference on Computer Communications, San Francisco, CA, USA.","DOI":"10.1109\/INFOCOM.2016.7524428"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Yin, X., Bartulovi\u0107, M., Sekar, V., and Sinopoli, B. (2017, January 24\u201326). On the efficiency and fairness of multiplayer HTTP-based adaptive video streaming. Proceedings of the 2017 American Control Conference (ACC), Seattle, WA, USA.","DOI":"10.23919\/ACC.2017.7963606"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3397227","article-title":"QoE-fair DASH video streaming using server-side reinforcement learning","volume":"16","author":"Altamimi","year":"2020","journal-title":"ACM Trans. Multimed. Comput. Commun. Appl."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Nathan, V., Sivaraman, V., Addanki, R., Khani, M., and Alizadeh, M. (2019, January 19\u201323). End-to-end transport for video QoE fairness. Proceedings of the ACM Special Interest Group on Data Communication, Beijing, China.","DOI":"10.1145\/3341302.3342077"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Jiang, W., Ning, P., Zhang, Z., Hu, J., and Wang, J. (2021, January 25\u201327). Practical Bandwidth Allocation for Video QoE Fairness. Proceedings of the International Conference on Wireless Algorithms, Systems, and Applications, Nanjing, China.","DOI":"10.1007\/978-3-030-85928-2_41"},{"key":"ref_11","unstructured":"Li, Z., Aaron, A., and Manohara, M. (2016). Toward a practical perceptual video quality metric. Netflix Tech Blog, 6, Available online: https:\/\/medium.com\/netflix-techblog\/toward-a-practical-perceptual-video-quality-metric-653f208b9652."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1145\/1400097.1400105","article-title":"CUBIC: A new TCP-friendly high-speed TCP variant","volume":"42","author":"Ha","year":"2008","journal-title":"ACM SIGOPS Oper. Syst. Rev."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1246","DOI":"10.1109\/TNET.2006.886335","article-title":"FAST TCP: Motivation, architecture, algorithms, performance","volume":"14","author":"Wei","year":"2006","journal-title":"IEEE\/ACM Trans. Netw."},{"key":"ref_14","unstructured":"Rhee, I., Xu, L., and Ha, S. (2016). CUBIC for Fast Long-Distance Networks, Internet Engineering Task Force (IETF)."},{"key":"ref_15","unstructured":"Lowe, R., Wu, Y., Tamar, A., and Harb, J. (2017, January 4\u20139). Multi-agent actor-critic for mixed cooperative-competitive environments. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_16","unstructured":"Rashid, T., Samvelyan, M., Witt, C.D., Farquhar, G., Foerster, J., and Whiteson, S. (2018, January 10\u201315). QMIX: Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learning. Proceedings of the 35th International Conference on Machine Learning, Stockholm, Sweden."},{"key":"ref_17","unstructured":"Yu, C., Velu, A., Vinitsky, E., Wang, Y., and Wu, Y. (2021). The Surprising Effectiveness of MAPPO in Cooperative, Multi-Agent Games. arXiv."},{"key":"ref_18","unstructured":"Schulman, J., Wolski, F., Dhariwal, P., Radford, A., and Klimov, O. (2017). Proximal policy optimization algorithms. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1145\/2829988.2787486","article-title":"A control-theoretic approach for dynamic adaptive video streaming over HTTP","volume":"45","author":"Yin","year":"2015","journal-title":"ACM SIGCOMM Comput. Commun. Rev."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Mao, H., Netravali, R., and Alizadeh, M. (2017, January 21\u201325). Neural adaptive video streaming with pensieve. Proceedings of the Conference of the ACM Special Interest Group on Data Communication, Los Angeles, CA, USA.","DOI":"10.1145\/3098822.3098843"}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/14\/5\/152\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:13:55Z","timestamp":1760138035000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/14\/5\/152"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,18]]},"references-count":20,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2022,5]]}},"alternative-id":["fi14050152"],"URL":"https:\/\/doi.org\/10.3390\/fi14050152","relation":{},"ISSN":["1999-5903"],"issn-type":[{"type":"electronic","value":"1999-5903"}],"subject":[],"published":{"date-parts":[[2022,5,18]]}}}