{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,10]],"date-time":"2025-12-10T04:07:10Z","timestamp":1765339630286,"version":"3.46.0"},"publisher-location":"New York, NY, USA","reference-count":48,"publisher":"ACM","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,10,27]]},"DOI":"10.1145\/3746027.3755323","type":"proceedings-article","created":{"date-parts":[[2025,10,25]],"date-time":"2025-10-25T06:54:15Z","timestamp":1761375255000},"page":"12045-12053","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Progressive Learning with Human Feedback for Personalized Adaptive Video Streaming"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-5391-5112","authenticated-orcid":false,"given":"Zhaohui","family":"Jiang","sequence":"first","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-4070-1941","authenticated-orcid":false,"given":"Xuening","family":"Feng","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9378-6329","authenticated-orcid":false,"given":"Tianchi","family":"Huang","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4251-825X","authenticated-orcid":false,"given":"Ruixiao","family":"Zhang","sequence":"additional","affiliation":[{"name":"ByteDance Inc., San Diego, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2008-4569","authenticated-orcid":false,"given":"Paul","family":"Weng","sequence":"additional","affiliation":[{"name":"Duke Kunshan University, Kunshan, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4352-6507","authenticated-orcid":false,"given":"Yifei","family":"Zhu","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,10,27]]},"reference":[{"key":"e_1_3_2_2_1_1","unstructured":"[n. d.]. Toward A Practical Perceptual Video Quality Metric | by Netflix Technology Blog | Netflix TechBlog. https:\/\/netflixtechblog.com\/toward-a-practicalperceptual- video-quality-metric-653f208b9652 VMAF-blog1."},{"key":"e_1_3_2_2_2_1","unstructured":"2025. Amazon Prime Video. https:\/\/www.primevideo.com"},{"key":"e_1_3_2_2_3_1","unstructured":"2025. Netflix. https:\/\/www.netflix.com\/"},{"key":"e_1_3_2_2_4_1","unstructured":"2025. Q Appendix. https:\/\/sites.ji.sjtu.edu.cn\/yifei-zhu\/wp-content\/uploads\/ sites\/19\/2025\/07\/QPLUS_Appendix.pdf"},{"key":"e_1_3_2_2_5_1","unstructured":"2025. YouTube. https:\/\/www.youtube.com\/"},{"key":"e_1_3_2_2_6_1","volume-title":"Proc. ACM SIGOCOMM","author":"Akhtar Zahaib","year":"2018","unstructured":"Zahaib Akhtar, Yun Seong Nam, Ramesh Govindan, Sanjay Rao, Jessica Chen, Ethan Katz-Bassett, Bruno Ribeiro, Jibin Zhan, and Hui Zhang. 2018. Oboe: autotuning video ABR algorithms to network conditions. In Proc. ACM SIGOCOMM (Budapest, Hu..) (SIGCOMM '18). 44--58."},{"volume-title":"ICME (Hong Kong, China)","author":"Asan Av\u015far","key":"e_1_3_2_2_7_1","unstructured":"Av\u015far Asan, Werner Robitza, Is-haka Mkwawa, Lingfen Sun, Emmanuel Ifeachor, and Alexander Raake. 2017. Impact of video resolution changes on QoE for adaptive video streaming. In ICME (Hong Kong, China). IEEE, 499--504."},{"key":"e_1_3_2_2_8_1","first-page":"324","article-title":"Rank Analysis of Incomplete Block Designs","volume":"39","author":"Bradley Ralph Allan","year":"1952","unstructured":"Ralph Allan Bradley and Milton E. Terry. 1952. Rank Analysis of Incomplete Block Designs: I. The Method of Paired Comparisons. Biometrika 39, 3\/4 (1952), 324--345.","journal-title":"I. The Method of Paired Comparisons. Biometrika"},{"volume-title":"NeurIPS (Long Beach, California, USA) (NIPS'17)","author":"Christiano Paul F.","key":"e_1_3_2_2_9_1","unstructured":"Paul F. Christiano, Jan Leike, Tom B. Brown, Miljan Martic, Shane Legg, and Dario Amodei. 2017. Deep reinforcement learning from human preferences. In NeurIPS (Long Beach, California, USA) (NIPS'17). Curran Associates Inc., Red Hook, NY, USA, 4302--4310."},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"crossref","unstructured":"Florin Dobrian Vyas Sekar Asad Awan Ion Stoica Dilip Joseph Aditya Ganjam Jibin Zhan and Hui Zhang. 2011. Understanding the impact of video quality on user engagement. In SIGCOMM (Toronto Ontario Canada) (SIGCOMM '11). 362--373.","DOI":"10.1145\/2018436.2018478"},{"key":"e_1_3_2_2_11_1","article-title":"A Bayesian Quality-of-Experience Model for Adaptive Streaming Videos","volume":"18","author":"Duanmu Zhengfang","year":"2023","unstructured":"Zhengfang Duanmu, Wentao Liu, Diqi Chen, Zhuoran Li, Zhou Wang, Yizhou Wang, andWen Gao. 2023. A Bayesian Quality-of-Experience Model for Adaptive Streaming Videos. ACM Trans. Multimedia Comput. Commun. Appl. 18, 3s, Article 141 (feb 2023), 24 pages.","journal-title":"ACM Trans. Multimedia Comput. Commun. Appl."},{"key":"e_1_3_2_2_12_1","unstructured":"Zhengfang Duanmu Wentao Liu Zhuoran Li Diqi Chen Zhou Wang Yizhou Wang and Wen Gao. 2020. Assessing the Quality-of-Experience of Adaptive Bitrate Video Streaming. arXiv:2008.08804 [eess.IV]"},{"key":"e_1_3_2_2_13_1","volume-title":"Comparing Comparisons: Informative and Easy Human Feedback with Distinguishability Queries. In ICML.","author":"Feng Xuening","year":"2025","unstructured":"Xuening Feng, Zhaohui JIANG, Timo Kaufmann, Eyke H\u00fcllermeier, Paul Weng, and Yifei Zhu. 2025. Comparing Comparisons: Informative and Easy Human Feedback with Distinguishability Queries. In ICML."},{"key":"e_1_3_2_2_14_1","volume-title":"DUO: Diverse, Uncertain, On-Policy Query Generation and Selection for Reinforcement Learning from Human Feedback. In AAAI.","author":"Feng Xuening","year":"2025","unstructured":"Xuening Feng, Zhaohui Jiang, Timo Kaufmann, Puchen Xu, Eyke H\u00fcllermeier, Paul Weng, and Yifei Zhu. 2025. DUO: Diverse, Uncertain, On-Policy Query Generation and Selection for Reinforcement Learning from Human Feedback. In AAAI."},{"key":"e_1_3_2_2_15_1","unstructured":"Leo Gao John Schulman and Jacob Hilton. 2023. Scaling Laws for Reward Model Overoptimization. In ICML (Honolulu Hawaii USA). 10835--10866."},{"key":"e_1_3_2_2_16_1","volume-title":"Query-Policy Misalignment in Preference-Based Reinforcement Learning. ArXiv abs\/2305.17400","author":"Hu Xiao","year":"2023","unstructured":"Xiao Hu, Jianxiong Li, Xianyuan Zhan, Qing-Shan Jia, and Ya-Qin Zhang. 2023. Query-Policy Misalignment in Preference-Based Reinforcement Learning. ArXiv abs\/2305.17400 (2023)."},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"crossref","unstructured":"Tianchi Huang Rui-Xiao Zhang ChengleiWu and Lifeng Sun. 2023. Optimizing Adaptive Video Streaming with Human Feedback. In MM (Ottawa ON Canada) (MM '23). 1707--1718.","DOI":"10.1145\/3581783.3611771"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2020.3000363"},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2022.3180804"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"crossref","unstructured":"Te-Yuan Huang Ramesh Johari Nick McKeown Matthew Trunnell and Mark Watson. 2014. A buffer-based approach to rate adaptation: evidence from a large video streaming service. In SIGCOMM (Chicago Illinois USA) (SIGCOMM '14). 187--198.","DOI":"10.1145\/2619239.2626296"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2019.2939282"},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"crossref","unstructured":"Junchen Jiang Vyas Sekar and Hui Zhang. 2012. Improving fairness efficiency and stability in HTTP-based adaptive video streaming with FESTIVE. In CoNEXT (Nice France) (CoNEXT '12). 97--108.","DOI":"10.1145\/2413176.2413189"},{"key":"e_1_3_2_2_23_1","unstructured":"Zhaohui JIANG Xuening Feng Paul Weng Yifei Zhu Yan Song Tianze Zhou Yujing Hu Tangjie Lv and Changjie Fan. 2025. Reinforcement Learning from Imperfect Corrective Actions and Proxy Rewards. In ICLR (Singapore)."},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2013.2281542"},{"volume-title":"B-Pref: Benchmarking Preference-Based Reinforcement Learning","author":"Lee Kimin","key":"e_1_3_2_2_25_1","unstructured":"Kimin Lee, Laura Smith, Anca Dragan, and Pieter Abbeel. 2021. B-Pref: Benchmarking Preference-Based Reinforcement Learning. In NeurIPS. Neural Information Processing Systems Foundation, Curran Associates Inc."},{"key":"e_1_3_2_2_26_1","volume-title":"ICML (Proceedings of Machine Learning Research","volume":"6163","author":"Lee Kimin","year":"2021","unstructured":"Kimin Lee, Laura M Smith, and Pieter Abbeel. 2021. PEBBLE: Feedback-Efficient Interactive Reinforcement Learning via Relabeling Experience and Unsupervised Pre-training. In ICML (Proceedings of Machine Learning Research, Vol. 139). PMLR, 6152--6163."},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"crossref","unstructured":"Yiyun Lu Yifei Zhu and Zhi Wang. 2022. Personalized 360-degree video streaming: A meta-learning approach. In ACM Multimedia. 3143--3151.","DOI":"10.1145\/3503161.3548047"},{"key":"e_1_3_2_2_28_1","volume-title":"RLIF: Interactive Imitation Learning as Reinforcement Learning. In ICLR (Vienna, Austria).","author":"Luo Jianlan","year":"2024","unstructured":"Jianlan Luo, Perry Dong, Yuexiang Zhai, Yi Ma, and Sergey Levine. 2024. RLIF: Interactive Imitation Learning as Reinforcement Learning. In ICLR (Vienna, Austria)."},{"key":"e_1_3_2_2_29_1","volume-title":"Mehrdad Khani Shirkoohi, Songtao He, Vikram Nathan, Frank Cangialosi, Shaileshh Venkatakrishnan, Wei-HungWeng, Song Han, Tim Kraska, and Dr. Mohammad Alizadeh.","author":"Mao Hongzi","year":"2019","unstructured":"Hongzi Mao, Parimarjan Negi, Akshay Narayan, Hanrui Wang, Jiacheng Yang, Haonan Wang, Ryan Marcus, ravichandra addanki, Mehrdad Khani Shirkoohi, Songtao He, Vikram Nathan, Frank Cangialosi, Shaileshh Venkatakrishnan, Wei-HungWeng, Song Han, Tim Kraska, and Dr. Mohammad Alizadeh. 2019. Park: An Open Platform for Learning-Augmented Computer Systems. In NeurIPS, Vol. 32. Curran Associates, Inc."},{"key":"e_1_3_2_2_30_1","doi-asserted-by":"publisher","unstructured":"Hongzi Mao Ravi Netravali and Mohammad Alizadeh. 2017. Neural Adaptive Video Streaming with Pensieve. In SIGCOMM (Los Angeles CA USA) (SIGCOMM '17). 197--210. doi:10.1145\/3098822.3098843","DOI":"10.1145\/3098822.3098843"},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"crossref","unstructured":"Volodymyr Mnih Koray Kavukcuoglu David Silver Andrei A Rusu Joel Veness Marc G Bellemare Alex Graves Martin Riedmiller Andreas K Fidjeland Georg Ostrovski et al. 2015. Human-level control through deep reinforcement learning. nature 518 7540 (2015) 529--533.","DOI":"10.1038\/nature14236"},{"key":"e_1_3_2_2_32_1","volume-title":"Spontaneous Reward Hacking in Iterative Self-Refinement. CoRR abs\/2407.04549","author":"Pan Jane","year":"2024","unstructured":"Jane Pan, He He, Samuel R. Bowman, and Shi Feng. 2024. Spontaneous Reward Hacking in Iterative Self-Refinement. CoRR abs\/2407.04549 (2024)."},{"key":"e_1_3_2_2_33_1","volume-title":"CoNEXT3, Article 17 (nov","author":"Peroni Leonardo","year":"2023","unstructured":"Leonardo Peroni, Sergey Gorinsky, Farzad Tashtarian, and Christian Timmerer. 2023. Empowerment of Atypical Viewers via Low-Effort Personalized Modeling of Video Streaming Quality. CoNEXT 1, CoNEXT3, Article 17 (nov 2023), 27 pages."},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2020.3032416"},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/QoMEX.2017.7965689"},{"volume-title":"ICML (Honolulu, Hawaii, USA) (Proceedings of Machine Learning Research","author":"Runje Davor","key":"e_1_3_2_2_36_1","unstructured":"Davor Runje and Sharath M Shankaranarayana. 2023. Constrained Monotonic Neural Networks. In ICML (Honolulu, Hawaii, USA) (Proceedings of Machine Learning Research, Vol. 202). PMLR, 29338--29353."},{"volume-title":"The Global Internet Phenomena Report","year":"2024","key":"e_1_3_2_2_37_1","unstructured":"Sandvine. 2024. The Global Internet Phenomena Report January 2024. https:\/\/www.sandvine.com\/blog\/sandvines-2024-global-internet-phenomenareport- global-internet-usage-continues-to-grow"},{"key":"e_1_3_2_2_38_1","unstructured":"Tom Schaul John Quan Ioannis Antonoglou and David Silver. 2016. Prioritized Experience Replay. In ICLR (San Juan Puerto Rico)."},{"key":"e_1_3_2_2_39_1","volume-title":"Aaron Courville, Marc G Bellemare, Rishabh Agarwal, and Pablo Samuel Castro.","author":"Schwarzer Max","year":"2023","unstructured":"Max Schwarzer, Johan Samir Obando Ceron, Aaron Courville, Marc G Bellemare, Rishabh Agarwal, and Pablo Samuel Castro. 2023. Bigger, better, faster: Humanlevel atari with human-level efficiency. In ICML. PMLR, 30365--30380."},{"key":"e_1_3_2_2_40_1","volume-title":"NeurIPS","volume":"35","author":"Skalse Joar","year":"2022","unstructured":"Joar Skalse, Nikolaus Howe, Dmitrii Krasheninnikov, and David Krueger. 2022. Defining and Characterizing Reward Gaming. In NeurIPS, Vol. 35. Curran Associates, Inc., 9460--9471."},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2020.2996964"},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1943552.1943572"},{"key":"e_1_3_2_2_43_1","volume-title":"17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20)","author":"Yan Francis Y.","year":"2020","unstructured":"Francis Y. Yan, Hudson Ayers, Chenzhi Zhu, Sadjad Fouladi, James Hong, Keyi Zhang, Philip Levis, and Keith Winstein. 2020. Learning in situ: a randomized experiment in video streaming. In 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20). USENIX Association, Santa Clara, CA, 495--511."},{"key":"e_1_3_2_2_44_1","doi-asserted-by":"publisher","unstructured":"Xiaoqi Yin Abhishek Jindal Vyas Sekar and Bruno Sinopoli. 2015. A Control- Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP. (2015) 325--338. doi:10.1145\/2785956.2787486","DOI":"10.1145\/2785956.2787486"},{"key":"e_1_3_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2020.2973828"},{"key":"e_1_3_2_2_46_1","volume-title":"Haotian Li, Anfu Zhou, Chuanming Wang, and Huadong Ma.","author":"Zhang Huanhuan","year":"2024","unstructured":"Huanhuan Zhang, Liu zhuo, Haotian Li, Anfu Zhou, Chuanming Wang, and Huadong Ma. 2024. AraLive: Automatic Reward Adaption for Learning-based Live Video Streaming. In MM. 11099--11108."},{"key":"e_1_3_2_2_47_1","volume-title":"NeurIPS 2023 Workshop on Instruction Tuning and Instruction Following. Curran Associates Inc.","author":"Zheng Rui","year":"2023","unstructured":"Rui Zheng, Shihan Dou, Songyang Gao, Yuan Hua, Wei Shen, Binghai Wang, Yan Liu, Senjie Jin, Yuhao Zhou, Limao Xiong, Lu Chen, Zhiheng Xi, Nuo Xu,Wenbin Lai, Minghao Zhu, Haoran Huang, Tao Gui, Qi Zhang, and Xuanjing Huang. 2023. Delve into PPO: Implementation Matters for Stable RLHF. In NeurIPS 2023 Workshop on Instruction Tuning and Instruction Following. Curran Associates Inc."},{"volume-title":"Adaptive Bitrate with User-level QoE Preference for Video Streaming","author":"Zuo Xutong","key":"e_1_3_2_2_48_1","unstructured":"Xutong Zuo, Jiayu Yang, Mowei Wang, and Yong Cui. 2022. Adaptive Bitrate with User-level QoE Preference for Video Streaming. In INFOCOM. IEEE, London, United Kingdom, 1279--1288."}],"event":{"name":"MM '25: The 33rd ACM International Conference on Multimedia","sponsor":["SIGMM ACM Special Interest Group on Multimedia"],"location":"Dublin Ireland","acronym":"MM '25"},"container-title":["Proceedings of the 33rd ACM International Conference on Multimedia"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3746027.3755323","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,10]],"date-time":"2025-12-10T04:04:01Z","timestamp":1765339441000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3746027.3755323"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,27]]},"references-count":48,"alternative-id":["10.1145\/3746027.3755323","10.1145\/3746027"],"URL":"https:\/\/doi.org\/10.1145\/3746027.3755323","relation":{},"subject":[],"published":{"date-parts":[[2025,10,27]]},"assertion":[{"value":"2025-10-27","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}