{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,20]],"date-time":"2026-01-20T03:34:29Z","timestamp":1768880069530,"version":"3.49.0"},"reference-count":29,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2018,4,3]],"date-time":"2018-04-03T00:00:00Z","timestamp":1522713600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100016746","name":"Futurewei Technologies","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100016746","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["CNS-1731658"],"award-info":[{"award-number":["CNS-1731658"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Meas. Anal. Comput. Syst."],"published-print":{"date-parts":[[2018,4,3]]},"abstract":"<jats:p>The design of schedulers to optimize heterogeneous users' Quality of Experience (QoE) remains a challenging and important problem for wireless systems. This paper explores three inter-related aspects of this problem: 1) non-linear relationships between a user's QoE and flow delays; 2) managing load dependent QoE trade-offs among heterogeneous application classes; and 3), striking a good balance between opportunistic scheduling and greedy QoE optimization. To that end we study downlink schedulers which minimize the expected cost modeled by convex functions of flow delays for users with heterogeneous channel rate variations. The essential features of this challenging problem are modeled as a Markov Decision Process to which we apply Whittle's relaxation, which in turn is shown to be indexable. Based on the Whittle's relaxation we develop a new scheduling policy, Opportunistic Delay Based Index Policy (ODIP). We then prove various structural properties for ODIP which result in closed form expressions for Whittle's indices under different scheduler scenarios. Using extensive simulations we show that ODIP scheduler provides a robust means to realize complex QoE trade-offs for a range of system loads.<\/jats:p>","DOI":"10.1145\/3179418","type":"journal-article","created":{"date-parts":[[2018,4,4]],"date-time":"2018-04-04T12:11:45Z","timestamp":1522843905000},"page":"1-39","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":15,"title":["A Whittle's Index Based Approach for QoE Optimization in Wireless Networks"],"prefix":"10.1145","volume":"2","author":[{"given":"Arjun","family":"Anand","sequence":"first","affiliation":[{"name":"The University of Texas at Austin, Austin, TX, USA"}]},{"given":"Gustavo","family":"de Veciana","sequence":"additional","affiliation":[{"name":"The University of Texas at Austin, Austin, TX, USA"}]}],"member":"320","published-online":{"date-parts":[[2018,4,3]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.4108\/ICST.VALUETOOLS2008.4335"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11134-009-9141-x"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/1769187.1769304"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2745844.2745851"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1993744.1993761"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11134-012-9285-y"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.comcom.2009.10.016"},{"key":"e_1_2_1_8_1","volume-title":"Measurement-based Scheduler for Multi-class QoE Optimization in Wireless Networks Proc. INFOCOM. 1--9.","author":"Anand Arjun","year":"2017","unstructured":"Arjun Anand and Gustavo de Veciana . 2017 . Measurement-based Scheduler for Multi-class QoE Optimization in Wireless Networks Proc. INFOCOM. 1--9. Arjun Anand and Gustavo de Veciana. 2017. Measurement-based Scheduler for Multi-class QoE Optimization in Wireless Networks Proc. INFOCOM. 1--9."},{"key":"e_1_2_1_9_1","volume-title":"Ni no-Mora, and M. O'Keeffe","author":"Ansell P. S.","year":"2003","unstructured":"P. S. Ansell , K. D. Glazebrook , J. Ni no-Mora, and M. O'Keeffe . 2003 . Whittle's Index Policy for a Multi-Class Queueing System with Convex Holding Costs. Mathematical Methods of Operations Research , Vol. 57 , 1 (01 Apr.. 2003), 21--39. P. S. Ansell, K. D. Glazebrook, J. Ni no-Mora, and M. O'Keeffe. 2003. Whittle's Index Policy for a Multi-Class Queueing System with Convex Holding Costs. Mathematical Methods of Operations Research, Vol. 57, 1 (01 Apr.. 2003), 21--39."},{"key":"e_1_2_1_10_1","volume-title":"INFOCOM","volume":"2","author":"Avrachenkov Konstantin","year":"2004","unstructured":"Konstantin Avrachenkov , Urtzi Ayesta , Patrick Brown , and Eeva Nyberg . 2004 . Differentiation Between Short and Long TCP flows: Predictability of the Response Time Proc . INFOCOM , Vol. Vol. 2 . 762--773. Konstantin Avrachenkov, Urtzi Ayesta, Patrick Brown, and Eeva Nyberg. 2004. Differentiation Between Short and Long TCP flows: Predictability of the Response Time Proc. INFOCOM, Vol. Vol. 2. 762--773."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.peva.2010.08.015"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2012.2199764"},{"key":"e_1_2_1_13_1","volume-title":"Dynamic Programming and Optimal Control (bibinfoedition4 ed.)","author":"Bertsekas Dimitri P.","unstructured":"Dimitri P. Bertsekas . 2012. Dynamic Programming and Optimal Control (bibinfoedition4 ed.) . Vol. Vol. 2 . Athena Scientific . Dimitri P. Bertsekas. 2012. Dynamic Programming and Optimal Control (bibinfoedition4 ed.). Vol. Vol. 2. Athena Scientific."},{"key":"e_1_2_1_14_1","volume-title":"Multidisciplinary Int. Conf. on Scheduling : Theory and Applications (MISTA","author":"Bispo Carlos F.","year":"2011","unstructured":"Carlos F. Bispo . 2011 . Single Server Scheduling Problem: Optimal policy for Convex Costs Depends on Arrival Rates Proc . Multidisciplinary Int. Conf. on Scheduling : Theory and Applications (MISTA 2011). 275--296. Carlos F. Bispo. 2011. Single Server Scheduling Problem: Optimal policy for Convex Costs Depends on Arrival Rates Proc. Multidisciplinary Int. Conf. on Scheduling : Theory and Applications (MISTA 2011). 275--296."},{"key":"e_1_2_1_15_1","volume-title":"User-level Performance of Channel-Aware Scheduling Algorithms in Wireless Data Networks Proc. INFOCOM","volume":"1","author":"Borst Sem","year":"2003","unstructured":"Sem Borst . 2003 . User-level Performance of Channel-Aware Scheduling Algorithms in Wireless Data Networks Proc. INFOCOM , Vol. Vol. 1 . 321--331. Sem Borst. 2003. User-level Performance of Channel-Aware Scheduling Algorithms in Wireless Data Networks Proc. INFOCOM, Vol. Vol. 1. 321--331."},{"key":"e_1_2_1_16_1","volume-title":"Flow-Level Stability of Channel-Aware Scheduling Algorithms Proc. 4th International Symposium on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks. 1--6.","author":"Borst Sem","year":"2006","unstructured":"Sem Borst and Matthieu Jonckheere . 2006 . Flow-Level Stability of Channel-Aware Scheduling Algorithms Proc. 4th International Symposium on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks. 1--6. Sem Borst and Matthieu Jonckheere. 2006. Flow-Level Stability of Channel-Aware Scheduling Algorithms Proc. 4th International Symposium on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks. 1--6."},{"key":"e_1_2_1_17_1","volume-title":"Multi-armed Bandit Allocation Indices","author":"Gittins John C.","unstructured":"John C. Gittins , Kevin D. Glazebrook , and Richard Weber . 2011. Multi-armed Bandit Allocation Indices ( 2 nd ed.). Qiley . John C. Gittins, Kevin D. Glazebrook, and Richard Weber. 2011. Multi-armed Bandit Allocation Indices (2nd ed.). Qiley.","edition":"2"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1287\/msom.1070.0211"},{"key":"e_1_2_1_19_1","volume-title":"Performance Modeling and Design of Computer Systems: Queueing Theory in Action","author":"Harchol-Balter Mor","unstructured":"Mor Harchol-Balter . 2013. Performance Modeling and Design of Computer Systems: Queueing Theory in Action . Cambridge University Press . Mor Harchol-Balter. 2013. Performance Modeling and Design of Computer Systems: Queueing Theory in Action. Cambridge University Press."},{"key":"e_1_2_1_20_1","unstructured":"Tobias Hobfeld Sebastian Biedermann Raimund Schatz Alexander Platzer Sebastian Egger and Markus Fiedler. 2011. The Memory Effect and its Implications on Web QoE modeling Proc. Int. Teletraffic Cong.(ITC). 103--110.   Tobias Hobfeld Sebastian Biedermann Raimund Schatz Alexander Platzer Sebastian Egger and Markus Fiedler. 2011. The Memory Effect and its Implications on Web QoE modeling Proc. Int. Teletraffic Cong.(ITC). 103--110."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.peva.2011.07.012"},{"key":"e_1_2_1_22_1","volume-title":"Computer Applications","author":"Kleinrock Leonard","unstructured":"Leonard Kleinrock . 1976. Queueing Systems . Vol. Vol. II : Computer Applications . Wiley Interscience . Leonard Kleinrock. 1976. Queueing Systems. Vol. Vol. II: Computer Applications. Wiley Interscience."},{"key":"e_1_2_1_23_1","volume-title":"Neely","author":"Li","year":"2011","unstructured":"Chi-ping Li and Michael J . Neely . 2011 . Delay and Power-Optimal Control in Multi-Class Queueing Systems. ArXiv e-prints (Jan .. 2011). showeprint{arxiv}math.OC\/1101.2478 Chi-ping Li and Michael J. Neely. 2011. Delay and Power-Optimal Control in Multi-Class Queueing Systems. ArXiv e-prints (Jan.. 2011). showeprint{arxiv}math.OC\/1101.2478"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1287\/opre.1040.0152"},{"key":"e_1_2_1_25_1","volume-title":"Measuring the Quality of Experience of HTTP Video Streaming Proc. IFIP\/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops. 485--492","author":"Mok Ricky K. P.","unstructured":"Ricky K. P. Mok , Edward W. W. Chan , and Rocky K. C. Chang . 2011 . Measuring the Quality of Experience of HTTP Video Streaming Proc. IFIP\/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops. 485--492 . Ricky K. P. Mok, Edward W. W. Chan, and Rocky K. C. Chang. 2011. Measuring the Quality of Experience of HTTP Video Streaming Proc. IFIP\/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops. 485--492."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCOMM.2009.09.0800902"},{"key":"e_1_2_1_27_1","volume-title":"Improving the Quality of Experience with Size-Based and Opportunistic Scheduling Proc. International Symposium on Wireless Communications Systems (ISWCS). 443--448","author":"Proebster Magnus","year":"2014","unstructured":"Magnus Proebster . 2014 . Improving the Quality of Experience with Size-Based and Opportunistic Scheduling Proc. International Symposium on Wireless Communications Systems (ISWCS). 443--448 . Magnus Proebster. 2014. Improving the Quality of Experience with Size-Based and Opportunistic Scheduling Proc. International Symposium on Wireless Communications Systems (ISWCS). 443--448."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1186\/1687-1499-2012-216"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.2307\/1427683"}],"container-title":["Proceedings of the ACM on Measurement and Analysis of Computing Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3179418","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3179418","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3179418","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:08:18Z","timestamp":1750208898000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3179418"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,4,3]]},"references-count":29,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2018,4,3]]}},"alternative-id":["10.1145\/3179418"],"URL":"https:\/\/doi.org\/10.1145\/3179418","relation":{},"ISSN":["2476-1249"],"issn-type":[{"value":"2476-1249","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,4,3]]},"assertion":[{"value":"2018-04-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}