{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T16:44:21Z","timestamp":1779295461922,"version":"3.51.4"},"reference-count":47,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2020,2,17]],"date-time":"2020-02-17T00:00:00Z","timestamp":1581897600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Nokia Center for Advanced Research"},{"name":"European Research Council (ERC) under the European Union's Horizon 2020 research and innovation programme","award":["637991"],"award-info":[{"award-number":["637991"]}]},{"DOI":"10.13039\/501100002341","name":"Academy of Finland","doi-asserted-by":"crossref","award":["297892"],"award-info":[{"award-number":["297892"]}],"id":[{"id":"10.13039\/501100002341","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2020,2,29]]},"abstract":"<jats:p>Cloud gaming enables playing high-end games, originally designed for PC or game console setups, on low-end devices such as netbooks and smartphones, by offloading graphics rendering to GPU-powered cloud servers. However, transmitting the high-resolution video requires a large amount of network bandwidth, even though it is a compressed video stream. Foveated video encoding (FVE) reduces the bandwidth requirement by taking advantage of the non-uniform acuity of human visual system and by knowing where the user is looking. Based on a consumer-grade real-time eye tracker and an open source cloud gaming platform, we provide a cloud gaming FVE prototype that is game-agnostic and requires no modifications to the underlying game engine. In this article, we describe the prototype and its evaluation through measurements with representative games from different genres to understand the effect of parametrization of the FVE scheme on bandwidth requirements and to understand its feasibility from the latency perspective. We also present results from a user study on first-person shooter games. The results suggest that it is possible to find a \u201csweet spot\u201d for the encoding parameters so the users hardly notice the presence of foveated encoding but at the same time the scheme yields most of the achievable bandwidth savings.<\/jats:p>","DOI":"10.1145\/3369110","type":"journal-article","created":{"date-parts":[[2020,3,4]],"date-time":"2020-03-04T10:23:32Z","timestamp":1583317412000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":65,"title":["Cloud Gaming with Foveated Video Encoding"],"prefix":"10.1145","volume":"16","author":[{"given":"Gazi Karam","family":"Illahi","sequence":"first","affiliation":[{"name":"Aalto University, Espoo, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas Van","family":"Gemert","sequence":"additional","affiliation":[{"name":"Aalto University, Espoo, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matti","family":"Siekkinen","sequence":"additional","affiliation":[{"name":"Aalto University and University of Helsinki, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Enrico","family":"Masala","sequence":"additional","affiliation":[{"name":"Politecnico di Torino, Turin, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Antti","family":"Oulasvirta","sequence":"additional","affiliation":[{"name":"Aalto University, Espoo, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Antti","family":"Yl\u00e4-J\u00e4\u00e4ski","sequence":"additional","affiliation":[{"name":"Aalto University, Espoo, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,2,17]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00530-014-0381-1"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2017.2750918"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3127589"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2676652.2683461"},{"key":"e_1_2_1_5_1","unstructured":"Speedtest by Ookla. 2019. Monthly Comparisons of Internet Speeds from Around the World. Retrieved from https:\/\/www.speedtest.net\/global-index.  Speedtest by Ookla. 2019. Monthly Comparisons of Internet Speeds from Around the World. Retrieved from https:\/\/www.speedtest.net\/global-index."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIC.2014.22"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/CloudCom.2013.17"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2013.2291532"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2072298.2071991"},{"key":"e_1_2_1_10_1","first-page":"6","article-title":"Perceptually-friendly H.264\/AVC video coding based on foveated just-noticeable-distortion model","volume":"20","author":"Chen Zhenzhong","year":"2010","unstructured":"Zhenzhong Chen and Christine Guillemot . 2010 . Perceptually-friendly H.264\/AVC video coding based on foveated just-noticeable-distortion model . IEEE Trans. Circ. Syst. Vid. Technol. 20 , 6 (June 2010), 806--819. DOI:https:\/\/doi.org\/10.1109\/TCSVT.2010.2045912 10.1109\/TCSVT.2010.2045912 Zhenzhong Chen and Christine Guillemot. 2010. Perceptually-friendly H.264\/AVC video coding based on foveated just-noticeable-distortion model. IEEE Trans. Circ. Syst. Vid. Technol. 20, 6 (June 2010), 806--819. DOI:https:\/\/doi.org\/10.1109\/TCSVT.2010.2045912","journal-title":"IEEE Trans. Circ. Syst. Vid. Technol."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/NetGames.2012.6404024"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1167838.1167860"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the 33rd ACM Conference on Human Factors in Computing Systems (CHI\u201915)","author":"Deber Jonathan","year":"2015","unstructured":"Jonathan Deber , Ricardo Jota , Clifton Forlines , and Daniel Wigdor . 2015 . How much faster is fast enough? User perception of latency 8 latency improvements in direct and indirect touch . In Proceedings of the 33rd ACM Conference on Human Factors in Computing Systems (CHI\u201915) , 1, 1 (2015), 1827--1836. DOI:https:\/\/doi.org\/10.1145\/2702123.2702300 10.1145\/2702123.2702300 Jonathan Deber, Ricardo Jota, Clifton Forlines, and Daniel Wigdor. 2015. How much faster is fast enough? User perception of latency 8 latency improvements in direct and indirect touch. In Proceedings of the 33rd ACM Conference on Human Factors in Computing Systems (CHI\u201915), 1, 1 (2015), 1827--1836. DOI:https:\/\/doi.org\/10.1145\/2702123.2702300"},{"key":"e_1_2_1_14_1","volume-title":"Evaluation of the Tobii EyeX eye tracking controller and Matlab toolkit for research. Behav. Res. Meth. 49, 3 (01","author":"Gibaldi Agostino","year":"2017","unstructured":"Agostino Gibaldi , Mauricio Vanegas , Peter J. Bex , and Guido Maiello . 2017. Evaluation of the Tobii EyeX eye tracking controller and Matlab toolkit for research. Behav. Res. Meth. 49, 3 (01 June 2017 ), 923--946. DOI:https:\/\/doi.org\/10.3758\/s13428-016-0762-9 10.3758\/s13428-016-0762-9 Agostino Gibaldi, Mauricio Vanegas, Peter J. Bex, and Guido Maiello. 2017. Evaluation of the Tobii EyeX eye tracking controller and Matlab toolkit for research. Behav. Res. Meth. 49, 3 (01 June 2017), 923--946. DOI:https:\/\/doi.org\/10.3758\/s13428-016-0762-9"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2483977.2483981"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2483977.2483981"},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the International Conference on Advances in Computer Entertainment.","author":"Ijsselsteijn Wijnand","year":"2007","unstructured":"Wijnand Ijsselsteijn , Yvonne de Kort , Karolien Poels , Audrius Jurgelionis , and Francesco Bellotti . 2007 . Characterising and measuring user experiences in digital games . In Proceedings of the International Conference on Advances in Computer Entertainment. Wijnand Ijsselsteijn, Yvonne de Kort, Karolien Poels, Audrius Jurgelionis, and Francesco Bellotti. 2007. Characterising and measuring user experiences in digital games. In Proceedings of the International Conference on Advances in Computer Entertainment."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/MMSP.2017.8122235"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2004.834657"},{"key":"e_1_2_1_20_1","volume-title":"7th Meeting.","author":"JVT.","unstructured":"JVT. 2003. Joint video team (JVT) of ISO\/IEC MPEG and ITU-T VCEG. Draft ITU-T recommendation and final draft international standard of joint video specification (ITU-T Rec. H264 ISO\/IEC 14496--10 AVC), document JVT-G050d35 , 7th Meeting. JVT. 2003. Joint video team (JVT) of ISO\/IEC MPEG and ITU-T VCEG. Draft ITU-T recommendation and final draft international standard of joint video specification (ITU-T Rec. H264 ISO\/IEC 14496--10 AVC), document JVT-G050d35, 7th Meeting."},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the 5th International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing. 330--335","author":"Jarschel M.","year":"2011","unstructured":"M. Jarschel , D. Schlosser , S. Scheuring , and T. Ho\u00dffeld . 2011. An evaluation of QoE in cloud gaming based on subjective tests . In Proceedings of the 5th International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing. 330--335 .DOI:https:\/\/doi.org\/10.1109\/IMIS. 2011 .92 10.1109\/IMIS.2011.92 M. Jarschel, D. Schlosser, S. Scheuring, and T. Ho\u00dffeld. 2011. An evaluation of QoE in cloud gaming based on subjective tests. In Proceedings of the 5th International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing. 330--335.DOI:https:\/\/doi.org\/10.1109\/IMIS.2011.92"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3083187.3083191"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2010.07.001"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2018.2794119"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/QoMEX.2017.7965669"},{"key":"e_1_2_1_26_1","volume-title":"Digital and medical image processing. Universiteit Utrecht","author":"Maintz Twan","year":"2005","unstructured":"Twan Maintz . 2005. Digital and medical image processing. Universiteit Utrecht ( 2005 ). Twan Maintz. 2005. Digital and medical image processing. Universiteit Utrecht (2005)."},{"key":"e_1_2_1_27_1","unstructured":"Loren Merritt and Rahul Vanam. 2006. x264: A high performance H. 264\/AVC encoder. Retrieved from http:\/\/neuron2.net\/library\/avc\/overview_x264_v8_5.pdf.  Loren Merritt and Rahul Vanam. 2006. x264: A high performance H. 264\/AVC encoder. Retrieved from http:\/\/neuron2.net\/library\/avc\/overview_x264_v8_5.pdf."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICMEW.2015.7169781"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.21437\/PQS.2013-31"},{"key":"e_1_2_1_30_1","volume-title":"New techniques for assessing audio and video quality in real-time interactive communications. IHM-HCI Tutorial","author":"Mullin Jim","year":"2001","unstructured":"Jim Mullin , Lucy Smallwood , Anna Watson , and Gillian Wilson . 2001. New techniques for assessing audio and video quality in real-time interactive communications. IHM-HCI Tutorial 2001 , Lille , France . 1--63. Jim Mullin, Lucy Smallwood, Anna Watson, and Gillian Wilson. 2001. New techniques for assessing audio and video quality in real-time interactive communications. IHM-HCI Tutorial 2001, Lille, France. 1--63."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/GLOCOM.2015.7417405"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/WCCIT.2013.6618758"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980055.2980056"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.2352\/ISSN.2470-1173.2016.16.HVEI-117"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.2352\/ISSN.2470-1173.2017.14.HVEI-124"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.visres.2015.12.001"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2910017.2910592"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1167\/16.15.23"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/MNET.2013.6574660"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.5555\/2755535.2755552"},{"key":"e_1_2_1_41_1","unstructured":"Rand S. Swenson. 2006. Review of Clinical and Functional Neuroscience. Retrieved from https:\/\/www.dartmouth.edu\/rswenson\/NeuroSci\/index.html.  Rand S. Swenson. 2006. Review of Clinical and Functional Neuroscience. Retrieved from https:\/\/www.dartmouth.edu\/rswenson\/NeuroSci\/index.html."},{"key":"e_1_2_1_42_1","unstructured":"Tobii. 2015. Developer\u2019s Guide Tobii EyeX SDK for C\/C++. Retrieved from http:\/\/developer-files.tobii.com\/wp-content\/uploads\/2016\/03\/Developers-Guide-C-Cpp.pdf.  Tobii. 2015. Developer\u2019s Guide Tobii EyeX SDK for C\/C++. Retrieved from http:\/\/developer-files.tobii.com\/wp-content\/uploads\/2016\/03\/Developers-Guide-C-Cpp.pdf."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2006.101"},{"key":"e_1_2_1_44_1","volume-title":"Foundations of Vision","author":"Wandell Brian A.","unstructured":"Brian A. Wandell . 1995. Foundations of Vision . Vol. 8 . Sinauer Associates , Sunderland, MA . Brian A. Wandell. 1995. Foundations of Vision. Vol. 8. Sinauer Associates, Sunderland, MA."},{"key":"e_1_2_1_45_1","volume-title":"Bovik","author":"Wang Zhou","year":"2006","unstructured":"Zhou Wang and Alan C . Bovik . 2006 . Foveated image and video coding. In Digital Video, Image Quality, and Perceptual Coding, Hong Ren Wu and Kamisetty Ramamohan Rao (Eds.). CRC Press , Boca Raton, FL, 431--457. Zhou Wang and Alan C. Bovik. 2006. Foveated image and video coding. In Digital Video, Image Quality, and Perceptual Coding, Hong Ren Wu and Kamisetty Ramamohan Rao (Eds.). CRC Press, Boca Raton, FL, 431--457."},{"key":"e_1_2_1_46_1","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1109\/TIP.2003.809015","article-title":"Foveation scalable video coding with automatic fixation selection","volume":"12","author":"Wang Zhou","year":"2003","unstructured":"Zhou Wang , Ligang Lu , and Alan. C. Bovik . 2003 . Foveation scalable video coding with automatic fixation selection . IEEE Trans. Image Proc. 12 , 2 (Feb. 2003), 243--254. DOI:https:\/\/doi.org\/10.1109\/TIP.2003.809015 10.1109\/TIP.2003.809015 Zhou Wang, Ligang Lu, and Alan. C. Bovik. 2003. Foveation scalable video coding with automatic fixation selection. IEEE Trans. Image Proc. 12, 2 (Feb. 2003), 243--254. DOI:https:\/\/doi.org\/10.1109\/TIP.2003.809015","journal-title":"IEEE Trans. Image Proc."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2964284.2967292"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3369110","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3369110","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:53:05Z","timestamp":1750204385000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3369110"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,17]]},"references-count":47,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,2,29]]}},"alternative-id":["10.1145\/3369110"],"URL":"https:\/\/doi.org\/10.1145\/3369110","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,17]]},"assertion":[{"value":"2018-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-02-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}