{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,30]],"date-time":"2026-07-30T13:06:27Z","timestamp":1785416787371,"version":"3.56.0"},"reference-count":51,"publisher":"Association for Computing Machinery (ACM)","issue":"CHI PLAY","license":[{"start":{"date-parts":[[2021,10,5]],"date-time":"2021-10-05T00:00:00Z","timestamp":1633392000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2021,10,5]]},"abstract":"<jats:p>Cloud gaming services and remote play offer a wide range of advantages but can inherent a considerable delay between input and action also known as latency. Previous work indicates that deep learning algorithms such as artificial neural networks (ANN) are able to compensate for latency. As high latency in video games significantly reduces player performance and game experience, this work investigates if latency can be compensated using ANNs within a live first-person action game. We developed a 3D video game and coupled it with the prediction of an ANN. We trained our network on data of 24 participants who played the game in a first study. We evaluated our system in a second user study with 96 participants. To simulate latency in cloud game streaming services, we added 180 ms latency to the game by buffering user inputs. In the study we predicted latency values of 60 ms, 120 ms and 180 ms. Our results show that players achieve significantly higher scores, substantially more hits per shot and associate the game significantly stronger with a positive affect when supported by our ANN. This work illustrates that high latency systems, such as game streaming services, benefit from utilizing a predictive system.<\/jats:p>","DOI":"10.1145\/3474710","type":"journal-article","created":{"date-parts":[[2021,10,6]],"date-time":"2021-10-06T22:59:48Z","timestamp":1633561188000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":21,"title":["Increasing Player Performance and Game Experience in High Latency Systems"],"prefix":"10.1145","volume":"5","author":[{"given":"David","family":"Halbhuber","sequence":"first","affiliation":[{"name":"University of Regensburg, Regensburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Niels","family":"Henze","sequence":"additional","affiliation":[{"name":"University of Regensburg, Regensburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Valentin","family":"Schwind","sequence":"additional","affiliation":[{"name":"Frankfurt University of Applied Sciences, Frankfurt, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,10,6]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","unstructured":"Mart'in Abadi Ashish Agarwal Paul Barham Eugene Brevdo Zhifeng Chen Craig Citro Greg S. Corrado Andy Davis Jeffrey Dean Matthieu Devin Sanjay Ghemawat Ian Goodfellow Andrew Harp Geoffrey Irving Michael Isard Yangqing Jia Rafal Jozefowicz Lukasz Kaiser Manjunath Kudlur Josh Levenberg Dandelion Man\u00e9 Rajat Monga Sherry Moore Derek Murray Chris Olah Mike Schuster Jonathon Shlens Benoit Steiner Ilya Sutskever Kunal Talwar Paul Tucker Vincent Vanhoucke Vijay Vasudevan Fernanda Vi\u00e9gas Oriol Vinyals Pete Warden Martin Wattenberg Martin Wicke Yuan Yu and Xiaoqiang Zheng. 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. https:\/\/doi.org\/10.5555\/3026877.3026899 Software available from tensorflow.org.","DOI":"10.5555\/3026877.3026899"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.5555\/2619648.2619680"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033--295X.106.3.529"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1016540.1016556"},{"key":"e_1_2_1_5_1","volume-title":"Game Developers Conference","volume":"98033","author":"Bernier Yahn W","year":"2001","unstructured":"Yahn W Bernier. 2001. Latency compensating methods in client\/server in-game protocol design and optimization. In Game Developers Conference, Vol. 98033."},{"key":"e_1_2_1_6_1","unstructured":"BLADE. 2020. Shadow - Verwandle deine Ger\u00e4te in einen Gaming PC. https:\/\/shadow.tech\/. Accessed on 2020-08--23."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1177\/107118138102500180"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2072298.2071991"},{"key":"e_1_2_1_9_1","unstructured":"Video Games Chronicle. 2020. Warcraft 3: Reforged is now the worst user scored game ever on Metacritic. https:\/\/www.videogameschronicle.com\/news\/warcraft-3-reforged-is-now-the-worst-user-scored-game-ever-on-metacritic\/. Accessed on 2021-07-05."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1167838.1167860"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2968120.2987743"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/2755535.2755538"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00530-014-0362--4"},{"key":"e_1_2_1_14_1","unstructured":"EarlyGame. 2020. Remote esports -- is it sustainable? https:\/\/www.earlygame.com\/remote-esports-is-it-sustainable\/. Accessed on 2021-07-05."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/QoMEX.2018.8463382"},{"key":"e_1_2_1_16_1","unstructured":"Eurogamer. 2020. Doom Eternal on Stadia looks great - but the lag is just too high. https:\/\/www.eurogamer.net\/articles\/digitalfoundry-2020-doom-eternal-stadia-looks-the-part-but-lag-is-too-high . Accessed on 2020-08--21."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0055392"},{"key":"e_1_2_1_18_1","unstructured":"Forbes. 2019. Why 'Anthem' Failed And Why It Was Never Destined To Succeed. https:\/\/www.forbes.com\/sites\/erikkain\/2019\/05\/30\/why-anthem-failed-and-why-it-was-never-destined-to-succeed\/. Accessed on 2021-07-05."},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the fourteenth international conference on artificial intelligence and statistics . 315--323","author":"Glorot Xavier","year":"2011","unstructured":"Xavier Glorot, Antoine Bordes, and Yoshua Bengio. 2011. Deep sparse rectifier neural networks. In Proceedings of the fourteenth international conference on artificial intelligence and statistics . 315--323."},{"key":"e_1_2_1_20_1","unstructured":"Google. 2020. Stadia - Game Streaming. https:\/\/stadia.google.com\/. Accessed on 2020-08--23."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2935334.2935381"},{"key":"e_1_2_1_22_1","volume-title":"Yvonne AW de Kort, and Karolien Poels","author":"Jsselsteijn Wijnand A","year":"2013","unstructured":"Wijnand A IJsselsteijn, Yvonne AW de Kort, and Karolien Poels. 2013. The game experience questionnaire. Eindhoven: Technische Universiteit Eindhoven (2013), 3--9."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702432"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2481317"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/NetGames.2017.7991545"},{"key":"e_1_2_1_26_1","first-page":"296","article-title":"Latency reduction by sub-frame encoding and transmission","volume":"13","author":"Kim Taekhyun","year":"2014","unstructured":"Taekhyun Kim, Swagat Mohapatra, Mukta Gore, and Alok Ahuja. 2014. Latency reduction by sub-frame encoding and transmission. US Patent App. 13\/728,296.","journal-title":"US Patent App."},{"key":"e_1_2_1_27_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_2_1_28_1","unstructured":"Kotaku. 2019. Bug-Riddled Update Shows Why Fallout 76 Needs A Public Test Server. https:\/\/kotaku.com\/bug-riddled-update-shows-why-fallout-76-needs-a-public-1836457946 . Accessed on 2021-07-05."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132272.3134138"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300790"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445245"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242671.3242678"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/169059.169431"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557037"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2380116.2380174"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1005847.1005879"},{"key":"e_1_2_1_37_1","unstructured":"PCGamer. 2019. Here's how Stadia's input lag compares to native PC gaming. https:\/\/www.pcgamer.com\/heres-how-stadias-input-lag-compares-to-native-pc-gaming\/. Accessed on 2020-08--21."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1517494.1517513"},{"key":"e_1_2_1_39_1","unstructured":"Razer. 2021 a. RAZER DEATHADDER V2 PRO. https:\/\/www2.razer.com\/eu-en\/store\/razer-deathadder-v2-pro . Accessed on 2021-07-05."},{"key":"e_1_2_1_40_1","unstructured":"Razer. 2021 b. RAZER HUNTSMAN V2 ANALOG - US. https:\/\/www2.razer.com\/eu-en\/store\/razer-huntsman-v2-analog\/. Accessed on 2021-07-05."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3339825.3391855"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3385956.3418941"},{"key":"e_1_2_1_43_1","volume-title":"et almbox","author":"Smilkov Daniel","year":"2019","unstructured":"Daniel Smilkov, Nikhil Thorat, Yannick Assogba, Ann Yuan, Nick Kreeger, Ping Yu, Kangyi Zhang, Shanqing Cai, Eric Nielsen, David Soergel, et almbox. 2019. Tensorflow. js: Machine learning for the web and beyond. arXiv preprint arXiv:1901.05350 (2019)."},{"key":"e_1_2_1_44_1","doi-asserted-by":"crossref","unstructured":"Josef Spjut. 2021. A Case Study of First Person Aiming at Low Latency for Esports. (2021).","DOI":"10.31219\/osf.io\/nu9p3"},{"key":"e_1_2_1_45_1","volume-title":"Dropout: a simple way to prevent neural networks from overfitting. The journal of machine learning research","author":"Srivastava Nitish","year":"2014","unstructured":"Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: a simple way to prevent neural networks from overfitting. The journal of machine learning research , Vol. 15, 1 (2014), 1929--1958."},{"key":"e_1_2_1_46_1","volume-title":"DOTA 2 The International championships prize pool from 2011 to","year":"2019","unstructured":"Statista. 2021. DOTA 2 The International championships prize pool from 2011 to 2019. https:\/\/www.statista.com\/statistics\/749033\/dota-2-championships-prize-pool\/. Accessed on 2021-07-05."},{"key":"e_1_2_1_47_1","volume-title":"Proceedings of the 15th IARIA Advanced International Conference on Telecommunications (AICT) .","author":"Sun Jiawei","year":"2019","unstructured":"Jiawei Sun and Mark Claypool. 2019. Evaluating Streaming and Latency Compensation in a Cloud-based Game. In Proceedings of the 15th IARIA Advanced International Conference on Telecommunications (AICT) ."},{"key":"e_1_2_1_48_1","first-page":"432","article-title":"Adaptive bitrate streaming latency reduction","volume":"10","author":"Sun Wendell","year":"2019","unstructured":"Wendell Sun. 2019. Adaptive bitrate streaming latency reduction. US Patent 10,432,982.","journal-title":"US Patent"},{"key":"e_1_2_1_49_1","unstructured":"TensorFlow. 2015. TensorFlow. https:\/\/www.tensorflow.org\/tutorials\/structured_data\/time_series . Accessed on 2020--10--21."},{"key":"e_1_2_1_50_1","unstructured":"PCMag UK. 2015. OnLive Streaming Service Shutting Down at End of April. https:\/\/uk.pcmag.com\/gaming-systems\/40903\/onlive-streaming-service-shutting-down-at-end . Accessed on 2021-04--28."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300650"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3474710","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3474710","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:43Z","timestamp":1750191523000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3474710"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,5]]},"references-count":51,"journal-issue":{"issue":"CHI PLAY","published-print":{"date-parts":[[2021,10,5]]}},"alternative-id":["10.1145\/3474710"],"URL":"https:\/\/doi.org\/10.1145\/3474710","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,5]]},"assertion":[{"value":"2021-10-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}