{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,8]],"date-time":"2025-12-08T22:31:10Z","timestamp":1765233070106,"version":"3.41.0"},"reference-count":43,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2020,8,26]],"date-time":"2020-08-26T00:00:00Z","timestamp":1598400000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Comput. Graph. Interact. Tech."],"published-print":{"date-parts":[[2020,8,26]]},"abstract":"<jats:p>End-to-end latency in remote-rendering systems can reduce user task performance. This notably includes aiming tasks on game streaming services, which are presently below the standards of competitive first-person desktop gaming. We evaluate the latency-induced penalty on task completion time in a controlled environment and show that it can be significantly mitigated by adopting and modifying image and simulation-warping techniques from virtual reality, eliminating up to 80% of the penalty from 80 ms of added latency. This has potential to enable remote rendering for esports and increase the effectiveness of remote-rendered content creation and robotic teleoperation. We provide full experimental methodology, analysis, implementation details, and source code.<\/jats:p>","DOI":"10.1145\/3406187","type":"journal-article","created":{"date-parts":[[2021,3,23]],"date-time":"2021-03-23T17:45:26Z","timestamp":1616521526000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["Post-Render Warp with Late Input Sampling Improves Aiming Under High Latency Conditions"],"prefix":"10.1145","volume":"3","author":[{"given":"Joohwan","family":"Kim","sequence":"first","affiliation":[{"name":"NVIDIA"}]},{"given":"Pyarelal","family":"Knowles","sequence":"additional","affiliation":[{"name":"NVIDIA"}]},{"given":"Josef","family":"Spjut","sequence":"additional","affiliation":[{"name":"NVIDIA"}]},{"given":"Ben","family":"Boudaoud","sequence":"additional","affiliation":[{"name":"NVIDIA"}]},{"given":"Morgan","family":"Mcguire","sequence":"additional","affiliation":[{"name":"NVIDIA"}]}],"member":"320","published-online":{"date-parts":[[2020,8,26]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1016540.1016559"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1837026.1837047"},{"key":"e_1_2_2_3_1","volume-title":"Hutchins, and Paul Pedriana","author":"Beeler Dean","year":"2016","unstructured":"Dean Beeler , Ed Hutchins, and Paul Pedriana . 2016 . Asynchronous Spacewarp. https:\/\/developer.oculus.com\/blog\/asynchronous-spacewarp\/ Oculus Blog Post . Dean Beeler, Ed Hutchins, and Paul Pedriana. 2016. Asynchronous Spacewarp. https:\/\/developer.oculus.com\/blog\/asynchronous-spacewarp\/ Oculus Blog Post."},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1016540.1016556"},{"key":"e_1_2_2_5_1","unstructured":"Yahn W. Bernier. 2003. Latency Compensating Methods in Client\/Server In-game Protocol Design and Optimization. (2003).  Yahn W. Bernier. 2003. Latency Compensating Methods in Client\/Server In-game Protocol Design and Optimization. (2003)."},{"key":"e_1_2_2_6_1","volume-title":"How sensitive are online gamers to network quality? Commun. ACM 49 (11","author":"Chen Kuan-Ta","year":"2006","unstructured":"Kuan-Ta Chen , Polly Huang , and Chin-Laung Lei . 2006. How sensitive are online gamers to network quality? Commun. ACM 49 (11 2006 ), 34--38. https:\/\/doi.org\/10.1145\/1167838.1167859 10.1145\/1167838.1167859 Kuan-Ta Chen, Polly Huang, and Chin-Laung Lei. 2006. How sensitive are online gamers to network quality? Commun. ACM 49 (11 2006), 34--38. https:\/\/doi.org\/10.1145\/1167838.1167859"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/166117.166153"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/NetGames.2012.6404024"},{"key":"e_1_2_2_9_1","volume-title":"A Hybrid Edge-Cloud Architecture for Reducing On-Demand Gaming Latency. Multimedia Systems 20 (10","author":"Choy Sharon","year":"2014","unstructured":"Sharon Choy , Bernard Wong , Gwendal Simon , and Catherine Rosenberg . 2014. A Hybrid Edge-Cloud Architecture for Reducing On-Demand Gaming Latency. Multimedia Systems 20 (10 2014 ), 503--519. https:\/\/doi.org\/10.1007\/s00530-014-0367-z 10.1007\/s00530-014-0367-z Sharon Choy, Bernard Wong, Gwendal Simon, and Catherine Rosenberg. 2014. A Hybrid Edge-Cloud Architecture for Reducing On-Demand Gaming Latency. Multimedia Systems 20 (10 2014), 503--519. https:\/\/doi.org\/10.1007\/s00530-014-0367-z"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.comnet.2005.04.008"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1167838.1167860"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1730836.1730863"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2009.01641.x"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323033"},{"key":"e_1_2_2_15_1","unstructured":"Benjamin Goyette. 2016. Fighting Latency on Call of Duty Black Ops III. (2016). https:\/\/www.gdcvault.com\/play\/1023220\/GDC.  Benjamin Goyette. 2016. Fighting Latency on Call of Duty Black Ops III. (2016). https:\/\/www.gdcvault.com\/play\/1023220\/GDC."},{"key":"e_1_2_2_16_1","unstructured":"Akimitsu Hogge. 2019. Controller to Display Latency in 'Call of Duty'. (2019). https:\/\/www.gdcvault.com\/play\/1026327\/GDC.  Akimitsu Hogge. 2019. Controller to Display Latency in 'Call of Duty'. (2019). https:\/\/www.gdcvault.com\/play\/1026327\/GDC."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702432"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3240508.3240620"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.5555\/3141475.3141484"},{"key":"e_1_2_2_20_1","volume-title":"Furion: Engineering High-Quality Immersive Virtual Reality on Today's Mobile Devices","author":"Lai Z.","year":"2019","unstructured":"Z. Lai , Y. C. Hu , Y. Cui , L. Sun , N. Dai , and H. Lee . 2019 . Furion: Engineering High-Quality Immersive Virtual Reality on Today's Mobile Devices . IEEE Transactions on Mobile Computing ( 2019), 1--1. Z. Lai, Y. C. Hu, Y. Cui, L. Sun, N. Dai, and H. Lee. 2019. Furion: Engineering High-Quality Immersive Virtual Reality on Today's Mobile Devices. IEEE Transactions on Mobile Computing (2019), 1--1."},{"key":"e_1_2_2_21_1","volume-title":"Experiences with Client-Based Speculative Remote Display. In USENIX 2008 Annual Technical Conference","author":"Lange John R.","year":"2008","unstructured":"John R. Lange , Peter A. Dinda , and Samuel Rossoff . 2008 . Experiences with Client-Based Speculative Remote Display. In USENIX 2008 Annual Technical Conference ( Boston, Massachusetts) (ATC'08). USENIX Association, USA, 419--432. John R. Lange, Peter A. Dinda, and Samuel Rossoff. 2008. Experiences with Client-Based Speculative Remote Display. In USENIX 2008 Annual Technical Conference (Boston, Massachusetts) (ATC'08). USENIX Association, USA, 419--432."},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2742647.2742656"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/965105.807465"},{"key":"e_1_2_2_24_1","unstructured":"Gerrit Lochmann Bernhard Reinert Tobias Ritschel Stefan M\u00fcller and Hans-Peter Seidel. 2014. Real-time Reflective and Refractive Novel-view Synthesis.. In VMV. 9--16.  Gerrit Lochmann Bernhard Reinert Tobias Ritschel Stefan M\u00fcller and Hans-Peter Seidel. 2014. Real-time Reflective and Refractive Novel-view Synthesis.. In VMV. 9--16."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242671.3242678"},{"key":"e_1_2_2_26_1","unstructured":"I Scott MacKenzie. 2012. Human-computer interaction: An empirical research perspective. Newnes.  I Scott MacKenzie. 2012. Human-computer interaction: An empirical research perspective. Newnes."},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/253284.253292"},{"key":"e_1_2_2_28_1","unstructured":"Joanna Nelius. 2020. PCGamer GeForce Now beats Statdia in our input latency testing. https:https:\/\/www.pcgamer.com\/geforce-now-beats-stadia-in-our-input-latency-testing\/. Accessed: 2020-04-13.  Joanna Nelius. 2020. PCGamer GeForce Now beats Statdia in our input latency testing. https:https:\/\/www.pcgamer.com\/geforce-now-beats-stadia-in-our-input-latency-testing\/. Accessed: 2020-04-13."},{"volume-title":"Global esports market report","key":"e_1_2_2_29_1","unstructured":"Newzoo. 2020. Global esports market report . Vol. April 2020 Update. Newzoo . Newzoo. 2020. Global esports market report. Vol. April 2020 Update. Newzoo."},{"key":"e_1_2_2_30_1","unstructured":"Oculus Blog Facebook 2019. Introducing ASW 2.0: Better Accuracy Lower Latency. Oculus Blog Facebook. https:\/\/www.oculus.com\/blog\/introducing-asw-2-point-0-better-accuracy-lower-latency\/?fb_comment_id=2229988523715492_2230021217045556.  Oculus Blog Facebook 2019. Introducing ASW 2.0: Better Accuracy Lower Latency. Oculus Blog Facebook. https:\/\/www.oculus.com\/blog\/introducing-asw-2-point-0-better-accuracy-lower-latency\/?fb_comment_id=2229988523715492_2230021217045556."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2713168.2713188"},{"volume-title":"Computer Graphics Forum","author":"Reinert Bernhard","key":"e_1_2_2_32_1","unstructured":"Bernhard Reinert , Johannes Kopf , Tobias Ritschel , Eduardo Cuervo , David Chu , and Hans-Peter Seidel . 2016. Proxy-guided image-based rendering for mobile devices . In Computer Graphics Forum , Vol. 35 . Wiley Online Library , 353--362. Bernhard Reinert, Johannes Kopf, Tobias Ritschel, Eduardo Cuervo, David Chu, and Hans-Peter Seidel. 2016. Proxy-guided image-based rendering for mobile devices. In Computer Graphics Forum, Vol. 35. Wiley Online Library, 353--362."},{"key":"e_1_2_2_33_1","unstructured":"Riot Games. 2020. Valorant.  Riot Games. 2020. Valorant."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00530-012-0271-3"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2657078"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/280814.280882"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/963900.963901"},{"volume-title":"SIGGRAPH Asia 2019 Technical Briefs (Brisbane, QLD, Australia) (SA '19)","author":"Spjut Josef","key":"e_1_2_2_38_1","unstructured":"Josef Spjut , Ben Boudaoud , Kamran Binaee , Jonghyun Kim , Alexander Majercik , Morgan McGuire , David Luebke , and Joohwan Kim . 2019a. Latency of 30 ms Benefits First Person Targeting Tasks More Than Refresh Rate Above 60 Hz . In SIGGRAPH Asia 2019 Technical Briefs (Brisbane, QLD, Australia) (SA '19) . Association for Computing Machinery , New York, NY, USA , 110--113. https:\/\/doi.org\/10.1145\/3355088.3365170 10.1145\/3355088.3365170 Josef Spjut, Ben Boudaoud, Kamran Binaee, Jonghyun Kim, Alexander Majercik, Morgan McGuire, David Luebke, and Joohwan Kim. 2019a. Latency of 30 ms Benefits First Person Targeting Tasks More Than Refresh Rate Above 60 Hz. In SIGGRAPH Asia 2019 Technical Briefs (Brisbane, QLD, Australia) (SA '19). Association for Computing Machinery, New York, NY, USA, 110--113. https:\/\/doi.org\/10.1145\/3355088.3365170"},{"key":"e_1_2_2_39_1","volume-title":"FirstPerson-Science: Quantifying Psychophysics for First Person Shooter Tasks. In UCI Esports Conference.","author":"Spjut Josef","year":"2019","unstructured":"Josef Spjut , Ben Boudaoud , Kamran Binaee , Alexander Majercik , Morgan McGuire , and Joohwan Kim . 2019 b. FirstPerson-Science: Quantifying Psychophysics for First Person Shooter Tasks. In UCI Esports Conference. Josef Spjut, Ben Boudaoud, Kamran Binaee, Alexander Majercik, Morgan McGuire, and Joohwan Kim. 2019b. FirstPerson-Science: Quantifying Psychophysics for First Person Shooter Tasks. In UCI Esports Conference."},{"key":"e_1_2_2_40_1","unstructured":"Josef Spjut Ben Boudaoud Pyarelal Knowles Zander Majercik Morgan McGuire and Joohwan Kim. 2019c. FirstPerson-Science. https:\/\/github.com\/NVlabs\/abstract-fps  Josef Spjut Ben Boudaoud Pyarelal Knowles Zander Majercik Morgan McGuire and Joohwan Kim. 2019c. FirstPerson-Science. https:\/\/github.com\/NVlabs\/abstract-fps"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1342250.1342279"},{"key":"e_1_2_2_42_1","unstructured":"Valve Software. 2012. Counter-Strike: Global Offensive.  Valve Software. 2012. Counter-Strike: Global Offensive."},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2993369.2993375"}],"container-title":["Proceedings of the ACM on Computer Graphics and Interactive Techniques"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3406187","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3406187","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:31:52Z","timestamp":1750195912000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3406187"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,26]]},"references-count":43,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,8,26]]}},"alternative-id":["10.1145\/3406187"],"URL":"https:\/\/doi.org\/10.1145\/3406187","relation":{},"ISSN":["2577-6193"],"issn-type":[{"type":"electronic","value":"2577-6193"}],"subject":[],"published":{"date-parts":[[2020,8,26]]},"assertion":[{"value":"2020-08-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}