{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T15:56:55Z","timestamp":1780675015645,"version":"3.54.1"},"reference-count":77,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2024,8,14]],"date-time":"2024-08-14T00:00:00Z","timestamp":1723593600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000028","name":"Semiconductor Research Corporation","doi-asserted-by":"crossref","award":["2021-IR-3053"],"award-info":[{"award-number":["2021-IR-3053"]}],"id":[{"id":"10.13039\/100000028","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Embed. Comput. Syst."],"published-print":{"date-parts":[[2024,9,30]]},"abstract":"<jats:p>With the advent of low-power ultra-fast hardware and GPUs, virtual reality (VR) has gained a lot of prominence in the past few years and is being used in various areas, such as education, entertainment, scientific visualization, and computer-aided design. VR-based applications are highly interactive, and one of the most important performance metrics for these applications is the motion-to-photon-delay (MPD). MPD is the delay from the user\u2019s head movement to the time at which the image gets updated on the VR screen. Since the human visual system can even detect an error of a few pixels (very spatially sensitive), the MPD should be as small as possible.<\/jats:p>\n          <jats:p>\n            Popular VR vendors use the GPU-accelerated Asynchronous Time Warp (ATW) algorithm to reduce the MPD. ATW reduces the MPD if and only if the warping operation finishes just before the display refreshes. However, due to the competition between the different constituent applications for the single, shared GPU, the GPU-accelerated ATW algorithm suffers from an unpredictable ATW latency, making it challenging to find the ideal time instance for starting the time warp and ensuring that it completes with the least amount of lag relative to the screen refresh. Hence, the state-of-the-art is to use a separate hardware unit for the time-warping operation. Our approach,\n            <jats:italic>PredATW<\/jats:italic>\n            , uses an ML-based hardware predictor to predict the ATW latency for a VR application, and then schedule it as late as possible while running the time-warping operation on the GPU itself. As far as we know, this is the first work to do so. Our predictor achieves an error of only 0.22 ms across several popular VR applications for predicting the ATW latency. As compared to the baseline architecture, we reduce deadline misses by 80.6%.\n          <\/jats:p>","DOI":"10.1145\/3677329","type":"journal-article","created":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T11:01:56Z","timestamp":1721386916000},"page":"1-37","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["PredATW: Predicting the Asynchronous Time Warp Latency For VR Systems"],"prefix":"10.1145","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-1565-7199","authenticated-orcid":false,"given":"Akanksha","family":"Dixit","sequence":"first","affiliation":[{"name":"Electrical Engineering, Indian Institute of Technology Delhi, New Delhi, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1657-8523","authenticated-orcid":false,"given":"Smruti R.","family":"Sarangi","sequence":"additional","affiliation":[{"name":"Electrical Engineering, Indian Institute of Technology Delhi, New Delhi, India"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,8,14]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1201\/b22086"},{"key":"e_1_3_2_3_2","volume-title":"A QoE Model for Digital Twin Systems in the Era of the Tactile Internet","author":"Alja\u2019Afreh Mohammad","year":"2021","unstructured":"Mohammad Alja\u2019Afreh. 2021. A QoE Model for Digital Twin Systems in the Era of the Tactile Internet. Ph.D. Dissertation. Universit\u00e9 d\u2019Ottawa\/University of Ottawa."},{"key":"e_1_3_2_4_2","unstructured":"AltspaceVR. 2016. Altspace VR. Retrieved from https:\/\/store.steampowered.com\/app\/407060\/AltspaceVR\/. Accessed 2022-10-20."},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/RTSS.2017.00017"},{"key":"e_1_3_2_6_2","unstructured":"Michael Antonov. 2016. Asynchronous Timewarp Examined. Retrieved from https:\/\/developer.oculus.com\/blog\/asynchronous-timewarp-examined\/. Accessed 2022-05-10."},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/RTAS58335.2023.00012"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISM.2005.71"},{"key":"e_1_3_2_9_2","volume-title":"A Positional Timewarp Accelerator for Mobile Virtual Reality Devices","author":"Barnes Russell M.","year":"2017","unstructured":"Russell M. Barnes. 2017. A Positional Timewarp Accelerator for Mobile Virtual Reality Devices. University of California, Santa Barbara, CA."},{"key":"e_1_3_2_10_2","unstructured":"Dean Beeler and Anuj Gosalia. 2016. Asynchronous Time Warp. Retrieved from https:\/\/developer.oculus.com\/blog\/asynchronous-timewarp-on-oculus-rift\/"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.2352\/ISSN.2169-4672.2007.1.0.10"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","unstructured":"Kevin Boos David Chu and Eduardo Cuervo. 2016. FlashBack: Immersive virtual reality on mobile devices via rendering memoization. GetMobile Mob. Comput. Commun. 20 4 (2016) 23\u201327. 10.1145\/3081016.3081026","DOI":"10.1145\/3081016.3081026"},{"key":"e_1_3_2_13_2","unstructured":"Jason Brownlee. 2020. LOOCV for Evaluating Machine Learning Algorithms. Retrieved from https:\/\/machinelearningmastery.com\/loocv-for-evaluating-machine-learning-algorithms\/. Accessed 2023-03-07."},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","unstructured":"Umer Asghar Chattha Uzair Iqbal Janjua Fozia Anwar Tahir Mustafa Madni Muhammad Faisal Cheema and Sana Iqbal Janjua. 2020. Motion sickness in virtual reality: An empirical evaluation. IEEE Access 8 (2020) 130486\u2013130499. 10.1109\/ACCESS.2020.3007076","DOI":"10.1109\/ACCESS.2020.3007076"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3517745.3561417"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/AICAS.2019.8771596"},{"key":"e_1_3_2_17_2","unstructured":"ClarkVision. 2018. Notes on the Resolution and Other Details of the Human Eye. Retrieved from https:\/\/clarkvision.com\/imagedetail\/eye-resolution.html. Accessed 2022-10-14."},{"key":"e_1_3_2_18_2","unstructured":"Counterpoint. 2023. Global XR (AR and VR Headsets) Shipments Market Share: By Quarter. Retrieved from https:\/\/www.counterpointresearch.com\/global-xr-ar-vr-headsets-market-share\/. Accessed 2023-03-28."},{"key":"e_1_3_2_19_2","unstructured":"Akanksha Dixit and Smruti R. Sarangi. 2024. Effects of the MPD on User Experience. Retrieved from https:\/\/csciitd-my.sharepoint.com\/:f:\/g\/personal\/eez208413_iitd_ac_in\/Eu6R1YCl5ChElXj5Gl00-c4BPBq1c826OrHW17EFVHwVBg?e=9Nunp9. Accessed 2024-03-04."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","unstructured":"Linus Franke Laura Fink Jana Martschinke Kai Selgrad and Marc Stamminger. 2021. Time-warped foveated rendering for virtual reality headsets. Comput. Graph. Forum 40 1 (2021) 110\u2013123. 10.1111\/cgf.14176","DOI":"10.1111\/cgf.14176"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","unstructured":"Borko Furht and Pornvit Saksobhavivat. 1998. Fast content-based multimedia retrieval technique using compressed data. MSAS 3527 (1998) 561\u2013571. 10.1117\/12.325851","DOI":"10.1117\/12.325851"},{"key":"e_1_3_2_22_2","unstructured":"Newgrange Game. 2022. Sanctuary VR. Retrieved from https:\/\/store.steampowered.com\/app\/565730\/Sanctuary_VR_Also_contains_nonVR_version\/. Accessed 2022-10-20."},{"key":"e_1_3_2_23_2","unstructured":"Khronos Group. 2022. OpenGL. Retrieved from https:\/\/www.opengl.org\/. Accessed 2023-03-03."},{"key":"e_1_3_2_24_2","unstructured":"Khronos Group. 2023. Vulkan. Retrieved from https:\/\/www.vulkan.org\/. Accessed 2023-03-03."},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","unstructured":"Brian K. Guenter Mark Finch Steven Mark Drucker Desney S. Tan and John M. Snyder. 2012. Foveated 3D graphics. ACM Trans. Graph. 31 6 (2012) 164:1\u2013164:10. 10.1145\/2366145.2366183","DOI":"10.1145\/2366145.2366183"},{"key":"e_1_3_2_26_2","doi-asserted-by":"crossref","unstructured":"David M. Hoffman and Grace Lee. 2019. Temporal requirements for VR displays to create a more comfortable and immersive visual experience. Info. Display 35 2 (2019) 9\u201339.","DOI":"10.1002\/msid.1018"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/GLOBECOM38437.2019.9014097"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/IISWC53511.2021.00014"},{"key":"e_1_3_2_29_2","unstructured":"Fortune Business Insights. 2023. Virtual Reaity Market. Retrieved from https:\/\/www.fortunebusinessinsights.com\/industry-reports\/virtual-reality-market-101378. Accessed 2023-07-28."},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/VR.2009.4811025"},{"key":"e_1_3_2_31_2","volume-title":"Scene-motion-and latency-perception thresholds for head-mounted displays","author":"Jerald Jason J.","year":"2009","unstructured":"Jason J. Jerald. 2009. Scene-motion-and latency-perception thresholds for head-mounted displays. Ph.D. Dissertation. The University of North Carolina at Chapel Hill."},{"key":"e_1_3_2_32_2","doi-asserted-by":"crossref","unstructured":"Sourabh Katoch Sumit Singh Chauhan and Vijay Kumar. 2021. A review on genetic algorithm: Past present and future. Multimedia Tools Appl. 80 (2021) 8091\u20138126.","DOI":"10.1007\/s11042-020-10139-6"},{"key":"e_1_3_2_33_2","doi-asserted-by":"crossref","unstructured":"Viktor Kelkkanen Markus Fiedler and David Lindero. 2021. Synchronous remote rendering for VR. Int. J. Comput. Games Technol. 2021 (2021) 1\u201316.","DOI":"10.1155\/2021\/6676644"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","unstructured":"Ripan Kumar Kundu Akhlaqur Rahman and Shuva Paul. 2021. A study on sensor system latency in VR motion sickness. J. Sens. Actuator Netw. 10 3 (2021) 53. 10.3390\/jsan10030053","DOI":"10.3390\/jsan10030053"},{"key":"e_1_3_2_35_2","unstructured":"Luden.io. 2015. InMind VR. Retrieved from https:\/\/store.steampowered.com\/app\/343740\/InMind_VR\/. Accessed 2022-10-20."},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/HiPC.2014.7116897"},{"key":"e_1_3_2_37_2","unstructured":"Meta. 2022. Oculus Debug Tool. Retrieved from https:\/\/developer.oculus.com\/documentation\/native\/pc\/dg-debug-tool\/. Accessed 2023-03-06."},{"key":"e_1_3_2_38_2","unstructured":"Microsoft. 2022. DirectX Graphics and Gaming. Retrieved from https:\/\/learn.microsoft.com\/en-us\/windows\/win32\/directx. Accessed 2023-03-03."},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","unstructured":"Diksha Moolchandani Anshul Kumar and Smruti R. Sarangi. 2022. Performance and power prediction for concurrent execution on GPUs. ACM Trans. Archit. Code Optim. 19 3 Article 35 (May2022) 27 pages. 10.1145\/3522712","DOI":"10.1145\/3522712"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISAP.2005.1599245"},{"key":"e_1_3_2_41_2","unstructured":"NVIDIA. 2014. NVIDIA\u2019s Next Generation CUDA Compute Architecture. Retrieved from https:\/\/www.nvidia.com\/content\/dam\/en-zz\/Solutions\/Data-Center\/tesla-product-literature\/NVIDIA-Kepler-GK110-GK210-Architecture-Whitepaper.pdf. Accessed 2023-01-08."},{"key":"e_1_3_2_42_2","unstructured":"NVIDIA. 2020. NVIDIA Ampere Architecture. Retrieved from https:\/\/www.nvidia.com\/en-in\/data-center\/ampere-architecture\/. Accessed 2023-03-03."},{"key":"e_1_3_2_43_2","unstructured":"NVIDIA. 2021. NVIDIA Multi-Instance GPU. Retrieved from https:\/\/www.nvidia.com\/en-in\/technologies\/multi-instance-gpu\/. Accessed 2023-07-28."},{"key":"e_1_3_2_44_2","unstructured":"NVIDIA. 2021. NVIDIA RTX A4000 Features & Benefits. Retrieved from https:\/\/download.boston.co.uk\/downloads\/b\/4\/d\/b4d996a2-fc90-45c7-9fc8-2ab2e2a8a12a\/Boston-NVIDIARTXA4000-Features-Benefits.pdf. Accessed 2023-08-03."},{"key":"e_1_3_2_45_2","unstructured":"NVIDIA. 2022. NVIDIA Ada Lovelace Architecture. Retrieved from https:\/\/www.nvidia.com\/en-in\/geforce\/ada-lovelace-architecture\/. Accessed 2024-03-03."},{"key":"e_1_3_2_46_2","unstructured":"NVIDIA. 2022. NVIDIA Nsight Graphics. Retrieved from https:\/\/developer.nvidia.com\/nsight-graphics. Accessed 2023-01-08."},{"key":"e_1_3_2_47_2","unstructured":"NVIDIA. 2022. NVIDIA VRWorks Graphics. Retrieved from https:\/\/developer.nvidia.com\/vrworks. Accessed 2022-10-05."},{"key":"e_1_3_2_48_2","unstructured":"NVIDIA. 2023. Nsight Graphics User Guide. Retrieved from https:\/\/docs.nvidia.com\/nsight-graphics\/UserGuide\/index.html. Accessed 2023-08-03."},{"key":"e_1_3_2_49_2","unstructured":"NVIDIA. 2023. NVIDIA Nsight Perf SDK. Retrieved from https:\/\/developer.nvidia.com\/nsight-perf-sdk. Accessed 2023-08-03."},{"key":"e_1_3_2_50_2","unstructured":"Oculus. 2016. Oculus Dreamdeck. Retrieved from https:\/\/www.oculus.com\/deeplink\/?action=view&path=app\/941682542593981&ref=oculus_desktop\/. Accessed 2024-02-01."},{"key":"e_1_3_2_51_2","unstructured":"Oculus. 2016. Oculus PC App. Retrieved from https:\/\/www.oculus.com\/. Accessed 2024-02-01."},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/2929464.2929472"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","unstructured":"Anjul Patney Marco Salvi Joohwan Kim Anton Kaplanyan Chris Wyman Nir Benty David Luebke and Aaron E. Lefohn. 2016. Towards foveated rendering for gaze-tracked virtual reality. ACM Trans. Graph. 35 6 (2016) 179:1\u2013179:12. 10.1145\/2980179.2980246","DOI":"10.1145\/2980179.2980246"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.2312\/pt.20151201"},{"key":"e_1_3_2_55_2","unstructured":"PS VR2. 2022. PlayStation VR2. Retrieved from https:\/\/www.playstation.com\/en-us\/ps-vr2\/. Accessed 2023-03-07."},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/RTAS52030.2021.00026"},{"key":"e_1_3_2_57_2","doi-asserted-by":"crossref","unstructured":"Yeongil Ryu and Eun-Seok Ryu. 2021. Overview of motion-to-photon latency reduction for mitigating VR sickness. KSII Trans. Internet Info. Syst. 15 7 (2021) 2531\u20132546.","DOI":"10.3837\/tiis.2021.07.013"},{"key":"e_1_3_2_58_2","unstructured":"Scikit. 2022. scikit-learn. Retrieved from https:\/\/scikit-learn.org\/stable\/. Accessed 2022-10-20."},{"key":"e_1_3_2_59_2","unstructured":"Sensics. 2016. Time-warp Explained. Retrieved from https:\/\/medium.com\/insights-on-virtual-reality\/time-warp-explained-febea194ca87. Accessed 2023-08-04."},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1109\/VR.2009.4810995"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","unstructured":"Ferdi Alexander Smit Robert van Liere and Bernd Froehlich. 2010. A programmable display layer for virtual reality system architectures. IEEE Trans. Vis. Comput. Graph. 16 1 (2010) 28\u201342. 10.1109\/TVCG.2009.75","DOI":"10.1109\/TVCG.2009.75"},{"key":"e_1_3_2_62_2","unstructured":"UL Solutions. 2016. VRMark. Retrieved from https:\/\/store.steampowered.com\/app\/464170\/VRMark\/. Accessed 2022-10-06."},{"key":"e_1_3_2_63_2","unstructured":"UL Solutions. 2020. Oculus Quest 2. Retrieved from https:\/\/www.meta.com\/quest\/products\/quest-2\/. Accessed 2022-01-08."},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1109\/VR46266.2020.00086"},{"key":"e_1_3_2_65_2","unstructured":"Steam. 2023. Steam. Retrieved from https:\/\/store.steampowered.com\/. Accessed 2023-03-03."},{"key":"e_1_3_2_66_2","unstructured":"Lightspeed Studios. 2016. NVIDIA VR Funhouse. Retrieved from https:\/\/store.steampowered.com\/app\/468700\/NVIDIA_VR_Funhouse\/. Accessed 2024-02-01."},{"key":"e_1_3_2_67_2","unstructured":"Sora Thompson. 2016. VR and The Resolution of The Human Eye. Retrieved from https:\/\/medium.com\/@FreneticPony\/virtual-reality-and-the-resolution-of-the-human-eye-5e601b0ef030. Accessed 2022-10-14."},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.2312\/hpg.20161202"},{"key":"e_1_3_2_69_2","unstructured":"Valve. 2016. The Lab. Retrieved from https:\/\/store.steampowered.com\/app\/450390\/The_Lab\/. Accessed 2024-02-01."},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1145\/2993369.2993375"},{"key":"e_1_3_2_71_2","unstructured":"Corey Whelan. 2021. What Causes Virtual Reality (VR) Motion Sickness? Retrieved from https:\/\/www.healthline.com\/health\/vr-motion-sickness. Accessed 2022-10-14."},{"key":"e_1_3_2_72_2","unstructured":"Wikipedia. 2022. Macroblock. Retrieved from https:\/\/en.wikipedia.org\/wiki\/Macroblock"},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1145\/3445814.3446715"},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.1109\/HPCA.2019.00013"},{"key":"e_1_3_2_75_2","unstructured":"Xinreality. 2020. Timewarp. Retrieved from https:\/\/xinreality.com\/wiki\/Timewarp. Accessed 2023-08-04."},{"key":"e_1_3_2_76_2","first-page":"20:1\u201320:21","volume-title":"Proceedings of the 30th Euromicro Conference on Real-Time Systems","author":"Yang Ming","year":"2018","unstructured":"Ming Yang. 2018. Avoiding pitfalls when using NVIDIA GPUs for real-time tasks in autonomous systems. In Proceedings of the 30th Euromicro Conference on Real-Time Systems. IEEE, 20:1\u201320:21."},{"key":"e_1_3_2_77_2","doi-asserted-by":"publisher","DOI":"10.1109\/PCS48520.2019.8954518"},{"key":"e_1_3_2_78_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISCA45697.2020.00030"}],"container-title":["ACM Transactions on Embedded Computing Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3677329","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3677329","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:04:21Z","timestamp":1750291461000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3677329"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,14]]},"references-count":77,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2024,9,30]]}},"alternative-id":["10.1145\/3677329"],"URL":"https:\/\/doi.org\/10.1145\/3677329","relation":{},"ISSN":["1539-9087","1558-3465"],"issn-type":[{"value":"1539-9087","type":"print"},{"value":"1558-3465","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,14]]},"assertion":[{"value":"2023-10-07","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-06-30","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-08-14","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}