{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,24]],"date-time":"2026-02-24T19:14:37Z","timestamp":1771960477658,"version":"3.50.1"},"reference-count":58,"publisher":"Association for Computing Machinery (ACM)","issue":"1","funder":[{"name":"Ministry of Electronics and Information Technology (MeitY), Government of India","award":["#3095895"],"award-info":[{"award-number":["#3095895"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2026,2,28]]},"abstract":"<jats:p>\n            High-refresh rate displays have become very popular in recent years due to the need for superior visual quality in gaming, professional displays and specialized applications such as medical imaging. However, high-refresh rate displays alone do not guarantee a superior visual experience; the GPU needs to render frames at a matching rate. Otherwise, we observe disconcerting visual artifacts such as screen tearing and stuttering. Real-time frame generation is an effective technique to increase frame rates by predicting new frames from other rendered frames. There are two methods in this space: interpolation and extrapolation. Interpolation-based methods provide good image quality at the cost of a higher runtime because they also require the next rendered frame. On the other hand, extrapolation methods are much faster at the cost of quality. This article introduces\n            <jats:italic toggle=\"yes\">PatchEX<\/jats:italic>\n            , a novel frame extrapolation method that aims to provide the quality of interpolation at the speed of extrapolation. It smartly segments each frame into foreground and background regions and employs a novel neural network to generate the final extrapolated frame. Additionally, a wavelet transform (WT)-based filter pruning technique is applied to compress the network, significantly reducing the runtime of the extrapolation process. Our results demonstrate that\n            <jats:italic toggle=\"yes\">PatchEX<\/jats:italic>\n            achieves a 61.32% and 49.21% improvement in PSNR over the latest extrapolation methods ExtraNet and ExtraSS, respectively, while being 3\u00d7 and 2.6\u00d7 faster, respectively.\n          <\/jats:p>","DOI":"10.1145\/3759247","type":"journal-article","created":{"date-parts":[[2025,8,12]],"date-time":"2025-08-12T11:29:36Z","timestamp":1754998176000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["PatchEX: High-Quality Real-Time Temporal Supersampling through Patch-based Parallel Extrapolation"],"prefix":"10.1145","volume":"45","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-1565-7199","authenticated-orcid":false,"given":"Akanksha","family":"Dixit","sequence":"first","affiliation":[{"name":"Electrical Engineering, Indian Institute of Technology Delhi","place":["New Delhi, India"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1657-8523","authenticated-orcid":false,"given":"Smruti R.","family":"Sarangi","sequence":"additional","affiliation":[{"name":"Hi-Tech Robotics and Autonomous Systems Chair Professor, Electrical Engineering, Indian Institute of Technology Delhi","place":["New Delhi, India"]}]}],"member":"320","published-online":{"date-parts":[[2025,9,11]]},"reference":[{"key":"e_1_3_2_2_1","unstructured":"2023. Gaming Monitors Market Trend Share Growth Size and Forecast 2030. Retrieved May 15 2024 from https:\/\/www.zionmarketresearch.com\/report\/gaming-monitors-market-size"},{"key":"e_1_3_2_3_1","unstructured":"2024. Mixamo. Retrieved April 10 2024 from https:\/\/www.mixamo.com\/"},{"key":"e_1_3_2_4_1","first-page":"1","volume-title":"Proceedings of the ACM SIGGRAPH 2010 Talks","author":"Andreev Dmitry","year":"2010","unstructured":"Dmitry Andreev. 2010. Real-time frame rate up-conversion for video games: or how to get from 30 to 60 fps for\u201d free\u201d. In Proceedings of the ACM SIGGRAPH 2010 Talks. ACM, 1\u20131."},{"key":"e_1_3_2_5_1","unstructured":"Anonymous Authors. 2024. Video Results. Retrieved June 12 2024 from https:\/\/drive.google.com\/drive\/folders\/1hfo7vzAFXd3SzJ0MbtLXpD_TnvTTsc9K"},{"key":"e_1_3_2_6_1","unstructured":"Dean Beeler and Anuj Gosalia. 2016. Asynchronous Timewarp on Oculus Rift. Retrieved February 24 2025 from https:\/\/developers.meta.com\/horizon\/blog\/asynchronous-timewarp-on-oculus-rift\/"},{"key":"e_1_3_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3618379"},{"key":"e_1_3_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344972"},{"key":"e_1_3_2_9_1","first-page":"819","volume-title":"Proceedings of the 2005 16th British Machine Vision Conference, BMVC 2005","author":"Bj\u00f6rkman M\u00e5rten","year":"2005","unstructured":"M\u00e5rten Bj\u00f6rkman and Jan-Olof Eklundh. 2005. Foveated figure-ground segmentation and its role in recognition. In Proceedings of the 2005 16th British Machine Vision Conference, BMVC 2005. British Machine Vision Association, BMVA, Oxford, United Kingdom, 819\u2013828."},{"key":"e_1_3_2_10_1","first-page":"237","volume-title":"Computer Graphics Forum","author":"Bowles Huw","year":"2012","unstructured":"Huw Bowles, Kenny Mitchell, Robert W. Sumner, Jeremy Moore, and Markus Gross. 2012. Iterative image warping. In Computer Graphics Forum, P. Cignoni and T. Ertl (Guest Editors). Vol. 31. Wiley Online Library, 237\u2013246."},{"key":"e_1_3_2_11_1","unstructured":"Andrew Burnes and Henry C. Lin. 2023. NVIDIA ADA Science. Retrieved May 9 2023 from https:\/\/images.nvidia.com\/aem-dam\/Solutions\/geforce\/ada\/ada-lovelace-architecture\/nvidia-ada-gpu-science.pdf"},{"key":"e_1_3_2_12_1","first-page":"3488","volume-title":"Proceedings of the 2016 23rd International Conference on Pattern Recognition (ICPR)","author":"Cornia Marcella","year":"2016","unstructured":"Marcella Cornia, Lorenzo Baraldi, Giuseppe Serra, and Rita Cucchiara. 2016. A deep multi-level network for saliency prediction. In Proceedings of the 2016 23rd International Conference on Pattern Recognition (ICPR). IEEE, 3488\u20133493."},{"key":"e_1_3_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.89"},{"key":"e_1_3_2_14_1","unstructured":"Beeler Dean Hutchins Ed and Pedriana Paul. 2016. Asynchronous Spacewarp. Retrieved February 24 2025 from https:\/\/developers.meta.com\/horizon\/blog\/asynchronous-spacewarp\/"},{"issue":"4","key":"e_1_3_2_15_1","article-title":"A perceptual model of motion quality for rendering with adaptive refresh-rate and resolution","volume":"39","author":"Denes Gyorgy","year":"2020","unstructured":"Gyorgy Denes, Akshay Jindal, Aliaksei Mikhailiuk, and Rafa\u0142 K. Mantiuk. 2020. A perceptual model of motion quality for rendering with adaptive refresh-rate and resolution. ACM Transactions on Graphics (TOG) 39, 4 (2020), 133\u20131.","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"e_1_3_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3677329"},{"issue":"6","key":"e_1_3_2_17_1","doi-asserted-by":"crossref","first-page":"890","DOI":"10.1177\/0956797620984464","article-title":"The foreground bias: Initial scene representations across the depth plane","volume":"32","author":"Fernandes Suzette","year":"2021","unstructured":"Suzette Fernandes and Monica S. Castelhano. 2021. The foreground bias: Initial scene representations across the depth plane. Psychological Science 32, 6 (2021), 890\u2013902.","journal-title":"Psychological Science"},{"key":"e_1_3_2_18_1","unstructured":"Epic Games. 2023a. Marketplace. Retrieved May 23 2023 from https:\/\/www.unrealengine.com\/marketplace\/en-US\/store"},{"key":"e_1_3_2_19_1","unstructured":"Epic Games. 2023b. Unreal Engine 5. Retrieved April 10 2024 from https:\/\/www.unrealengine.com\/en-US\/unreal-engine-5"},{"key":"e_1_3_2_20_1","first-page":"53","volume-title":"Proceedings of the 6th International Workshop on Symbiotic Interaction, Symbiotic 2017, Revised Selected Papers 6","author":"Gembler Felix","year":"2018","unstructured":"Felix Gembler, Piotr Stawicki, Aya Rezeika, Abdul Saboor, Mihaly Benda, and Ivan Volosyak. 2018. Effects of monitor refresh rates on c-VEP BCIs. In Proceedings of the 6th International Workshop on Symbiotic Interaction, Symbiotic 2017, Revised Selected Papers 6. Springer, 53\u201362."},{"key":"e_1_3_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2013.2273004"},{"issue":"6","key":"e_1_3_2_22_1","first-page":"1","article-title":"ExtraNet: Real-time extrapolated rendering for low-latency temporal supersampling","volume":"40","author":"Guo Jie","year":"2021","unstructured":"Jie Guo, Xihao Fu, Liqiang Lin, Hengjun Ma, Yanwen Guo, Shiqiu Liu, and Ling-Qi Yan. 2021. ExtraNet: Real-time extrapolated rendering for low-latency temporal supersampling. ACM Transactions on Graphics (TOG) 40, 6 (2021), 1\u201316.","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"e_1_3_2_23_1","first-page":"757679","article-title":"Assessing the effect of the refresh rate of a device on various motion stimulation frequencies based on steady-state motion visual evoked potentials","author":"Han Chengcheng","year":"2022","unstructured":"Chengcheng Han, Guanghua Xu, Xiaowei Zheng, Peiyuan Tian, Kai Zhang, Wenqiang Yan, Yaguang Jia, and Xiaobi Chen. 2022. Assessing the effect of the refresh rate of a device on various motion stimulation frequencies based on steady-state motion visual evoked potentials. Frontiers in Neuroscience 15, 1 (2022), 757679.","journal-title":"Frontiers in Neuroscience"},{"key":"e_1_3_2_24_1","first-page":"2103","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"38","author":"He Ruian","year":"2024","unstructured":"Ruian He, Shili Zhou, Yuqi Sun, Ri Cheng, Weimin Tan, and Bo Yan. 2024. Low-latency space-time supersampling for real-time rendering. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 38. AAAI Press, Washington, DC, USA, 2103\u20132111."},{"key":"e_1_3_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1730804.1730819"},{"key":"e_1_3_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2010.579"},{"key":"e_1_3_2_27_1","unstructured":"Juho Huhti. 2019. The effect of high monitor refresh rate on game experience. Masters Thesis. University of Vaasa Wolffintie 32 65200 Vaasa Finland."},{"key":"e_1_3_2_28_1","doi-asserted-by":"crossref","first-page":"694","DOI":"10.1007\/978-3-319-46475-6_43","volume-title":"ECCV 2016: Proceedings of the 14th European Conference on Computer Vision, Part II 14","author":"Johnson Justin","year":"2016","unstructured":"Justin Johnson, Alexandre Alahi, and Li Fei-Fei. 2016. Perceptual losses for real-time style transfer and super-resolution. In ECCV 2016: Proceedings of the 14th European Conference on Computer Vision, Part II 14. Springer, Amsterdam, The Netherlands, 694\u2013711."},{"key":"e_1_3_2_29_1","first-page":"1","volume-title":"Proceedings of the 2024 IEEE Conference on Games (CoG)","author":"Klein Devi","year":"2024","unstructured":"Devi Klein, Josef Spjut, Ben Boudaoud, and Joohwan Kim. 2024. Variable frame timing affects perception of smoothness in first-person gaming. In Proceedings of the 2024 IEEE Conference on Games (CoG). IEEE, 1\u20138."},{"key":"e_1_3_2_30_1","unstructured":"BiBi LED. 2025. Introduction. Retrieved April 12 2025 from https:\/\/www.bibiled.com\/how-does-a-high-refresh-rate-led-display-help-achieve-zero-delay-in-financial-information\/"},{"key":"e_1_3_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3190859"},{"key":"e_1_3_2_32_1","first-page":"74","volume-title":"Proceedings of the Graphics Interface 2022 Conference","author":"Li Zhan","year":"2022","unstructured":"Zhan Li, Carl S. Marshall, Deepak S. Vembar, and Feng Liu. 2022. Future frame synthesis for fast Monte Carlo rendering. In Proceedings of the Graphics Interface 2022 Conference. CHCCS, 74\u201383."},{"key":"e_1_3_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00160"},{"key":"e_1_3_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACPR.2015.7486599"},{"key":"e_1_3_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580665"},{"key":"e_1_3_2_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2024.106577"},{"key":"e_1_3_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275087"},{"key":"e_1_3_2_38_1","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1007\/978-3-030-61105-7_34","volume-title":"Advances on P2P, Parallel, Grid, Cloud and Internet Computing: Proceedings of the 15th International Conference on P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC-2020) 15","author":"Murakami Koshiro","year":"2021","unstructured":"Koshiro Murakami, Kazuya Miyashita, and Hideo Miyachi. 2021. A study on the relationship between refresh-rate of display and reaction time of eSports. In Advances on P2P, Parallel, Grid, Cloud and Internet Computing: Proceedings of the 15th International Conference on P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC-2020) 15. Springer, 339\u2013347."},{"key":"e_1_3_2_39_1","first-page":"61","volume-title":"Graphics Hardware","author":"Nehab Diego","year":"2007","unstructured":"Diego Nehab, Pedro V. Sander, Jason Lawrence, Natalya Tatarchuk, and John R. Isidoro. 2007. Accelerating real-time shading with reverse reprojection caching. In Graphics Hardware, Timo Aila and Mark Segal (Eds.). Vol. 41. ACM, California, USA, 61\u201362."},{"key":"e_1_3_2_40_1","unstructured":"Netflix. 2016. Toward A practical perceptual video quality metric. Retrieved June 11 2025 from https:\/\/netflixtechblog.com\/toward-a-practical-perceptual-video-quality-metric-653f208b9652"},{"key":"e_1_3_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2380116.2380174"},{"key":"e_1_3_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00548"},{"key":"e_1_3_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2002.1017623"},{"key":"e_1_3_2_44_1","volume-title":"Proceedings of the International Conference on Neural Information Processing Systems","volume":"32","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et\u00a0al. 2019. Pytorch: An imperative style, high-performance deep learning library. In Proceedings of the International Conference on Neural Information Processing Systems, Vol. 32. NeuRIPS, Vancouver, Canada."},{"key":"e_1_3_2_45_1","doi-asserted-by":"publisher","unstructured":"Cai Ran Xinfu Li and Fang Yang. 2023. Multi-step structure image inpainting model with attention mechanism. Sensors 23 4 (2023) 2316. DOI:10.3390\/s23042316","DOI":"10.3390\/s23042316"},{"key":"e_1_3_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3339825.3391855"},{"key":"e_1_3_2_47_1","first-page":"082","volume-title":"Proceedings of the 2022 International Conference on Artificial Intelligence in Information and Communication (ICAIIC)","author":"Shimizu Joi","year":"2022","unstructured":"Joi Shimizu, Heming Sun, and Jiro Katto. 2022. Forward and backward warping for optical flow-based frame interpolation. In Proceedings of the 2022 International Conference on Artificial Intelligence in Information and Communication (ICAIIC). IEEE, 082\u2013086."},{"key":"e_1_3_2_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00553"},{"key":"e_1_3_2_49_1","first-page":"669","volume-title":"Proceedings of the SID Symposium Digest of Technical Papers","volume":"51","author":"Slavenburg Gerrit A.","year":"2020","unstructured":"Gerrit A. Slavenburg, Marcel Janssens, Luis Lucas, Robert Jan Schutten, and Tom Verbeure. 2020. 46-1: Invited paper: Variable refresh rate displays. In Proceedings of the SID Symposium Digest of Technical Papers, Vol. 51. Wiley Online Library, 669\u2013672."},{"key":"e_1_3_2_50_1","unstructured":"Philipp Wagner. 2011. Local Binary Patterns. Retrieved May 24 2024 from https:\/\/www.bytefish.de\/blog\/local_binary_patterns.html"},{"key":"e_1_3_2_51_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13150"},{"key":"e_1_3_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3610548.3618224"},{"key":"e_1_3_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3610548.3618211"},{"key":"e_1_3_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3625468.3647625"},{"key":"e_1_3_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3641519.3657424"},{"key":"e_1_3_2_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00753"},{"key":"e_1_3_2_57_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.142616"},{"key":"e_1_3_2_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.00550"},{"key":"e_1_3_2_59_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02946650"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3759247","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,11]],"date-time":"2025-09-11T12:19:47Z","timestamp":1757593187000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3759247"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,11]]},"references-count":58,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,2,28]]}},"alternative-id":["10.1145\/3759247"],"URL":"https:\/\/doi.org\/10.1145\/3759247","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,11]]},"assertion":[{"value":"2024-07-06","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-07-24","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-09-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}