{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T22:17:09Z","timestamp":1779315429961,"version":"3.51.4"},"reference-count":69,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2025,4,29]],"date-time":"2025-04-29T00:00:00Z","timestamp":1745884800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"crossref","award":["2023YFF0905102"],"award-info":[{"award-number":["2023YFF0905102"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"NSFC","doi-asserted-by":"crossref","award":["62233013"],"award-info":[{"award-number":["62233013"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100022963","name":"Key Research and Development Program of Zhejiang Province","doi-asserted-by":"crossref","award":["2025C01064. 2025C01072"],"award-info":[{"award-number":["2025C01064. 2025C01072"]}],"id":[{"id":"10.13039\/100022963","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2025,4,30]]},"abstract":"<jats:p>\n            Rendering realistic images in real-time on high-frame-rate display devices poses considerable challenges, even with advanced graphics cards. This stimulates a demand for frame prediction technologies to boost frame rates. The key to these algorithms is to exploit spatiotemporal coherence by warping rendered pixels with motion representations. However, existing motion estimation methods can suffer from low precision, high overhead, and incomplete support for visual effects. In this article, we present a rendered frame prediction framework with a novel motion representation, dubbed\n            <jats:italic>motion-guided flow (MoFlow)<\/jats:italic>\n            , aiming at overcoming the intrinsic limitations of optical flow and motion vectors and precisely capture the dynamics of intricate geometries, lighting, and translucent objects. Notably, we construct MoFlows using a recurrent feature streaming network, which specializes in learning latent motion features from multiple frames. The results of extensive experiments demonstrate that, compared to state-of-the-art methods, our method achieves superior visual quality and temporal stability with lower latency. The recurrent mechanism allows our method to predict single or multiple consecutive frames, increasing the frame rate by over 2\u00d7. The proposed approach represents a flexible pipeline to meet the demands of various graphics applications, devices, and scenarios.\n          <\/jats:p>","DOI":"10.1145\/3730400","type":"journal-article","created":{"date-parts":[[2025,4,18]],"date-time":"2025-04-18T11:25:41Z","timestamp":1744975541000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["MoFlow: Motion-Guided Flows for Recurrent Rendered Frame Prediction"],"prefix":"10.1145","volume":"44","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-5311-8404","authenticated-orcid":false,"given":"Zhizhen","family":"Wu","sequence":"first","affiliation":[{"name":"State Key Lab of CAD&amp;CG, Zhejiang University, Hangzhou, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-9924-5676","authenticated-orcid":false,"given":"Zhilong","family":"Yuan","sequence":"additional","affiliation":[{"name":"Zhejiang University, Hangzhou, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-1193-9564","authenticated-orcid":false,"given":"Chenyu","family":"Zuo","sequence":"additional","affiliation":[{"name":"State Key Lab of CAD&amp;CG, Zhejiang University, Hangzhou, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8857-8373","authenticated-orcid":false,"given":"Yazhen","family":"Yuan","sequence":"additional","affiliation":[{"name":"Tencent, Hangzhou, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0667-2599","authenticated-orcid":false,"given":"Yifan","family":"Peng","sequence":"additional","affiliation":[{"name":"The University of Hong Kong, Hong Kong, Hong Kong"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-0778-6171","authenticated-orcid":false,"given":"Guiyang","family":"Pu","sequence":"additional","affiliation":[{"name":"China Mobile (Hangzhou) Information Technology Co., Ltd, Hangzhou, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4267-0347","authenticated-orcid":false,"given":"Rui","family":"Wang","sequence":"additional","affiliation":[{"name":"State Key Lab of CAD&amp;CG, Zhejiang University, Hangzhou, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3296-7999","authenticated-orcid":false,"given":"Yuchi","family":"Huo","sequence":"additional","affiliation":[{"name":"State Key Lab of CAD&amp;CG, Zhejiang University, Hangzhou, China and Zhejiang Lab, Hangzhou, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,4,29]]},"reference":[{"key":"e_1_3_2_2_1","unstructured":"AMD. 2022. FidelityFX Super Resolution 2.1. (2022). Retrieved October 26 2024 from https:\/\/github.com\/GPUOpen-Effects\/FidelityFX-FSR2"},{"key":"e_1_3_2_3_1","unstructured":"AMD. 2023. FidelityFX Super Resolution 2.1. (2023). Retrieved October 26 2024 from https:\/\/gpuopen.com\/fidelityfx-super-resolution-3\/"},{"issue":"2","key":"e_1_3_2_4_1","article-title":"FLIP: A difference evaluator for alternating images.","volume":"3","author":"Andersson Pontus","year":"2020","unstructured":"Pontus Andersson, Jim Nilsson, Tomas Akenine-M\u00f6ller, Magnus Oskarsson, Kalle \u00c5str\u00f6m, and Mark D. Fairchild. 2020. FLIP: A difference evaluator for alternating images. Proceedings of the ACM in Computer Graphics and Interactive Techniques 3, 2 (2020), 15\u20131.","journal-title":"Proceedings of the ACM in Computer Graphics and Interactive Techniques"},{"issue":"4","key":"e_1_3_2_5_1","article-title":"Kernel-predicting convolutional networks for denoising Monte Carlo renderings.","volume":"36","author":"Bako Steve","year":"2017","unstructured":"Steve Bako, Thijs Vogels, Brian McWilliams, Mark Meyer, Jan Nov\u00e1k, Alex Harvill, Pradeep Sen, Tony Derose, and Fabrice Rousselle. 2017. Kernel-predicting convolutional networks for denoising Monte Carlo renderings. ACM Transactions on Graphics 36, 4 (2017), 97\u20131.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_3_2_6_1","first-page":"1","volume-title":"ACM SIGGRAPH 2023 Conference Proceedings","author":"Balint Martin","year":"2023","unstructured":"Martin Balint, Krzysztof Wolski, Karol Myszkowski, Hans-Peter Seidel, and Rafa\u0142 Mantiuk. 2023. Neural partitioning pyramids for denoising monte carlo renderings. In ACM SIGGRAPH 2023 Conference Proceedings. 1\u201311."},{"key":"e_1_3_2_7_1","first-page":"3703","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Bao Wenbo","year":"2019","unstructured":"Wenbo Bao, Wei-Sheng Lai, Chao Ma, Xiaoyun Zhang, Zhiyong Gao, and Ming-Hsuan Yang. 2019. Depth-aware video frame interpolation. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 3703\u20133712."},{"issue":"6","key":"e_1_3_2_8_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3478513.3480553","article-title":"Neural frame interpolation for rendered content","volume":"40","author":"Briedis Karlis Martins","year":"2021","unstructured":"Karlis Martins Briedis, Abdelaziz Djelouah, Mark Meyer, Ian McGonigal, Markus Gross, and Christopher Schroers. 2021. Neural frame interpolation for rendered content. ACM Transactions on Graphics 40, 6 (2021), 1\u201313.","journal-title":"ACM Transactions on Graphics"},{"issue":"4","key":"e_1_3_2_9_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3072959.3073601","article-title":"Interactive reconstruction of Monte Carlo image sequences using a recurrent denoising autoencoder","volume":"36","author":"Chaitanya Chakravarty R. Alla","year":"2017","unstructured":"Chakravarty R. Alla Chaitanya, Anton S. Kaplanyan, Christoph Schied, Marco Salvi, Aaron Lefohn, Derek Nowrouzezahrai, and Timo Aila. 2017. Interactive reconstruction of Monte Carlo image sequences using a recurrent denoising autoencoder. ACM Transactions on Graphics 36, 4 (2017), 1\u201312.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_3_2_10_1","first-page":"168","volume-title":"Proceedings of the 1st International Conference on Image Processing","author":"Charbonnier Pierre","year":"1994","unstructured":"Pierre Charbonnier, Laure Blanc-Feraud, Gilles Aubert, and Michel Barlaud. 1994. Two deterministic half-quadratic regularization algorithms for computed imaging. In Proceedings of the 1st International Conference on Image Processing. IEEE, 168\u2013172."},{"key":"e_1_3_2_11_1","first-page":"10663","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Choi Myungsub","year":"2020","unstructured":"Myungsub Choi, Heewon Kim, Bohyung Han, Ning Xu, and Kyoung Mu Lee. 2020. Channel attention is all you need for video frame interpolation. In Proceedings of the AAAI Conference on Artificial Intelligence. 10663\u201310671."},{"key":"e_1_3_2_12_1","first-page":"1","volume-title":"ACM SIGGRAPH 2022 Conference Proceedings","author":"Datta Sayantan","year":"2022","unstructured":"Sayantan Datta, Derek Nowrouzezahrai, Christoph Schied, and Zhao Dong. 2022. Neural shadow mapping. In ACM SIGGRAPH 2022 Conference Proceedings. 1\u20139."},{"key":"e_1_3_2_13_1","first-page":"1174","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Denton Emily","year":"2018","unstructured":"Emily Denton and Rob Fergus. 2018. Stochastic video generation with a learned prior. In Proceedings of the International Conference on Machine Learning. PMLR, 1174\u20131183."},{"key":"e_1_3_2_14_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"Dosovitskiy Alexey","year":"2015","unstructured":"Alexey Dosovitskiy, Philipp Fischer, Eddy Ilg, Philip Hausser, Caner Hazirbas, Vladimir Golkov, Patrick van der Smagt, Daniel Cremers, and Thomas Brox. 2015. FlowNet: Learning optical flow with convolutional networks. In Proceedings of the IEEE International Conference on Computer Vision."},{"key":"e_1_3_2_15_1","unstructured":"Epic Games. 2022. Screen Percentage with Temporal Upsample | Unreal Engine 4.27. (2022). Retrieved 2022 from https:\/\/dev.epicgames.com\/documentation\/en-us\/unreal-engine\/screen-percentage-with-temporal-upsample?application_version=4.27"},{"key":"e_1_3_2_16_1","first-page":"9006","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Gao Hang","year":"2019","unstructured":"Hang Gao, Huazhe Xu, Qi-Zhi Cai, Ruth Wang, Fisher Yu, and Trevor Darrell. 2019. Disentangling propagation and generation for video prediction. In Proceedings of the IEEE\/CVF International Conference on Computer Vision. 9006\u20139015."},{"key":"e_1_3_2_17_1","first-page":"2220","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Garrepalli Risheek","year":"2023","unstructured":"Risheek Garrepalli, Jisoo Jeong, Rajeswaran C. Ravindran, Jamie Menjay Lin, and Fatih Porikli. 2023. Dift: Dynamic iterative field transforms for memory efficient optical flow. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 2220\u20132229."},{"issue":"6","key":"e_1_3_2_18_1","first-page":"1","article-title":"ExtraNet: Real-time extrapolated rendering for low-latency temporal supersampling","volume":"40","author":"Guo Jie","year":"2021","unstructured":"Jie Guo, Xihao Fu, Liqiang Lin, Hengjun Ma, Yanwen Guo, Shiqiu Liu, and Ling-Qi Yan. 2021. ExtraNet: Real-time extrapolated rendering for low-latency temporal supersampling. ACM Transactions on Graphics 40, 6 (2021), 1\u201316.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_3_2_19_1","doi-asserted-by":"crossref","unstructured":"Yu-Xiao Guo Guojun Chen Yue Dong and Xin Tong. 2022. Classifier guided temporal supersampling for real-time rendering. In Computer Graphics Forum. Wiley Online Library 237\u2013246.","DOI":"10.1111\/cgf.14672"},{"key":"e_1_3_2_20_1","first-page":"1026","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"He Kaiming","year":"2015","unstructured":"Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2015. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In Proceedings of the IEEE International Conference on Computer Vision. 1026\u20131034."},{"issue":"1","key":"e_1_3_2_21_1","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/0004-3702(81)90024-2","article-title":"Determining optical flow","volume":"17","author":"Horn Berthold K. P.","year":"1981","unstructured":"Berthold K. P. Horn and Brian G. Schunck. 1981. Determining optical flow. Artificial Intelligence 17, 1-3 (1981), 185\u2013203.","journal-title":"Artificial Intelligence"},{"key":"e_1_3_2_22_1","first-page":"6121","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Hu Xiaotao","year":"2023","unstructured":"Xiaotao Hu, Zhewei Huang, Ailin Huang, Jun Xu, and Shuchang Zhou. 2023. A dynamic multi-scale voxel flow network for video prediction. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 6121\u20136131."},{"key":"e_1_3_2_23_1","doi-asserted-by":"crossref","unstructured":"Zhaoyang Huang Xiaoyu Shi Chao Zhang Qiang Wang Ka Chun Cheung Hongwei Qin Jifeng Dai and Hongsheng Li. 2022. Flowformer: A transformer architecture for optical flow. In European Conference on Computer Vision Springer 668\u2013685.","DOI":"10.1007\/978-3-031-19790-1_40"},{"key":"e_1_3_2_24_1","first-page":"624","volume-title":"Proceedings of the European Conference on Computer Vision","author":"Huang Zhewei","year":"2022","unstructured":"Zhewei Huang, Tianyuan Zhang, Wen Heng, Boxin Shi, and Shuchang Zhou. 2022b. Real-time intermediate flow estimation for video frame interpolation. In Proceedings of the European Conference on Computer Vision. Springer, 624\u2013642."},{"key":"e_1_3_2_25_1","first-page":"169","volume-title":"Proceedings of the European Conference on Computer Vision","author":"Hui Tak-Wai","year":"2020","unstructured":"Tak-Wai Hui and Chen Change Loy. 2020. Liteflownet3: Resolving correspondence ambiguity for more accurate optical flow estimation. In Proceedings of the European Conference on Computer Vision. Springer, 169\u2013184."},{"key":"e_1_3_2_26_1","first-page":"8981","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Hui Tak-Wai","year":"2018","unstructured":"Tak-Wai Hui, Xiaoou Tang, and Chen Change Loy. 2018. Liteflownet: A lightweight convolutional neural network for optical flow estimation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 8981\u20138989."},{"key":"e_1_3_2_27_1","volume-title":"Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition","author":"Ilg E.","year":"2017","unstructured":"E. Ilg, N. Mayer, T. Saikia, M. Keuper, and T. Brox. 2017. FlowNet 2.0: Evolution of optical flow estimation with deep networks. In Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_3_2_28_1","unstructured":"Intel. 2022. Intel Xe Super Sampling. Retrieved March 18 2025 from https:\/\/www.intel.com\/content\/www\/us\/en\/products\/docs\/discretegpus\/%0Aarc\/software\/gaming-technologies.html"},{"issue":"4","key":"e_1_3_2_29_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3450626.3459793","article-title":"Interactive Monte Carlo denoising using affinity of neural features","volume":"40","author":"I\u015f\u0131k Mustafa","year":"2021","unstructured":"Mustafa I\u015f\u0131k, Krishna Mullia, Matthew Fisher, Jonathan Eisenmann, and Micha\u00ebl Gharbi. 2021. Interactive Monte Carlo denoising using affinity of neural features. ACM Transactions on Graphics 40, 4 (2021), 1\u201313.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_3_2_30_1","first-page":"9772","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Jiang Shihao","year":"2021","unstructured":"Shihao Jiang, Dylan Campbell, Yao Lu, Hongdong Li, and Richard Hartley. 2021. Learning to estimate hidden motions with global motion aggregation. In Proceedings of the IEEE\/CVF International Conference on Computer Vision. 9772\u20139781."},{"key":"e_1_3_2_31_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Jin Xin","year":"2023","unstructured":"Xin Jin, Longhai Wu, Jie Chen, Youxin Chen, Jayoon Koo, and Cheul-hee Hahm. 2023. A unified pyramid recurrent network for video frame interpolation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition."},{"issue":"6","key":"e_1_3_2_32_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3355089.3356557","article-title":"DeepFovea: Neural reconstruction for foveated rendering and video compression using learned statistics of natural videos","volume":"38","author":"Kaplanyan Anton S.","year":"2019","unstructured":"Anton S. Kaplanyan, Anton Sochenov, Thomas Leimk\u00fchler, Mikhail Okunev, Todd Goodall, and Gizem Rufo. 2019. DeepFovea: Neural reconstruction for foveated rendering and video compression using learned statistics of natural videos. ACM Transactions on Graphics 38, 6 (2019), 1\u201313.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_3_2_33_1","first-page":"1969","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Kong Lingtong","year":"2022","unstructured":"Lingtong Kong, Boyuan Jiang, Donghao Luo, Wenqing Chu, Xiaoming Huang, Ying Tai, Chengjie Wang, and Jie Yang. 2022. IFRNet: Intermediate feature refine network for efficient frame interpolation. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 1969\u20131978."},{"key":"e_1_3_2_34_1","first-page":"10310","volume-title":"Proceedings of the 2021 IEEE International Conference on Robotics and Automation","author":"Kong Lingtong","year":"2021","unstructured":"Lingtong Kong, Chunhua Shen, and Jie Yang. 2021. Fastflownet: A lightweight network for fast optical flow estimation. In Proceedings of the 2021 IEEE International Conference on Robotics and Automation. IEEE, 10310\u201310316."},{"key":"e_1_3_2_35_1","first-page":"5316","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Lee Hyeongmin","year":"2020","unstructured":"Hyeongmin Lee, Taeoh Kim, Tae-young Chung, Daehyun Pak, Yuseok Ban, and Sangyoun Lee. 2020. Adacof: Adaptive collaboration of flows for video frame interpolation. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 5316\u20135325."},{"key":"e_1_3_2_36_1","volume-title":"Proceedings of the Graphics Interface 2022","author":"Li Zhan","year":"2022","unstructured":"Zhan Li, Carl S. Marshall, Deepak S. Vembar, and Feng Liu. 2022. Future frame synthesis for fast Monte Carlo rendering. In Proceedings of the Graphics Interface 2022."},{"key":"e_1_3_2_37_1","volume-title":"Proceedings of the GPU Technology Conference","author":"Liu Edward","year":"2020","unstructured":"Edward Liu. 2020. DLSS 2.0-Image reconstruction for real-time rendering with deep learning. In Proceedings of the GPU Technology Conference."},{"key":"e_1_3_2_38_1","first-page":"4463","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"Liu Ziwei","year":"2017","unstructured":"Ziwei Liu, Raymond A. Yeh, Xiaoou Tang, Yiming Liu, and Aseem Agarwala. 2017. Video frame synthesis using deep voxel flow. In Proceedings of the IEEE International Conference on Computer Vision. 4463\u20134471."},{"key":"e_1_3_2_39_1","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Loshchilov Ilya","year":"2019","unstructured":"Ilya Loshchilov and Frank Hutter. 2019. Decoupled weight decay regularization. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_2_40_1","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Lotter William","year":"2016","unstructured":"William Lotter, Gabriel Kreiman, and David Cox. 2016. Deep predictive coding networks for video prediction and unsupervised learning. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_2_41_1","article-title":"Image restoration using very deep convolutional encoder-decoder networks with symmetric skip connections","volume":"29","author":"Mao Xiaojiao","year":"2016","unstructured":"Xiaojiao Mao, Chunhua Shen, and Yu-Bin Yang. 2016. Image restoration using very deep convolutional encoder-decoder networks with symmetric skip connections. Advances in Neural Information Processing Systems 29 (2016), 2810\u20132818.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_42_1","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Meister Simon","year":"2018","unstructured":"Simon Meister, Junhwa Hur, and Stefan Roth. 2018. Unflow: Unsupervised learning of optical flow with a bidirectional census loss. In Proceedings of the AAAI Conference on Artificial Intelligence."},{"issue":"2","key":"e_1_3_2_43_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3446790","article-title":"Temporally adaptive shading reuse for real-time rendering and virtual reality","volume":"40","author":"Mueller Joerg H.","year":"2021","unstructured":"Joerg H. Mueller, Thomas Neff, Philip Voglreiter, Markus Steinberger, and Dieter Schmalstieg. 2021. Temporally adaptive shading reuse for real-time rendering and virtual reality. ACM Transactions on Graphics 40, 2 (2021), 1\u201314.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_3_2_44_1","first-page":"261","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"Niklaus Simon","year":"2017","unstructured":"Simon Niklaus, Long Mai, and Feng Liu. 2017. Video frame interpolation via adaptive separable convolution. In Proceedings of the IEEE International Conference on Computer Vision. 261\u2013270."},{"key":"e_1_3_2_45_1","unstructured":"NVIDIA. 2022. DLSS 3.0. (2022). Retrieved October 26 2024 from https:\/\/www.nvidia.com\/en-us\/geforce\/technologies\/dlss\/"},{"key":"e_1_3_2_46_1","first-page":"1568","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Park Junheum","year":"2023","unstructured":"Junheum Park, Jintae Kim, and Chang-Su Kim. 2023. Biformer: Learning bilateral motion estimation via bilateral transformer for 4k video frame interpolation. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 1568\u20131577."},{"key":"e_1_3_2_47_1","article-title":"Pytorch: An imperative style, high-performance deep learning library","volume":"32","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et\u00a0al. 2019. Pytorch: An imperative style, high-performance deep learning library. Advances in Neural Information Processing Systems 32 (2019).","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_48_1","first-page":"4161","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Ranjan Anurag","year":"2017","unstructured":"Anurag Ranjan and Michael J. Black. 2017. Optical flow estimation using a spatial pyramid network. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4161\u20134170."},{"key":"e_1_3_2_49_1","first-page":"2077","volume-title":"Proceedings of the 2019 IEEE Winter Conference on Applications of Computer Vision","author":"Ren Zhile","year":"2019","unstructured":"Zhile Ren, Orazio Gallo, Deqing Sun, Ming-Hsuan Yang, Erik B. Sudderth, and Jan Kautz. 2019. A fusion approach for multi-frame optical flow estimation. In Proceedings of the 2019 IEEE Winter Conference on Applications of Computer Vision. IEEE, 2077\u20132086."},{"key":"e_1_3_2_50_1","first-page":"234","volume-title":"Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention","author":"Ronneberger Olaf","year":"2015","unstructured":"Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. In Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 234\u2013241."},{"key":"e_1_3_2_51_1","first-page":"2378","volume-title":"Proceedings of the Computer Graphics Forum","author":"Scherzer Daniel","year":"2012","unstructured":"Daniel Scherzer, Lei Yang, Oliver Mattausch, Diego Nehab, Pedro V. Sander, Michael Wimmer, and Elmar Eisemann. 2012. Temporal coherence methods in real-time rendering. In Proceedings of the Computer Graphics Forum. Wiley Online Library, 2378\u20132408."},{"key":"e_1_3_2_52_1","article-title":"Convolutional LSTM network: A machine learning approach for precipitation nowcasting","volume":"28","author":"Shi Xingjian","year":"2015","unstructured":"Xingjian Shi, Zhourong Chen, Hao Wang, Dit-Yan Yeung, Wai-Kin Wong, and Wang-chun Woo. 2015. Convolutional LSTM network: A machine learning approach for precipitation nowcasting. Advances in Neural Information Processing Systems 28, 1 (2015), 802\u2013810.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_53_1","first-page":"14489","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Sim Hyeonjun","year":"2021","unstructured":"Hyeonjun Sim, Jihyong Oh, and Munchurl Kim. 2021. Xvfi: Extreme video frame interpolation. In Proceedings of the IEEE\/CVF International Conference on Computer Vision. 14489\u201314498."},{"key":"e_1_3_2_54_1","first-page":"843","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Srivastava Nitish","year":"2015","unstructured":"Nitish Srivastava, Elman Mansimov, and Ruslan Salakhudinov. 2015. Unsupervised learning of video representations using lstms. In Proceedings of the International Conference on Machine Learning. PMLR, 843\u2013852."},{"key":"e_1_3_2_55_1","first-page":"8934","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Sun Deqing","year":"2018","unstructured":"Deqing Sun, Xiaodong Yang, Ming-Yu Liu, and Jan Kautz. 2018. Pwc-net: Cnns for optical flow using pyramid, warping, and cost volume. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 8934\u20138943."},{"key":"e_1_3_2_56_1","first-page":"402","volume-title":"Proceedings of the European Conference on Computer Vision","author":"Teed Zachary","year":"2020","unstructured":"Zachary Teed and Jia Deng. 2020. Raft: Recurrent all-pairs field transforms for optical flow. In Proceedings of the European Conference on Computer Vision. Springer, 402\u2013419."},{"issue":"6","key":"e_1_3_2_57_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3414685.3417786","article-title":"A reduced-precision network for image reconstruction","volume":"39","author":"Thomas Manu Mathew","year":"2020","unstructured":"Manu Mathew Thomas, Karthik Vaidyanathan, Gabor Liktor, and Angus G. Forbes. 2020. A reduced-precision network for image reconstruction. ACM Transactions on Graphics 39, 6 (2020), 1\u201312.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_3_2_58_1","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1007\/978-3-7091-6809-7_3","volume-title":"Rendering Techniques\u2019 99: Proceedings of the Eurographics Workshop in Granada, Spain, June 21\u201323, 1999 10","author":"Walter Bruce","year":"1999","unstructured":"Bruce Walter, George Drettakis, and Steven Parker. 1999. Interactive rendering using the render cache. In Rendering Techniques\u2019 99: Proceedings of the Eurographics Workshop in Granada, Spain, June 21\u201323, 1999 10. Springer, 19\u201330."},{"key":"e_1_3_2_59_1","first-page":"1","volume-title":"Proceedings of the SIGGRAPH Asia 2023 Conference Papers","author":"Wu Songyin","year":"2023","unstructured":"Songyin Wu, Sungye Kim, Zheng Zeng, Deepak Vembar, Sangeeta Jha, Anton Kaplanyan, and Ling-Qi Yan. 2023. ExtraSS: A framework for joint spatial super sampling and frame extrapolation. In Proceedings of the SIGGRAPH Asia 2023 Conference Papers. 1\u201311."},{"issue":"6","key":"e_1_3_2_60_1","first-page":"1","article-title":"GFFE: G-buffer free frame extrapolation for low-latency real-time rendering","volume":"43","author":"Wu Songyin","year":"2024","unstructured":"Songyin Wu, Deepak Vembar, Anton Sochenov, Selvakumar Panneer, Sungye Kim, Anton Kaplanyan, and Ling-Qi Yan. 2024. GFFE: G-buffer free frame extrapolation for low-latency real-time rendering. ACM Transactions on Graphics 43, 6 (2024), 1\u201315.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_3_2_61_1","first-page":"17814","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Wu Yue","year":"2022","unstructured":"Yue Wu, Qiang Wen, and Qifeng Chen. 2022. Optimizing video prediction via video frame interpolation. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 17814\u201317823."},{"key":"e_1_3_2_62_1","first-page":"1","volume-title":"Proceedings of the SIGGRAPH Asia 2023 Conference Papers","author":"Wu Zhizhen","year":"2023","unstructured":"Zhizhen Wu, Chenyu Zuo, Yuchi Huo, Yazhen Yuan, Yifan Peng, Guiyang Pu, Rui Wang, and Hujun Bao. 2023. Adaptive recurrent frame prediction with learnable motion vectors. In Proceedings of the SIGGRAPH Asia 2023 Conference Papers. 1\u201311."},{"key":"e_1_3_2_63_1","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/11744023_17","volume-title":"Computer Vision\u2013ECCV 2006: 9th European Conference on Computer Vision, Graz, Austria, May 7\u201313, 2006. Proceedings, Part I 9","author":"Xiao Jiangjian","year":"2006","unstructured":"Jiangjian Xiao, Hui Cheng, Harpreet Sawhney, Cen Rao, and Michael Isnardi. 2006. Bilateral filtering-based optical flow estimation with occlusion detection. In Computer Vision\u2013ECCV 2006: 9th European Conference on Computer Vision, Graz, Austria, May 7\u201313, 2006. Proceedings, Part I 9. Springer, 211\u2013224."},{"key":"e_1_3_2_64_1","first-page":"10498","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Xu Haofei","year":"2021","unstructured":"Haofei Xu, Jiaolong Yang, Jianfei Cai, Juyong Zhang, and Xin Tong. 2021. High-resolution optical flow from 1d attention and correlation. In Proceedings of the IEEE\/CVF International Conference on Computer Vision. 10498\u201310507."},{"key":"e_1_3_2_65_1","first-page":"8121","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Xu Haofei","year":"2022","unstructured":"Haofei Xu, Jing Zhang, Jianfei Cai, Hamid Rezatofighi, and Dacheng Tao. 2022. GMFlow: Learning optical flow via global matching. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 8121\u20138130."},{"key":"e_1_3_2_66_1","first-page":"607","volume-title":"Proceedings of the Computer Graphics Forum","author":"Yang Lei","year":"2020","unstructured":"Lei Yang, Shiqiu Liu, and Marco Salvi. 2020. A survey of temporal antialiasing techniques. In Proceedings of the Computer Graphics Forum. Wiley Online Library, 607\u2013621."},{"key":"e_1_3_2_67_1","first-page":"79","volume-title":"Proceedings of the Computer Graphics Forum","author":"Zeng Zheng","year":"2021","unstructured":"Zheng Zeng, Shiqiu Liu, Jinglei Yang, Lu Wang, and Ling-Qi Yan. 2021. Temporally reliable motion vectors for real-time ray tracing. In Proceedings of the Computer Graphics Forum. Wiley Online Library, 79\u201390."},{"key":"e_1_3_2_68_1","first-page":"5682","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Zhang Guozhen","year":"2023","unstructured":"Guozhen Zhang, Yuhan Zhu, Haonan Wang, Youxin Chen, Gangshan Wu, and Limin Wang. 2023. Extracting motion and appearance via inter-frame attention for efficient video frame interpolation. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 5682\u20135692."},{"key":"e_1_3_2_69_1","first-page":"6848","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Zhang Xiangyu","year":"2018","unstructured":"Xiangyu Zhang, Xinyu Zhou, Mengxiao Lin, and Jian Sun. 2018. Shufflenet: An extremely efficient convolutional neural network for mobile devices. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 6848\u20136856."},{"key":"e_1_3_2_70_1","first-page":"1","volume-title":"Proceedings of the SIGGRAPH Asia 2023 Conference Papers","author":"Zhong Zhihua","year":"2023","unstructured":"Zhihua Zhong, Jingsen Zhu, Yuxin Dai, Chuankun Zheng, Guanlin Chen, Yuchi Huo, Hujun Bao, and Rui Wang. 2023. FuseSR: Super resolution for real-time rendering through efficient multi-resolution fusion. In Proceedings of the SIGGRAPH Asia 2023 Conference Papers. 1\u201310."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3730400","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3730400","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:57:19Z","timestamp":1750298239000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3730400"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,29]]},"references-count":69,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,4,30]]}},"alternative-id":["10.1145\/3730400"],"URL":"https:\/\/doi.org\/10.1145\/3730400","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4,29]]},"assertion":[{"value":"2024-10-22","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-03-25","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-04-29","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}