{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,18]],"date-time":"2026-07-18T22:22:47Z","timestamp":1784413367806,"version":"3.55.0"},"reference-count":72,"publisher":"Springer Science and Business Media LLC","issue":"9","license":[{"start":{"date-parts":[[2025,6,6]],"date-time":"2025-06-06T00:00:00Z","timestamp":1749168000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2025,6,6]],"date-time":"2025-06-06T00:00:00Z","timestamp":1749168000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61632003, 61375022, 61403005"],"award-info":[{"award-number":["61632003, 61375022, 61403005"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100012542","name":"Sichuan Province Science and Technology Support Program","doi-asserted-by":"publisher","award":["2023YFSY0008"],"award-info":[{"award-number":["2023YFSY0008"]}],"id":[{"id":"10.13039\/100012542","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012237","name":"Beijing Advanced Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology","doi-asserted-by":"publisher","award":["2018IRS11"],"award-info":[{"award-number":["2018IRS11"]}],"id":[{"id":"10.13039\/501100012237","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Comput Vis"],"published-print":{"date-parts":[[2025,9]]},"DOI":"10.1007\/s11263-025-02481-9","type":"journal-article","created":{"date-parts":[[2025,6,5]],"date-time":"2025-06-05T22:41:25Z","timestamp":1749163285000},"page":"6362-6373","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":34,"title":["Real-Time Neural Radiance Talking Portrait Synthesis via Audio-Spatial Decomposition"],"prefix":"10.1007","volume":"133","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2487-4469","authenticated-orcid":false,"given":"Jiaxiang","family":"Tang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kaisiyuan","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hang","family":"Zhou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaokang","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dongliang","family":"He","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tianshu","family":"Hu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jingtuo","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ziwei","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gang","family":"Zeng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jingdong","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,6,6]]},"reference":[{"key":"2481_CR1","unstructured":"Amodei, Dario, Ananthanarayanan, Sundaram, Anubhai, Rishita, Bai, Jingliang, Battenberg, Eric, Case, Carl, Casper, Jared, Catanzaro, Bryan, Cheng, Qiang, & Chen, Guoliang, et\u00a0al. (2016). Deep speech 2: End-to-end speech recognition in english and mandarin. In ICML 173\u2013182. PMLR."},{"key":"2481_CR2","first-page":"12449","volume":"33","author":"Alexei Baevski","year":"2020","unstructured":"Baevski, Alexei, Zhou, Yuhao, Mohamed, Abdelrahman, & Auli, Michael. (2020). wav2vec 2.0: A framework for self-supervised learning of speech representations. NeurIPS, 33, 12449\u201312460.","journal-title":"NeurIPS"},{"key":"2481_CR3","doi-asserted-by":"crossref","unstructured":"Baltrusaitis, Tadas, Zadeh, Amir, Lim, Yao\u00a0Chong, & Morency, Louis-Philippe. (2018).Openface 2.0: Facial behavior analysis toolkit. In FG59\u201366. IEEE.","DOI":"10.1109\/FG.2018.00019"},{"key":"2481_CR4","volume-title":"Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman, Ricardo Martin-Brualla, and Pratul P","author":"T Jonathan","year":"2021","unstructured":"Jonathan, T. (2021). Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman, Ricardo Martin-Brualla, and Pratul P. Srinivasan. Mip-nerf: A multiscale representation for anti-aliasing neural radiance fields."},{"key":"2481_CR5","doi-asserted-by":"crossref","unstructured":"Barron, Jonathan\u00a0T., Mildenhall, Ben, Verbin, Dor, Srinivasan, Pratul\u00a0P., & Hedman, Peter. (2021).Mip-nerf 360: Unbounded anti-aliased neural radiance fields. arXiv preprint arXiv:2111.12077.","DOI":"10.1109\/CVPR52688.2022.00539"},{"key":"2481_CR6","doi-asserted-by":"crossref","unstructured":"Brand, Matthew, puppetry, Voice. (1999). In Proceedings of the 26th annual conference on Computer graphics and interactive techniques 21\u201328.","DOI":"10.1145\/311535.311537"},{"key":"2481_CR7","doi-asserted-by":"crossref","unstructured":"Bregler, Christoph, Covell, Michele, & Slaney, Malcolm. (1997). Video rewrite: Driving visual speech with audio. In Proceedings of the 24th annual conference on Computer graphics and interactive techniques 353\u2013360.","DOI":"10.1145\/258734.258880"},{"key":"2481_CR8","doi-asserted-by":"crossref","unstructured":"Bulat, Adrian, & Tzimiropoulos, Georgios. (2017). How far are we from solving the 2d & 3d face alignment problem? (and a dataset of 230,000 3d facial landmarks). In ICCV.","DOI":"10.1109\/ICCV.2017.116"},{"key":"2481_CR9","doi-asserted-by":"crossref","unstructured":"Chan, Eric\u00a0R. Lin, Connor\u00a0Z. Chan, Matthew\u00a0A. Nagano, Koki, Pan, Boxiao, De\u00a0Mello, Shalini, Gallo, Orazio, Guibas, Leonidas, Tremblay, Jonathan, & Khamis, Sameh, et\u00a0al. (2021). Efficient geometry-aware 3d generative adversarial networks. arXiv preprint arXiv:2112.07945.","DOI":"10.1109\/CVPR52688.2022.01565"},{"key":"2481_CR10","doi-asserted-by":"crossref","unstructured":"Chen, Anpei, Xu, Zexiang, Geiger, Andreas, Yu, Jingyi, & Su, Hao. (2022). Tensorf: Tensorial radiance fields. arXiv preprint arXiv:2203.09517.","DOI":"10.1007\/978-3-031-19824-3_20"},{"key":"2481_CR11","doi-asserted-by":"crossref","unstructured":"Chen, Lele, Cui, Guofeng, Liu, Celong, Li, Zhong, Kou, Ziyi, Xu, Yi, & Xu, Chenliang. (2020). Talking-head generation with rhythmic head motion. In ECCV, pages 35\u201351. Springer.","DOI":"10.1007\/978-3-030-58545-7_3"},{"key":"2481_CR12","doi-asserted-by":"crossref","unstructured":"Chen, Lele, Li, Zhiheng, Maddox, Ross\u00a0K. Duan, Zhiyao, & Xu, Chenliang. (2018). Lip movements generation at a glance. In ECCV 520\u2013535.","DOI":"10.1007\/978-3-030-01234-2_32"},{"key":"2481_CR13","doi-asserted-by":"crossref","unstructured":"Chen, Lele, Maddox, Ross\u00a0K. Duan, Zhiyao, & Xu, Chenliang. (2019). Hierarchical cross-modal talking face generation with dynamic pixel-wise loss. In CVPR, pages 7832\u20137841.","DOI":"10.1109\/CVPR.2019.00802"},{"key":"2481_CR14","doi-asserted-by":"crossref","unstructured":"Cheng, Kun, Cun, Xiaodong, Zhang, Yong, Xia, Menghan, Yin, Fei, Zhu, Mingrui, Wang, Xuan, Wang, Jue, & Wang, Nannan. (2022). Videoretalking: Audio-based lip synchronization for talking head video editing in the wild. In SIGGRAPH Asia 2022 Conference Papers1\u20139.","DOI":"10.1145\/3550469.3555399"},{"key":"2481_CR15","unstructured":"Chung, Joon\u00a0Son, Jamaludin, Amir, & Zisserman, Andrew. (2017). You said that? arXiv preprint arXiv:1705.02966."},{"key":"2481_CR16","doi-asserted-by":"crossref","unstructured":"Chung, Joon\u00a0Son, & Zisserman, Andrew. (2016). Out of time: automated lip sync in the wild. In ACCV, pages 251\u2013263. Springer.","DOI":"10.1007\/978-3-319-54427-4_19"},{"key":"2481_CR17","doi-asserted-by":"crossref","unstructured":"Cudeiro, Daniel, Bolkart, Timo, Laidlaw, Cassidy, Ranjan, Anurag, & Black, Michael\u00a0J. (2019).Capture, learning, and synthesis of 3d speaking styles. In CVPR 10101\u201310111.","DOI":"10.1109\/CVPR.2019.01034"},{"key":"2481_CR18","doi-asserted-by":"crossref","unstructured":"Das, Dipanjan, Biswas, Sandika, Sinha, Sanjana, & Bhowmick, Brojeshwar. (2020). Speech-driven facial animation using cascaded gans for learning of motion and texture. In ECCV, pages 408\u2013424. Springer.","DOI":"10.1007\/978-3-030-58577-8_25"},{"key":"2481_CR19","doi-asserted-by":"crossref","unstructured":"Fang, Jiemin, Yi, Taoran, Wang, Xinggang, Xie, Lingxi, Zhang, Xiaopeng, Liu, Wenyu, Nie\u00dfner, Matthias, & Tian, Qi. (2022). Fast dynamic radiance fields with time-aware neural voxels. arXiv preprint arXiv:2205.15285.","DOI":"10.1145\/3550469.3555383"},{"issue":"4","key":"2481_CR20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3450626.3459936","volume":"40","author":"Yao Feng","year":"2021","unstructured":"Feng, Yao, Feng, Haiwen, Black, Michael J., & Bolkart, Timo. (2021). Learning an animatable detailed 3d face model from in-the-wild images. ACM Transactions on Graphics (ToG), 40(4), 1\u201313.","journal-title":"ACM Transactions on Graphics (ToG)"},{"key":"2481_CR21","doi-asserted-by":"crossref","unstructured":"Gafni, Guy, Thies, Justus, Zollhofer, Michael, & Nie\u00dfner, Matthias. (2021). Dynamic neural radiance fields for monocular 4d facial avatar reconstruction. In CVPR, 8649\u20138658.","DOI":"10.1109\/CVPR46437.2021.00854"},{"key":"2481_CR22","doi-asserted-by":"crossref","unstructured":"Gao, Xuan, Zhong, Chenglai, Xiang, Jun, Hong, Yang, Guo, Yudong, & Zhang, Juyong. (2022). Reconstructing personalized semantic facial nerf models from monocular video. ACM TOG, 41(6).","DOI":"10.1145\/3550454.3555501"},{"key":"2481_CR23","doi-asserted-by":"crossref","unstructured":"Guo, Xiang, Chen, Guanying, Dai, Yuchao, Ye, Xiaoqing, Sun, Jiadai, Tan, Xiao, & Ding, Errui. (2022).Neural deformable voxel grid for fast optimization of dynamic view synthesis. arXiv preprint arXiv:2206.07698.","DOI":"10.1007\/978-3-031-26319-4_27"},{"key":"2481_CR24","doi-asserted-by":"crossref","unstructured":"Guo, Yudong, Chen, Keyu, Liang, Sen, Liu, Yong-Jin., Bao, Hujun, & Zhang, Juyong. (2021). Ad-nerf: Audio driven neural radiance fields for talking head synthesis. In ICCV, 5784\u20135794.","DOI":"10.1109\/ICCV48922.2021.00573"},{"key":"2481_CR25","doi-asserted-by":"crossref","unstructured":"Ji, Xinya, Zhou, Hang, Wang, Kaisiyuan, Wayne, Wu., Loy, Chen Change, Cao, Xun, & Feng, Xu. (2021). Audio-driven emotional video portraits. In CVPR, 14080\u201314089.","DOI":"10.1109\/CVPR46437.2021.01386"},{"key":"2481_CR26","unstructured":"Kingma, Diederik\u00a0P., & Ba, Jimmy. (2014). Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980."},{"key":"2481_CR27","doi-asserted-by":"crossref","unstructured":"Lee, Cheng-Han., Liu, Ziwei, Lingyun, Wu., & Luo, Ping. (2020). Maskgan: Towards diverse and interactive facial image manipulation. In CVPR, 5549\u20135558.","DOI":"10.1109\/CVPR42600.2020.00559"},{"key":"2481_CR28","doi-asserted-by":"crossref","unstructured":"Li, Jiahe, Zhang, Jiawei, Bai, Xiao, Zhou, Jun, & Gu, Lin. (2023). Efficient region-aware neural radiance fields for high-fidelity talking portrait synthesis. In Proceedings of the IEEE\/CVF International Conference on Computer Vision, pages 7568\u20137578.","DOI":"10.1109\/ICCV51070.2023.00696"},{"key":"2481_CR29","doi-asserted-by":"crossref","unstructured":"Li, Zhengqi, Niklaus, Simon, Snavely, Noah, & Wang, Oliver. (2021). Neural scene flow fields for space-time view synthesis of dynamic scenes. In CVPR, 6498\u20136508.","DOI":"10.1109\/CVPR46437.2021.00643"},{"key":"2481_CR30","unstructured":"Liu, Jia-Wei, Cao, Yan-Pei, Mao, Weijia, Zhang, Wenqiao, Zhang, David\u00a0Junhao, Keppo, Jussi, Shan, Ying, Qie, Xiaohu, & Shou, Mike\u00a0Zheng. (2022). Devrf: Fast deformable voxel radiance fields for dynamic scenes. arXiv preprint arXiv:2205.15723."},{"key":"2481_CR31","volume-title":"Kyaw Zaw Lin, Tat-Seng Chua, and Christian Theobalt","author":"Lingjie Liu","year":"2020","unstructured":"Liu, Lingjie, & Jiatao, Gu. (2020). Kyaw Zaw Lin, Tat-Seng Chua, and Christian Theobalt. NeurIPS: Neural sparse voxel fields."},{"key":"2481_CR32","doi-asserted-by":"crossref","unstructured":"Liu, Xian, Xu, Yinghao, Wu, Qianyi, Zhou, Hang, Wu, Wayne, & Zhou, Bolei. (2022). Semantic-aware implicit neural audio-driven video portrait generation. arXiv preprint arXiv:2201.07786.","DOI":"10.1007\/978-3-031-19836-6_7"},{"issue":"6","key":"2481_CR33","first-page":"1","volume":"40","author":"Lu Yuanxun","year":"2021","unstructured":"Yuanxun, Lu., Chai, Jinxiang, & Cao, Xun. (2021). Live speech portraits: real-time photorealistic talking-head animation. ACM TOG, 40(6), 1\u201317.","journal-title":"ACM TOG"},{"key":"2481_CR34","doi-asserted-by":"crossref","unstructured":"Martin-Brualla, Ricardo, Radwan, Noha, Sajjadi, Mehdi SM., Barron, Jonathan T., Dosovitskiy, Alexey, & Duckworth, Daniel. (2021). Nerf in the wild: Neural radiance fields for unconstrained photo collections. In CVPR, 7210\u20137219.","DOI":"10.1109\/CVPR46437.2021.00713"},{"key":"2481_CR35","doi-asserted-by":"crossref","unstructured":"Meshry, Moustafa, Suri, Saksham, Davis, Larry S., & Shrivastava, Abhinav. (2021). Learned spatial representations for few-shot talking-head synthesis. In ICCV, 13829\u201313838.","DOI":"10.1109\/ICCV48922.2021.01357"},{"key":"2481_CR36","volume-title":"and Ren Ng","author":"Ben Mildenhall","year":"2020","unstructured":"Mildenhall, Ben, Srinivasan, Pratul P., Tancik, Matthew, Barron, Jonathan T., & Ramamoorthi, Ravi. (2020). and Ren Ng. Nerf: Representing scenes as neural radiance fields for view synthesis. In ECCV."},{"key":"2481_CR37","doi-asserted-by":"crossref","unstructured":"M\u00fcller, Thomas, Evans, Alex, Schied, Christoph, & Keller, Alexander. (2022). Instant neural graphics primitives with a multiresolution hash encoding. arXiv:2201.05989.","DOI":"10.1145\/3528223.3530127"},{"key":"2481_CR38","doi-asserted-by":"crossref","unstructured":"Park, Keunhong, Sinha, Utkarsh, Barron, Jonathan T., Bouaziz, Sofien, Goldman, Dan B., Seitz, Steven M., & Martin-Brualla, Ricardo. (2021). Nerfies: Deformable neural radiance fields. In ICCV, 5865\u20135874.","DOI":"10.1109\/ICCV48922.2021.00581"},{"key":"2481_CR39","doi-asserted-by":"crossref","unstructured":"Park, Keunhong, Sinha, Utkarsh, Hedman, Peter, Barron, Jonathan\u00a0T., Bouaziz, Sofien, Goldman, Dan\u00a0B, Martin-Brualla, Ricardo, & Seitz, Steven\u00a0M. (2021). Hypernerf: A higher-dimensional representation for topologically varying neural radiance fields. arXiv preprint arXiv:2106.13228.","DOI":"10.1145\/3478513.3480487"},{"key":"2481_CR40","unstructured":"Paszke, Adam, Gross, Sam, Massa, Francisco, Lerer, Adam, Bradbury, James, Chanan, Gregory, Killeen, Trevor, Lin, Zeming, Gimelshein, Natalia, Antiga, Luca, et al. (2019). Pytorch: An imperative style, high-performance deep learning library. NeurIPS, 32."},{"key":"2481_CR41","doi-asserted-by":"crossref","unstructured":"Peng, Sida, Dong, Junting, Wang, Qianqian, Zhang, Shangzhan, Shuai, Qing, Zhou, Xiaowei, & Bao, Hujun. (2021). Animatable neural radiance fields for modeling dynamic human bodies. In ICCV.","DOI":"10.1109\/ICCV48922.2021.01405"},{"key":"2481_CR42","doi-asserted-by":"crossref","unstructured":"Peng, Sida, Zhang, Yuanqing, Yinghao, Xu., Wang, Qianqian, Shuai, Qing, Bao, Hujun, & Zhou, Xiaowei. (2021). Neural body: Implicit neural representations with structured latent codes for novel view synthesis of dynamic humans. In CVPR, 9054\u20139063.","DOI":"10.1109\/CVPR46437.2021.00894"},{"key":"2481_CR43","doi-asserted-by":"crossref","unstructured":"Peng, Ziqiao, Hu, Wentao, Shi, Yue, Zhu, Xiangyu, Zhang, Xiaomei, Zhao, Hao, He, Jun, Liu, Hongyan, & Fa, Zhaoxin. (2024). Synctalk: The devil is in the synchronization for talking head synthesis. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition 666\u2013676.","DOI":"10.1109\/CVPR52733.2024.00070"},{"key":"2481_CR44","doi-asserted-by":"crossref","unstructured":"Pham, Hai X., Cheung, Samuel, & Pavlovic, Vladimir. (2017). Speech-driven 3d facial animation with implicit emotional awareness: a deep learning approach. In CVPRW, 80\u201388.","DOI":"10.1109\/CVPRW.2017.287"},{"key":"2481_CR45","doi-asserted-by":"crossref","unstructured":"Prajwal, K. R., Mukhopadhyay, Rudrabha, Namboodiri, Vinay P., & Jawahar, C. V. (2020). A lip sync expert is all you need for speech to lip generation in the wild. In ACM MM, 484\u2013492.","DOI":"10.1145\/3394171.3413532"},{"key":"2481_CR46","doi-asserted-by":"crossref","unstructured":"Pumarola, Albert, Corona, Enric, Pons-Moll, Gerard, & Moreno-Noguer, Francesc. (2021). D-nerf: Neural radiance fields for dynamic scenes. In CVPR, 10318\u201310327.","DOI":"10.1109\/CVPR46437.2021.01018"},{"key":"2481_CR47","volume-title":"and Angjoo Kanazawa","author":"Sara Fridovich-Keil","year":"2022","unstructured":"Fridovich-Keil, Sara, Alex, Yu., Tancik, Matthew, Chen, Qinhong, & Recht, Benjamin. (2022). and Angjoo Kanazawa. Plenoxels: Radiance fields without neural networks. In CVPR."},{"key":"2481_CR48","doi-asserted-by":"crossref","unstructured":"Shen, Shuai, Li, Wanhua, Zhu, Zheng, Duan, Yueqi, Zhou, Jie, & Lu, Jiwen. (2022). Learning dynamic facial radiance fields for few-shot talking head synthesis. arXiv preprint arXiv:2207.11770.","DOI":"10.1007\/978-3-031-19775-8_39"},{"key":"2481_CR49","doi-asserted-by":"crossref","unstructured":"Let me talk as you want. (2022). Linsen Song, Wayne Wu, Chen Qian, Ran He, and Chen Change Loy. Everybody\u2019s talkin\u2019. IEEE Transactions on Information Forensics and Security, 17, 585\u2013598.","DOI":"10.1109\/TIFS.2022.3146783"},{"key":"2481_CR50","doi-asserted-by":"crossref","unstructured":"Song, Yang, Zhu, Jingwen, Li, Dawei, Wang, Xiaolong, & Qi, Hairong. (2018). Talking face generation by conditional recurrent adversarial network. arXiv preprint arXiv:1804.04786.","DOI":"10.24963\/ijcai.2019\/129"},{"key":"2481_CR51","doi-asserted-by":"crossref","unstructured":"Sun, Cheng, Sun, Min, & Chen, Hwann-Tzong. (2021). Direct voxel grid optimization: Super-fast convergence for radiance fields reconstruction. arXiv preprint arXiv:2111.11215.","DOI":"10.1109\/CVPR52688.2022.00538"},{"issue":"4","key":"2481_CR52","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3072959.3073640","volume":"36","author":"Supasorn Suwajanakorn","year":"2017","unstructured":"Suwajanakorn, Supasorn, Seitz, Steven M., & Kemelmacher-Shlizerman, Ira. (2017). Synthesizing obama: learning lip sync from audio. ACM TOG, 36(4), 1\u201313.","journal-title":"ACM TOG"},{"key":"2481_CR53","unstructured":"Tang, Jiaxiang. (2022). Torch-ngp: a pytorch implementation of instant-ngp, https:\/\/github.com\/ashawkey\/torch-ngp."},{"issue":"4","key":"2481_CR54","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3072959.3073699","volume":"36","author":"Sarah Taylor","year":"2017","unstructured":"Taylor, Sarah, Kim, Taehwan, Yue, Yisong, Mahler, Moshe, Krahe, James, Rodriguez, Anastasio Garcia, Hodgins, Jessica, & Matthews, Iain. (2017). A deep learning approach for generalized speech animation. ACM TOG, 36(4), 1\u201311.","journal-title":"ACM TOG"},{"key":"2481_CR55","doi-asserted-by":"crossref","unstructured":"Thies, Justus, Elgharib, Mohamed, Tewari, Ayush, Theobalt, Christian, & Nie\u00dfner, Matthias. (2020). Neural voice puppetry: Audio-driven facial reenactment. In ECCV, 716\u2013731.","DOI":"10.1007\/978-3-030-58517-4_42"},{"key":"2481_CR56","doi-asserted-by":"crossref","unstructured":"Thies, Justus, Zollhofer, Michael, Stamminger, Marc, Theobalt, Christian, & Nie\u00dfner, Matthias. (2016). Face2face: Real-time face capture and reenactment of rgb videos. In CVPR, 2387\u20132395.","DOI":"10.1109\/CVPR.2016.262"},{"key":"2481_CR57","doi-asserted-by":"crossref","unstructured":"Tretschk, Edgar, Tewari, Ayush, Golyanik, Vladislav, Zollh\u00f6fer, Michael, Lassner, Christoph, & Theobalt, Christian. (2021). Non-rigid neural radiance fields: Reconstruction and novel view synthesis of a dynamic scene from monocular video. In ICCV, 12959\u201312970.","DOI":"10.1109\/ICCV48922.2021.01272"},{"issue":"5","key":"2481_CR58","doi-asserted-by":"publisher","first-page":"1398","DOI":"10.1007\/s11263-019-01251-8","volume":"128","author":"Konstantinos Vougioukas","year":"2020","unstructured":"Vougioukas, Konstantinos, Petridis, Stavros, & Pantic, Maja. (2020). Realistic speech-driven facial animation with gans. IJCV, 128(5), 1398\u20131413.","journal-title":"IJCV"},{"key":"2481_CR59","doi-asserted-by":"crossref","unstructured":"Wang, Kaisiyuan, Qianyi, Wu., Song, Linsen, Yang, Zhuoqian, Wayne, Wu., Qian, Chen, Ran He, Yu., & Qiao, and Chen Change Loy. (2020). Mead: A large-scale audio-visual dataset for emotional talking-face generation. In ECCV, 700\u2013717.","DOI":"10.1007\/978-3-030-58589-1_42"},{"key":"2481_CR60","doi-asserted-by":"crossref","unstructured":"Wang, Liao, Zhang, Jiakai, Liu, Xinhang, Zhao, Fuqiang, Zhang, Yanshun, Zhang, Yingliang, Minye, Wu., Jingyi, Yu., & Lan, Xu. (2022). Fourier plenoctrees for dynamic radiance field rendering in real-time. In CVPR, 13524\u201313534.","DOI":"10.1109\/CVPR52688.2022.01316"},{"key":"2481_CR61","doi-asserted-by":"crossref","unstructured":"Wang, Suzhen, Li, Lincheng, Ding, Yu, Fan, Changjie, & Yu, Xin. (2021). Audio2head: Audio-driven one-shot talking-head generation with natural head motion. arXiv preprint arXiv:2107.09293.","DOI":"10.24963\/ijcai.2021\/152"},{"key":"2481_CR62","doi-asserted-by":"crossref","unstructured":"Haozhe, Wu., Jia, Jia, Wang, Haoyu, Dou, Yishun, Duan, Chao, & Deng, Qingshan. (2021). Imitating arbitrary talking style for realistic audio-driven talking face synthesis. In ACM MM, 1478\u20131486.","DOI":"10.1145\/3474085.3475280"},{"key":"2481_CR63","doi-asserted-by":"crossref","unstructured":"Xu, Yuelang, Wang, Lizhen, Zhao, Xiaochen, Zhang, Hongwen, & Liu, Yebin. (2023). Avatarmav: Fast 3d head avatar reconstruction using motion-aware neural voxels. In ACM SIGGRAPH 2023 Conference Proceedings 1\u201310.","DOI":"10.1145\/3588432.3591567"},{"key":"2481_CR64","unstructured":"Ye, Zhenhui, Jiang, Ziyue, Ren, Yi, Liu, Jinglin, He, Jinzheng, & Zhao, Zhou. (2023). Geneface: Generalized and high-fidelity audio-driven 3d talking face synthesis. arXiv preprint arXiv:2301.13430."},{"key":"2481_CR65","unstructured":"Yi, Ran, Ye, Zipeng, Zhang, Juyong, Bao, Hujun, & Liu, Yong-Jin. (2020). Audio-driven talking face video generation with learning-based personalized head pose. arXiv preprint arXiv:2002.10137."},{"key":"2481_CR66","doi-asserted-by":"crossref","unstructured":"Yu, Alex, Li, Ruilong, Tancik, Matthew, Li, Hao, Ng, Ren, & Kanazawa, Angjoo. (2021). PlenOctrees for real-time rendering of neural radiance fields. In ICCV.","DOI":"10.1109\/ICCV48922.2021.00570"},{"key":"2481_CR67","volume-title":"Alexei A Efros, Eli Shechtman, and Oliver Wang","author":"Richard Zhang","year":"2018","unstructured":"Zhang, Richard, & Isola, Phillip. (2018). Alexei A Efros, Eli Shechtman, and Oliver Wang. In CVPR: The unreasonable effectiveness of deep features as a perceptual metric."},{"key":"2481_CR68","doi-asserted-by":"crossref","unstructured":"Zhang, Zhimeng, Lincheng Li, Yu., & Ding, and Changjie Fan. (2021). Flow-guided one-shot talking face generation with a high-resolution audio-visual dataset. In CVPR, 3661\u20133670.","DOI":"10.1109\/CVPR46437.2021.00366"},{"key":"2481_CR69","doi-asserted-by":"crossref","unstructured":"Hang Zhou, Yu., Liu, Ziwei Liu, Luo, Ping, & Wang, Xiaogang. (2019). Talking face generation by adversarially disentangled audio-visual representation. In AAAI, 33, 9299\u20139306.","DOI":"10.1609\/aaai.v33i01.33019299"},{"key":"2481_CR70","doi-asserted-by":"crossref","unstructured":"Zhou, Hang, Sun, Yasheng, Wayne, Wu., Loy, Chen Change, Wang, Xiaogang, & Liu, Ziwei. (2021). Pose-controllable talking face generation by implicitly modularized audio-visual representation. In CVPR, 4176\u20134186.","DOI":"10.1109\/CVPR46437.2021.00416"},{"issue":"6","key":"2481_CR71","first-page":"1","volume":"39","author":"Yang Zhou","year":"2020","unstructured":"Zhou, Yang, Han, Xintong, Shechtman, Eli, Echevarria, Jose, Kalogerakis, Evangelos, & Li, Dingzeyu. (2020). Makelttalk: speaker-aware talking-head animation. ACM TOG, 39(6), 1\u201315.","journal-title":"ACM TOG"},{"key":"2481_CR72","doi-asserted-by":"crossref","unstructured":"Zielonka, Wojciech, Bolkart, Timo, & Thies, Justus. (2023). Instant volumetric head avatars. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 4574\u20134584.","DOI":"10.1109\/CVPR52729.2023.00444"}],"container-title":["International Journal of Computer Vision"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11263-025-02481-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11263-025-02481-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11263-025-02481-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,9]],"date-time":"2025-09-09T07:58:38Z","timestamp":1757404718000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11263-025-02481-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,6]]},"references-count":72,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2025,9]]}},"alternative-id":["2481"],"URL":"https:\/\/doi.org\/10.1007\/s11263-025-02481-9","relation":{},"ISSN":["0920-5691","1573-1405"],"issn-type":[{"value":"0920-5691","type":"print"},{"value":"1573-1405","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,6]]},"assertion":[{"value":"26 April 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 May 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 June 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no relevant financial or non-financial interests to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"Our code is available at: .","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Code availability"}}]}}