{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T19:49:20Z","timestamp":1776887360725,"version":"3.51.2"},"publisher-location":"New York, NY, USA","reference-count":47,"publisher":"ACM","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,10,27]]},"DOI":"10.1145\/3746027.3755286","type":"proceedings-article","created":{"date-parts":[[2025,10,25]],"date-time":"2025-10-25T07:26:51Z","timestamp":1761377211000},"page":"9987-9995","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Disentangle Identity, Cooperate Emotion: Correlation-Aware Emotional Talking Portrait Generation"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-0165-9052","authenticated-orcid":false,"given":"Weipeng","family":"Tan","sequence":"first","affiliation":[{"name":"Fudan University, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-5882-9458","authenticated-orcid":false,"given":"Chuming","family":"Lin","sequence":"additional","affiliation":[{"name":"Tencent, YouTu Lab, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3891-2227","authenticated-orcid":false,"given":"Chengming","family":"Xu","sequence":"additional","affiliation":[{"name":"Tencent, YouTu Lab, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-2256-0179","authenticated-orcid":false,"given":"FeiFan","family":"Xu","sequence":"additional","affiliation":[{"name":"Tencent, YouTu Lab, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5764-3096","authenticated-orcid":false,"given":"Xiaobin","family":"Hu","sequence":"additional","affiliation":[{"name":"Tencent, YouTu Lab, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-1044-5853","authenticated-orcid":false,"given":"Xiaozhong","family":"Ji","sequence":"additional","affiliation":[{"name":"Tencent, YouTu Lab, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5407-5150","authenticated-orcid":false,"given":"Junwei","family":"Zhu","sequence":"additional","affiliation":[{"name":"Tencent, YouTu Lab, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4216-8090","authenticated-orcid":false,"given":"Chengjie","family":"Wang","sequence":"additional","affiliation":[{"name":"Tencent, YouTu Lab, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6595-6893","authenticated-orcid":false,"given":"Yanwei","family":"Fu","sequence":"additional","affiliation":[{"name":"Fudan University, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,10,27]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"crossref","unstructured":"Volker Blanz and Thomas Vetter. 1999. A morphable model for the synthesis of 3D faces. In ACM SIGGRAPH.","DOI":"10.1145\/311535.311556"},{"key":"e_1_3_2_1_2_1","unstructured":"Andreas Blattmann Tim Dockhorn Sumith Kulal Daniel Mendelevitch Maciej Kilian Dominik Lorenz Yam Levi Zion English Vikram Voleti Adam Letts et al. 2023a. Stable video diffusion: Scaling latent video diffusion models to large datasets. arXiv preprint arXiv:2311.15127 (2023)."},{"key":"e_1_3_2_1_3_1","unstructured":"Andreas Blattmann Tim Dockhorn Sumith Kulal Daniel Mendelevitch Maciej Kilian Dominik Lorenz Yam Levi Zion English Vikram Voleti Adam Letts et al. 2023b. Stable video diffusion: Scaling latent video diffusion models to large datasets. arXiv preprint arXiv:2311.15127 (2023)."},{"key":"e_1_3_2_1_4_1","unstructured":"Ting Chen Simon Kornblith Mohammad Norouzi and Geoffrey Hinton. 2020. A simple framework for contrastive learning of visual representations. In ICML."},{"key":"e_1_3_2_1_5_1","volume-title":"Echomimic: Lifelike audio-driven portrait animations through editable landmark conditions. arXiv preprint arXiv:2407.08136","author":"Chen Zhiyuan","year":"2024","unstructured":"Zhiyuan Chen, Jiajiong Cao, Zhiquan Chen, Yuming Li, and Chenguang Ma. 2024. Echomimic: Lifelike audio-driven portrait animations through editable landmark conditions. arXiv preprint arXiv:2407.08136 (2024)."},{"key":"e_1_3_2_1_6_1","volume-title":"Videoretalking: Audio-based lip synchronization for talking head video editing in the wild. In ACM SIGGRAPH Asia.","author":"Cheng Kun","year":"2022","unstructured":"Kun Cheng, Xiaodong Cun, Yong Zhang, Menghan Xia, Fei Yin, Mingrui Zhu, Xuan Wang, Jue Wang, and Nannan Wang. 2022. Videoretalking: Audio-based lip synchronization for talking head video editing in the wild. In ACM SIGGRAPH Asia."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.21437\/interspeech.2018-1929"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-54427-4_19"},{"key":"e_1_3_2_1_9_1","volume-title":"Hallo2: Long-duration and high-resolution audio-driven portrait image animation. arXiv preprint arXiv:2410.07718","author":"Cui Jiahao","year":"2024","unstructured":"Jiahao Cui, Hui Li, Yao Yao, Hao Zhu, Hanlin Shang, Kaihui Cheng, Hang Zhou, Siyu Zhu, and Jingdong Wang. 2024. Hallo2: Long-duration and high-resolution audio-driven portrait image animation. arXiv preprint arXiv:2410.07718 (2024)."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.02069"},{"key":"e_1_3_2_1_11_1","unstructured":"Martin Heusel Hubert Ramsauer Thomas Unterthiner Bernhard Nessler and Sepp Hochreiter. 2017. Gans trained by a two time-scale update rule converge to a local nash equilibrium. In NeurIPS."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52733.2024.00745"},{"key":"e_1_3_2_1_13_1","volume-title":"Sonic: Shifting Focus to Global Audio Perception in Portrait Animation. arXiv preprint arXiv:2411.16331","author":"Ji Xiaozhong","year":"2024","unstructured":"Xiaozhong Ji, Xiaobin Hu, Zhihong Xu, Junwei Zhu, Chuming Lin, Qingdong He, Jiangning Zhang, Donghao Luo, Yi Chen, Qin Lin, et al., 2024. Sonic: Shifting Focus to Global Audio Perception in Portrait Animation. arXiv preprint arXiv:2411.16331 (2024)."},{"key":"e_1_3_2_1_14_1","volume-title":"Eamm: One-shot emotional talking face via audio-based emotion-aware motion model. In ACM SIGGRAPH.","author":"Ji Xinya","year":"2022","unstructured":"Xinya Ji, Hang Zhou, Kaisiyuan Wang, Qianyi Wu, Wayne Wu, Feng Xu, and Xun Cao. 2022. Eamm: One-shot emotional talking face via audio-based emotion-aware motion model. In ACM SIGGRAPH."},{"key":"e_1_3_2_1_15_1","volume-title":"Xun Cao, and Feng Xu.","author":"Ji Xinya","year":"2021","unstructured":"Xinya Ji, Hang Zhou, Kaisiyuan Wang, Wayne Wu, Chen Change Loy, Xun Cao, and Feng Xu. 2021. Audio-driven emotional video portraits. In CVPR."},{"key":"e_1_3_2_1_16_1","volume-title":"Loopy: Taming audio-driven portrait avatar with long-term motion dependency. arXiv preprint arXiv:2409.02634","author":"Jiang Jianwen","year":"2024","unstructured":"Jianwen Jiang, Chao Liang, Jiaqi Yang, Gaojie Lin, Tianyun Zhong, and Yanbo Zheng. 2024. Loopy: Taming audio-driven portrait avatar with long-term motion dependency. arXiv preprint arXiv:2409.02634 (2024)."},{"key":"e_1_3_2_1_17_1","volume-title":"Elucidating the design space of diffusion-based generative models. Advances in neural information processing systems","author":"Karras Tero","year":"2022","unstructured":"Tero Karras, Miika Aittala, Timo Aila, and Samuli Laine. 2022. Elucidating the design space of diffusion-based generative models. Advances in neural information processing systems, Vol. 35 (2022), 26565-26577."},{"key":"e_1_3_2_1_18_1","volume-title":"Adam: A method for stochastic optimization. In ICLR.","author":"Kingma Diederik P","year":"2015","unstructured":"Diederik P Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In ICLR."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"crossref","unstructured":"Borong Liang Yan Pan Zhizhi Guo Hang Zhou Zhibin Hong Xiaoguang Han Junyu Han Jingtuo Liu Errui Ding and Jingdong Wang. 2022. Expressive talking head generation with granular audio-visual control. In CVPR.","DOI":"10.1109\/CVPR52688.2022.00338"},{"key":"e_1_3_2_1_20_1","volume-title":"Styletalk: One-shot talking head generation with controllable speaking styles. In AAAI.","author":"Ma Yifeng","year":"2023","unstructured":"Yifeng Ma, Suzhen Wang, Zhipeng Hu, Changjie Fan, Tangjie Lv, Yu Ding, Zhidong Deng, and Xin Yu. 2023. Styletalk: One-shot talking head generation with controllable speaking styles. In AAAI."},{"key":"e_1_3_2_1_21_1","volume-title":"EarthSynth: Generating Informative Earth Observation with Diffusion Models. arXiv preprint arXiv:2505.12108","author":"Pan Jiancheng","year":"2025","unstructured":"Jiancheng Pan, Shiye Lei, Yuqian Fu, Jiahao Li, Yanxing Liu, Yuze Sun, Xiao He, Long Peng, Xiaomeng Huang, and Bo Zhao. 2025. EarthSynth: Generating Informative Earth Observation with Diffusion Models. arXiv preprint arXiv:2505.12108 (2025)."},{"key":"e_1_3_2_1_22_1","volume-title":"Pytorch: An imperative style, high-performance deep learning library. In NeurIPS.","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al., 2019. Pytorch: An imperative style, high-performance deep learning library. In NeurIPS."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"crossref","unstructured":"KR Prajwal Rudrabha Mukhopadhyay Vinay P Namboodiri and CV Jawahar. 2020. A lip sync expert is all you need for speech to lip generation in the wild. In ACM MM.","DOI":"10.1145\/3394171.3413532"},{"key":"e_1_3_2_1_24_1","volume-title":"Tao Xu, Greg Brockman, Christine McLeavey, and Ilya Sutskever.","author":"Radford Alec","year":"2023","unstructured":"Alec Radford, Jong Wook Kim, Tao Xu, Greg Brockman, Christine McLeavey, and Ilya Sutskever. 2023. Robust speech recognition via large-scale weak supervision. In ICML."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Robin Rombach Andreas Blattmann Dominik Lorenz Patrick Esser and Bj\u00f6rn Ommer. 2022. High-resolution image synthesis with latent diffusion models. In CVPR.","DOI":"10.1109\/CVPR52688.2022.01042"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","unstructured":"Elena Ryumina Denis Dresvyanskiy and Alexey Karpov. 2022. In Search of a Robust Facial Expressions Recognition Model: A Large-Scale Visual Cross-Corpus Study. Neurocomputing (2022). doi:10.1016\/j.neucom.2022.10.013","DOI":"10.1016\/j.neucom.2022.10.013"},{"key":"e_1_3_2_1_27_1","volume-title":"Difftalk: Crafting diffusion models for generalized audio-driven portraits animation. In CVPR.","author":"Shen Shuai","year":"2023","unstructured":"Shuai Shen, Wenliang Zhao, Zibin Meng, Wanhua Li, Zheng Zhu, Jie Zhou, and Jiwen Lu. 2023. Difftalk: Crafting diffusion models for generalized audio-driven portraits animation. In CVPR."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"crossref","unstructured":"Sanjana Sinha Sandika Biswas Ravindra Yadav and Brojeshwar Bhowmick. 2022. Emotion-controllable generalized talking face generation. In IJCAI.","DOI":"10.24963\/ijcai.2022\/184"},{"key":"e_1_3_2_1_29_1","volume-title":"Emo: Emote portrait alive-generating expressive portrait videos with audio2video diffusion model under weak conditions. In ECCV.","author":"Tian Linrui","year":"2024","unstructured":"Linrui Tian, Qi Wang, Bang Zhang, and Liefeng Bo. 2024. Emo: Emote portrait alive-generating expressive portrait videos with audio2video diffusion model under weak conditions. In ECCV."},{"key":"e_1_3_2_1_30_1","volume-title":"ICLR Workshops.","author":"Unterthiner Thomas","year":"2019","unstructured":"Thomas Unterthiner, Sjoerd van Steenkiste, Karol Kurach, Rapha\u00ebl Marinier, Marcin Michalski, and Sylvain Gelly. 2019. FVD: A new metric for video generation. In ICLR Workshops."},{"key":"e_1_3_2_1_31_1","unstructured":"Aaron Van Den Oord Oriol Vinyals et al. 2017. Neural discrete representation learning. Advances in neural information processing systems Vol. 30 (2017)."},{"key":"e_1_3_2_1_32_1","volume-title":"Visualizing data using t-SNE. Journal of machine learning research","author":"der Maaten Laurens Van","year":"2008","unstructured":"Laurens Van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of machine learning research (2008)."},{"key":"e_1_3_2_1_33_1","volume-title":"V-Express: Conditional Dropout for Progressive Training of Portrait Video Generation. arXiv preprint arXiv:2406.02511","author":"Wang Cong","year":"2024","unstructured":"Cong Wang, Kuan Tian, Jun Zhang, Yonghang Guan, Feng Luo, Fei Shen, Zhiwei Jiang, Qing Gu, Xiao Han, and Wei Yang. 2024. V-Express: Conditional Dropout for Progressive Training of Portrait Video Generation. arXiv preprint arXiv:2406.02511 (2024)."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"crossref","unstructured":"Jiadong Wang Xinyuan Qian Malu Zhang Robby T Tan and Haizhou Li. 2023. Seeing What You Said: Talking Face Generation Guided by a Lip Reading Expert. In CVPR.","DOI":"10.1109\/CVPR52729.2023.01408"},{"key":"e_1_3_2_1_35_1","volume-title":"Mead: A large-scale audio-visual dataset for emotional talking-face generation. In ECCV.","author":"Wang Kaisiyuan","year":"2020","unstructured":"Kaisiyuan Wang, Qianyi Wu, Linsen Song, Zhuoqian Yang, Wayne Wu, Chen Qian, Ran He, Yu Qiao, and Chen Change Loy. 2020. Mead: A large-scale audio-visual dataset for emotional talking-face generation. In ECCV."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"crossref","unstructured":"Suzhen Wang Lincheng Li Yu Ding Changjie Fan and Xin Yu. 2021. Audio2head: Audio-driven one-shot talking-head generation with natural head motion. In IJCAI.","DOI":"10.24963\/ijcai.2021\/152"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"crossref","unstructured":"Suzhen Wang Lincheng Li Yu Ding and Xin Yu. 2022. One-shot talking face generation from single-speaker audio-visual correlation learning. In AAAI.","DOI":"10.1609\/aaai.v36i3.20154"},{"key":"e_1_3_2_1_38_1","volume-title":"Aniportrait: Audio-driven synthesis of photorealistic portrait animation. arXiv preprint arXiv:2403.17694","author":"Wei Huawei","year":"2024","unstructured":"Huawei Wei, Zejun Yang, and Zhisheng Wang. 2024. Aniportrait: Audio-driven synthesis of photorealistic portrait animation. arXiv preprint arXiv:2403.17694 (2024)."},{"key":"e_1_3_2_1_39_1","unstructured":"Haozhe Wu Jia Jia Haoyu Wang Yishun Dou Chao Duan and Qingshan Deng. 2021. Imitating arbitrary talking style for realistic audio-driven talking face synthesis. In ACM MM."},{"key":"e_1_3_2_1_40_1","volume-title":"Yuchao Gu, Yufei Shi, Wynne Hsu, Ying Shan, Xiaohu Qie, and Mike Zheng Shou.","author":"Wu Jay Zhangjie","year":"2023","unstructured":"Jay Zhangjie Wu, Yixiao Ge, Xintao Wang, Stan Weixian Lei, Yuchao Gu, Yufei Shi, Wynne Hsu, Ying Shan, Xiaohu Qie, and Mike Zheng Shou. 2023. Tune-a-video: One-shot tuning of image diffusion models for text-to-video generation. In ICCV."},{"key":"e_1_3_2_1_41_1","volume-title":"X-portrait: Expressive portrait animation with hierarchical motion attention. In ACM SIGGRAPH.","author":"Xie You","year":"2024","unstructured":"You Xie, Hongyi Xu, Guoxian Song, Chao Wang, Yichun Shi, and Linjie Luo. 2024. X-portrait: Expressive portrait animation with hierarchical motion attention. In ACM SIGGRAPH."},{"key":"e_1_3_2_1_42_1","volume-title":"Yao Yao, and Siyu Zhu.","author":"Xu Mingwang","year":"2024","unstructured":"Mingwang Xu, Hui Li, Qingkun Su, Hanlin Shang, Liwei Zhang, Ce Liu, Jingdong Wang, Luc Van Gool, Yao Yao, and Siyu Zhu. 2024. Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animation. arXiv preprint arXiv:2406.08801 (2024)."},{"key":"e_1_3_2_1_43_1","volume-title":"MegActor: Harness the Power of Raw Video for Vivid Portrait Animation. arXiv preprint arXiv:2405.20851","author":"Yang Shurong","year":"2024","unstructured":"Shurong Yang, Huadong Li, Juhao Wu, Minhao Jing, Linze Li, Renhe Ji, Jiajun Liang, and Haoqiang Fan. 2024. MegActor: Harness the Power of Raw Video for Vivid Portrait Animation. arXiv preprint arXiv:2405.20851 (2024)."},{"key":"e_1_3_2_1_44_1","volume-title":"Sadtalker: Learning realistic 3d motion coefficients for stylized audio-driven single image talking face animation. In CVPR.","author":"Zhang Wenxuan","year":"2023","unstructured":"Wenxuan Zhang, Xiaodong Cun, Xuan Wang, Yong Zhang, Xi Shen, Yu Guo, Ying Shan, and Fei Wang. 2023. Sadtalker: Learning realistic 3d motion coefficients for stylized audio-driven single image talking face animation. In CVPR."},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"crossref","unstructured":"Zhimeng Zhang Lincheng Li Yu Ding and Changjie Fan. 2021. Flow-guided one-shot talking face generation with a high-resolution audio-visual dataset. In CVPR.","DOI":"10.1109\/CVPR46437.2021.00366"},{"key":"e_1_3_2_1_46_1","volume-title":"Xiaogang Wang, and Ziwei Liu.","author":"Zhou Hang","year":"2021","unstructured":"Hang Zhou, Yasheng Sun, Wayne Wu, Chen Change Loy, Xiaogang Wang, and Ziwei Liu. 2021. Pose-controllable talking face generation by implicitly modularized audio-visual representation. In CVPR."},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417774"}],"event":{"name":"MM '25: The 33rd ACM International Conference on Multimedia","location":"Dublin Ireland","acronym":"MM '25","sponsor":["SIGMM ACM Special Interest Group on Multimedia"]},"container-title":["Proceedings of the 33rd ACM International Conference on Multimedia"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3746027.3755286","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,10]],"date-time":"2025-12-10T04:07:56Z","timestamp":1765339676000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3746027.3755286"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,27]]},"references-count":47,"alternative-id":["10.1145\/3746027.3755286","10.1145\/3746027"],"URL":"https:\/\/doi.org\/10.1145\/3746027.3755286","relation":{},"subject":[],"published":{"date-parts":[[2025,10,27]]},"assertion":[{"value":"2025-10-27","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}