{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:08:51Z","timestamp":1750219731890,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":39,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,10,29]],"date-time":"2023-10-29T00:00:00Z","timestamp":1698537600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,10,29]]},"DOI":"10.1145\/3607541.3616820","type":"proceedings-article","created":{"date-parts":[[2023,10,17]],"date-time":"2023-10-17T22:10:31Z","timestamp":1697580631000},"page":"137-143","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Responsive Listening Head Synthesis with 3DMM and Dual-Stream Prediction Network"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3197-8103","authenticated-orcid":false,"given":"Jun","family":"Yu","sequence":"first","affiliation":[{"name":"University of Science and Technology of China, Hefei, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2683-3313","authenticated-orcid":false,"given":"Shenshen","family":"Du","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, Hefei, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-2655-6098","authenticated-orcid":false,"given":"Haoxiang","family":"Shi","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, Hefei, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-5405-1673","authenticated-orcid":false,"given":"Yiwei","family":"Zhang","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, Hefei, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-7408-6962","authenticated-orcid":false,"given":"Renbin","family":"Su","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, Hefei, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2540-3215","authenticated-orcid":false,"given":"Zhongpeng","family":"Cai","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, Hefei, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5181-3384","authenticated-orcid":false,"given":"Lei","family":"Wang","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, Hefei, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,10,29]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"German Barquero Johnny N\u00fanez Zhen Xu Sergio Escalera Wei-Wei Tu Isabelle Guyon and Cristina Palmero. 2022. Comparison of Spatio-Temporal Models for Human Motion and Pose Forecasting in Face-to-Face Interaction Scenarios Supplementary Material. (2022).  German Barquero Johnny N\u00fanez Zhen Xu Sergio Escalera Wei-Wei Tu Isabelle Guyon and Cristina Palmero. 2022. Comparison of Spatio-Temporal Models for Human Motion and Pose Forecasting in Face-to-Face Interaction Scenarios Supplementary Material. (2022)."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311556"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1891903.1891910"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1109\/TVCG.2013.249","article-title":"Facewarehouse: A 3d facial expression database for visual computing","volume":"20","author":"Cao Chen","year":"2013","unstructured":"Chen Cao , Yanlin Weng , Shun Zhou , Yiying Tong , and Kun Zhou . 2013 . Facewarehouse: A 3d facial expression database for visual computing . IEEE Transactions on Visualization and Computer Graphics , Vol. 20 , 3 (2013), 413 -- 425 . Chen Cao, Yanlin Weng, Shun Zhou, Yiying Tong, and Kun Zhou. 2013. Facewarehouse: A 3d facial expression database for visual computing. IEEE Transactions on Visualization and Computer Graphics, Vol. 20, 3 (2013), 413--425.","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"key":"e_1_3_2_1_5_1","volume-title":"You said that? arXiv preprint arXiv:1705.02966","author":"Chung Joon Son","year":"2017","unstructured":"Joon Son Chung , Amir Jamaludin , and Andrew Zisserman . 2017. You said that? arXiv preprint arXiv:1705.02966 ( 2017 ). Joon Son Chung, Amir Jamaludin, and Andrew Zisserman. 2017. You said that? arXiv preprint arXiv:1705.02966 (2017)."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2019.00038"},{"key":"e_1_3_2_1_7_1","volume-title":"Finding structure in time. Cognitive science","author":"Elman Jeffrey L","year":"1990","unstructured":"Jeffrey L Elman . 1990. Finding structure in time. Cognitive science , Vol. 14 , 2 ( 1990 ), 179--211. Jeffrey L Elman. 1990. Finding structure in time. Cognitive science, Vol. 14, 2 (1990), 179--211."},{"key":"e_1_3_2_1_8_1","volume-title":"Affective Faces for Goal-Driven Dyadic Communication. arXiv preprint arXiv:2301.10939","author":"Geng Scott","year":"2023","unstructured":"Scott Geng , Revant Teotia , Purva Tendulkar , Sachit Menon , and Carl Vondrick . 2023. Affective Faces for Goal-Driven Dyadic Communication. arXiv preprint arXiv:2301.10939 ( 2023 ). Scott Geng, Revant Teotia, Purva Tendulkar, Sachit Menon, and Carl Vondrick. 2023. Affective Faces for Goal-Driven Dyadic Communication. arXiv preprint arXiv:2301.10939 (2023)."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_2_1_10_1","volume-title":"Gans trained by a two time-scale update rule converge to a local nash equilibrium. Advances in neural information processing systems","author":"Heusel Martin","year":"2017","unstructured":"Martin Heusel , Hubert Ramsauer , Thomas Unterthiner , Bernhard Nessler , and Sepp Hochreiter . 2017. Gans trained by a two time-scale update rule converge to a local nash equilibrium. Advances in neural information processing systems , Vol. 30 ( 2017 ). Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. 2017. Gans trained by a two time-scale update rule converge to a local nash equilibrium. Advances in neural information processing systems , Vol. 30 (2017)."},{"key":"e_1_3_2_1_11_1","volume-title":"Long short-term memory. Neural computation","author":"Hochreiter Sepp","year":"1997","unstructured":"Sepp Hochreiter and J\u00fcrgen Schmidhuber . 1997. Long short-term memory. Neural computation , Vol. 9 , 8 ( 1997 ), 1735--1780. Sepp Hochreiter and J\u00fcrgen Schmidhuber. 1997. Long short-term memory. Neural computation, Vol. 9, 8 (1997), 1735--1780."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.01386"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073658"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00453"},{"key":"e_1_3_2_1_15_1","volume-title":"Understanding convolutional neural networks. arXiv preprint arXiv:1605.09081","author":"Koushik Jayanth","year":"2016","unstructured":"Jayanth Koushik . 2016. Understanding convolutional neural networks. arXiv preprint arXiv:1605.09081 ( 2016 ). Jayanth Koushik. 2016. Understanding convolutional neural networks. arXiv preprint arXiv:1605.09081 (2016)."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.113"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i3.16286"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130813"},{"key":"e_1_3_2_1_19_1","volume-title":"7th International Conference on Learning Representations, ICLR","author":"Loshchilov I","year":"2019","unstructured":"I Loshchilov and F Hutter . 2019 . \" Decoupled Weight Decay Regularization \", 7th International Conference on Learning Representations, ICLR . New Orleans, LA, USA, May 6--9 (2019), 2019. I Loshchilov and F Hutter. 2019. \" Decoupled Weight Decay Regularization\", 7th International Conference on Learning Representations, ICLR. New Orleans, LA, USA, May 6--9 (2019), 2019."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.01357"},{"key":"e_1_3_2_1_21_1","volume-title":"Voice recognition algorithms using mel frequency cepstral coefficient (MFCC) and dynamic time warping (DTW) techniques. arXiv preprint arXiv:1003.4083","author":"Muda Lindasalwa","year":"2010","unstructured":"Lindasalwa Muda , Mumtaj Begam , and Irraivan Elamvazuthi . 2010. Voice recognition algorithms using mel frequency cepstral coefficient (MFCC) and dynamic time warping (DTW) techniques. arXiv preprint arXiv:1003.4083 ( 2010 ). Lindasalwa Muda, Mumtaj Begam, and Irraivan Elamvazuthi. 2010. Voice recognition algorithms using mel frequency cepstral coefficient (MFCC) and dynamic time warping (DTW) techniques. arXiv preprint arXiv:1003.4083 (2010)."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2011.2131660"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01975"},{"key":"e_1_3_2_1_24_1","volume-title":"Albert Clap\u00e9s, Johnny N\u00fanez, David Curto, Sorina Smeureanu, Javier Selva, Zejian Zhang, David Saeteros, et al.","author":"Palmero Cristina","year":"2022","unstructured":"Cristina Palmero , German Barquero , Julio CS Jacques Junior , Albert Clap\u00e9s, Johnny N\u00fanez, David Curto, Sorina Smeureanu, Javier Selva, Zejian Zhang, David Saeteros, et al. 2022 . Chalearn LAP challenges on self-reported personality recognition and non-verbal behavior forecasting during social dyadic interactions: Dataset, design, and results. In Understanding Social Behavior in Dyadic and Small Group Interactions . PMLR, 4--52. Cristina Palmero, German Barquero, Julio CS Jacques Junior, Albert Clap\u00e9s, Johnny N\u00fanez, David Curto, Sorina Smeureanu, Javier Selva, Zejian Zhang, David Saeteros, et al. 2022. Chalearn LAP challenges on self-reported personality recognition and non-verbal behavior forecasting during social dyadic interactions: Dataset, design, and results. In Understanding Social Behavior in Dyadic and Small Group Interactions. PMLR, 4--52."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394171.3413532"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.01350"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00121"},{"key":"e_1_3_2_1_28_1","volume-title":"Learning person-specific cognition from facial reactions for automatic personality recognition","author":"Song Siyang","year":"2022","unstructured":"Siyang Song , Zilong Shao , Shashank Jaiswal , Linlin Shen , Michel Valstar , and Hatice Gunes . 2022a. Learning person-specific cognition from facial reactions for automatic personality recognition . IEEE Transactions on Affective Computing ( 2022 ). Siyang Song, Zilong Shao, Shashank Jaiswal, Linlin Shen, Michel Valstar, and Hatice Gunes. 2022a. Learning person-specific cognition from facial reactions for automatic personality recognition. IEEE Transactions on Affective Computing (2022)."},{"key":"e_1_3_2_1_29_1","volume-title":"Gratis: Deep learning graph representation with task-specific topology and multi-dimensional edge features. arXiv preprint arXiv:2211.12482","author":"Song Siyang","year":"2022","unstructured":"Siyang Song , Yuxin Song , Cheng Luo , Zhiyuan Song , Selim Kuzucu , Xi Jia , Zhijiang Guo , Weicheng Xie , Linlin Shen , and Hatice Gunes . 2022 b. Gratis: Deep learning graph representation with task-specific topology and multi-dimensional edge features. arXiv preprint arXiv:2211.12482 (2022). Siyang Song, Yuxin Song, Cheng Luo, Zhiyuan Song, Selim Kuzucu, Xi Jia, Zhijiang Guo, Weicheng Xie, Linlin Shen, and Hatice Gunes. 2022b. Gratis: Deep learning graph representation with task-specific topology and multi-dimensional edge features. arXiv preprint arXiv:2211.12482 (2022)."},{"key":"e_1_3_2_1_30_1","volume-title":"Dropout: a simple way to prevent neural networks from overfitting. The journal of machine learning research","author":"Srivastava Nitish","year":"2014","unstructured":"Nitish Srivastava , Geoffrey Hinton , Alex Krizhevsky , Ilya Sutskever , and Ruslan Salakhutdinov . 2014. Dropout: a simple way to prevent neural networks from overfitting. The journal of machine learning research , Vol. 15 , 1 ( 2014 ), 1929--1958. Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: a simple way to prevent neural networks from overfitting. The journal of machine learning research , Vol. 15, 1 (2014), 1929--1958."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3072959.3073699","article-title":"A deep learning approach for generalized speech animation","volume":"36","author":"Taylor Sarah","year":"2017","unstructured":"Sarah Taylor , Taehwan Kim , Yisong Yue , Moshe Mahler , James Krahe , Anastasio Garcia Rodriguez , Jessica Hodgins , and Iain Matthews . 2017 . A deep learning approach for generalized speech animation . ACM Transactions On Graphics (TOG) , Vol. 36 , 4 (2017), 1 -- 11 . Sarah Taylor, Taehwan Kim, Yisong Yue, Moshe Mahler, James Krahe, Anastasio Garcia Rodriguez, Jessica Hodgins, and Iain Matthews. 2017. A deep learning approach for generalized speech animation. ACM Transactions On Graphics (TOG) , Vol. 36, 4 (2017), 1--11.","journal-title":"ACM Transactions On Graphics (TOG)"},{"key":"e_1_3_2_1_32_1","unstructured":"Nguyen Tan Viet Tuyen and Oya Celiktutan. 2022. Context-aware human behaviour forecasting in dyadic interactions. In Understanding Social Behavior in Dyadic and Small Group Interactions. PMLR 88--106.  Nguyen Tan Viet Tuyen and Oya Celiktutan. 2022. Context-aware human behaviour forecasting in dyadic interactions. In Understanding Social Behavior in Dyadic and Small Group Interactions. PMLR 88--106."},{"key":"e_1_3_2_1_33_1","volume-title":"Attention is all you need. Advances in neural information processing systems","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan N Gomez , \u0141ukasz Kaiser , and Illia Polosukhin . 2017. Attention is all you need. Advances in neural information processing systems , Vol. 30 ( 2017 ). Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems , Vol. 30 (2017)."},{"key":"e_1_3_2_1_34_1","volume-title":"The evolution of video quality measurement: From PSNR to hybrid metrics","author":"Winkler Stefan","year":"2008","unstructured":"Stefan Winkler and Praveen Mohandas . 2008. The evolution of video quality measurement: From PSNR to hybrid metrics . IEEE transactions on Broadcasting , Vol. 54 , 3 ( 2008 ), 660--668. Stefan Winkler and Praveen Mohandas. 2008. The evolution of video quality measurement: From PSNR to hybrid metrics. IEEE transactions on Broadcasting , Vol. 54, 3 (2008), 660--668."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3474085.3475280"},{"key":"e_1_3_2_1_36_1","volume-title":"Audio-driven talking face video generation with learning-based personalized head pose. arXiv preprint arXiv:2002.10137","author":"Yi Ran","year":"2020","unstructured":"Ran Yi , Zipeng Ye , Juyong Zhang , Hujun Bao , and Yong-Jin Liu . 2020. Audio-driven talking face video generation with learning-based personalized head pose. arXiv preprint arXiv:2002.10137 ( 2020 ). Ran Yi, Zipeng Ye, Juyong Zhang, Hujun Bao, and Yong-Jin Liu. 2020. Audio-driven talking face video generation with learning-based personalized head pose. arXiv preprint arXiv:2002.10137 (2020)."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.00836"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-19839-7_8"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3414685.3417774","article-title":"Makelttalk: speaker-aware talking-head animation","volume":"39","author":"Zhou Yang","year":"2020","unstructured":"Yang Zhou , Xintong Han , Eli Shechtman , Jose Echevarria , Evangelos Kalogerakis , and Dingzeyu Li . 2020 . Makelttalk: speaker-aware talking-head animation . ACM Transactions On Graphics (TOG) , Vol. 39 , 6 (2020), 1 -- 15 . io Yang Zhou, Xintong Han, Eli Shechtman, Jose Echevarria, Evangelos Kalogerakis, and Dingzeyu Li. 2020. Makelttalk: speaker-aware talking-head animation. ACM Transactions On Graphics (TOG) , Vol. 39, 6 (2020), 1--15. io","journal-title":"ACM Transactions On Graphics (TOG)"}],"event":{"name":"MM '23: The 31st ACM International Conference on Multimedia","sponsor":["SIGMM ACM Special Interest Group on Multimedia"],"location":"Ottawa ON Canada","acronym":"MM '23"},"container-title":["Proceedings of the 1st International Workshop on Multimedia Content Generation and Evaluation: New Methods and Practice"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3607541.3616820","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3607541.3616820","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:36:28Z","timestamp":1750178188000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3607541.3616820"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,29]]},"references-count":39,"alternative-id":["10.1145\/3607541.3616820","10.1145\/3607541"],"URL":"https:\/\/doi.org\/10.1145\/3607541.3616820","relation":{},"subject":[],"published":{"date-parts":[[2023,10,29]]},"assertion":[{"value":"2023-10-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}