{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T11:30:27Z","timestamp":1775129427503,"version":"3.50.1"},"reference-count":65,"publisher":"World Scientific Pub Co Pte Ltd","issue":"02","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["U20A20174"],"award-info":[{"award-number":["U20A20174"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100017594","name":"Medical Science and Technology Project of Zhejiang Province","doi-asserted-by":"publisher","award":["2015TP1004"],"award-info":[{"award-number":["2015TP1004"]}],"id":[{"id":"10.13039\/501100017594","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100018557","name":"Science and Technology Project of Nantong City","doi-asserted-by":"publisher","award":["kh2103003"],"award-info":[{"award-number":["kh2103003"]}],"id":[{"id":"10.13039\/501100018557","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Comp. Intel. Appl."],"published-print":{"date-parts":[[2024,6]]},"abstract":"<jats:p> Realistic co-speech gestures are important to anthropomorphize ECAs, as nonverbal behavior improves expressiveness of their speech greatly. However, the existing approaches to generating co-speech gestures with sufficient details (including fingers, etc.) in 3D scenarios are indeed rare. Additionally, they hardly address the problem of abnormal gestures, temporal\u2013spatial coherence and diversity of gesture sequences comprehensively. To handle abnormal gesture issues, we put forward an angle conversion method to remove body part length from the original in-the-wild video dataset via transferring coordinates of human upper body key points into relative deflection angles and pitch angles. We also propose a neural network called HARP with encoder\u2013decoder architecture to transfer MFCC featured speech audio into aforementioned angles on the basis of CNN and LSTM. The angles then can be rendered as corresponding co-speech gestures. Compared with the other latest approaches, the co-speech gestures generated by HARP are proved to be almost as good as the real person, i.e., they have strong temporal\u2013spatial coherence, diversity, persuasiveness and credibility. Our approach puts finer control on co-speech gestures than most of the existing works by handling all key points of the human upper body. It is more feasible for industrial application, since HARP can be adaptive to any human upper body model. All related code and evidence videos of HARP can be accessed at https:\/\/github.com\/drrobincroft\/HARP . <\/jats:p>","DOI":"10.1142\/s1469026824500068","type":"journal-article","created":{"date-parts":[[2024,4,25]],"date-time":"2024-04-25T07:30:25Z","timestamp":1714030225000},"source":"Crossref","is-referenced-by-count":1,"title":["An Angle-Oriented Approach to Transferring Speech to Gesture for Highly Anthropomorphized Embodied Conversational Agents"],"prefix":"10.1142","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6857-0155","authenticated-orcid":false,"given":"Jiwei","family":"Liu","sequence":"first","affiliation":[{"name":"College of Computer Science and Electronic Engineering, Hunan University, Yuelushan, Changsha 410082, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0877-3887","authenticated-orcid":false,"given":"Zheng","family":"Qin","sequence":"additional","affiliation":[{"name":"College of Computer Science and Electronic Engineering, Hunan University, Yuelushan, Changsha 410082, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8487-0561","authenticated-orcid":false,"given":"Zixing","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Computer Science and Electronic Engineering, Hunan University, Yuelushan, Changsha 410082, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6890-8953","authenticated-orcid":false,"given":"Jixin","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Computer Science, Hubei University of Technology, Road Nanli, Wuhan 430068, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2024,4,25]]},"reference":[{"key":"S1469026824500068BIB001","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2022.107368"},{"issue":"6","key":"S1469026824500068BIB002","first-page":"e25891","volume":"9","author":"Stara V.","year":"2021","journal-title":"JMIR mHealth uHealth"},{"key":"S1469026824500068BIB003","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.6553"},{"key":"S1469026824500068BIB004","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-020-00680-7"},{"key":"S1469026824500068BIB005","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-017-0784-6"},{"key":"S1469026824500068BIB006","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00955"},{"key":"S1469026824500068BIB007","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073699"},{"key":"S1469026824500068BIB008","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-25090-3_9"},{"key":"S1469026824500068BIB009","doi-asserted-by":"publisher","DOI":"10.1007\/s11423-016-9476-z"},{"key":"S1469026824500068BIB010","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4020-6710-5_3"},{"key":"S1469026824500068BIB011","doi-asserted-by":"publisher","DOI":"10.1631\/FITEE.1700826"},{"key":"S1469026824500068BIB012","doi-asserted-by":"publisher","DOI":"10.1145\/365153.365168"},{"key":"S1469026824500068BIB013","volume-title":"Artificial Paranoia: A Computer Simulation of Paranoid Processes","author":"Colby K. M.","year":"2013"},{"key":"S1469026824500068BIB014","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4020-6710-5_13"},{"key":"S1469026824500068BIB015","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/2697.001.0001"},{"key":"S1469026824500068BIB018","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"S1469026824500068BIB019","doi-asserted-by":"publisher","DOI":"10.1145\/2736277.2741667"},{"key":"S1469026824500068BIB020","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2017.2741510"},{"key":"S1469026824500068BIB021","doi-asserted-by":"publisher","DOI":"10.1016\/j.csl.2017.12.003"},{"key":"S1469026824500068BIB022","doi-asserted-by":"publisher","DOI":"10.1002\/9781119992691"},{"key":"S1469026824500068BIB023","doi-asserted-by":"publisher","DOI":"10.1002\/9781119992691.ch3"},{"key":"S1469026824500068BIB024","doi-asserted-by":"publisher","DOI":"10.1145\/3382507.3418815"},{"key":"S1469026824500068BIB025","doi-asserted-by":"publisher","DOI":"10.1145\/3395208"},{"key":"S1469026824500068BIB026","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566594"},{"key":"S1469026824500068BIB027","first-page":"5180","volume-title":"Proc. Int. Conf. Machine Learning, PMLR","author":"Wang Y.","year":"2018"},{"key":"S1469026824500068BIB028","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00121"},{"issue":"4","key":"S1469026824500068BIB029","first-page":"1","volume":"37","author":"Sha T.","year":"2021","journal-title":"ACM Comput. Surv."},{"key":"S1469026824500068BIB030","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01234-2_32"},{"key":"S1469026824500068BIB031","author":"Eskimez S. E.","year":"2021","journal-title":"IEEE Trans. Multimedia"},{"key":"S1469026824500068BIB032","doi-asserted-by":"publisher","DOI":"10.1145\/3394171.3413532"},{"key":"S1469026824500068BIB034","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-019-01251-8"},{"issue":"6","key":"S1469026824500068BIB035","first-page":"1","volume":"39","author":"Zhou Y.","year":"2020","journal-title":"ACM Trans. Graph."},{"key":"S1469026824500068BIB036","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01034"},{"key":"S1469026824500068BIB038","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00573"},{"key":"S1469026824500068BIB039","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459936"},{"key":"S1469026824500068BIB040","doi-asserted-by":"publisher","DOI":"10.1145\/3478513.3480484"},{"key":"S1469026824500068BIB041","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i3.16286"},{"key":"S1469026824500068BIB042","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2019.8793720"},{"key":"S1469026824500068BIB043","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511807572"},{"key":"S1469026824500068BIB044","doi-asserted-by":"publisher","DOI":"10.1007\/s10919-008-0063-9"},{"key":"S1469026824500068BIB045","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2018.07.006"},{"key":"S1469026824500068BIB046","doi-asserted-by":"publisher","DOI":"10.1016\/j.specom.2019.04.005"},{"key":"S1469026824500068BIB047","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2022.3149173"},{"key":"S1469026824500068BIB048","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00790"},{"key":"S1469026824500068BIB049","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00361"},{"key":"S1469026824500068BIB050","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417838"},{"key":"S1469026824500068BIB051","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2020.09.009"},{"key":"S1469026824500068BIB052","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58523-5_15"},{"key":"S1469026824500068BIB053","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.01110"},{"key":"S1469026824500068BIB054","doi-asserted-by":"publisher","DOI":"10.1177\/002383099403700208"},{"key":"S1469026824500068BIB055","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-2958.1990.tb00229.x"},{"key":"S1469026824500068BIB056","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-70022-9_33"},{"key":"S1469026824500068BIB057","volume-title":"Gesture Generation by Imitation: From Human Behavior to Computer Character Animation","author":"Kipp M.","year":"2005"},{"key":"S1469026824500068BIB058","doi-asserted-by":"publisher","DOI":"10.1007\/11821830_17"},{"key":"S1469026824500068BIB059","doi-asserted-by":"publisher","DOI":"10.1075\/gest.12.1.04hos"},{"key":"S1469026824500068BIB060","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2018.2798607"},{"key":"S1469026824500068BIB061","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.01089"},{"key":"S1469026824500068BIB062","doi-asserted-by":"publisher","DOI":"10.1145\/3472306.3478335"},{"key":"S1469026824500068BIB063","volume-title":"Gesture and Speech in Interaction: An Overview","author":"Wagner P.","year":"2014"},{"key":"S1469026824500068BIB064","first-page":"2","volume-title":"IEEE Int. Conf. Acoustics, Speech and Signal Processing","author":"Lamere P.","year":"2003"},{"key":"S1469026824500068BIB065","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"S1469026824500068BIB066","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1988.10478639"},{"key":"S1469026824500068BIB067","doi-asserted-by":"publisher","DOI":"10.1145\/3474085.3475223"},{"key":"S1469026824500068BIB068","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01021"},{"key":"S1469026824500068BIB069","doi-asserted-by":"publisher","DOI":"10.1109\/3DV.2019.00084"}],"container-title":["International Journal of Computational Intelligence and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S1469026824500068","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,27]],"date-time":"2024-06-27T04:07:23Z","timestamp":1719461243000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S1469026824500068"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,25]]},"references-count":65,"journal-issue":{"issue":"02","published-print":{"date-parts":[[2024,6]]}},"alternative-id":["10.1142\/S1469026824500068"],"URL":"https:\/\/doi.org\/10.1142\/s1469026824500068","relation":{},"ISSN":["1469-0268","1757-5885"],"issn-type":[{"value":"1469-0268","type":"print"},{"value":"1757-5885","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,25]]},"article-number":"2450006"}}