{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,25]],"date-time":"2026-07-25T20:15:32Z","timestamp":1785010532769,"version":"3.55.0"},"reference-count":39,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2021,3,22]],"date-time":"2021-03-22T00:00:00Z","timestamp":1616371200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>In this paper, we propose a new data-driven framework for 3D hand and full-body motion emotion transfer. Specifically, we formulate the motion synthesis task as an image-to-image translation problem. By presenting a motion sequence as an image representation, the emotion can be transferred by our framework using StarGAN. To evaluate our proposed method\u2019s effectiveness, we first conducted a user study to validate the perceived emotion from the captured and synthesized hand motions. We further evaluate the synthesized hand and full body motions qualitatively and quantitatively. Experimental results show that our synthesized motions are comparable to the captured motions and those created by an existing method in terms of naturalness and visual quality.<\/jats:p>","DOI":"10.3390\/computers10030038","type":"journal-article","created":{"date-parts":[[2021,3,22]],"date-time":"2021-03-22T11:13:26Z","timestamp":1616411606000},"page":"38","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Emotion Transfer for 3D Hand and Full Body Motion Using StarGAN"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6180-9853","authenticated-orcid":false,"given":"Jacky C. P.","family":"Chan","sequence":"first","affiliation":[{"name":"Department of Computer Science, Hong Kong Baptist University, Hong Kong, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5862-106X","authenticated-orcid":false,"given":"Edmond S. L.","family":"Ho","sequence":"additional","affiliation":[{"name":"Department of Computer and Information Sciences, Northumbria University, Newcastle upon Tyne NE1 8ST, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,3,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Karras, T., Aila, T., Laine, S., Herva, A., and Lehtinen, J. (2017). Audio-Driven Facial Animation by Joint End-to-End Learning of Pose and Emotion. ACM Trans. Graph., 36.","DOI":"10.1145\/3072959.3073658"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"741","DOI":"10.1016\/j.chb.2010.10.018","article-title":"Facial expression of emotion and perception of the Uncanny Valley in virtual characters","volume":"27","author":"Tinwell","year":"2011","journal-title":"Comput. Hum. Behav."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1007\/s12193-013-0124-1","article-title":"MARC: A framework that features emotion models for facial animation during human\u2014Computer interaction","volume":"7","author":"Courgeon","year":"2013","journal-title":"J. Multimodal User Interfaces"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1111\/1467-8659.t01-1-00645","article-title":"Emotion Disc and Emotion Squares: Tools to Explore the Facial Expression Space","volume":"22","author":"Ruttkay","year":"2003","journal-title":"Comput. Graph. Forum"},{"key":"ref_5","unstructured":"Ritsos, P.D., and Xu, K. (2020). Emotion Transfer for 3D Hand Motion using StarGAN. Computer Graphics and Visual Computing (CGVC), The Eurographics Association."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Wang, Y., Tree, J.E.F., Walker, M., and Neff, M. (2016). Assessing the Impact of Hand Motion on Virtual Character Personality. ACM Trans. Appl. Percept., 13.","DOI":"10.1145\/2874357"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"J\u00f6rg, S., Hodgins, J., and Safonova, A. (2012). Data-Driven Finger Motion Synthesis for Gesturing Characters. ACM Trans. Graph., 31.","DOI":"10.1145\/2366145.2366208"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"41:1","DOI":"10.1145\/2185520.2185537","article-title":"Synthesis of Detailed Hand Manipulations Using Contact Sampling","volume":"31","author":"Ye","year":"2012","journal-title":"ACM Trans. Graph."},{"key":"ref_9","unstructured":"Liu, C.K. (2008, January 7\u20139). Synthesis of Interactive Hand Manipulation. Proceedings of the 2008 ACM SIGGRAPH\/Eurographics Symposium on Computer Animation, SCA \u201908, Aire-la-Ville, Switzerland."},{"key":"ref_10","unstructured":"Andrews, S., and Kry, P.G. (2012, January 9\u201323). Policies for Goal Directed Multi-Finger Manipulation. Proceedings of the VRIPHYS 2012: 9th Workshop on Virtual Reality Interaction and Physical Simulation, Darmstadt, Germany."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Liu, C.K. (2009, January 1\u20132). Dextrous Manipulation from a Grasping Pose. Proceedings of the ACM SIGGRAPH 2009 Papers, SIGGRAPH\u201909, New York, NY, USA.","DOI":"10.1145\/1576246.1531365"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Bai, Y., and Liu, C.K. (June, January 31). Dexterous manipulation using both palm and fingers. Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6907059"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Alexanderson, S., O\u2019Sullivan, C., and Beskow, J. (2016). Robust online motion capture labeling of finger markers. Proceedings of the 9th International Conference on Motion in Games, ACM.","DOI":"10.1145\/2994258.2994264"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Han, S., Liu, B., Wang, R., Ye, Y., Twigg, C.D., and Kin, K. (2018). Online Optical Marker-Based Hand Tracking with Deep Labels. ACM Trans. Graph., 37.","DOI":"10.1145\/3197517.3201399"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Irimia, A.S., Chan, J.C.P., Mistry, K., Wei, W., and Ho, E.S.L. (2019). Emotion Transfer for Hand Animation. MIG \u201919: Motion, Interaction and Games, ACM.","DOI":"10.1145\/3359566.3364692"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Wheatland, N., J\u00f6rg, S., and Zordan, V. (2013). Automatic Hand-Over Animation Using Principle Component Analysis. Proceedings of the Motion on Games, Association for Computing Machinery.","DOI":"10.1145\/2522628.2522656"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Unuma, M., Anjyo, K., and Takeuchi, R. (1995). Fourier Principles for Emotion-based Human Figure Animation. Proceedings of the 22Nd Annual Conference on Computer Graphics and Interactive Techniques, ACM.","DOI":"10.1145\/218380.218419"},{"key":"ref_18","unstructured":"Amaya, K., Bruderlin, A., and Calvert, T. (1996, January 22\u201324). Emotion from Motion. Proceedings of the Conference on Graphics Interface \u201996, Toronto, ON, Canada."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Brand, M., and Hertzmann, A. (2000, January 23\u201328). Style machines. Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, Orleans, LA, USA.","DOI":"10.1145\/344779.344865"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"799","DOI":"10.1111\/j.1467-8659.2004.00809.x","article-title":"Style-based motion synthesis","volume":"Volume 23","author":"Urtasun","year":"2004","journal-title":"Computer Graphics Forum"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1477926.1477927","article-title":"Generalizing motion edits with gaussian processes","volume":"28","author":"Ikemoto","year":"2009","journal-title":"ACM Trans. Graph. Tog"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2766999","article-title":"Realtime style transfer for unlabeled heterogeneous human motion","volume":"34","author":"Xia","year":"2015","journal-title":"Acm Trans. Graph. Tog"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Hsu, E., Pulli, K., and Popovi\u0107, J. (2015, January 9\u201313). Style Translation for Human Motion. Proceedings of the ACM SIGGRAPH 2005 Papers, Los Angeles, CA, USA.","DOI":"10.1145\/1186822.1073315"},{"key":"ref_24","unstructured":"Shapiro, A., Cao, Y., and Faloutsos, P. (2006, January 7\u20139). Style Components. Proceedings of the Graphics Interface 2006, Toronto, ON, Canada."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1109\/MCG.2017.3271464","article-title":"Fast Neural Style Transfer for Motion Data","volume":"37","author":"Holden","year":"2017","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_26","unstructured":"Smith, H.J., Cao, C., Neff, M., and Wang, Y. (August, January 28). Efficient Neural Networks for Real-Time Motion Style Transfer. Proceedings of the International Conference on Computer Graphics and Interactive Techniques, Los Angeles, CA, USA."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Lee, S.J., and Popovi\u0107, Z. (2010). Learning Behavior Styles with Inverse Reinforcement Learning. ACM Trans. Graph., 29.","DOI":"10.1145\/1833351.1778859"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"129:1","DOI":"10.1145\/2897824.2925968","article-title":"Painting Style Transfer for Head Portraits Using Convolutional Neural Networks","volume":"35","author":"Selim","year":"2016","journal-title":"ACM Trans. Graph."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2338","DOI":"10.1109\/TIP.2017.2678168","article-title":"Style Transfer Via Texture Synthesis","volume":"26","author":"Elad","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Matsuo, S., Shimoda, W., and Yanai, K. (2017, January 10\u201314). Partial style transfer using weakly supervised semantic segmentation. Proceedings of the 2017 IEEE International Conference on Multimedia Expo Workshops (ICMEW), Hong Kong, China.","DOI":"10.1109\/ICMEW.2017.8026228"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"134","DOI":"10.3758\/BF03192758","article-title":"A motion capture library for the study of identity, gender, and emotion perception from biological motion","volume":"38","author":"Ma","year":"2006","journal-title":"Behav. Res. Methods"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"e1871","DOI":"10.1002\/cav.1871","article-title":"A generic framework for editing and synthesizing multimodal data with relative emotion strength","volume":"30","author":"Chan","year":"2019","journal-title":"Comput. Animat. Virtual Worlds"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zhu, J., Park, T., Isola, P., and Efros, A.A. (2017, January 22\u201329). Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.244"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Yi, Z., Zhang, H., Tan, P., and Gong, M. (2017, January 22\u201329). DualGAN: Unsupervised Dual Learning for Image-to-Image Translation. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.310"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Choi, Y., Choi, M., Kim, M., Ha, J., Kim, S., and Choo, J. (2018, January 1\u201323). StarGAN: Unified Generative Adversarial Networks for Multi-domain Image-to-Image Translation. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00916"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Holden, D., Saito, J., and Komura, T. (2016). A Deep Learning Framework for Character Motion Synthesis and Editing. ACM Trans. Graph., 35.","DOI":"10.1145\/2897824.2925975"},{"key":"ref_37","unstructured":"Kipf, T.N., and Welling, M. (2017, January 24\u201326). Semi-Supervised Classification with Graph Convolutional Networks. Proceedings of the International Conference on Learning Representations (ICLR), Toulon, France."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Men, Q., Ho, E.S.L., Shum, H.P.H., and Leung, H. (2020). A Quadruple Diffusion Convolutional Recurrent Network for Human Motion Prediction. IEEE Trans. Circuits Syst. Video Technol.","DOI":"10.1109\/TCSVT.2020.3038145"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Aristidou, A., Zeng, Q., Stavrakis, E., Yin, K., Cohen-Or, D., Chrysanthou, Y., and Chen, B. (2017, January 28\u201330). Emotion Control of Unstructured Dance Movements. Proceedings of the ACM SIGGRAPH\/Eurographics Symposium on Computer Animation, Los Angeles, CA, USA.","DOI":"10.1145\/3099564.3099566"}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/10\/3\/38\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:39:23Z","timestamp":1760161163000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/10\/3\/38"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,22]]},"references-count":39,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2021,3]]}},"alternative-id":["computers10030038"],"URL":"https:\/\/doi.org\/10.3390\/computers10030038","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,22]]}}}