{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T19:04:38Z","timestamp":1783105478229,"version":"3.54.6"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T00:00:00Z","timestamp":1731974400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Research Foundation of Kore","award":["RS-2024-00333478"],"award-info":[{"award-number":["RS-2024-00333478"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2024,12,19]]},"abstract":"<jats:p>Interactive motion between multiple characters is widely utilized in games and movies. However, the method for generating interactive motions considering the character's diverse mesh shape has yet to be studied. We propose a Spatio Cooperative Transformer (SCT) to retarget the interacting motions of two characters having arbitrary mesh connectivity. SCT predicts the residual of root position and joint rotations considering the shape difference between the source and target of interacting characters. In addition, we introduce an anchor loss function for SCT to maintain the geometric distance between the interacting characters when they are retargeted. We also propose a motion augmentation method with deformation-based adaptation to prepare a source-target paired dataset with an identical mesh connectivity for training. In experiments, our method achieved higher accuracy for semantic preservation and produced less artifacts of inter-penetration between the interacting characters for unseen characters and motions than the baselines. Moreover, we conducted a user evaluation using characters with various shapes, spanning low-to-high interaction levels to prove better semantic preservation of our method compared to previous studies.<\/jats:p>","DOI":"10.1145\/3687962","type":"journal-article","created":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T15:46:04Z","timestamp":1732031164000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Geometry-Aware Retargeting for Two-Skinned Characters Interaction"],"prefix":"10.1145","volume":"43","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-8351-736X","authenticated-orcid":false,"given":"Inseo","family":"Jang","sequence":"first","affiliation":[{"name":"Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0832-6545","authenticated-orcid":false,"given":"Soojin","family":"Choi","sequence":"additional","affiliation":[{"name":"Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8490-5338","authenticated-orcid":false,"given":"Seokhyeon","family":"Hong","sequence":"additional","affiliation":[{"name":"Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8355-7522","authenticated-orcid":false,"given":"Chaelin","family":"Kim","sequence":"additional","affiliation":[{"name":"Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1925-3326","authenticated-orcid":false,"given":"Junyong","family":"Noh","sequence":"additional","affiliation":[{"name":"Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,11,19]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392462"},{"key":"e_1_2_1_2_1","unstructured":"Adobe. 2021. Adobe Animation Dataset. https:\/\/www.mixamo.com\/"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2485895.2485905"},{"key":"e_1_2_1_4_1","volume-title":"Computer Graphics Forum","author":"Borno Mazen Al","unstructured":"Mazen Al Borno, Ludovic Righetti, Michael J Black, Scott L Delp, Eugene Fiume, and Javier Romero. 2018. Robust Physics-based Motion Retargeting with Realistic Body Shapes. In Computer Graphics Forum, Vol. 37. Wiley Online Library, 81--92."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359566.3360075"},{"key":"e_1_2_1_6_1","volume-title":"Black","author":"Bogo Federica","year":"2016","unstructured":"Federica Bogo, Angjoo Kanazawa, Christoph Lassner, Peter Gehler, Javier Romero, and Michael J. Black. 2016. Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Image. In Computer Vision - ECCV 2016 (Lecture Notes in Computer Science). Springer International Publishing."},{"key":"e_1_2_1_7_1","unstructured":"Th\u00e9o Cheynel Thomas Rossi Baptiste Bellot-Gurlet Damien Rohmer and Marie-Paule Cani. 2023. Sparse Motion Semantics for Contact-Aware Retargeting. (2023)."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/PCCGA.1999.803346"},{"key":"e_1_2_1_9_1","doi-asserted-by":"crossref","unstructured":"Anindita Ghosh Rishabh Dabral Vladislav Golyanik Christian Theobalt and Philipp Slusallek. 2023. ReMoS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactions. In arXiv.","DOI":"10.1007\/978-3-031-72764-1_24"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/280814.280820"},{"key":"e_1_2_1_11_1","volume-title":"Computer Graphics Forum","author":"Goel Aman","unstructured":"Aman Goel, Qianhui Men, and Edmond SL Ho. 2022. Interaction Mix and Match: Synthesizing Close Interaction using Conditional Hierarchical GAN with Multi-Hot Class Embedding. In Computer Graphics Forum, Vol. 41. Wiley Online Library, 327--338."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778770"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2013.6631113"},{"key":"e_1_2_1_14_1","volume-title":"Pose-aware attention network for flexible motion retargeting by body part. arXiv preprint arXiv:2306.08006","author":"Hu Lei","year":"2023","unstructured":"Lei Hu, Zihao Zhang, Chongyang Zhong, Boyuan Jiang, and Shihong Xia. 2023. Pose-aware attention network for flexible motion retargeting by body part. arXiv preprint arXiv:2306.08006 (2023)."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.248"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13363"},{"key":"e_1_2_1_17_1","first-page":"4","article-title":"A variational U-Net for motion retargeting","volume":"31","author":"Kim Seong Uk","year":"2020","unstructured":"Seong Uk Kim, Hanyoung Jang, and Jongmin Kim. 2020. A variational U-Net for motion retargeting. Computer Animation and Virtual Worlds 31, 4--5 (2020), e1947.","journal-title":"Computer Animation and Virtual Worlds"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2593780"},{"key":"e_1_2_1_19_1","volume-title":"Adam: A Method for Stochastic Optimization. In International Conference on Learning Representations (ICLR)","author":"Kingma Diederik","year":"2015","unstructured":"Diederik Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In International Conference on Learning Representations (ICLR). San Diega, CA, USA."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3610548.3618206"},{"key":"e_1_2_1_21_1","volume-title":"Intergen: Diffusion-based multi-human motion generation under complex interactions. International Journal of Computer Vision","author":"Liang Han","year":"2024","unstructured":"Han Liang, Wenqian Zhang, Wenxuan Li, Jingyi Yu, and Lan Xu. 2024. Intergen: Diffusion-based multi-human motion generation under complex interactions. International Journal of Computer Vision (2024), 1--21."},{"key":"e_1_2_1_22_1","volume-title":"PMnet: Learning of Disentangled Pose and Movement for Unsupervised Motion Retargeting. In British Machine Vision Conference (BMVC).","author":"Lim Jongin","year":"2019","unstructured":"Jongin Lim, Hyung Jin Chang, and Jin Young Choi. 2019. PMnet: Learning of Disentangled Pose and Movement for Unsupervised Motion Retargeting. In British Machine Vision Conference (BMVC)."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/1218064.1218093"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274247.3274507"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818013"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1002\/cav.233"},{"key":"e_1_2_1_27_1","volume-title":"International Conference on Computer Vision. 5442--5451","author":"Mahmood Naureen","unstructured":"Naureen Mahmood, Nima Ghorbani, Nikolaus F. Troje, Gerard Pons-Moll, and Michael J. Black. 2019. AMASS: Archive of Motion Capture as Surface Shapes. In International Conference on Computer Vision. 5442--5451."},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision. 9720--9729","author":"Ruben Villegas","year":"2021","unstructured":"Villegas Ruben, Ceylan Duygu, Hertzmann Aaron, Yang Jimei, and Saito Jun. 2021. Contact-aware retargeting of skinned motion. In Proceedings of the IEEE\/CVF International Conference on Computer Vision. 9720--9729."},{"key":"e_1_2_1_29_1","volume-title":"Human motion diffusion as a generative prior. arXiv preprint arXiv:2303.01418","author":"Shafir Yonatan","year":"2023","unstructured":"Yonatan Shafir, Guy Tevet, Roy Kapon, and Amit H Bermano. 2023. Human motion diffusion as a generative prior. arXiv preprint arXiv:2303.01418 (2023)."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2019.2893247"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1037957.1037963"},{"key":"e_1_2_1_32_1","volume-title":"Julien Pettr\u00e9, Taku Komura, and Nicolas Mansard.","author":"Tonneau Steve","year":"2016","unstructured":"Steve Tonneau, Rami Ali Al-Ashqar, Julien Pettr\u00e9, Taku Komura, and Nicolas Mansard. 2016. Character contact re-positioning under large environment deformation. In Computer Graphics Forum, Vol. 35. Wiley Online Library, 127--138."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.5555\/3295222.3295349"},{"key":"e_1_2_1_34_1","volume-title":"Neural Kinematic Networks for Unsupervised Motion Retargetting. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Villegas Ruben","year":"2018","unstructured":"Ruben Villegas, Jimei Yang, Duygu Ceylan, and Honglak Lee. 2018. Neural Kinematic Networks for Unsupervised Motion Retargetting. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01249-6_37"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356499"},{"key":"e_1_2_1_37_1","doi-asserted-by":"crossref","unstructured":"Haodong Zhang ZhiKe Chen Haocheng Xu Lei Hao Xiaofei Wu Songcen Xu Zhensong Zhang Yue Wang and Rong Xiong. 2024. Semantics-aware Motion Retargeting with Vision-Language Models. (2024).","DOI":"10.1109\/CVPR52733.2024.00210"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.01332"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3588432.3591491"},{"key":"e_1_2_1_40_1","volume-title":"On the Continuity of Rotation Representations in Neural Networks. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Zhou Yi","year":"2019","unstructured":"Yi Zhou, Connelly Barnes, Lu Jingwan, Yang Jimei, and Li Hao. 2019. On the Continuity of Rotation Representations in Neural Networks. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3687962","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3687962","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:09:58Z","timestamp":1750295398000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3687962"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,19]]},"references-count":40,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2024,12,19]]}},"alternative-id":["10.1145\/3687962"],"URL":"https:\/\/doi.org\/10.1145\/3687962","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,19]]},"assertion":[{"value":"2024-11-19","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}