{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,12]],"date-time":"2026-05-12T03:29:38Z","timestamp":1778556578928,"version":"3.51.4"},"reference-count":49,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2023,2,26]],"date-time":"2023-02-26T00:00:00Z","timestamp":1677369600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Silesian University of Technology (Gliwice, Poland)","award":["Rau6, 2023"],"award-info":[{"award-number":["Rau6, 2023"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In the fourth industrial revolution, the scale of execution for interactive applications increased substantially. These interactive and animated applications are human-centric, and the representation of human motion is unavoidable, making the representation of human motions ubiquitous. Animators strive to computationally process human motion in a way that the motions appear realistic in animated applications. Motion style transfer is an attractive technique that is widely used to create realistic motions in near real-time. motion style transfer approach employs existing captured motion data to generate realistic samples automatically and updates the motion data accordingly. This approach eliminates the need for handcrafted motions from scratch for every frame. The popularity of deep learning (DL) algorithms reshapes motion style transfer approaches, as such algorithms can predict subsequent motion styles. The majority of motion style transfer approaches use different variants of deep neural networks (DNNs) to accomplish motion style transfer approaches. This paper provides a comprehensive comparative analysis of existing state-of-the-art DL-based motion style transfer approaches. The enabling technologies that facilitate motion style transfer approaches are briefly presented in this paper. When employing DL-based methods for motion style transfer, the selection of the training dataset plays a key role in the performance. By anticipating this vital aspect, this paper provides a detailed summary of existing well-known motion datasets. As an outcome of the extensive overview of the domain, this paper highlights the contemporary challenges faced by motion style transfer approaches.<\/jats:p>","DOI":"10.3390\/s23052597","type":"journal-article","created":{"date-parts":[[2023,2,27]],"date-time":"2023-02-27T02:15:37Z","timestamp":1677464137000},"page":"2597","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["Deep Learning-Based Motion Style Transfer Tools, Techniques and Future Challenges"],"prefix":"10.3390","volume":"23","author":[{"given":"Syed Muhammad Abrar","family":"Akber","sequence":"first","affiliation":[{"name":"Department of Computer Graphics, Vision and Digital Systems, Faculty of Automatic Control, Electronics and Computer Science, Silesian University of Technology, 44-100 Gliwice, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sadia Nishat","family":"Kazmi","sequence":"additional","affiliation":[{"name":"Faculty of Automatic Control, Electronics and Computer Science, Silesian University of Technology, 44-100 Gliwice, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0886-9061","authenticated-orcid":false,"given":"Syed Muhammad","family":"Mohsin","sequence":"additional","affiliation":[{"name":"Department of Computer Science, COMSATS University Islamabad, Islamabad 45550, Pakistan"},{"name":"College of Intellectual Novitiates (COIN), Virtual University of Pakistan, Lahore 55150, Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4354-8258","authenticated-orcid":false,"given":"Agnieszka","family":"Szcz\u0119sna","sequence":"additional","affiliation":[{"name":"Department of Computer Graphics, Vision and Digital Systems, Faculty of Automatic Control, Electronics and Computer Science, Silesian University of Technology, 44-100 Gliwice, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1016\/j.ins.2020.08.060","article-title":"Fast human motion transfer based on a meta network","volume":"547","author":"Jian","year":"2021","journal-title":"Inf. Sci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1111\/cgf.12860","article-title":"Motion Style Retargeting to Characters With Different Morphologies","volume":"36","author":"Yoo","year":"2017","journal-title":"Comput. Graph. Forum"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1109\/38.708559","article-title":"Verbs and Adverbs: Multidimensional Motion Interpolation","volume":"18","author":"Rose","year":"1998","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_4","first-page":"15","article-title":"Extracting movement, posture, and temporal style features from human motion","volume":"7","author":"Etemad","year":"2014","journal-title":"Biol. Inspired Cogn. Archit."},{"key":"ref_5","unstructured":"Ma, W., Xia, S., Hodgins, J.K., Yang, X., Li, C., and Wang, Z. (2010, January 2\u20134). Modeling Style and Variation in Human Motion. Proceedings of the Eurographics\/ACM SIGGRAPH Symposium on Computer Animation (SCA), Madrid, Spain."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"115848","DOI":"10.1109\/ACCESS.2020.3003652","article-title":"Deep Learning Based Advanced Spatio-Temporal Extraction Model in Medical Sports Rehabilitation for Motion Analysis and Data Processing","volume":"8","author":"Cui","year":"2020","journal-title":"IEEE Access"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1109\/MCG.2017.3271464","article-title":"Fast Neural Style Transfer for Motion Data","volume":"37","author":"Holden","year":"2017","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3340254","article-title":"Efficient Neural Networks for Real-time Motion Style Transfer","volume":"2","author":"Smith","year":"2019","journal-title":"Proc. ACM Comput. Graph. Interact. Tech."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2897824.2925975","article-title":"A deep learning framework for character motion synthesis and editing","volume":"35","author":"Holden","year":"2016","journal-title":"ACM Trans. Graph."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1082","DOI":"10.1145\/1073204.1073315","article-title":"Style translation for human motion","volume":"24","author":"Hsu","year":"2005","journal-title":"ACM Trans. Graph."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1145\/3386569.3392469","article-title":"Unpaired motion style transfer from video to animation","volume":"39","author":"Aberman","year":"2020","journal-title":"ACM Trans. Graph."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Arshad, M.Z., Jamsrandorj, A., Kim, J., and Mun, K.R. (2022). Gait Events Prediction Using Hybrid CNN-RNN-Based Deep Learning Models through a Single Waist-Worn Wearable Sensor. Sensors, 22.","DOI":"10.3390\/s22218226"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Oudre, L., Barrois-M\u00fcller, R., Moreau, T., Truong, C., Vienne-Jumeau, A., Ricard, D., Vayatis, N., and Vidal, P.P. (2018). Template-based step detection with inertial measurement units. Sensors, 18.","DOI":"10.3390\/s18114033"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Mannini, A., Trojaniello, D., Cereatti, A., and Sabatini, A.M. (2016). A machine learning framework for gait classification using inertial sensors: Application to elderly, post-stroke and huntington\u2019s disease patients. Sensors, 16.","DOI":"10.3390\/s16010134"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Siew, P.M., and Linares, R. (2022). Optimal Tasking of Ground-Based Sensors for Space Situational Awareness Using Deep Reinforcement Learning. Sensors, 22.","DOI":"10.3390\/s22207847"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Liu, Y., Zhu, M., Wang, J., Guo, X., Yang, Y., and Wang, J. (2022). Multi-Scale Deep Neural Network Based on Dilated Convolution for Spacecraft Image Segmentation. Sensors, 22.","DOI":"10.3390\/s22114222"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"144800","DOI":"10.1109\/ACCESS.2019.2942853","article-title":"Cascade2vec: Learning Dynamic Cascade Representation by Recurrent Graph Neural Networks","volume":"7","author":"Huang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Ma, N., Peng, Y., Wang, S., and Leong, P.H. (2018). An unsupervised deep hyperspectral anomaly detector. Sensors, 18.","DOI":"10.3390\/s18030693"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"97082","DOI":"10.1109\/ACCESS.2020.2997473","article-title":"QRS Complex Detection Using Novel Deep Learning Neural Networks","volume":"8","author":"Cai","year":"2020","journal-title":"IEEE Access"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Gouda, W., Tahir, S., Alanazi, S., Almufareh, M., and Alwakid, G. (2022). Unsupervised Outlier Detection in IOT Using Deep VAE. Sensors, 22.","DOI":"10.3390\/s22176617"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"44982","DOI":"10.1109\/ACCESS.2022.3169782","article-title":"DanceConv: Dance Motion Generation With Convolutional Networks","volume":"10","author":"Kritsis","year":"2022","journal-title":"IEEE Access"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1810","DOI":"10.1109\/ACCESS.2016.2557846","article-title":"Learning Human Identity From Motion Patterns","volume":"4","author":"Neverova","year":"2016","journal-title":"IEEE Access"},{"key":"ref_23","unstructured":"Nguyen, X.T., Le, T.H., and Yu, H. (2018). Motion style extraction based on sparse coding decomposition. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Thanh, N.X., and Yu, H. (2019). Learning and Transferring Motion Style using Sparse PCA. VNU J. Sci. Comput. Sci. Commun. Eng., 35.","DOI":"10.25073\/2588-1086\/vnucsce.206"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"119:1","DOI":"10.1145\/2766999","article-title":"Realtime style transfer for unlabeled heterogeneous human motion","volume":"34","author":"Xia","year":"2015","journal-title":"ACM Trans. Graph."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"145:1","DOI":"10.1145\/3197517.3201366","article-title":"Mode-adaptive neural networks for quadruped motion control","volume":"37","author":"Zhang","year":"2018","journal-title":"ACM Trans. Graph."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1111\/cgf.13555","article-title":"Few-shot Learning of Homogeneous Human Locomotion Styles","volume":"37","author":"Mason","year":"2018","journal-title":"Comput. Graph. Forum"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Dong, Y., Aristidou, A., Shamir, A., Mahler, M., and Jain, E. (2020, January 16\u201318). Adult2child: Motion Style Transfer using CycleGANs. Proceedings of the Motion, Interaction and Games (MIG), North Charleston, SC, USA.","DOI":"10.1145\/3424636.3426909"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Tao, T., Zhan, X., Chen, Z., and van de Panne, M. (2022, January 18\u201324). Style-ERD: Responsive and coherent online motion style transfer. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00648"},{"key":"ref_30","unstructured":"Chang, Z., Findlay, E.J., Zhang, H., and Shum, H.P. (2022). Unifying Human Motion Synthesis and Style Transfer with Denoising Diffusion Probabilistic Models. arXiv."},{"key":"ref_31","first-page":"1","article-title":"Motion puzzle: Arbitrary motion style transfer by body part","volume":"41","author":"Jang","year":"2022","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_32","unstructured":"Wang, Q., Chen, M., Arti\u00e8res, T., and Denoyer, L. (2018, January 25\u201327). Transferring style in motion capture sequences with adversarial learning. Proceedings of the European Symposium on Artificial Neural Networks, ESANN, Bruges, Belgium."},{"key":"ref_33","unstructured":"Fourati, N., and Pelachaud, C. (2014, January 26\u201331). Emilya: Emotional body expression in daily actions database. Proceedings of the International Conference on Language Resources and Evaluation, LREC, Reykjavik, Icelan."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1111\/cgf.14426","article-title":"A Survey on Deep Learning for Skeleton-Based Human Animation","volume":"41","author":"Mourot","year":"2022","journal-title":"Comput. Graph. Forum"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1145\/3386569.3392462","article-title":"Skeleton-aware networks for deep motion retargeting","volume":"39","author":"Aberman","year":"2020","journal-title":"ACM Trans. Graph."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"3316","DOI":"10.1109\/TPAMI.2021.3053765","article-title":"Symbiotic Graph Neural Networks for 3D Skeleton-Based Human Action Recognition and Motion Prediction","volume":"44","author":"Li","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Jain, A., Zamir, A.R., Savarese, S., and Saxena, A. (2016, January 27\u201330). Structural-RNN: Deep Learning on Spatio-Temporal Graphs. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.573"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3072959.3073663","article-title":"Phase-functioned neural networks for character control","volume":"36","author":"Holden","year":"2017","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Cai, Y., Huang, L., Wang, Y., Cham, T.J., Cai, J., Yuan, J., Liu, J., Yang, X., Zhu, Y., and Shen, X. (2020, January 23\u201328). Learning progressive joint propagation for human motion prediction. Proceedings of the European Conference Computer Vision ECCV, Glasgow, UK.","DOI":"10.1007\/978-3-030-58571-6_14"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3386569.3392422","article-title":"Character controllers using motion vaes","volume":"39","author":"Ling","year":"2020","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Marwah, T., Mittal, G., and Balasubramanian, V.N. (2017, January 22\u201329). Attentive Semantic Video Generation Using Captions. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.159"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1325","DOI":"10.1109\/TPAMI.2013.248","article-title":"Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural Environments","volume":"36","author":"Ionescu","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_43","unstructured":"M\u00fcller, M., R\u00f6der, T., Clausen, M., Eberhardt, B., Kr\u00fcger, B., and Weber, A. (2007). Documentation Mocap Database HDM05, Universit\u00e4t Bonn. Technical Report CG-2007-2."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Shahroudy, A., Liu, J., Ng, T., and Wang, G. (2016, January 27\u201330). NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysis. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.115"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"2684","DOI":"10.1109\/TPAMI.2019.2916873","article-title":"NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understanding","volume":"42","author":"Liu","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1007\/s11263-009-0273-6","article-title":"HumanEva: Synchronized Video and Motion Capture Dataset and Baseline Algorithm for Evaluation of Articulated Human Motion","volume":"87","author":"Sigal","year":"2010","journal-title":"Int. J. Comput. Vis."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"von Marcard, T., Henschel, R., Black, M.J., Rosenhahn, B., and Pons-Moll, G. (2018, January 8\u201314). Recovering Accurate 3D Human Pose in the Wild Using IMUs and a Moving Camera. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01249-6_37"},{"key":"ref_48","unstructured":"Mahmood, N., Ghorbani, N., Troje, N.F., Pons-Moll, G., and Black, M.J. (2, January 27). AMASS: Archive of Motion Capture As Surface Shapes. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Trumble, M., Gilbert, A., Malleson, C., Hilton, A., and Collomosse, J.P. (2017, January 4\u20137). Total Capture: 3D Human Pose Estimation Fusing Video and Inertial Sensors. Proceedings of the British Machine Vision Conference (BMVC), London, UK.","DOI":"10.5244\/C.31.14"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/5\/2597\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:43:06Z","timestamp":1760121786000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/5\/2597"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,26]]},"references-count":49,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["s23052597"],"URL":"https:\/\/doi.org\/10.3390\/s23052597","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,26]]}}}