{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T07:54:48Z","timestamp":1773388488821,"version":"3.50.1"},"reference-count":44,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,4,5]],"date-time":"2024-04-05T00:00:00Z","timestamp":1712275200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neurorobot."],"abstract":"<jats:p>In the realm of human motion recognition systems, the augmentation of 3D human pose data plays a pivotal role in enriching and enhancing the quality of original datasets through the generation of synthetic data. This augmentation is vital for addressing the current research gaps in diversity and complexity, particularly when dealing with rare or complex human movements. Our study introduces a groundbreaking approach employing Generative Adversarial Networks (GANs), coupled with Support Vector Machine (SVM) and DenseNet, further enhanced by robot-assisted technology to improve the precision and efficiency of data collection. The GANs in our model are responsible for generating highly realistic and diverse 3D human motion data, while SVM aids in the effective classification of this data. DenseNet is utilized for the extraction of key features, facilitating a comprehensive and integrated approach that significantly elevates both the data augmentation process and the model's ability to process and analyze complex human movements. The experimental outcomes underscore our model's exceptional performance in motion quality assessment, showcasing a substantial improvement over traditional methods in terms of classification accuracy and data processing efficiency. These results validate the effectiveness of our integrated network model, setting a solid foundation for future advancements in the field. Our research not only introduces innovative methodologies for 3D human pose data enhancement but also provides substantial technical support for practical applications across various domains, including sports science, rehabilitation medicine, and virtual reality. By combining advanced algorithmic strategies with robotic technologies, our work addresses key challenges in data augmentation and motion quality assessment, paving the way for new research and development opportunities in these critical areas.<\/jats:p>","DOI":"10.3389\/fnbot.2024.1371385","type":"journal-article","created":{"date-parts":[[2024,4,5]],"date-time":"2024-04-05T04:56:33Z","timestamp":1712292993000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["3D human pose data augmentation using Generative Adversarial Networks for robotic-assisted movement quality assessment"],"prefix":"10.3389","volume":"18","author":[{"given":"Xuefeng","family":"Wang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yang","family":"Mi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiang","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2024,4,5]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"505","DOI":"10.1016\/j.dcan.2020.12.001","article-title":"Robot and its living space: a roadmap for robot development based on the view of living space","volume":"7","author":"Cai","year":"2021","journal-title":"Digit. Commun. Netw"},{"key":"B2","doi-asserted-by":"publisher","first-page":"109621","DOI":"10.1016\/j.asoc.2022.109621","article-title":"Camera view planning based on generative adversarial imitation learning in indoor active exploration","volume":"129","author":"Dai","year":"2022","journal-title":"Appl. Soft Comput"},{"key":"B3","doi-asserted-by":"publisher","first-page":"105655","DOI":"10.1016\/j.engappai.2022.105655","article-title":"Digital twin of an industrial workstation: a novel method of an auto-labeled data generator using virtual reality for human action recognition in the context of human-robot collaboration","volume":"118","author":"Dallel","year":"2023","journal-title":"Eng. Appl. Artif. Intell"},{"key":"B4","doi-asserted-by":"publisher","first-page":"110879","DOI":"10.1016\/j.jenvman.2020.110879","article-title":"Multiscale land use impacts on water quality: assessment, planning, and future perspectives in brazil","volume":"270","author":"De Mello","year":"2020","journal-title":"J. Environ. Manage"},{"key":"B5","doi-asserted-by":"publisher","first-page":"106195","DOI":"10.1016\/j.cie.2019.106195","article-title":"Augmented reality in support of intelligent manufacturing-a systematic literature review","volume":"140","author":"Egger","year":"2020","journal-title":"Comput. Ind. Eng"},{"key":"B6","doi-asserted-by":"publisher","first-page":"111028","DOI":"10.1016\/j.knosys.2023.111028","article-title":"A smoothing group lasso based interval type-2 fuzzy neural network for simultaneous feature selection and system identification","volume":"280","author":"Gao","year":"2023","journal-title":"Knowl.-Based Syst"},{"key":"B7","doi-asserted-by":"publisher","first-page":"1203104","DOI":"10.3389\/fnins.2023.1203104","article-title":"Generative AI for brain image computing and brain network computing: a review","volume":"17","author":"Gong","year":"2023","journal-title":"Front. Neurosci."},{"key":"B8","doi-asserted-by":"publisher","first-page":"3313","DOI":"10.1109\/TKDE.2021.3130191","article-title":"A review on generative adversarial networks: algorithms, theory, and applications","volume":"35","author":"Gui","year":"2021","journal-title":"IEEE Trans. Knowl. Data Eng"},{"key":"B9","doi-asserted-by":"publisher","first-page":"88604","DOI":"10.1109\/ACCESS.2020.2992740","article-title":"Global spatio-temporal attention for action recognition based on 3D human skeleton data","volume":"8","author":"Han","year":"2020","journal-title":"IEEE Access"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2023.3266819","article-title":"3-D brain reconstruction by hierarchical shape-perception network from a single incomplete image","author":"Hu","year":"2023"},{"key":"B11","doi-asserted-by":"publisher","first-page":"1325","DOI":"10.1109\/TPAMI.2013.248","article-title":"Human3.6M Large scale datasets and predictive methods for 3D human sensing in natural environments","volume":"36","author":"Ionescu","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell"},{"key":"B12","doi-asserted-by":"publisher","first-page":"627","DOI":"10.1007\/978-3-319-48881-3_44","article-title":"\u201cMulti-person pose estimation with local joint-to-person associations,\u201d","author":"Iqbal","year":"2016"},{"key":"B13","doi-asserted-by":"publisher","first-page":"20771","DOI":"10.1007\/s11042-022-13921-w","article-title":"Deep learning-based for human segmentation and tracking, 3D human pose estimation and action recognition on monocular video of mads dataset","volume":"82","author":"Le","year":"2023","journal-title":"Multimed. Tools Appl"},{"key":"B14","doi-asserted-by":"publisher","first-page":"1504","DOI":"10.1016\/j.spinee.2021.05.015","article-title":"Is there a difference between navigated and non-navigated robot cohorts in robot-assisted spine surgery? A multicenter, propensity-matched analysis of 2,800 screws and 372 patients","volume":"21","author":"Lee","year":"2021","journal-title":"Spine J"},{"key":"B15","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1016\/j.eururo.2022.06.018","article-title":"Application of improved robot-assisted laparoscopic telesurgery with 5G technology in urology","volume":"83","author":"Li","year":"2023","journal-title":"Eur. Urol"},{"key":"B16","first-page":"127","article-title":"Hierarchical matching algorithm of visual image for mobile robots based on deep reinforcement learning","volume":"61","author":"Li","year":"2023","journal-title":"J. Jilin Univ. Sci. Ed"},{"key":"B17","doi-asserted-by":"publisher","first-page":"1148545","DOI":"10.3389\/fnbot.2023.1148545","article-title":"Model transfer from 2d to 3D study for boxing pose estimation","volume":"17","author":"Lin","year":"2023","journal-title":"Front. Neurorobot"},{"key":"B18","doi-asserted-by":"publisher","first-page":"2684","DOI":"10.1109\/TPAMI.2019.2916873","article-title":"NTU RGB+D 120: a large-scale benchmark for 3D human activity understanding","volume":"42","author":"Liu","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell"},{"key":"B19","doi-asserted-by":"publisher","first-page":"1596","DOI":"10.1007\/s11263-021-01436-0","article-title":"Enhanced 3D human pose estimation from videos by using attention-based neural network with dilated convolutions","volume":"129","author":"Liu","year":"2021","journal-title":"Int. J. Comput. Vis"},{"key":"B20","doi-asserted-by":"publisher","first-page":"2752","DOI":"10.1109\/TPAMI.2020.2976014","article-title":"Multi-task deep learning for real-time 3D human pose estimation and action recognition","volume":"43","author":"Luvizon","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell"},{"key":"B21","doi-asserted-by":"publisher","first-page":"98754","DOI":"10.1109\/ACCESS.2021.3095559","article-title":"Software defect prediction using ensemble learning: a systematic literature review","volume":"9","author":"Matloob","year":"2021","journal-title":"IEEE Access"},{"key":"B22","doi-asserted-by":"crossref","DOI":"10.1109\/3DV.2017.00064","article-title":"\u201cMonocular 3D human pose estimation in the wild using improved cnn supervision,\u201d","author":"Mehta","year":"2017"},{"key":"B23","first-page":"641","article-title":"Simulation of video association motion tracking based on trajectory extraction algorithm","volume":"60","author":"Nian","year":"2022","journal-title":"J. Jilin Univ. Sci. Ed"},{"key":"B24","doi-asserted-by":"publisher","first-page":"122419","DOI":"10.1016\/j.eswa.2023.122419","article-title":"Occluded person re-identification with deep learning: a survey and perspectives","volume":"239","author":"Ning","year":"2024","journal-title":"Expert Syst. Appl"},{"key":"B25","doi-asserted-by":"publisher","first-page":"835","DOI":"10.1007\/s10055-020-00489-9","article-title":"Immersive virtual reality in k-12 and higher education: a systematic review of the last decade scientific literature","volume":"25","author":"Pellas","year":"2021","journal-title":"Virtual Real"},{"key":"B26","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1007\/978-3-030-27202-9_2","article-title":"A deep learning approach for real-time 3D human action recognition from skeletal data,\"","author":"Pham","year":"2019"},{"key":"B27","doi-asserted-by":"publisher","first-page":"8251","DOI":"10.1109\/TIP.2021.3113783","article-title":"Direct unsupervised super-resolution using generative adversarial network (DUS-GAN) for real-world data","volume":"30","author":"Prajapati","year":"2021","journal-title":"IEEE Trans. Image Process"},{"key":"B28","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1016\/j.autcon.2019.04.015","article-title":"Impact assessment of reinforced learning methods on construction workers' fall risk behavior using virtual reality","volume":"104","author":"Shi","year":"2019","journal-title":"Autom. Constr"},{"key":"B29","doi-asserted-by":"publisher","first-page":"746","DOI":"10.1007\/s11263-009-0273-6","article-title":"\u201cHumaneva: synchronized video and motion capture dataset for evaluation of articulated human motion,\u201d","author":"Sigal","year":"2010"},{"key":"B30","doi-asserted-by":"publisher","first-page":"28133","DOI":"10.1007\/s10489-023-04940-7","article-title":"Stemgan: spatio-temporal generative adversarial network for video anomaly detection","volume":"53","author":"Singh","year":"2023","journal-title":"Appl. Intell"},{"key":"B31","doi-asserted-by":"publisher","first-page":"29357","DOI":"10.1007\/s11042-019-7433-7","article-title":"Deep neural networks for human pose estimation from a very low resolution depth image","volume":"78","author":"Szczuko","year":"2019","journal-title":"Multimed. Tools Appl"},{"key":"B32","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1016\/j.cviu.2018.02.003","article-title":"Semi-and weakly-supervised human pose estimation","volume":"170","author":"Ukita","year":"2018","journal-title":"Comput. Vis. Image Underst"},{"key":"B33","doi-asserted-by":"publisher","first-page":"118","DOI":"10.1016\/j.cviu.2018.04.007","article-title":"RGB-D-based human motion recognition with deep learning: a survey","volume":"171","author":"Wang","year":"2018","journal-title":"Comput. Vis. Image Underst"},{"key":"B34","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1016\/j.neucom.2022.06.033","article-title":"Simplified-attention enhanced graph convolutional network for 3D human pose estimation","volume":"501","author":"Wang","year":"2022","journal-title":"Neurocomputing"},{"key":"B35","doi-asserted-by":"publisher","first-page":"443","DOI":"10.1016\/j.ijresmar.2020.04.004","article-title":"Virtual and augmented reality: advancing research in consumer marketing","volume":"37","author":"Wedel","year":"2020","journal-title":"Int. J. Res. Mark"},{"key":"B36","doi-asserted-by":"publisher","first-page":"102802","DOI":"10.1016\/j.jvcir.2020.102802","article-title":"Hand pose estimation in object-interaction based on deep learning for virtual reality applications","volume":"70","author":"Wu","year":"2020","journal-title":"J. Vis. Commun. Image Represent"},{"key":"B37","doi-asserted-by":"publisher","first-page":"6327","DOI":"10.1109\/TPAMI.2021.3087695","article-title":"Monocular 3D pose estimation via pose grammar and data augmentation","volume":"44","author":"Xu","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell"},{"key":"B38","doi-asserted-by":"publisher","first-page":"4401","DOI":"10.1109\/TNNLS.2021.3118369","article-title":"Morphological feature visualization of Alzheimer's disease via multidirectional perception gan","volume":"34","author":"Yu","year":"2022","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"B39","doi-asserted-by":"publisher","first-page":"5080","DOI":"10.1109\/TCSVT.2022.3147788","article-title":"Deep learning-based perceptual video quality enhancement for 3D synthesized view","volume":"32","author":"Zhang","year":"2022","journal-title":"IEEE Trans. Circ. Syst. Video Technol"},{"key":"B40","doi-asserted-by":"publisher","first-page":"103311","DOI":"10.1016\/j.autcon.2020.103311","article-title":"Virtual reality applications for the built environment: research trends and opportunities","volume":"118","author":"Zhang","year":"2020","journal-title":"Autom. Constr"},{"key":"B41","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1016\/j.compbiomed.2019.01.009","article-title":"Application of supervised machine learning algorithms in the classification of sagittal gait patterns of cerebral palsy children with spastic diplegia","volume":"106","author":"Zhang","year":"2019","journal-title":"Comput. Biol. Med"},{"key":"B42","doi-asserted-by":"publisher","first-page":"106931","DOI":"10.1016\/j.ress.2020.106931","article-title":"Accident prediction accuracy assessment for highway-rail grade crossings using random forest algorithm compared with decision tree","volume":"200","author":"Zhou","year":"2020","journal-title":"Reliab. Eng. Syst. Saf"},{"key":"B43","doi-asserted-by":"publisher","first-page":"943","DOI":"10.1109\/JBHI.2019.2950334","article-title":"Ultrafast plane wave imaging with line-scan-quality using an ultrasound-transfer generative adversarial network","volume":"24","author":"Zhou","year":"2019","journal-title":"IEEE J. Biomed. Health Inf"},{"key":"B44","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1016\/j.jfoodeng.2019.06.009","article-title":"Application of machine learning algorithms in quality assurance of fermentation process of black tea-based on electrical properties","volume":"263","author":"Zhu","year":"2019","journal-title":"J. Food Eng"}],"container-title":["Frontiers in Neurorobotics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2024.1371385\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,5]],"date-time":"2024-04-05T04:56:35Z","timestamp":1712292995000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2024.1371385\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,5]]},"references-count":44,"alternative-id":["10.3389\/fnbot.2024.1371385"],"URL":"https:\/\/doi.org\/10.3389\/fnbot.2024.1371385","relation":{},"ISSN":["1662-5218"],"issn-type":[{"value":"1662-5218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,5]]},"article-number":"1371385"}}