{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T18:27:45Z","timestamp":1754159265227,"version":"3.41.2"},"reference-count":39,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,7,25]],"date-time":"2025-07-25T00:00:00Z","timestamp":1753401600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100020963","name":"Moonshot Research and Development Program","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100020963","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003051","name":"New Energy and Industrial Technology Development Organization","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003051","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Bioeng. Biotechnol."],"abstract":"<jats:p>Electromyography (EMG) is essential for accurate assessment of motor function in rehabilitation, sports science, and robotics. However, its various time-consuming human operations (e.g., electromagnetic noise countermeasures) limit its widespread use. Meanwhile, motion capture technology has become more accessible, leading to increasing interest in musculoskeletal simulation models such as OpenSim. Although advances have been made in individualizing the model parameters, accurately estimating muscle activity remains a significant challenge. Previous efforts to optimize the parameters in musculoskeletal model simulators have yielded limited improvements in estimation accuracy. A key source of error that is identified in this study is the spatio-temporal distortion between the estimated and actual muscle activity, which has been inadequately addressed in previous research. To address this problem, this study proposes the Neural-Enhanced Motion-to-EMG (NEM2E) framework, which mitigates spatio-temporal distortions in simulated muscle activity using the Spatio-Temporal Distortion Refinement Network (STDR-Net). The STDR-Net is implemented via a Sequence-to-Sequence model with attention mechanisms to refine the estimates. Validation on two public datasets (walking and running motions) confirms significant accuracy improvements: enhanced estimations for all five muscles in the running dataset and for two of five muscles in the walking dataset. These findings demonstrate the potential of the NEM2E framework to refine OpenSim-generated muscle activity estimates and advance personalized applications in muscle activity analysis.<\/jats:p>","DOI":"10.3389\/fbioe.2025.1611414","type":"journal-article","created":{"date-parts":[[2025,7,25]],"date-time":"2025-07-25T05:26:40Z","timestamp":1753421200000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Neural-enhanced motion-to-EMG: refining simulated muscle activity from musculoskeletal models using a Seq2Seq approach"],"prefix":"10.3389","volume":"13","author":[{"given":"Tatsuya","family":"Teramae","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Takamitsu","family":"Matsubara","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tomoyuki","family":"Noda","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun","family":"Morimoto","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2025,7,25]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"655","DOI":"10.1299\/jsdd.6.655","article-title":"Development of walking analysis system using by motion sensor with Mobile force plate","volume":"6","author":"Adachi","year":"2011","journal-title":"J. Syst. Des. Dyn."},{"key":"B2","volume-title":"AnyBody Modeling System","year":"2025"},{"key":"B3","volume-title":"Healthcare Tech Solves Corporate and Social Issues and Improves Business Productivity","year":"2025"},{"key":"B4","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1007\/s10439-009-9852-5","article-title":"A model of the lower limb for analysis of human movement","volume":"38","author":"Arnold","year":"2010","journal-title":"Ann. Biomed. Eng."},{"key":"B5","doi-asserted-by":"publisher","first-page":"1104","DOI":"10.1080\/10255842.2020.1867978","article-title":"Bops: a matlab toolbox to batch musculoskeletal data processing for opensim","volume":"24","author":"Bedo","year":"2021","journal-title":"Comput. Methods Biomechanics Biomed. Eng."},{"key":"B6","doi-asserted-by":"publisher","first-page":"e0189406","DOI":"10.1371\/journal.pone.0189406","article-title":"Muscle function in glenohumeral joint stability during lifting task","volume":"12","author":"Blache","year":"2017","journal-title":"PLos One"},{"key":"B7","first-page":"492","article-title":"Myosuite: a contact-rich simulation suite for musculoskeletal motor control","author":"Caggiano","year":"2022"},{"key":"B8","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1007\/s10237-011-0290-6","article-title":"A musculoskeletal model for the lumbar spine","volume":"11","author":"Christophy","year":"2012","journal-title":"Biomechanics Model. Mechanobiol."},{"key":"B9","doi-asserted-by":"publisher","first-page":"1940","DOI":"10.1109\/tbme.2007.901024","article-title":"Opensim: open-Source software to create and analyze dynamic simulations of movement","volume":"54","author":"Delp","year":"2007","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"B10","doi-asserted-by":"publisher","first-page":"e1008493","DOI":"10.1371\/journal.pcbi.1008493","article-title":"Opensim moco: musculoskeletal optimal control","volume":"16","author":"Dembia","year":"2021","journal-title":"PLOS Comput. Biol."},{"key":"B11","volume-title":"Preface","year":"2025"},{"key":"B12","doi-asserted-by":"publisher","first-page":"1359337","DOI":"10.3389\/fbioe.2024.1359337","article-title":"Exploring biomechanical variations in ankle joint injuries among Latin dancers with different stance patterns: utilizing opensim musculoskeletal models","volume":"12","author":"Gao","year":"2024","journal-title":"Front. Bioeng. Biotechnol."},{"key":"B13","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1007\/978-3-030-55807-9_19","article-title":"Upper limbs musculoskeletal opensim model: customization and assessment","volume-title":"Advances in Italian mechanism science","author":"Gastaldi","year":"2021"},{"key":"B14","doi-asserted-by":"publisher","first-page":"780","DOI":"10.1016\/j.jbiomech.2012.11.024","article-title":"Muscle contributions to fore-aft and vertical body mass center accelerations over a range of running speeds","volume":"46","author":"Hamner","year":"2013","journal-title":"J. Biomechanics"},{"key":"B15","doi-asserted-by":"publisher","first-page":"2709","DOI":"10.1016\/j.jbiomech.2010.06.025","article-title":"Muscle contributions to propulsion and support during running","volume":"43","author":"Hamner","year":"2010","journal-title":"J. Biomech."},{"key":"B16","doi-asserted-by":"publisher","first-page":"388","DOI":"10.1016\/j.jbiomech.2015.12.040","article-title":"Mechanisms used to increase peak propulsive force following 12-weeks of gait training in individuals poststroke","volume":"49","author":"Hsiao","year":"2016","journal-title":"J. Biomechanics"},{"key":"B17","first-page":"1","article-title":"Adam: a method for stochastic optimization","author":"Kingma","year":"2015"},{"key":"B18","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1186\/s12984-018-0379-6","article-title":"Biomechanics and energetics of walking in powered ankle exoskeletons using myoelectric control versus mechanically intrinsic control","volume":"15","author":"Koller","year":"2018","journal-title":"J. Neuroeng Rehabil."},{"key":"B19","doi-asserted-by":"publisher","first-page":"e1638","DOI":"10.7717\/peerj.1638","article-title":"Generating optimal control simulations of musculoskeletal movement using opensim and matlab","volume":"4","author":"Lee","year":"2016","journal-title":"PeerJ"},{"key":"B20","doi-asserted-by":"publisher","first-page":"3243","DOI":"10.1016\/j.jbiomech.2008.07.031","article-title":"Muscle contributions to support and progression over a range of walking speeds","volume":"41","author":"Liu","year":"2008","journal-title":"J. Biomechanics"},{"key":"B21","doi-asserted-by":"publisher","first-page":"085804","DOI":"10.1088\/0957-0233\/21\/8\/085804","article-title":"A wearable force plate system for the continuous measurement of triaxial ground reaction force in biomechanical applications","volume":"21","author":"Liu","year":"2010","journal-title":"Meas. Sci. Technol."},{"key":"B22","doi-asserted-by":"crossref","first-page":"1412","DOI":"10.18653\/v1\/D15-1166","article-title":"Effective approaches to attention-based neural machine translation","volume-title":"Proceedings of the 2015 conference on empirical methods in natural language processing","author":"Luong","year":"2015"},{"key":"B23","doi-asserted-by":"publisher","first-page":"1517","DOI":"10.1016\/j.jbiomech.2012.03.016","article-title":"A platform for dynamic simulation and control of movement based on opensim and matlab","volume":"45","author":"Mansouri","year":"2012","journal-title":"J. biomechanics"},{"key":"B24","doi-asserted-by":"publisher","first-page":"1055","DOI":"10.1080\/10255842.2022.2104607","article-title":"Opencolab project: Opensim in google colaboratory to explore biomechanics on the web","volume":"26","author":"Mokhtarzadeh","year":"2023","journal-title":"Comput. Methods Biomechanics Biomed. Eng."},{"key":"B25","doi-asserted-by":"publisher","first-page":"3273","DOI":"10.1109\/lra.2022.3144519","article-title":"Human-in-the-loop weight compensation in upper limb wearable robots towards total muscles\u2019 effort minimization","volume":"7","author":"Nasiri","year":"2022","journal-title":"IEEE Robotics Automation Lett."},{"key":"B26","doi-asserted-by":"publisher","first-page":"104028","DOI":"10.1016\/j.imavis.2020.104028","article-title":"Synergetic reconstruction from 2D pose and 3D motion for wide-space multi-person video motion capture in the wild","volume":"104","author":"Ohashi","year":"2020","journal-title":"Image Vis. Comput."},{"key":"B27","volume-title":"OpenSim Software Ecosystem","year":"2025"},{"key":"B28","doi-asserted-by":"publisher","first-page":"1238","DOI":"10.1016\/j.jbiomech.2016.02.046","article-title":"An investigation of jogging biomechanics using the full-body lumbar spine model: model development and validation","volume":"49","author":"Raabe","year":"2016","journal-title":"J. Biomechanics"},{"key":"B29","doi-asserted-by":"publisher","first-page":"186","DOI":"10.1016\/j.piutam.2011.04.019","article-title":"Simulation of human movement: applications using opensim","volume":"2","author":"Reinbolt","year":"2011","journal-title":"Procedia Iutam"},{"key":"B30","doi-asserted-by":"publisher","first-page":"829","DOI":"10.1007\/s10439-005-3320-7","article-title":"A model of the upper extremity for simulating musculoskeletal surgery and analyzing neuromuscular control","volume":"33","author":"Saul","year":"2005","journal-title":"Ann. Biomed. Eng."},{"key":"B31","doi-asserted-by":"publisher","first-page":"e1006223","DOI":"10.1371\/journal.pcbi.1006223","article-title":"Opensim: simulating musculoskeletal dynamics and neuromuscular control to study human and animal movement","volume":"14","author":"Seth","year":"2018","journal-title":"PLOS Comput. Biol."},{"key":"B32","year":"2025"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1409.3215","article-title":"Sequence to sequence learning with neural networks","volume":"27","author":"Sutskever","year":"2014","journal-title":"Adv. neural Inf. Process. Syst."},{"key":"B34","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1016\/s0021-9290(02)00432-3","article-title":"Generating dynamic simulations of movement using computed muscle control","volume":"36","author":"Thelen","year":"2003","journal-title":"J. Biomechanics"},{"key":"B35","first-page":"5026","article-title":"Mujoco: a physics engine for model-based control","author":"Todorov","year":"2012"},{"key":"B36","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1016\/j.cmpb.2017.09.012","article-title":"Nmsbuilder: freeware to create subject-specific musculoskeletal models for opensim","volume":"152","author":"Valente","year":"2017","journal-title":"Comput. Methods. Prog. Biomed."},{"key":"B37","doi-asserted-by":"publisher","first-page":"e112625","DOI":"10.1371\/journal.pone.0112625","article-title":"Are subject-specific musculoskeletal models robust to the uncertainties in parameter identification?","volume":"9","author":"Valente","year":"2014","journal-title":"PLos One"},{"key":"B38","doi-asserted-by":"publisher","first-page":"412","DOI":"10.1080\/10255842.2022.2065630","article-title":"Full body musculoskeletal model for simulations of gait in persons with transtibial amputation","volume":"26","author":"Willson","year":"2023","journal-title":"Comput. Methods Biomechanics Biomed. Eng."},{"key":"B39","doi-asserted-by":"publisher","first-page":"1377767","DOI":"10.3389\/fbioe.2024.1377767","article-title":"Analysis of lumbar spine loading during walking in patients with chronic low back pain and healthy controls: an opensim-based study","volume":"12","author":"Zhang","year":"2024","journal-title":"Front. Bioeng. Biotechnol."}],"container-title":["Frontiers in Bioengineering and Biotechnology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fbioe.2025.1611414\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,25]],"date-time":"2025-07-25T05:26:42Z","timestamp":1753421202000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fbioe.2025.1611414\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,25]]},"references-count":39,"alternative-id":["10.3389\/fbioe.2025.1611414"],"URL":"https:\/\/doi.org\/10.3389\/fbioe.2025.1611414","relation":{},"ISSN":["2296-4185"],"issn-type":[{"value":"2296-4185","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,25]]},"article-number":"1611414"}}