{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T17:57:45Z","timestamp":1790791065899,"version":"4.1.0"},"reference-count":50,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2022,12,15]],"date-time":"2022-12-15T00:00:00Z","timestamp":1671062400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2024446"],"award-info":[{"award-number":["2024446"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Bioeng. Biotechnol."],"abstract":"<jats:p>We anticipate wide adoption of wrist and forearm electomyographic (EMG) interface devices worn daily by the same user. This presents unique challenges that are not yet well addressed in the EMG literature, such as adapting for session-specific differences while learning a longer-term model of the specific user. In this manuscript we present two contributions toward this goal. First, we present the MiSDIREKt (Multi-Session Dynamic Interaction Recordings of EMG and Kinematics) dataset acquired using a novel hardware design. A single participant performed four kinds of hand interaction tasks in virtual reality for 43 distinct sessions over 12\u00a0days, totaling 814\u00a0min. Second, we analyze this data using a non-linear encoder-decoder for dimensionality reduction in gesture classification. We find that an architecture which recalibrates with a small amount of single session data performs at an accuracy of 79.5% on that session, as opposed to architectures which learn solely from the single session (49.6%) or learn only from the training data (55.2%).<\/jats:p>","DOI":"10.3389\/fbioe.2022.1034672","type":"journal-article","created":{"date-parts":[[2022,12,15]],"date-time":"2022-12-15T06:07:06Z","timestamp":1671084426000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Deep learning and session-specific rapid recalibration for dynamic hand gesture recognition from EMG"],"prefix":"10.3389","volume":"10","author":[{"given":"Maxim","family":"Karrenbach","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pornthep","family":"Preechayasomboon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"Sauer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Boe","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eric","family":"Rombokas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2022,12,15]]},"reference":[{"key":"B1","first-page":"929","article-title":"Advancing muscle-computer interfaces with high-density electromyography","author":"Amma","year":"2015"},{"key":"B2","doi-asserted-by":"publisher","first-page":"9","DOI":"10.3389\/fnbot.2016.00009","article-title":"Deep learning with convolutional neural networks applied to electromyography data: A resource for the classification of movements for prosthetic hands","volume":"10","author":"Atzori","year":"2016","journal-title":"Front. Neurorobot."},{"key":"B3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/sdata.2014.53","article-title":"Electromyography data for non-invasive naturally-controlled robotic hand prostheses","volume":"1","author":"Atzori","year":"2014","journal-title":"Sci. Data"},{"key":"B4","first-page":"272","article-title":"Electromyography (emg) data-driven load classification using empirical mode decomposition and feature analysis","author":"Aziz","year":"2019"},{"key":"B5","doi-asserted-by":"publisher","first-page":"724626","DOI":"10.3389\/fbioe.2021.724626","article-title":"Dimensionality reduction of human gait for prosthetic control","volume":"9","author":"Boe","year":"2021","journal-title":"Front. Bioeng. Biotechnol."},{"key":"B6","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1109\/TII.2020.3041618","article-title":"Electromyography-based gesture recognition: Is it time to change focus from the forearm to the wrist?","volume":"18","author":"Botros","year":"2022","journal-title":"IEEE Trans. Ind. Inf."},{"key":"B7","first-page":"506","article-title":"Multiple hand gesture recognition based on surface emg signal","author":"Chen","year":"2007"},{"key":"B8","doi-asserted-by":"publisher","first-page":"137809","DOI":"10.1109\/ACCESS.2021.3118281","article-title":"Robhand: A hand exoskeleton with real-time emg-driven embedded control. Quantifying hand gesture recognition delays for bilateral rehabilitation","volume":"9","author":"Cisnal","year":"2021","journal-title":"IEEE Access"},{"key":"B9","doi-asserted-by":"publisher","first-page":"760","DOI":"10.1109\/TNSRE.2019.2896269","article-title":"Deep learning for electromyographic hand gesture signal classification using transfer learning","volume":"27","author":"C\u00f4t\u00e9-Allard","year":"2019","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"B10","first-page":"523","article-title":"Real-time classification of electromyographic signals for robotic control","author":"Crawford","year":"2005"},{"key":"B11","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1109\/70.34763","article-title":"On grasp choice, grasp models, and the design of hands for manufacturing tasks","volume":"5","author":"Cutkosky","year":"1989","journal-title":"IEEE Trans. Robot. Autom."},{"key":"B12","doi-asserted-by":"publisher","first-page":"3333","DOI":"10.1152\/jn.00714.2012","article-title":"Virtual biomechanics: A new method for online reconstruction of force from emg recordings","volume":"108","author":"de Rugy","year":"2012","journal-title":"J. neurophysiology"},{"key":"B13","doi-asserted-by":"publisher","first-page":"2888","DOI":"10.1109\/JBHI.2022.3142034","article-title":"Compression of emg signals using deep convolutional autoencoders","volume":"26","author":"Dinashi","year":"2022","journal-title":"IEEE J. Biomed. Health Inf."},{"key":"B14","doi-asserted-by":"publisher","first-page":"458","DOI":"10.3390\/S17030458","article-title":"Surface emg-based inter-session gesture recognition enhanced by deep domain adaptation","volume":"17","author":"Du","year":"2017","journal-title":"Sensors (Basel, Switz."},{"key":"B15","doi-asserted-by":"publisher","first-page":"102210","DOI":"10.1016\/J.BSPC.2020.102210","article-title":"Emg hand gesture classification using handcrafted and deep features","volume":"63","author":"Fajardo","year":"2021","journal-title":"Biomed. Signal Process. Control"},{"key":"B16","first-page":"405","article-title":"Development of a surface emg acquisition system with novel electrodes configuration and signal representation","volume-title":"Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics) 8102 LNAI","author":"Fang","year":"2013"},{"key":"B17","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1109\/THMS.2015.2470657","article-title":"The grasp taxonomy of human grasp types","volume":"46","author":"Feix","year":"2016","journal-title":"IEEE Trans. Human-Mach. Syst."},{"key":"B18","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-020-62154-0","article-title":"Comparison between a wireless dry electrode eeg system with a conventional wired wet electrode eeg system for clinical applications","volume":"10","author":"Hinrichs","year":"2020","journal-title":"Sci. Rep."},{"key":"B19","doi-asserted-by":"publisher","first-page":"504","DOI":"10.1126\/SCIENCE.1127647","article-title":"Reducing the dimensionality of data with neural networks","volume":"313","author":"Hinton","year":"2006","journal-title":"Science"},{"key":"B20","doi-asserted-by":"publisher","first-page":"94","DOI":"10.25046\/AJ030111","article-title":"Auto-encoder based deep learning for surface electromyography signal processing","volume":"3","author":"Ibrahim","year":"2018","journal-title":"Adv. Sci. Technol. Eng. Syst. J."},{"key":"B21","doi-asserted-by":"publisher","first-page":"3302","DOI":"10.1109\/EMBC44109.2020.9175279","article-title":"Emg-based hand gesture classification with long short-term memory deep recurrent neural networks","volume":"2020","author":"Jabbari","year":"2020","journal-title":"Annu. Int. Conf. IEEE Eng. Med. Biol. Soc."},{"key":"B22","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1186\/s12984-018-0437-0","article-title":"Identification of forearm skin zones with similar muscle activation patterns during activities of daily living","volume":"15","author":"Jarque-Bou","year":"2018","journal-title":"J. NeuroEngineering Rehabil."},{"key":"B23","doi-asserted-by":"publisher","first-page":"3548","DOI":"10.3390\/S19163548","article-title":"putemg\u2014a surface electromyography hand gesture recognition dataset","volume":"19","author":"Kaczmarek","year":"2019","journal-title":"Sensors (Basel, Switz."},{"key":"B24","doi-asserted-by":"publisher","first-page":"437","DOI":"10.5014\/AJOT.34.7.437","article-title":"Patterns of static prehension in normal hands","volume":"34","author":"Kamakura","year":"1980","journal-title":"Am. J. Occup. Ther."},{"key":"B25","first-page":"30","article-title":"EMG-based hand gesture recognition for realtime biosignal interfacing","author":"Kim","year":"2008"},{"key":"B26","doi-asserted-by":"publisher","first-page":"3148","DOI":"10.1109\/TMC.2020.2994955","article-title":"Continuous authentication through finger gesture interaction for smart homes using wifi","volume":"20","author":"Kong","year":"2021","journal-title":"IEEE Trans. Mob. Comput."},{"key":"B27","doi-asserted-by":"publisher","first-page":"2329","DOI":"10.1109\/TPAMI.2020.2964173","article-title":"Deep residual correction network for partial domain adaptation","volume":"43","author":"Li","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"B28","doi-asserted-by":"publisher","first-page":"62","DOI":"10.4067\/s0718-33052018000100062","article-title":"Expert committee classifier for hand motions recognition from emg signals","volume":"26","author":"L\u00f3pez","year":"2018","journal-title":"Ingeniare. Rev. Chil. Ing."},{"key":"B29","doi-asserted-by":"publisher","first-page":"1573","DOI":"10.1016\/J.JBIOMECH.2010.01.027","article-title":"Filtering the surface emg signal: Movement artifact and baseline noise contamination","volume":"43","author":"Luca","year":"2010","journal-title":"J. Biomechanics"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1101\/2022.08.26.504777","article-title":"Using adversarial networks to extend brain computer interface decoding accuracy over time","author":"Ma","year":"2022"},{"key":"B31","doi-asserted-by":"publisher","first-page":"3119","DOI":"10.3390\/JCM11113119","article-title":"An semg-controlled forearm bracelet for assessing and training manual dexterity in rehabilitation: A systematic review","volume":"11","author":"Matsugi","year":"2022","journal-title":"J. Clin. Med. 2022"},{"key":"B32","article-title":"Learning to operate a high-dimensional hand via a low-dimensional controller","volume-title":"Review","author":"Portnova-Fahreeva","year":"2022"},{"key":"B33","doi-asserted-by":"publisher","first-page":"429","DOI":"10.3389\/fbioe.2020.00429","article-title":"Linear and non-linear dimensionality-reduction techniques on full hand kinematics","volume":"8","author":"Portnova-Fahreeva","year":"2020","journal-title":"Front. Bioeng. Biotechnol."},{"key":"B34","article-title":"Actually active electrodes: Pneumatically actuated electrodes for emg-based interaction in virtual reality","volume-title":"Review","author":"Prechayasomboon","year":"2023"},{"key":"B35","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/FRVIR.2021.738613","article-title":"Haplets: Finger-worn wireless and low-encumbrance vibrotactile haptic feedback for virtual and augmented reality","volume":"2","author":"Preechayasomboon","year":"2021","journal-title":"Front. Virtual Real."},{"key":"B36","doi-asserted-by":"publisher","first-page":"e0203987","DOI":"10.1371\/JOURNAL.PONE.0203987","article-title":"User experience of controlling the deka arm with emg pattern recognition","volume":"13","author":"Resnik","year":"2018","journal-title":"PLOS ONE"},{"key":"B37","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1016\/j.imu.2018.10.006","article-title":"Surface electromyography low-frequency content: Assessment in isometric conditions after electrocardiogram cancellation by the segmented-beat modulation method","volume":"13","author":"Sbrollini","year":"2018","journal-title":"Inf. Med. Unlocked"},{"key":"B38","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1017\/S0022112010001217","article-title":"Dynamic mode decomposition of numerical and experimental data","volume":"656","author":"Schmid","year":"2010","journal-title":"J. Fluid Mech."},{"key":"B39","doi-asserted-by":"publisher","first-page":"780","DOI":"10.1016\/J.JHSA.2005.01.002","article-title":"Refined myoelectric control in below-elbow amputees using artificial neural networks and a data glove","volume":"30","author":"Sebelius","year":"2005","journal-title":"J. Hand Surg."},{"key":"B40","first-page":"3285","article-title":"The performance of lstm and bilstm in forecasting time series","author":"Siami-Namini","year":"2019"},{"key":"B41","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1016\/J.PATREC.2019.07.021","article-title":"Emg-based online classification of gestures with recurrent neural networks","volume":"128","author":"Sim\u00e3o","year":"2019","journal-title":"Pattern Recognit. Lett."},{"key":"B42","volume-title":"Uc2018 dualmyo hand gesture dataset","author":"Sim\u00e3o","year":"2018"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.32474\/OAJBEB.2018.01.000104","article-title":"A comprehensive study on emg feature extraction and classifiers","volume":"1","author":"Spiewak","year":"2018","journal-title":"Open Access J. Biomed. Eng. Biosci."},{"key":"B44","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1186\/s12984-018-0363-1","article-title":"Online mapping of emg signals into kinematics by autoencoding","volume":"15","author":"Vujaklija","year":"2018","journal-title":"J. NeuroEngineering Rehabil."},{"key":"B45","first-page":"164","article-title":"In situ spatial ar surgical planning using projector-kinect system","author":"Wen","year":"2013"},{"key":"B46","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1016\/J.CMPB.2013.12.018","article-title":"Hand gesture guided robot-assisted surgery based on a direct augmented reality interface","volume":"116","author":"Wen","year":"2014","journal-title":"Comput. methods programs Biomed."},{"key":"B47","doi-asserted-by":"publisher","first-page":"9803869","DOI":"10.1109\/TKDE.2022.3185233","article-title":"A collaborative alignment framework of transferable knowledge extraction for unsupervised domain adaptation","author":"Xie","year":"2022","journal-title":"IEEE Trans. Knowl. Data Eng"},{"key":"B48","doi-asserted-by":"publisher","first-page":"379","DOI":"10.3389\/fnins.2017.00379","article-title":"Self-recalibrating surface emg pattern recognition for neuroprosthesis control based on convolutional neural network","volume":"11","author":"Zhai","year":"2017","journal-title":"Front. Neurosci."},{"key":"B49","doi-asserted-by":"publisher","first-page":"3994","DOI":"10.3390\/S20143994","article-title":"A novel surface electromyographic signal-based hand gesture prediction using a recurrent neural network","volume":"20","author":"Zhang","year":"2020","journal-title":"Sensors 2020"},{"key":"B50","doi-asserted-by":"publisher","first-page":"847180","DOI":"10.3389\/fnins.2022.847180","article-title":"User-independent emg gesture recognition method based on adaptive learning","volume":"16","author":"Zheng","year":"2022","journal-title":"Front. Neurosci."}],"container-title":["Frontiers in Bioengineering and Biotechnology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fbioe.2022.1034672\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,15]],"date-time":"2022-12-15T06:07:09Z","timestamp":1671084429000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fbioe.2022.1034672\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,15]]},"references-count":50,"alternative-id":["10.3389\/fbioe.2022.1034672"],"URL":"https:\/\/doi.org\/10.3389\/fbioe.2022.1034672","relation":{},"ISSN":["2296-4185"],"issn-type":[{"value":"2296-4185","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,15]]},"article-number":"1034672"}}