{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T14:45:16Z","timestamp":1776350716780,"version":"3.51.2"},"reference-count":31,"publisher":"Association for Computing Machinery (ACM)","issue":"2","funder":[{"name":"Science and Technology Department of Sichuan","award":["2023YFH0037, 2023ZHCG0075, and 2024YFFK0033"],"award-info":[{"award-number":["2023YFH0037, 2023ZHCG0075, and 2024YFFK0033"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Appl. Percept."],"published-print":{"date-parts":[[2026,4,30]]},"abstract":"<jats:p>\n                    The interaction between stroke patients and rehabilitation training robots is difficult because the motion intention cannot be executed by limbs due to their weak motor ability. Although brain\u2013computer interaction (BCI) is beneficial for perceiving the motion of patients, it cannot solve the problem independently without receiving enough data about the effectiveness of the robotic assistance. This study proposes a BCI method that integrates rehabilitation training and training effect evaluation in a mixed reality (MR) environment. Three Electroencephalogram (EEG) experimental paradigms were designed, using motor imagery to convert the four-classification problem of motor execution into three binary classification problems. An EEG classification model of a multi-scale convolution residual network based on a multi-head attention mechanism was built, consisting of a multi-head attention mechanism layer, four convolutional layers, and a pooling layer. The highest accuracy and best Kappa coefficient of 12 participants on the testing dataset were recorded. The average classification accuracy of MI, ME1, and ME2 achieves 80.35%, 87.52%, and 86.51%, respectively, proving the proposed classification method has sufficient decoding accuracy. Comparing the hemodynamic response curves of the participants\u2019 upper limbs before and after robotic assistance during rehabilitation training, hemodynamic response curves were analyzed quantitatively. With the paired-sample\n                    <jats:italic toggle=\"yes\">t<\/jats:italic>\n                    -test to compare the hemodynamics of a single participant, the significance of the overall mean difference was calculated to evaluate the influence of robotic assistance on enhancing local tissue blood oxygen, improving tissue function, and accelerating local tissue repair. The study verifies the effectiveness of robotic rehabilitation training and helps develop new types of BCI with better coordination between motion intention perception and motor ability.\n                  <\/jats:p>","DOI":"10.1145\/3799698","type":"journal-article","created":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T08:53:32Z","timestamp":1772268812000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Motion Intention Decoding and Training Effect Evaluation in Robot-assisted Upper Limb Rehabilitation Based on MR-BCI"],"prefix":"10.1145","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-6314-4578","authenticated-orcid":false,"given":"Xiaodong","family":"Liu","sequence":"first","affiliation":[{"name":"School of Mechanical Engineering, Southwest Jiaotong University, Chengdu, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-0703-7677","authenticated-orcid":false,"given":"Dongxian","family":"Ye","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Southwest Jiaotong University, Chengdu, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5673-2134","authenticated-orcid":false,"given":"Peng","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Southwest Jiaotong University, Chengdu, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-4926-2808","authenticated-orcid":false,"given":"Yutong","family":"Fu","sequence":"additional","affiliation":[{"name":"School of Physical and Mathematical Sciences, Nanyang Technological University, Singapore, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-0162-5465","authenticated-orcid":false,"given":"Xiangyun","family":"Li","sequence":"additional","affiliation":[{"name":"West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8136-9816","authenticated-orcid":false,"given":"Kang","family":"Li","sequence":"additional","affiliation":[{"name":"West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2026,4,16]]},"reference":[{"issue":"19","key":"e_1_3_1_2_2","doi-asserted-by":"crossref","first-page":"12739","DOI":"10.3390\/ijerph191912739","article-title":"Effectiveness of rehabilitation exercise in improving physical function of stroke patients: A systematic review","volume":"19","author":"Lee K. E.","year":"2022","unstructured":"K. E. Lee, M. Choi, and B. Jeoung. 2022. Effectiveness of rehabilitation exercise in improving physical function of stroke patients: A systematic review. International Journal of Environmental Research and Public Health 19, 19 (2022), 12739.","journal-title":"International Journal of Environmental Research and Public Health"},{"issue":"2","key":"e_1_3_1_3_2","doi-asserted-by":"crossref","first-page":"190","DOI":"10.3390\/healthcare10020190","article-title":"Rehabilitation of upper limb motor impairment in stroke: A narrative review on the prevalence, risk factors, and economic statistics of stroke and state of the art therapies","volume":"10","author":"Anwer S.","year":"2022","unstructured":"S. Anwer, A. Waris, S. O. Gilani, J. Iqbal, N. Shaikh, A. N. Pujari, and I. K. Niazi. 2022. Rehabilitation of upper limb motor impairment in stroke: A narrative review on the prevalence, risk factors, and economic statistics of stroke and state of the art therapies. Healthcare 10, 2 (2022), 190.","journal-title":"Healthcare"},{"issue":"1","key":"e_1_3_1_4_2","first-page":"6621950","article-title":"Motor function assessment of upper limb in stroke patients","volume":"2021","author":"Pan B.","year":"2021","unstructured":"B. Pan, Z. Huang, T. Jin, J. Wu, Z. Zhang, and Y. Shen. 2021. Motor function assessment of upper limb in stroke patients. Journal of Healthcare Engineering 2021, 1 (2021), 6621950.","journal-title":"Journal of Healthcare Engineering"},{"issue":"1","key":"e_1_3_1_5_2","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1111\/j.1747-4949.2012.00967.x","article-title":"Predicting activities after stroke: What is clinically relevant","volume":"8","author":"Kwakkel G.","year":"2013","unstructured":"G. Kwakkel and B. Kollen. 2013. Predicting activities after stroke: What is clinically relevant? International Journal of Stroke 8, 1 (2013), 25\u201332.","journal-title":"International Journal of Stroke"},{"key":"e_1_3_1_6_2","first-page":"1","volume-title":"Proceedings of the 2010 International Conference on Autonomous and Intelligent Systems (AIS \u201910)","author":"Alamri A.","year":"2010","unstructured":"A. Alamri, H.-N. Kim, and A. El Saddik. 2010. A decision model of stroke patient rehabilitation with augmented reality-based games. In Proceedings of the 2010 International Conference on Autonomous and Intelligent Systems (AIS \u201910). IEEE, 1\u20136."},{"key":"e_1_3_1_7_2","first-page":"379","volume-title":"The World Journal of Biological Psychiatry","volume":"13","author":"Thome J.","year":"2012","unstructured":"J. Thome, A.-C. Ehlis, A. J. Fallgatter, K. Krauel, K. W. Lange, P. Riederer, M. Romanos, R. Taurines, O. Tucha, M. Uzbekov, et\u00a0al. 2012. Biomarkers for attention-deficit\/hyperactivity disorder (ADHD). A consensus report of the WFSBP task force on biological markers and the world federation of ADHD. The World Journal of Biological Psychiatry 13, 5 (2012), 379\u2013400."},{"issue":"4","key":"e_1_3_1_8_2","first-page":"e37559","article-title":"Virtual and augmented reality in post-stroke rehabilitation: A narrative review","volume":"15","author":"Khokale R.","year":"2023","unstructured":"R. Khokale, G. S. Mathew, S. Ahmed, S. Maheen, M. Fawad, P. Bandaru, A. Zerin, Z. Nazir, I. Khawaja, I. Sharif, et\u00a0al. 2023. Virtual and augmented reality in post-stroke rehabilitation: A narrative review. Cureus 15, 4 (2023), e37559.","journal-title":"Cureus"},{"issue":"1","key":"e_1_3_1_9_2","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1186\/s12984-023-01225-5","article-title":"Robotic arm training in neurorehabilitation enhanced by augmented reality\u2014A usability and feasibility study","volume":"20","author":"de Crignis A. C.","year":"2023","unstructured":"A. C. de Crignis, S.-T. Ruhnau, M. H\u00f6sl, J. Lefint, T. Amberger, J. Dressnandt, H. Brunner, and F. M\u00fcller. 2023. Robotic arm training in neurorehabilitation enhanced by augmented reality\u2014A usability and feasibility study. Journal of NeuroEngineering and Rehabilitation 20, 1 (2023), 105.","journal-title":"Journal of NeuroEngineering and Rehabilitation"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207702"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/2838944.2838954"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/2856767.2856773"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.3389\/fdgth.2023.1078511"},{"issue":"1","key":"e_1_3_1_14_2","doi-asserted-by":"crossref","first-page":"56","DOI":"10.3390\/brainsci13010056","article-title":"Sensorimotor rhythm-based brain\u2013computer interfaces for motor tasks used in hand upper extremity rehabilitation after stroke: A systematic review","volume":"13","author":"Fu J.","year":"2022","unstructured":"J. Fu, S. Chen, and J. Jia. 2022. Sensorimotor rhythm-based brain\u2013computer interfaces for motor tasks used in hand upper extremity rehabilitation after stroke: A systematic review. Brain Sciences 13, 1 (2022), 56.","journal-title":"Brain Sciences"},{"issue":"3","key":"e_1_3_1_15_2","doi-asserted-by":"crossref","first-page":"414","DOI":"10.1109\/TCDS.2018.2875052","article-title":"Motor-imagery-based teleoperation of a dual-arm robot performing manipulation tasks","volume":"11","author":"Liu Y.","year":"2018","unstructured":"Y. Liu, W. Su, Z. Li, G. Shi, X. Chu, Y. Kang, and W. Shang. 2018. Motor-imagery-based teleoperation of a dual-arm robot performing manipulation tasks. IEEE Transactions on Cognitive and Developmental Systems 11, 3 (2018), 414\u2013424.","journal-title":"IEEE Transactions on Cognitive and Developmental Systems"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.3390\/math10040618"},{"issue":"5","key":"e_1_3_1_17_2","doi-asserted-by":"crossref","first-page":"056009","DOI":"10.1088\/1741-2560\/11\/5\/056009","article-title":"Detection of the onset of upper-limb movements based on the combined analysis of changes in the sensorimotor rhythms and slow cortical potentials","volume":"11","author":"Ib\u00e1\u00f1ez J.","year":"2014","unstructured":"J. Ib\u00e1\u00f1ez, J. Serrano, M. Del Castillo, E. Monge-Pereira, F. Molina-Rueda, I. Alguacil-Diego, and J. L. Pons. 2014. Detection of the onset of upper-limb movements based on the combined analysis of changes in the sensorimotor rhythms and slow cortical potentials. Journal of Neural Engineering 11, 5 (2014), 056009.","journal-title":"Journal of Neural Engineering"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(12)61816-9"},{"key":"e_1_3_1_19_2","first-page":"1406","article-title":"Effects of task oriented rehabilitation of upper extremity after stroke: A systematic review","volume":"72","author":"Hussain M.","year":"2022","unstructured":"M. Hussain, A. Fatima, A. Ahmad, and S. A. Gilani. 2022. Effects of task oriented rehabilitation of upper extremity after stroke: A systematic review. The Journal of the Pakistan Medical Association 72 (2022), 1406\u20131415.","journal-title":"The Journal of the Pakistan Medical Association"},{"issue":"15","key":"e_1_3_1_20_2","doi-asserted-by":"crossref","first-page":"5865","DOI":"10.3390\/s22155865","article-title":"Concurrent fNIRS and EEG for brain function investigation: A systematic, methodology-focused review","volume":"22","author":"Li R.","year":"2022","unstructured":"R. Li, D. Yang, F. Fang, K.-S. Hong, A. L. Reiss, and Y. Zhang. 2022. Concurrent fNIRS and EEG for brain function investigation: A systematic, methodology-focused review. Sensors 22, 15 (2022), 5865.","journal-title":"Sensors"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1111\/nyas.13948"},{"key":"e_1_3_1_22_2","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1016\/j.trf.2022.11.013","article-title":"Cognitive load, working memory capacity and driving performance: A preliminary fNIRS and eye tracking study","volume":"92","author":"Broadbent D. P.","year":"2023","unstructured":"D. P. Broadbent, G. D\u2019Innocenzo, T. J. Ellmers, J. Parsler, A. J. Szameitat, and D. T. Bishop. 2023. Cognitive load, working memory capacity and driving performance: A preliminary fNIRS and eye tracking study. Transportation Research Part F: Traffic Psychology and Behaviour 92 (2023), 121\u2013132.","journal-title":"Transportation Research Part F: Traffic Psychology and Behaviour"},{"issue":"4","key":"e_1_3_1_23_2","doi-asserted-by":"crossref","first-page":"713","DOI":"10.5114\/biolsport.2021.103571","article-title":"The use of muscle near-infrared spectroscopy (NIRS) to assess the aerobic training loads of world-class rowers","volume":"38","author":"Klusiewicz A.","year":"2021","unstructured":"A. Klusiewicz, K. R\u0119bi\u015b, M. Ozimek, and A. Czaplicki. 2021. The use of muscle near-infrared spectroscopy (NIRS) to assess the aerobic training loads of world-class rowers. Biology of Sport 38, 4 (2021), 713\u2013719.","journal-title":"Biology of Sport"},{"issue":"1","key":"e_1_3_1_24_2","doi-asserted-by":"crossref","first-page":"6336","DOI":"10.1038\/s41598-020-63297-w","article-title":"New insights into mechanical, metabolic and muscle oxygenation signals during and after high-intensity tethered running","volume":"10","author":"Manchado-Gobatto F.","year":"2020","unstructured":"F. Manchado-Gobatto, A. Marostegan, F. Rasteiro, C. Cirino, J. Cruz, M. Moreno, and C. Gobatto. 2020. New insights into mechanical, metabolic and muscle oxygenation signals during and after high-intensity tethered running. Scientific Reports 10, 1 (2020), 6336.","journal-title":"Scientific Reports"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.3389\/fneur.2019.00058"},{"key":"e_1_3_1_26_2","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1007\/BF00599514","article-title":"Changes in muscle oxygenation during weight-lifting exercise","volume":"68","author":"Tamaki T.","year":"1994","unstructured":"T. Tamaki, S. Uchiyama, T. Tamura, and S. Nakano. 1994. Changes in muscle oxygenation during weight-lifting exercise. European Journal of Applied Physiology and Occupational Physiology 68 (1994), 465\u2013469.","journal-title":"European Journal of Applied Physiology and Occupational Physiology"},{"issue":"03","key":"e_1_3_1_27_2","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1055\/s-2000-8880","article-title":"Comparison of muscle oxygen consumption measured by near infrared continuous wave spectroscopy during supramaximal and intermittent pedalling exercise","volume":"21","author":"Bae S. Y.","year":"2000","unstructured":"S. Y. Bae, T. Hamaoka, T. Katsumura, T. Shiga, H. Ohno, and S. Haga. 2000. Comparison of muscle oxygen consumption measured by near infrared continuous wave spectroscopy during supramaximal and intermittent pedalling exercise. International Journal of Sports Medicine 21, 03 (2000), 168\u2013174.","journal-title":"International Journal of Sports Medicine"},{"issue":"1","key":"e_1_3_1_28_2","first-page":"2796815","article-title":"Hand passive mobilization performed with robotic assistance: Acute effects on upper limb perfusion and spasticity in stroke survivors","volume":"2017","author":"Gobbo M.","year":"2017","unstructured":"M. Gobbo, P. Gaffurini, L. Vacchi, S. Lazzarini, J. Villafane, C. Orizio, S. Negrini, and L. Bissolotti. 2017. Hand passive mobilization performed with robotic assistance: Acute effects on upper limb perfusion and spasticity in stroke survivors. BioMed Research International 2017, 1 (2017), 2796815.","journal-title":"BioMed Research International"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2017.12.002"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNSRE.2022.3194600"},{"issue":"2","key":"e_1_3_1_31_2","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1007\/s11257-022-09348-5","article-title":"Design, development, and evaluation of an interactive personalized social robot to monitor and coach post-stroke rehabilitation exercises","volume":"33","author":"Lee M. H.","year":"2023","unstructured":"M. H. Lee, D. P. Siewiorek, A. Smailagic, A. Bernardino, and S. B. I Badia. 2023. Design, development, and evaluation of an interactive personalized social robot to monitor and coach post-stroke rehabilitation exercises. User Modeling and User-Adapted Interaction 33, 2 (2023), 545.","journal-title":"User Modeling and User-Adapted Interaction"},{"issue":"3","key":"e_1_3_1_32_2","doi-asserted-by":"crossref","first-page":"e13745","DOI":"10.1016\/j.heliyon.2023.e13745","article-title":"Improvement of brain\u2013computer interface in motor imagery training through the designing of a dynamic experiment and FBCSP","volume":"9","author":"Lin C.-L.","year":"2023","unstructured":"C.-L. Lin and L.-T. Chen. 2023. Improvement of brain\u2013computer interface in motor imagery training through the designing of a dynamic experiment and FBCSP. Heliyon 9, 3 (2023), e13745.","journal-title":"Heliyon"}],"container-title":["ACM Transactions on Applied Perception"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3799698","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T13:49:44Z","timestamp":1776347384000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3799698"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,16]]},"references-count":31,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2026,4,30]]}},"alternative-id":["10.1145\/3799698"],"URL":"https:\/\/doi.org\/10.1145\/3799698","relation":{},"ISSN":["1544-3558","1544-3965"],"issn-type":[{"value":"1544-3558","type":"print"},{"value":"1544-3965","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,16]]},"assertion":[{"value":"2024-12-27","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-02-09","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-04-16","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}