{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,8]],"date-time":"2026-07-08T15:55:52Z","timestamp":1783526152017,"version":"3.55.0"},"reference-count":50,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2023,12,29]],"date-time":"2023-12-29T00:00:00Z","timestamp":1703808000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["2017R1C1B5076731"],"award-info":[{"award-number":["2017R1C1B5076731"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["GCU-202008440009"],"award-info":[{"award-number":["GCU-202008440009"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Gachon University research fund","award":["2017R1C1B5076731"],"award-info":[{"award-number":["2017R1C1B5076731"]}]},{"name":"Gachon University research fund","award":["GCU-202008440009"],"award-info":[{"award-number":["GCU-202008440009"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Measuring the daily use of an affected limb after hospital discharge is crucial for hemiparetic stroke rehabilitation. Classifying movements using non-intrusive wearable sensors provides context for arm use and is essential for the development of a home rehabilitation system. However, the movement classification of stroke patients poses unique challenges, including variability and sparsity. To address these challenges, we collected movement data from 15 hemiparetic stroke patients (Stroke group) and 29 non-disabled individuals (ND group). The participants performed two different tasks, the range of motion (14 movements) task and the activities of daily living (56 movements) task, wearing five inertial measurement units in a home setting. We trained a 1D convolutional neural network and evaluated its performance for different training groups: ND-only, Stroke-only, and ND and Stroke jointly. We further compared the model performance with data augmentation from axis rotation and investigated how the performance varied based on the asymmetry of movements. The joint training of ND + Stroke yielded an increased F1-score by a margin of 31.6% and 10.6% compared to ND-only training and Stroke-only training, respectively. Data augmentation further enhanced F1-scores across all conditions by an average of 11.3%. Finally, asymmetric movements decreased the F1-score by 25.9% compared to symmetric movements in the Stroke group, indicating the importance of asymmetry in movement classification.<\/jats:p>","DOI":"10.3390\/s24010210","type":"journal-article","created":{"date-parts":[[2023,12,29]],"date-time":"2023-12-29T11:19:21Z","timestamp":1703848761000},"page":"210","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Investigating Activity Recognition for Hemiparetic Stroke Patients Using Wearable Sensors: A Deep Learning Approach with Data Augmentation"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9040-9170","authenticated-orcid":false,"given":"Youngmin","family":"Oh","sequence":"first","affiliation":[{"name":"School of Computing, Gachon University, Seongnam 13120, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sol-A","family":"Choi","sequence":"additional","affiliation":[{"name":"Department of Physical Therapy, Jeonju University, Jeonju 55069, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yumi","family":"Shin","sequence":"additional","affiliation":[{"name":"Department of Physical Therapy, Jeonju University, Jeonju 55069, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yeonwoo","family":"Jeong","sequence":"additional","affiliation":[{"name":"Department of Physical Therapy, Jeonju University, Jeonju 55069, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jongkuk","family":"Lim","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Dankook University, Yongin 16890, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5222-4538","authenticated-orcid":false,"given":"Sujin","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Physical Therapy, Jeonju University, Jeonju 55069, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,12,29]]},"reference":[{"key":"ref_1","first-page":"241","article-title":"The Learned Nonuse Phenomenon: Implications for Rehabilitation","volume":"42","author":"Taub","year":"2006","journal-title":"Eur. Medicophys."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.1212\/01.wnl.0000238164.90657.c2","article-title":"The Motor Activity Log-28: Assessing Daily Use of the Hemiparetic Arm after Stroke","volume":"67","author":"Uswatte","year":"2006","journal-title":"Neurology"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2181","DOI":"10.1161\/01.STR.0000087172.16305.CD","article-title":"Probability of Regaining Dexterity in the Flaccid Upper Limb: Impact of Severity of Paresis and Time since Onset in Acute Stroke","volume":"34","author":"Kwakkel","year":"2003","journal-title":"Stroke"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1957","DOI":"10.1016\/j.apmr.2012.05.011","article-title":"Relationship between Arm Usage and Instrumental Activities of Daily Living after Unilateral Stroke","volume":"93","author":"Haaland","year":"2012","journal-title":"Arch. Phys. Med. Rehabil."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1327","DOI":"10.2522\/ptj.20080402","article-title":"A Functional Threshold for Long-Term Use of Hand and Arm Function Can Be Determined: Predictions from a Computational Model and Supporting Data from the Extremity Constraint-Induced Therapy Evaluation (EXCITE) Trial","volume":"89","author":"Schweighofer","year":"2009","journal-title":"Phys. Ther."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Hidaka, Y., Han, C.E., Wolf, S.L., Winstein, C.J., and Schweighofer, N. (2012). Use It and Improve It or Lose It: Interactions between Arm Function and Use in Humans Post-Stroke. PLoS Comput. Biol., 8.","DOI":"10.1371\/journal.pcbi.1002343"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"e184","DOI":"10.2196\/jmir.7385","article-title":"Activity Recognition for Persons with Stroke Using Mobile Phone Technology: Toward Improved Performance in a Home Setting","volume":"19","author":"Shawen","year":"2017","journal-title":"J. Med. Internet Res."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2100411","DOI":"10.1109\/JTEHM.2018.2829208","article-title":"Enabling Stroke Rehabilitation in Home and Community Settings: A Wearable Sensor-Based Approach for Upper-Limb Motor Training","volume":"6","author":"Lee","year":"2018","journal-title":"IEEE J. Transl. Eng. Health Med."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"662","DOI":"10.1161\/01.STR.31.3.662","article-title":"Objective Measurement of Functional Upper-Extremity Movement Using Accelerometer Recordings Transformed with a Threshold Filter","volume":"31","author":"Uswatte","year":"2000","journal-title":"Stroke"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Parnandi, A., Wade, E., and Mataric, M. (September, January 31). Functional Score Estimation of Post-Stroke Assessment Test from Wearable Inertial Sensor Data. Proceedings of the 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Buenos Aires, Argentina.","DOI":"10.1109\/IEMBS.2010.5626156"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1016\/j.apmr.2022.09.003","article-title":"The Essential Role of Social Context and Self-Efficacy in Daily Paretic Arm\/Hand Use after Stroke: An Ecological Momentary Assessment Study with Accelerometry","volume":"104","author":"Chen","year":"2022","journal-title":"Arch. Phys. Med. Rehabil."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2100310","DOI":"10.1109\/JTEHM.2019.2897306","article-title":"Use of Accelerometry for Long Term Monitoring of Stroke Patients","volume":"7","author":"Lucas","year":"2019","journal-title":"IEEE J. Transl. Eng. Health Med."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"505","DOI":"10.1007\/s11042-014-2010-6","article-title":"Max-Margin Adaptive Model for Complex Video Pattern Recognition","volume":"74","author":"Yu","year":"2015","journal-title":"Multimed. Tools Appl."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1186\/s12984-019-0612-y","article-title":"Wearable Technology in Stroke Rehabilitation: Towards Improved Diagnosis and Treatment of Upper-Limb Motor Impairment","volume":"16","author":"Popa","year":"2019","journal-title":"J. Neuroeng. Rehabil."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2499621","article-title":"A Tutorial on Human Activity Recognition Using Body-Worn Inertial Sensors","volume":"46","author":"Bulling","year":"2014","journal-title":"ACM Comput. Surv."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1038\/s41746-020-00328-w","article-title":"Enabling Precision Rehabilitation Interventions Using Wearable Sensors and Machine Learning to Track Motor Recovery","volume":"3","author":"Hankov","year":"2020","journal-title":"NPJ Digit. Med."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Lee, T.K.M., Leo, K.-H., Sanel, S., Chew, E., and Zhao, L. (September, January 28). Triaxial Rehabilitative Data Analysis Incorporating Matching Pursuit. Proceedings of the 2017 25th European Signal Processing Conference (EUSIPCO), Kos, Greece.","DOI":"10.23919\/EUSIPCO.2017.8081244"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1158","DOI":"10.1109\/TNSRE.2021.3089613","article-title":"Quantification of Motor Function Post-Stroke Using Novel Combination of Wearable Inertial and Mechanomyographic Sensors","volume":"29","author":"Formstone","year":"2021","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"3026","DOI":"10.1109\/TBME.2019.2899927","article-title":"Rehab-Net: Deep Learning Framework for Arm Movement Classification Using Wearable Sensors for Stroke Rehabilitation","volume":"66","author":"Panwar","year":"2019","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_20","unstructured":"Kaku, A., Parnandi, A., Venkatesan, A., Pandit, N., Schambra, H., and Fernandez-Granda, C. (2020, January 7\u20138). Towards Data-Driven Stroke Rehabilitation via Wearable Sensors and Deep Learning. Proceedings of the 5th Machine Learning for Healthcare Conference, Virtual."},{"key":"ref_21","unstructured":"Boukhennoufa, I., Zhai, X., Utti, V., Jackson, J., and McDonald-Maier, K.D. (November, January 1). A Comprehensive Evaluation of State-of-the-Art Time-Series Deep Learning Models for Activity-Recognition in Post-Stroke Rehabilitation Assessment. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS), Virtual."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"107398","DOI":"10.1016\/j.ymssp.2020.107398","article-title":"1D Convolutional Neural Networks and Applications: A Survey","volume":"151","author":"Kiranyaz","year":"2021","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long Short-Term Memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Cho, K., Van Merri\u00ebnboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. (2014). Learning Phrase Representations Using RNN Encoder-Decoder for Statistical Machine Translation. arXiv.","DOI":"10.3115\/v1\/D14-1179"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhang, S., Li, Y., Zhang, S., Shahabi, F., Xia, S., Deng, Y., and Alshurafa, N. (2022). Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances. Sensors, 22.","DOI":"10.3390\/s22041476"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1310\/NCB1-JWAA-09QE-7TXB","article-title":"Bimanual Training After Stroke: Are Two Hands Better Than One?","volume":"11","author":"Rose","year":"2004","journal-title":"Top. Stroke Rehabil."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1191\/0269215505cr896oa","article-title":"Effectiveness of Unilateral and Symmetrical Bilateral Task Training for Arm during the Subacute Phase after Stroke: A Randomized Controlled Trial","volume":"19","author":"Desrosiers","year":"2005","journal-title":"Clin. Rehabil."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"106","DOI":"10.2340\/16501977-0928","article-title":"Unilateral versus Bilateral Upper Limb Exercise Therapy after Stroke: A Systematic Review","volume":"44","author":"Peper","year":"2012","journal-title":"J. Rehabil. Med."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"969","DOI":"10.1177\/1545968315583720","article-title":"Quantifying Real-World Upper-Limb Activity in Nondisabled Adults and Adults with Chronic Stroke","volume":"29","author":"Bailey","year":"2015","journal-title":"Neurorehabilit. Neural Repair"},{"key":"ref_30","first-page":"216","article-title":"Data Augmentation of Wearable Sensor Data for Parkinson\u2019s Disease Monitoring Using Convolutional Neural Networks","volume":"Volume 2017","author":"Um","year":"2017","journal-title":"Proceedings of the 19th ACM International Conference on Multimodal Interaction(ICMI 2017)"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1831","DOI":"10.1161\/STROKEAHA.118.023603","article-title":"Dosage Matters: A Phase IIb Randomized Controlled Trial of Motor Therapy in the Chronic Phase after Stroke","volume":"50","author":"Winstein","year":"2019","journal-title":"Stroke"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/0028-3932(71)90067-4","article-title":"The Assessment and Analysis of Handedness: The Edinburgh Inventory","volume":"9","author":"Oldfield","year":"1971","journal-title":"Neuropsychologia"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"13","DOI":"10.2340\/1650197771331","article-title":"The Post-Stroke Hemiplegic Patient. 1. a Method for Evaluation of Physical Performance","volume":"7","author":"Leyman","year":"1975","journal-title":"Scand. J. Rehabil. Med."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1177\/1545968311425048","article-title":"Minimal Detectable Change of the Actual Amount of Use Test and the Motor Activity Log: The EXCITE Trial","volume":"26","author":"Chen","year":"2012","journal-title":"Neurorehabil. Neural Repair"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"571","DOI":"10.1001\/jama.2016.0276","article-title":"Effect of a Task-Oriented Rehabilitation Program on Upper Extremity Recovery Following Motor Stroke: The ICARE Randomized Clinical Trial","volume":"315","author":"Winstein","year":"2016","journal-title":"JAMA"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1635","DOI":"10.1161\/01.STR.32.7.1635","article-title":"Assessing Wolf Motor Function Test as Outcome Measure for Research in Patients After Stroke","volume":"32","author":"Wolf","year":"2001","journal-title":"Stroke"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"787","DOI":"10.2340\/16501977-0276","article-title":"Evaluation of Functional Outcome Measures for the Hemiparetic Upper Limb: A Systematic Review","volume":"40","author":"Ashford","year":"2008","journal-title":"J. Rehabil. Med."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"e12","DOI":"10.1093\/geront\/gnz147","article-title":"A Comprehensive Overview of Activities of Daily Living in Existing Frailty Instruments: A Systematic Literature Search","volume":"61","author":"Costenoble","year":"2021","journal-title":"Gerontologist"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-Based Learning Applied to Document Recognition","volume":"86","author":"Lecun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"ImageNet Classification with Deep Convolutional Neural Networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_41","unstructured":"Le, Q.V., Jaitly, N., and Hinton, G.E. (2015). A Simple Way to Initialize Recurrent Networks of Rectified Linear Units. arXiv."},{"key":"ref_42","first-page":"1929","article-title":"Dropout: A Simple Way to Prevent Neural Networks from Overfitting","volume":"5","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1186\/s40537-019-0197-0","article-title":"A Survey on Image Data Augmentation for Deep Learning","volume":"6","author":"Shorten","year":"2019","journal-title":"J. Big Data"},{"key":"ref_44","unstructured":"Loshchilov, I., and Hutter, F. (2017). Decoupled Weight Decay Regularization. arXiv."},{"key":"ref_45","unstructured":"Raudenbush, S.W., and Bryk, A.S. (2001). Hierarchical Linear Models: Applications and Data Analysis Methods (Vol. 1), SAGE Publications. [2nd ed.]."},{"key":"ref_46","unstructured":"R Core Team (2013). R: A Language and Environment for Statistical Computing, The R Foundation."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"2880","DOI":"10.1016\/j.jstrokecerebrovasdis.2017.07.004","article-title":"Measuring Functional Arm Movement after Stroke Using a Single Wrist-Worn Sensor and Machine Learning","volume":"26","author":"Bochniewicz","year":"2017","journal-title":"J. Stroke Cerebrovasc. Dis."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Chen, P.W., Baune, N.A., Zwir, I., Wang, J., Swamidass, V., and Wong, A.W.K. (2021). Measuring Activities of Daily Living in Stroke Patients with Motion Machine Learning Algorithms: A Pilot Study. Int. J. Environ. Res. Public Health, 18.","DOI":"10.3390\/ijerph18041634"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"30283","DOI":"10.1109\/ACCESS.2021.3055960","article-title":"Upper Limb Rehabilitation System for Stroke Survivors Based on Multi-Modal Sensors and Machine Learning","volume":"9","author":"Miao","year":"2021","journal-title":"IEEE Access"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Boukhennoufa, I., Zhai, X., Utti, V., Jackson, J., and McDonald-Maier, K.D. (2022). Wearable Sensors and Machine Learning in Post-Stroke Rehabilitation Assessment: A Systematic Review. Biomed. Signal Process. Control, 71.","DOI":"10.1016\/j.bspc.2021.103197"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/1\/210\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:44:27Z","timestamp":1760132667000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/1\/210"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,29]]},"references-count":50,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,1]]}},"alternative-id":["s24010210"],"URL":"https:\/\/doi.org\/10.3390\/s24010210","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,29]]}}}