{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T04:40:32Z","timestamp":1773117632478,"version":"3.50.1"},"reference-count":25,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2021,1,25]],"date-time":"2021-01-25T00:00:00Z","timestamp":1611532800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>With an ageing society comes the increased prevalence of gait disorders. The restriction of mobility leads to a considerable reduction in the quality of life, because associated falls increase morbidity and mortality. Consideration of gait analysis data often alters surgical recommendations. For that reason, the early and systematic diagnostic treatment of gait disorders can spare a lot of suffering. As modern gait analysis systems are, in most cases, still very costly, many patients are not privileged enough to have access to comparable therapies. Low-cost systems such as inertial measurement units (IMUs) still pose major challenges, but offer possibilities for automatic real-time motion analysis. In this paper, we present a new approach to reliably detect human gait phases, using IMUs and machine learning methods. This approach should form the foundation of a new medical device to be used for gait analysis. A model is presented combining deep 2D-convolutional and LSTM networks to perform a classification task; it predicts the current gait phase with an accuracy of over 92% on an unseen subject, differentiating between five different phases. In the course of the paper, different approaches to optimize the performance of the model are presented and evaluated.<\/jats:p>","DOI":"10.3390\/s21030789","type":"journal-article","created":{"date-parts":[[2021,1,25]],"date-time":"2021-01-25T12:28:31Z","timestamp":1611577711000},"page":"789","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":40,"title":["Deep Convolutional and LSTM Networks on Multi-Channel Time Series Data for Gait Phase Recognition"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2394-4103","authenticated-orcid":false,"given":"David","family":"Kreuzer","sequence":"first","affiliation":[{"name":"Institute for Medical Engineering and Mechatronic, Ulm University of Applied Sciences, 89081 Ulm, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3427-3827","authenticated-orcid":false,"given":"Michael","family":"Munz","sequence":"additional","affiliation":[{"name":"Institute for Medical Engineering and Mechatronic, Ulm University of Applied Sciences, 89081 Ulm, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2021,1,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1007\/s00586-010-1639-8","article-title":"Gait adaptations in low back pain patients with lumbar disc herniation: Trunk coordination and arm swing","volume":"20","author":"Huang","year":"2010","journal-title":"Eur. Spine J."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1016\/j.gaitpost.2018.10.003","article-title":"Impact of gait analysis on pathology identification and surgical recommendations in children with spina bifida","volume":"67","author":"Mueske","year":"2019","journal-title":"Gait Posture"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1111\/j.1532-5415.2005.00580.x","article-title":"Epidemiology of Gait Disorders in Community-Residing Older Adults","volume":"54","author":"Verghese","year":"2006","journal-title":"J. Am. Geriatr. Soc."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/CC.2015.7114054","article-title":"Healthcare algorithms by wearable inertial sensors: A survey","volume":"12","author":"Buke","year":"2015","journal-title":"China Commun."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"657","DOI":"10.1016\/j.gaitpost.2012.06.017","article-title":"Gait phase detection and discrimination between walking-jogging activities using hidden Markov models applied to foot motion data from a gyroscope","volume":"36","author":"Mannini","year":"2012","journal-title":"Gait Posture"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"16212","DOI":"10.3390\/s140916212","article-title":"A Novel HMM Distributed Classifier for the Detection of Gait Phases by Means of a Wearable Inertial Sensor Network","volume":"14","author":"Taborri","year":"2014","journal-title":"Sensors"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Nguyen, M.D., Mun, K., Jung, D., Han, J., Park, M., Kim, J., and Kim, J. (2020, January 4\u20136). IMU-based Spectrogram Approach with Deep Convolutional Neural Networks for Gait Classification. Proceedings of the 2020 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA.","DOI":"10.1109\/ICCE46568.2020.9042999"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2776","DOI":"10.3390\/s140202776","article-title":"Online Phase Detection Using Wearable Sensors for Walking with a Robotic Prosthesis","volume":"14","author":"Kamnik","year":"2014","journal-title":"Sensors"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zebin, T., Peek, N., Casson, A., and Sperrin, M. (2018, January 18\u201321). Human activity recognition from inertial sensor time-series using batch normalized deep LSTM recurrent networks. Proceedings of the 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Honolulu, HI, USA.","DOI":"10.1109\/EMBC.2018.8513115"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Vaith, A., Taetz, B., and Bleser, G. (2020, January 6\u20139). Uncertainty based active learning with deep neural networks for inertial gait analysis. Proceedings of the 2020 IEEE 23rd International Conference on Information Fusion (FUSION), Rustenburg, South Africa.","DOI":"10.23919\/FUSION45008.2020.9190449"},{"key":"ref_11","unstructured":"Yang, J.B., Nguyen, M.N., San, P.P., Li, X.L., and Krishnaswamy, S. (2015, January 25\u201331). Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition. Proceedings of the 24th International Conference on Artificial Intelligence (IJCAI\u201915), Buenos Aires, Argentina."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Moya Rueda, F., Grzeszick, R., Fink, G., Feldhorst, S., and Hompel, M. (2018). Convolutional Neural Networks for Human Activity Recognition Using Body-Worn Sensors. Informatics, 5.","DOI":"10.3390\/informatics5020026"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ord\u00f3\u00f1ez, F.J., and Roggen, D. (2016). Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition. Sensors, 16.","DOI":"10.3390\/s16010115"},{"key":"ref_14","unstructured":"Zou, Q., Wang, Y., Zhao, Y., Wang, Q., Shen, C., and Li, Q. (2018). Deep Learning Based Gait Recognition Using Smartphones in the Wild. arXiv."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Martinez-Hernandez, U., Solis, A.R., and Dehghani, A. (2018, January 26\u201329). Recognition of Walking Activity and Prediction of Gait Periods with a CNN and First-Order MC Strategy. Proceedings of the 2018 7th IEEE International Conference on Biomedical Robotics and Biomechatronics (Biorob), Enschede, The Netherlands.","DOI":"10.1109\/BIOROB.2018.8487220"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Jeon, H., Kim, S.L., Kim, S., and Lee, D. (2020). Fast Wearable Sensor\u2013Based Foot\u2013Ground Contact Phase Classification Using a Convolutional Neural Network with Sliding-Window Label Overlapping. Sensors, 20.","DOI":"10.3390\/s20174996"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Coviello, G., Avitabile, G., and Florio, A. (2020). A Synchronized Multi-Unit Wireless Platform for Long-Term Activity Monitoring. Electronics, 9.","DOI":"10.3390\/electronics9071118"},{"key":"ref_18","unstructured":"O\u2019Shea, K., and Nash, R. (2015). An Introduction to Convolutional Neural Networks. arXiv."},{"key":"ref_19","unstructured":"Sherstinsky, A. (2018). Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network. arXiv."},{"key":"ref_20","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. ImageNet Classification with Deep Convolutional Neural Networks, Curran Associates Inc.. 3\u20138 December 2012."},{"key":"ref_21","unstructured":"Glorot, X., and Bengio, Y. (2010, January 13\u201315). Understanding the difficulty of training deep feedforward neural networks. Proceedings of the International Conference on Artificial Intelligence and Statistics (AISTATS\u201910), Sardinia, Italy."},{"key":"ref_22","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv."},{"key":"ref_23","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, The MIT Press."},{"key":"ref_24","unstructured":"Guo, C., Pleiss, G., Sun, Y., and Weinberger, K.Q. (2017). On Calibration of Modern Neural Networks. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Berrar, D. (2018). Cross-Validation, Elsevier.","DOI":"10.1016\/B978-0-12-809633-8.20349-X"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/3\/789\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:15:01Z","timestamp":1760159701000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/3\/789"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,25]]},"references-count":25,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["s21030789"],"URL":"https:\/\/doi.org\/10.3390\/s21030789","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,25]]}}}