{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,7]],"date-time":"2026-04-07T16:33:55Z","timestamp":1775579635097,"version":"3.50.1"},"reference-count":36,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2018,5,25]],"date-time":"2018-05-25T00:00:00Z","timestamp":1527206400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Informatics"],"abstract":"<jats:p>Human activity recognition (HAR) is a classification task for recognizing human movements. Methods of HAR are of great interest as they have become tools for measuring occurrences and durations of human actions, which are the basis of smart assistive technologies and manual processes analysis. Recently, deep neural networks have been deployed for HAR in the context of activities of daily living using multichannel time-series. These time-series are acquired from body-worn devices, which are composed of different types of sensors. The deep architectures process these measurements for finding basic and complex features in human corporal movements, and for classifying them into a set of human actions. As the devices are worn at different parts of the human body, we propose a novel deep neural network for HAR. This network handles sequence measurements from different body-worn devices separately. An evaluation of the architecture is performed on three datasets, the Oportunity, Pamap2, and an industrial dataset, outperforming the state-of-the-art. In addition, different network configurations will also be evaluated. We find that applying convolutions per sensor channel and per body-worn device improves the capabilities of convolutional neural network (CNNs).<\/jats:p>","DOI":"10.3390\/informatics5020026","type":"journal-article","created":{"date-parts":[[2018,5,28]],"date-time":"2018-05-28T03:54:21Z","timestamp":1527479661000},"page":"26","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":153,"title":["Convolutional Neural Networks for Human Activity Recognition Using Body-Worn Sensors"],"prefix":"10.3390","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8115-5968","authenticated-orcid":false,"given":"Fernando","family":"Moya Rueda","sequence":"first","affiliation":[{"name":"Department of Computer Science, TU Dortmund University, 44227 Dortmund, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7934-7469","authenticated-orcid":false,"given":"Ren\u00e9","family":"Grzeszick","sequence":"additional","affiliation":[{"name":"Department of Computer Science, TU Dortmund University, 44227 Dortmund, Germany"},{"name":"Fraunhofer IML, 44227 Dortmund, Germany"}]},{"given":"Gernot A.","family":"Fink","sequence":"additional","affiliation":[{"name":"Department of Computer Science, TU Dortmund University, 44227 Dortmund, Germany"}]},{"given":"Sascha","family":"Feldhorst","sequence":"additional","affiliation":[{"name":"Fraunhofer IML, 44227 Dortmund, Germany"}]},{"given":"Michael","family":"Ten Hompel","sequence":"additional","affiliation":[{"name":"Fraunhofer IML, 44227 Dortmund, Germany"},{"name":"Department of Mechanical Engineering, TU Dortmund University, 44227 Dortmund, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2018,5,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Feichtenhofer, C., Pinz, A., and Zisserman, A. (arXiv, 2016). Convolutional two-stream network fusion for video action recognition, arXiv.","DOI":"10.1109\/CVPR.2016.213"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Zeng, M., Nguyen, L.T., Yu, B., Mengshoel, O.J., Zhu, J., Wu, P., and Zhang, J. (2014, January 6\u20137). Convolutional neural networks for human activity recognition using mobile sensors. Proceedings of the 2014 6th International Conference on Mobile Computing, Applications and Services (MobiCASE), Austin, TX, USA.","DOI":"10.4108\/icst.mobicase.2014.257786"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Ronao, C.A., and Cho, S.B. (2015, January 9\u201312). Deep convolutional neural networks for human activity recognition with smartphone sensors. Proceedings of the International Conference on Neural Information Processing, Istanbul, Turkey.","DOI":"10.1007\/978-3-319-26561-2_6"},{"key":"ref_4","unstructured":"Yang, J., Nguyen, M.N., San, P.P., Li, X., and Krishnaswamy, S. (2015, January 25\u201331). Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition. Proceedings of the 24th International Conference on Artificial Intelligence (IJCAI\u201915 ), Buenos Aires, Argentina."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ord\u00f3\u00f1ez, F.J., and Roggen, D. (2016). Deep convolutional and LSTM recurrent neural networks for multimodal wearable activity recognition. Sensors, 16.","DOI":"10.3390\/s16010115"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1145\/2499621","article-title":"A tutorial on human activity recognition using body-worn inertial sensors","volume":"46","author":"Bulling","year":"2014","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1192","DOI":"10.1109\/SURV.2012.110112.00192","article-title":"A Survey on Human Activity Recognition Using Wearable Sensors","volume":"15","author":"Lara","year":"2013","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Feldhorst, S., Masoudenijad, M., ten Hompel, M., and Fink, G.A. (2016, January 24\u201326). Motion Classification for Analyzing the Order Picking Process using Mobile Sensors. Proceedings of the 5th International Conference on Pattern Recognition Applications and Methods, Rome, Italy.","DOI":"10.5220\/0005828407060713"},{"key":"ref_9","unstructured":"Hammerla, N.Y., Halloran, S., and Ploetz, T. (arXiv, 2016). Deep, convolutional, and recurrent models for human activity recognition using wearables, arXiv."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1016\/j.patcog.2017.12.024","article-title":"Efficient Dense Labelling of Human Activity Sequences from Wearables using Fully Convolutional Networks","volume":"78","author":"Yao","year":"2018","journal-title":"Pattern Recogn."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Grzeszick, R., Lenk, J.M., Moya Rueda, F., Fink, G.A., Feldhorst, S., and ten Hompel, M. (2017, January 21\u201322). Deep Neural Network based Human Activity Recognition for the Order Picking Process. Proceedings of the 4th International Workshop on Sensor-based Activity Recognition and Interaction, Rostock, Germany.","DOI":"10.1145\/3134230.3134231"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Roggen, D., Cuspinera, L.P., Pombo, G., Ali, F., and Nguyen-Dinh, L.V. (2015, January 9\u201311). Limited-memory warping LCSS for real-time low-power pattern recognition in wireless nodes. Proceedings of the European Conference on Wireless Sensor Networks, Porto, Portugal.","DOI":"10.1007\/978-3-319-15582-1_10"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1109\/MPRV.2014.52","article-title":"In-home activity recognition: Bayesian inference for hidden Markov models","volume":"13","author":"Ordonez","year":"2014","journal-title":"IEEE Pervasive Comput."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Huynh, T., and Schiele, B. (2005, January 12\u201314). Analyzing features for activity recognition. Proceedings of the 2005 Joint Conference on Smart Objects and Ambient Intelligence: Innovative Context-Aware Services: Usages and Technologies, Grenoble, France.","DOI":"10.1145\/1107548.1107591"},{"key":"ref_15","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. ImageNet classification with deep convolutional neural networks. Proceedings of the 25th International Conference on Neural Information Processing Systems."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_17","unstructured":"Badrinarayanan, V., Handa, A., and Cipolla, R. (arXiv, 2015). Segnet: A deep convolutional encoder-decoder architecture for robust semantic pixel-wise labelling, arXiv."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2552","DOI":"10.1109\/TPAMI.2014.2339814","article-title":"Word spotting and recognition with embedded attributes","volume":"36","author":"Gordo","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Sudholt, S., and Fink, G.A. (2016, January 23\u201326). PHOCNet: A Deep Convolutional Neural Network for Word Spotting in Handwritten Documents. Proceedings of the International Conference on Frontiers in Handwriting Recognition, Shenzhen, China.","DOI":"10.1109\/ICFHR.2016.0060"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Wu, C., Ng, R.W., Torralba, O.S., and Hain, T. (2017, January 22\u201324). Analysing acoustic model changes for active learning in automatic speech recognition. Proceedings of the 2017 International Conference on Systems, Signals and Image Processing (IWSSIP), Poznan, Poland.","DOI":"10.1109\/IWSSIP.2017.7965609"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_22","unstructured":"Graves, A. (arXiv, 2013). Generating sequences with recurrent neural networks, arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Ravi, D., Wong, C., Lo, B., and Yang, G.Z. (2016, January 14\u201317). Deep learning for human activity recognition: A resource efficient implementation on low-power devices. Proceedings of the 2016 IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks (BSN), San Francisco, CA, USA.","DOI":"10.1109\/BSN.2016.7516235"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1109\/JBHI.2016.2633287","article-title":"A deep learning approach to on-node sensor data analytics for mobile or wearable devices","volume":"21","author":"Ravi","year":"2017","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1016\/0031-3203(82)90024-3","article-title":"Neocognitron: A new algorithm for pattern recognition tolerant of deformations and shifts in position","volume":"15","author":"Fukushima","year":"1982","journal-title":"Pattern Recogn."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"LeCun, Y., Kavukcuoglu, K., and Farabet, C. (June, January 30). Convolutional networks and applications in vision. Proceedings of the 2010 IEEE International Symposium on Circuits and Systems (ISCAS), Paris, France.","DOI":"10.1109\/ISCAS.2010.5537907"},{"key":"ref_27","unstructured":"(2018, March 06). OPPORTUNITY Activity Recognition Data Set. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/opportunity+activity+recognition."},{"key":"ref_28","unstructured":"(2017, November 30). PAMAP2 Physical Activity Monitoring Data Set. Available online: http:\/\/archive.ics.uci.edu\/ml\/datasets\/pamap2+physical+activity+monitoring."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Roggen, D., Calatroni, A., Rossi, M., Holleczek, T., F\u00f6rster, K., Tr\u00f6ster, G., Lukowicz, P., Bannach, D., Pirkl, G., and Ferscha, A. (2010, January 15\u201318). Collecting complex activity datasets in highly rich networked sensor environments. Proceedings of the 2010 Seventh International Conference on Networked Sensing Systems (INSS), Kassel, Germany.","DOI":"10.1109\/INSS.2010.5573462"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2033","DOI":"10.1016\/j.patrec.2012.12.014","article-title":"The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition","volume":"34","author":"Chavarriaga","year":"2013","journal-title":"Pattern Recogn. Lett."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Reiss, A., and Stricker, D. (2012, January 18\u201322). Introducing a new benchmarked dataset for activity monitoring. Proceedings of the 2012 16th International Symposium on Wearable Computers (ISWC), Newcastle, UK.","DOI":"10.1109\/ISWC.2012.13"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., and Darrell, T. (arXiv, 2014). Caffe: Convolutional Architecture for Fast Feature Embedding, arXiv.","DOI":"10.1145\/2647868.2654889"},{"key":"ref_33","unstructured":"Saxe, A.M., McClelland, J.L., and Ganguli, S. (arXiv, 2013). Exact solutions to the nonlinear dynamics of learning in deep linear neural networks, arXiv."},{"key":"ref_34","unstructured":"Rippel, O., Snoek, J., and Adams, R.P. (2015, January 7\u201312). Spectral representations for convolutional neural networks. Proceedings of the Advances in Neural Information Processing Systems, Montr\u00e9al, QC, Canada."},{"key":"ref_35","first-page":"1833","article-title":"Permutation Tests for Studying Classifier Performance","volume":"11","author":"Ojala","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"ref_36","unstructured":"Moya Rueda, F. (2018, April 16). CNN IMU. Available online: https:\/\/github.com\/wilfer9008\/CNN_IMU."}],"container-title":["Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9709\/5\/2\/26\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:05:53Z","timestamp":1760195153000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9709\/5\/2\/26"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,5,25]]},"references-count":36,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2018,6]]}},"alternative-id":["informatics5020026"],"URL":"https:\/\/doi.org\/10.3390\/informatics5020026","relation":{},"ISSN":["2227-9709"],"issn-type":[{"value":"2227-9709","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,5,25]]}}}