{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,12]],"date-time":"2026-06-12T07:51:59Z","timestamp":1781250719497,"version":"3.54.1"},"reference-count":32,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2023,2,17]],"date-time":"2023-02-17T00:00:00Z","timestamp":1676592000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"GIST Research Project grant funded by the GIST in 2022"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>With the development of wearable devices such as smartwatches, several studies have been conducted on the recognition of various human activities. Various types of data are used, e.g., acceleration data collected using an inertial measurement unit sensor. Most scholars segmented the entire timeseries data with a fixed window size before performing recognition. However, this approach has limitations in performance because the execution time of the human activity is usually unknown. Therefore, there have been many attempts to solve this problem through the method of activity recognition by sliding the classification window along the time axis. In this study, we propose a method for classifying all frames rather than a window-based recognition method. For implementation, features extracted using multiple convolutional neural networks with different kernel sizes were fused and used. In addition, similar to the convolutional block attention module, an attention layer to each channel and spatial level is applied to improve the model recognition performance. To verify the performance of the proposed model and prove the effectiveness of the proposed method on human activity recognition, evaluation experiments were performed. For comparison, models using various basic deep learning modules and models, in which all frames were classified for recognizing a specific wave in electrocardiography data were applied. As a result, the proposed model reported the best F1-score (over 0.9) for all kinds of target activities compared to other deep learning-based recognition models. Further, for the improvement verification of the proposed CEF method, the proposed method was compared with three types of SW method. As a result, the proposed method reported the 0.154 higher F1-score than SW. In the case of the designed model, the F1-score was higher as much as 0.184.<\/jats:p>","DOI":"10.3390\/s23042278","type":"journal-article","created":{"date-parts":[[2023,2,20]],"date-time":"2023-02-20T02:29:08Z","timestamp":1676860148000},"page":"2278","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["A Deep Learning-Based Semantic Segmentation Model Using MCNN and Attention Layer for Human Activity Recognition"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8363-3054","authenticated-orcid":false,"given":"Sang-hyub","family":"Lee","sequence":"first","affiliation":[{"name":"School of Integrated Technology, Gwangju Institute of Science and Technology, Gwangju 61005, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8787-5608","authenticated-orcid":false,"given":"Deok-Won","family":"Lee","sequence":"additional","affiliation":[{"name":"School of Integrated Technology, Gwangju Institute of Science and Technology, Gwangju 61005, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6050-6594","authenticated-orcid":false,"given":"Mun Sang","family":"Kim","sequence":"additional","affiliation":[{"name":"School of Integrated Technology, Gwangju Institute of Science and Technology, Gwangju 61005, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.patrec.2018.02.010","article-title":"Deep learning for sensor-based activity recognition: A survey","volume":"119","author":"Wang","year":"2019","journal-title":"Pattern Recognit. Lett."},{"key":"ref_2","first-page":"1","article-title":"Deep learning for sensor-based human activity recognition: Overview, challenges, and opportunities","volume":"54","author":"Chen","year":"2021","journal-title":"ACM Comput. Surv."},{"key":"ref_3","first-page":"3200","article-title":"Human action recognition from various data modalities: A review","volume":"45","author":"Sun","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"210816","DOI":"10.1109\/ACCESS.2020.3037715","article-title":"Human activity recognition using inertial, physiological and environmental sensors: A comprehensive survey","volume":"8","author":"Demrozi","year":"2020","journal-title":"IEEE Access"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Abdel-Salam, R., Mostafa, R., and Hadhood, M. (2021, January 8). Human activity recognition using wearable sensors: Review, challenges, evaluation benchmark. Proceedings of the International Workshop on Deep Learning for Human Activity Recognition, Kyoto, Japan.","DOI":"10.1007\/978-981-16-0575-8_1"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"5668","DOI":"10.1109\/TCYB.2021.3137753","article-title":"A Segmentation Scheme for Knowledge Discovery in Human Activity Spotting","volume":"52","author":"Uslu","year":"2022","journal-title":"IEEE Trans. Cybern."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Rueda, F.M., Grzeszick, R., Fink, G.A., Feldhorst, S., and Hompel, M.T. (2018). Convolutional neural networks for human activity recognition using body-worn sensors. Informatics, 5.","DOI":"10.3390\/informatics5020026"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2033","DOI":"10.1016\/j.patrec.2012.12.014","article-title":"The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition","volume":"34","author":"Chavarriaga","year":"2013","journal-title":"Pattern Recognit. Lett."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Reiss, A., and Stricker, D. (2012, January 18\u201322). Introducing a new benchmarked dataset for activity monitoring. Proceedings of the 2012 16th International Symposium on Wearable Computers, Newcastle, UK.","DOI":"10.1109\/ISWC.2012.13"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Grzeszick, R., Lenk, J.M., Rueda, F.M., Fink, G.A., Feldhorst, S., and Ten Hompel, M. (2017, January 21\u201322). Deep neural network based human activity recognition for the order picking process. Proceedings of the 4th international Workshop on Sensor-Based Activity Recognition and Interaction, Rostock, Germany.","DOI":"10.1145\/3134230.3134231"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zeng, M., Nguyen, L.T., Yu, B., Mengshoel, O.J., Zhu, J., Wu, P., and Zhang, J. (2014, January 6\u20137). Convolutional neural networks for human activity recognition using mobile sensors. Proceedings of the 6th International Conference on Mobile Computing, Applications and Services, Austin, TX, USA.","DOI":"10.4108\/icst.mobicase.2014.257786"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1109\/MPRV.2008.40","article-title":"Wearable activity tracking in car manufacturing","volume":"7","author":"Stiefmeier","year":"2008","journal-title":"IEEE Pervasive Comput."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Lockhart, J.W., Weiss, G.M., Xue, J.C., Gallagher, S.T., Grosner, A.B., and Pulickal, T.T. (2011, January 21). Design considerations for the WISDM smart phone-based sensor mining architecture. Proceedings of the Fifth International Workshop on Knowledge Discovery from Sensor Data, San Diego, CA, USA.","DOI":"10.1145\/2003653.2003656"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Cho, H., and Yoon, S.M. (2018). Divide and conquer-based 1D CNN human activity recognition using test data sharpening. Sensors, 18.","DOI":"10.3390\/s18041055"},{"key":"ref_15","unstructured":"Anguita, D., Ghio, A., Oneto, L., Parra Perez, X., and Reyes Ortiz, J.L. (2013, January 24\u201326). A public domain dataset for human activity recognition using smartphones. Proceedings of the 21th International European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, Bruges, Belgium."},{"key":"ref_16","unstructured":"Hammerla, N.Y., Halloran, S., and Pl\u00f6tz, T. (2016). Deep, convolutional, and recurrent models for human activity recognition using wearables. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Bachlin, M., Roggen, D., Troster, G., Plotnik, M., Inbar, N., Meidan, I., Herman, T., Brozgol, M., Shaviv, E., and Giladi, N. (2009, January 4\u20137). Potentials of Enhanced Context Awareness in Wearable Assistants for Parkinson\u2019s Disease Patients with the Freezing of Gait Syndrome. Proceedings of the 2009 International Symposium on Wearable Computers, Linz, Austria.","DOI":"10.1109\/ISWC.2009.14"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Pienaar, S.W., and Malekian, R. (2019, January 18\u201320). Human activity recognition using LSTM-RNN deep neural network architecture. Proceedings of the 2019 IEEE 2nd Wireless Africa Conference (WAC), Pretoria, South Africa.","DOI":"10.1109\/AFRICA.2019.8843403"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1145\/1964897.1964918","article-title":"Activity recognition using cell phone accelerometers","volume":"12","author":"Kwapisz","year":"2011","journal-title":"ACM SigKDD Explor. Newsl."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"7316954","DOI":"10.1155\/2018\/7316954","article-title":"Deep residual bidir-LSTM for human activity recognition using wearable sensors","volume":"2018","author":"Zhao","year":"2018","journal-title":"Math. Probl. Eng."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1904","DOI":"10.1109\/TPAMI.2015.2389824","article-title":"Spatial pyramid pooling in deep convolutional networks for visual recognition","volume":"37","author":"He","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J.-Y., and Kweon, I.S. (2018, January 8\u201314). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_23","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017). Attention is all you need. Adv. Neural Inf. Process. Syst., 30."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Twomey, N., Diethe, T., Fafoutis, X., Elsts, A., McConville, R., Flach, P., and Craddock, I. (2018). A comprehensive study of activity recognition using accelerometers. Informatics, 5.","DOI":"10.20944\/preprints201803.0147.v1"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1016\/j.icte.2020.04.004","article-title":"Supervised ECG wave segmentation using convolutional LSTM","volume":"6","author":"Malali","year":"2020","journal-title":"ICT Express"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Matias, P., Folgado, D., Gamboa, H., and Carreiro, A. (2021). Time Series Segmentation Using Neural Networks with Cross-Domain Transfer Learning. Electronics, 10.","DOI":"10.3390\/electronics10151805"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Sereda, I., Alekseev, S., Koneva, A., Kataev, R., and Osipov, G. (2019, January 14\u201319). ECG segmentation by neural networks: Errors and correction. Proceedings of the 2019 International Joint Conference on Neural Networks (IJCNN), Budapest, Hungary.","DOI":"10.1109\/IJCNN.2019.8852106"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Moskalenko, V., Zolotykh, N., and Osipov, G. (2019, January 7\u201311). Deep learning for ECG segmentation. Proceedings of the International Conference on Neuroinformatics, Dolgoprudny, Russia.","DOI":"10.1007\/978-3-030-30425-6_29"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"105445","DOI":"10.1016\/j.compbiomed.2022.105445","article-title":"ECG_SegNet: An ECG delineation model based on the encoder-decoder structure","volume":"145","author":"Liang","year":"2022","journal-title":"Comput. Biol. Med."},{"key":"ref_30","unstructured":"Bai, S., Kolter, J.Z., and Koltun, V. (2018). An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv."},{"key":"ref_31","unstructured":"Jaderberg, M., Simonyan, K., and Zisserman, A. (2015). Spatial transformer networks. Adv. Neural Inf. Process. Syst., 28."},{"key":"ref_32","unstructured":"Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017, January 21\u201326). Pointnet: Deep learning on point sets for 3d classification and segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/4\/2278\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:39:57Z","timestamp":1760121597000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/4\/2278"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,17]]},"references-count":32,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["s23042278"],"URL":"https:\/\/doi.org\/10.3390\/s23042278","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,17]]}}}