{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,15]],"date-time":"2026-10-15T16:11:55Z","timestamp":1792080715386,"version":"4.4.0"},"reference-count":29,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2023,10,10]],"date-time":"2023-10-10T00:00:00Z","timestamp":1696896000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2018AAA0100205"],"award-info":[{"award-number":["2018AAA0100205"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Sensor-based human activity recognition aims to classify human activities or behaviors according to the data from wearable or embedded sensors, leading to a new direction in the field of Artificial Intelligence. When the activities become high-level and sophisticated, such as in the multiple technical skills of playing badminton, it is usually a challenging task due to the difficulty of feature extraction from the sensor data. As a kind of end-to-end approach, deep neural networks have the capacity of automatic feature learning and extracting. However, most current studies on sensor-based badminton activity recognition adopt CNN-based architectures, which lack the ability of capturing temporal information and global signal comprehension. To overcome these shortcomings, we propose a deep learning framework which combines the convolutional layers, LSTM structure, and self-attention mechanism together. Specifically, this framework can automatically extract the local features of the sensor signals in time domain, take the LSTM structure for processing the badminton activity data, and focus attention on the information that is essential to the badminton activity recognition task. It is demonstrated by the experimental results on an actual badminton single sensor dataset that our proposed framework has obtained a badminton activity recognition (37 classes) accuracy of 97.83%, which outperforms the existing methods, and also has the advantages of lower training time and faster convergence.<\/jats:p>","DOI":"10.3390\/s23208373","type":"journal-article","created":{"date-parts":[[2023,10,10]],"date-time":"2023-10-10T10:23:42Z","timestamp":1696933422000},"page":"8373","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Self-Attention-Based Deep Convolution LSTM Framework for Sensor-Based Badminton Activity Recognition"],"prefix":"10.3390","volume":"23","author":[{"given":"Jingyang","family":"Deng","sequence":"first","affiliation":[{"name":"School of Mathematical Sciences and LMAM, Peking University, Beijing 100871, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shuyi","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Mathematical Sciences and LMAM, Peking University, Beijing 100871, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7388-4295","authenticated-orcid":false,"given":"Jinwen","family":"Ma","sequence":"additional","affiliation":[{"name":"School of Mathematical Sciences and LMAM, Peking University, Beijing 100871, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,10,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Vepakomma, P., De, D., Das, S.K., and Bhansali, S. (2015, January 9\u201312). A-Wristocracy: Deep Learning on Wrist-worn Sensing for Recognition of User Complex Activities. Proceedings of the 2015 IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks, Cambridge, MA, USA.","DOI":"10.1109\/BSN.2015.7299406"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Hammerla, N., Fisher, J., Andras, P., Rochester, L., Walker, R., and Pl\u00f6tz, T. (2015, January 25\u201330). PD Disease State Assessment in Naturalistic Environments Using Deep Learning. Proceedings of the AAAI Conference on Artificial Intelligence, Austin, TX, USA.","DOI":"10.1609\/aaai.v29i1.9484"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"7125","DOI":"10.1109\/ACCESS.2016.2617282","article-title":"Hand Gesture Recognition Using Micro-Doppler Signatures with Convolutional Neural Network","volume":"4","author":"Kim","year":"2016","journal-title":"IEEE Access"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"31715","DOI":"10.1109\/ACCESS.2018.2839766","article-title":"Human Daily and Sport Activity Recognition Using a Wearable Inertial Sensor Network","volume":"6","author":"Hsu","year":"2018","journal-title":"IEEE Access"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"107561","DOI":"10.1016\/j.patcog.2020.107561","article-title":"Sensor-based and Vision-based Human Activity Recognition: A Comprehensive Survey","volume":"108","author":"Dang","year":"2020","journal-title":"Pattern Recognit."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Wang, Y., Fang, W., Ma, J., Li, X., and Zhong, A. (2019, January 3\u20136). Automatic Badminton Action Recognition Using CNN with Adaptive Feature Extraction on Sensor Data. Proceedings of the International Conference on Intelligent Computing, Nanchang, China.","DOI":"10.1007\/978-3-030-26763-6_13"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.patrec.2018.02.010","article-title":"Deep Learning for Sensor-based Activity Recognition: A Survey","volume":"119","author":"Wang","year":"2019","journal-title":"Pattern Recognit. Lett."},{"key":"ref_8","unstructured":"Hussain, S., and Rashid, H.U. (2012, January 18\u201319). User Independent Hand Gesture Recognition by Accelerated DTW. Proceedings of the 2012 International Conference on Informatics, Electronics & Vision, Dhaka, Bangladesh."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Yao, S., Hu, S., Zhao, Y., Zhang, A., and Abdelzaher, T. (2017, January 3\u20137). Deepsense: A Unified Deep Learning Framework for Time-series Mobile Sensing Data Processing. Proceedings of the 26th International Conference on World Wide Web, Perth, Australia.","DOI":"10.1145\/3038912.3052577"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ma, H., Li, W., Zhang, X., Gao, S., and Lu, S. (2019, January 10\u201316). AttnSense: Multi-level Attention Mechanism for Multimodal Human Activity Recognition. Proceedings of the International Joint Conference on Artificial Intelligence, Macao, China.","DOI":"10.24963\/ijcai.2019\/431"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Betancourt, C., Chen, W.H., and Kuan, C.W. (2020, January 11\u201314). Self-Attention Networks for Human Activity Recognition Using Wearable Devices. Proceedings of the 2020 IEEE International Conference on Systems, Man, and Cybernetics, Toronto, ON, Canada.","DOI":"10.1109\/SMC42975.2020.9283381"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1109\/ICSP48669.2020.9320935","article-title":"Hierarchical Multi-classification for Sensor-based Badminton Activity Recognition","volume":"Volume 1","author":"Wang","year":"2020","journal-title":"Proceedings of the 2020 15th IEEE International Conference on Signal Processing (ICSP)"},{"key":"ref_13","unstructured":"Wang, Y., Pan, G., Ma, J., Li, X., and Zhong, A. (2021, January 12\u201315). Label Similarity Based Graph Network for Badminton Activity Recognition. Proceedings of the Intelligent Computing Theories and Application: 17th International Conference, ICIC 2021, Shenzhen, China. Proceedings, Part I 17."},{"key":"ref_14","unstructured":"Yang, J., Wang, S., Chen, N., Chen, X., and Shi, P. (2010, January 3\u20137). Wearable Accelerometer Based Extendable Activity Recognition System. Proceedings of the 2010 IEEE International Conference on Robotics and Automation, Anchorage, AK, USA."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Anik, M.A.I., Hassan, M., Mahmud, H., and Hasan, M.K. (2016, January 18\u201320). Activity Recognition of a Badminton Game through Accelerometer and Gyroscope. Proceedings of the 2016 19th International Conference on Computer and Information Technology (ICCIT), Dhaka, Bangladesh.","DOI":"10.1109\/ICCITECHN.2016.7860197"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1016\/j.patcog.2018.01.025","article-title":"A Novel Random Forests Based Class Incremental Learning Method for Activity Recognition","volume":"78","author":"Hu","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ord\u00f3\u00f1ez, F.J., and Roggen, D. (2016). Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition. Sensors, 16.","DOI":"10.3390\/s16010115"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Murahari, V.S., and Pl\u00f6tz, T. (2018, January 8\u201312). On Attention Models for Human Activity Recognition. Proceedings of the 2018 ACM International Symposium on Wearable Computers, Singapore.","DOI":"10.1145\/3267242.3267287"},{"key":"ref_19","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention is All You Need. Adv. Neural Inf. Process. Syst., 30."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1007\/s00779-010-0293-9","article-title":"Preprocessing Techniques for Context Recognition from Accelerometer Data","volume":"14","author":"Figo","year":"2010","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"769","DOI":"10.1109\/THMS.2016.2571265","article-title":"Badminton Stroke Recognition Based on Body Sensor Networks","volume":"46","author":"Wang","year":"2016","journal-title":"IEEE Trans. Hum.-Mach. Syst."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"7892902","DOI":"10.1155\/2021\/7892902","article-title":"Recognition of Badminton Shot Action Based on the Improved Hidden Markov Model","volume":"2021","author":"Ma","year":"2021","journal-title":"J. Healthc. Eng."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Steels, T., Van Herbruggen, B., Fontaine, J., De Pessemier, T., Plets, D., and De Poorter, E. (2020). Badminton Activity Recognition Using Accelerometer Data. Sensors, 20.","DOI":"10.3390\/s20174685"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Anand, A., Sharma, M., Srivastava, R., Kaligounder, L., and Prakash, D. (2017, January 18\u201321). Wearable Motion Sensor Based Analysis of Swing Sports. Proceedings of the 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA), Cancun, Mexico.","DOI":"10.1109\/ICMLA.2017.0-149"},{"key":"ref_25","unstructured":"Hammerla, N.Y., Halloran, S., and Pl\u00f6tz, T. (2016). Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3090076","article-title":"Ensembles of Deep LSTM Learners for Activity Recognition Using Wearables","volume":"1","author":"Guan","year":"2017","journal-title":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."},{"key":"ref_27","unstructured":"Mahmud, S., Tonmoy, M.T.H., Bhaumik, K.K., Rahman, A.K.M.M., Amin, M.A., Shoyaib, M., Khan, M.A.H., and Ali, A.A. (2020). Human Activity Recognition from Wearable Sensor Data Using Self-Attention. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Yao, S., Zhao, Y., Shao, H., Liu, D., Liu, S., Hao, Y., Piao, A., Hu, S., Lu, S., and Abdelzaher, T.F. (May, January 29). Sadeepsense: Self-attention Deep Learning Framework for Heterogeneous On-device Sensors in Internet of Things Applications. Proceedings of the IEEE INFOCOM 2019-IEEE Conference on Computer Communications, Paris, France.","DOI":"10.1109\/INFOCOM.2019.8737500"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"44776","DOI":"10.1109\/ACCESS.2018.2865093","article-title":"Feature Extraction, Performance Analysis and System Design Using the Du Mobility Dataset","volume":"6","author":"Saha","year":"2018","journal-title":"IEEE Access"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/20\/8373\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:04:28Z","timestamp":1760130268000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/20\/8373"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,10]]},"references-count":29,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["s23208373"],"URL":"https:\/\/doi.org\/10.3390\/s23208373","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,10]]}}}