{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T09:50:36Z","timestamp":1776765036808,"version":"3.51.2"},"reference-count":32,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2020,3,27]],"date-time":"2020-03-27T00:00:00Z","timestamp":1585267200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61871046"],"award-info":[{"award-number":["61871046"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Human activity recognition (HAR) is a popular and challenging research topic, driven by a variety of applications. More recently, with significant progress in the development of deep learning networks for classification tasks, many researchers have made use of such models to recognise human activities in a sensor-based manner, which have achieved good performance. However, sensor-based HAR still faces challenges; in particular, recognising similar activities that only have a different sequentiality and similarly classifying activities with large inter-personal variability. This means that some human activities have large intra-class scatter and small inter-class separation. To deal with this problem, we introduce a margin mechanism to enhance the discriminative power of deep learning networks. We modified four kinds of common neural networks with our margin mechanism to test the effectiveness of our proposed method. The experimental results demonstrate that the margin-based models outperform the unmodified models on the OPPORTUNITY, UniMiB-SHAR, and PAMAP2 datasets. We also extend our research to the problem of open-set human activity recognition and evaluate the proposed method\u2019s performance in recognising new human activities.<\/jats:p>","DOI":"10.3390\/s20071871","type":"journal-article","created":{"date-parts":[[2020,4,1]],"date-time":"2020-04-01T03:44:13Z","timestamp":1585712653000},"page":"1871","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":29,"title":["Margin-Based Deep Learning Networks for Human Activity Recognition"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4336-961X","authenticated-orcid":false,"given":"Tianqi","family":"Lv","sequence":"first","affiliation":[{"name":"School of Electronic Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaojuan","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Electronic Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lei","family":"Jin","sequence":"additional","affiliation":[{"name":"School of Electronic Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yabo","family":"Xiao","sequence":"additional","affiliation":[{"name":"School of Electronic Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mei","family":"Song","sequence":"additional","affiliation":[{"name":"School of Electronic Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,3,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1016\/j.inffus.2017.09.014","article-title":"Geometrical kinematic modeling on human motion using method of multi-sensor fusion","volume":"41","author":"Xu","year":"2018","journal-title":"Inf. Fusion"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Margarito, J., Helaoui, R., Bianchi, A., Sartor, F., and Bonomi, A. (2015). User-Independent Recognition of Sports Activities from a Single Wrist-worn Accelerometer: A Template Matching Based Approach. IEEE Trans. Biomed. Eng.","DOI":"10.1109\/TBME.2015.2471094"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"17013","DOI":"10.3390\/s150717013","article-title":"Contextual Sensing: Integrating Contextual Information with Human and Technical Geo-Sensor Information for Smart Cities","volume":"15","author":"Bernd","year":"2015","journal-title":"Sensors"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"115","DOI":"10.3390\/s16010115","article-title":"Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition","volume":"16","author":"Francisco","year":"2016","journal-title":"Sensors"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Li, F., Kimiaki, S., Muhammad, N., Lukas, K., and Marcin, G. (2018). Comparison of Feature Learning Methods for Human Activity Recognition Using Wearable Sensors. Sensors, 18.","DOI":"10.3390\/s18020679"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Xu, L., Yang, W., Cao, Y., and Li, Q. (2017, January 29\u201331). Human activity recognition based on random forests. Proceedings of the 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD), Guangxi, China.","DOI":"10.1109\/FSKD.2017.8393329"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Panwar, M., Dyuthi, S.R., Prakash, K.C., Biswas, D., and Naik, G.R. (2017, January 11\u201315). CNN based approach for activity recognition using a wrist-worn accelerometer. Proceedings of the 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Jeju Island, Korea.","DOI":"10.1109\/EMBC.2017.8037349"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1109\/JBHI.2019.2909688","article-title":"TSE-CNN: A Two-Stage End-To-End CNN for Human Activity Recognition","volume":"24","author":"Huang","year":"2019","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_9","unstructured":"Liu, W., Wen, Y., Yu, Z., and Yang, M. (2016, January 19\u201324). Large-Margin Softmax Loss for Convolutional Neural Networks. Proceedings of the International Conference on International Conference on Machine Learning, New York, NY, USA."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wen, Y., Zhang, K., Li, Z., and Qiao, Y. (2016). A Discriminative Feature Learning Approach for Deep Face Recognition. Eur. Conf. Comput. Vis.","DOI":"10.1007\/978-3-319-46478-7_31"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Liu, W., Wen, Y., Yu, Z., Li, M., Raj, B., and Song, L. (2017, January 22\u201325). Sphereface: Deep hypersphere embedding for face recognition. Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.713"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Roggen, D., Calatroni, A., Rossi, M., Holleczek, T., F\u00f6rster, K., Tr\u00f6ster, G., Lukowicz, P., Bannach, D., Pirkl, G., and Ferscha, A. (2010, January 15\u201318). Collecting complex activity datasets in highly rich networked sensor environments. Proceedings of the Seventh international conference on networked sensing systems (INSS), Kassel, Germany.","DOI":"10.1109\/INSS.2010.5573462"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Micucci, D., Mobilio, M., and Napoletano, P. (2017). UniMiB SHAR: A Dataset for Human Activity Recognition Using Acceleration Data from Smartphones. Appl. Sci., 7.","DOI":"10.20944\/preprints201706.0033.v1"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Reiss, A., and Stricker, D. (2012, January 18\u201322). Introducing a New Benchmarked Dataset for Activity Monitoring. Proceedings of the 16th International Symposium on Wearable Computers, Newcastle, UK.","DOI":"10.1109\/ISWC.2012.13"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3070","DOI":"10.1109\/TII.2017.2712746","article-title":"Robust Human Activity Recognition Using Smartphone Sensors via CT-PCA and Online SVM","volume":"13","author":"Chen","year":"2013","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Hossain, T., Goto, H., Ahad, M.A.R., and Inoue, S. (2018, January 25\u201328). A Study on Sensor-based Activity Recognition Having Missing Data. Proceedings of the 7th International Conference on Informatics, Electronics & Vision (ICIEV) and 2018 2nd International Conference on Imaging, Vision & Pattern Recognition (icIVPR), Saratha Devi, Germany.","DOI":"10.1109\/ICIEV.2018.8641012"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Mobark, M., Chuprat, S., and Mantoro, T. (2017, January 1\u20133). Improving the accuracy of complex activities recognition using accelerometer-embedded mobile phone classifiers. Proceedings of the Second International Conference on Informatics and Computing (ICIC), Jayapura, Indonesia.","DOI":"10.1109\/IAC.2017.8280606"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Vepakomma, P., De, D., Das, S.K., and Bhansali, S. (2015, January 9\u201312). A-Wristocracy: Deep Learning on Wrist-worn Sensing for Recognition of User Complex Activities. Proceedings of the 2015 IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks (BSN), Cambridge, MA, USA.","DOI":"10.1109\/BSN.2015.7299406"},{"key":"ref_19","first-page":"160","article-title":"An effective deep autoencoder approach for online smartphone-based human activity recognition","volume":"17","author":"Almaslukh","year":"2017","journal-title":"Int. J. Comput. Sci. Netw. Secur."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Yu, S. (2018, January 25\u201327). Residual Learning and LSTM Networks for Wearable Human Activity Recognition Problem. Proceedings of the 37th Chinese Control Conference (CCC), Wuhan, China.","DOI":"10.23919\/ChiCC.2018.8482968"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Hao, W., Wang, Y., Zheng, Z., Xing, J., Li, Z., Gong, D., Zhou, J., and Wei, L. (2020, February 10). CosFace: Large Margin Cosine Loss for Deep Face Recognition. Available online: http:\/\/openaccess.thecvf.com\/content-cvpr-2018\/CameraReady\/1797.pdf.","DOI":"10.1109\/CVPR.2018.00552"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Deng, J., Guo, J., Xue, N., and Zafeiriou, S. (2019, January 16\u201320). ArcFace: Additive Angular Margin Loss for Deep Face Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00482"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wojke, N., and Bewley, A. (2018, January 12\u201315). Deep cosine metric learning for person re-identification. Proceedings of the IEEE winter conference on applications of computer vision (WACV), Lake Tahoe, NV, USA.","DOI":"10.1109\/WACV.2018.00087"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhai, Y., Guo, X., Lu, Y., and Li, H. (2019, January 16\u201320). In Defense of the Classification Loss for Person Re-Identification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Long Beach, CA, USA.","DOI":"10.1109\/CVPRW.2019.00194"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Pan, P., Zheng, Y., Zhao, K., Zhang, Y., Ren, X., and Jin, R. (2018, January 19\u201323). Visual search at alibaba. Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, ACM, London, UK.","DOI":"10.1145\/3219819.3219820"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Hu, H., Wang, Y., Yang, L., Komlev, P., Huang, L., Chen, X.S., Huang, J., Wu, Y., Merchant, M., and Sacheti, A. (2018, January 19\u201323). Web-scale responsive visual search at bing. Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, ACM, London, UK.","DOI":"10.1145\/3219819.3219843"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Younes, R., Jones, M., and Martin, T.L. (2018). Classifier for activities with variations. Sensors, 18.","DOI":"10.3390\/s18103529"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Kim, Y.J., Kang, B.N., and Kim, D. (2015, January 9\u201312). Hidden Markov model ensemble for activity recognition using tri-axis accelerometer. Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, Kowloon Tong, Hong Kong.","DOI":"10.1109\/SMC.2015.528"},{"key":"ref_29","unstructured":"Arthur, D., and Vassilvitskii, S. (2007, January 7\u20139). K-Means++: The Advantages of Careful Seeding. Proceedings of the eighteenth annual ACM-SIAM symposium on Discrete algorithms. Society for Industrial and Applied Mathematics, University City Science Center, Philadelphia, PA, USA."},{"key":"ref_30","unstructured":"Zappi, P., Lombriser, C., Stiefmeier, T., Farella, E., Roggen, D., Benini, L., and Tr\u00f6ster, G. (February, January 30). Activity recognition from on-body sensors: Accuracy-power trade-off by dynamic sensor selection. Proceedings of the European Conference on Wireless Sensor Networks, Porto, Portugal."},{"key":"ref_31","unstructured":"Ioffe, S., and Szegedy, C. (2015). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. arXiv."},{"key":"ref_32","unstructured":"(2020, February 10). Automatic Differentiation in Pytorch 2017. Available online: https:\/\/openreview.net\/forum?id=BJJsrmfCZ."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/7\/1871\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:12:36Z","timestamp":1760173956000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/7\/1871"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,27]]},"references-count":32,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2020,4]]}},"alternative-id":["s20071871"],"URL":"https:\/\/doi.org\/10.3390\/s20071871","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,3,27]]}}}