{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,24]],"date-time":"2026-01-24T17:34:38Z","timestamp":1769276078414,"version":"3.49.0"},"reference-count":42,"publisher":"Springer Science and Business Media LLC","issue":"8","license":[{"start":{"date-parts":[[2022,8,3]],"date-time":"2022-08-03T00:00:00Z","timestamp":1659484800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,8,3]],"date-time":"2022-08-03T00:00:00Z","timestamp":1659484800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Appl Intell"],"published-print":{"date-parts":[[2023,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Human activity recognition based on generated sensor data plays a major role in a large number of applications such as healthcare monitoring and surveillance system. Yet, accurately recognizing human activities is still challenging and active research due to people\u2019s tendency to perform daily activities in a different and multitasking way. Existing approaches based on the recurrent setting for human activity recognition have some issues, such as the inability to process data parallelly, the requirement for more memory and high computational cost albeit they achieved reasonable results. Convolutional Neural Network processes data parallelly, but, it breaks the ordering of input data, which is significant to build an effective model for human activity recognition. To overcome these challenges, this study proposes causal convolution based on performers-attention and supervised contrastive learning to entirely forego recurrent architectures, efficiently maintain the ordering of human daily activities and focus more on important timesteps of the sensors\u2019 data. Supervised contrastive learning is integrated to learn a discriminative representation of human activities and enhance predictive performance. The proposed network is extensively evaluated for human activities using multiple datasets including wearable sensor data and smart home environments data. The experiments on three wearable sensor datasets and five smart home public datasets of human activities reveal that our proposed network achieves better results and reduces the training time compared with the existing state-of-the-art methods and basic temporal models.<\/jats:p>","DOI":"10.1007\/s10489-022-03937-y","type":"journal-article","created":{"date-parts":[[2022,8,3]],"date-time":"2022-08-03T04:02:27Z","timestamp":1659499347000},"page":"8809-8825","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["ConvNet-based performers attention and supervised contrastive learning for activity recognition"],"prefix":"10.1007","volume":"53","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9489-8330","authenticated-orcid":false,"given":"Rebeen Ali","family":"Hamad","sequence":"first","affiliation":[]},{"given":"Longzhi","family":"Yang","sequence":"additional","affiliation":[]},{"given":"Wai Lok","family":"Woo","sequence":"additional","affiliation":[]},{"given":"Bo","family":"Wei","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,8,3]]},"reference":[{"key":"3937_CR1","unstructured":"Anguita D, Ghio A, Oneto L, Parra X, Reyes-Ortiz JL (2013) A public domain dataset for human activity recognition using smartphones. In: Esann, vol 3, p 3"},{"key":"3937_CR2","unstructured":"Bai S, Zico Kolter J, Koltun V (2018) An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv:1803.01271"},{"issue":"8","key":"3937_CR3","doi-asserted-by":"publisher","first-page":"1798","DOI":"10.1109\/TPAMI.2013.50","volume":"35","author":"Y Bengio","year":"2013","unstructured":"Bengio Y, Courville A, Vincent P (2013) Representation learning: a review and new perspectives. IEEE Trans Pattern Anal Mach Intell 35(8):1798\u20131828","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"3937_CR4","doi-asserted-by":"crossref","unstructured":"Betancourt C, Chen W-H, Kuan C-w (2020) Self-attention networks for human activity recognition using wearable devices. In: 2020 IEEE international conference on systems, man, and cybernetics (SMC). IEEE, pp 1194\u20131199","DOI":"10.1109\/SMC42975.2020.9283381"},{"key":"3937_CR5","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1016\/j.jpdc.2017.05.007","volume":"118","author":"L Cao","year":"2018","unstructured":"Cao L, Wang Y, Bo Z, Jin Q, Vasilakos AV (2018) Gchar: an efficient group-based context\u2014aware human activity recognition on smartphone. J Parallel Distrib Comput 118:67\u201380","journal-title":"J Parallel Distrib Comput"},{"key":"3937_CR6","unstructured":"Choromanski K, Likhosherstov V, Dohan D, Song X, Gane A, Sarlos T, Hawkins P, Davis J, Mohiuddin A, Kaiser L et al (2020) Rethinking attention with performers. arXiv:2009.14794"},{"key":"3937_CR7","doi-asserted-by":"crossref","unstructured":"Cui Y, Jia M, Lin T-Y, Song Y, Belongie S (2019) Class-balanced loss based on effective number of samples. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 9268\u20139277","DOI":"10.1109\/CVPR.2019.00949"},{"key":"3937_CR8","doi-asserted-by":"crossref","unstructured":"Fang H, Si H, Chen L (2013) Recurrent neural network for human activity recognition in smart home. In: Proceedings of 2013 Chinese intelligent automation conference. Springer, pp 341\u2013348","DOI":"10.1007\/978-3-642-38524-7_37"},{"key":"3937_CR9","doi-asserted-by":"crossref","unstructured":"Gao W, Zhang L, Teng Q, Wu H, Min F, He J (2020) Danhar: dual attention network for multimodal human activity recognition using wearable sensors. arXiv:2006.14435","DOI":"10.1016\/j.asoc.2021.107728"},{"key":"3937_CR10","doi-asserted-by":"crossref","unstructured":"Hadsell R, Chopra S, LeCun Y (2006) Dimensionality reduction by learning an invariant mapping. In: 2006 IEEE computer society conference on computer vision and pattern recognition (CVPR\u201906), vol 2. IEEE, pp 1735\u20131742","DOI":"10.1109\/CVPR.2006.100"},{"key":"3937_CR11","doi-asserted-by":"publisher","unstructured":"Hamad RA, Salguero AG, Bouguelia M, Espinilla M, Quero JM (2019) Efficient activity recognition in smart homes using delayed fuzzy temporal windows on binary sensors. IEEE J Biomed Health Inf: 1\u20131. https:\/\/doi.org\/10.1109\/JBHI.2019.2918412","DOI":"10.1109\/JBHI.2019.2918412"},{"key":"3937_CR12","doi-asserted-by":"crossref","unstructured":"Hamad R, Jarpe E, Lundstrom J (2018) Stability analysis of the t-sne algorithm for human activity pattern data. In: 2018 IEEE international conference on systems, man, and cybernetics (SMC). IEEE, pp 1839\u20131845","DOI":"10.1109\/SMC.2018.00318"},{"issue":"20","key":"3937_CR13","doi-asserted-by":"publisher","first-page":"13705","DOI":"10.1007\/s00521-021-06007-5","volume":"33","author":"RA Hamad","year":"2021","unstructured":"Hamad RA, Kimura M, Yang L, Woo WL, Bo W (2021) Dilated causal convolution with multi-head self attention for sensor human activity recognition. Neural Comput Appl 33(20):13705\u201313722","journal-title":"Neural Comput Appl"},{"issue":"4","key":"3937_CR14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s42979-020-00211-1","volume":"1","author":"RA Hamad","year":"2020","unstructured":"Hamad RA, Kimura M, Lundstr\u00f6m J (2020) Efficacy of imbalanced data handling methods on deep learning for smart homes environments. SN Comput Sci 1(4):1\u201310","journal-title":"SN Comput Sci"},{"issue":"15","key":"3937_CR15","doi-asserted-by":"publisher","first-page":"5293","DOI":"10.3390\/app10155293","volume":"10","author":"RA Hamad","year":"2020","unstructured":"Hamad RA, Yang L, Woo WL, Wei B (2020) Joint learning of temporal models to handle imbalanced data for human activity recognition. Appl Sci 10(15):5293","journal-title":"Appl Sci"},{"issue":"6","key":"3937_CR16","doi-asserted-by":"publisher","first-page":"2287","DOI":"10.1109\/JSEN.2018.2885796","volume":"19","author":"J He","year":"2018","unstructured":"He J, Zhang Q, Wang L, Pei L (2018) Weakly supervised human activity recognition from wearable sensors by recurrent attention learning. IEEE Sensor J 19(6):2287\u20132297","journal-title":"IEEE Sensor J"},{"issue":"8","key":"3937_CR17","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735\u20131780","journal-title":"Neural Comput"},{"key":"3937_CR18","unstructured":"Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International conference on machine learning, pp 448\u2013456. PMLR"},{"key":"3937_CR19","doi-asserted-by":"crossref","unstructured":"Jiang W, Yin Z (2015) Human activity recognition using wearable sensors by deep convolutional neural networks. In: Proceedings of the 23rd ACM international conference on multimedia, pp 1307\u20131310","DOI":"10.1145\/2733373.2806333"},{"key":"3937_CR20","unstructured":"Khosla P, Teterwak P, Wang C, Sarna A, Tian Y, Isola P, Maschinot A, Liu C, Krishnan D (2020) Supervised contrastive learning. In: Larochelle H, Ranzato M, Hadsell R, Balcan MF, Lin H (eds) Advances in neural information processing systems, vol 33. Curran Associates, Inc., pp 18661\u201318673. https:\/\/proceedings.neurips.cc\/paper\/2020\/file\/d89a66c7c80a29b1bdbab0f2a1a94af8-Paper.pdf"},{"key":"3937_CR21","doi-asserted-by":"crossref","unstructured":"Lee D, Helal S (2013) From activity recognition to situation recognition. In: International conference on smart homes and health telematics. Springer, pp 245\u2013251","DOI":"10.1007\/978-3-642-39470-6_31"},{"key":"3937_CR22","doi-asserted-by":"publisher","first-page":"501","DOI":"10.1016\/j.neucom.2018.10.104","volume":"396","author":"D Liciotti","year":"2020","unstructured":"Liciotti D, Bernardini M, Romeo L, Frontoni E (2020) A sequential deep learning application for recognising human activities in smart homes. Neurocomputing 396:501\u2013513","journal-title":"Neurocomputing"},{"key":"3937_CR23","doi-asserted-by":"crossref","unstructured":"Lin T-Y, Goyal P, Girshick R, He K, Doll\u00e1r P (2017) Focal loss for dense object detection. In: Proceedings of the IEEE international conference on computer vision, pp 2980\u20132988","DOI":"10.1109\/ICCV.2017.324"},{"key":"3937_CR24","unstructured":"Mahmud S, Tonmoy MTH, Bhaumik KK, Rahman AM, Amin MA, Shoyaib M, Khan MAH, Ali A (2020) Human activity recognition from wearable sensor data using self-attention. In: ECAI 2020 - 24th European conference on artificial intelligence, 29 August-8 September 2020. Santiago de Compostela, Spain"},{"key":"3937_CR25","doi-asserted-by":"publisher","first-page":"441","DOI":"10.1016\/j.eswa.2018.07.068","volume":"114","author":"J Medina-Quero","year":"2018","unstructured":"Medina-Quero J, Zhang S, Nugent C, Espinilla M (2018) Ensemble classifier of long short-term memory with fuzzy temporal windows on binary sensors for activity recognition. Expert Syst Appl 114:441\u2013453","journal-title":"Expert Syst Appl"},{"key":"3937_CR26","doi-asserted-by":"crossref","unstructured":"Murahari VS, Pl\u00f6tz T (2018) On attention models for human activity recognition. In: Proceedings of the 2018 ACM international symposium on wearable computers, pp 100\u2013103","DOI":"10.1145\/3267242.3267287"},{"key":"3937_CR27","doi-asserted-by":"crossref","unstructured":"Niu W, Long J, Han D, Wang Y-F (2004) Human activity detection and recognition for video surveillance. In: 2004 IEEE international conference on multimedia and expo (ICME)(IEEE cat. no. 04TH8763), vol 1. IEEE, pp 719\u2013722","DOI":"10.1109\/ICME.2004.1394293"},{"key":"3937_CR28","doi-asserted-by":"crossref","unstructured":"Noroozi M, Favaro P (2016) Unsupervised learning of visual representations by solving jigsaw puzzles. In: European conference on computer vision. Springer, pp 69\u201384","DOI":"10.1007\/978-3-319-46466-4_5"},{"key":"3937_CR29","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1016\/j.eswa.2018.03.056","volume":"105","author":"HF Nweke","year":"2018","unstructured":"Nweke HF, Teh YW, Al-Garadi MA, Alo UR (2018) Deep learning algorithms for human activity recognition using mobile and wearable sensor networks: state of the art and research challenges. Expert Syst Appl 105:233\u2013261","journal-title":"Expert Syst Appl"},{"key":"3937_CR30","doi-asserted-by":"crossref","unstructured":"Ogbuabor G, La R (2018) Human activity recognition for healthcare using smartphones. In: Proceedings of the 2018 10th international conference on machine learning and computing, pp 41\u201346","DOI":"10.1145\/3195106.3195157"},{"key":"3937_CR31","unstructured":"van den Oord A, Dieleman S, Zen H, Simonyan K, Vinyals O, Graves A, Kalchbrenner N (2016) Andrew senior, and koray kavukcuoglu"},{"issue":"5","key":"3937_CR32","doi-asserted-by":"publisher","first-page":"5460","DOI":"10.3390\/s130505460","volume":"13","author":"F Ord\u00f3\u00f1ez","year":"2013","unstructured":"Ord\u00f3\u00f1ez F, De Toledo P, Sanchis A, et al. (2013) Activity recognition using hybrid generative\/discriminative models on home environments using binary sensors. Sensors 13(5):5460\u20135477","journal-title":"Sensors"},{"issue":"1","key":"3937_CR33","doi-asserted-by":"publisher","first-page":"115","DOI":"10.3390\/s16010115","volume":"16","author":"FJ Ord\u00f3\u00f1ez","year":"2016","unstructured":"Ord\u00f3\u00f1ez FJ, Roggen D (2016) Deep convolutional and lstm recurrent neural networks for multimodal wearable activity recognition. Sensors 16(1):115","journal-title":"Sensors"},{"key":"3937_CR34","doi-asserted-by":"crossref","unstructured":"Quero JM, Orr C, Zang S, Nugent C, Salguero A, Espinilla M (2018) Real-time recognition of interleaved activities based on ensemble classifier of long short-term memory with fuzzy temporal windows. In: Multidisciplinary digital publishing institute proceedings, vol 2, p 1225","DOI":"10.3390\/proceedings2191225"},{"key":"3937_CR35","doi-asserted-by":"publisher","first-page":"754","DOI":"10.1016\/j.neucom.2015.07.085","volume":"171","author":"J-L Reyes-Ortiz","year":"2016","unstructured":"Reyes-Ortiz J-L, Oneto L, Sam\u00e0 A, Parra X, Anguita D (2016) Transition-aware human activity recognition using smartphones. Neurocomputing 171:754\u2013767","journal-title":"Neurocomputing"},{"key":"3937_CR36","doi-asserted-by":"crossref","unstructured":"Singh D, Merdivan E, Hanke S, Kropf J, Geist M, Holzinger A (2017) Convolutional and recurrent neural networks for activity recognition in smart environment. In: Towards integrative machine learning and knowledge extraction. Springer, pp 194\u2013205","DOI":"10.1007\/978-3-319-69775-8_12"},{"issue":"6","key":"3937_CR37","doi-asserted-by":"publisher","first-page":"8575","DOI":"10.1109\/JSEN.2020.3045135","volume":"21","author":"SP Singh","year":"2020","unstructured":"Singh SP, Sharma MK, Lay-Ekuakille A, Gangwar D, Gupta S (2020) Deep convlstm with self-attention for human activity decoding using wearable sensors. IEEE Sensor J 21(6):8575\u20138582","journal-title":"IEEE Sensor J"},{"issue":"1","key":"3937_CR38","first-page":"1929","volume":"15","author":"N Srivastava","year":"2014","unstructured":"Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15(1):1929\u20131958","journal-title":"J Mach Learn Res"},{"key":"3937_CR39","doi-asserted-by":"crossref","unstructured":"Torres RLS, Ranasinghe DC, Shi Q, Sample AP (2013a) Sensor enabled wearable rfid technology for mitigating the risk of falls near beds. In: 2013 IEEE international conference on RFID (RFID). IEEE, pp 191\u2013198","DOI":"10.1109\/RFID.2013.6548154"},{"key":"3937_CR40","doi-asserted-by":"crossref","unstructured":"Torres RLS, Ranasinghe DC, Shi Q (2013b) Evaluation of wearable sensor tag data segmentation approaches for real time activity classification in elderly. In: International conference on mobile and ubiquitous systems: computing, networking, and services. Springer, pp 384\u2013395","DOI":"10.1007\/978-3-319-11569-6_30"},{"key":"3937_CR41","doi-asserted-by":"crossref","unstructured":"van Kasteren TLM, Englebienne G, Kr\u00f6se BJA (2011) Data: Human activity recognition from wireless sensor network Benchmark and software. In: Activity recognition in pervasive intelligent environments. Springer, pp 165\u2013186","DOI":"10.2991\/978-94-91216-05-3_8"},{"key":"3937_CR42","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I (2017) Attention is all you need. arXiv:1706.03762"}],"container-title":["Applied Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-022-03937-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10489-022-03937-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-022-03937-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,30]],"date-time":"2024-09-30T15:33:46Z","timestamp":1727710426000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10489-022-03937-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,3]]},"references-count":42,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2023,4]]}},"alternative-id":["3937"],"URL":"https:\/\/doi.org\/10.1007\/s10489-022-03937-y","relation":{},"ISSN":["0924-669X","1573-7497"],"issn-type":[{"value":"0924-669X","type":"print"},{"value":"1573-7497","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,3]]},"assertion":[{"value":"24 June 2022","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 August 2022","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}