{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:56:37Z","timestamp":1760151397330,"version":"build-2065373602"},"reference-count":38,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2022,3,14]],"date-time":"2022-03-14T00:00:00Z","timestamp":1647216000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61772574 and 62171482"],"award-info":[{"award-number":["61772574 and 62171482"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Basic and Applied Basic Research of Guangdong Province, P.R. China","award":["2021A1515011758"],"award-info":[{"award-number":["2021A1515011758"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Activity recognition is fundamental to many applications envisaged in pervasive computing, especially in smart environments where the resident\u2019s data collected from sensors will be mapped to human activities. Previous research usually focuses on scripted or pre-segmented sequences related to activities, whereas many real-world deployments require information about the ongoing activities in real time. In this paper, we propose an online activity recognition model on streaming sensor data that incorporates the spatio-temporal correlation-based dynamic segmentation method and the stigmergy-based emergent modeling method to recognize activities when new sensor events are recorded. The dynamic segmentation approach integrating sensor correlation and time correlation judges whether two consecutive sensor events belong to the same window or not, avoiding events from very different functional areas or with a long time interval in the same window, thus obtaining the segmented window for every single event. Then, the emergent paradigm with marker-based stigmergy is adopted to build activity features that are explicitly represented as a directed weighted network to define the context for the last sensor event in this window, which does not need sophisticated domain knowledge. We validate the proposed method utilizing the real-world dataset Aruba from the CASAS project and the results show the effectiveness.<\/jats:p>","DOI":"10.3390\/s22062250","type":"journal-article","created":{"date-parts":[[2022,3,15]],"date-time":"2022-03-15T02:56:20Z","timestamp":1647312980000},"page":"2250","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Online Activity Recognition Combining Dynamic Segmentation and Emergent Modeling"],"prefix":"10.3390","volume":"22","author":[{"given":"Zimin","family":"Xu","sequence":"first","affiliation":[{"name":"School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou 510006, China"},{"name":"Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, Guangzhou 510006, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4031-7996","authenticated-orcid":false,"given":"Guoli","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou 510006, China"},{"name":"Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, Guangzhou 510006, China"}]},{"given":"Xuemei","family":"Guo","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou 510006, China"},{"name":"Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, Guangzhou 510006, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,3,14]]},"reference":[{"key":"ref_1","unstructured":"United Nations (2019). World Population Prospects 2019: Highlights. Population Division of the United Nations Department of Economic and Social Affairs, United Nations."},{"key":"ref_2","first-page":"156","article-title":"Population aging in Iran and rising health care costs","volume":"12","author":"Mirzaie","year":"2017","journal-title":"Iran. J. Ageing"},{"key":"ref_3","first-page":"390","article-title":"Device-free non-privacy invasive classification of elderly travel patterns in a smart house using PIR sensors and DCNN","volume":"18","author":"Gochoo","year":"2018","journal-title":"IEEE Sens. J."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1016\/S0921-8890(03)00077-0","article-title":"Autominder: An intelligent cognitive orthotic system for people with memory impairment","volume":"44","author":"Pollack","year":"2003","journal-title":"Robot. Auton. Syst."},{"key":"ref_5","unstructured":"Das, B., Chen, C., Seelye, A.M., and Cook, D.J. (2011, January 20\u201322). An automated prompting system for smart environments. Proceedings of the 9th International Conference on Smart Homes and Health Telematics (ICOST 2011), Montreal, QC, Canada."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Yan, S., Liao, Y., Feng, X., and Liu, Y. (2016, January 23\u201325). Real time activity recognition on streaming sensor data for smart environments. Proceedings of the 4th IEEE International Conference on Progress in Informatics and Computing (IEEE PIC), Shanghai, China.","DOI":"10.1109\/PIC.2016.7949466"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1016\/j.engappai.2010.09.007","article-title":"A review on time series data mining","volume":"24","author":"Fu","year":"2011","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"26783","DOI":"10.3390\/s151026783","article-title":"Can smartwatches replace smartphones for posture tracking?","volume":"15","author":"Mortazavi","year":"2015","journal-title":"Sensors"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"180","DOI":"10.1016\/j.medengphy.2014.11.008","article-title":"Activity classification in persons with stroke based on frequency features","volume":"37","author":"Laudanski","year":"2015","journal-title":"Med. Eng. Phys."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"116","DOI":"10.15837\/ijccc.2017.1.2787","article-title":"Feature analysis to human activity recognition","volume":"12","author":"Suto","year":"2016","journal-title":"Int. J. Comput. Commun."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1016\/j.pmcj.2015.04.003","article-title":"Monitoring elderly behavior via indoor position-based stigmergy","volume":"23","author":"Barsocchi","year":"2015","journal-title":"Pervasive Mob. Comput."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"103859","DOI":"10.1016\/j.engappai.2020.103859","article-title":"Sensor-based activity recognition of solitary elderly via stigmergy and two-layer framework","volume":"95","author":"Xu","year":"2020","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/MC.2012.328","article-title":"CASAS: A smart home in a box","volume":"46","author":"Cook","year":"2012","journal-title":"Computer"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"30509","DOI":"10.1007\/s11042-020-09004-3","article-title":"Vision-based human activity recognition: A survey","volume":"79","author":"Beddiar","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/j.eswa.2018.03.056","article-title":"Deep learning algorithms for human activity recognition using mobile and wearable sensor networks: State of the art and research challenges","volume":"105","author":"Nweke","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Fu, Z., He, X., Wang, E., Huo, J., Huang, J., and Wu, D. (2021). Personalized human activity recognition based on integrated wearable sensor and transfer learning. Sensors, 21.","DOI":"10.3390\/s21030885"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1016\/j.engappai.2018.08.009","article-title":"Online activity recognition and daily habit modeling for solitary elderly through indoor position-based stigmergy","volume":"76","author":"Tan","year":"2018","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_18","first-page":"693","article-title":"Unobtrusive activity recognition of elderly people living alone using anonymous binary sensors and DCNN","volume":"23","author":"Gochoo","year":"2019","journal-title":"IEEE J. Biomed. Health"},{"key":"ref_19","first-page":"2933","article-title":"Activity recognition in sensor data streams for active and assisted living environments","volume":"28","author":"Mosa","year":"2017","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Tan, T.H., Badarch, L., Zeng, W.X., Gochoo, M., Alnajjar, F.S., and Hsieh, J.W. (2021). Binary sensors-based privacy-preserved activity recognition of elderly living alone using an RNN. Sensors, 21.","DOI":"10.3390\/s21165371"},{"key":"ref_21","unstructured":"Patterson, D.J., Fox, D., Kautz, H., and Philipose, M. (2005, January 18\u201321). Fine-grained activity recognition by aggregating abstract object usage. Proceedings of the 9th International Symposium on Wearable Computers, Osaka, Japan."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1141","DOI":"10.1007\/s12652-019-01380-5","article-title":"Online human activity recognition employing hierarchical hidden Markov models","volume":"11","author":"Asghari","year":"2020","journal-title":"J. Ambient Intell. Humaniz. Comput."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Fan, C., and Gao, F. (2021). Enhanced human activity recognition using wearable sensors via a hybrid feature selection method. Sensors, 21.","DOI":"10.3390\/s21196434"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Tapia, E.M., Intille, S.S., and Larson, K. (2004, January 18\u201323). Activity recognition in the home using simple and ubiquitous sensors. Proceedings of the 2nd International Conference on Pervasive Computing, Linz, Austria.","DOI":"10.1007\/978-3-540-24646-6_10"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1109\/MPRV.2002.1037719","article-title":"Activity and location recognition using wearable sensors","volume":"1","author":"Lee","year":"2002","journal-title":"IEEE Pervasive Comput."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Huynh, T., Blanke, U., and Schiele, B. (2007, January 20\u201321). Scalable recognition of daily activities with wearable sensors. Proceedings of the 3rd International Symposium on Location- and Contest-Awareness (LoCA 2007), Oberpfaffenhofen, Germany.","DOI":"10.1007\/978-3-540-75160-1_4"},{"key":"ref_27","unstructured":"Liao, L., Fox, D., and Kautz, H. (2005, January 12\u201315). Extracting places and activities from GPS traces using hierarchical conditional random fields. Proceedings of the 12th International Symposium on Robotics Research (ISRR), San Francisco, CA, USA."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"311","DOI":"10.3233\/AIS-2010-0070","article-title":"Activity recognition using semi-Markov models on real world smart home datasets","volume":"2","author":"Englebienne","year":"2010","journal-title":"J. Ambient Intell. Smart Environ."},{"key":"ref_29","unstructured":"Huynh, T., and Schiele, B. (2006, January 10\u201311). Unsupervised discovery of structure in activity data using multiple eigenspaces. Proceedings of the 2nd International Workshop on Location- and Context-Awareness (LoCA 2006), Dublin, Ireland."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"37","DOI":"10.18280\/ts.370105","article-title":"Human action recognition in video sequences using deep belief networks","volume":"37","author":"Abdellaoui","year":"2020","journal-title":"Trait. Signal"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"6077","DOI":"10.1007\/s12652-020-01917-z","article-title":"Enhanced fuzzy finite state machine for human activity modelling and recognition","volume":"11","author":"Mohmed","year":"2020","journal-title":"J. Ambient Intell. Humaniz. Comput."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Mutegeki, R., and Han, D.S. (2020, January 19\u201321). A CNN-LSTM approach to human activity recognition. Proceedings of the 2020 International Conference on Artificial Intelligence in Information and Communication (ICAIIC), Fukuoka, Japan.","DOI":"10.1109\/ICAIIC48513.2020.9065078"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1016\/j.pmcj.2012.07.003","article-title":"Activity recognition on streaming sensor data","volume":"10","author":"Krishnan","year":"2014","journal-title":"Pervasive Mob. Comput."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"961","DOI":"10.1109\/TKDE.2011.51","article-title":"A knowledge-driven approach to activity recognition in smart homes","volume":"24","author":"Chen","year":"2011","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.pmcj.2012.11.004","article-title":"Dynamic sensor data segmentation for real-time knowledge-driven activity recognition","volume":"10","author":"Okeyo","year":"2014","journal-title":"Pervasive Mob. Comput."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Sfar, H., and Bouzeghoub, A. (2019, January 8\u201312). DataSeg: Dynamic streaming sensor data segmentation for activity recognition. Proceedings of the 34th ACM\/SIGAPP Annual International Symposium on Applied Computing (SAC), Limassol, Cyprus.","DOI":"10.1145\/3297280.3297332"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Yala, N., Fergani, B., and Fleury, A. (2015, January 2\u20134). Feature extraction for human activity recognition on streaming data. Proceedings of the International Symposium on Innovations in Intelligent SysTems and Applications (INISTA 2015), Madrid, Spain.","DOI":"10.1109\/INISTA.2015.7276759"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1007\/s12652-016-0412-1","article-title":"Towards improving feature extraction and classification for activity recognition on streaming data","volume":"8","author":"Yala","year":"2017","journal-title":"J. Ambient Intell. Humaniz. Comput."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/6\/2250\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:36:16Z","timestamp":1760135776000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/6\/2250"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,14]]},"references-count":38,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["s22062250"],"URL":"https:\/\/doi.org\/10.3390\/s22062250","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,3,14]]}}}