{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,4]],"date-time":"2026-02-04T18:04:55Z","timestamp":1770228295271,"version":"3.49.0"},"reference-count":38,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2023,2,9]],"date-time":"2023-02-09T00:00:00Z","timestamp":1675900800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"HARSHEE project"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Recently, deep learning (DL) approaches have been extensively employed to recognize human activities in smart buildings, which greatly broaden the scope of applications in this field. Convolutional neural networks (CNN), well known for feature extraction and activity classification, have been applied for estimating human activities. However, most CNN-based techniques usually focus on divided sequences associated to activities, since many real-world employments require information about human activities in real time. In this work, an online human activity recognition (HAR) framework on streaming sensor is proposed. The methodology incorporates real-time dynamic segmentation, stigmergy-based encoding, and classification with a CNN2D. Dynamic segmentation decides if two succeeding events belong to the same activity segment or not. Then, because a CNN2D requires a multi-dimensional format in input, stigmergic track encoding is adopted to build encoded features in a multi-dimensional format. It adopts the directed weighted network (DWN) that takes into account the human spatio-temporal tracks with a requirement of overlapping activities. It represents a matrix that describes an activity segment. Once the DWN for each activity segment is determined, a CNN2D with a DWN in input is adopted to classify activities. The proposed approach is applied to a real case study: the \u201cAruba\u201d dataset from the CASAS database.<\/jats:p>","DOI":"10.3390\/s23041969","type":"journal-article","created":{"date-parts":[[2023,2,10]],"date-time":"2023-02-10T02:09:59Z","timestamp":1675994999000},"page":"1969","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Convolutional Neural Network Bootstrapped by Dynamic Segmentation and Stigmergy-Based Encoding for Real-Time Human Activity Recognition in Smart Homes"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5291-7297","authenticated-orcid":false,"given":"Houda","family":"Najeh","sequence":"first","affiliation":[{"name":"Lab-STICC, IMT Atlantique, 29280 Brest, France"},{"name":"Delta Dore Company, Le Vieux Ch\u00eane, 35270 Bonnemain, France"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0655-2880","authenticated-orcid":false,"given":"Christophe","family":"Lohr","sequence":"additional","affiliation":[{"name":"Lab-STICC, IMT Atlantique, 29280 Brest, France"}]},{"given":"Benoit","family":"Leduc","sequence":"additional","affiliation":[{"name":"Delta Dore Company, Le Vieux Ch\u00eane, 35270 Bonnemain, France"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1306","DOI":"10.1016\/j.enbuild.2017.11.022","article-title":"Towards adoption of building energy simulation and optimization for passive building design: A survey and a review","volume":"158","author":"Tian","year":"2018","journal-title":"Energy Build."},{"key":"ref_2","unstructured":"Phan, H. (2022). Mod\u00e9lisation de l\u2019Activit\u00e9 des M\u00e9nages dans le B\u00e2timent R\u00e9sidentiel Instrument\u00e9. [Ph.D. Thesis, University of Bordeaux]."},{"key":"ref_3","unstructured":"Alhamoud, A., Xu, P., Englert, F., Reinhardt, A., Scholl, P., Boehnstedt, D., and Steinmetz, R. Extracting human behavior patterns from appliance-level power consumption data. Proceedings of the European Conference on Wireless Sensor Networks."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"111303","DOI":"10.1016\/j.enbuild.2021.111303","article-title":"Occupancy and occupant activity drivers of energy consumption in residential buildings","volume":"250","author":"Akbari","year":"2021","journal-title":"Energy Build."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2498","DOI":"10.3390\/electronics10202498","article-title":"Using Language Model to Bootstrap Human Activity Recognition Ambient Sensors Based in Smart Homes","volume":"10","author":"Bouchabou","year":"2021","journal-title":"Electronics"},{"key":"ref_6","unstructured":"Bouchabou, D., Nguyen, S.M., Lohr, C., Leduc, B., and Kanellos, I. Fully convolutional network bootstrapped by word encoding and embedding for activity recognition in smart homes. Proceedings of the International Workshop on Deep Learning for Human Activity Recognition."},{"key":"ref_7","first-page":"1245","article-title":"A comparative analysis of windowing approaches in dense sensing environments","volume":"2","author":"Quigley","year":"2018","journal-title":"Multidiscip. Digit. Publ. Inst. Proc."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/j.pmcj.2019.01.004","article-title":"Enhancing activity recognition using CPD-based activity segmentation","volume":"53","author":"Aminikhanghahi","year":"2019","journal-title":"Pervasive Mob. Comput."},{"key":"ref_9","unstructured":"Van Kasteren, T.L.M. (2011). Activity Recognition for Health Monitoring Elderly Using Temporal Probabilistic Models, ASCI, University of Amsterdam."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1016\/j.eswa.2018.07.068","article-title":"Ensemble classifier of long short-term memory with fuzzy temporal windows on binary sensors for activity recognition","volume":"114","author":"Zhang","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1016\/j.pmcj.2015.04.003","article-title":"Monitoring elderly behavior via indoor position-based stigmergy","volume":"23","author":"Barsocchi","year":"2015","journal-title":"Pervasive Mob. Comput."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"103859","DOI":"10.1016\/j.engappai.2020.103859","article-title":"Sensor-based activity recognition of solitary elderly via stigmergy and two-layer framework","volume":"95","author":"Xu","year":"2020","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/MC.2012.328","article-title":"CASAS: A smart home in a box","volume":"46","author":"Cook","year":"2012","journal-title":"Computer"},{"key":"ref_14","unstructured":"Phan, H., Recht, T., Mora, L., and Ploix, S. (2020, January 19\u201320). Contextualized model for occupants\u2019 activities estimation in connected buildings. Proceedings of the Conf\u00e9rence Francophone de l\u2019International Building Performance Simulation Association 2020 (IBPSA), Chalons en Champaigne, France."},{"key":"ref_15","unstructured":"Le, X.H.B., Kashif, A., Ploix, S., Dugdale, J., Di, M., and Mascolo, S.A. (2010, January 9\u201310). Simulating inhabitant behaviour to manage energy at home. Proceedings of the International Building Performance Simulation Association Conference, Moret-sur-Loing, France."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.pmcj.2005.07.003","article-title":"Developing context-aware pervasive computing applications: Models and approach","volume":"2","author":"Henricksen","year":"2006","journal-title":"Pervasive Mob. Comput."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"410","DOI":"10.1108\/17440080911006199","article-title":"Ontology-based activity recognition in intelligent pervasive environments","volume":"5","author":"Chen","year":"2009","journal-title":"Int. J. Web Inf. Syst."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"961","DOI":"10.1109\/TKDE.2011.51","article-title":"A knowledge-driven approach to activity recognition in smart homes","volume":"24","author":"Chen","year":"2011","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_19","unstructured":"Hawarah, L., Ploix, S., and Jacomino, M. User behavior prediction in energy consumption in housing using Bayesian networks. Proceedings of the International Conference on Artificial Intelligence and Soft Computing."},{"key":"ref_20","unstructured":"Huynh, T., Blanke, U., and Schiele, B. Scalable recognition of daily activities with wearable sensors. Proceedings of the International Symposium on Location-and Context-Awareness."},{"key":"ref_21","unstructured":"Patterson, D.J., Fox, D., Kautz, H., and Philipose, M. (2005, January 18\u201321). Fine-grained activity recognition by aggregating abstract object usage. Proceedings of the 9th IEEE International Symposium on Wearable Computers (ISWC\u201905), Osaka, Japan."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"6434","DOI":"10.3390\/s21196434","article-title":"Enhanced human activity recognition using wearable sensors via a hybrid feature selection method","volume":"21","author":"Fan","year":"2021","journal-title":"Sensors"},{"key":"ref_23","unstructured":"Tapia, E.M., Intille, S.S., and Larson, K. Activity recognition in the home using simple and ubiquitous sensors. Proceedings of the International Conference on Pervasive Computing."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1109\/MPRV.2002.1037719","article-title":"Activity and location recognition using wearable sensors","volume":"1","author":"Lee","year":"2002","journal-title":"IEEE Pervasive Comput."},{"key":"ref_25","first-page":"48","article-title":"Evaluating machine learning techniques for activity classification in smart home environments","volume":"12","author":"SEDKY","year":"2018","journal-title":"Int. J. Inf. Syst. Comput. Sci."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1016\/j.buildenv.2016.10.013","article-title":"Modelling window status in school classrooms. Results from a case study in Italy","volume":"111","author":"Stazi","year":"2017","journal-title":"Build. Environ."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Mehr, H.D., Polat, H., and Cetin, A. (2016, January 20\u201321). Resident activity recognition in smart homes by using artificial neural networks. Proceedings of the 2016 4th International Istanbul Smart Grid Congress and Fair (ICSG), Istanbul, Turkyie.","DOI":"10.1109\/SGCF.2016.7492428"},{"key":"ref_28","first-page":"693","article-title":"Unobtrusive activity recognition of elderly people living alone using anonymous binary sensors and DCNN","volume":"23","author":"Gochoo","year":"2018","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1016\/j.engappai.2018.08.009","article-title":"Online activity recognition and daily habit modeling for solitary elderly through indoor position-based stigmergy","volume":"76","author":"Tan","year":"2018","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Mutegeki, R., and Han, D.S. (2020, January 19\u201321). A CNN-LSTM approach to human activity recognition. Proceedings of the 2020 International Conference on Artificial Intelligence in Information and Communication (ICAIIC), Fukuoka, Japan.","DOI":"10.1109\/ICAIIC48513.2020.9065078"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2250","DOI":"10.3390\/s22062250","article-title":"Online Activity Recognition Combining Dynamic Segmentation and Emergent Modeling","volume":"22","author":"Xu","year":"2022","journal-title":"Sensors"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.pmcj.2012.11.004","article-title":"Dynamic sensor data segmentation for real-time knowledge-driven activity recognition","volume":"10","author":"Okeyo","year":"2014","journal-title":"Pervasive Mob. Comput."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Sfar, H., and Bouzeghoub, A. (2019, January 8\u201312). DataSeg: Dynamic streaming sensor data segmentation for activity recognition. Proceedings of the 34th ACM\/SIGAPP Symposium on Applied Computing, Limassol, Cyprus.","DOI":"10.1145\/3297280.3297332"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1016\/j.pmcj.2012.07.003","article-title":"Activity recognition on streaming sensor data","volume":"10","author":"Krishnan","year":"2014","journal-title":"Pervasive Mob. Comput."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"5458","DOI":"10.3390\/s22145458","article-title":"Dynamic Segmentation of Sensor Events for Real-Time Human Activity Recognition in a Smart Home Context","volume":"22","author":"Najeh","year":"2022","journal-title":"Sensors"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Mohmed, G., Lotfi, A., and Pourabdollah, A. (2020, January 30). Employing a deep convolutional neural network for human activity recognition based on binary ambient sensor data. Proceedings of the Proceedings of the 13th ACM International Conference on PErvasive Technologies Related to Assistive Environments, Online.","DOI":"10.1145\/3389189.3397991"},{"key":"ref_37","first-page":"1","article-title":"New incremental SVM algorithms for human activity recognition in smart homes","volume":"2022","author":"Nawal","year":"2022","journal-title":"J. Ambient. Intell. Humaniz. Comput."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1016\/j.neucom.2018.10.104","article-title":"A sequential deep learning application for recognising human activities in smart homes","volume":"396","author":"Liciotti","year":"2020","journal-title":"Neurocomputing"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/4\/1969\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:29:31Z","timestamp":1760120971000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/4\/1969"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,9]]},"references-count":38,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["s23041969"],"URL":"https:\/\/doi.org\/10.3390\/s23041969","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,9]]}}}