{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T17:52:50Z","timestamp":1781891570668,"version":"3.54.5"},"reference-count":58,"publisher":"SAGE Publications","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["AIS"],"published-print":{"date-parts":[[2024,6,7]]},"abstract":"<jats:p>Detecting anomalies in patterns of sensor data is important in many practical applications, including domestic activity monitoring for Active Assisted Living (AAL). How to represent and analyse these patterns, however, remains a challenging task, especially when data is relatively scarce and an explicit model is required to be fine-tuned for specific scenarios. This paper, therefore, presents a new approach for temporal modelling of long-term human activities with smart-home sensors, which is used to detect anomalous situations in a robot-assisted environment. The model is based on wavelet transforms and used to forecast smart sensor data, providing a temporal prior to detect unexpected events in human environments. To this end, a new extension of Hybrid Markov Logic Networks has been developed that merges different anomaly indicators, including activities detected by binary sensors, expert logic rules, and wavelet-based temporal models. The latter in particular allows the inference system to discover deviations from long-term activity patterns, which cannot be detected by simpler frequency-based models. Two new publicly available datasets were collected using several smart-sensors to evaluate the approach in office and domestic scenarios. The experimental results demonstrate the effectiveness of the proposed solutions and their successful deployment in complex human environments, showing their potential for future smart-home and robot integrated services.<\/jats:p>","DOI":"10.3233\/ais-230144","type":"journal-article","created":{"date-parts":[[2023,11,3]],"date-time":"2023-11-03T12:11:19Z","timestamp":1699013479000},"page":"181-200","source":"Crossref","is-referenced-by-count":2,"title":["Wavelet-based temporal models of human activity for anomaly detection in smart robot-assisted environments1"],"prefix":"10.1177","volume":"16","author":[{"given":"Manuel","family":"Fernandez-Carmona","sequence":"first","affiliation":[{"name":"Ingenier\u00eda de Sistemas Integrados Group, University of M\u00e1laga (UMA), Malaga, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sariah","family":"Mghames","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Lincoln, Lincoln, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicola","family":"Bellotto","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Lincoln, Lincoln, United Kingdom"},{"name":"Department of Information Engineering, University of Padua, Padua, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","reference":[{"key":"10.3233\/AIS-230144_ref1","doi-asserted-by":"crossref","unstructured":"J.\u00a0Audibert, P.\u00a0Michiardi, F.\u00a0Guyard, S.\u00a0Marti and M.A.\u00a0Zuluaga, Usad: Unsupervised anomaly detection on multivariate time series, in: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2020, pp.\u00a03395\u20133404.","DOI":"10.1145\/3394486.3403392"},{"issue":"2","key":"10.3233\/AIS-230144_ref2","doi-asserted-by":"publisher","first-page":"1721","DOI":"10.3390\/s110201721","article-title":"Leg motion classification with artificial neural networks using wavelet-based features of gyroscope signals","volume":"11","author":"Ayrulu-Erdem","year":"2011","journal-title":"Sensors"},{"key":"10.3233\/AIS-230144_ref4","unstructured":"N.\u00a0Bellotto, M.\u00a0Fernandez-Carmona and S.\u00a0Cosar, ENRICHME integration of ambient intelligence and robotics for AAL, in: Wellbeing AI: From Machine Learning to Subjectivity Oriented Computing (AAAI 2017 Spring Symposium), AAAI, 2017."},{"key":"10.3233\/AIS-230144_ref5","unstructured":"A.E.\u00a0Budson and P.R.\u00a0Solomon, Memory Loss, Alzheimer\u2019s Disease, and Dementia-E-Book: A Practical Guide for Clinicians, Elsevier Health Sciences, 2021."},{"issue":"4","key":"10.3233\/AIS-230144_ref7","doi-asserted-by":"publisher","first-page":"399","DOI":"10.3233\/AIS-160386","article-title":"On-line human activity recognition from audio and home automation sensors: Comparison of sequential and non-sequential models in realistic smart homes","volume":"8","author":"Chahuara","year":"2016","journal-title":"Journal of ambient intelligence and smart environments"},{"issue":"2","key":"10.3233\/AIS-230144_ref8","doi-asserted-by":"publisher","first-page":"667","DOI":"10.1109\/TPWRS.2009.2033277","article-title":"ARIMA-based time series model of stochastic wind power generation","volume":"25","author":"Chen","year":"2010","journal-title":"IEEE Trans. on Power Systems"},{"key":"10.3233\/AIS-230144_ref9","unstructured":"K.\u00a0Chodorow, MongoDB: The Definitive Guide, O\u2019Reilly Media, 2013."},{"key":"10.3233\/AIS-230144_ref10","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2022.109147"},{"issue":"2","key":"10.3233\/AIS-230144_ref11","doi-asserted-by":"publisher","first-page":"1035","DOI":"10.1109\/TPWRS.2005.846054","article-title":"Day-ahead electricity price forecasting using the wavelet transform and ARIMA models","volume":"20","author":"Conejo","year":"2005","journal-title":"IEEE Trans. on Power Systems"},{"issue":"7","key":"10.3233\/AIS-230144_ref12","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1109\/MC.2012.328","article-title":"CASAS: A smart home in a box","volume":"46","author":"Cook","year":"2013","journal-title":"Computer"},{"key":"10.3233\/AIS-230144_ref13","unstructured":"C.\u00a0Coppola, T.\u00a0Krajnik, T.\u00a0Duckett and N.\u00a0Bellotto, Learning temporal context for activity recognition, in: 2016 ECAI, 2016, pp.\u00a0107\u2013115."},{"key":"10.3233\/AIS-230144_ref14","doi-asserted-by":"publisher","first-page":"779","DOI":"10.1007\/s12369-019-00614-y","article-title":"ENRICHME: Perception and interaction of an assistive robot for the elderly at home","volume":"12","author":"Cosar","year":"2020","journal-title":"International Journal of Social Robotics"},{"issue":"2","key":"10.3233\/AIS-230144_ref15","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1111\/j.1741-6612.2007.00217.x","article-title":"A survey of the frequency and impact of behaviours of concern in dementia on residential aged care staff","volume":"26","author":"Cubit","year":"2007","journal-title":"Australasian Journal on Ageing"},{"issue":"3","key":"10.3233\/AIS-230144_ref16","doi-asserted-by":"publisher","first-page":"358","DOI":"10.1109\/TCYB.2014.2326059","article-title":"Texture classification and retrieval using shearlets and linear regression","volume":"45","author":"Dong","year":"2015","journal-title":"IEEE Trans. on Cybernetics"},{"key":"10.3233\/AIS-230144_ref17","unstructured":"S.\u00a0Elsworth and S.\u00a0G\u00fcttel, Time Series Forecasting Using LSTM Networks: A Symbolic Approach, 2020."},{"key":"10.3233\/AIS-230144_ref18","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1016\/j.patcog.2016.03.028","article-title":"High-dimensional and large-scale anomaly detection using a linear one-class SVM with deep learning","volume":"58","author":"Erfani","year":"2016","journal-title":"Pattern Recognition"},{"key":"10.3233\/AIS-230144_ref19","doi-asserted-by":"crossref","unstructured":"J.\u00a0Fairbanks, D.\u00a0Ediger, R.\u00a0McColl, D.A.\u00a0Bader and E.\u00a0Gilbert, A statistical framework for streaming graph analysis, in: 2013 IEEE\/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2013), 2013, pp.\u00a0341\u2013347.","DOI":"10.1145\/2492517.2492620"},{"issue":"9","key":"10.3233\/AIS-230144_ref20","doi-asserted-by":"publisher","first-page":"3981","DOI":"10.1109\/TIP.2012.2200491","article-title":"Efficient image denoising method based on a new adaptive wavelet packet thresholding function","volume":"21","author":"Fathi","year":"2012","journal-title":"IEEE Trans. on Image Processing"},{"key":"10.3233\/AIS-230144_ref21","doi-asserted-by":"crossref","unstructured":"M.\u00a0Fernandez-Carmona and N.\u00a0Bellotto, On-line inference comparison with Markov logic network engines for activity recognition in AAL environments, in: IEEE International Conference on Intelligent Environments, IEEE, 2016.","DOI":"10.1109\/IE.2016.29"},{"key":"10.3233\/AIS-230144_ref22","doi-asserted-by":"crossref","unstructured":"M.\u00a0Fernandez-Carmona, S.\u00a0Cosar, C.\u00a0Coppola and N.\u00a0Bellotto, Entropy-based abnormal activity detection fusing RGB-d and domotic sensors, in: IEEE Int. Conf. on Multisensor Fusion and Integration for Intelligent Systems (MFI), 2017.","DOI":"10.1109\/MFI.2017.8170405"},{"issue":"10","key":"10.3233\/AIS-230144_ref23","doi-asserted-by":"publisher","first-page":"1978","DOI":"10.1109\/TCYB.2014.2322310","article-title":"Structural generative descriptions for time series classification","volume":"44","author":"Garc\u00eda-Trevi\u00f1o","year":"2014","journal-title":"IEEE Trans. on Cybernetics"},{"issue":"2","key":"10.3233\/AIS-230144_ref24","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1007\/s00779-014-0827-7","article-title":"Hierarchical activity recognition for dementia care using Markov logic network","volume":"19","author":"Gayathri","year":"2015","journal-title":"Personal Ubiquitous Comput."},{"key":"10.3233\/AIS-230144_ref25","unstructured":"N.H.\u00a0Ghassemi and M.P.\u00a0Deisenroth, Analytic long-term forecasting with periodic Gaussian processes, in: AISTATS, 2014, pp.\u00a0303\u2013311."},{"issue":"11","key":"10.3233\/AIS-230144_ref26","doi-asserted-by":"crossref","first-page":"2580","DOI":"10.1016\/j.csda.2009.12.010","article-title":"Wavelet-based detection of outliers in financial time series","volume":"54","author":"Gran\u00e9","year":"2010","journal-title":"Computational Statistics & Data Analysis"},{"key":"10.3233\/AIS-230144_ref28","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1016\/j.knosys.2017.09.030","article-title":"Learning and inference in knowledge-based probabilistic model for medical diagnosis","volume":"138","author":"Jiang","year":"2017","journal-title":"Knowledge-Based Systems"},{"key":"10.3233\/AIS-230144_ref29","doi-asserted-by":"crossref","unstructured":"F.\u00a0Jovan, J.\u00a0Wyatt, N.\u00a0Hawes and T.\u00a0Krajn\u00edk, A Poisson-spectral model for modelling temporal patterns in human data observed by a robot, in: 2016 IROS, 2016, pp.\u00a04013\u20134018. ISSN 2153-0866.","DOI":"10.1109\/IROS.2016.7759591"},{"key":"10.3233\/AIS-230144_ref30","doi-asserted-by":"crossref","unstructured":"T.\u00a0Krajnik, J.P.\u00a0Fentanes, G.\u00a0Cielniak, C.\u00a0Dondrup and T.\u00a0Duckett, Spectral analysis for long-term robotic mapping, in: 2014 ICRA, 2014, pp.\u00a03706\u20133711. ISSN 1050-4729.","DOI":"10.1109\/ICRA.2014.6907396"},{"key":"10.3233\/AIS-230144_ref31","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-36824-0_15"},{"issue":"6","key":"10.3233\/AIS-230144_ref32","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1080\/19427867.2017.1342945","article-title":"Modeling travel mode choice behavior with bounded rationality using Markov logic networks","volume":"11","author":"Li","year":"2019","journal-title":"Transportation Letters"},{"key":"10.3233\/AIS-230144_ref33","doi-asserted-by":"crossref","unstructured":"Z.\u00a0Li, Y.\u00a0Zhao, N.\u00a0Botta, C.\u00a0Ionescu and X.\u00a0Hu, COPOD: Copula-based outlier detection, in: IEEE International Conference on Data Mining (ICDM), IEEE, 2020.","DOI":"10.1109\/ICDM50108.2020.00135"},{"issue":"1","key":"10.3233\/AIS-230144_ref34","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1109\/TCYB.2015.2399172","article-title":"Learning spatio-temporal representations for action recognition: A genetic programming approach","volume":"46","author":"Liu","year":"2016","journal-title":"IEEE Trans. on Cybernetics"},{"key":"10.3233\/AIS-230144_ref35","first-page":"23","article-title":"Web survey paradata on response time outliers: A systematic literature review","volume":"15","author":"Matja\u0161i\u010d","year":"2018","journal-title":"Metodoloski Zvezki"},{"key":"10.3233\/AIS-230144_ref36","doi-asserted-by":"crossref","unstructured":"S.\u00a0Mghames, L.\u00a0Castri, M.\u00a0Hanheide and N.\u00a0Bellotto, A neuro-symbolic approach for enhanced human motion prediction, in: Proceedings of the International Joint Conference on Neural Networks (IJCNN), 2023.","DOI":"10.1109\/IJCNN54540.2023.10191970"},{"key":"10.3233\/AIS-230144_ref37","doi-asserted-by":"publisher","first-page":"74422","DOI":"10.1109\/ACCESS.2019.2921096","article-title":"Outlier detection in wearable sensor data for human activity recognition (HAR) based on DRNNs","volume":"7","author":"Munoz-Organero","year":"2019","journal-title":"IEEE Access"},{"key":"10.3233\/AIS-230144_ref38","doi-asserted-by":"publisher","DOI":"10.1109\/OPTIP.2016.7528492"},{"issue":"4","key":"10.3233\/AIS-230144_ref39","doi-asserted-by":"publisher","first-page":"554","DOI":"10.3390\/math10040554","article-title":"Abnormality detection and failure prediction using explainable Bayesian deep learning: Methodology and case study with industrial data","volume":"10","author":"Nor","year":"2022","journal-title":"Mathematics"},{"key":"10.3233\/AIS-230144_ref40","doi-asserted-by":"crossref","unstructured":"R.\u00a0Ravichandran, E.\u00a0Prassler, N.\u00a0Huebel and S.\u00a0Blumenthal, A workbench for quantitative comparison of databases in multi-robot applications, in: 2018 IROS, 2018, pp.\u00a03744\u20133750.","DOI":"10.1109\/IROS.2018.8594241"},{"key":"10.3233\/AIS-230144_ref41","doi-asserted-by":"publisher","DOI":"10.3390\/app13031778"},{"issue":"1\u20132","key":"10.3233\/AIS-230144_ref42","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1007\/s10994-006-5833-1","article-title":"Markov Logic Networks","volume":"62","author":"Richardson","year":"2006","journal-title":"Machine learning"},{"key":"10.3233\/AIS-230144_ref44","unstructured":"L.\u00a0Serafini and A.A.\u00a0Garcez, Logic tensor networks: Deep learning and logical reasoning from data and knowledge, in: 11th Int. Workshop on Neural-Symbolic Learning and Reasoning (NeSy16), 2016."},{"issue":"7","key":"10.3233\/AIS-230144_ref45","doi-asserted-by":"crossref","first-page":"2501","DOI":"10.1109\/TSMC.2018.2819026","article-title":"Toward hand-dominated activity recognition systems with wristband-interaction behavior analysis","volume":"50","author":"Shen","year":"2020","journal-title":"IEEE Trans. on Systems, Man, and Cybernetics: Systems"},{"key":"10.3233\/AIS-230144_ref46","unstructured":"L.\u00a0Smirek, G.\u00a0Zimmermann and D.\u00a0Ziegler, Towards universally usable smart homes\u00a0\u2013 how can MyUI, URC and openHAB contribute to an adaptive user interface platform? in: CENTRIC 2014, Nice, France, 2014, pp.\u00a029\u201338. ISBN 9781612083698."},{"key":"10.3233\/AIS-230144_ref47","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1016\/j.engappai.2015.06.006","article-title":"Unsupervised discovery of activities of daily living characterized by their periodicity and variability","volume":"45","author":"Soulas","year":"2015","journal-title":"Engineering Applications of Artificial Intelligence"},{"key":"10.3233\/AIS-230144_ref48","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330672"},{"key":"10.3233\/AIS-230144_ref49","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1016\/j.neucom.2015.03.085","article-title":"A novel wavelet-SVM short-time passenger flow prediction in Beijing subway system","volume":"166","author":"Sun","year":"2015","journal-title":"Neurocomputing"},{"key":"10.3233\/AIS-230144_ref50","doi-asserted-by":"publisher","DOI":"10.1109\/PERCOMW.2018.8480299"},{"issue":"2","key":"10.3233\/AIS-230144_ref51","doi-asserted-by":"publisher","first-page":"350","DOI":"10.3390\/make4020015","article-title":"An attention-based ConvLSTM autoencoder with dynamic thresholding for unsupervised anomaly detection in multivariate time series","volume":"4","author":"Tayeh","year":"2022","journal-title":"Machine Learning and Knowledge Extraction"},{"key":"10.3233\/AIS-230144_ref52","doi-asserted-by":"crossref","unstructured":"T.L.M.\u00a0van Kasteren, G.\u00a0Englebienne and B.\u00a0Kr\u00f6se, Human activity recognition from wireless sensor network data: Benchmark and software, in: Activity Recognition in Pervasive Intelligent Environments, Ambient and Pervasive Intelligence, Atlantis Press, 2010.","DOI":"10.2991\/978-94-91216-05-3_8"},{"key":"10.3233\/AIS-230144_ref53","doi-asserted-by":"publisher","DOI":"10.1109\/ICMA.2018.8484380"},{"key":"10.3233\/AIS-230144_ref54","unstructured":"J.\u00a0Wang and P.\u00a0Domingos, Hybrid Markov logic networks, in: 23 National Conference on Artificial Intelligence, AAAI\u201908, Vol.\u00a02, AAAI Press, 2008, pp.\u00a01106\u20131111. ISBN 978-1-57735-368-3."},{"issue":"2","key":"10.3233\/AIS-230144_ref55","doi-asserted-by":"publisher","first-page":"1659","DOI":"10.1109\/TVT.2016.2555986","article-title":"Device-free simultaneous wireless localization and activity recognition with wavelet feature","volume":"66","author":"Wang","year":"2017","journal-title":"IEEE Trans. on Vehicular Technology"},{"issue":"2","key":"10.3233\/AIS-230144_ref56","doi-asserted-by":"publisher","first-page":"823","DOI":"10.1007\/s00521-021-05731-2","article-title":"A novel energy-based online sequential extreme learning machine to detect anomalies over real-time data streams","volume":"34","author":"Wang","year":"2022","journal-title":"Neural Computing and Applications"},{"key":"10.3233\/AIS-230144_ref57","doi-asserted-by":"crossref","unstructured":"Y.\u00a0Wei, J.\u00a0Jang-Jaccard, W.\u00a0Xu, F.\u00a0Sabrina, S.\u00a0Camtepe and M.\u00a0Boulic, Lstm-autoencoder based anomaly detection for indoor air quality time series data, IEEE Sensors Journal (2023).","DOI":"10.1109\/JSEN.2022.3230361"},{"issue":"10","key":"10.3233\/AIS-230144_ref58","doi-asserted-by":"publisher","first-page":"1545","DOI":"10.1109\/LSP.2018.2867724","article-title":"NonSTOP: A NonSTationary online prediction method for time series","volume":"25","author":"Xie","year":"2018","journal-title":"IEEE Signal Processing Letters"},{"key":"10.3233\/AIS-230144_ref59","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611975673.66"},{"issue":"96","key":"10.3233\/AIS-230144_ref60","first-page":"1","article-title":"PyOD: A Python toolbox for scalable outlier detection","volume":"20","author":"Zhao","year":"2019","journal-title":"Journal of Machine Learning Research"},{"issue":"5","key":"10.3233\/AIS-230144_ref61","doi-asserted-by":"publisher","first-page":"3469","DOI":"10.1109\/TII.2020.3022432","article-title":"Variational LSTM enhanced anomaly detection for industrial big data","volume":"17","author":"Zhou","year":"2020","journal-title":"IEEE Transactions on Industrial Informatics"},{"key":"10.3233\/AIS-230144_ref62","unstructured":"B.\u00a0Zong, Q.\u00a0Song, M.R.\u00a0Min, W.\u00a0Cheng, C.\u00a0Lumezanu, D.\u00a0Cho and H.\u00a0Chen, Deep autoencoding Gaussian mixture model for unsupervised anomaly detection, in: International Conference on Learning Representations, 2018."}],"container-title":["Journal of Ambient Intelligence and Smart Environments"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/AIS-230144","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T09:19:27Z","timestamp":1777367967000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/AIS-230144"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,7]]},"references-count":58,"journal-issue":{"issue":"2"},"URL":"https:\/\/doi.org\/10.3233\/ais-230144","relation":{},"ISSN":["1876-1372","1876-1364"],"issn-type":[{"value":"1876-1372","type":"electronic"},{"value":"1876-1364","type":"print"}],"subject":[],"published":{"date-parts":[[2024,6,7]]}}}