{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T19:34:31Z","timestamp":1774899271659,"version":"3.50.1"},"reference-count":21,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2021,11,6]],"date-time":"2021-11-06T00:00:00Z","timestamp":1636156800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Multivariate time series anomaly detection is a widespread problem in the field of failure prevention. Fast prevention means lower repair costs and losses. The amount of sensors in novel industry systems makes the anomaly detection process quite difficult for humans. Algorithms that automate the process of detecting anomalies are crucial in modern failure prevention systems. Therefore, many machine learning models have been designed to address this problem. Mostly, they are autoencoder-based architectures with some generative adversarial elements. This work shows a framework that incorporates neuroevolution methods to boost the anomaly detection scores of new and already known models. The presented approach adapts evolution strategies for evolving an ensemble model, in which every single model works on a subgroup of data sensors. The next goal of neuroevolution is to optimize the architecture and hyperparameters such as the window size, the number of layers, and the layer depths. The proposed framework shows that it is possible to boost most anomaly detection deep learning models in a reasonable time and a fully automated mode. We ran tests on the SWAT and WADI datasets. To the best of our knowledge, this is the first approach in which an ensemble deep learning anomaly detection model is built in a fully automatic way using a neuroevolution strategy.<\/jats:p>","DOI":"10.3390\/e23111466","type":"journal-article","created":{"date-parts":[[2021,11,7]],"date-time":"2021-11-07T20:41:14Z","timestamp":1636317674000},"page":"1466","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Ensemble Neuroevolution-Based Approach for Multivariate Time Series Anomaly Detection"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4221-0017","authenticated-orcid":false,"given":"Kamil","family":"Faber","sequence":"first","affiliation":[{"name":"Department of Computer Science, AGH University of Science and Technology, Adama Mickiewicza 30, 30-059 Krakow, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9357-9231","authenticated-orcid":false,"given":"Marcin","family":"Pietron","sequence":"additional","affiliation":[{"name":"Department of Computer Science, AGH University of Science and Technology, Adama Mickiewicza 30, 30-059 Krakow, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5329-1452","authenticated-orcid":false,"given":"Dominik","family":"Zurek","sequence":"additional","affiliation":[{"name":"Department of Computer Science, AGH University of Science and Technology, Adama Mickiewicza 30, 30-059 Krakow, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Deng, A., and Hooi, B. (2021). Graph Neural Network-Based Anomaly Detection in Multivariate Time Series. arXiv.","DOI":"10.1609\/aaai.v35i5.16523"},{"key":"ref_2","unstructured":"Miikkulainen, R., Liang, J., Meyerson, E., Rawal, A., Fink, D., Francon, O., Raju, B., Shahrzad, H., Navruzyan, A., and Duffy, N. (2017). Evolving Deep Neural Networks. arXiv."},{"key":"ref_3","unstructured":"Isermann, R. (2004, January 14\u201318). Model-Based Fault Detection and Diagnosis - Status and Applications. Proceedings of the 16th IFAC Symposium on Automatic Control in Aerospace 2004, Saint-Petersburg, Russia."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Elomaa, T., Mannila, H., and Toivonen, H. (2002). Fast Outlier Detection in High Dimensional Spaces. Principles of Data Mining and Knowledge Discovery, Springer.","DOI":"10.1007\/3-540-45681-3"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1145\/335191.335388","article-title":"LOF: Identifying Density-Based Local Outliers","volume":"29","author":"Breunig","year":"2000","journal-title":"SIGMOD Rec."},{"key":"ref_6","unstructured":"Ma, J., and Perkins, S. (2003, January 20\u201324). Time-series novelty detection using one-class support vector machines. Proceedings of the International Joint Conference on Neural Networks, Jantzen Beachm Portland, OR, USA."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Liu, F.T., Ting, K.M., and Zhou, Z.H. (2008, January 15\u201319). Isolation Forest. Proceedings of the 2008 Eighth IEEE International Conference on Data Mining, Washington, DC, USA.","DOI":"10.1109\/ICDM.2008.17"},{"key":"ref_8","unstructured":"Zong, B., Song, Q., Min, M.R., Cheng, W., Lumezanu, C., ki Cho, D., and Chen, H. (May, January 30). Deep Autoencoding Gaussian Mixture Model for Unsupervised Anomaly Detection. Proceedings of the 6th International Conference on Learning Representations (ICLR 2018), Vancouver, BC, Canada."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1544","DOI":"10.1109\/LRA.2018.2801475","article-title":"A Multimodal Anomaly Detector for Robot-Assisted Feeding Using an LSTM-Based Variational Autoencoder","volume":"3","author":"Park","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_10","unstructured":"Russo, S., Disch, A., Blumensaat, F., and Villez, K. (2020). Anomaly Detection using Deep Autoencoders for in-situ Wastewater Systems Monitoring Data. arXiv."},{"key":"ref_11","unstructured":"Audibert, J., Michiardi, P., Guyard, F., Marti, S., and Zuluaga, M.A. (2020, January 6\u201310). USAD: UnSupervised Anomaly Detection on Multivariate Time Series. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery Data Mining, KDD \u201920, online."},{"key":"ref_12","unstructured":"Tetko, I.V., K\u016frkov\u00e1, V., Karpov, P., and Theis, F. (2019). MAD-GAN: Multivariate Anomaly Detection for Time Series Data with Generative Adversarial Networks. Artificial Neural Networks and Machine Learning\u2014ICANN 2019: Text and Time Series, Springer International Publishing."},{"key":"ref_13","unstructured":"Galvan, P.M.E. (2020). Neuroevolution in Deep Neural Networks: Current Trends and Future Challenges. arXiv."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/j.isprsjprs.2020.11.025","article-title":"SceneNet: Remote sensing scene classification deep learning network using multi-objective neural evolution architecture search","volume":"172","author":"Ma","year":"2021","journal-title":"ISPRS J. Photogramm. Remote. Sens."},{"key":"ref_15","unstructured":"Sun, Y., Xue, B., Zhang, M., and Yen, G.G. (2017). Evolving Deep Convolutional Neural Networks for Image Classification. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Mirsky, Y., Doitshman, T., Elovici, Y., and Shabtai, A. (2018). Kitsune: An Ensemble of Autoencoders for Online Network Intrusion Detection. arXiv.","DOI":"10.14722\/ndss.2018.23204"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Jin, X., Xing, X., Elahi, H., Wang, G., and Jiang, H. (2020, January 10\u201313). A Malware Detection Approach Using Malware Images and Autoencoders. Proceedings of the 2020 IEEE 17th International Conference on Mobile Ad Hoc and Sensor Systems (MASS), Delhi, India.","DOI":"10.1109\/MASS50613.2020.00009"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1111\/coin.12146","article-title":"Threaded ensembles of autoencoders for stream learning","volume":"34","author":"Dong","year":"2018","journal-title":"Comput. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Mathur, A.P., and Tippenhauer, N.O. (2016, January 11). SWaT: A water treatment testbed for research and training on ICS security. Proceedings of the 2016 International Workshop on Cyber-Physical Systems for Smart Water Networks (CySWater), Vienna, Austria.","DOI":"10.1109\/CySWater.2016.7469060"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ahmed, C., Palleti, V., and Mathur, A. (2017, January 21). WADI: A water distribution testbed for research in the design of secure cyber physical systems. Proceedings of the 3rd International Workshop on Cyber-Physical Systems for Smart Water Networks, Pittsburgh, PA, USA.","DOI":"10.1145\/3055366.3055375"},{"key":"ref_21","unstructured":"Maas, A.L., Hannun, A.Y., and Ng, A.Y. (2013, January 16\u201321). Rectifier nonlinearities improve neural network acoustic models. Proceedings of the ICML Workshop on Deep Learning for Audio, Speech and Language Processing, Atlanta, GA, USA."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/11\/1466\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:26:44Z","timestamp":1760167604000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/11\/1466"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,6]]},"references-count":21,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2021,11]]}},"alternative-id":["e23111466"],"URL":"https:\/\/doi.org\/10.3390\/e23111466","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,6]]}}}