{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,25]],"date-time":"2026-07-25T16:50:54Z","timestamp":1784998254282,"version":"3.55.0"},"reference-count":78,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2024,1,22]],"date-time":"2024-01-22T00:00:00Z","timestamp":1705881600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,1,22]],"date-time":"2024-01-22T00:00:00Z","timestamp":1705881600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100009886","name":"Regione Puglia","doi-asserted-by":"publisher","award":["CUP H94I20000410008, Grant n. 7EDD092A"],"award-info":[{"award-number":["CUP H94I20000410008, Grant n. 7EDD092A"]}],"id":[{"id":"10.13039\/501100009886","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010661","name":"Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["Grant n. 883286"],"award-info":[{"award-number":["Grant n. 883286"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Universit\u00e0 degli Studi di Bari Aldo Moro"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Mach Learn"],"published-print":{"date-parts":[[2024,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The identification of anomalous activities is a challenging and crucially important task in sensor networks. This task is becoming increasingly complex with the increasing volume of data generated in real-world domains, and greatly benefits from the use of predictive models to identify anomalies in real time. A key use case for this task is the identification of misbehavior that may be caused by involuntary faults or deliberate actions. However, currently adopted anomaly detection methods are often affected by limitations such as the inability to analyze large-scale data, a reduced effectiveness when data presents multiple densities, a strong dependence on user-defined threshold configurations, and a lack of explainability in the extracted predictions. In this paper, we propose a distributed deep learning method that extends growing hierarchical self-organizing maps, originally designed for clustering tasks, to address anomaly detection tasks. The SOM-based modeling capabilities of the method enable the analysis of data with multiple densities, by exploiting multiple SOMs organized as a hierarchy. Our map-reduce implementation under Apache Spark allows the method to process and analyze large-scale sensor network data. An automatic threshold-tuning strategy reduces user efforts and increases the robustness of the method with respect to noisy instances. Moreover, an explainability component resorting to instance-based feature ranking emphasizes the most salient features influencing the decisions of the anomaly detection model, supporting users in their understanding of raised alerts. Experiments are conducted on five real-world sensor network datasets, including wind and photovoltaic energy production, vehicular traffic, and pedestrian flows. Our results show that the proposed method outperforms state-of-the-art anomaly detection competitors. Furthermore, a scalability analysis reveals that the method is able to scale linearly as the data volume presented increases, leveraging multiple worker nodes in a distributed computing setting. Qualitative analyses on the level of anomalous pollen in the air further emphasize the effectiveness of our proposed method, and its potential in determining the level of danger in raised alerts.<\/jats:p>","DOI":"10.1007\/s10994-023-06501-y","type":"journal-article","created":{"date-parts":[[2024,1,22]],"date-time":"2024-01-22T18:03:02Z","timestamp":1705946582000},"page":"4445-4486","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Distributed and explainable GHSOM for anomaly detection in sensor networks"],"prefix":"10.1007","volume":"113","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8641-7880","authenticated-orcid":false,"given":"Paolo","family":"Mignone","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8366-6059","authenticated-orcid":false,"given":"Roberto","family":"Corizzo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6690-7583","authenticated-orcid":false,"given":"Michelangelo","family":"Ceci","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,1,22]]},"reference":[{"key":"6501_CR1","first-page":"15","volume":"14","author":"V Chandola","year":"2007","unstructured":"Chandola, V., Banerjee, A., & Kumar, V. (2007). Outlier detection: A survey. ACM Computing Surveys, 14, 15.","journal-title":"ACM Computing Surveys"},{"key":"6501_CR2","doi-asserted-by":"crossref","unstructured":"Urvoy, M., & Autrusseau, F. Application of grubbs\u2019 test for outliers to the detection of watermarks. In Proceedings of the 2nd ACM Workshop on Information Hiding and Multimedia Security (pp. 49\u201360) (2014).","DOI":"10.1145\/2600918.2600931"},{"key":"6501_CR3","unstructured":"Rousseeuw, P. J., & Leroy, A. M. Robust regression and outlier detection (2005)."},{"key":"6501_CR4","unstructured":"McCallum, A., Freitag, D., & Pereira, F. C. (2000). Maximum entropy Markov models for information extraction and segmentation. In Icml (Vol. 17, pp. 591\u2013598)."},{"key":"6501_CR5","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1007\/978-1-4615-0953-0_4","volume-title":"Applications of data mining in computer security","author":"E Eskin","year":"2002","unstructured":"Eskin, E., Arnold, A., Prerau, M., Portnoy, L., & Stolfo, S. (2002). A geometric framework for unsupervised anomaly detection: Detecting intrusions in unlabeled data. Applications of data mining in computer security (pp. 77\u2013101). Springer."},{"key":"6501_CR6","volume-title":"Pattern classification","author":"RO Duda","year":"2006","unstructured":"Duda, R. O., & Hart, P. E. (2006). Pattern classification. John Wiley & Sons."},{"issue":"2","key":"6501_CR7","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1162\/neco.1994.6.2.181","volume":"6","author":"MI Jordan","year":"1994","unstructured":"Jordan, M. I., & Jacobs, R. A. (1994). Hierarchical mixtures of experts and the EM algorithm. Neural Computation, 6(2), 181\u2013214.","journal-title":"Neural Computation"},{"issue":"3","key":"6501_CR8","doi-asserted-by":"publisher","first-page":"151","DOI":"10.3233\/JCS-980109","volume":"6","author":"SA Hofmeyr","year":"1998","unstructured":"Hofmeyr, S. A., Forrest, S., & Somayaji, A. (1998). Intrusion detection using sequences of system calls. Journal of Computer Security, 6(3), 151\u2013180.","journal-title":"Journal of Computer Security"},{"key":"6501_CR9","doi-asserted-by":"crossref","unstructured":"Javitz, H. S., & Valdes, A. (1991). The SRI IDES statistical anomaly detector. In IEEE Symposium on Security and Privacy (pp. 316\u2013326).","DOI":"10.1109\/RISP.1991.130799"},{"issue":"8","key":"6501_CR10","first-page":"687","volume":"212","author":"M Desforges","year":"1998","unstructured":"Desforges, M., Jacob, P., & Cooper, J. (1998). Applications of probability density estimation to the detection of abnormal conditions in engineering. Proceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science, 212(8), 687\u2013703.","journal-title":"Proceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science"},{"key":"6501_CR11","unstructured":"Lee, W., & Xiang, D. (2001). Information-theoretic measures for anomaly detection. In Proceedings 2001 IEEE Symposium on Security and Privacy, S &P 2001 (pp. 130\u2013143)."},{"key":"6501_CR12","unstructured":"Arning, A., Agrawal, R., & Raghavan, P. (1996). A linear method for deviation detection in large databases. In: A. Press (Ed.), KDD\u201996 (pp. 164\u2013169)."},{"key":"6501_CR13","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-3860-5","volume-title":"An introduction to Kolmogorov complexity and its applications","author":"M Li","year":"1993","unstructured":"Li, M., & Vit\u00e1nyi, P. M. B. (1993). An introduction to Kolmogorov complexity and its applications. Springer."},{"key":"6501_CR14","doi-asserted-by":"publisher","first-page":"400","DOI":"10.1007\/11538059_42","volume-title":"Advances in intelligent computing","author":"Z He","year":"2005","unstructured":"He, Z., Deng, S., & Xu, X. (2005). An optimization model for outlier detection in categorical data. In D.-S. Huang, X.-P. Zhang, & G.-B. Huang (Eds.), Advances in intelligent computing (pp. 400\u2013409). Springer."},{"key":"6501_CR15","doi-asserted-by":"publisher","unstructured":"Noble, C. C., & Cook, D. J. (2003). Graph-based anomaly detection. In Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD \u201903 (pp. 631\u2013636). Association for Computing Machinery. https:\/\/doi.org\/10.1145\/956750.956831","DOI":"10.1145\/956750.956831"},{"key":"6501_CR16","doi-asserted-by":"publisher","first-page":"218","DOI":"10.1016\/j.compchemeng.2019.04.007","volume":"126","author":"WT Hale","year":"2019","unstructured":"Hale, W. T., Wilhelm, M., Palmer, K. A., Stuber, M. D., & Bollas, G. M. (2019). Semi-infinite programming for global guarantees of robust fault detection and isolation in safety-critical systems. Computers & Chemical Engineering, 126, 218\u2013230. https:\/\/doi.org\/10.1016\/j.compchemeng.2019.04.007","journal-title":"Computers & Chemical Engineering"},{"issue":"2","key":"6501_CR17","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1007\/s41060-021-00258-0","volume":"12","author":"B Lebichot","year":"2021","unstructured":"Lebichot, B., Paldino, G. M., Siblini, W., He-Guelton, L., Obl\u00e9, F., & Bontempi, G. (2021). Incremental learning strategies for credit cards fraud detection. International Journal of Data Science and Analytics, 12(2), 165\u2013174. https:\/\/doi.org\/10.1007\/s41060-021-00258-0","journal-title":"International Journal of Data Science and Analytics"},{"key":"6501_CR18","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2019.105124","volume":"189","author":"A Aldweesh","year":"2020","unstructured":"Aldweesh, A., Derhab, A., & Emam, A. Z. (2020). Deep learning approaches for anomaly-based intrusion detection systems: A survey, taxonomy, and open issues. Knowledge-Based System, 189, 105124. https:\/\/doi.org\/10.1016\/j.knosys.2019.105124","journal-title":"Knowledge-Based System"},{"issue":"3","key":"6501_CR19","doi-asserted-by":"publisher","first-page":"809","DOI":"10.1109\/TBDATA.2020.2991008","volume":"8","author":"M Zhang","year":"2022","unstructured":"Zhang, M., Li, T., Yu, Y., Li, Y., Hui, P., & Zheng, Y. (2022). Urban anomaly analytics: Description, detection, and prediction. IEEE Transactions on Big Data, 8(3), 809\u2013826. https:\/\/doi.org\/10.1109\/TBDATA.2020.2991008","journal-title":"IEEE Transactions on Big Data"},{"key":"6501_CR20","doi-asserted-by":"crossref","unstructured":"Kou, Y., Lu, C. T., & Chen, D. (2006). Spatial weighted outlier detection. In Proceedings of the 2006 SIAM International Conference on Data Mining 2006 (pp. 614\u2013618). SIAM.","DOI":"10.1137\/1.9781611972764.71"},{"key":"6501_CR21","doi-asserted-by":"crossref","unstructured":"Shekhar, S., Lu, C. T., & Zhang, P. (2001). Detecting graph-based spatial outliers: Algorithms and applications (a summary of results). In ACM SIGKDD (pp. 371\u2013376).","DOI":"10.1145\/502512.502567"},{"key":"6501_CR22","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1007\/978-3-030-88942-5_36","volume-title":"Discovery science","author":"R Corizzo","year":"2021","unstructured":"Corizzo, R., Ceci, M., Pio, G., Mignone, P., & Japkowicz, N. (2021). Spatially-aware autoencoders for detecting contextual anomalies in geo-distributed data. In C. Soares & L. Torgo (Eds.), Discovery science (pp. 461\u2013471). Springer."},{"key":"6501_CR23","doi-asserted-by":"publisher","unstructured":"Wang, G., Zhan, Y., Wang, X., Song, M., & Nahrstedt, K. (2022). Hierarchical semi-supervised contrastive learning for contamination-resistant anomaly detection (Vol. 13685, pp. 110\u2013128). https:\/\/doi.org\/10.1007\/978-3-031-19806-9_7","DOI":"10.1007\/978-3-031-19806-9_7"},{"issue":"1","key":"6501_CR24","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1186\/s40537-020-00320-x","volume":"7","author":"S Thudumu","year":"2020","unstructured":"Thudumu, S., Branch, P., Jin, J., & Singh, J. J. (2020). A comprehensive survey of anomaly detection techniques for high dimensional big data. Journal of Big Data, 7(1), 42. https:\/\/doi.org\/10.1186\/s40537-020-00320-x","journal-title":"Journal of Big Data"},{"key":"6501_CR25","doi-asserted-by":"publisher","unstructured":"Reddy Shabad, P. K., Alrashide, A., & Mohammed, O. (2021). Anomaly detection in smart grids using machine learning. In IECON 2021\u201447th Annual Conference of the IEEE Industrial Electronics Society (pp. 1\u20138). https:\/\/doi.org\/10.1109\/IECON48115.2021.9589851","DOI":"10.1109\/IECON48115.2021.9589851"},{"key":"6501_CR26","unstructured":"Sch\u00f6lkopf, B., Williamson, R. C., Smola, A. J., Shawe-Taylor, J., & Platt, J. C. Support vector method for novelty detection. In Advances in neural information processing systems (pp. 582\u2013588) (2000)"},{"key":"6501_CR27","doi-asserted-by":"crossref","unstructured":"Liu, F. T., Ting, K. M., & Zhou, Z. H. Isolation forest. In 2008 Eighth IEEE International Conference on Data Mining pp. 413\u2013422. IEEE.","DOI":"10.1109\/ICDM.2008.17"},{"issue":"1","key":"6501_CR28","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s40537-014-0007-7","volume":"2","author":"MM Najafabadi","year":"2015","unstructured":"Najafabadi, M. M., Villanustre, F., Khoshgoftaar, T. M., Seliya, N., Wald, R., & Muharemagic, E. (2015). Deep learning applications and challenges in big data analytics. Journal of Big Data, 2(1), 1\u201321.","journal-title":"Journal of Big Data"},{"key":"6501_CR29","doi-asserted-by":"crossref","unstructured":"Sakurada, M., & Yairi, T. (2014). Anomaly detection using autoencoders with nonlinear dimensionality reduction. In MLSDA 2014 (pp. 4\u201311).","DOI":"10.1145\/2689746.2689747"},{"key":"6501_CR30","doi-asserted-by":"crossref","unstructured":"Zhou, C., & Paffenroth, R. C. (2017). Anomaly detection with robust deep autoencoders. In ACM SIGKDD 2017 (pp. 665\u2013674).","DOI":"10.1145\/3097983.3098052"},{"key":"6501_CR31","doi-asserted-by":"crossref","unstructured":"Chong, Y. S., & Tay, Y. H. (2017). Abnormal event detection in videos using spatiotemporal autoencoder. In International Symposium on Neural Networks (pp. 189\u2013196). Springer.","DOI":"10.1007\/978-3-319-59081-3_23"},{"key":"6501_CR32","doi-asserted-by":"publisher","unstructured":"Kriegel, H., Schubert, M., & Zimek, A. (2008). Angle-based outlier detection in high-dimensional data (pp. 444\u2013452). https:\/\/doi.org\/10.1145\/1401890.1401946","DOI":"10.1145\/1401890.1401946"},{"key":"6501_CR33","doi-asserted-by":"publisher","unstructured":"Pham, N., & Pagh, R. (2012). A near-linear time approximation algorithm for angle-based outlier detection in high-dimensional data (pp. 877\u2013885). https:\/\/doi.org\/10.1145\/2339530.2339669","DOI":"10.1145\/2339530.2339669"},{"issue":"6","key":"6501_CR34","doi-asserted-by":"publisher","first-page":"5471","DOI":"10.3233\/JIFS-211955","volume":"42","author":"AF Jahromi","year":"2022","unstructured":"Jahromi, A. F., Hajiloei, M., Dehghani, Y., & Lahoninezhad, S. (2022). Improved subspace-based and angle-based outlier detections for fuzzy datasets with a real case study. Journal of Intelligent & Fuzzy Systems, 42(6), 5471\u20135481. https:\/\/doi.org\/10.3233\/JIFS-211955","journal-title":"Journal of Intelligent & Fuzzy Systems"},{"key":"6501_CR35","doi-asserted-by":"publisher","unstructured":"Li, Z., Zhao, Y., Botta, N., Ionescu, C., & Hu, X. (2020). Copod: Copula-based outlier detection. In 2020 IEEE International Conference on Data Mining (ICDM) (pp. 1118\u20131123). https:\/\/doi.org\/10.1109\/ICDM50108.2020.00135","DOI":"10.1109\/ICDM50108.2020.00135"},{"issue":"9","key":"6501_CR36","doi-asserted-by":"publisher","first-page":"1464","DOI":"10.1109\/5.58325","volume":"78","author":"T Kohonen","year":"1990","unstructured":"Kohonen, T. (1990). The self-organizing map. Proceedings of the IEEE, 78(9), 1464\u20131480. https:\/\/doi.org\/10.1109\/5.58325","journal-title":"Proceedings of the IEEE"},{"issue":"2","key":"6501_CR37","doi-asserted-by":"publisher","first-page":"808","DOI":"10.1007\/s11036-019-01353-0","volume":"26","author":"X Qu","year":"2021","unstructured":"Qu, X., Yang, L., Guo, K., Ma, L., Sun, M., Ke, M., & Li, M. (2021). A survey on the development of self-organizing maps for unsupervised intrusion detection. Mobile Networks and Applications, 26(2), 808\u2013829.","journal-title":"Mobile Networks and Applications"},{"key":"6501_CR38","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2018.12.007","author":"A Malondkar","year":"2018","unstructured":"Malondkar, A., Corizzo, R., Kiringa, I., Ceci, M., & Japkowicz, N. (2018). Spark-GHSOM: Growing hierarchical self-organizing map for large scale mixed attribute datasets. Information Sciences. https:\/\/doi.org\/10.1016\/j.ins.2018.12.007","journal-title":"Information Sciences"},{"issue":"2","key":"6501_CR39","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1080\/00401706.1960.10489888","volume":"2","author":"FJ Anscombe","year":"1960","unstructured":"Anscombe, F. J. (1960). Rejection of outliers. Technometrics, 2(2), 123\u2013146.","journal-title":"Technometrics"},{"key":"6501_CR40","doi-asserted-by":"publisher","DOI":"10.1145\/1541880.1541882","author":"V Chandola","year":"2009","unstructured":"Chandola, V., Banerjee, A., & Kumar, V. (2009). Anomaly detection: A survey. ACM Computing Surveys (CSUR). https:\/\/doi.org\/10.1145\/1541880.1541882","journal-title":"ACM Computing Surveys (CSUR)"},{"issue":"1","key":"6501_CR41","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1561\/2200000006","volume":"2","author":"Y Bengio","year":"2009","unstructured":"Bengio, Y. (2009). Learning deep architectures for AI. Foundations and Trends in Machine Learning, 2(1), 1\u2013127. https:\/\/doi.org\/10.1561\/2200000006","journal-title":"Foundations and Trends in Machine Learning"},{"key":"6501_CR42","unstructured":"Kashyap, R. V. (2022). A survey of deep learning optimizers-first and second order methods. CoRRarXiv:2211.15596"},{"key":"6501_CR43","unstructured":"Kingma, D. P., & Ba, J. Adam: A method for stochastic optimization. In Y. Bengio, Y. LeCun (Eds.), 3rd International Conference on Learning Representations, ICLR 2015, 7\u20139 May, 2015, Conference Track Proceedings."},{"key":"6501_CR44","unstructured":"Draxler, F., Veschgini, K., Salmhofer, M., & Hamprecht, F. A. Essentially no barriers in neural network energy landscape. In J. G. Dy, A. Krause (Eds.), Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\u00e4ssan, Stockholm, Sweden, 10\u201315 July, 2018. Proceedings of Machine Learning Research. PMLR."},{"issue":"1","key":"6501_CR45","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1016\/S0925-2312(97)00068-4","volume":"18","author":"A Mu\u00f1oz","year":"1998","unstructured":"Mu\u00f1oz, A., & Muruz\u00e1bal, J. (1998). Self-organizing maps for outlier detection. Neurocomputing, 18(1), 33\u201360. https:\/\/doi.org\/10.1016\/S0925-2312(97)00068-4","journal-title":"Neurocomputing"},{"key":"6501_CR46","doi-asserted-by":"publisher","unstructured":"Palomo, E. J., Ortiz-de-Lazcano-Lobato, J. M., Dom\u00ednguez, E., & Luque, R. M. (2010). An anomaly detection system using a ghsom-1. In The 2010 International Joint Conference on Neural Networks (IJCNN) (pp. 1\u20137). https:\/\/doi.org\/10.1109\/IJCNN.2010.5596967","DOI":"10.1109\/IJCNN.2010.5596967"},{"issue":"12","key":"6501_CR47","doi-asserted-by":"publisher","first-page":"1576","DOI":"10.1016\/j.jpdc.2012.09.004","volume":"72","author":"D Ippoliti","year":"2012","unstructured":"Ippoliti, D., & Zhou, X. (2012). A-ghsom: An adaptive growing hierarchical self organizing map for network anomaly detection. Journal of Parallel and Distributed Computing, 72(12), 1576\u20131590. https:\/\/doi.org\/10.1016\/j.jpdc.2012.09.004","journal-title":"Journal of Parallel and Distributed Computing"},{"key":"6501_CR48","doi-asserted-by":"publisher","unstructured":"Borges Hink, R. C., Beaver, J. M., Buckner, M. A., Morris, T., Adhikari, U., & Pan, S. (2014). Machine learning for power system disturbance and cyber-attack discrimination. In 2014 7th International Symposium on Resilient Control Systems (ISRCS) (pp. 1\u20138). https:\/\/doi.org\/10.1109\/ISRCS.2014.6900095","DOI":"10.1109\/ISRCS.2014.6900095"},{"issue":"3","key":"6501_CR49","doi-asserted-by":"publisher","first-page":"650","DOI":"10.1109\/TII.2015.2420951","volume":"11","author":"S Pan","year":"2015","unstructured":"Pan, S., Morris, T., & Adhikari, U. (2015). Classification of disturbances and cyber-attacks in power systems using heterogeneous time-synchronized data. IEEE Transactions on Industrial Informatics, 11(3), 650\u2013662. https:\/\/doi.org\/10.1109\/TII.2015.2420951","journal-title":"IEEE Transactions on Industrial Informatics"},{"issue":"6","key":"6501_CR50","doi-asserted-by":"publisher","first-page":"3104","DOI":"10.1109\/TSG.2015.2409775","volume":"6","author":"S Pan","year":"2015","unstructured":"Pan, S., Morris, T., & Adhikari, U. (2015). Developing a hybrid intrusion detection system using data mining for power systems. IEEE Transactions on Smart Grid, 6(6), 3104\u20133113. https:\/\/doi.org\/10.1109\/TSG.2015.2409775","journal-title":"IEEE Transactions on Smart Grid"},{"key":"6501_CR51","first-page":"174","volume":"17","author":"S Pan","year":"2015","unstructured":"Pan, S., Morris, T. H., & Adhikari, U. (2015). A specification-based intrusion detection framework for cyber-physical environment in electric power system. International Journal of Network Security, 17, 174\u2013188.","journal-title":"International Journal of Network Security"},{"key":"6501_CR52","doi-asserted-by":"publisher","unstructured":"Shin, H. K., Lee, W., Yun, J. H., & Kim, H. (2020). HAI 1.0: HIL-based augmented ics security dataset. USENIX Association. https:\/\/doi.org\/10.5555\/3485754.3485755","DOI":"10.5555\/3485754.3485755"},{"key":"6501_CR53","doi-asserted-by":"publisher","first-page":"110404","DOI":"10.1016\/j.enbuild.2020.110404","volume":"227","author":"Y Himeur","year":"2020","unstructured":"Himeur, Y., Alsalemi, A., Bensaali, F., & Amira, A. (2020). Building power consumption datasets: Survey, taxonomy and future directions. Energy and Buildings, 227, 110404. https:\/\/doi.org\/10.1016\/j.enbuild.2020.110404","journal-title":"Energy and Buildings"},{"issue":"1","key":"6501_CR54","doi-asserted-by":"publisher","first-page":"404","DOI":"10.1109\/TII.2022.3162846","volume":"19","author":"B Su","year":"2023","unstructured":"Su, B., Zhou, Z., & Chen, H. (2023). Pvel-ad: A large-scale open-world dataset for photovoltaic cell anomaly detection. IEEE Transactions on Industrial Informatics, 19(1), 404\u2013413. https:\/\/doi.org\/10.1109\/TII.2022.3162846","journal-title":"IEEE Transactions on Industrial Informatics"},{"key":"6501_CR55","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1016\/j.neucom.2018.05.017","volume":"310","author":"M De Benedetti","year":"2018","unstructured":"De Benedetti, M., Leonardi, F., Messina, F., Santoro, C., & Vasilakos, A. (2018). Anomaly detection and predictive maintenance for photovoltaic systems. Neurocomputing, 310, 59\u201368. https:\/\/doi.org\/10.1016\/j.neucom.2018.05.017","journal-title":"Neurocomputing"},{"issue":"11","key":"6501_CR56","doi-asserted-by":"publisher","first-page":"8973","DOI":"10.1016\/j.aej.2022.02.038","volume":"61","author":"A Malki","year":"2022","unstructured":"Malki, A., Atlam, E.-S., & Gad, I. (2022). Machine learning approach of detecting anomalies and forecasting time-series of IoT devices. Alexandria Engineering Journal, 61(11), 8973\u20138986. https:\/\/doi.org\/10.1016\/j.aej.2022.02.038","journal-title":"Alexandria Engineering Journal"},{"issue":"3","key":"6501_CR57","doi-asserted-by":"publisher","first-page":"4106","DOI":"10.1109\/JSYST.2021.3136683","volume":"16","author":"A Takiddin","year":"2022","unstructured":"Takiddin, A., Ismail, M., Zafar, U., & Serpedin, E. (2022). Deep autoencoder-based anomaly detection of electricity theft cyberattacks in smart grids. IEEE Systems Journal, 16(3), 4106\u20134117. https:\/\/doi.org\/10.1109\/JSYST.2021.3136683","journal-title":"IEEE Systems Journal"},{"key":"6501_CR58","doi-asserted-by":"publisher","first-page":"156053","DOI":"10.1109\/ACCESS.2020.3019095","volume":"8","author":"M Ceci","year":"2020","unstructured":"Ceci, M., Corizzo, R., Japkowicz, N., Mignone, P., & Pio, G. (2020). Echad: Embedding-based change detection from multivariate time series in smart grids. IEEE Access, 8, 156053\u2013156066.","journal-title":"IEEE Access"},{"key":"6501_CR59","doi-asserted-by":"publisher","first-page":"116601","DOI":"10.1016\/j.apenergy.2021.116601","volume":"287","author":"Y Himeur","year":"2021","unstructured":"Himeur, Y., Ghanem, K., Alsalemi, A., Bensaali, F., & Amira, A. (2021). Artificial intelligence based anomaly detection of energy consumption in buildings: A review, current trends and new perspectives. Applied Energy, 287, 116601. https:\/\/doi.org\/10.1016\/j.apenergy.2021.116601","journal-title":"Applied Energy"},{"issue":"8","key":"6501_CR60","doi-asserted-by":"publisher","first-page":"2260","DOI":"10.1109\/TITS.2017.2675710","volume":"18","author":"M Riveiro","year":"2017","unstructured":"Riveiro, M., Lebram, M., & Elmer, M. (2017). Anomaly detection for road traffic: A visual analytics framework. IEEE Transactions on Intelligent Transportation Systems, 18(8), 2260\u20132270. https:\/\/doi.org\/10.1109\/TITS.2017.2675710","journal-title":"IEEE Transactions on Intelligent Transportation Systems"},{"key":"6501_CR61","doi-asserted-by":"publisher","unstructured":"Kraiman, J. B., Arouh, S. L., & Webb, M. L. (2002). Automated anomaly detection processor. https:\/\/doi.org\/10.1117\/12.474940","DOI":"10.1117\/12.474940"},{"key":"6501_CR62","doi-asserted-by":"publisher","unstructured":"Mignone, P., Malerba, D., & Ceci, M. (2022). Anomaly detection for public transport and air pollution analysis. In 2022 IEEE International Conference on Big Data (Big Data) (pp. 2867\u20132874). https:\/\/doi.org\/10.1109\/BigData55660.2022.10020470","DOI":"10.1109\/BigData55660.2022.10020470"},{"key":"6501_CR63","doi-asserted-by":"publisher","first-page":"108370","DOI":"10.1016\/j.sigpro.2021.108370","volume":"192","author":"SE Sofuoglu","year":"2022","unstructured":"Sofuoglu, S. E., & Aviyente, S. (2022). Gloss: Tensor-based anomaly detection in spatiotemporal urban traffic data. Signal Processing, 192, 108370. https:\/\/doi.org\/10.1016\/j.sigpro.2021.108370","journal-title":"Signal Processing"},{"key":"6501_CR64","doi-asserted-by":"publisher","unstructured":"Zhang, M., Li, T., Shi, H., Li, Y., & Hui, P. (2019). A decomposition approach for urban anomaly detection across spatiotemporal data (pp. 6043\u20136049). https:\/\/doi.org\/10.24963\/ijcai.2019\/837","DOI":"10.24963\/ijcai.2019\/837"},{"issue":"2","key":"6501_CR65","doi-asserted-by":"publisher","first-page":"378","DOI":"10.1007\/s10618-012-0278-6","volume":"25","author":"D Stojanova","year":"2012","unstructured":"Stojanova, D., Ceci, M., Appice, A., & D\u017eeroski, S. (2012). Network regression with predictive clustering trees. Data Mining and Knowledge Discovery, 25(2), 378\u2013413. https:\/\/doi.org\/10.1007\/s10618-012-0278-6","journal-title":"Data Mining and Knowledge Discovery"},{"key":"6501_CR66","doi-asserted-by":"publisher","first-page":"24120","DOI":"10.1109\/ACCESS.2020.2969428","volume":"8","author":"BA Tama","year":"2020","unstructured":"Tama, B. A., Nkenyereye, L., Islam, S. M. R., & Kwak, K.-S. (2020). An enhanced anomaly detection in web traffic using a stack of classifier ensemble. IEEE Access, 8, 24120\u201324134. https:\/\/doi.org\/10.1109\/ACCESS.2020.2969428","journal-title":"IEEE Access"},{"key":"6501_CR67","doi-asserted-by":"publisher","first-page":"366","DOI":"10.1007\/978-981-15-1899-7_26","volume-title":"Big data","author":"X Duan","year":"2019","unstructured":"Duan, X., Chen, N., & Xie, Y. (2019). Intelligent detection of large-scale KPI streams anomaly based on transfer learning. In H. Jin, X. Lin, X. Cheng, X. Shi, N. Xiao, & Y. Huang (Eds.), Big data (pp. 366\u2013379). Springer."},{"issue":"8","key":"6501_CR68","doi-asserted-by":"publisher","first-page":"2440","DOI":"10.1109\/JSAC.2022.3180785","volume":"40","author":"S Zhang","year":"2022","unstructured":"Zhang, S., Zhong, Z., Li, D., Fan, Q., Sun, Y., Zhu, M., Zhang, Y., Pei, D., Sun, J., Liu, Y., Yang, H., & Zou, Y. (2022). Efficient KPI anomaly detection through transfer learning for large-scale web services. IEEE Journal on Selected Areas in Communications, 40(8), 2440\u20132455. https:\/\/doi.org\/10.1109\/JSAC.2022.3180785","journal-title":"IEEE Journal on Selected Areas in Communications"},{"key":"6501_CR69","doi-asserted-by":"publisher","unstructured":"Xu, H., Chen, W., Zhao, N., Li, Z., Bu, J., Li, Z., Liu, Y., Zhao, Y., Pei, D., Feng, Y., Chen, J., Wang, Z., & Qiao, H. (2018). Unsupervised anomaly detection via variational auto-encoder for seasonal KPIs in web applications. In Proceedings of the 2018 World Wide Web Conference. WWW \u201918 (pp. 187\u2013196). International World Wide Web Conferences Steering Committee. https:\/\/doi.org\/10.1145\/3178876.3185996","DOI":"10.1145\/3178876.3185996"},{"key":"6501_CR70","doi-asserted-by":"publisher","unstructured":"Hagemann, T., & Katsarou, K. (2020). Reconstruction-based anomaly detection for the cloud: A comparison on the yahoo! webscope s5 dataset. In Proceedings of the 2020 4th International Conference on Cloud and Big Data Computing. ICCBDC \u201920 (pp. 68\u201375). Association for Computing Machinery. https:\/\/doi.org\/10.1145\/3416921.3416934","DOI":"10.1145\/3416921.3416934"},{"key":"6501_CR71","unstructured":"Yahoo! webscope dataset ydata-labeled-time-series-anomalies-v1_0. https:\/\/research.yahoo.com"},{"key":"6501_CR72","doi-asserted-by":"crossref","unstructured":"Dittenbach, M., Merkl, D., & Rauber, A. (2000). The growing hierarchical self-organizing map. In Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium (Vol. 6, pp. 15\u201319). IEEE.","DOI":"10.1109\/IJCNN.2000.859366"},{"key":"6501_CR73","doi-asserted-by":"publisher","unstructured":"Chan, A., & Pampalk, E. (2002). Growing hierarchical self organising map (ghsom) toolbox: Visualisations and enhancements. In Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP \u201902 (Vol. 5, pp. 2537\u201325415). https:\/\/doi.org\/10.1109\/ICONIP.2002.1201952","DOI":"10.1109\/ICONIP.2002.1201952"},{"key":"6501_CR74","doi-asserted-by":"crossref","unstructured":"Gama, J. (2010). Knowledge discovery from data streams.","DOI":"10.1201\/EBK1439826119"},{"key":"6501_CR75","doi-asserted-by":"crossref","unstructured":"Beggel, L., Pfeiffer, M., & Bischl, B. Robust anomaly detection in images using adversarial autoencoders. In ECMLPKDD 2019 (pp. 206\u2013222). Springer.","DOI":"10.1007\/978-3-030-46150-8_13"},{"issue":"96","key":"6501_CR76","first-page":"1","volume":"20","author":"Y Zhao","year":"2019","unstructured":"Zhao, Y., Nasrullah, Z., & Li, Z. (2019). Pyod: A python toolbox for scalable outlier detection. Journal of Machine Learning Research, 20(96), 1\u20137.","journal-title":"Journal of Machine Learning Research"},{"key":"6501_CR77","doi-asserted-by":"crossref","unstructured":"Bengio, Y. (2012). Practical recommendations for gradient-based training of deep architectures (pp. 437\u2013478).","DOI":"10.1007\/978-3-642-35289-8_26"},{"issue":"3","key":"6501_CR78","doi-asserted-by":"publisher","first-page":"956","DOI":"10.1109\/TII.2016.2604758","volume":"13","author":"M Ceci","year":"2016","unstructured":"Ceci, M., Corizzo, R., Fumarola, F., Malerba, D., & Rashkovska, A. (2016). Predictive modeling of pv energy production: How to set up the learning task for a better prediction? IEEE Transactions on Industrial Informatics, 13(3), 956\u2013966.","journal-title":"IEEE Transactions on Industrial Informatics"}],"container-title":["Machine Learning"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-023-06501-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10994-023-06501-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-023-06501-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,31]],"date-time":"2024-05-31T18:49:10Z","timestamp":1717181350000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10994-023-06501-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,22]]},"references-count":78,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2024,7]]}},"alternative-id":["6501"],"URL":"https:\/\/doi.org\/10.1007\/s10994-023-06501-y","relation":{},"ISSN":["0885-6125","1573-0565"],"issn-type":[{"value":"0885-6125","type":"print"},{"value":"1573-0565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,22]]},"assertion":[{"value":"8 March 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 October 2023","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 December 2023","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 January 2024","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"Not applicable.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}}]}}