{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T09:04:43Z","timestamp":1774602283687,"version":"3.50.1"},"reference-count":40,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2021,5,7]],"date-time":"2021-05-07T00:00:00Z","timestamp":1620345600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Automatic anomaly detection monitoring plays a vital role in water utilities\u2019 distribution systems to reduce the risk posed by unclean water to consumers. One of the major problems with anomaly detection is imbalanced datasets. Dynamic selection techniques combined with ensemble models have proven to be effective for imbalanced datasets classification tasks. In this paper, water quality anomaly detection is formulated as a classification problem in the presences of class imbalance. To tackle this problem, considering the asymmetry dataset distribution between the majority and minority classes, the performance of sixteen previously proposed single and static ensemble classification methods embedded with resampling strategies are first optimised and compared. After that, six dynamic selection techniques, namely, Modified Class Rank (Rank), Local Class Accuracy (LCA), Overall-Local Accuracy (OLA), K-Nearest Oracles Eliminate (KNORA-E), K-Nearest Oracles Union (KNORA-U) and Meta-Learning for Dynamic Ensemble Selection (META-DES) in combination with homogeneous and heterogeneous ensemble models and three SMOTE-based resampling algorithms (SMOTE, SMOTE+ENN and SMOTE+Tomek Links), and one missing data method (missForest) are proposed and evaluated. A binary real-world drinking-water quality anomaly detection dataset is utilised to evaluate the models. The experimental results obtained reveal all the models benefitting from the combined optimisation of both the classifiers and resampling methods. Considering the three performance measures (balanced accuracy, F-score and G-mean), the result also shows that the dynamic classifier selection (DCS) techniques, in particular, the missForest+SMOTE+RANK and missForest+SMOTE+OLA models based on homogeneous ensemble-bagging with decision tree as the base classifier, exhibited better performances in terms of balanced accuracy and G-mean, while the Bg+mF+SMENN+LCA model based on homogeneous ensemble-bagging with random forest has a better overall F1-measure in comparison to the other models.<\/jats:p>","DOI":"10.3390\/sym13050818","type":"journal-article","created":{"date-parts":[[2021,5,7]],"date-time":"2021-05-07T22:36:24Z","timestamp":1620426984000},"page":"818","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Accessing Imbalance Learning Using Dynamic Selection Approach in Water Quality Anomaly Detection"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6125-0180","authenticated-orcid":false,"given":"Eustace M.","family":"Dogo","sequence":"first","affiliation":[{"name":"Department of Electrical and Electronic Engineering Science, University of Johannesburg, Auckland Park, Johannesburg 2006, South Africa"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nnamdi I.","family":"Nwulu","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronic Engineering Science, University of Johannesburg, Auckland Park, Johannesburg 2006, South Africa"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3452-9581","authenticated-orcid":false,"given":"Bhekisipho","family":"Twala","sequence":"additional","affiliation":[{"name":"Faculty of Engineering and the Built Environment, Durban University of Technology, Durban 4000, South Africa"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Clinton","family":"Aigbavboa","sequence":"additional","affiliation":[{"name":"Sustainable Human Settlement and Construction Research Centre, Faculty of Engineering and the Built Environment, University of Johannesburg, Auckland Park, Johannesburg 2006, South Africa"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,7]]},"reference":[{"key":"ref_1","unstructured":"(2018, February 12). Waterborne Diseases Factsheet. Available online: http:\/\/www.waterwise.co.za\/site\/water\/diseases\/waterborne.html."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Yang, Z., Liu, Y., Hou, D., Feng, T., Wei, Y., Zhang, J., Huang, P., and Zhang, G. (2014, January 5\u20138). Water quality event detection based on Multivariate empirical mode decomposition. Proceedings of the 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC), San Diego, CA, USA.","DOI":"10.1109\/SMC.2014.6974329"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Pub Singapore (2016). Managing the water distribution network with a smart water grid. Smart Water, 1, 1\u201313.","DOI":"10.1186\/s40713-016-0004-4"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1080\/1573062X.2019.1637002","article-title":"Survey of machine learning methods applied to anomaly detection on drinking-water quality data","volume":"16","author":"Dogo","year":"2019","journal-title":"Urban. Water J."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1016\/j.eswa.2016.12.035","article-title":"Learning from class-imbalanced data: Review of methods and applications","volume":"73","author":"Haixiang","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/j.inffus.2017.09.010","article-title":"Dynamic classifier selection: Recent advances and perspectives","volume":"41","author":"Cruz","year":"2018","journal-title":"Inf. Fusion"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3668","DOI":"10.1016\/j.eswa.2011.09.059","article-title":"Dynamic classifier ensemble model for customer classification with imbalanced class distribution","volume":"39","author":"Xiao","year":"2012","journal-title":"Expert Syst. Appl."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Cruz, R.M., Zakane, H.H., Sabourin, R., and Cavalcanti, G.D. (December, January 28). Dynamic Ensemble Selection VS K-NN: Why and when Dynamic selection obtains higher classification performance?. Proceedings of the 2017 Seventh International Conference on Image Processing Theory, Tools and Applications (IPTA), Montreal, QC, Canada.","DOI":"10.1109\/IPTA.2017.8310100"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3665","DOI":"10.1016\/j.patcog.2014.05.003","article-title":"Dynamic selection of classifiers\u2014A comprehensive review","volume":"47","author":"Sabourin","year":"2014","journal-title":"Pattern Recognit."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1925","DOI":"10.1016\/j.patcog.2014.12.003","article-title":"META-DES: A dynamic ensemble selection framework using meta-learning","volume":"48","author":"Cruz","year":"2015","journal-title":"Pattern Recognit."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1016\/j.neucom.2018.01.060","article-title":"A study on combining dynamic selection and data preprocessing for imbalance learning","volume":"286","author":"Roy","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"408","DOI":"10.1109\/TSMC.1972.4309137","article-title":"Asymptotic properties of nearest neighbor rules using edited data","volume":"3","author":"Wilson","year":"1972","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1109\/TPAMI.2011.142","article-title":"Prototype selection for nearest neighbor classification: Taxonomy and empirical study","volume":"34","author":"Garcia","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"218015","DOI":"10.1109\/ACCESS.2020.3038658","article-title":"Empirical Comparison of Approaches for Mitigating Effects of Class Imbalances in Water Quality Anomaly Detection","volume":"8","author":"Dogo","year":"2020","journal-title":"IEEE Access"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1007\/s00521-009-0295-6","article-title":"Pattern classification with missing data: A review","volume":"19","year":"2010","journal-title":"Neural Comput. Appl."},{"key":"ref_16","first-page":"559","article-title":"Imbalanced-learn: A python toolbox to tackle the curse of imbalanced datasets in machine learning","volume":"18","author":"Nogueira","year":"2017","journal-title":"J. Mach. Learn. Res."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1007\/s13748-016-0094-0","article-title":"Learning from imbalanced data: Open challenges and future directions","volume":"5","author":"Krawczyk","year":"2016","journal-title":"Prog. Artif. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1613\/jair.953","article-title":"SMOTE: Synthetic minority over-sampling technique","volume":"16","author":"Chawla","year":"2002","journal-title":"J. Artif. Intell. Res."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1145\/1007730.1007735","article-title":"A study of the behavior of several methods for balancing machine learning training data","volume":"6","author":"Batista","year":"2004","journal-title":"ACM SIGKDD Explor. Newsl."},{"key":"ref_20","first-page":"1","article-title":"Deslib: A dynamic ensemble selection library in python","volume":"21","author":"Cruz","year":"2020","journal-title":"J. Mach. Learn. Res."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1718","DOI":"10.1016\/j.patcog.2007.10.015","article-title":"From dynamic classifier selection to dynamic ensemble selection","volume":"41","author":"Ko","year":"2008","journal-title":"Pattern Recognit."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"500","DOI":"10.1109\/TKDE.2007.1016","article-title":"Classifier ensembles with a random linear oracle","volume":"19","author":"Kuncheva","year":"2007","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"142368","DOI":"10.1016\/j.scitotenv.2020.142368","article-title":"A novel dynamic multi-criteria ensemble selection mechanism applied to drinking-water quality anomaly detection","volume":"749","author":"Moritz","year":"2020","journal-title":"Sci. Total. Environ."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1940009","DOI":"10.1142\/S0218001419400093","article-title":"On Dynamic ensemble selection and data preprocessing for multi-class imbalance learning","volume":"33","author":"Cruz","year":"2019","journal-title":"Int. J. Pattern Recognit. Artif. Intell."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1109\/34.588027","article-title":"Combination of multiple classifiers using local accuracy estimates","volume":"19","author":"Woods","year":"1997","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1109\/34.990132","article-title":"Complexity measures of supervised classification problems","volume":"24","author":"Ho","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Kong, J., Kowalczyk, W., Nguyen, D.A., B\u00e4ck, T., and Menzel, S. (2019, January 6\u20139). Hyperparameter optimisation for improving classification under class imbalance. Proceedings of the 2019 IEEE Symposium Series on Computational Intelligence (SSCI), Xiamen, China.","DOI":"10.1109\/SSCI44817.2019.9002679"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3347711","article-title":"How Complex is your classification problem? A survey on measuring classification complexity","volume":"52","author":"Lorena","year":"2019","journal-title":"ACM Comput. Surv."},{"key":"ref_29","unstructured":"Kohavi, R. (2021, March 31). A study of cross-validation and bootstrap for accuracy estimation and model selection. Available online: https:\/\/www.ijcai.org\/Proceedings\/95-2\/Papers\/016.pdf."},{"key":"ref_30","unstructured":"SPOTSeven Lab (2019, February 26). GECCO Challenge 2017\u2014Monitoring of Drinking-Water Quality. Available online: http:\/\/www.spotseven.de\/gecco\/gecco-challenge\/gecco-challenge-2017\/."},{"key":"ref_31","unstructured":"Yin, H., Camacho, D., Novais, P., and Tall\u00f3n-Ballesteros, A. (2018). Applying tree ensemble to detect anomalies in real-world water composition dataset. Proceedings of the Intelligent Data Engineering and Automated Learning-IDEAL 2018, Springer. Lecture Notes in Computer Science."},{"key":"ref_32","first-page":"294","article-title":"Machine learning approaches for anomaly detection of water quality on a real-world data set","volume":"3","author":"Muharemi","year":"2019","journal-title":"J. Inf. Telecommun."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ribeiro, V.H.A., and Reynoso-Meza, G. (2018, January 1\u20132). Online anomaly detection for drinking water quality using a multi-objective machine learning approach. Proceedings of the Genetic and Evolutionary Computation Conference Companion (GECCO \u201918), New York, NY, USA.","DOI":"10.1145\/3205651.3208202"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Ribeiro, V.H.A., and Reynoso-Meza, G. (2019, January 1\u20132). Monitoring of drinking-water quality by means of a multi-objective ensemble learning approach. Proceedings of the Genetic and Evolutionary Computation Conference Companion (GECCO \u201919), New York, NY, USA.","DOI":"10.1145\/3319619.3326745"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1016\/j.future.2020.02.022","article-title":"Smart data-driven quality prediction for urban water source management","volume":"107","author":"Wu","year":"2020","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1109\/TSMCC.2011.2161285","article-title":"A review on ensembles for the class imbalance problem: Bagging-, boosting- and hybrid-based approaches","volume":"42","author":"Galar","year":"2012","journal-title":"IEEE Trans. Syst. Man Cybern. Part C"},{"key":"ref_37","first-page":"1","article-title":"Statistical comparisons of classifiers over multiple data sets","volume":"7","year":"2006","journal-title":"J. Mach. Learn. Res."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1080\/00031305.2016.1154108","article-title":"The ASA statement on p-values: Context, process and purpose","volume":"70","author":"Wasserstein","year":"2016","journal-title":"Am. Stat."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1038\/506150a","article-title":"Scientific method: Statistical errors","volume":"506","author":"Nuzzo","year":"2014","journal-title":"Nature"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1038\/d41586-019-00857-9","article-title":"Comment: Retire statistical significance","volume":"567","author":"Amrhein","year":"2019","journal-title":"Nature"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/13\/5\/818\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:57:56Z","timestamp":1760162276000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/13\/5\/818"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,7]]},"references-count":40,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2021,5]]}},"alternative-id":["sym13050818"],"URL":"https:\/\/doi.org\/10.3390\/sym13050818","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,7]]}}}