{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,10]],"date-time":"2026-08-10T12:53:14Z","timestamp":1786366394342,"version":"3.56.0"},"reference-count":53,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2023,1,16]],"date-time":"2023-01-16T00:00:00Z","timestamp":1673827200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Educational data mining is capable of producing useful data-driven applications (e.g., early warning systems in schools or the prediction of students\u2019 academic achievement) based on predictive models. However, the class imbalance problem in educational datasets could hamper the accuracy of predictive models as many of these models are designed on the assumption that the predicted class is balanced. Although previous studies proposed several methods to deal with the imbalanced class problem, most of them focused on the technical details of how to improve each technique, while only a few focused on the application aspect, especially for the application of data with different imbalance ratios. In this study, we compared several sampling techniques to handle the different ratios of the class imbalance problem (i.e., moderately or extremely imbalanced classifications) using the High School Longitudinal Study of 2009 dataset. For our comparison, we used random oversampling (ROS), random undersampling (RUS), and the combination of the synthetic minority oversampling technique for nominal and continuous (SMOTE-NC) and RUS as a hybrid resampling technique. We used the Random Forest as our classification algorithm to evaluate the results of each sampling technique. Our results show that random oversampling for moderately imbalanced data and hybrid resampling for extremely imbalanced data seem to work best. The implications for educational data mining applications and suggestions for future research are discussed.<\/jats:p>","DOI":"10.3390\/info14010054","type":"journal-article","created":{"date-parts":[[2023,1,16]],"date-time":"2023-01-16T06:52:10Z","timestamp":1673851930000},"page":"54","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":336,"title":["A Comparison of Undersampling, Oversampling, and SMOTE Methods for Dealing with Imbalanced Classification in Educational Data Mining"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9622-3780","authenticated-orcid":false,"given":"Tarid","family":"Wongvorachan","sequence":"first","affiliation":[{"name":"Measurement, Evaluation, and Data Science, University of Alberta, Edmonton, AB T6G 2G5, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9859-9749","authenticated-orcid":false,"given":"Surina","family":"He","sequence":"additional","affiliation":[{"name":"Measurement, Evaluation, and Data Science, University of Alberta, Edmonton, AB T6G 2G5, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5853-1267","authenticated-orcid":false,"given":"Okan","family":"Bulut","sequence":"additional","affiliation":[{"name":"Centre for Research in Applied Measurement and Evaluation, University of Alberta, Edmonton, AB T6G 2G5, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1900","DOI":"10.1080\/03075079.2018.1466872","article-title":"Early warning system as a predictor for student performance in higher education blended courses","volume":"44","author":"Jokhan","year":"2019","journal-title":"Stud. High. Educ."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Chen, G., Rolim, V., Mello, R.F., and Ga\u0161evi\u0107, D. (2020, January 23\u201327). Let\u2019s shine together! A comparative study between learning analytics and educational data mining. Proceedings of the tenth International Conference on Learning Analytics & Knowledge, Frankfurt, Germany.","DOI":"10.1145\/3375462.3375500"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Bulut, O., Gorgun, G., Yildirim-Erbasli, S.N., Wongvorachan, T., Daniels, L.M., Gao, Y., Lai, K.W., and Shin, J. Standing on the shoulders of giants: Online formative assessments as the foundation for predictive learning analytics models. Br. J. Educ. Technol., 2022.","DOI":"10.1111\/bjet.13276"},{"key":"ref_4","unstructured":"Ma, Y., and He, H. (2013). Imbalanced Learning: Foundations, Algorithms, and Applications, John Wiley & Sons."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1007\/978-981-10-6602-3_3","article-title":"Comparing the behavior of oversampling and undersampling approach of class imbalance learning by combining class imbalance problem with noise","volume":"Volume 653","author":"Saini","year":"2018","journal-title":"ICT Based Innovations"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Barros, T.M., SouzaNeto, P.A., Silva, I., and Guedes, L.A. (2019). Predictive models for imbalanced data: A school dropout perspective. Educ. Sci., 9.","DOI":"10.3390\/educsci9040275"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1016\/j.eswa.2016.12.035","article-title":"Learning from class-imbalanced data: Review of methods and applications","volume":"73","author":"Guo","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1007\/s10489-012-0374-8","article-title":"Predicting student failure at school using genetic programming and different data mining approaches with high dimensional and imbalanced data","volume":"38","author":"Cano","year":"2013","journal-title":"Appl. Intell."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"052041","DOI":"10.1088\/1742-6596\/1529\/5\/052041","article-title":"Improved students\u2019 performance prediction for multi-class imbalanced problems using hybrid and ensemble approach in educational data mining","volume":"1529","author":"Hassan","year":"2020","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Van Hulse, J., Khoshgoftaar, T.M., and Napolitano, A. (2009, January 10\u201312). An empirical comparison of repetitive undersampling techniques. Proceedings of the 2009 IEEE International Conference on Information Reuse & Integration, IEEE, Las Vegas, NA, USA.","DOI":"10.1109\/IRI.2009.5211614"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"105662","DOI":"10.1016\/j.asoc.2019.105662","article-title":"An empirical comparison and evaluation of minority oversampling techniques on a large number of imbalanced datasets","volume":"83","year":"2019","journal-title":"Appl. Soft Comput."},{"key":"ref_12","unstructured":"Guy-Evans, O. (2023, January 03). Bronfenbrenner\u2019s Ecological Systems Theory. Available online: https:\/\/www.simplypsychology.org\/Bronfenbrenner.html."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"52","DOI":"10.5539\/hes.v9n3p52","article-title":"Revisiting the Tinto\u2019s Theoretical Dropout Model","volume":"9","author":"Nicoletti","year":"2019","journal-title":"High. Educ. Stud."},{"key":"ref_14","unstructured":"Slim, A., Hush, D., Ojah, T., and Babbitt, T. (2018, January 16\u201320). Predicting Student Enrollment Based on Student and College Characteristics. Proceedings of the International Conference on Educational Data Mining (EDM), Raleigh, NC, USA."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"429","DOI":"10.3233\/IDA-2002-6504","article-title":"The class imbalance problem: A systematic study","volume":"6","author":"Japkowicz","year":"2002","journal-title":"Intell. Data Anal."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Guo, B., Zhang, R., Xu, G., Shi, C., and Yang, L. (2015, January 27\u201329). Predicting students performance in educational data mining. Proceedings of the 2015 international symposium on educational technology (ISET), Wuhan, China.","DOI":"10.1109\/ISET.2015.33"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40537-019-0192-5","article-title":"Survey on deep learning with class imbalance","volume":"6","author":"Johnson","year":"2019","journal-title":"J. Big Data"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Rashu, R.I., Haq, N., and Rahman, R.M. (2014, January 22\u201323). Data mining approaches to predict final grade by overcoming class imbalance problem. Proceedings of the 2014 17th International Conference on Computer and Information Technology (ICCIT), Dhaka, Bangladesh.","DOI":"10.1109\/ICCITechn.2014.7073095"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1080\/08839514.2021.1877481","article-title":"Classifier selection and ensemble model for multi-class imbalance learning in education grants prediction","volume":"35","author":"Sun","year":"2021","journal-title":"Appl. Artif. Intell."},{"key":"ref_20","first-page":"1","article-title":"Imbalanced-learn: A python toolbox to tackle the curse of imbalanced datasets in machine learning","volume":"18","author":"Lema","year":"2017","journal-title":"J. Mach. Learn. Res."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Patel, H., Singh Rajput, D., Thippa Reddy, G., Iwendi, C., Kashif Bashir, A., and Jo, O. (2020). A review on classification of imbalanced data for wireless sensor networks. Int. J. Distrib. Sens. Netw., 16.","DOI":"10.1177\/1550147720916404"},{"key":"ref_22","unstructured":"Cieslak, D.A., Chawla, N.V., and Striegel, A. (2006, January 10\u201312). Combating imbalance in network intrusion datasets. Proceedings of the GrC, Atlanta, GA, USA."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"352","DOI":"10.1016\/j.neucom.2019.06.100","article-title":"smote-variants: A Python Implementation of 85 Minority Oversampling Techniques","volume":"366","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"408","DOI":"10.1109\/TSMC.1972.4309137","article-title":"Asymptotic properties of nearest neighbor rules using edited data","volume":"SMC-2","author":"Wilson","year":"1972","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Gazzah, S., and Amara, N.E.B. (2008, January 16\u201319). New oversampling approaches based on polynomial fitting for imbalanced data sets. Proceedings of the 2008 the Eighth Iapr International Workshop on Document Analysis Systems, Nara, Japan.","DOI":"10.1109\/DAS.2008.74"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.ins.2017.05.008","article-title":"Clustering-based undersampling in class-imbalanced data","volume":"409\u2013410","author":"Lin","year":"2017","journal-title":"Inf. Sci."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Pristyanto, Y., Pratama, I., and Nugraha, A.F. (2018, January 6\u20137). Data level approach for imbalanced class handling on educational data mining multiclass classification. Proceedings of the 2018 International Conference on Information and Communications Technology (ICOIACT), Yogyakarta, Indonesia.","DOI":"10.1109\/ICOIACT.2018.8350792"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1007\/s10618-012-0295-5","article-title":"Training and assessing classification rules with imbalanced data","volume":"28","author":"Menardi","year":"2014","journal-title":"Data Min. Knowl. Discov."},{"key":"ref_29","unstructured":"Dattagupta, S.J. (2018). A Performance Comparison of Oversampling Methods for Data Generation in Imbalanced Learning Tasks. [Ph.D. Thesis, Universidade Nova de Lisboa]."},{"key":"ref_30","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1016\/j.knosys.2011.05.002","article-title":"Class imbalance methods for translation initiation site recognition in DNA sequences","volume":"25","author":"Fyfe","year":"2012","journal-title":"Knowl.-Based Syst."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1613\/jair.953","article-title":"SMOTE: Synthetic minority oversampling technique","volume":"16","author":"Chawla","year":"2002","journal-title":"J. Artif. Intell. Res."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"170668","DOI":"10.1109\/ACCESS.2019.2955086","article-title":"Grouped SMOTE with noise filtering mechanism for classifying imbalanced data","volume":"7","author":"Cheng","year":"2019","journal-title":"IEEE Access"},{"key":"ref_34","unstructured":"National Center for Educational Statistics [NCES] (2023, January 06). High School Longitudinal Study of 2009, Available online: https:\/\/nces.ed.gov\/surveys\/hsls09\/."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1686","DOI":"10.21105\/joss.01686","article-title":"Welcome to the tidyverse","volume":"4","author":"Wickham","year":"2019","journal-title":"J. Open Source Softw."},{"key":"ref_36","unstructured":"Wickham, H., and Bryan, J. (2023, January 06). Readxl: Read Excel Files, Available online: https:\/\/readxl.tidyverse.org."},{"key":"ref_37","unstructured":"Cui, B. (2023, January 06). DataExplorer. Available online: https:\/\/boxuancui.github.io\/DataExplorer\/."},{"key":"ref_38","first-page":"1","article-title":"mice: Multivariate Imputation by Chained Equations in R","volume":"45","year":"2011","journal-title":"J. Stat. Softw."},{"key":"ref_39","unstructured":"Harrell, F.E., and Dupont, C. (2023, January 06). Hmisc: Harrell Miscellaneous, Available online: https:\/\/cran.r-project.org\/web\/packages\/Hmisc\/index.html."},{"key":"ref_40","unstructured":"Wei, T., and Simko, V. (2023, January 06).  Package \u2018Corrplot\u2019: Visualization of a Correlation Matrix , Available online: https:\/\/cran.r-project.org\/web\/packages\/corrplot\/vignettes\/corrplot-intro.html."},{"key":"ref_41","unstructured":"Buuren, S.V. (2018). Flexible Imputation of Missing Data, Taylor and Francis Group. [2nd ed.]."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Shaik, A.B., and Srinivasan, S. (2019). A brief survey on random forest ensembles in classification model. International Conference on Innovative Computing and Communications, Springer.","DOI":"10.1007\/978-981-13-2354-6_27"},{"key":"ref_43","first-page":"1558","article-title":"Explaining the success of adaboost and random forests as interpolating classifiers","volume":"18","author":"Wyner","year":"2017","journal-title":"J. Mach. Learn. Res."},{"key":"ref_44","unstructured":"M\u00fcller, A.C., and Guido, S. (2016). Introduction to Machine Learning with Python: A Guide for Data Scientists, O\u2019Reilly Media, Inc."},{"key":"ref_45","unstructured":"Chau, V.T.N., and Phung, N.H. (2013, January 10\u201313). Imbalanced educational data classification: An effective approach with resampling and random forest. Proceedings of the The 2013 RIVF International Conference on Computing & Communication Technologies-Research, Innovation, and Vision for Future (RIVF), Hanoi, Vietnam."},{"key":"ref_46","first-page":"451","article-title":"Using educational data mining techniques to increase the prediction accuracy of student academic performance","volume":"120","author":"Ramaswami","year":"2019","journal-title":"Inf. Learn. Sci."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.ins.2018.06.056","article-title":"Improving imbalanced learning through a heuristic oversampling method based on k-means and SMOTE","volume":"465","author":"Douzas","year":"2018","journal-title":"Inf. Sci."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Mohammed, R., Rawashdeh, J., and Abdullah, M. (2020, January 7\u20139). Machine learning with oversampling and undersampling techniques: Overview study and experimental results. Proceedings of the 2020 11th International Conference on Information and Communication Systems (ICICS), Irbid, Jordan.","DOI":"10.1109\/ICICS49469.2020.239556"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1109\/MCI.2018.2866730","article-title":"Cross-validation for imbalanced datasets: Avoiding overoptimistic and overfitting approaches","volume":"13","author":"Santos","year":"2018","journal-title":"IEEE Comput. Intell. Mag."},{"key":"ref_50","first-page":"116","article-title":"Classification of non-performing financing using logistic regression and synthetic minority oversampling technique-nominal continuous (SMOTE-NC)","volume":"13","author":"Islahulhaq","year":"2021","journal-title":"Int. J. Adv. Soft Comput. Its Appl."},{"key":"ref_51","unstructured":"Kizilcec, R.F., and Lee, H. (2020). Algorithmic fairness in education. arXiv."},{"key":"ref_52","unstructured":"Organisation for Economic Co-operation and Development (OECD) (2018). PISA 2018 Results (Volume I): What Students Know and Can Do, OECD."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Chakravarthy, A.D., Bonthu, S., Chen, Z., and Zhu, Q. (2019, January 16\u201319). Predictive models with resampling: A comparative study of machine learning algorithms and their performances on handling imbalanced datasets. Proceedings of the 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA), Boca Raton, FL, USA.","DOI":"10.1109\/ICMLA.2019.00245"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/14\/1\/54\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:07:26Z","timestamp":1760119646000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/14\/1\/54"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,16]]},"references-count":53,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["info14010054"],"URL":"https:\/\/doi.org\/10.3390\/info14010054","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,16]]}}}