{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T16:14:19Z","timestamp":1774628059510,"version":"3.50.1"},"reference-count":41,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2025,6,25]],"date-time":"2025-06-25T00:00:00Z","timestamp":1750809600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Churn prediction has become one of the core concepts in customer relationship management within the insurances, telecom, and internet service provider industries, which is essential in customer retention. Therefore, this study attempts to analyze the effectiveness of the advanced machine learning and deep learning models for churn prediction in the evaluation of the models\u2019 performance across different sectors. This would help conclude whether the varied patterns of the churn throughout different sectors to the level that affects the model performance and to what extent. The work includes three datasets: namely, insurance churn, internet service provider customer churn, and Telecom churn datasets. The implementation and comparison conducted in this study of models include XGBoost, Convolutional Neural Networks (CNNs), and Ensemble Deep Learning with the pre-trained hybrid approach. The results show that the ensemble deep learning model outperforms other models in terms of accuracy and F1-score, achieving accuracies of up to 95.96% in the insurance churn dataset and of 98.42% in the telecom churn dataset. Moreover, traditional machine learning models like XGBoost also produced competitive results for selected datasets. The proposed deep learning ensembles reveal the strength and possibility for churn prediction and provide a benchmark for future research relevant to customer retention strategies. Also, the proposed ensemble deep learning model shows stable performance across different sectors, which reflects its ability to capture the varied churn patterns of different sectors.<\/jats:p>","DOI":"10.3390\/info16070537","type":"journal-article","created":{"date-parts":[[2025,6,26]],"date-time":"2025-06-26T05:53:13Z","timestamp":1750917193000},"page":"537","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["A Comprehensive Evaluation of Machine Learning and Deep Learning Models for Churn Prediction"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6181-097X","authenticated-orcid":false,"given":"Nabil M.","family":"AbdelAziz","sequence":"first","affiliation":[{"name":"Information Systems Department, Faculty of Computers and Informatics, Zagazig University, Zagazig 44519, Egypt"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6937-0892","authenticated-orcid":false,"given":"Mostafa","family":"Bekheet","sequence":"additional","affiliation":[{"name":"Information Systems Department, Faculty of Computers and Informatics, Zagazig University, Zagazig 44519, Egypt"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3433-7640","authenticated-orcid":false,"given":"Ahmad","family":"Salah","sequence":"additional","affiliation":[{"name":"College of Computing and Information Sciences, University of Technology and Applied Sciences, Ibri P.O. Box 466, Oman"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3988-1437","authenticated-orcid":false,"given":"Nissreen","family":"El-Saber","sequence":"additional","affiliation":[{"name":"Information Systems Department, Faculty of Computers and Informatics, Zagazig University, Zagazig 44519, Egypt"},{"name":"Software Engineering Department, Faculty of Information and Computers, Misr International University, Cairo 11785, Egypt"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-9234-1117","authenticated-orcid":false,"given":"Wafaa T.","family":"AbdelMoneim","sequence":"additional","affiliation":[{"name":"Information Systems Department, Faculty of Computers and Informatics, Zagazig University, Zagazig 44519, Egypt"}]}],"member":"1968","published-online":{"date-parts":[[2025,6,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1509\/jmkr.43.2.204","article-title":"Defection Detection: Measuring and Understanding the Predictive Accuracy of Customer Churn Models","volume":"43","author":"Neslin","year":"2006","journal-title":"J. Mark. Res."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Suh, Y. (2023). Machine learning based customer churn prediction in home appliance rental business. J. Big Data, 10.","DOI":"10.1186\/s40537-023-00721-8"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Raj, A., and Vetrithangam, D. (2023, January 28\u201330). Machine Learning and Deep Learning technique used in Customer Churn Prediction\u2014A Review. Proceedings of the 2023 International Conference on Computational Intelligence and Sustainable Engineering Solutions (CISES), Greater Noida, India.","DOI":"10.1109\/CISES58720.2023.10183530"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Chang, V., Hall, K., Xu, Q.A., Amao, F.O., Ganatra, M.A., and Benson, V. (2024). Prediction of Customer Churn Behavior in the Telecommunication Industry Using Machine Learning Models. Algorithms, 17.","DOI":"10.3390\/a17060231"},{"key":"ref_5","first-page":"15902","article-title":"Enhancing telecom customer retention using hybrid deep learning models","volume":"11","author":"Tan","year":"2023","journal-title":"IEEE Access"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Liu, X., Xia, G., Zhang, X., and Yu, C. (2024). Customer churn prediction model based on hybrid neural networks. Sci. Rep., 14.","DOI":"10.1038\/s41598-024-79603-9"},{"key":"ref_7","unstructured":"Pan, L., and Wang, X. (2023). Transformer-based churn prediction model with feature attention mechanism. Knowl. Based Syst., 282."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Khattak, A., Mehak, Z., Ahmad, H., Asghar, M.U., Asghar, M.Z., and Khan, A. (2023). Customer churn prediction using composite deep learning technique. Sci. Rep., 13.","DOI":"10.1038\/s41598-023-44396-w"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"22","DOI":"10.53623\/gisa.v3i1.249","article-title":"Machine Learning Predictive Models Analysis on Telecommunications Service Churn Rate","volume":"3","author":"Akbar","year":"2023","journal-title":"Green Intell. Syst. Appl."},{"key":"ref_10","first-page":"16","article-title":"Comparative Analysis of Deep Learning Architectures for Customer Churn Prediction in Banking","volume":"3","author":"Basit","year":"2024","journal-title":"J. Comput. Intell. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"69130","DOI":"10.1109\/ACCESS.2024.3401247","article-title":"A Big Data-Driven Hybrid Model for Enhancing Streaming Service Customer Retention Through Churn Prediction Integrated with Explainable AI","volume":"12","author":"Joy","year":"2024","journal-title":"IEEE Access"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Shobana, J., Gangadhar, C., Arora, R.K., Renjith, P.N., Bamini, J., and Chincholkar, Y.D. (2023). E-commerce customer churn prevention using machine learning-based business intelligence strategy. Meas. Sens., 27.","DOI":"10.1016\/j.measen.2023.100728"},{"key":"ref_13","first-page":"102","article-title":"Predicting Customer Churn in Travel and Tour Industry Using Machine Learning Algorithm Approaches","volume":"1","author":"Pono","year":"2023","journal-title":"Bus. Organ. Stud. E J."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ramanayake, C., Liyanage, D., Dhananjaya, P., Kumara, C., and Fernando, T.G.I. (2024, January 12\u201313). Telco Customer Churn Prediction Using Composite Deep Learning Technique. Proceedings of the 2024 6th International Conference on Advancements in Computing (ICAC), Colombo, Sri Lanka.","DOI":"10.1109\/ICAC64487.2024.10851050"},{"key":"ref_15","first-page":"2461","article-title":"Attention-based transformer models for customer churn prediction","volume":"34","author":"Wang","year":"2023","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Ljubi\u010di\u0107, K., Mer\u0107ep, A., and Kostanj\u010dar, Z. (2023). Churn prediction methods based on mutual customer interdependence. J. Comput. Sci., 67.","DOI":"10.1016\/j.jocs.2022.101940"},{"key":"ref_17","first-page":"388","article-title":"Comparative Analysis of Machine Learning Models for Customer Churn Prediction in the U.S. Banking and Financial Services: Economic Impact and Industry-Specific Insights","volume":"12","author":"Owolabi","year":"2024","journal-title":"J. Data Anal. Inf. Process."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"994","DOI":"10.1016\/j.asoc.2014.08.041","article-title":"Improved Churn Prediction in Telecommunication Industry Using Data Mining Techniques","volume":"24","author":"Keramati","year":"2014","journal-title":"Appl. Soft Comput."},{"key":"ref_19","first-page":"241","article-title":"Attribute Selection and Customer Churn Prediction in Telecom Industry","volume":"85","author":"Umayaparvathi","year":"2016","journal-title":"Procedia Comput. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/j.procs.2020.03.187","article-title":"Churn Prediction in Telecommunication Using Logistic Regression and Logit Boost","volume":"167","author":"Jain","year":"2020","journal-title":"Procedia Comput. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1999","DOI":"10.1016\/j.eswa.2010.07.134","article-title":"Employee Churn Prediction","volume":"38","author":"Saradhi","year":"2011","journal-title":"Expert Syst. Appl."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Hu, Y.C., Tiwari, S., Mishra, K., and Trivedi, M. (2019). Prediction of Employee Turnover Using Ensemble Learning. Ambient Communications and Computer Systems, Springer. Advances in Intelligent Systems and Computing.","DOI":"10.1007\/978-981-13-5934-7"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Shafie, M.R., Khosravi, H., Farhadpour, S., Das, S., and Ahmed, I. (2024). A cluster-based human resources analytics for predicting employee turnover using optimized Artificial Neural Networks and data augmentation. Decis. Anal. J., 11.","DOI":"10.1016\/j.dajour.2024.100461"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2188","DOI":"10.3390\/jtaer18040110","article-title":"A Brief Survey of Machine Learning and Deep Learning Techniques for E-Commerce Research","volume":"18","author":"Zhang","year":"2023","journal-title":"J. Theor. Appl. Electron. Commer. Res."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Anudeep, C., Venugopal, R., Aarif, M., Thiruma Valavan, A., Vuyyuru, V.A., and Muthuperumal, S. (2024, January 24\u201328). Predicting Customer Churn in E-commerce Subscription Services using RNN with Attention Mechanisms. Proceedings of the 15th International Conference on Computing Communication and Networking Technologies (ICCCNT), Kamand, India.","DOI":"10.1109\/ICCCNT61001.2024.10725520"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"165","DOI":"10.3390\/jtaer17010009","article-title":"Customer Churn in Retail E-Commerce Business: Spatial and Machine Learning Approach","volume":"17","author":"Kopczewska","year":"2022","journal-title":"J. Theor. Appl. Electron. Commer. Res."},{"key":"ref_27","first-page":"273","article-title":"Machine-Learning Techniques for Customer Retention: A Comparative Study","volume":"9","author":"Sabbeh","year":"2018","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_28","first-page":"1","article-title":"A Hybrid Swarm Intelligence Neural Network Model for Customer Churn Prediction","volume":"9","author":"Faris","year":"2018","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.simpat.2015.03.003","article-title":"A comparison of machine learning techniques for customer churn prediction","volume":"55","author":"Vafeiadis","year":"2015","journal-title":"Simul. Model. Pract. Theory"},{"key":"ref_30","unstructured":"(2025, May 01). Insurance Churn Data. Available online: https:\/\/www.kaggle.com\/datasets\/mukulsingh\/insurance-churn-prediction."},{"key":"ref_31","unstructured":"(2025, May 01). Internet Service Data. Available online: https:\/\/www.kaggle.com\/datasets\/mehmetsabrikunt\/internet-service-churn."},{"key":"ref_32","unstructured":"(2025, May 01). Telecom Data. Available online: https:\/\/www.kaggle.com\/datasets\/mnassrib\/telecom-churn-datasets."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2131","DOI":"10.1109\/TCBB.2019.2911071","article-title":"XGBoost Model for Chronic Kidney Disease Diagnosis","volume":"17","author":"Ogunleye","year":"2020","journal-title":"IEEE\/ACM Trans. Comput. Biol. Bioinform."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1109\/MIS.2020.2972533","article-title":"XGBoost Model and Its Application to Personal Credit Evaluation","volume":"35","author":"Li","year":"2020","journal-title":"IEEE Intell. Syst."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1016\/j.isprsjprs.2020.12.010","article-title":"Review on Convolutional Neural Networks (CNN) in Vegetation Remote Sensing","volume":"173","author":"Kattenborn","year":"2021","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_36","first-page":"897","article-title":"Classification of Breast Cancer Histology Image Using Ensemble of Pre-trained Neural Networks","volume":"Volume 10882","author":"Campilho","year":"2018","journal-title":"Image Analysis and Recognition, Proceedings of the 15th International Conference, ICIAR 2018, P\u00f3voa de Varzim, Portugal, 27\u201329 June 2018"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Aggarwal, P., and Vijayakumar, V. (2024, January 3\u20134). Customer churn prediction in the telecom sector. Proceedings of the 2024 3rd International Conference on Artificial Intelligence For Internet of Things (AIIoT), Vellore, India.","DOI":"10.1109\/AIIoT58432.2024.10574660"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Nagaraju, J., Sathwik, A.S., Saiteja, B., Challa, N.P., and Naseeba, B. (2023, January 19\u201320). Predicting Customer Churn in Insurance Industry Using Big Data and Machine Learning. Proceedings of the 2023 First International Conference on Advances in Electrical, Electronics and Computational Intelligence (ICAEECI), Tiruchengode, India.","DOI":"10.1109\/ICAEECI58247.2023.10370876"},{"key":"ref_39","first-page":"297","article-title":"Predicting customer churn for insurance data","volume":"Volume 12393","author":"Song","year":"2020","journal-title":"Big Data Analytics and Knowledge Discovery, Proceedings of the 22nd International Conference, DaWaK 2020, Bratislava, Slovakia, 14\u201317 September 2020"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Do, D., Huynh, P., Vo, P., and Vu, T. (2017, January 11\u201314). Customer churn prediction in an internet service provider. Proceedings of the 2017 IEEE International Conference on Big Data (Big Data), Boston, MA, USA.","DOI":"10.1109\/BigData.2017.8258400"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Alteer, S.A., and Alariyibi, A. (2024, January 19\u201321). Customer churn prediction using machine learning: A case study of Libyan internet service provider company. Proceedings of the 2024 IEEE 4th International Maghreb Meeting of the Conference on Sciences and Techniques of Automatic Control and Computer Engineering (MI-STA), Tripoli, Libya.","DOI":"10.1109\/MI-STA61267.2024.10599671"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/7\/537\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:58:11Z","timestamp":1760032691000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/7\/537"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,25]]},"references-count":41,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2025,7]]}},"alternative-id":["info16070537"],"URL":"https:\/\/doi.org\/10.3390\/info16070537","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,25]]}}}