{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,21]],"date-time":"2026-07-21T15:08:47Z","timestamp":1784646527680,"version":"3.55.0"},"reference-count":49,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2024,5,27]],"date-time":"2024-05-27T00:00:00Z","timestamp":1716768000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"VC Research","award":["VCR 0000183"],"award-info":[{"award-number":["VCR 0000183"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Customer churn is a significant concern, and the telecommunications industry has the largest annual churn rate of any major industry at over 30%. This study examines the use of ensemble learning models to analyze and forecast customer churn in the telecommunications business. Accurate churn forecasting is essential for successful client retention initiatives to combat regular customer churn. We used innovative and improved machine learning methods, including Decision Trees, Boosted Trees, and Random Forests, to enhance model interpretability and prediction accuracy. The models were trained and evaluated systematically by using a large dataset. The Random Forest model performed best, with 91.66% predictive accuracy, 82.2% precision, and 81.8% recall. Our results highlight how well the model can identify possible churners with the help of explainable AI (XAI) techniques, allowing for focused and timely intervention strategies. To improve the transparency of the decisions made by the classifier, this study also employs explainable artificial intelligence methods such as LIME and SHAP to illustrate the results of the customer churn prediction model. Our results demonstrate how crucial it is for customer relationship managers to implement strong analytical tools to reduce attrition and promote long-term economic viability in fiercely competitive marketplaces. This study indicates that ensemble learning models have strategic implications for improving consumer loyalty and organizational profitability in addition to confirming their performance.<\/jats:p>","DOI":"10.3390\/a17060231","type":"journal-article","created":{"date-parts":[[2024,5,27]],"date-time":"2024-05-27T08:36:22Z","timestamp":1716798982000},"page":"231","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":74,"title":["Prediction of Customer Churn Behavior in the Telecommunication Industry Using Machine Learning Models"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8012-5852","authenticated-orcid":false,"given":"Victor","family":"Chang","sequence":"first","affiliation":[{"name":"Department of Operations and Information Management, Aston Business School, Aston University, Birmingham B4 7ET, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2863-3312","authenticated-orcid":false,"given":"Karl","family":"Hall","sequence":"additional","affiliation":[{"name":"School of Computing, Engineering and Digital Technologies, Teesside University, Middlesbrough TS1 3BX, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qianwen","family":"Xu","sequence":"additional","affiliation":[{"name":"Department of Operations and Information Management, Aston Business School, Aston University, Birmingham B4 7ET, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Folakemi","family":"Amao","sequence":"additional","affiliation":[{"name":"School of Computing, Engineering and Digital Technologies, Teesside University, Middlesbrough TS1 3BX, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Meghana","family":"Ganatra","sequence":"additional","affiliation":[{"name":"Department of Operations and Information Management, Aston Business School, Aston University, Birmingham B4 7ET, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vladlena","family":"Benson","sequence":"additional","affiliation":[{"name":"Department of Operations and Information Management, Aston Business School, Aston University, Birmingham B4 7ET, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,5,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1684","DOI":"10.1080\/14783363.2018.1504621","article-title":"Linking customer satisfaction with financial performance: An empirical study of Scandinavian banks","volume":"31","author":"Eklof","year":"2020","journal-title":"Total Qual. Manag. Bus. Excell."},{"key":"ref_2","first-page":"46","article-title":"Enhancing Customer Value Creation with Market Culture: Developing 7Cs Framework","volume":"17","author":"Madhani","year":"2018","journal-title":"IUP J. Manag. Res."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.4018\/IJCINI.2020010101","article-title":"Deep convolutional neural networks for customer churn prediction analysis","volume":"14","author":"Chouiekh","year":"2020","journal-title":"Int. J. Cogn. Inform. Nat. Intell."},{"key":"ref_4","unstructured":"Duval, A. (2019). Explainable Artificial Intelligence (XAI), Mathematics Institute, The University of Warwick. MA4K9 Scholarly Report."},{"key":"ref_5","unstructured":"Reilly, J. (2024, April 13). The Machine Learning Revolution: Telco Customer Churn Prediction. Available online: https:\/\/www.akkio.com\/post\/telecom-customer-churn."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"012090","DOI":"10.1088\/1757-899X\/879\/1\/012090","article-title":"Sequential feature selection in customer churn prediction based on Naive Bayes","volume":"879","author":"Yulianti","year":"2020","journal-title":"IOP Conf. Ser. Mater. Sci. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Leung, C.K., Pazdor, A.G., and Souza, J. (2021, January 6\u20139). Explainable artificial intelligence for data science on customer churn. Proceedings of the 2021 IEEE 8th International Conference on Data Science and Advanced Analytics (DSAA), Porto, Portugal.","DOI":"10.1109\/DSAA53316.2021.9564166"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Mishra, A., and Reddy, U.S. (2017, January 23\u201324). A comparative study of customer churn prediction in telecom industry using ensemble based classifiers. Proceedings of the 2017 International Conference on Inventive Computing and Informatics (ICICI), Coimbatore, India.","DOI":"10.1109\/ICICI.2017.8365230"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"760","DOI":"10.1016\/j.ejor.2018.02.009","article-title":"A new hybrid classification algorithm for customer churn prediction based on logistic regression and decision trees","volume":"269","author":"Coussement","year":"2018","journal-title":"Eur. J. Oper. Res."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1007\/s00607-021-00908-y","article-title":"Customer churn prediction system: A machine learning approach","volume":"104","author":"Lalwani","year":"2022","journal-title":"Computing"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"707","DOI":"10.1007\/s00521-016-2477-3","article-title":"Particle classification optimization-based BP network for telecommunication customer churn prediction","volume":"29","author":"Yu","year":"2018","journal-title":"Neural Comput. Appl."},{"key":"ref_12","first-page":"24","article-title":"Customer churn prediction in telecommunication industry using deep learning","volume":"11","author":"Fujo","year":"2022","journal-title":"Inf. Sci. Lett."},{"key":"ref_13","first-page":"221","article-title":"Analyzing the role of e-crm in managing customer relations: A critical review of the literature","volume":"7","author":"Kampani","year":"2020","journal-title":"J. Crit. Rev."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2127","DOI":"10.1108\/JBIM-07-2019-0328","article-title":"The role of analytical CRM on salesperson use of competitive intelligence","volume":"35","author":"Nelson","year":"2020","journal-title":"J. Bus. Ind. Mark."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"121","DOI":"10.52131\/pjhss.2019.0701.0076","article-title":"The core components and types of CRM","volume":"7","author":"Asharai","year":"2019","journal-title":"Pak. J. Human. Soc. Sci."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"113553","DOI":"10.1016\/j.eswa.2020.113553","article-title":"Evaluation of customer behavior with temporal centrality metrics for churn prediction of prepaid contracts","volume":"160","author":"Baesens","year":"2020","journal-title":"Expert Syst. Appl."},{"key":"ref_17","first-page":"116","article-title":"Transformation from relationship marketing to electronic customer relationship management: A literature study","volume":"7","author":"Hendriyani","year":"2018","journal-title":"Rev. Integr. Bus. Econ. Res."},{"key":"ref_18","unstructured":"Chagas, B.N.R., Viana, J.A.N., Reinhold, O., Lobato, F., Jacob, A.F., and Alt, R. (2018, January 3\u20136). Current applications of machine learning techniques in CRM: A literature review and practical implications. Proceedings of the 2018 IEEE\/WIC\/ACM International Conference on Web Intelligence (WI), Santiago, Chile."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"121265","DOI":"10.1016\/j.techfore.2021.121265","article-title":"Can customer sentiment impact firm value? An integrated text mining approach","volume":"174","author":"Eachempati","year":"2022","journal-title":"Technol. Forecast. Soc. Chang."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"121275","DOI":"10.1016\/j.techfore.2021.121275","article-title":"A social CRM analytic framework for improving customer retention, acquisition, and conversion","volume":"174","author":"Lamrhari","year":"2022","journal-title":"Technol. Forecast. Soc. Chang."},{"key":"ref_21","first-page":"257","article-title":"The effect of trust, commitment, and conflict handling on customer retention: The mediating role of customer satisfaction","volume":"17","author":"Mahmoud","year":"2018","journal-title":"J. Relat. Mark."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1563","DOI":"10.1016\/j.ijforecast.2019.03.029","article-title":"Incorporating textual information in customer churn prediction models based on a convolutional neural network","volume":"36","author":"Coussement","year":"2020","journal-title":"Int. J. Forecast."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.indmarman.2021.10.001","article-title":"Uplift modeling and its implications for B2B customer churn prediction: A segmentation-based modeling approach","volume":"99","author":"Coussement","year":"2021","journal-title":"Ind. Mark. Manag."},{"key":"ref_24","unstructured":"Seymen, O.F., Dogan, O., and Hiziroglu, A. (2021). Proceedings of the 12th International Conference on Soft Computing and Pattern Recognition (SoCPaR 2020). SoCPaR 2020, Springer."},{"key":"ref_25","first-page":"857865","article-title":"Crop yield forecasting using artificial neural networks: A comparison between spatial and temporal models","volume":"2014","author":"Guo","year":"2014","journal-title":"Math. Probl. Eng."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Shahi, T.B., Shrestha, A., Neupane, A., and Guo, W. (2020). Stock price forecasting with deep learning: A comparative study. Mathematics, 8.","DOI":"10.3390\/math8091441"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"118309","DOI":"10.1016\/j.eswa.2022.118309","article-title":"Understanding customer satisfaction via deep learning and natural language processing","volume":"209","author":"Aldunate","year":"2022","journal-title":"Expert Syst. Appl."},{"key":"ref_28","unstructured":"Raza, K. (2019). U-Healthcare Monitoring Systems, Academic Press."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"8885861","DOI":"10.1155\/2020\/8885861","article-title":"Fake news detection using machine learning ensemble methods","volume":"2020","author":"Ahmad","year":"2020","journal-title":"Complexity"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1007\/978-3-030-33820-6_8","article-title":"Performance evaluation of different machine learning methods and deep-learning based convolutional neural network for health decision making","volume":"871","author":"Sahoo","year":"2020","journal-title":"Nat. Inspired Comput. Data Sci."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/S0957-4174(02)00030-1","article-title":"Turning telecommunications call details to churn prediction: A data mining approach","volume":"23","author":"Wei","year":"2002","journal-title":"Expert Syst. Appl."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"117","DOI":"10.5296\/bms.v11i2.17934","article-title":"Evaluating the Impact of Customer Relationship Management (CRM) Strategies on Customer Retention","volume":"11","author":"Anees","year":"2020","journal-title":"Bus. Manag. Strateg."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1177\/0008125619862257","article-title":"Organizational decision-making structures in the age of artificial intelligence","volume":"61","author":"Shrestha","year":"2019","journal-title":"Calif. Manag. Rev."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1093\/oxrep\/grab016","article-title":"The impact of machine learning on UK financial services","volume":"37","author":"Buchanan","year":"2021","journal-title":"Oxf. Rev. Econ. Pol."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"120339","DOI":"10.1016\/j.techfore.2020.120339","article-title":"The digital transformation of business. Towards the datafication of the relationship with customers","volume":"162","year":"2021","journal-title":"Technol. Forecast. Soc. Chang."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1582","DOI":"10.1287\/isre.2023.1199","article-title":"Expl(AI)ned: The impact of explainable artificial intelligence on users\u2019 information processing","volume":"34","author":"Bauer","year":"2023","journal-title":"Inf. Syst. Res."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"e12820","DOI":"10.1111\/exsy.12820","article-title":"Data-driven decision-making model based on artificial intelligence in higher education system of colleges and universities","volume":"40","author":"Teng","year":"2023","journal-title":"Expert Syst."},{"key":"ref_38","first-page":"847","article-title":"The Normative Potential of the European Rule on Automated Decisions: A New Reading for Art. 22 GDPR","volume":"81","author":"Djeffal","year":"2020","journal-title":"Z. Ausl\u00e4ndisches \u00d6ffentl. Recht V\u00f6lkerr."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Nkolele, R., and Wang, H. (2021, January 27\u201328). Explainable Machine Learning: A Manuscript on the Customer Churn in the Telecommunications Industry. Proceedings of the 2021 Ethics and Explainability for Responsible Data Science (EE-RDS), Johannesburg, South Africa.","DOI":"10.1109\/EE-RDS53766.2021.9708561"},{"key":"ref_40","first-page":"307","article-title":"A value for n-person games","volume":"Volum 2","author":"Shapley","year":"1953","journal-title":"Contributions to the Theory of Games"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1007\/s10115-013-0679-x","article-title":"Explaining prediction models and individual predictions with feature contributions","volume":"41","author":"Kononenko","year":"2014","journal-title":"Knowl. Inf. Syst."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"752558","DOI":"10.3389\/frai.2021.752558","article-title":"SHAP and LIME: An evaluation of discriminative power in credit risk","volume":"4","author":"Gramegna","year":"2021","journal-title":"Front. Artif. Intell."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1016\/j.ijinfomgt.2014.02.002","article-title":"Data quality management, data usage experience and acquisition intention of big data analytics","volume":"34","author":"Kwon","year":"2014","journal-title":"Int. J. Inf. Manag."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1089\/big.2013.1508","article-title":"Data science and its relationship to big data and data-driven decision making","volume":"1","author":"Provost","year":"2013","journal-title":"Big Data"},{"key":"ref_45","first-page":"3048","article-title":"CRISP-DM twenty years later: From data mining processes to data science trajectories","volume":"33","author":"Ferri","year":"2019","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_46","unstructured":"Hakkoum, H., Idri, A., and Abnane, I. (2020). Trends and Innovations in Information Systems and Technologies, Springer."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.artint.2013.10.003","article-title":"Algorithm runtime prediction: Methods & evaluation","volume":"206","author":"Hutter","year":"2014","journal-title":"Artif. Intell."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"115736","DOI":"10.1016\/j.eswa.2021.115736","article-title":"Explaining anomalies detected by autoencoders using Shapley Additive Explanations","volume":"186","author":"Antwarg","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1016\/j.ejor.2015.05.030","article-title":"Benchmarking state-of-the-art classification algorithms for credit scoring: An update of research","volume":"247","author":"Lessmann","year":"2015","journal-title":"Eur. J. Oper. Res."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/17\/6\/231\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:49:26Z","timestamp":1760107766000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/17\/6\/231"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,27]]},"references-count":49,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["a17060231"],"URL":"https:\/\/doi.org\/10.3390\/a17060231","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,27]]}}}