{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T14:12:27Z","timestamp":1777126347830,"version":"3.51.4"},"reference-count":23,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2024,10,13]],"date-time":"2024-10-13T00:00:00Z","timestamp":1728777600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>With the development of financial technology, the traditional experience-based and single-network credit default prediction model can no longer meet the current needs. This manuscript proposes a credit default prediction model based on TabNeT-Stacking. First, use the PyTorch deep learning framework to construct an improved TabNet structure. The multi-population genetic algorithm is used to optimize the Attention Transformer automatic feature selection module. The particle swarm algorithm is used to optimize the hyperparameter selection and achieve automatic parameter search. Finally, Stacking ensemble learning is used, and the improved TabNet is used to extract features. XGBoost (eXtreme Gradient Boosting), LightGBM (Light Gradient Boosting Machine), CatBoost (Category Boosting), KNN (K-NearestNeighbor), and SVM (Support Vector Machine) are selected as the first-layer base learners, and XGBoost is used as the second-layer meta-learner. The experimental results show that compared with original models, the credit default prediction model proposed in this manuscript outperforms the comparison models in terms of accuracy, precision, recall, F1 score, and AUC (Area Under the Curve) of credit default prediction results.<\/jats:p>","DOI":"10.3390\/e26100861","type":"journal-article","created":{"date-parts":[[2024,10,16]],"date-time":"2024-10-16T11:28:51Z","timestamp":1729078131000},"page":"861","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Research on Credit Default Prediction Model Based on TabNet-Stacking"],"prefix":"10.3390","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1716-838X","authenticated-orcid":false,"given":"Shijie","family":"Wang","sequence":"first","affiliation":[{"name":"School of Finance, Central University of Finance and Economics, Beijing 102206, China"},{"name":"RURAL CREDIT COOPERATIVE OF HEBEI, Shijiazhuang 050024, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xueyong","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Finance, Central University of Finance and Economics, Beijing 102206, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,10,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Hu, W., and Li, X. (2023). Financial technology development and green total factor productivity. Sustainability, 15.","DOI":"10.3390\/su151310309"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"938","DOI":"10.1016\/j.eap.2024.04.025","article-title":"Credit risk contagion in complex companies network\u2013Empirical research based on listed agricultural companies","volume":"82","author":"Zhang","year":"2024","journal-title":"Econ. Anal. Policy"},{"key":"ref_3","unstructured":"Beninel, F., Bouaguel, W., and Belmufti, G. (2012). Transfer learning using logistic regression in credit scoring. arXiv."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2767","DOI":"10.1016\/j.jbankfin.2010.06.001","article-title":"Consumer credit-risk models via machine-learning algorithms","volume":"34","author":"Khandani","year":"2010","journal-title":"J. Bank. Financ."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Azhan, M., and Meraj, S. (2020, January 3\u20135). Credit card fraud detection using machine learning and deep learning techniques. Proceedings of the 2020 3rd International Conference on Intelligent Sustainable Systems (ICISS), Thoothukudi, India.","DOI":"10.1109\/ICISS49785.2020.9316002"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2223","DOI":"10.1093\/rfs\/hhaa009","article-title":"Empirical asset pricing via machine learning","volume":"33","author":"Gu","year":"2020","journal-title":"Rev. Financ. Stud."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"46","DOI":"10.61351\/mf.v2i2.167","article-title":"Predicting stock prices in the Pakistan market using machine learning and technical indicators","volume":"2","author":"Raza","year":"2024","journal-title":"Mod. Financ."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.61351\/mf.v1i1.2","article-title":"Forecasting the equity premium: Do deep neural network models work?","volume":"1","author":"Zhou","year":"2023","journal-title":"Mod. Financ."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Arik, S.\u00d6., and Pfister, T. (2021, January 2\u20139). Tabnet: Attentive interpretable tabular learning. Proceedings of the AAAI Conference on Artificial Intelligence, Virtual.","DOI":"10.1609\/aaai.v35i8.16826"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Chen, T., and Guestrin, C. (2016, January 13\u201317). Xgboost: A scalable tree boosting system. Proceedings of the 22nd Acm Sigkdd International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939785"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2358661","DOI":"10.1080\/08839514.2024.2358661","article-title":"Performance Evaluation of Hybrid Machine Learning Algorithms for Online Lending Credit Risk Prediction","volume":"38","author":"Berhane","year":"2024","journal-title":"Appl. Artif. Intell."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"102397","DOI":"10.1016\/j.ribaf.2024.102397","article-title":"Credit scoring: Does XGboost outperform logistic regression? A test on Italian SMEs","volume":"70","author":"Zedda","year":"2024","journal-title":"Res. Int. Bus. Finance"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"116197","DOI":"10.1016\/j.cam.2024.116197","article-title":"An improved sparrow search algorithm optimized LightGBM approach for credit risk prediction of SMEs in supply chain finance","volume":"454","author":"Hou","year":"2025","journal-title":"J. Comput. Appl. Math."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"110302","DOI":"10.1016\/j.asoc.2023.110302","article-title":"Stacking ensemble method for personal credit risk assessment in Peer-to-Peer lending","volume":"142","author":"Yin","year":"2023","journal-title":"Appl. Soft Comput."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"\u00c1lvarez Chaves, M., Gupta, H.V., Ehret, U., and Guthke, A. (2024). On the Accurate Estimation of Information-Theoretic Quantities from Multi-Dimensional Sample Data. Entropy, 26.","DOI":"10.3390\/e26050387"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"5834","DOI":"10.1007\/s00034-024-02706-1","article-title":"High-Precision Direction of Arrival Estimation Based on LightGBM","volume":"43","author":"Wang","year":"2024","journal-title":"Circuits Syst. Signal Process."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Liu, X., Zhou, B., Qi, W., and Wang, J. (2024). Service Pricing and Charging Strategy for Video Platforms Considering Consumer Preferences, Wiley. International Transactions in Operational Research.","DOI":"10.1111\/itor.13514"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1186\/s40537-020-00369-8","article-title":"CatBoost for big data: An interdisciplinary review","volume":"7","author":"Hancock","year":"2020","journal-title":"J. Big Data"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Olaniran, O.R., Alzahrani, A.R.R., and Alzahrani, M.R. (2024). Eigenvalue Distributions in Random Confusion Matrices: Applications to Machine Learning Evaluation. Mathematics, 12.","DOI":"10.20944\/preprints202404.1010.v1"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1007\/s11403-023-00401-z","article-title":"Credit diversification and banking systemic risk","volume":"19","author":"Wang","year":"2024","journal-title":"J. Econ. Interact. Coord."},{"key":"ref_21","unstructured":"Javadi, S., and Osah, T. (2021). Credit risk correlation and the cost of bank loans. Financ. Manag."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"599","DOI":"10.1016\/j.ins.2023.02.014","article-title":"Loan default prediction using a credit rating-specific and multi-objective ensemble learning scheme","volume":"629","author":"Song","year":"2023","journal-title":"Inf. Sci."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"352","DOI":"10.1016\/j.bir.2024.01.006","article-title":"Exploring the impact of financial literacy on predicting credit default among farmers: An analysis using a hybrid machine learning model","volume":"24","author":"Lu","year":"2024","journal-title":"Borsa Istanb. Rev."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/26\/10\/861\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:12:40Z","timestamp":1760112760000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/26\/10\/861"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,13]]},"references-count":23,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2024,10]]}},"alternative-id":["e26100861"],"URL":"https:\/\/doi.org\/10.3390\/e26100861","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,13]]}}}