{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,1]],"date-time":"2026-03-01T05:23:40Z","timestamp":1772342620704,"version":"3.50.1"},"reference-count":38,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2021,5,8]],"date-time":"2021-05-08T00:00:00Z","timestamp":1620432000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Background: the credit scoring model is an effective tool for banks and other financial institutions to distinguish potential default borrowers. The credit scoring model represented by machine learning methods such as deep learning performs well in terms of the accuracy of default discrimination, but the model itself also has many shortcomings such as many hyperparameters and large dependence on big data. There is still a lot of room to improve its interpretability and robustness. Methods: the deep forest or multi-Grained Cascade Forest (gcForest) is a decision tree depth model based on the random forest algorithm. Using multidimensional scanning and cascading processing, gcForest can effectively identify and process high-dimensional feature information. At the same time, gcForest has fewer hyperparameters and has strong robustness. So, this paper constructs a two-stage hybrid default discrimination model based on multiple feature selection methods and gcForest algorithm, and at the same time, it optimizes the parameters for the lowest type II error as the first principle, and the highest AUC and accuracy as the second and third principles. GcForest can not only reflect the advantages of traditional statistical models in terms of interpretability and robustness but also take into account the advantages of deep learning models in terms of accuracy. Results: the validity of the hybrid default discrimination model is verified by three real open credit data sets of Australian, Japanese, and German in the UCI database. Conclusions: the performance of the gcForest is better than the current popular single classifiers such as ANN, and the common ensemble classifiers such as LightGBM, and CNNs in type II error, AUC, and accuracy. Besides, in comparison with other similar research results, the robustness and effectiveness of this model are further verified.<\/jats:p>","DOI":"10.3390\/e23050582","type":"journal-article","created":{"date-parts":[[2021,5,9]],"date-time":"2021-05-09T21:32:46Z","timestamp":1620595966000},"page":"582","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["A Two-Stage Hybrid Default Discriminant Model Based on Deep Forest"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2113-0096","authenticated-orcid":false,"given":"Gang","family":"Li","sequence":"first","affiliation":[{"name":"School of Business Administration, Northeastern University, Shenyang 110819, China"},{"name":"School of Economics, Northeastern University at Qinhuangdao, Qinhuangdao 066004, China"},{"name":"Institutes of Science and Development, Chinese Academy of Sciences, Beijing 100190, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8176-8788","authenticated-orcid":false,"given":"Hong-Dong","family":"Ma","sequence":"additional","affiliation":[{"name":"School of Business Administration, Northeastern University, Shenyang 110819, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8006-8018","authenticated-orcid":false,"given":"Rong-Yue","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Business Administration, Northeastern University, Shenyang 110819, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8479-5370","authenticated-orcid":false,"given":"Meng-Di","family":"Shen","sequence":"additional","affiliation":[{"name":"School of Business Administration, Northeastern University, Shenyang 110819, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9764-7665","authenticated-orcid":false,"given":"Ke-Xin","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Business Administration, Northeastern University, Shenyang 110819, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1111\/j.1540-6261.1968.tb00843.x","article-title":"Financial Ratios, Discriminant Analysis and the Prediction of Corporate Bankruptcy","volume":"9","author":"Altman","year":"1968","journal-title":"J. Financ."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/0304-4076(89)90026-2","article-title":"An econometric analysis of the bank credit scoring problem","volume":"40","author":"Boyes","year":"1989","journal-title":"J. Econom."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1016\/0378-4266(77)90022-X","article-title":"Early warning of bank failure: A logit regression approach","volume":"1","author":"Martin","year":"1977","journal-title":"J. Bank Financ."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"113925","DOI":"10.1016\/j.eswa.2020.113925","article-title":"Utilizing historical data for corporate credit rating assessment","volume":"165","author":"Wang","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1009","DOI":"10.1007\/s10796-020-10037-0","article-title":"A Hybrid Bi-level Metaheuristic for Credit Scoring","volume":"22","author":"Sen","year":"2020","journal-title":"Inform. Syst. Front."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"112718","DOI":"10.1016\/j.cam.2020.112718","article-title":"Exploration of credit risk of P2P platform based on data mining technology","volume":"372","author":"Cai","year":"2020","journal-title":"J. Comput. Appl. Math."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1114","DOI":"10.1108\/K-01-2014-0016","article-title":"Modeling credit scoring using neural network ensembles","volume":"43","author":"Tsai","year":"2014","journal-title":"Kybernetes"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Goh, R.Y., Lee, L.S., Seow, H.V., and Gopal, K. (2020). Hybrid Harmony Search\u2013Artificial Intelligence Models in Credit Scoring. Entropy, 22.","DOI":"10.3390\/e22090989"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhu, Y., Xie, C., Wang, G.J., and Yan, X.G. (2016). Predicting China\u2019s SME Credit Risk in Supply Chain Finance Based on Machine Learning Methods. Entropy, 18.","DOI":"10.3390\/e18050195"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"101130","DOI":"10.1016\/j.aei.2020.101130","article-title":"New hybrid data mining model for credit scoring based on feature selection algorithm and ensemble classifiers","volume":"45","author":"Nali","year":"2020","journal-title":"Adv. Eng. Inform."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zhou, Z., and Feng, J. (2017, January 19\u201325). Deep forest: Towards an alternative to deep neural networks. Proceedings of the 26th International Joint Conference on Artificial Intelligence(IJCAI\u201917), Melbourne, Australia.","DOI":"10.24963\/ijcai.2017\/497"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1023\/A:1007607513941","article-title":"An Experimental Comparison of Three Methods for Constructing Ensembles of Decision Trees: Bagging, Boosting, and Randomization","volume":"40","author":"Dietterich","year":"2000","journal-title":"Mach. Learn."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random Forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Chen, T., and Guestrin, C. (2016, January 13\u201317). XGBoost: A Scalable Tree Boosting System. Proceedings of the 22nd ACM SIGKDD International Conference, San Francisco, AC, USA.","DOI":"10.1145\/2939672.2939785"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1093\/nsr\/nwy108","article-title":"Deep forest","volume":"6","author":"Zhou","year":"2019","journal-title":"Natl. Sci. Rev."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"137913","DOI":"10.1109\/ACCESS.2019.2941515","article-title":"Deep forest in ADHD data classification","volume":"7","author":"Shao","year":"2019","journal-title":"IEEE Access"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"91992","DOI":"10.1109\/ACCESS.2019.2927465","article-title":"A Multiple-layer Representation Learning Model for Network-Based Attack Detection","volume":"7","author":"Zhang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"106263","DOI":"10.1016\/j.asoc.2020.106263","article-title":"Statistical and machine learning models in credit scoring: A systematic literature survey","volume":"91","author":"Dastile","year":"2020","journal-title":"Appl. Soft Comput."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/j.eswa.2018.12.020","article-title":"A novel multi-stage hybrid model with enhanced multi-population niche genetic algorithm: An application in credit scoring","volume":"121","author":"Zhang","year":"2019","journal-title":"Expert Syst. Appl."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"4902","DOI":"10.1016\/j.eswa.2009.12.025","article-title":"Combination of feature selection approaches with SVM in credit scoring","volume":"37","author":"Chen","year":"2010","journal-title":"Expert Syst. Appl."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.jretconser.2015.07.003","article-title":"A hybrid data mining model of feature selection algorithms and ensemble learning classifiers for credit scoring","volume":"27","author":"Koutanaei","year":"2015","journal-title":"J. Retail. Consum. Serv."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1016\/j.knosys.2014.10.010","article-title":"The effect of feature selection on financial distress prediction","volume":"73","author":"Liang","year":"2015","journal-title":"Knowl.-Based Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"e12217","DOI":"10.1111\/exsy.12217","article-title":"A feature selection enabled hybrid-bagging algorithm for credit risk evaluation","volume":"34","author":"Dahiya","year":"2017","journal-title":"Expert Syst."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"101413","DOI":"10.1016\/j.techsoc.2020.101413","article-title":"A study on credit scoring modeling with different feature selection and machine learning approaches","volume":"63","author":"Trivedi","year":"2020","journal-title":"Technol. Soc."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"23","DOI":"10.28991\/esj-2019-01165","article-title":"Deep Learning Research: Scientometric Assessment of Global Publications Output during 2004\u201317","volume":"3","author":"Gupta","year":"2019","journal-title":"Emerg. Sci. J."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2161","DOI":"10.1109\/ACCESS.2018.2887138","article-title":"A Deep Learning Approach for Credit Scoring of Peer-to-Peer Lending Using Attention Mechanism LSTM","volume":"7","author":"Wang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Kim, J., and Cho, S. (2019). Towards Repayment Prediction in Peer-to-Peer Social Lending Using Deep Learning. Mathematics, 7.","DOI":"10.3390\/math7111041"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"105740","DOI":"10.1016\/j.asoc.2019.105740","article-title":"Application of New Deep Genetic Cascade Ensemble of SVM Classifiers to Predict the Australian Credit Scoring","volume":"84","author":"Pawiak","year":"2019","journal-title":"Appl. Soft. Comput."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"177307","DOI":"10.1109\/ACCESS.2020.3027337","article-title":"A Deep Learning Based Online Credit Scoring Model for P2P Lending","volume":"8","author":"Zhang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1016\/j.ins.2019.12.045","article-title":"DGHNL: A New Deep Genetic Hierarchical Network of Learners for Prediction of Credit Scoring","volume":"516","author":"Pawiak","year":"2020","journal-title":"Inf. Sci."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"106852","DOI":"10.1016\/j.asoc.2020.106852","article-title":"A new deep learning ensemble credit risk evaluation model with an improved synthetic minority oversampling technique","volume":"98","author":"Shen","year":"2021","journal-title":"Appl. Soft. Comput."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1111\/coin.12200","article-title":"A novel hybrid credit scoring model based on ensemble feature selection and multilayer ensemble classification","volume":"35","author":"Tripathi","year":"2019","journal-title":"Comput. Intell."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/j.inffus.2014.10.005","article-title":"A new boosting design of Support Vector Machine classifiers","volume":"25","year":"2015","journal-title":"Inf. Fusion"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1","DOI":"10.5539\/ijef.v12n5p1","article-title":"A heterogeneous ensemble credit scoring model based on adaptive classifier selection: An application on imbalanced data","volume":"2","author":"Zhang","year":"2020","journal-title":"Int. J. Financ. Econ."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Ling, C.X., Huang, J., and Zhang, H. (2003, January 11\u201313). AUC: A Better Measure than Accuracy in Comparing Learning Algorithms. Proceedings of the 16th Conference of the Canadian Society for Computational Studies of Intelligence, AI 2003, Halifax, NS, Canada.","DOI":"10.1007\/3-540-44886-1_25"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"113872","DOI":"10.1016\/j.eswa.2020.113872","article-title":"A novel multi-stage ensemble model with enhanced outlier adaptation for credit scoring","volume":"165","author":"Zhang","year":"2020","journal-title":"Expert Syst. Appl."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1016\/j.dss.2019.01.002","article-title":"Two-stage consumer credit risk modelling using heterogeneous ensemble learning","volume":"118","author":"Papouskova","year":"2019","journal-title":"Decis. Support Syst."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"78549","DOI":"10.1109\/ACCESS.2019.2922676","article-title":"A Multi-Stage Self-Adaptive Classifier Ensemble Model With Application in Credit Scoring","volume":"99","author":"Guo","year":"2019","journal-title":"IEEE Access"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/5\/582\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:58:17Z","timestamp":1760162297000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/5\/582"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,8]]},"references-count":38,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2021,5]]}},"alternative-id":["e23050582"],"URL":"https:\/\/doi.org\/10.3390\/e23050582","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,8]]}}}