{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T20:36:00Z","timestamp":1781123760584,"version":"3.54.1"},"reference-count":49,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2022,4,27]],"date-time":"2022-04-27T00:00:00Z","timestamp":1651017600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["71874027"],"award-info":[{"award-number":["71874027"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Credit scoring is an effective tool for banks and lending companies to manage the potential credit risk of borrowers. Machine learning algorithms have made grand progress in automatic and accurate discrimination of good and bad borrowers. Notably, ensemble approaches are a group of powerful tools to enhance the performance of credit scoring. Random forest (RF) and Gradient Boosting Decision Tree (GBDT) have become the mainstream ensemble methods for precise credit scoring. RF is a Bagging-based ensemble that realizes accurate credit scoring enriches the diversity base learners by modifying the training object. However, the optimization pattern that works on invariant training targets may increase the statistical independence of base learners. GBDT is a boosting-based ensemble approach that reduces the credit scoring error by iteratively changing the training target while keeping the training features unchanged. This may harm the diversity of base learners. In this study, we incorporate the advantages of the Bagging ensemble training strategy and boosting ensemble optimization pattern to enhance the diversity of base learners. An extreme learning machine-based supervised augmented GBDT is proposed to enhance the discriminative ability for credit scoring. Experimental results on 4 public credit datasets show a significant improvement in credit scoring and suggest that the proposed method is a good solution to realize accurate credit scoring.<\/jats:p>","DOI":"10.3390\/a15050149","type":"journal-article","created":{"date-parts":[[2022,4,27]],"date-time":"2022-04-27T13:40:57Z","timestamp":1651066857000},"page":"149","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Extreme Learning Machine Enhanced Gradient Boosting for Credit Scoring"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4296-8138","authenticated-orcid":false,"given":"Yao","family":"Zou","sequence":"first","affiliation":[{"name":"Glorious Sun School of Business and Management, Donghua University, Shanghai 200051, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Changchun","family":"Gao","sequence":"additional","affiliation":[{"name":"Glorious Sun School of Business and Management, Donghua University, Shanghai 200051, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,4,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Simumba, N., Okami, S., Kodaka, A., and Kohtake, N. (2021). Comparison of Profit-Based Multi-Objective Approaches for Feature Selection in Credit Scoring. Algorithms, 14.","DOI":"10.3390\/a14090260"},{"key":"ref_2","first-page":"1","article-title":"Example-dependent cost-sensitive credit cards fraud detection using SMOTE and Bayes minimum risk","volume":"2","author":"Almhaithawi","year":"2020","journal-title":"SN Appl. Sci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"120462","DOI":"10.1016\/j.techfore.2020.120462","article-title":"Borrowers\u2019 credit quality scoring model and applications, with default discriminant analysis based on the extreme learning machine","volume":"165","author":"Pang","year":"2021","journal-title":"Technol. Forecast. Soc. Chang."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2510","DOI":"10.1016\/j.eswa.2014.10.037","article-title":"Detecting credit card fraud by modified Fisher discriminant analysis","volume":"42","author":"Mahmoudi","year":"2015","journal-title":"Expert Syst. Appl."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1016\/j.asoc.2016.02.025","article-title":"Technology credit scoring model with fuzzy logistic regression","volume":"43","author":"Sohn","year":"2016","journal-title":"Appl. Soft Comput."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1178","DOI":"10.1016\/j.ejor.2021.06.053","article-title":"Machine learning for credit scoring: Improving logistic regression with non-linear decision-tree effects","volume":"22","author":"Dumitrescu","year":"2022","journal-title":"Eur. J. Oper. Res."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1016\/j.engappai.2016.12.002","article-title":"A deep learning approach for credit scoring using credit default swaps","volume":"65","author":"Luo","year":"2017","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3508","DOI":"10.1016\/j.eswa.2014.12.006","article-title":"Investigation and improvement of multi-layer perceptron neural networks for credit scoring","volume":"42","author":"Zhao","year":"2015","journal-title":"Expert Syst. Appl."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"113615","DOI":"10.1016\/j.eswa.2020.113615","article-title":"A novel tree-based dynamic heterogeneous ensemble method for credit scoring","volume":"159","author":"Xia","year":"2020","journal-title":"Expert Syst. Appl."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1009","DOI":"10.1007\/s10796-020-10037-0","article-title":"A hybrid bi-level metaheuristic for credit scoring","volume":"22","year":"2020","journal-title":"Inf. Syst. Front."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"741","DOI":"10.1016\/j.eswa.2014.08.029","article-title":"Credit scoring using the clustered support vector machine","volume":"42","author":"Harris","year":"2015","journal-title":"Expert Syst. Appl."},{"key":"ref_12","first-page":"79","article-title":"Bank credit risk analysis with k-nearest-neighbor classifier: Case of Tunisian banks","volume":"14","author":"Abdelmoula","year":"2015","journal-title":"Account. Manag. Inf. Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1016\/j.ins.2019.12.045","article-title":"DGHNL: A new deep genetic hierarchical network of learners for prediction of credit scoring","volume":"516","author":"Abdar","year":"2020","journal-title":"Inf. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1595","DOI":"10.1016\/j.ejor.2006.09.101","article-title":"Measuring retail company performance using credit scoring techniques","volume":"183","author":"Hu","year":"2007","journal-title":"Eur. J. Oper. Res."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Okesola, O.J., Okokpujie, K.O., Adewale, A.A., John, S.N., and Omoruyi, O. (2017, January 14\u201316). An improved bank credit scoring model: A na\u00efve Bayesian approach. Proceedings of the 2017 International Conference on Computational Science and Computational Intelligence (CSCI), Las Vegas, NV, USA.","DOI":"10.1109\/CSCI.2017.36"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"104036","DOI":"10.1016\/j.engappai.2020.104036","article-title":"Step-wise multi-grained augmented gradient boosting decision trees for credit scoring","volume":"97","author":"Liu","year":"2021","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.jretconser.2015.07.003","article-title":"A hybrid data mining model of feature selection algorithms and ensemble learning classifiers for credit scoring","volume":"27","author":"Koutanaei","year":"2015","journal-title":"J. Retail. Consum. Serv."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"5932","DOI":"10.1016\/j.eswa.2013.05.022","article-title":"The application of brute force logistic regression to corporate credit scoring models: Evidence from Serbian financial statements","volume":"40","author":"Nikolic","year":"2013","journal-title":"Expert Syst. Appl."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1016\/0378-4266(78)90012-2","article-title":"Problems in applying discriminant analysis in credit scoring models","volume":"2","author":"Eisenbeis","year":"1978","journal-title":"J. Bank. Financ."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Nai, W., Liu, L., Wang, S., and Dong, D. (2018). Modeling the trend of credit card usage behavior for different age groups based on singular spectrum analysis. Algorithms, 11.","DOI":"10.3390\/a11020015"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Devi, C.D., and Chezian, R.M. (2016, January 24). A relative evaluation of the performance of ensemble learning in credit scoring. Proceedings of the 2016 IEEE International Conference on Advances in Computer Applications (ICACA), Coimbatore, India.","DOI":"10.1109\/ICACA.2016.7887943"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1016\/j.eswa.2017.01.011","article-title":"Reject inference in credit scoring using semi-supervised support vector machines","volume":"74","author":"Li","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2639","DOI":"10.1016\/j.eswa.2007.05.019","article-title":"Using neural network ensembles for bankruptcy prediction and credit scoring","volume":"34","author":"Tsai","year":"2008","journal-title":"Expert Syst. Appl."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1113","DOI":"10.1016\/j.csda.2004.11.006","article-title":"Mining the customer credit using classification and regression tree and multivariate adaptive regression splines","volume":"50","author":"Lee","year":"2006","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_25","unstructured":"Dohmatob, E. (2019, January 9\u201315). Generalized no free lunch theorem for adversarial robustness. Proceedings of the International Conference on Machine Learning, Long Beach, CA, USA."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"105740","DOI":"10.1016\/j.asoc.2019.105740","article-title":"Application of new deep genetic cascade ensemble of SVM classifiers to predict the Australian credit scoring","volume":"84","author":"Abdar","year":"2019","journal-title":"Appl. Soft Comput."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.eswa.2016.12.020","article-title":"A comparative study on base classifiers in ensemble methods for credit scoring","volume":"73","author":"Castellano","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1016\/j.eswa.2016.07.017","article-title":"A new hybrid ensemble credit scoring model based on classifiers consensus system approach","volume":"64","author":"Abbod","year":"2016","journal-title":"Expert Syst. Appl."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"113872","DOI":"10.1016\/j.eswa.2020.113872","article-title":"A novel multi-stage ensemble model with enhanced outlier adaptation for credit scoring","volume":"165","author":"Zhang","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/j.asoc.2018.01.021","article-title":"Dynamic ensemble classification for credit scoring using soft probability","volume":"65","author":"Feng","year":"2018","journal-title":"Appl. Soft Comput."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"114744","DOI":"10.1016\/j.eswa.2021.114744","article-title":"A new hybrid ensemble model with voting-based outlier detection and balanced sampling for credit scoring","volume":"174","author":"Zhang","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1016\/j.eswa.2017.10.022","article-title":"A novel heterogeneous ensemble credit scoring model based on bstacking approach","volume":"93","author":"Xia","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"101130","DOI":"10.1016\/j.aei.2020.101130","article-title":"New hybrid data mining model for credit scoring based on feature selection algorithm and ensemble classifiers","volume":"45","year":"2020","journal-title":"Adv. Eng. Inform."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"12717","DOI":"10.1016\/j.eswa.2011.04.059","article-title":"Poly-bagging predictors for classification modelling for credit scoring","volume":"38","author":"Louzada","year":"2011","journal-title":"Expert Syst. Appl."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1016\/j.eswa.2018.01.012","article-title":"A novel ensemble method for credit scoring: Adaption of different imbalance ratios","volume":"98","author":"He","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Zhang, X., Yang, Y., and Zhou, Z. (2018, January 8\u201310). A novel credit scoring model based on optimized random forest. Proceedings of the 2018 IEEE 8th Annual Computing and Communication Workshop and Conference (CCWC), Las Vegas, NV, USA.","DOI":"10.1109\/CCWC.2018.8301707"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"5325","DOI":"10.1007\/s10489-021-02715-6","article-title":"Multi-grained and multi-layered gradient boosting decision tree for credit scoring","volume":"52","author":"Liu","year":"2021","journal-title":"Appl. Intell."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"4007","DOI":"10.1016\/j.eswa.2011.09.075","article-title":"Decision tree-based technology credit scoring for start-up firms: Korean case","volume":"39","author":"Sohn","year":"2012","journal-title":"Expert Syst. Appl."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1016\/j.eswa.2017.02.017","article-title":"A boosted decision tree approach using Bayesian hyper-parameter optimization for credit scoring","volume":"78","author":"Xia","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Tannor, P., and Rokach, L. (2019, January 10\u201316). AugBoost: Gradient Boosting Enhanced with Step-Wise Feature Augmentation. Proceedings of the IJCAI, Macao, China.","DOI":"10.24963\/ijcai.2019\/493"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1016\/j.neucom.2005.12.126","article-title":"Extreme learning machine: Theory and applications","volume":"70","author":"Huang","year":"2006","journal-title":"Neurocomputing"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"549","DOI":"10.1007\/s00521-013-1522-8","article-title":"Extreme learning machine and its applications","volume":"25","author":"Ding","year":"2014","journal-title":"Neural Comput. Appl."},{"key":"ref_43","unstructured":"Cannings, T.I., and Samworth, R.J. (2015). Random-projection ensemble classification. arXiv."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"116034","DOI":"10.1016\/j.eswa.2021.116034","article-title":"Credit scoring based on tree-enhanced gradient boosting decision trees","volume":"189","author":"Liu","year":"2022","journal-title":"Expert Syst. Appl."},{"key":"ref_45","unstructured":"Dua, D., and Graff, C. (2022, February 21). UCI Machine Learning Repository. Available online: http:\/\/archive.ics.uci.edu\/ml."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Feurer, M., Springenberg, J., and Hutter, F. (2015, January 25\u201330). Initializing bayesian hyperparameter optimization via meta-learning. Proceedings of the Proceedings of the AAAI Conference on Artificial Intelligence, Austin, TX, USA.","DOI":"10.1609\/aaai.v29i1.9354"},{"key":"ref_47","first-page":"5477","article-title":"Improved credit scoring model using XGBoost with Bayesian hyper-parameter optimization","volume":"11","author":"Yotsawat","year":"2021","journal-title":"Int. J. Electr. Comput. Eng."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1309","DOI":"10.1109\/TNSM.2020.2980289","article-title":"Distributed evolutionary hyperparameter optimization for fuzzy time series","volume":"17","author":"Silva","year":"2020","journal-title":"IEEE Trans. Netw. Serv. Manag."},{"key":"ref_49","first-page":"3146","article-title":"Lightgbm: A highly efficient gradient boosting decision tree","volume":"30","author":"Ke","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/5\/149\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:01:48Z","timestamp":1760137308000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/15\/5\/149"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,27]]},"references-count":49,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2022,5]]}},"alternative-id":["a15050149"],"URL":"https:\/\/doi.org\/10.3390\/a15050149","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,4,27]]}}}