{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,1]],"date-time":"2026-01-01T10:06:18Z","timestamp":1767261978156,"version":"build-2065373602"},"reference-count":61,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2018,10,28]],"date-time":"2018-10-28T00:00:00Z","timestamp":1540684800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Informatics"],"abstract":"<jats:p>Credit scoring is generally recognized as one of the most significant operational research techniques used in banking and finance, aiming to identify whether a credit consumer belongs to either a legitimate or a suspicious customer group. With the vigorous development of the Internet and the widespread adoption of electronic records, banks and financial institutions have accumulated large repositories of labeled and mostly unlabeled data. Semi-supervised learning constitutes an appropriate machine- learning methodology for extracting useful knowledge from both labeled and unlabeled data. In this work, we evaluate the performance of two ensemble semi-supervised learning algorithms for the credit scoring problem. Our numerical experiments indicate that the proposed algorithms outperform their component semi-supervised learning algorithms, illustrating that reliable and robust prediction models could be developed by the adaptation of ensemble techniques in the semi-supervised learning framework.<\/jats:p>","DOI":"10.3390\/informatics5040040","type":"journal-article","created":{"date-parts":[[2018,10,29]],"date-time":"2018-10-29T11:10:41Z","timestamp":1540811441000},"page":"40","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["On Ensemble SSL Algorithms for Credit Scoring Problem"],"prefix":"10.3390","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3996-3301","authenticated-orcid":false,"given":"Ioannis E.","family":"Livieris","sequence":"first","affiliation":[{"name":"Computer &amp; Informatics Engineering Department, Technological Educational Institute of Western Greece, GR 263-34 Antirion, Greece"}]},{"given":"Niki","family":"Kiriakidou","sequence":"additional","affiliation":[{"name":"Department of Statistics and Insurance Science, University of Piraeus, GR 185-34 Piraeus, Greece"}]},{"given":"Andreas","family":"Kanavos","sequence":"additional","affiliation":[{"name":"Computer &amp; Informatics Engineering Department, Technological Educational Institute of Western Greece, GR 263-34 Antirion, Greece"}]},{"given":"Vassilis","family":"Tampakas","sequence":"additional","affiliation":[{"name":"Computer &amp; Informatics Engineering Department, Technological Educational Institute of Western Greece, GR 263-34 Antirion, Greece"}]},{"given":"Panagiotis","family":"Pintelas","sequence":"additional","affiliation":[{"name":"Department of Mathematics, University of Patras, Patras, GR 265-00, Greece"}]}],"member":"1968","published-online":{"date-parts":[[2018,10,28]]},"reference":[{"key":"ref_1","unstructured":"Mays, E. (2001). Handbook of Credit Scoring, Global Professional Publishing."},{"key":"ref_2","unstructured":"Altman, E. (2002). Bankruptcy, Credit Risk, and High Yield Junk Bonds, Wiley-Blackwell."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Kramer, J. (2017). Clearly Money Has Something to Do with Life\u2014But What Exactly? Reflections on Recent Credit Crunch Fiction (s). London Post-2010 in British Literature and Culture, Koninklijke Brill NV.","DOI":"10.1163\/9789004344013_013"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1848","DOI":"10.1093\/rfs\/hhp033","article-title":"Understanding the subprime mortgage crisis","volume":"24","author":"Demyanyk","year":"2009","journal-title":"Rev. Financial Stud."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1111\/j.1467-985X.1997.00078.x","article-title":"Statistical classification methods in consumer credit scoring: A review","volume":"160","author":"Hand","year":"1997","journal-title":"J. R. Stat. Soc. Ser. A (Stat. Soc.)"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Venkatraman, S. (2017). A Proposed Business Intelligent Framework for Recommender Systems. Informatics, 4.","DOI":"10.3390\/informatics4040040"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Lanza-Cruz, I., Berlanga, R., and Aramburu, M. (2018). Modeling Analytical Streams for Social Business Intelligence. Informatics, 5.","DOI":"10.20944\/preprints201806.0419.v1"},{"key":"ref_8","unstructured":"Stamate, C., Magoulas, G., and Thomas, M. (arXiv, 2015). Transfer learning approach for financial applications, arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2053","DOI":"10.1142\/S0218127406015891","article-title":"Computational intelligence methods for financial time series modeling","volume":"16","author":"Pavlidis","year":"2006","journal-title":"Int. J. Bifurc. Chaos"},{"key":"ref_10","unstructured":"Pavlidis, N., Tasoulis, D., and Vrahatis, M. (2003, January 8\u201312). Financial forecasting through unsupervised clustering and evolutionary trained neural networks. Proceedings of the Congress on Evolutionary Computation, Canberra, ACT, Australia."},{"key":"ref_11","first-page":"103","article-title":"Financial forecasting through unsupervised clustering and neural networks","volume":"6","author":"Pavlidis","year":"2006","journal-title":"Oper. Res."},{"key":"ref_12","unstructured":"Council, N.R. (2001). Building a Workforce for the Information Economy, National Academies Press."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"31","DOI":"10.3390\/informatics2040031","article-title":"Skills and vacancy analysis with data mining techniques","volume":"2","author":"Wowczko","year":"2015","journal-title":"Informatics"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Dinh, T., and Kwon, Y. (2018). An Empirical Study on Importance of Modeling Parameters and Trading Volume-Based Features in Daily Stock Trading Using Neural Networks. Informatics, 5.","DOI":"10.3390\/informatics5030036"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Rokach, L. (2010). Pattern Classification Using Ensemble Methods, World Scientific Publishing Company.","DOI":"10.1142\/9789814271073"},{"key":"ref_16","first-page":"1","article-title":"Introduction to semi-supervised learning","volume":"3","author":"Zhu","year":"2009","journal-title":"Synth. Lect. Artif. Intell. Mach. Learn."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Guo, T., and Li, G. (2012). Improved tri-training with unlabeled data. Software Engineering and Knowledge Engineering: Theory and Practice, Springer.","DOI":"10.1007\/978-3-642-25349-2_19"},{"key":"ref_18","unstructured":"Livieris, I.E., Tampakas, V., Kiriakidou, N., Mikropoulos, T., and Pintelas, P. (2018, January 20\u201322). Forecasting students\u2019 performance using an ensemble SSL algorithm. Proceedings of the 8th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Infoexclusion, Thessaloniki, Greece."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Livieris, I.E., Kanavos, A., Vonitsanos, G., Kiriakidou, N., Vikatos, A., Giotopoulos, K., and Tampakas, V. (2018, January 23\u201325). Performance evaluation of a SSL algorithm for forecasting the Dow Jones index. Proceedings of the 9th International Conference on Information, Intelligence, Systems and Applications, Zakynthos, Greece.","DOI":"10.1109\/IISA.2018.8633692"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Livieris, I.E., Kanavos, A., Tampakas, V., and Pintelas, P. (2018). An ensemble SSL algorithm for efficient chest X-ray image classification. J. Imaging, 4.","DOI":"10.3390\/jimaging4070095"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Livieris, I.E., Drakopoulou, K., Tampakas, V., Mikropoulos, T., and Pintelas, P. (2018). Predicting secondary school students\u2019 performance utilizing a semi-supervised learning approach. J. Educ. Comput. Res.","DOI":"10.1177\/0735633117752614"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Livieris, I.E., Drakopoulou, K., Tampakas, V., Mikropoulos, T., and Pintelas, P. (2018). An ensemble-based semi-supervised approach for predicting students\u2019 performance. Research on e-Learning and ICT in Education, Springer.","DOI":"10.1007\/978-3-319-95059-4_2"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Levati\u0107, J., Brbi\u0107, M., Perdih, T., Kocev, D., Vidulin, V., \u0160muc, T., Supek, F., and D\u017eeroski, S. (2017, January 18\u201322). Phenotype prediction with semi-supervised learning. Proceedings of the New Frontiers in Mining Complex Patterns: Sixth Edition of the International Workshop NFMCP 2017 in Conjunction with ECML-PKDD 2017, Skopje, Macedonia.","DOI":"10.1007\/978-3-319-78680-3_10"},{"key":"ref_24","first-page":"173","article-title":"Semi-supervised learning for quantitative structure-activity modeling","volume":"37","author":"Dzeroski","year":"2013","journal-title":"Informatica"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1007\/s10115-013-0706-y","article-title":"Self-labeled techniques for semi-supervised learning: Taxonomy, software and empirical study","volume":"42","author":"Triguero","year":"2015","journal-title":"Knowl. Inf. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"622","DOI":"10.1109\/TCYB.2014.2332003","article-title":"SEG-SSC: A Framework Based on Synthetic Examples Generation for Self-Labeled Semi-Supervised Classification","volume":"45","author":"Triguero","year":"2014","journal-title":"IEEE Trans. Cybern."},{"key":"ref_27","first-page":"117","article-title":"Classification methods applied to credit scoring: Systematic review and overall comparison","volume":"21","author":"Louzada","year":"2016","journal-title":"Surv. Oper. Res. Manag. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1057\/jors.2011.30","article-title":"Using semi-supervised classifiers for credit scoring","volume":"64","author":"Kennedy","year":"2013","journal-title":"J. Oper. Res. Soc."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1016\/j.eswa.2016.07.017","article-title":"A new hybrid ensemble credit scoring model based on classifiers consensus system approach","volume":"64","author":"Abbod","year":"2016","journal-title":"Expert Syst. Appl."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.eswa.2016.12.020","article-title":"A comparative study on base classifiers in ensemble methods for credit scoring","volume":"73","author":"Castellano","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1543","DOI":"10.3233\/JIFS-169449","article-title":"Hybrid credit scoring model using neighborhood rough set and multi-layer ensemble classification","volume":"34","author":"Tripathi","year":"2018","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1016\/j.neucom.2018.07.070","article-title":"Classifier selection and clustering with fuzzy assignment in ensemble model for credit scoring","volume":"316","author":"Zhang","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.knosys.2017.02.014","article-title":"Self-training for multi-target regression with tree ensembles","volume":"123","author":"Ceci","year":"2017","journal-title":"Knowl.-Based Syst."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/j.ins.2018.03.033","article-title":"Semi-supervised trees for multi-target regression","volume":"450","author":"Kocev","year":"2018","journal-title":"Inf. Sci."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Yarowsky, D. (1995, January 26\u201330). Unsupervised word sense disambiguation rivaling supervised methods. Proceedings of the 33rd Annual Meeting of the Association for Computational Linguistics, Cambridge, MA, USA.","DOI":"10.3115\/981658.981684"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Li, M., and Zhou, Z. (2005). SETRED: Self-training with editing. Pacific-Asia Conference on Knowledge Discovery and Data Mining, Springer.","DOI":"10.1007\/11430919_71"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Blum, A., and Mitchell, T. (1998, January 24\u201326). Combining labeled and unlabeled data with co-training. Proceedings of the 11th Annual Conference on Computational Learning Theory, Madison, WI, USA.","DOI":"10.1145\/279943.279962"},{"key":"ref_38","unstructured":"Zhou, Y., and Goldman, S. (2004, January 15\u201317). Democratic co-learning. Proceedings of the 16th IEEE International Conference on Tools with Artificial Intelligence (ICTAI), Boca Raton, FL, USA."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1088","DOI":"10.1109\/TSMCA.2007.904745","article-title":"Improve computer-aided diagnosis with machine learning techniques using undiagnosed samples","volume":"37","author":"Li","year":"2007","journal-title":"IEEE Trans. Syst. Man Cybern.-Part A Syst. Hum."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1529","DOI":"10.1109\/TKDE.2005.186","article-title":"Tri-training: Exploiting unlabeled data using three classifiers","volume":"17","author":"Zhou","year":"2005","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1007\/s11460-011-0126-2","article-title":"When Semi-supervised Learning Meets Ensemble Learning","volume":"Volume 6","author":"Zhou","year":"2011","journal-title":"Frontiers of Electrical and Electronic Engineering in China"},{"key":"ref_42","first-page":"1","article-title":"Ensemble methods in machine learning","volume":"Volume 1857","author":"Kittler","year":"2001","journal-title":"Multiple Classifier Systems"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"99","DOI":"10.3233\/JIFS-169571","article-title":"CST-Voting\u2014A semi-supervised ensemble method for classification problems","volume":"35","author":"Kostopoulos","year":"2018","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Livieris, I.E. (2019). A new ensemble self-labeled semi-supervised algorithm. Informatica, 1\u201314. to be appeared.","DOI":"10.31449\/inf.v43i2.2217"},{"key":"ref_45","unstructured":"Baumgartner, D., and Serpen, G. (2009, January 6\u20139). Large Experiment and Evaluation Tool for WEKA Classifiers. Proceedings of the International Conference on Data Mining, Miami, FL, USA."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1145\/1656274.1656278","article-title":"The WEKA data mining software: An update","volume":"11","author":"Hall","year":"2009","journal-title":"SIGKDD Explor. Newslett."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1016\/j.neucom.2013.05.055","article-title":"On the characterization of noise filters for self-training semi-supervised in nearest neighbor classification","volume":"132","author":"Triguero","year":"2014","journal-title":"Neurocomputing"},{"key":"ref_48","unstructured":"Bache, K., and Lichman, M. (2013). UCI Machine Learning Repository, University of California, Department of Information and Computer Science."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1023\/A:1007413511361","article-title":"On the optimality of the simple Bayesian classifier under zero-one loss","volume":"29","author":"Domingos","year":"1997","journal-title":"Mach. Learn."},{"key":"ref_50","unstructured":"Kearns, M., Solla, S., and Cohn, D. (1999). Using sparseness and analytic QP to speed training of support vector machines. Advances in Neural Information Processing Systems, MIT Press."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Rumelhart, D., and McClelland, J. (1986). Learning internal representations by error propagation. Parallel Distributed Processing: Explorations in the Microstructure of Cognition, MIT Press.","DOI":"10.7551\/mitpress\/5236.001.0001"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Aha, D. (1997). Lazy Learning, Kluwer Academic Publishers.","DOI":"10.1007\/978-94-017-2053-3"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10115-007-0114-2","article-title":"Top 10 algorithms in data mining","volume":"14","author":"Wu","year":"2008","journal-title":"Knowl. Inf. Syst."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"1203","DOI":"10.1109\/TCSVT.2011.2130270","article-title":"A boosted co-training algorithm for human action recognition","volume":"21","author":"Liu","year":"2011","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1007\/s13042-015-0328-7","article-title":"Semi-supervised selftraining for decision tree classifiers","volume":"8","author":"Tanha","year":"2015","journal-title":"Int. J. Mach. Learn. Cybern."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Livieris, I., Kanavos, A., Tampakas, V., and Pintelas, P. (2018). An auto-adjustable semi-supervised self-training algorithm. Algorithm, 11.","DOI":"10.3390\/a11090139"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"482","DOI":"10.1214\/aoms\/1177704575","article-title":"Rank methods for combination of independent experiments in analysis of variance","volume":"33","author":"Hodges","year":"1962","journal-title":"Ann. Math. Stat."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"920","DOI":"10.1080\/01621459.1993.10476358","article-title":"On a monotonicity problem in step-down multiple test procedures","volume":"88","author":"Finner","year":"1993","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1007\/s10844-017-0457-4","article-title":"Semi-supervised classification trees","volume":"49","author":"Ceci","year":"2017","journal-title":"J. Intell. Inf. Syst."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1016\/j.neucom.2015.04.102","article-title":"A semi-supervised online sequential extreme learning machine method","volume":"174","author":"Jia","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_61","first-page":"207","article-title":"A semi-supervised extreme learning machine method based on co-training","volume":"9","author":"Li","year":"2013","journal-title":"J. Comput. Inf. Syst."}],"container-title":["Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9709\/5\/4\/40\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:26:38Z","timestamp":1760196398000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9709\/5\/4\/40"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,10,28]]},"references-count":61,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2018,12]]}},"alternative-id":["informatics5040040"],"URL":"https:\/\/doi.org\/10.3390\/informatics5040040","relation":{},"ISSN":["2227-9709"],"issn-type":[{"type":"electronic","value":"2227-9709"}],"subject":[],"published":{"date-parts":[[2018,10,28]]}}}