{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T04:33:02Z","timestamp":1777696382807,"version":"3.51.4"},"reference-count":30,"publisher":"SAGE Publications","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IDA"],"published-print":{"date-parts":[[2023,3,15]]},"abstract":"<jats:p>Credit scoring is an important topic in financial activities and bankruptcy prediction that has been extensively explored using deep neural network (DNN) methods. DNN-based credit scoring models rely heavily on a large amount of labeled data. The accuracy of DNN-based credit assessment models relies heavily on large amounts of labeled data. However, purely data-driven learning makes it difficult to encode human intent to guide the model to capture the desired patterns and leads to low transparency of the model. Therefore, the Probabilistic Soft Logic Posterior Regularization (PSLPR) framework is proposed for integrating prior knowledge of logic rule with neural network. First, the PSLPR framework calculates the rule satisfaction distance for each instance using a probabilistic soft logic formula. Second, the logic rules are integrated into the posterior distribution of the DNN output to form a logic output. Finally, a novel discrepancy loss which measures the difference between the real label and the logic output is used to incorporate logic rules into the parameters of the neural network. Extensive experiments were conducted on two datasets, the Australian credit dataset and the credit card customer default dataset. To evaluate the obtained systems, several performance metrics were used, including PCC, Recall, F1 and AUC. The results show that compared to the standard DNN model, the four evaluation metrics are increased by 7.14%, 14.29%, 8.15%, and 5.43% respectively on the Australian credit dataset.<\/jats:p>","DOI":"10.3233\/ida-216460","type":"journal-article","created":{"date-parts":[[2023,4,7]],"date-time":"2023-04-07T11:36:40Z","timestamp":1680867400000},"page":"483-500","source":"Crossref","is-referenced-by-count":0,"title":["Integrating deep neural network with logic rules for credit scoring"],"prefix":"10.1177","volume":"27","author":[{"given":"Zhanli","family":"Li","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xinyu","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fan","family":"Deng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yun","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"key":"10.3233\/IDA-216460_ref1","doi-asserted-by":"crossref","first-page":"2998","DOI":"10.1016\/j.eswa.2014.11.028","article-title":"Genetic algorithms for credit scoring: Alternative fitness function performance comparison","volume":"46","author":"Kozeny","year":"2015","journal-title":"Expert Systems with Applications"},{"key":"10.3233\/IDA-216460_ref2","doi-asserted-by":"crossref","first-page":"5737","DOI":"10.1016\/j.eswa.2015.02.042","article-title":"Enhancing accuracy and interpretability of ensemble strategies in credit risk assessment. A correlated-adjusted decision forest proposal","volume":"42","author":"Florez-Lopez","year":"2015","journal-title":"Expert Systems with Applications"},{"key":"10.3233\/IDA-216460_ref3","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1016\/j.asoc.2015.11.037","article-title":"A multi-objective genetic optimization for fast, fuzzy rule-based credit classifization with balanced auucracy and interpretability","volume":"40","author":"Gorza\u0142czany","year":"2016","journal-title":"Applied Soft Computing"},{"key":"10.3233\/IDA-216460_ref4","doi-asserted-by":"crossref","first-page":"106263","DOI":"10.1016\/j.asoc.2020.106263","article-title":"Statistical and machine learning models in credit scoring: A systematic literature survey","volume":"91","author":"Dastile","year":"2020","journal-title":"Applied Soft Computing"},{"key":"10.3233\/IDA-216460_ref5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TKDE.2021.3079836","article-title":"Informed Machine Learning\u00a0\u2013 A Taxonomy and Survey of Integrating Knowledge into Learning Systems","volume":"99","author":"Vonrueden","year":"2021","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"10.3233\/IDA-216460_ref7","doi-asserted-by":"crossref","unstructured":"Z. Hu, X. Ma and Z. Liu, Harnessing Deep Neural Networks with Logic Rules, In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, 2016, Volume 1: Long Papers.","DOI":"10.18653\/v1\/P16-1228"},{"key":"10.3233\/IDA-216460_ref8","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.bar.2006.12.003","article-title":"Modelling corporate failure: A multinomial nested logit analysis for unordered outcomes","volume":"39","author":"Jones","year":"2007","journal-title":"The British Accounting Review"},{"key":"10.3233\/IDA-216460_ref9","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1111\/j.1540-6261.1968.tb00843.x","article-title":"Financial ratios, discriminant analysis and the prediction of corporate bankruptcy","volume":"23","author":"Altman","year":"1968","journal-title":"The Journal of Finance"},{"key":"10.3233\/IDA-216460_ref10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10462-015-9434-x","article-title":"Financial credit risk assessment: a recent review","volume":"45","author":"Chen","year":"2016","journal-title":"Artificial Intelligence Review"},{"key":"10.3233\/IDA-216460_ref11","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1016\/j.eswa.2006.07.007","article-title":"Credit scoring with a data mining approach based on support vector machines","volume":"33","author":"Huang","year":"2007","journal-title":"Expert systems with applications"},{"key":"10.3233\/IDA-216460_ref12","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1007\/s10257-021-00511-w","article-title":"A decision tree classifier for credit assessment problems in big data environments","volume":"19","author":"Chern","year":"2021","journal-title":"Information Systems and e-Business Management"},{"key":"10.3233\/IDA-216460_ref13","doi-asserted-by":"crossref","first-page":"1503","DOI":"10.1007\/s41870-020-00430-y","article-title":"Comparison and analysis of logistic regression, Na\u00c3\u00afve Bayes and KNN machine learning algorithms for credit card fraud detection","volume":"13","author":"Itoo","year":"2021","journal-title":"International Journal of Information Technology"},{"key":"10.3233\/IDA-216460_ref14","doi-asserted-by":"crossref","first-page":"113872","DOI":"10.1016\/j.eswa.2020.113872","article-title":"A novel multi-stage ensemble model with enhanced outlier adaptation for credit scoring","volume":"165","author":"Zhang","year":"2021","journal-title":"Expert Systems with Applications"},{"key":"10.3233\/IDA-216460_ref15","doi-asserted-by":"crossref","unstructured":"V.E. Neagoe, A.D. Ciotec and G.S. Cucu, Deep convolutional neural networks versus multilayer perceptron for financial prediction, In 2018 International Conference on Communications (COMM), 2018, pp.\u00a0201\u2013206.","DOI":"10.1109\/ICComm.2018.8453730"},{"key":"10.3233\/IDA-216460_ref16","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1016\/j.eswa.2018.02.029","article-title":"Predicting mortgage default using convolutional neural networks","volume":"102","author":"Kvamme","year":"2018","journal-title":"Expert Systems with Applications"},{"key":"10.3233\/IDA-216460_ref17","doi-asserted-by":"crossref","first-page":"50426","DOI":"10.1109\/ACCESS.2021.3068854","article-title":"Making Deep Learning-Based Predictions for Credit Scoring Explainable","volume":"9","author":"Datile","year":"2021","journal-title":"IEEE Access"},{"key":"10.3233\/IDA-216460_ref18","doi-asserted-by":"crossref","unstructured":"W. Samek, G. Montavon, A. Vedaldi, L.K. Hansen and K.R. Muller, Explainable AI: interpreting, explaining and visualizing deep learning, Lecture Notes in Computer Science, 2019.","DOI":"10.1007\/978-3-030-28954-6"},{"key":"10.3233\/IDA-216460_ref19","doi-asserted-by":"crossref","unstructured":"R.R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh and D. Batra, Grad-cam: Visual explanations from deep networks via gradient-based localization, In Proceedings of the IEEE international conference on computer vision, 2017, pp.\u00a0618\u2013626.","DOI":"10.1109\/ICCV.2017.74"},{"key":"10.3233\/IDA-216460_ref20","doi-asserted-by":"crossref","unstructured":"M.T. Ribeiro, S. Singh and C. Guestrin, \u201cWhy should i trust you?\u201d Explaining the predictions of any classifier, In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, 2016, pp.\u00a01135\u20131144.","DOI":"10.1145\/2939672.2939778"},{"key":"10.3233\/IDA-216460_ref21","doi-asserted-by":"crossref","first-page":"576","DOI":"10.1007\/s10696-015-9226-2","article-title":"A novel multistage deep belief network based extreme learning machine ensemble learning paradigm for credit risk assessment","volume":"28","author":"Yu","year":"2016","journal-title":"Flexible Services and Manufacturing Journal"},{"key":"10.3233\/IDA-216460_ref22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40537-021-00461-7","article-title":"Modelling customers credit card behaviour using bidirectional LSTM neural networks","volume":"8","author":"Ala\u2019raj","year":"2021","journal-title":"Journal of Big Data"},{"key":"10.3233\/IDA-216460_ref23","first-page":"5502","article-title":"A semantic loss function for deep learning with symbolic knowledge","author":"Xu","year":"2018","journal-title":"International Conference on Machine Learning"},{"key":"10.3233\/IDA-216460_ref24","first-page":"1931","article-title":"DL2: training and querying neural networks with logic","author":"Fischer","year":"2019","journal-title":"International Conference on Machine Learning"},{"key":"10.3233\/IDA-216460_ref25","doi-asserted-by":"crossref","unstructured":"Y. Zhou, Y. Yan, R. Han, J.H. Caufield, KW. Chang, Y. Sun, P. Ping and W. Wang, Clinical Temporal Relation Extraction with Probabilistic Soft Logic Regularization and Global Inference, In Proceedings of the AAAI Conference on Artificial Intelligence, 2021, pp.\u00a014647\u201314655.","DOI":"10.1609\/aaai.v35i16.17721"},{"key":"10.3233\/IDA-216460_ref26","doi-asserted-by":"crossref","unstructured":"H.B. Enderton, A mathematical introduction to logic, Elsevier, 2001.","DOI":"10.1016\/B978-0-08-049646-7.50005-9"},{"key":"10.3233\/IDA-216460_ref27","first-page":"38","article-title":"Distilling the Knowledge in a Neural Network","volume":"14","author":"Hinton","year":"2015","journal-title":"Computer Science"},{"key":"10.3233\/IDA-216460_ref28","first-page":"2001","article-title":"Posterior regularization for structured latent variable models","volume":"11","author":"Ganchev","year":"2010","journal-title":"The Journal of Machine Learning Research"},{"key":"10.3233\/IDA-216460_ref29","doi-asserted-by":"crossref","unstructured":"K. Krishna, P. Jyothi and M. Iyyer, Revisiting the importance of encoding logic rules in sentiment classification, In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, 2018, pp.\u00a04743\u20134751.","DOI":"10.18653\/v1\/D18-1505"},{"key":"10.3233\/IDA-216460_ref30","unstructured":"A. Kimmig, S. Bach, M. Broecheler, B. Huang and L. Getoor, A short introduction to probabilistic soft logic, In Proceedings of the NIPS Workshop on Probabilistic Programming: Foundations and Applications, 2012, pp.\u00a01\u20134."},{"key":"10.3233\/IDA-216460_ref31","unstructured":"T.L. Kampfer, Performance and Interpretability of Machine Learning Algorithms for Credit Risk Modelling, Ph.D. Dissertation, Ludwig-Maximilians-University Munich, 2018."}],"container-title":["Intelligent Data Analysis"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/IDA-216460","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:19:58Z","timestamp":1777454398000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/IDA-216460"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,15]]},"references-count":30,"journal-issue":{"issue":"2"},"URL":"https:\/\/doi.org\/10.3233\/ida-216460","relation":{},"ISSN":["1088-467X","1571-4128"],"issn-type":[{"value":"1088-467X","type":"print"},{"value":"1571-4128","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,15]]}}}