{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T05:18:01Z","timestamp":1780636681341,"version":"3.54.1"},"reference-count":72,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,6,2]],"date-time":"2023-06-02T00:00:00Z","timestamp":1685664000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,6,2]],"date-time":"2023-06-02T00:00:00Z","timestamp":1685664000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004281","name":"Narodowe Centrum Nauki","doi-asserted-by":"publisher","award":["2019\/35\/D\/HS4\/02466"],"award-info":[{"award-number":["2019\/35\/D\/HS4\/02466"]}],"id":[{"id":"10.13039\/501100004281","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Big Data"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The main dilemma in the case of classification tasks is to find\u2014from among many combinations of methods, techniques and values of their parameters\u2014such a structure of the classifier model that could achieve the best accuracy and efficiency. The aim of the article is to develop and practically verify a framework for multi-criteria evaluation of classification models for the purposes of credit scoring. The framework is based on the Multi-Criteria Decision Making (MCDM) method called PROSA (PROMETHEE for Sustainability Analysis), which brought added value to the modelling process, allowing the assessment of classifiers to include the consistency of the results obtained on the training set and the validation set, and the consistency of the classification results obtained for the data acquired in different time periods. The study considered two aggregation scenarios of TSC (Time periods, Sub-criteria, Criteria) and SCT (Sub-criteria, Criteria, Time periods), in which very similar results were obtained for the evaluation of classification models. The leading positions in the ranking were taken by borrower classification models using logistic regression and a small number of predictive variables. The obtained rankings were compared to the assessments of the expert team, which turned out to be very similar.<\/jats:p>","DOI":"10.1186\/s40537-023-00768-7","type":"journal-article","created":{"date-parts":[[2023,6,2]],"date-time":"2023-06-02T13:02:42Z","timestamp":1685710962000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Framework for multi-criteria assessment of classification models for the purposes of credit scoring"],"prefix":"10.1186","volume":"10","author":[{"given":"Pawe\u0142","family":"Ziemba","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jaros\u0142aw","family":"Becker","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aneta","family":"Becker","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aleksandra","family":"Radomska-Zalas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,6,2]]},"reference":[{"key":"768_CR1","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1016\/j.insmatheco.2022.01.008","volume":"104","author":"J Yin","year":"2022","unstructured":"Yin J, Han B, Wong HY. COVID-19 and credit risk: A long memory perspective. Insur Math Econ. 2022;104:15\u201334.","journal-title":"Insur Math Econ"},{"key":"768_CR2","doi-asserted-by":"publisher","first-page":"103005","DOI":"10.1016\/j.frl.2022.103005","volume":"48","author":"LTM Nguyen","year":"2022","unstructured":"Nguyen LTM, Luu HN, Nguyen TTP. The impact of interest rate policy on credit union lending during a crisis period. Financ Res Lett. 2022;48:103005.","journal-title":"Financ Res Lett"},{"key":"768_CR3","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1016\/j.cam.2017.04.036","volume":"329","author":"D Wang","year":"2018","unstructured":"Wang D, Zhang Z, Bai R, Mao Y. A hybrid system with filter approach and multiple population genetic algorithm for feature selection in credit scoring. J Comput Appl Math. 2018;329:307\u201321.","journal-title":"J Comput Appl Math"},{"key":"768_CR4","doi-asserted-by":"publisher","first-page":"1168","DOI":"10.1016\/j.procs.2022.01.148","volume":"199","author":"Y Hu","year":"2022","unstructured":"Hu Y, Su J. Research on credit risk evaluation of commercial banks based on artificial neural network model. Proced Comput Sci. 2022;199:1168\u201376.","journal-title":"Proced Comput Sci"},{"key":"768_CR5","doi-asserted-by":"publisher","first-page":"106058","DOI":"10.1016\/j.jeconbus.2022.106058","volume":"120","author":"JP Hughes","year":"2022","unstructured":"Hughes JP, Moon C-G. How bad is a bad loan? Distinguishing inherent credit risk from inefficient lending (Does the capital market price this difference?). J Econ Bus. 2022;120:106058.","journal-title":"J Econ Bus"},{"key":"768_CR6","doi-asserted-by":"publisher","first-page":"254","DOI":"10.1016\/j.procs.2019.09.049","volume":"158","author":"A Tun\u00e7","year":"2019","unstructured":"Tun\u00e7 A. Feature selection in credibility study for finance sector. Proced Comput Sci. 2019;158:254\u20139.","journal-title":"Proced Comput Sci"},{"key":"768_CR7","doi-asserted-by":"publisher","first-page":"3301","DOI":"10.1016\/j.procs.2020.09.068","volume":"176","author":"P Ziemba","year":"2020","unstructured":"Ziemba P, Radomska-Zalas A, Becker J. Client evaluation decision models in the credit scoring tasks. Proced Comput Sci. 2020;176:3301\u20139.","journal-title":"Proced Comput Sci"},{"key":"768_CR8","first-page":"117","volume":"21","author":"F Louzada","year":"2016","unstructured":"Louzada F, Ara A, Fernandes GB. Classification methods applied to credit scoring: systematic review and overall comparison. Surv Oper Res Manag Sci. 2016;21:117\u201334.","journal-title":"Surv Oper Res Manag Sci"},{"key":"768_CR9","doi-asserted-by":"publisher","first-page":"2099","DOI":"10.3390\/electronics10172099","volume":"10","author":"P Ziemba","year":"2021","unstructured":"Ziemba P, Becker J, Becker A, Radomska-Zalas A, Pawluk M, Wierzba D. Credit decision support based on real set of cash loans using integrated machine learning algorithms. Electronics. 2021;10:2099.","journal-title":"Electronics"},{"key":"768_CR10","first-page":"65","volume-title":"Advances in computers","author":"JR Rice","year":"1976","unstructured":"Rice JR. The algorithm selection problem **This work was partially supported by the National Science Foundation through Grant GP-32940X. This chapter was presented as the George E. Forsythe Memorial Lecture at the Computer Science Conference, February 19, 1975, Washington, D. C. In: Rubinoff M, Yovits MC, editors. Advances in computers. Amsterdam: Elsevier; 1976. p. 65\u2013118."},{"key":"768_CR11","unstructured":"Wolpert DH, Macready WG. No free lunch theorems for search. Santa Fe Institute. 1995. https:\/\/econpapers.repec.org\/paper\/wopsafiwp\/95-02-010.htm. Accessed 20 Apr 2023."},{"key":"768_CR12","doi-asserted-by":"publisher","first-page":"168","DOI":"10.1016\/j.aci.2018.08.003","volume":"17","author":"A Tharwat","year":"2020","unstructured":"Tharwat A. Classification assessment methods. Appl Comput Inform. 2020;17:168\u201392.","journal-title":"Appl Comput Inform"},{"key":"768_CR13","first-page":"2","volume":"30","author":"A Kaur","year":"2018","unstructured":"Kaur A, Kaur I. An empirical evaluation of classification algorithms for fault prediction in open source projects. J King Saud Univ Comput Inform Sci. 2018;30:2\u201317.","journal-title":"J King Saud Univ Comput Inform Sci"},{"key":"768_CR14","doi-asserted-by":"crossref","unstructured":"Sharma S, Mittal V, Srivastava R, Singh SK. Empirical evaluation of various classification methods. In: 2020 2nd International Conference on Advances in Computing, Communication Control and Networking (ICACCCN). 2020. pp. 105\u20139.","DOI":"10.1109\/ICACCCN51052.2020.9362773"},{"key":"768_CR15","unstructured":"Berrer H, Paterson I, Keller J. Evaluation of Machine-Learning Algorithm Ranking Advisors. In: Proceedings of the PKDD-2000 Workshop on DataMining, Decision Support, Meta-Learning and ILP: Forum for Practical Problem Presentation and Prospective Solutions. 2000."},{"key":"768_CR16","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/j.ins.2010.04.019","volume":"191","author":"Y Peng","year":"2012","unstructured":"Peng Y, Wang G, Wang H. User preferences based software defect detection algorithms selection using MCDM. Inf Sci. 2012;191:3\u201313.","journal-title":"Inf Sci"},{"key":"768_CR17","doi-asserted-by":"publisher","first-page":"118912","DOI":"10.1016\/j.eswa.2022.118912","volume":"213","author":"S Boeschoten","year":"2023","unstructured":"Boeschoten S, Catal C, Tekinerdogan B, Lommen A, Blokland M. The automation of the development of classification models and improvement of model quality using feature engineering techniques. Expert Syst Appl. 2023;213:118912.","journal-title":"Expert Syst Appl"},{"key":"768_CR18","doi-asserted-by":"crossref","unstructured":"de Moura Rezende dos Santos F, Guedes de Oliveira Almeida F, Pereira Rocha Martins AC, Bittencourt Reis AC, Holanda M. Ranking machine learning classifiers using multicriteria approach. In: 2018 11th International Conference on the Quality of Information and Communications Technology (QUATIC). 2018. pp. 168\u201374.","DOI":"10.1109\/QUATIC.2018.00034"},{"key":"768_CR19","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1007\/s40070-013-0004-7","volume":"1","author":"B Roy","year":"2013","unstructured":"Roy B, S\u0142owi\u0144ski R. Questions guiding the choice of a multicriteria decision aiding method. EURO J Decis Process. 2013;1:69\u201397.","journal-title":"EURO J Decis Process"},{"key":"768_CR20","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1080\/009083190881607","volume":"1","author":"H Polatidis","year":"2006","unstructured":"Polatidis H, Haralambopoulos DA, Munda G, Vreeker R. Selecting an appropriate multi-criteria decision analysis technique for renewable energy planning. Energy Sour Part B. 2006;1:181\u201393.","journal-title":"Energy Sour Part B"},{"key":"768_CR21","doi-asserted-by":"publisher","first-page":"1584","DOI":"10.1016\/j.rser.2005.11.005","volume":"11","author":"E L\u00f8ken","year":"2007","unstructured":"L\u00f8ken E. Use of multicriteria decision analysis methods for energy planning problems. Renew Sustain Energy Rev. 2007;11:1584\u201395.","journal-title":"Renew Sustain Energy Rev"},{"key":"768_CR22","doi-asserted-by":"publisher","first-page":"527","DOI":"10.1287\/isre.1080.0198","volume":"20","author":"U Kayande","year":"2009","unstructured":"Kayande U, De Bruyn A, Lilien GL, Rangaswamy A, van Bruggen GH. How incorporating feedback mechanisms in a DSS affects DSS evaluations. Inform Syst Res. 2009;20:527\u201346.","journal-title":"Inform Syst Res"},{"key":"768_CR23","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1287\/mnsc.42.1.51","volume":"42","author":"SJ Hoch","year":"1996","unstructured":"Hoch SJ, Schkade DA. A psychological approach to decision support systems. Manag Sci. 1996;42:51\u201364.","journal-title":"Manag Sci"},{"key":"768_CR24","doi-asserted-by":"publisher","first-page":"816","DOI":"10.1016\/j.ejor.2015.08.039","volume":"249","author":"J Luoma","year":"2016","unstructured":"Luoma J. Model-based organizational decision making: a behavioral lens. Eur J Oper Res. 2016;249:816\u201326.","journal-title":"Eur J Oper Res"},{"key":"768_CR25","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1007\/s41664-018-0068-2","volume":"2","author":"Y Xu","year":"2018","unstructured":"Xu Y, Goodacre R. On splitting training and validation set: a comparative study of cross-validation, bootstrap and systematic sampling for estimating the generalization performance of supervised learning. J Anal Test. 2018;2:249\u201362.","journal-title":"J Anal Test"},{"key":"768_CR26","doi-asserted-by":"publisher","first-page":"377","DOI":"10.1016\/j.csda.2012.07.007","volume":"57","author":"V Hofer","year":"2013","unstructured":"Hofer V, Krempl G. Drift mining in data: a framework for addressing drift in classification. Comput Stat Data Anal. 2013;57:377\u201391.","journal-title":"Comput Stat Data Anal"},{"key":"768_CR27","first-page":"100070","volume":"2","author":"Z Young","year":"2022","unstructured":"Young Z, Steele R. Empirical evaluation of performance degradation of machine learning-based predictive models\u2014a case study in healthcare information systems. Int J Inform Manag Data Insights. 2022;2:100070.","journal-title":"Int J Inform Manag Data Insights"},{"key":"768_CR28","doi-asserted-by":"publisher","first-page":"11654","DOI":"10.1038\/s41598-022-15245-z","volume":"12","author":"D Vela","year":"2022","unstructured":"Vela D, Sharp A, Zhang R, Nguyen T, Hoang A, Pianykh OS. Temporal quality degradation in AI models. Sci Rep. 2022;12:11654.","journal-title":"Sci Rep"},{"key":"768_CR29","doi-asserted-by":"publisher","first-page":"1555","DOI":"10.3390\/su11061555","volume":"11","author":"P Ziemba","year":"2019","unstructured":"Ziemba P. Towards strong sustainability management\u2014a generalized PROSA method. Sustainability. 2019;11:1555.","journal-title":"Sustainability"},{"key":"768_CR30","doi-asserted-by":"publisher","first-page":"892","DOI":"10.1007\/s10489-015-0689-3","volume":"43","author":"G Wang","year":"2015","unstructured":"Wang G, Song Q, Zhu X. An improved data characterization method and its application in classification algorithm recommendation. Appl Intell. 2015;43:892\u2013912.","journal-title":"Appl Intell"},{"key":"768_CR31","doi-asserted-by":"publisher","first-page":"10262","DOI":"10.1109\/ACCESS.2020.2964726","volume":"8","author":"I Khan","year":"2020","unstructured":"Khan I, Zhang X, Rehman M, Ali R. A literature survey and empirical study of meta-learning for classifier selection. IEEE Access. 2020;8:10262\u201381.","journal-title":"IEEE Access"},{"key":"768_CR32","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1080\/01605682.2021.1922098","volume":"73","author":"M B\u00fccker","year":"2022","unstructured":"B\u00fccker M, Szepannek G, Gosiewska A, Biecek P. Transparency, auditability, and explainability of machine learning models in credit scoring. J Oper Res Soc. 2022;73:70\u201390.","journal-title":"J Oper Res Soc"},{"key":"768_CR33","doi-asserted-by":"publisher","first-page":"106263","DOI":"10.1016\/j.asoc.2020.106263","volume":"91","author":"X Dastile","year":"2020","unstructured":"Dastile X, Celik T, Potsane M. Statistical and machine learning models in credit scoring: a systematic literature survey. Appl Soft Comput. 2020;91:106263.","journal-title":"Appl Soft Comput"},{"key":"768_CR34","doi-asserted-by":"publisher","first-page":"101413","DOI":"10.1016\/j.techsoc.2020.101413","volume":"63","author":"SK Trivedi","year":"2020","unstructured":"Trivedi SK. A study on credit scoring modeling with different feature selection and machine learning approaches. Technol Soc. 2020;63:101413.","journal-title":"Technol Soc"},{"key":"768_CR35","doi-asserted-by":"publisher","first-page":"9809","DOI":"10.1007\/s00521-019-04537-7","volume":"32","author":"G Teles","year":"2020","unstructured":"Teles G, Rodrigues JJPC, Saleem K, Kozlov S, Rab\u00ealo RAL. Machine learning and decision support system on credit scoring. Neural Comput Appl. 2020;32:9809\u201326.","journal-title":"Neural Comput Appl"},{"key":"768_CR36","doi-asserted-by":"publisher","DOI":"10.16925\/2357-6014.2020.01.11","author":"MR Kumar","year":"2020","unstructured":"Kumar MR, Gunjan VK. Review of machine learning models for credit scoring analysis. Ingenier\u00eda Solidaria. 2020. https:\/\/doi.org\/10.16925\/2357-6014.2020.01.11.","journal-title":"Ingenier\u00eda Solidaria"},{"key":"768_CR37","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2008.01687","author":"AR Provenzano","year":"2020","unstructured":"Provenzano AR, Trifir\u00f2 D, Datteo A, Giada L, Jean N, Riciputi A, et al. Machine learning approach for credit scoring. arXiv. 2020. https:\/\/doi.org\/10.48550\/arXiv.2008.01687.","journal-title":"arXiv"},{"key":"768_CR38","doi-asserted-by":"publisher","first-page":"1","DOI":"10.31181\/jdaic10017022023p","volume":"3","author":"A Pu\u0161ka","year":"2023","unstructured":"Pu\u0161ka A, \u0160tili\u0107 A, Stojanovi\u0107 I. Approach for multi-criteria ranking of Balkan countries based on the index of economic freedom. J Decis Anal Intell Comput. 2023;3:1\u201314.","journal-title":"J Decis Anal Intell Comput"},{"key":"768_CR39","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1007\/978-3-319-05864-1_4","volume-title":"Multicriteria analysis in finance","author":"M Doumpos","year":"2014","unstructured":"Doumpos M, Zopounidis C. Credit scoring. In: Doumpos M, Zopounidis C, editors. Multicriteria analysis in finance. Cham: Springer International Publishing; 2014. p. 43\u201359."},{"key":"768_CR40","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1080\/13504509.2021.1935360","volume":"29","author":"PK Roy","year":"2022","unstructured":"Roy PK, Shaw K. Modelling a sustainable credit score system (SCSS) using BWM and fuzzy TOPSIS. Int J Sustain Dev World Ecol. 2022;29:195\u2013208.","journal-title":"Int J Sustain Dev World Ecol"},{"key":"768_CR41","doi-asserted-by":"publisher","first-page":"379","DOI":"10.31181\/dmame0306102022c","volume":"6","author":"R Chaurasiya","year":"2023","unstructured":"Chaurasiya R, Jain D. Hybrid MCDM method on pythagorean fuzzy set and its application. Decis Mak Appl Manag Eng. 2023;6:379\u201398.","journal-title":"Decis Mak Appl Manag Eng"},{"key":"768_CR42","first-page":"319","volume":"3","author":"A Kalousis","year":"1999","unstructured":"Kalousis A, Theoharis T. NOEMON: design, implementation and performance results of an intelligent assistant for classifier selection. Intell Data Anal. 1999;3:319\u201337.","journal-title":"Intell Data Anal"},{"key":"768_CR43","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1007\/BF00993475","volume":"20","author":"CE Brodley","year":"1995","unstructured":"Brodley CE. Recursive automatic bias selection for classifier construction. Mach Learn. 1995;20:63\u201394.","journal-title":"Mach Learn"},{"key":"768_CR44","doi-asserted-by":"publisher","first-page":"e94137","DOI":"10.1371\/journal.pone.0094137","volume":"9","author":"DR Amancio","year":"2014","unstructured":"Amancio DR, Comin CH, Casanova D, Travieso G, Bruno OM, Rodrigues FA, et al. A systematic comparison of supervised classifiers. PLoS ONE. 2014;9:e94137.","journal-title":"PLoS ONE"},{"key":"768_CR45","doi-asserted-by":"publisher","first-page":"112206","DOI":"10.1016\/j.rse.2020.112206","volume":"253","author":"Y Wu","year":"2021","unstructured":"Wu Y, Duguay CR, Xu L. Assessment of machine learning classifiers for global lake ice cover mapping from MODIS TOA reflectance data. Remote Sens Environ. 2021;253:112206.","journal-title":"Remote Sens Environ"},{"key":"768_CR46","doi-asserted-by":"publisher","first-page":"1135","DOI":"10.3390\/rs12071135","volume":"12","author":"S Talukdar","year":"2020","unstructured":"Talukdar S, Singha P, Mahato S, Shahfahad PS, Liou Y-A, et al. Land-use land-cover classification by machine learning classifiers for satellite observations\u2014a review. Remote Sens. 2020;12:1135.","journal-title":"Remote Sens"},{"key":"768_CR47","doi-asserted-by":"publisher","first-page":"316","DOI":"10.1016\/j.asr.2020.10.013","volume":"67","author":"J Roy","year":"2021","unstructured":"Roy J, Saha S. Integration of artificial intelligence with meta classifiers for the gully erosion susceptibility assessment in Hinglo river basin, Eastern India. Adv Space Res. 2021;67:316\u201333.","journal-title":"Adv Space Res"},{"key":"768_CR48","doi-asserted-by":"publisher","first-page":"599","DOI":"10.1016\/j.cie.2016.06.004","volume":"101","author":"H Kartal","year":"2016","unstructured":"Kartal H, Oztekin A, Gunasekaran A, Cebi F. An integrated decision analytic framework of machine learning with multi-criteria decision making for multi-attribute inventory classification. Comput Ind Eng. 2016;101:599\u2013613.","journal-title":"Comput Ind Eng"},{"key":"768_CR49","doi-asserted-by":"crossref","unstructured":"T\u00fcys\u00fczo\u011flu G, Yaslan Y. Biomedical data classification using supervised classifiers and ensemble based dictionaries. In: 2017 25th Signal Processing and Communications Applications Conference (SIU). 2017. pp. 1\u20134.","DOI":"10.1109\/SIU.2017.7960347"},{"key":"768_CR50","doi-asserted-by":"publisher","DOI":"10.1007\/s11277-022-09467-7","author":"NK Chauhan","year":"2022","unstructured":"Chauhan NK, Singh K. Performance assessment of machine learning classifiers using selective feature approaches for cervical cancer detection. Wireless Pers Commun. 2022. https:\/\/doi.org\/10.1007\/s11277-022-09467-7.","journal-title":"Wireless Pers Commun"},{"key":"768_CR51","doi-asserted-by":"crossref","unstructured":"Chand N, Mishra P, Krishna CR, Pilli ES, Govil MC. A comparative analysis of SVM and its stacking with other classification algorithm for intrusion detection. In: 2016 International Conference on Advances in Computing, Communication, Automation (ICACCA) (Spring). 2016. pp. 1\u20136.","DOI":"10.1109\/ICACCA.2016.7578859"},{"key":"768_CR52","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2002.06532","author":"D Ji","year":"2021","unstructured":"Ji D, Logan RL IV, Smyth P, Steyvers M. Active Bayesian assessment for black-box classifiers. arXiv. 2021. https:\/\/doi.org\/10.48550\/arXiv.2002.06532.","journal-title":"arXiv"},{"key":"768_CR53","doi-asserted-by":"publisher","first-page":"202","DOI":"10.1016\/j.neucom.2017.03.063","volume":"249","author":"S Gu","year":"2017","unstructured":"Gu S, Jin Y. Multi-train: a semi-supervised heterogeneous ensemble classifier. Neurocomputing. 2017;249:202\u201311.","journal-title":"Neurocomputing"},{"key":"768_CR54","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1142\/S0219622012500095","volume":"11","author":"G Kou","year":"2012","unstructured":"Kou G, Lu Y, Peng Y, Shi Y. Evaluation of classification algorithms using MCDM and rank correlation. Int J Info Tech Dec Mak. 2012;11:197\u2013225.","journal-title":"Int J Info Tech Dec Mak"},{"key":"768_CR55","unstructured":"Awodele O, Kasali F, Akinsola JET, Kuyoro S. Performance evaluation of supervised machine learning algorithms using multi-criteria decision making techniques. In: 2020 International Conference on Information Technology in Education and Development (ITED). 2020. pp. 17\u201334."},{"key":"768_CR56","doi-asserted-by":"publisher","first-page":"690","DOI":"10.3390\/math9060690","volume":"9","author":"R Panigrahi","year":"2021","unstructured":"Panigrahi R, Borah S, Bhoi AK, Ijaz MF, Pramanik M, Jhaveri RH, et al. Performance assessment of supervised classifiers for designing intrusion detection systems: a comprehensive review and recommendations for future research. Mathematics. 2021;9:690.","journal-title":"Mathematics"},{"key":"768_CR57","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1016\/j.eswa.2016.11.034","volume":"71","author":"R Ali","year":"2017","unstructured":"Ali R, Lee S, Chung TC. Accurate multi-criteria decision making methodology for recommending machine learning algorithm. Expert Syst Appl. 2017;71:257\u201378.","journal-title":"Expert Syst Appl"},{"key":"768_CR58","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1016\/j.procs.2015.03.182","volume":"47","author":"JP Kandhasamy","year":"2015","unstructured":"Kandhasamy JP, Balamurali S. Performance analysis of classifier models to predict diabetes mellitus. Proced Comput Sci. 2015;47:45\u201351.","journal-title":"Proced Comput Sci"},{"key":"768_CR59","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1016\/j.knosys.2018.07.015","volume":"159","author":"X Zhu","year":"2018","unstructured":"Zhu X, Yang X, Ying C, Wang G. A new classification algorithm recommendation method based on link prediction. Knowl-Based Syst. 2018;159:171\u201385.","journal-title":"Knowl-Based Syst"},{"key":"768_CR60","doi-asserted-by":"publisher","first-page":"2038","DOI":"10.1016\/j.patcog.2006.12.019","volume":"40","author":"M-L Zhang","year":"2007","unstructured":"Zhang M-L, Zhou Z-H. ML-KNN: a lazy learning approach to multi-label learning. Pattern Recogn. 2007;40:2038\u201348.","journal-title":"Pattern Recogn"},{"key":"768_CR61","unstructured":"IPA\u2014BD Polska. 2021. https:\/\/bdpolska.com\/produkt\/inteligentna-platforma-analityczna\/. Accessed 19 Apr 2023."},{"key":"768_CR62","unstructured":"O nas\u2014BD Polska. 2021. https:\/\/bdpolska.com\/o-nas\/. Accessed 20 Apr 2023."},{"key":"768_CR63","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1613\/jair.953","volume":"16","author":"NV Chawla","year":"2002","unstructured":"Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP. SMOTE: synthetic minority over-sampling technique. Jf Artif Intell Res. 2002;16:321\u201357.","journal-title":"Jf Artif Intell Res"},{"key":"768_CR64","doi-asserted-by":"publisher","first-page":"126595","DOI":"10.1109\/ACCESS.2021.3112573","volume":"9","author":"P Ziemba","year":"2021","unstructured":"Ziemba P. Multi-criteria group assessment of E-commerce websites based on the new PROSA GDSS method\u2014the case of Poland. IEEE Access. 2021;9:126595\u2013609.","journal-title":"IEEE Access"},{"key":"768_CR65","doi-asserted-by":"publisher","first-page":"5048","DOI":"10.3390\/en15145048","volume":"15","author":"P Ziemba","year":"2022","unstructured":"Ziemba P, Gago I. Compromise multi-criteria selection of E-scooters for the vehicle sharing system in Poland. Energies. 2022;15:5048.","journal-title":"Energies"},{"key":"768_CR66","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1007\/978-1-4939-3094-4_6","volume-title":"Multiple criteria decision analysis: state of the art surveys","author":"J-P Brans","year":"2016","unstructured":"Brans J-P, De Smet Y. PROMETHEE Methods. In: Greco S, Ehrgott M, Figueira JR, editors. Multiple criteria decision analysis: state of the art surveys. New York: Springer; 2016. p. 187\u2013219. https:\/\/doi.org\/10.1007\/978-1-4939-3094-4_6."},{"key":"768_CR67","doi-asserted-by":"publisher","first-page":"6299","DOI":"10.3390\/en13236299","volume":"13","author":"P Ziemba","year":"2020","unstructured":"Ziemba P. Multi-criteria stochastic selection of electric vehicles for the sustainable development of local government and state administration units in Poland. Energies. 2020;13:6299.","journal-title":"Energies"},{"key":"768_CR68","first-page":"28","volume":"2","author":"SC Deshmukh","year":"2013","unstructured":"Deshmukh SC. Preference ranking organization method of enrichment evaluation (promethee). Int J Eng Sci Invent. 2013;2:28\u201334.","journal-title":"Int J Eng Sci Invent"},{"key":"768_CR69","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1007\/BF00134132","volume":"31","author":"B Roy","year":"1991","unstructured":"Roy B. The outranking approach and the foundations of electre methods. Theor Decis. 1991;31:49\u201373.","journal-title":"Theor Decis"},{"key":"768_CR70","unstructured":"MacCrimmon KR. Decision making among multiple-attribute alternatives: a survey and consolidated approach. 1968 Dec. Report No.: RM-4823-ARPA."},{"key":"768_CR71","volume-title":"Multiple attribute decision making: methods and applications: a state-of-the-art survey","author":"C-L Hwang","year":"1981","unstructured":"Hwang C-L, Yoon K. Multiple attribute decision making: methods and applications: a state-of-the-art survey. Berlin Heidelberg: Springer-Verlag; 1981."},{"key":"768_CR72","doi-asserted-by":"publisher","first-page":"204","DOI":"10.3390\/sym12020204","volume":"12","author":"P Ziemba","year":"2020","unstructured":"Ziemba P, Becker A, Becker J. A consensus measure of expert judgment in the fuzzy TOPSIS method. Symmetry. 2020;12:204.","journal-title":"Symmetry"}],"container-title":["Journal of Big Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-023-00768-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s40537-023-00768-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-023-00768-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,2]],"date-time":"2023-06-02T14:05:47Z","timestamp":1685714747000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofbigdata.springeropen.com\/articles\/10.1186\/s40537-023-00768-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,2]]},"references-count":72,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["768"],"URL":"https:\/\/doi.org\/10.1186\/s40537-023-00768-7","relation":{},"ISSN":["2196-1115"],"issn-type":[{"value":"2196-1115","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,2]]},"assertion":[{"value":"25 August 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 May 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 June 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"94"}}