{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T12:14:27Z","timestamp":1781093667487,"version":"3.54.1"},"reference-count":65,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2023,1,15]],"date-time":"2023-01-15T00:00:00Z","timestamp":1673740800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The use of machine learning in medical decision support systems can improve diagnostic accuracy and objectivity for clinical experts. In this study, we conducted a comparison of 16 different fuzzy rule-based algorithms applied to 12 medical datasets and real-world data. The results of this comparison showed that the best performing algorithms in terms of average results of Matthews correlation coefficient (MCC), area under the curve (AUC), and accuracy (ACC) was a classifier based on fuzzy logic and gene expression programming (GPR), repeated incremental pruning to produce error reduction (Ripper), and ordered incremental genetic algorithm (OIGA), respectively. We also analyzed the number and size of the rules generated by each algorithm and provided examples to objectively evaluate the utility of each algorithm in clinical decision support. The shortest and most interpretable rules were generated by 1R, GPR, and C45Rules-C. Our research suggests that GPR is capable of generating concise and interpretable rules while maintaining good classification performance, and it may be a valuable algorithm for generating rules from medical data.<\/jats:p>","DOI":"10.3390\/s23020992","type":"journal-article","created":{"date-parts":[[2023,1,16]],"date-time":"2023-01-16T05:30:07Z","timestamp":1673847007000},"page":"992","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Comparative Study of Fuzzy Rule-Based Classifiers for Medical Applications"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3610-1810","authenticated-orcid":false,"given":"Anna","family":"Czmil","sequence":"first","affiliation":[{"name":"The Faculty of Electrical and Computer Engineering, Rzeszow University of Technology, Powstancow Warszawy 12, 35-959 Rzeszow, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1016\/j.eswa.2005.07.022","article-title":"A multilayer perceptron-based medical decision support system for heart disease diagnosis","volume":"30","author":"Yan","year":"2006","journal-title":"Expert Syst. Appl."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1016\/j.eswa.2017.06.031","article-title":"A medical decision support system for disease diagnosis under uncertainty","volume":"88","author":"Malmir","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Casalino, G., Castellano, G., Castiello, C., Pasquadibisceglie, V., and Zaza, G. (2019). A Fuzzy Rule-Based Decision Support System for Cardiovascular Risk Assessment. Fuzzy Logic and Applications, Springer International Publishing.","DOI":"10.1007\/978-3-030-12544-8_8"},{"key":"ref_4","first-page":"329","article-title":"Who is afraid of black box algorithms? On the epistemological and ethical basis of trust in medical AI","volume":"47","author":"Jongsma","year":"2021","journal-title":"J. Med. Ethics"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"101134","DOI":"10.1016\/j.softx.2022.101134","article-title":"CACP: Classification Algorithms Comparison Pipeline","volume":"19","author":"Czmil","year":"2022","journal-title":"SoftwareX"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Grosan, C., and Abraham, A. (2011). Intelligent Systems, Intelligent Systems Reference Library, Springer.","DOI":"10.1007\/978-3-642-21004-4"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"154096","DOI":"10.1109\/ACCESS.2019.2949286","article-title":"Black-Box vs. White-Box: Understanding Their Advantages and Weaknesses From a Practical Point of View","volume":"7","year":"2019","journal-title":"IEEE Access"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"560","DOI":"10.1016\/j.ins.2021.05.041","article-title":"Extremely simple classifier based on fuzzy logic and gene expression programming","volume":"571","author":"Kluska","year":"2021","journal-title":"Inf. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"103458","DOI":"10.1016\/j.artint.2021.103458","article-title":"A review of possible effects of cognitive biases on interpretation of rule-based machine learning models","volume":"295","author":"Kliegr","year":"2021","journal-title":"Artif. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1016\/S0019-9958(65)90241-X","article-title":"Fuzzy sets","volume":"8","author":"Zadeh","year":"1965","journal-title":"Inf. Control"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., and Zurada, J.M. (2015). Selected Applications of P1-TS Fuzzy Rule-Based Systems. Lecture Notes in Computer Science, Proceedings of the International Conference on Artificial Intelligence and Soft Computing, Zakopane, Poland, 14\u201318 June 2015, Springer International Publishing.","DOI":"10.1007\/978-3-319-19369-4"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Dec, G., Dra\u0142us, G., Mazur, D., and Kwiatkowski, B. (2021). Forecasting Models of Daily Energy Generation by PV Panels Using Fuzzy Logic. Energies, 14.","DOI":"10.3390\/en14061676"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., and Zurada, J.M. (2014). The Classifier for Prediction of Peri-operative Complications in Cervical Cancer Treatment. Lecture Notes in Computer Science, Proceedings of the International Conference on Artificial Intelligence and Soft Computing, Zakopane, Poland, 14\u201318 June 2015, Springer International Publishing.","DOI":"10.1007\/978-3-319-19369-4"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Al-shami, T.M. (2022). (2, 1)-Fuzzy sets: Properties, weighted aggregated operators and their applications to multi-criteria decision-making methods. Complex Intell. Syst.","DOI":"10.1007\/s40747-022-00878-4"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1023\/A:1022631118932","article-title":"Very simple classification rules perform well on most commonly used datasets","volume":"11","author":"Holte","year":"1993","journal-title":"Mach. Learn."},{"key":"ref_16","unstructured":"Witten, I.H., Frank, E., and Hall, M.A. (2011). Data Mining: Practical Machine Learning Tools and Techniques, Morgan Kaufmann. [3rd ed.]."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1007\/BF00114779","article-title":"A Nearest Hyperrectangle Learning Method","volume":"6","author":"Salzberg","year":"1991","journal-title":"Mach. Learn."},{"key":"ref_18","unstructured":"Cohen, W. (2019). Fast Effective Rule Induction. Lecture Notes on Multidisciplinary Industrial Engineering, Proceedings of the Twelfth International Conference on Management Science and Engineering Management, Tahoe City, CA, USA, 9\u201312 July 1995, Springer."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ouyang, C.S., Lee, C.T., and Lee, S.J. (2007, January 5\u20137). An Improved Fuzzy Genetics-Based Machine Learning Algorithm for Pattern Classification. Proceedings of the Second International Conference on Innovative Computing, Information and Control (ICICIC 2007), Kumamoto, Japan.","DOI":"10.1109\/ICICIC.2007.150"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.ins.2003.03.013","article-title":"A hybrid decision tree\/genetic algorithm method for data mining","volume":"163","author":"Carvalho","year":"2004","journal-title":"Inf. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1109\/TEVC.2002.806857","article-title":"Inducing oblique decision trees with evolutionary algorithms","volume":"7","author":"Kamath","year":"2003","journal-title":"IEEE Trans. Evol. Comput."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/S0165-0114(96)00280-1","article-title":"Completeness and consistency conditions for learning fuzzy rules","volume":"96","author":"Gonzalez","year":"1998","journal-title":"Fuzzy Sets Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1109\/TSMCB.2002.805696","article-title":"Evolutionary learning of hierarchical decision rules","volume":"33","author":"Riquelme","year":"2003","journal-title":"Trans. Syst. Man Cybern.\u2014Part B Cybern."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1109\/TEVC.2005.856068","article-title":"An organizational coevolutionary algorithm for classification","volume":"10","author":"Jiao","year":"2006","journal-title":"IEEE Trans. Evol. Comput."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1239","DOI":"10.1002\/int.20046","article-title":"Ordered incremental training with genetic algorithms","volume":"19","author":"Zhu","year":"2004","journal-title":"Int. J. Intell. Syst."},{"key":"ref_26","unstructured":"Corcoran, A., and Sen, S. (1994, January 27\u201329). Using Real-Valued Genetic Algorithms to Evolve Rule Sets for Classification. Proceedings of the 1st IEEE Conference on Evolutionary Computation, Orlando, FL, USA."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Aamir, K.M., Sarfraz, L., Ramzan, M., Bilal, M., Shafi, J., and Attique, M. (2021). A Fuzzy Rule-Based System for Classification of Diabetes. Sensors, 21.","DOI":"10.3390\/s21238095"},{"key":"ref_28","unstructured":"Adeli, A., and Neshat, M. (2010, January 17\u201319). A fuzzy expert system for heart disease diagnosis. Proceedings of the International MultiConference of Engineers and Computer Scientists 2010 Vol I, Hong Kong. Available online: https:\/\/www.iaeng.org\/publication\/IMECS2010\/IMECS2010_pp134-139.pdf."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1224","DOI":"10.1111\/jep.13302","article-title":"Fuzzy logic\u2013based clinical decision support system for the evaluation of renal function in post-Transplant Patients","volume":"26","author":"Improta","year":"2019","journal-title":"J. Eval. Clin. Pract."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Rotshtein, A. (2017). Design and Tuning of Fuzzy Rule-Based Systems for Medical Diagnosis. Fuzzy and Neuro-Fuzzy Systems in {Medicine, CRC Press.","DOI":"10.1201\/9780203713419-11"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"564867","DOI":"10.1155\/2015\/564867","article-title":"Fuzzy Rule-Based Classification System for Assessing Coronary Artery Disease","volume":"2015","author":"Mohammadpour","year":"2015","journal-title":"Comput. Math. Methods Med."},{"key":"ref_32","first-page":"1004","article-title":"A fuzzy logic\u2013based warning system for patients classification","volume":"25","author":"Sagahyroon","year":"2017","journal-title":"Health Inform. J."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1109\/TSMC.1986.4308946","article-title":"Fuzzy Set Theory in Medical Diagnosis","volume":"16","author":"Adlassnig","year":"1986","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"560","DOI":"10.1007\/BF02513349","article-title":"Classification of premature ventricular complexes using filter bank features, induction of decision trees and a fuzzy rule-based system","volume":"37","author":"Wieben","year":"1999","journal-title":"Med. Biol. Eng. Comput."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1109\/TITB.2007.907985","article-title":"Automated Diagnosis of Coronary Artery Disease Based on Data Mining and Fuzzy Modeling","volume":"12","author":"Tsipouras","year":"2008","journal-title":"IEEE Trans. Inf. Technol. Biomed."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Sanz, J., Pagola, M., Bustince, H., Brugos, A., Fern\u00e1ndez, A., and Herrera, F. (2011, January 11\u201315). A case study on medical diagnosis of cardiovascular diseases using a Genetic Algorithm for Tuning Fuzzy Rule-Based Classification Systems with Interval-Valued Fuzzy Sets. Proceedings of the 2011 IEEE Symposium on Advances in Type-2 Fuzzy Logic Systems (T2FUZZ), Paris, France.","DOI":"10.1109\/T2FUZZ.2011.5949553"},{"key":"ref_37","unstructured":"Hosseini, R., Ellis, T., Mazinani, M., and Dehmeshki, J. (2011, January 5\u20139). A genetic fuzzy approach for rule extraction for rule-based classification with application to medical diagnosis. Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD), Athens, Greece."},{"key":"ref_38","first-page":"1331","article-title":"Fuzzy rule based classification for heart dataset using fuzzy decision tree algorithm based on fuzzy RDBMS","volume":"28","author":"Mala","year":"2013","journal-title":"World Appl. Sci. J."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.asoc.2013.11.009","article-title":"Medical diagnosis of cardiovascular diseases using an interval-valued fuzzy rule-based classification system","volume":"20","author":"Sanz","year":"2014","journal-title":"Appl. Soft Comput."},{"key":"ref_40","first-page":"45","article-title":"A rule-based system for automatic de-identification of medical narrative texts","volume":"39","author":"Krstev","year":"2015","journal-title":"Informatica"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Sadeghzadeh, M. (2017, January 20\u201322). A New Method for Diagnosing Breast Cancer using Firefly Algorithm and Fuzzy Rule based Classification. Proceedings of the 2017 IEEE 11th International Conference on Application of Information and Communication Technologies (AICT), Moscow, Russia.","DOI":"10.1109\/ICAICT.2017.8687061"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1016\/j.jbi.2018.02.008","article-title":"Mortality prediction in intensive care units (ICUs) using a deep rule-based fuzzy classifier","volume":"79","author":"Davoodi","year":"2018","journal-title":"J. Biomed. Inform."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"169029","DOI":"10.1109\/ACCESS.2019.2954707","article-title":"Feature Selection and Rule Generation Integrated Learning for Takagi-Sugeno-Kang Fuzzy System and its Application in Medical Data Classification","volume":"7","author":"Gu","year":"2019","journal-title":"IEEE Access"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Karthikeyan, R., Geetha, P., and Ramaraj, E. (2019, January 21\u201322). Rule Based System for Better Prediction of Diabetes. Proceedings of the 2019 3rd International Conference on Computing and Communications Technologies (ICCCT), Chennai, India.","DOI":"10.1109\/ICCCT2.2019.8824842"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Singh, N., and Singh, P. (2020). Medical Diagnosis of Coronary Artery Disease Using Fuzzy Rule-Based Classification Approach. Advances in Biomedical Engineering and Technology, Springer.","DOI":"10.1007\/978-981-15-6329-4_27"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Hossain, S., Sarma, D., Chakma, R.J., Alam, W., Hoque, M.M., and Sarker, I.H. (2020). A rule-based expert system to assess coronary artery disease under uncertainty. Communications in Computer and Information Science, Springer.","DOI":"10.1007\/978-981-15-6648-6_12"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/S0933-3657(00)00077-4","article-title":"On the use and usefulness of fuzzy sets in medical AI","volume":"21","author":"Steimann","year":"2001","journal-title":"Artif. Intell. Med."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"106943","DOI":"10.1016\/j.knosys.2021.106943","article-title":"An intelligent hybrid classification algorithm integrating fuzzy rule-based extraction and harmony search optimization: Medical diagnosis applications","volume":"220","author":"Mousavi","year":"2021","journal-title":"Knowl.-Based Syst."},{"key":"ref_49","unstructured":"Varshney, A.K., and Torra, V. (2022). Literature Review of various Fuzzy Rule based Systems. arXiv."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1299","DOI":"10.5958\/0974-360X.2016.00247.X","article-title":"Review of Fuzzy Rule Based Classification systems","volume":"9","author":"Chandrasekar","year":"2016","journal-title":"Res. J. Pharm. Technol."},{"key":"ref_51","first-page":"260","article-title":"Review of Fuzzy Systems through various jargons of technology","volume":"7","author":"Gilda","year":"2020","journal-title":"J. Emerg. Technol. Innov. Res."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1016\/j.asoc.2013.10.014","article-title":"Applications of neuro fuzzy systems: A brief review and future outline","volume":"15","author":"Kar","year":"2014","journal-title":"Appl. Soft Comput."},{"key":"ref_53","first-page":"255","article-title":"KEEL Data-Mining Software Tool: Data Set Repository, Integration of Algorithms and Experimental Analysis Framework","volume":"17","author":"Luengo","year":"2011","journal-title":"J. Multiple Valued Log. Soft Comput."},{"key":"ref_54","unstructured":"Weiss, S.M., and Kulikowski, C.A. (1991). Computer Systems That Learn: Classification and Prediction Methods From Statistics, Neural Nets, Machine Learning, and Expert Systems, Morgan Kaufmann."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Czmil, A., Czmil, S., and Mazur, D. (2019). A Method to Detect Type 1 Diabetes Based on Physical Activity Measurements Using a Mobile Device. Appl. Sci., 9.","DOI":"10.3390\/app9122555"},{"key":"ref_56","unstructured":"Czmil, A. (2023, January 12). GPR: A Python Implementation of an Extremely Simple Classifier Based on Fuzzy Logic and Gene Expression Programming (Version 1.0.0) [Computer Software], 2022. Available online: https:\/\/github.com\/czmilanna\/gpr-algorithm."},{"key":"ref_57","unstructured":"Quinlan, J. (1993). C4.5: Programs for Machine Learning, Morgan Kauffman."},{"key":"ref_58","unstructured":"Quinlan, J. (1995, January 9\u201312). MDL and Categorical Theories (Continued). Proceedings of the Twelfth International Conference on Management Science and Engineering Management, Tahoe City, CA, USA."},{"key":"ref_59","first-page":"59","article-title":"Improving the genetic algorithm of SLAVE","volume":"16","author":"Perez","year":"2009","journal-title":"Mathw. Soft Comput."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1109\/91.755399","article-title":"SLAVE: A genetic learning system based on an iterative approach","volume":"7","author":"Gonzalez","year":"1999","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_61","unstructured":"Batarseh, F.A., and Yang, R. (2020). 5\u2014Foundations of data imbalance and solutions for a data democracy. Data Democracy, Academic Press."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"5979","DOI":"10.1038\/s41598-022-09954-8","article-title":"On evaluation metrics for medical applications of artificial intelligence","volume":"12","author":"Hicks","year":"2022","journal-title":"Sci. Rep."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1109\/TKDE.2005.50","article-title":"Using AUC and accuracy in evaluating learning algorithms","volume":"17","author":"Huang","year":"2005","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1111\/j.0956-7976.2005.00782.x","article-title":"How Many Variables Can Humans Process?","volume":"16","author":"Halford","year":"2005","journal-title":"Psychol. Sci."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1109\/4235.585893","article-title":"No free lunch theorems for optimization","volume":"1","author":"Wolpert","year":"1997","journal-title":"IEEE Trans. Evol. Comput."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/2\/992\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:06:28Z","timestamp":1760119588000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/2\/992"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,15]]},"references-count":65,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["s23020992"],"URL":"https:\/\/doi.org\/10.3390\/s23020992","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,15]]}}}