{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:52:43Z","timestamp":1760143963690,"version":"build-2065373602"},"reference-count":74,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2024,3,5]],"date-time":"2024-03-05T00:00:00Z","timestamp":1709596800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Polish National Centre for Research and Development","award":["POIR.01.01.01-00-1157\/19-02"],"award-info":[{"award-number":["POIR.01.01.01-00-1157\/19-02"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MAKE"],"abstract":"<jats:p>Most rule induction algorithms generate rules with simple logical conditions based on equality or inequality relations. This feature limits their ability to discover complex dependencies that may exist in data. This article presents an extension to the sequential covering rule induction algorithm that allows it to generate complex and M-of-N conditions within the premises of rules. The proposed methodology uncovers complex patterns in data that are not adequately expressed by rules with simple conditions. The novel two-phase approach efficiently generates M-of-N conditions by analysing frequent sets in previously induced simple and complex rule conditions. The presented method allows rule induction for classification, regression and survival problems. Extensive experiments on various public datasets show that the proposed method often leads to more concise rulesets compared to those using only simple conditions. Importantly, the inclusion of complex conditions and M-of-N conditions has no statistically significant negative impact on the predictive ability of the ruleset. Experimental results and a ready-to-use implementation are available in the GitHub repository. The proposed algorithm can potentially serve as a valuable tool for knowledge discovery and facilitate the interpretation of rule-based models by making them more concise.<\/jats:p>","DOI":"10.3390\/make6010026","type":"journal-article","created":{"date-parts":[[2024,3,5]],"date-time":"2024-03-05T11:26:59Z","timestamp":1709638019000},"page":"554-579","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Classification, Regression, and Survival Rule Induction with Complex and M-of-N Elementary Conditions"],"prefix":"10.3390","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6035-1951","authenticated-orcid":false,"given":"Cezary","family":"Maszczyk","sequence":"first","affiliation":[{"name":"Department of Computer Networks and Systems, Silesian University of Technology, ul. Akademicka 16, 44-100 Gliwice, Poland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2393-9761","authenticated-orcid":false,"given":"Marek","family":"Sikora","sequence":"additional","affiliation":[{"name":"Department of Computer Networks and Systems, Silesian University of Technology, ul. Akademicka 16, 44-100 Gliwice, Poland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5715-6239","authenticated-orcid":false,"given":"\u0141ukasz","family":"Wr\u00f3bel","sequence":"additional","affiliation":[{"name":"Department of Computer Networks and Systems, Silesian University of Technology, ul. Akademicka 16, 44-100 Gliwice, Poland"}]}],"member":"1968","published-online":{"date-parts":[[2024,3,5]]},"reference":[{"key":"ref_1","first-page":"307","article-title":"Fast discovery of association rules","volume":"12","author":"Agrawal","year":"1996","journal-title":"Adv. Knowl. Discov. Data Min."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1002\/widm.1144","article-title":"Subgroup discovery","volume":"5","author":"Atzmueller","year":"2015","journal-title":"Wiley Interdiscip. Rev. Data Min. Knowl. Discov."},{"key":"ref_3","first-page":"377","article-title":"Supervised descriptive rule discovery: A unifying survey of contrast set, emerging pattern and subgroup mining","volume":"10","author":"Novak","year":"2009","journal-title":"J. Mach. Learn. Res."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1570","DOI":"10.3390\/make5040079","article-title":"Explainable Stacked Ensemble Deep Learning (SEDL) Framework to Determine Cause of Death from Verbal Autopsies","volume":"5","author":"Mapundu","year":"2023","journal-title":"Mach. Learn. Knowl. Extr."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ribeiro, M.T., Singh, S., and Guestrin, C. (2018, January 2\u20137). Anchors: High-precision model-agnostic explanations. Proceedings of the AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.11491"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"419","DOI":"10.3233\/FI-2016-1455","article-title":"Rule quality measures settings in classification, regression and survival rule induction\u2014An empirical approach","volume":"149","author":"Sikora","year":"2016","journal-title":"Fundam. Inform."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.knosys.2019.02.019","article-title":"GuideR: A guided separate-and-conquer rule learning in classification, regression, and survival settings","volume":"173","author":"Sikora","year":"2019","journal-title":"Knowl. Based Syst."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"105480","DOI":"10.1016\/j.knosys.2020.105480","article-title":"RuleKit: A comprehensive suite for rule-based learning","volume":"194","author":"Sikora","year":"2020","journal-title":"Knowl. Based Syst."},{"key":"ref_9","unstructured":"Michalski, R.S. (1969, January 8\u201311). On the Quasi-Minimal Solution of the Covering Problem. Proceedings of the V. International Symposium on Information Processing (FCIP), Bled, Yugoslavia."},{"key":"ref_10","unstructured":"Michalski, R.S. (1973). AQVAL\/1\u2013Computer Implementation of a Variable-Valued Logic System VL1 and Examples of its Application to Pattern Recognition, George Mason University."},{"key":"ref_11","unstructured":"Michalski, R.S., Mozetic, I., Hong, J., and Lavrac, N. (1986). The AQ15 Inductive Learning System: An Overview and Experiments, University of Illinois."},{"key":"ref_12","unstructured":"Bloedorn, E., Michalski, R.S., and Wnek, J. (1993, January 26\u201329). Multistrategy constructive induction: AQ17-MCI. Proceedings of the 2nd International Workshop on Multistrategy Learning, Harpers Ferry, WV, USA."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wojtusiak, J., Michalski, R.S., Kaufman, K.A., and Pietrzykowski, J. (2006, January 13\u201315). The AQ21 natural induction program for pattern discovery: Initial version and its novel features. Proceedings of the 2006 18th IEEE International Conference on Tools with Artificial Intelligence (ICTAI\u201906), Arlington, VA, USA.","DOI":"10.1109\/ICTAI.2006.109"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1023\/A:1006524209794","article-title":"Separate-and-conquer rule learning","volume":"13","year":"1999","journal-title":"Artif. Intell. Rev."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"F\u00fcrnkranz, J., Gamberger, D., and Lavra\u010d, N. (2012). Foundations of Rule Learning, Springer Science & Business Media.","DOI":"10.1007\/978-3-540-75197-7"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1007\/BF00116835","article-title":"The CN2 induction algorithm","volume":"3","author":"Clark","year":"1989","journal-title":"Mach. Learn."},{"key":"ref_17","unstructured":"Cohen, W.W. (1995). Machine Learning Proceedings 1995, Elsevier."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"27","DOI":"10.3233\/FI-1997-3113","article-title":"A new version of the rule induction system LERS","volume":"31","year":"1997","journal-title":"Fundam. Inform."},{"key":"ref_19","unstructured":"Greco, S., Matarazzo, B., Slowinski, R., and Stefanowski, J. (2000, January 16\u201319). An algorithm for induction of decision rules consistent with the dominance principle. Proceedings of the Rough Sets and Current Trends in Computing: Second International Conference, RSCTC 2000, Banff, AB, Canada."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"987","DOI":"10.1016\/j.ins.2010.10.030","article-title":"Sequential covering rule induction algorithm for variable consistency rough set approaches","volume":"181","year":"2011","journal-title":"Inf. Sci."},{"key":"ref_21","unstructured":"Liu, B., Hsu, W., and Ma, Y. (1998, January 27\u201331). Integrating classification and association rule mining. Proceedings of the Fourth International Conference on Knowledge Discovery and Data Mining, New York, NY, USA."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1531","DOI":"10.1587\/transinf.E95.D.1531","article-title":"Classification based on predictive association rules of incomplete data","volume":"95","author":"Yoon","year":"2012","journal-title":"IEICE Trans. Inf. Syst."},{"key":"ref_23","first-page":"3","article-title":"A simple, fast, and effective rule learner","volume":"99","author":"Cohen","year":"1999","journal-title":"AAAI\/IAAI"},{"key":"ref_24","unstructured":"Weiss, S.M., and Indurkhya, N. (July, January 29). Lightweight rule induction. Proceedings of the Seventeenth International Conference on Machine Learning, Stanford, CA, USA."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1007\/s10618-010-0177-7","article-title":"ENDER: A statistical framework for boosting decision rules","volume":"21","year":"2010","journal-title":"Data Min. Knowl. Discov."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Stefanowski, J. (2004, January 1\u20135). The bagging and n 2-classifiers based on rules induced by MODLEM. Proceedings of the International Conference on Rough Sets and Current Trends in Computing, Uppsala, Sweden.","DOI":"10.1007\/978-3-540-25929-9_59"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Su, G., Wei, D., Varshney, K.R., and Malioutov, D.M. (2016, January 13\u201316). Learning sparse two-level boolean rules. Proceedings of the 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP), Salerno, Italy.","DOI":"10.1109\/MLSP.2016.7738856"},{"key":"ref_28","first-page":"2357","article-title":"A bayesian framework for learning rule sets for interpretable classification","volume":"18","author":"Wang","year":"2017","journal-title":"J. Mach. Learn. Res."},{"key":"ref_29","unstructured":"Dash, S., Gunluk, O., and Wei, D. (2018). Boolean decision rules via column generation. Adv. Neural Inf. Process. Syst., 31."},{"key":"ref_30","unstructured":"Hailesilassie, T. (2016). Rule extraction algorithm for deep neural networks: A review. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Yu, L., Li, M., Zhang, Y.L., Li, L., and Zhou, J. (2023, January 21\u201325). FINRule: Feature Interactive Neural Rule Learning. Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, Birmingham, UK.","DOI":"10.1145\/3583780.3614884"},{"key":"ref_32","unstructured":"Zarlenga, M.E., Shams, Z., and Jamnik, M. (2021). Efficient decompositional rule extraction for deep neural networks. arXiv."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Qiao, L., Wang, W., and Lin, B. (2021, January 2\u20139). Learning accurate and interpretable decision rule sets from neural networks. Proceedings of the AAAI Conference on Artificial Intelligence, Virtually.","DOI":"10.1609\/aaai.v35i5.16555"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1109\/72.914524","article-title":"A new methodology of extraction, optimization and application of crisp and fuzzy logical rules","volume":"12","author":"Duch","year":"2001","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1016\/0950-7051(96)81920-4","article-title":"Survey and critique of techniques for extracting rules from trained artificial neural networks","volume":"8","author":"Andrews","year":"1995","journal-title":"Knowl. Based Syst."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.ins.2006.06.003","article-title":"Rudiments of rough sets","volume":"177","author":"Pawlak","year":"2007","journal-title":"Inf. Sci."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Sta\u0144czyk, U., Zielosko, B., and Baron, G. (2020). Discretisation of conditions in decision rules induced for continuous data. PLoS ONE, 15.","DOI":"10.1371\/journal.pone.0231788"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1049\/trit.2019.0025","article-title":"Rule induction based on rough sets from information tables having continuous domains","volume":"4","author":"Nakata","year":"2019","journal-title":"CAAI Trans. Intell. Technol."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1497","DOI":"10.1109\/TKDE.2006.179","article-title":"On mining instance-centric classification rules","volume":"18","author":"Wang","year":"2006","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"571","DOI":"10.1007\/s10994-022-06290-w","article-title":"Efficient learning of large sets of locally optimal classification rules","volume":"112","author":"Huynh","year":"2023","journal-title":"Mach. Learn."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1016\/S0019-9958(65)90241-X","article-title":"Fuzzy sets","volume":"8","author":"Zadeh","year":"1965","journal-title":"Inf. Control"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1007\/s10618-009-0131-8","article-title":"FURIA: An algorithm for unordered fuzzy rule induction","volume":"19","year":"2009","journal-title":"Data Min. Knowl. Discov."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"143","DOI":"10.3233\/FI-2013-805","article-title":"CHIRA\u2014Convex hull based iterative algorithm of rules aggregation","volume":"123","author":"Sikora","year":"2013","journal-title":"Fundam. Inform."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Setiono, R., and Liu, H. (1997, January 23\u201325). NeuroLinear: A system for extracting oblique decision rules from neural networks. Proceedings of the Machine Learning: ECML-97: 9th European Conference on Machine Learning, Prague, Czech Republic.","DOI":"10.1007\/3-540-62858-4_87"},{"key":"ref_45","unstructured":"Ming, T.K. (1994, January 4\u20137). An M-of-N rule induction algorithm and its application to DNA domain. Proceedings of the 1994 Proceedings of the Twenty-Seventh Hawaii International Conference on System Sciences, Wailea, HI, USA."},{"key":"ref_46","first-page":"387","article-title":"Extending theory refinement to m-of-n rules","volume":"17","author":"Baffes","year":"1993","journal-title":"Informatica"},{"key":"ref_47","unstructured":"Larsen, O., Freitas, A.A., and Nievola, J.C. (2002, January 9\u201313). Constructing X-of-N Attributes with a Genetic Algorithm. Proceedings of the GECCO Late Breaking Papers, New York, NY, USA."},{"key":"ref_48","unstructured":"Wnek, J., and Michalski, R.S. (1994). Working Notes of the ML-COLT94 Workshop on Constructive Induction, Springer."},{"key":"ref_49","unstructured":"Sebag, M. (July, January 28). Constructive induction: A version space based approach. Proceedings of the International Conference on Artificial Intelligence, Las Vegas, NV, USA."},{"key":"ref_50","unstructured":"Murphy, P.M., and Pazzani, M.J. (1991). Machine Learning Proceedings 1991, Elsevier."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1542","DOI":"10.1109\/72.641475","article-title":"A partial order for the M-of-N rule-extraction algorithm","volume":"8","author":"Maire","year":"1997","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"512","DOI":"10.1109\/72.839020","article-title":"Extracting M-of-N rules from trained neural networks","volume":"11","author":"Setiono","year":"2000","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1023\/A:1007626017208","article-title":"Constructing X-of-N attributes for decision tree learning","volume":"40","author":"Zheng","year":"2000","journal-title":"Mach. Learn."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Beck, F., F\u00fcrnkranz, J., and Huynh, V.Q.P. (2023, January 18\u201320). Layerwise Learning of Mixed Conjunctive and Disjunctive Rule Sets. Proceedings of the International Joint Conference on Rules and Reasoning, Oslo, Norway.","DOI":"10.1007\/978-3-031-45072-3_7"},{"key":"ref_55","unstructured":"Michalski, R.S. (2004). Attributional calculus: A logic and representation language for natural induction., George Mason University. Reports of the Machine Learning and Inference Laboratory, MLI 04-2."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1109\/5254.671089","article-title":"Data-driven constructive induction","volume":"13","author":"Bloedorn","year":"1998","journal-title":"IEEE Intell. Syst. Their Appl."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1023\/A:1022622132310","article-title":"Hypothesis-driven constructive induction in AQ17-HCI: A method and experiments","volume":"14","author":"Wnek","year":"1994","journal-title":"Mach. Learn."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Khalid, S., Khalil, T., and Nasreen, S. (2014, January 27\u201329). A survey of feature selection and feature extraction techniques in machine learning. Proceedings of the 2014 Science and Information Conference, London, UK.","DOI":"10.1109\/SAI.2014.6918213"},{"key":"ref_59","first-page":"173","article-title":"An overview of principal component analysis","volume":"4","author":"Karamizadeh","year":"2013","journal-title":"J. Signal Inf. Process."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3178155","article-title":"A survey on multidimensional scaling","volume":"51","author":"Saeed","year":"2018","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"100118","DOI":"10.1016\/j.health.2022.100118","article-title":"An assessment of machine learning models and algorithms for early prediction and diagnosis of diabetes using health indicators","volume":"2","author":"Chang","year":"2022","journal-title":"Healthc. Anal."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"414","DOI":"10.1080\/01621459.1988.10478612","article-title":"Logistic regression, survival analysis, and the Kaplan-Meier curve","volume":"83","author":"Efron","year":"1988","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1007\/s10994-009-5162-2","article-title":"On the quest for optimal rule learning heuristics","volume":"78","author":"Janssen","year":"2010","journal-title":"Mach. Learn."},{"key":"ref_64","unstructured":"(2023, November 24). RuleKit Documentation. Available online: https:\/\/github.com\/adaa-polsl\/RuleKit\/wiki."},{"key":"ref_65","unstructured":"Janssen, F., and F\u00fcrnkranz, J. (2011, January 16\u201322). Heuristic Rule-Based Regression via Dynamic Reduction to Classification. Proceedings of the IJCAI 2011 22nd International Joint Conference on Artificial Intelligence, Barcelona, Spain."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"553","DOI":"10.1093\/biomet\/69.3.553","article-title":"A class of rank test procedures for censored survival data","volume":"69","author":"Harrington","year":"1982","journal-title":"Biometrika"},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"Sidhu, S., Meena, U.K., Nawani, A., Gupta, H., and Thakur, N. (2014). FP Growth algorithm implementation. Int. J. Comput. Appl., 93.","DOI":"10.5120\/16233-5613"},{"key":"ref_68","unstructured":"Bruha, I. (1997). Machine Learning and Statistics: The Interface, John Wiley."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"2529","DOI":"10.1002\/(SICI)1097-0258(19990915\/30)18:17\/18<2529::AID-SIM274>3.0.CO;2-5","article-title":"Assessment and comparison of prognostic classification schemes for survival data","volume":"18","author":"Graf","year":"1999","journal-title":"Stat. Med."},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1198\/016214504000001907","article-title":"False discovery rate\u2013adjusted multiple confidence intervals for selected parameters","volume":"100","author":"Benjamini","year":"2005","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_71","first-page":"1","article-title":"Statistical comparisons of classifiers over multiple data sets","volume":"7","year":"2006","journal-title":"J. Mach. Learn. Res."},{"key":"ref_72","unstructured":"Wnek, J. (2024, February 21). MONK\u2019s Problems. UCI Machine Learning Repository. Available online: https:\/\/archive.ics.uci.edu\/dataset\/70\/monk+s+problems."},{"key":"ref_73","first-page":"2007","article-title":"Generalized Boosted Models: A guide to the gbm package","volume":"1","author":"Ridgeway","year":"2007","journal-title":"Update"},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1037\/0033-295X.101.1.53","article-title":"Rule-plus-exception model of classification learning","volume":"101","author":"Nosofsky","year":"1994","journal-title":"Psychol. Rev."}],"container-title":["Machine Learning and Knowledge Extraction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-4990\/6\/1\/26\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:09:40Z","timestamp":1760105380000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-4990\/6\/1\/26"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,5]]},"references-count":74,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,3]]}},"alternative-id":["make6010026"],"URL":"https:\/\/doi.org\/10.3390\/make6010026","relation":{},"ISSN":["2504-4990"],"issn-type":[{"type":"electronic","value":"2504-4990"}],"subject":[],"published":{"date-parts":[[2024,3,5]]}}}