{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,11]],"date-time":"2026-02-11T18:31:46Z","timestamp":1770834706782,"version":"3.50.1"},"reference-count":55,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2024,1,1]],"date-time":"2024-01-01T00:00:00Z","timestamp":1704067200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,2,1]],"date-time":"2024-02-01T00:00:00Z","timestamp":1706745600000},"content-version":"vor","delay-in-days":31,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Appl Intell"],"published-print":{"date-parts":[[2024,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Feature Ensembles are a robust and effective method for finding the feature set that yields the best predictive accuracy for learning agents. However, current feature ensemble algorithms do not consider explainability as a key factor in their construction. To address this limitation, we present an algorithm that optimizes for the explainability and performance of a model \u2013 the<jats:bold>O<\/jats:bold>ptimizing<jats:bold>F<\/jats:bold>eature<jats:bold>E<\/jats:bold>nsembles for<jats:bold>E<\/jats:bold>xplainability (OFEE) algorithm. OFEE uses intersections of feature sets to produce a feature ensemble that optimally balances explainability and performance. Furthermore, OFEE is parameter-free and as such optimizes itself to a given dataset and explainability requirements. To evaluated OFEE, we considered two explainability measures, one based on ensemble size and the other based on ensemble stability. We found that OFEE was overall extremely effective within the nine canonical datasets we considered. It outperformed other feature selection algorithms by an average of over 8% and 7% respectively when considering the size and stability explainability measures.<\/jats:p>","DOI":"10.1007\/s10489-023-05069-3","type":"journal-article","created":{"date-parts":[[2024,2,1]],"date-time":"2024-02-01T04:55:01Z","timestamp":1706763301000},"page":"2248-2260","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["An algorithm to optimize explainability using feature ensembles"],"prefix":"10.1007","volume":"54","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7851-8147","authenticated-orcid":false,"given":"Teddy","family":"Lazebnik","sequence":"first","affiliation":[]},{"given":"Svetlana","family":"Bunimovich-Mendrazitsky","sequence":"additional","affiliation":[]},{"given":"Avi","family":"Rosenfeld","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,2,1]]},"reference":[{"issue":"3","key":"5069_CR1","first-page":"16","volume":"3","author":"O Amir","year":"2013","unstructured":"Amir O, Gal K (2013) Plan recognition and visualization in exploratory learning environments. ACM Transactions on Interactive Intelligent Systems (TiiS) 3(3):16","journal-title":"ACM Transactions on Interactive Intelligent Systems (TiiS)"},{"issue":"4","key":"5069_CR2","first-page":"64","volume":"5","author":"A Azaria","year":"2015","unstructured":"Azaria A, Rabinovich Z, Goldman CV, Kraus S (2015) Strategic information disclosure to people with multiple alternatives. ACM Transactions on Intelligent Systems and Technology (TIST) 5(4):64","journal-title":"ACM Transactions on Intelligent Systems and Technology (TIST)"},{"key":"5069_CR3","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1016\/j.artint.2016.10.005","volume":"242","author":"S Barrett","year":"2017","unstructured":"Barrett S, Rosenfeld A, Kraus S, Stone P (2017) Making friends on the fly: Cooperating with new teammates. Artificial Intelligence 242:132\u2013171","journal-title":"Artificial Intelligence"},{"key":"5069_CR4","unstructured":"Richardson A, Rosenfeld A (2018) A survey of interpretability and explainability in human-agent systems. XAI 2018, 137"},{"issue":"12","key":"5069_CR5","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1145\/2629559","volume":"57","author":"NR Jennings","year":"2014","unstructured":"Jennings NR, Moreau L, Nicholson D, Ramchurn S, Roberts S, Rodden T, Rogers A (2014) Human-agent collectives. Communications of the ACM 57(12):80\u201388","journal-title":"Communications of the ACM"},{"key":"5069_CR6","doi-asserted-by":"publisher","first-page":"1249","DOI":"10.1038\/s41598-023-28328-2","volume":"13","author":"LS Keren","year":"2023","unstructured":"Keren LS, Liberzon A, Lazebnik T (2023) A computational framework for physics-informed symbolic regression with straightforward integration of domain knowledge. Scientific Reports 13:1249","journal-title":"Scientific Reports"},{"key":"5069_CR7","unstructured":"Rosenfeld A (2021) Better metrics for evaluating explainable artificial intelligence. In: AAMAS \u201921: 20th international conference on autonomous agents and multiagent systems, ACM, pp\u00a045\u201350"},{"issue":"1","key":"5069_CR8","doi-asserted-by":"publisher","first-page":"137","DOI":"10.2307\/25148784","volume":"31","author":"B Xiao","year":"2007","unstructured":"Xiao B, Benbasat I (2007) E-commerce product recommendation agents: use, characteristics, and impact. MIS quarterly 31(1):137\u2013209","journal-title":"MIS quarterly"},{"key":"5069_CR9","doi-asserted-by":"crossref","unstructured":"Savchenko E, Lazebnik T (2023) Computer aided functional style identification and correction in modern Russian texts. Journal of Data, Information and Management 4:25\u201332","DOI":"10.1007\/s42488-021-00062-2"},{"key":"5069_CR10","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1186\/s12911-022-01877-8","volume":"22","author":"T Lazebnik","year":"2022","unstructured":"Lazebnik T, Bahouth Z, Bunimovich-Mendrazitsky S, Halachmi S (2022) Predicting acute kidney injury following open partial nephrectomy treatment using sat-pruned explainable machine learning model. BMC Med Inform Decis Mak 22:133","journal-title":"BMC Med Inform Decis Mak"},{"issue":"6","key":"5069_CR11","doi-asserted-by":"publisher","first-page":"673","DOI":"10.1007\/s10458-019-09408-y","volume":"33","author":"A Rosenfeld","year":"2019","unstructured":"Rosenfeld A, Richardson A (2019) Explainability in human-agent systems. Auton Agent Multi-Agent Syst 33(6):673\u2013705","journal-title":"Auton Agent Multi-Agent Syst"},{"key":"5069_CR12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.inffus.2018.11.008","volume":"52","author":"V Bol\u00f3n-Canedo","year":"2019","unstructured":"Bol\u00f3n-Canedo V, Alonso-Betanzos A (2019) Ensembles for feature selection: a review and future trends. Inf Fusion 52:1\u201312","journal-title":"Inf Fusion"},{"key":"5069_CR13","unstructured":"Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J Mach Learn Res 3(Mar):1157\u20131182"},{"key":"5069_CR14","unstructured":"Liu H, Motoda H, Setiono R, Zhao Z (2010) Feature selection: An ever evolving frontier in data mining. In: Feature selection in data mining, PMLR, pp\u00a04\u201313"},{"issue":"1","key":"5069_CR15","doi-asserted-by":"publisher","first-page":"18","DOI":"10.3390\/e23010018","volume":"23","author":"P Linardatos","year":"2021","unstructured":"Linardatos P, Papastefanopoulos V, Kotsiantis S (2021) Explainable ai: a review of machine learning interpretability methods. Entropy 23(1):18","journal-title":"Entropy"},{"issue":"2","key":"5069_CR16","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1023\/A:1007958904918","volume":"24","author":"P Viola","year":"1997","unstructured":"Viola P, Wells WM III (1997) Alignment by maximization of mutual information. Int J Comput Vis 24(2):137\u2013154","journal-title":"Int J Comput Vis"},{"issue":"1","key":"5069_CR17","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1080\/00031305.1978.10479237","volume":"32","author":"DC Hoaglin","year":"1978","unstructured":"Hoaglin DC, Welsch RE (1978) The hat matrix in regression and anova. Am Stat 32(1):17\u201322","journal-title":"Am Stat"},{"key":"5069_CR18","doi-asserted-by":"crossref","unstructured":"Plackett RL (1983) Karl pearson and the chi-squared test. Int Stat Rev\/Revue Int Stat 59\u201372","DOI":"10.2307\/1402731"},{"key":"5069_CR19","doi-asserted-by":"crossref","unstructured":"Xue Y, Tang Y, Xu X, Liang J, Neri F (2021) Multi-objective feature selection with missing data in classification. IEEE Trans Emerg Top Comput Intell","DOI":"10.1109\/TETCI.2021.3074147"},{"issue":"5","key":"5069_CR20","doi-asserted-by":"publisher","first-page":"882","DOI":"10.1109\/TEVC.2020.2968743","volume":"24","author":"X Song","year":"2020","unstructured":"Song X, Zhang Y, Guo Y, Sun X (2020) Variable-size cooperative coevolutionary particle swarm optimization for feature selection on high-dimensional data. IEEE Trans Evol Comput 24(5):882\u2013895","journal-title":"IEEE Trans Evol Comput"},{"issue":"4","key":"5069_CR21","doi-asserted-by":"publisher","first-page":"937","DOI":"10.1007\/s11634-017-0285-y","volume":"12","author":"A Ben Brahim","year":"2018","unstructured":"Ben Brahim A, Limam M (2018) Ensemble feature selection for high dimensional data: a new method and a comparative study. Adv Data Anal Classif 12(4):937\u2013952","journal-title":"Adv Data Anal Classif"},{"key":"5069_CR22","first-page":"313","volume-title":"Machine learning and knowledge discovery in databases, Berlin, Heidelberg, 2008","author":"Y Saeys","year":"2008","unstructured":"Saeys Y, Abeel T, Van de Peer Y (2008) Robust feature selection using ensemble feature selection techniques. In: Daelemans W, Goethals B, Morik K (eds) Machine learning and knowledge discovery in databases, Berlin, Heidelberg, 2008. Springer, Berlin Heidelberg, pp 313\u2013325"},{"key":"5069_CR23","doi-asserted-by":"crossref","unstructured":"Chen K, Xue B, Zhang M, Zhou F (2021) Correlation-guided updating strategy for feature selection in classification with surrogate-assisted particle swarm optimisation. IEEE Trans Evol Comput","DOI":"10.1109\/TEVC.2021.3134804"},{"issue":"7","key":"5069_CR24","doi-asserted-by":"publisher","first-page":"941","DOI":"10.1093\/bioinformatics\/btp093","volume":"25","author":"M Netzer","year":"2009","unstructured":"Netzer M, Millonig G, Osl M, Pfeifer B, Praun S, Villinger J, Vogel W, Baumgartner C (2009) A new ensemble-based algorithm for identifying breath gas marker candidates in liver disease using ion molecule reaction mass spectrometry. Bioinformatics 25(7):941\u2013947","journal-title":"Bioinformatics"},{"issue":"4","key":"5069_CR25","doi-asserted-by":"publisher","first-page":"721","DOI":"10.1016\/j.jbi.2009.05.006","volume":"42","author":"M Osl","year":"2009","unstructured":"Osl M, Dreiseitl S, Cerqueira F, Netzer M, Pfeifer B, Baumgartner C (2009) Demoting redundant features to improve the discriminatory ability in cancer data. J Biomed Inform 42(4):721\u2013725","journal-title":"J Biomed Inform"},{"key":"5069_CR26","doi-asserted-by":"crossref","unstructured":"Saeys Y, Abeel T, Van\u00a0de Peer Y (2008) Robust feature selection using ensemble feature selection techniques. In: Joint european conference on machine learning and knowledge discovery in databases, Springer, pp\u00a0313\u2013325","DOI":"10.1007\/978-3-540-87481-2_21"},{"key":"5069_CR27","doi-asserted-by":"crossref","unstructured":"Mallipeddi R, Suganthan PN (2010) Differential evolution with ensemble of constraint handling techniques for solving cec 2010 benchmark problems. In: IEEE congress on evolutionary computation, IEEE, pp\u00a01\u20138","DOI":"10.1109\/CEC.2010.5586330"},{"issue":"3","key":"5069_CR28","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1145\/3236386.3241340","volume":"16","author":"ZC Lipton","year":"2018","unstructured":"Lipton ZC (2018) The mythos of model interpretability: in machine learning, the concept of interpretability is both important and slippery. Queue 16(3):31\u201357","journal-title":"Queue"},{"issue":"5","key":"5069_CR29","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1038\/s42256-019-0048-x","volume":"1","author":"C Rudin","year":"2019","unstructured":"Rudin C (2019) Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nat Mach Intell 1(5):206\u2013215","journal-title":"Nat Mach Intell"},{"key":"5069_CR30","doi-asserted-by":"crossref","unstructured":"Chen JY, Procci K, Boyce M, Wright J, Garcia A, Barnes M (2014) Situation awareness-based agent transparency. Technical report, Army Research Lab Aberdeen Proving Ground MD Human Research and Engineering Directorate","DOI":"10.21236\/ADA600351"},{"key":"5069_CR31","doi-asserted-by":"crossref","unstructured":"Guidotti R, Monreale A, Ruggieri S, Turini F, Giannotti F, Pedreschi D (2018) A survey of methods for explaining black box models. ACM Comput Surv 51(5):93:1\u201393:42","DOI":"10.1145\/3236009"},{"key":"5069_CR32","unstructured":"S\u00f8rmo F, Cassens J (2004) Explanation goals in case-based reasoning. In: Proceedings of the ECCBR 2004 workshops number 142-04, pp\u00a0165\u2013174"},{"issue":"2","key":"5069_CR33","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1007\/s10462-005-4607-7","volume":"24","author":"F S\u00f8rmo","year":"2005","unstructured":"S\u00f8rmo F, Cassens J, Aamodt A (2005) Explanation in case-based reasoning-perspectives and goals. Artif Intell Rev 24(2):109\u2013143","journal-title":"Artif Intell Rev"},{"key":"5069_CR34","unstructured":"Kononenko I (1999) Explaining classifications for individual instances. In: Proceedings of IJCAI\u201999. Citeseer"},{"issue":"3","key":"5069_CR35","doi-asserted-by":"publisher","first-page":"1437","DOI":"10.1109\/TKDE.2003.1245283","volume":"15","author":"MA Hall","year":"2003","unstructured":"Hall MA, Holmes G (2003) Benchmarking attribute selection techniques for discrete class data mining. IEEE Trans Knowl Data Eng 15(3):1437\u20131447","journal-title":"IEEE Trans Knowl Data Eng"},{"issue":"3","key":"5069_CR36","doi-asserted-by":"publisher","first-page":"228","DOI":"10.1109\/TNB.2005.853657","volume":"4","author":"K-B Duan","year":"2005","unstructured":"Duan K-B, Rajapakse JC, Wang H, Azuaje F (2005) Multiple svm-rfe for gene selection in cancer classification with expression data. IEEE Trans Nanobioscience 4(3):228\u2013234","journal-title":"IEEE Trans Nanobioscience"},{"key":"5069_CR37","doi-asserted-by":"crossref","unstructured":"Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Trans Evol Comput 67","DOI":"10.1109\/4235.585893"},{"key":"5069_CR38","doi-asserted-by":"crossref","unstructured":"Liu R, Liu E, Yang J, Li M, Wang F (2006) Optimizing the hyper-parameters for svm by combining evolution strategies with a grid search. Intell Control Autom 344","DOI":"10.1007\/978-3-540-37256-1_87"},{"key":"5069_CR39","doi-asserted-by":"publisher","first-page":"258","DOI":"10.1090\/qam\/10667","volume":"2","author":"BC Haskell","year":"1944","unstructured":"Haskell BC (1944) The method of steepest descent for non-linear minimization problems. Quart Appl Math 2:258\u2013261","journal-title":"Quart Appl Math"},{"key":"5069_CR40","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1016\/j.neucom.2013.03.067","volume":"135","author":"V Bol\u00f3n-Canedo","year":"2014","unstructured":"Bol\u00f3n-Canedo V, S\u00e1nchez-Marono N (2014) Alonso-Betanzos A (2014) Data classification using an ensemble of filters. Neurocomputing 135:13\u201320","journal-title":"Neurocomputing"},{"key":"5069_CR41","doi-asserted-by":"crossref","unstructured":"Pes B (2019) Ensemble feature selection for high-dimensional data: a stability analysis across multiple domains. Neural Comput & Applic pp\u00a01\u201323","DOI":"10.1007\/s00521-019-04082-3"},{"key":"5069_CR42","doi-asserted-by":"publisher","first-page":"124","DOI":"10.1016\/j.knosys.2016.11.017","volume":"118","author":"B Seijo-Pardo","year":"2017","unstructured":"Seijo-Pardo B, Porto-D\u00edaz I, Bol\u00f3n-Canedo V, Alonso-Betanzos A (2017) Ensemble feature selection: homogeneous and heterogeneous approaches. Knowl-Based Syst 118:124\u2013139","journal-title":"Knowl-Based Syst"},{"key":"5069_CR43","doi-asserted-by":"crossref","unstructured":"Moreno-Sanchez PA (2021) An automated feature selection and classification pipeline to improve explainability of clinical prediction models. In: 2021 IEEE 9th international conference on healthcare informatics (ICHI), pp\u00a0527\u2013534","DOI":"10.1109\/ICHI52183.2021.00100"},{"issue":"3","key":"5069_CR44","doi-asserted-by":"publisher","first-page":"142","DOI":"10.1109\/TGE.1977.6498972","volume":"15","author":"PH Swain","year":"1977","unstructured":"Swain PH, Hauska H (1977) The decision tree classifier: design and potential. IEEE Trans Geosci Electron 15(3):142\u2013147","journal-title":"IEEE Trans Geosci Electron"},{"issue":"3","key":"5069_CR45","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0033812","volume":"7","author":"G Stiglic","year":"2012","unstructured":"Stiglic G, Kocbek S, Pernek I, Kokol P (2012) Comprehensive decision tree models in bioinformatics. Plos One 7(3):e33812","journal-title":"Plos One"},{"key":"5069_CR46","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1016\/j.engappai.2014.11.012","volume":"39","author":"D Sanchez","year":"2015","unstructured":"Sanchez D, Batet M, Martinez S, Domingo-Ferrer J (2015) Semantic variance: an intuitive measure for ontology accuracy evaluation. Eng Appl Artif Intell 39:89\u201399","journal-title":"Eng Appl Artif Intell"},{"key":"5069_CR47","unstructured":"Khaire UM, Dhanalakshmi R (2019) Stability of feature selection algorithm: a review. J King Saud Univ Comput Inform Sci"},{"key":"5069_CR48","doi-asserted-by":"crossref","unstructured":"Rezatofighi H, Tsoi N, Gwak K, Sageghain A, Reid I, Savarese S (2019) Generalized intersection over union: a metric and a loss for bounding box regression. roceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","DOI":"10.1109\/CVPR.2019.00075"},{"key":"5069_CR49","doi-asserted-by":"crossref","unstructured":"Kudelic R (2016) Monte-carlo randomized algorithm for minimal feedback arc set problem. Appl Soft Comput 41:235\u2013246","DOI":"10.1016\/j.asoc.2015.12.018"},{"key":"5069_CR50","first-page":"497","volume":"5","author":"A Bjorck","year":"1996","unstructured":"Bjorck A (1996) Numerical methods for least squares problems. J Soc Ind Appl Math Mathmatic 5:497\u2013513","journal-title":"J Soc Ind Appl Math Mathmatic"},{"key":"5069_CR51","doi-asserted-by":"crossref","unstructured":"Shanock LR, Baran BE, Gentry WA, Pattison SC, Heggestad ED (2010) Polynomial regression with response surface analysis: a powerful approach for examining moderation and overcoming limitations of difference scores. J Bus Psychol 25:543\u2013554","DOI":"10.1007\/s10869-010-9183-4"},{"key":"5069_CR52","unstructured":"Lazebnik T, Rosenfeld A (2023) FSPL: filter and embedding feature selection pipeline meta learning. Int J Appl Math Comput Sci"},{"key":"5069_CR53","doi-asserted-by":"crossref","unstructured":"Neumann J, Schnorr C, Steidl G (2005) Combined svm-based feature selection and classification. Mach Learn 61:129\u2013150","DOI":"10.1007\/s10994-005-1505-9"},{"key":"5069_CR54","doi-asserted-by":"crossref","unstructured":"Muthukrishnan R, Rohini R (2016) Lasso: a feature selection technique in predictive modeling for machine learning. In: 2016 IEEE international conference on advances in computer applications (ICACA), pp\u00a018\u201320","DOI":"10.1109\/ICACA.2016.7887916"},{"key":"5069_CR55","doi-asserted-by":"crossref","unstructured":"Lazebnik T, Bunimovich-Mendrazitsky S (2023) Decision tree post-pruning without loss of accuracy using the SAT-PP algorithm with an empirical evaluation on oncology data. Data Knowl Eng 102173","DOI":"10.1016\/j.datak.2023.102173"}],"container-title":["Applied Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-023-05069-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10489-023-05069-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-023-05069-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,9]],"date-time":"2024-11-09T19:24:53Z","timestamp":1731180293000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10489-023-05069-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1]]},"references-count":55,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,1]]}},"alternative-id":["5069"],"URL":"https:\/\/doi.org\/10.1007\/s10489-023-05069-3","relation":{},"ISSN":["0924-669X","1573-7497"],"issn-type":[{"value":"0924-669X","type":"print"},{"value":"1573-7497","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1]]},"assertion":[{"value":"28 September 2023","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 February 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors did not receive support from any organization for the submitted work.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing Interests"}},{"value":"The data used in this study does not require informed consent or ethical approval as the data is open accessed and generated by others.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical standard"}}]}}