{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T12:03:59Z","timestamp":1777982639613,"version":"3.51.4"},"reference-count":56,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T00:00:00Z","timestamp":1769904000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T00:00:00Z","timestamp":1769904000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Evol. Intel."],"published-print":{"date-parts":[[2026,2]]},"DOI":"10.1007\/s12065-026-01145-y","type":"journal-article","created":{"date-parts":[[2026,2,2]],"date-time":"2026-02-02T05:20:19Z","timestamp":1770009619000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Quantifying overall agreement between explanation methods to address the disagreement problem"],"prefix":"10.1007","volume":"19","author":[{"given":"Gaurav","family":"Parashar","sequence":"first","affiliation":[]},{"given":"Alka","family":"Chaudhary","sequence":"additional","affiliation":[]},{"given":"Dilkeshwar","family":"Pandey","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2026,2,2]]},"reference":[{"key":"1145_CR1","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman L (2001) Random forests. Mach Learn 45:5\u201332","journal-title":"Mach Learn"},{"key":"1145_CR2","doi-asserted-by":"crossref","unstructured":"Friedman JH (2001) Greedy function approximation: a gradient boosting machine. Ann Stat. pp 1189\u20131232","DOI":"10.1214\/aos\/1013203451"},{"key":"1145_CR3","doi-asserted-by":"crossref","unstructured":"Chen T, Guestrin C (2016) Xgboost: A scalable tree boosting system. In: Proc 22nd Acm Sigkdd Intl Conf Knowl Disc Data Mining. pp. 785\u2013794","DOI":"10.1145\/2939672.2939785"},{"issue":"12","key":"1145_CR4","doi-asserted-by":"publisher","first-page":"338","DOI":"10.1007\/s10462-024-10952-7","volume":"57","author":"O Mitru\u0163","year":"2024","unstructured":"Mitru\u0163 O, Moise G, Moldoveanu A, Moldoveanu F, Leordeanu M, Petrescu L (2024) Clarity in complexity: how aggregating explanations resolves the disagreement problem. Artif Intell Rev 57(12):338","journal-title":"Artif Intell Rev"},{"key":"1145_CR5","doi-asserted-by":"crossref","unstructured":"Ribeiro MT, Singh S, Guestrin C (2016) why should i trust you? Explaining the predictions of any classifier. In: Proc 22nd ACM SIGKDD Intl Conf Knowl Disc Data Mining. pp. 1135\u20131144","DOI":"10.1145\/2939672.2939778"},{"key":"1145_CR6","unstructured":"Lundberg SM, Lee S-I (2017) A unified approach to interpreting model predictions. Adv neural inform proc syst. 30"},{"key":"1145_CR7","doi-asserted-by":"publisher","unstructured":"Mothilal RK, Sharma A, Tan C (2020) Explaining machine learning classifiers through diverse counterfactual explanations. In: Proc 2020 Conf Fairness, Accountability, Trans. ACM, Barcelona. https:\/\/doi.org\/10.1145\/3351095.3372850","DOI":"10.1145\/3351095.3372850"},{"key":"1145_CR8","doi-asserted-by":"crossref","unstructured":"Krishna S, Han T, Gu A, Wu S, Jabbari S, Lakkaraju H (2024) The disagreement problem in explainable machine learning: a practitioner\u2019s perspective. Trans Mach Learn Res.","DOI":"10.21203\/rs.3.rs-2963888\/v1"},{"key":"1145_CR9","unstructured":"Laberge G, Pequignot YB, Marchand M, Khomh F (2024) Tackling the XAI disagreement problem with regional explanations. In: Intl Conf Artif Intell Stat, PMLR. pp. 2017\u20132025."},{"issue":"3","key":"1145_CR10","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1007\/s11750-024-00670-2","volume":"32","author":"D Brughmans","year":"2024","unstructured":"Brughmans D, Melis L, Martens D (2024) Disagreement amongst counterfactual explanations: how transparency can be misleading. TOP 32(3):429\u2013462","journal-title":"TOP"},{"key":"1145_CR11","doi-asserted-by":"publisher","first-page":"462","DOI":"10.1007\/978-3-031-43418-1_28","volume-title":"Machine learning and knowledge discovery in databases: research track","author":"S M\u00fcller","year":"2023","unstructured":"M\u00fcller S, Toborek V, Beckh K, Jakobs M, Bauckhage C, Welke P (2023) An empirical evaluation of the rashomon effect in explainable machine learning. In: Koutra D, Plant C, Gomez Rodriguez M, Baralis E, Bonchi F (eds) Machine learning and knowledge discovery in databases: research track. Springer, Cham, pp 462\u2013478"},{"key":"1145_CR12","doi-asserted-by":"publisher","unstructured":"Banegas-Luna AJ, Mart\u0131nez-Cortes C, Perez-Sanchez H (2023) Fighting the disagreement in explainable machine learning with consensus. Accessed  12 Jan 2026 https:\/\/doi.org\/10.48550\/arXiv.2307.01288}","DOI":"10.48550\/arXiv.2307.01288"},{"issue":"12","key":"1145_CR13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10462-024-10952-7","volume":"57","author":"O Mitrut","year":"2024","unstructured":"Mitrut O, Moise G, Moldoveanu A, Moldoveanu F, Leordeanu M, Petrescu L (2024) Clarity in complexity: how aggregating explanations resolves the disagreement problem. Artif Intell Rev 57(12):1\u201353","journal-title":"Artif Intell Rev"},{"issue":"10","key":"1145_CR14","doi-asserted-by":"publisher","first-page":"7862","DOI":"10.1109\/TVCG.2025.3558074","volume":"31","author":"P Silva","year":"2025","unstructured":"Silva P, Guardieiro V, Barr B, Silva C, Nonato LG (2025) Visagreement: visualizing and exploring explanations (dis)agreement. IEEE Trans Visual Comput Graphics 31(10):7862\u20137875. https:\/\/doi.org\/10.1109\/TVCG.2025.3558074","journal-title":"IEEE Trans Visual Comput Graphics"},{"key":"1145_CR15","unstructured":"Pirie C, Wiratunga N, Wijekoon A, Moreno-Garcia CF (2023) Agree: a feature attribution aggregation framework to address explainer disagreements with alignment metrics. In: Malburg L, Verma D (eds.) CEUR Workshop Proceedings. CEUR Workshop Proceedings, vol. 3438. pp. 184\u2013199 . https:\/\/ceur-ws.org\/Vol-3438\/"},{"key":"1145_CR16","doi-asserted-by":"crossref","unstructured":"Goethals S, Martens D, Evgeniou T (2023) Manipulation risks in explainable AI: the implications of the disagreement problem. In: Joint Eur Conf Mach Learn Knowl Disc Databases. Springer. pp. 185\u2013200","DOI":"10.1007\/978-3-031-74633-8_12"},{"key":"1145_CR17","doi-asserted-by":"publisher","DOI":"10.1016\/j.jrt.2024.100076","volume":"17","author":"M Naiseh","year":"2024","unstructured":"Naiseh M, Simkute A, Zieni B, Jiang N, Ali R (2024) C-XAI: a conceptual framework for designing XAI tools that support trust calibration. J Responsible Tech 17:100076. https:\/\/doi.org\/10.1016\/j.jrt.2024.100076","journal-title":"J Responsible Tech"},{"key":"1145_CR18","doi-asserted-by":"crossref","unstructured":"Palacio S, Lucieri A, Munir M, Ahmed S, Hees J, Dengel A (2021) XAI handbook: towards a unified framework for explainable AI. In: Proc IEEE\/CVF Intl Conf Comput Vis, pp. 3766\u20133775","DOI":"10.1109\/ICCVW54120.2021.00420"},{"issue":"3","key":"1145_CR19","doi-asserted-by":"publisher","first-page":"170","DOI":"10.30574\/wjaets.2025.14.3.0106","volume":"14","author":"A Chinnaraju","year":"2025","unstructured":"Chinnaraju A (2025) Explainable AI (XAI) for trustworthy and transparent decision-making: a theoretical framework for AI interpretability. World J Adv Eng Tech Sci 14(3):170\u2013207","journal-title":"World J Adv Eng Tech Sci"},{"key":"1145_CR20","doi-asserted-by":"publisher","first-page":"549","DOI":"10.1109\/TFUZZ.2024.3485212","volume":"33","author":"F Yin","year":"2025","unstructured":"Yin F, Lam H-K, Watson DS (2025) Hierarchical fuzzy model-agnostic explanation: framework, algorithms, and interface for XAI. IEEE Trans Fuzzy Syst 33:549\u2013558. https:\/\/doi.org\/10.1109\/TFUZZ.2024.3485212","journal-title":"IEEE Trans Fuzzy Syst"},{"key":"1145_CR21","doi-asserted-by":"publisher","unstructured":"Kalasampath K, Spoorthi KN, Sajeev S, Kuppa SS, Ajay K, Maruthamuthu A (2025) A literature review on applications of explainable artificial intelligence (XAI). IEEE Access 13, 41111\u201341140 https:\/\/doi.org\/10.1109\/ACCESS.2025.3546681","DOI":"10.1109\/ACCESS.2025.3546681"},{"issue":"3","key":"1145_CR22","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1007\/s44230-023-00032-4","volume":"3","author":"A Bogdanova","year":"2023","unstructured":"Bogdanova A, Imakura A, Sakurai T (2023) Dc-shap method for consistent explainability in privacy-preserving distributed machine learning. Human-Centric Intell Syst 3(3):197\u2013210","journal-title":"Human-Centric Intell Syst"},{"issue":"12","key":"1145_CR23","doi-asserted-by":"publisher","first-page":"2663","DOI":"10.3390\/electronics12122663","volume":"12","author":"E Pintelas","year":"2023","unstructured":"Pintelas E, Livieris IE, Pintelas P (2023) Explainable feature extraction and prediction framework for 3d image recognition applied to pneumonia detection. Electronics 12(12):2663","journal-title":"Electronics"},{"key":"1145_CR24","unstructured":"Samek W, Wiegand T, M\u00fcller K-R (2017) Explainable artificial intelligence: Understanding, visualizing and interpreting deep learning models. arXiv:1708.08296"},{"key":"1145_CR25","doi-asserted-by":"crossref","unstructured":"Marcinkevi\u010ds R, Vogt JE (2023) Interpretable and explainable machine learning: a methods-centric overview with concrete examples. WIREs Data Mining Knowl Disc 13, 3 (2023), e1493","DOI":"10.1002\/widm.1493"},{"key":"1145_CR26","doi-asserted-by":"crossref","unstructured":"Kovalerchuk B, McCoy E (2024) Explainable machine learning for categorical and mixed data with lossless visualization. In: Artif Intell Vis Adv Vis Knowl Disc, pp. 73\u2013123. Springer, Cham","DOI":"10.1007\/978-3-031-46549-9_3"},{"issue":"4","key":"1145_CR27","doi-asserted-by":"publisher","first-page":"1760","DOI":"10.3390\/make5040086","volume":"5","author":"G Rosenberg","year":"2023","unstructured":"Rosenberg G, Brubaker JK, Schuetz MJ, Salton G, Zhu Z, Zhu EY, Kad\u0131o\u011flu S, Borujeni SE, Katzgraber HG (2023) Explainable artificial intelligence using expressive Boolean formulas. Mach Learn Knowl Extraction 5(4):1760\u20131795","journal-title":"Mach Learn Knowl Extraction"},{"issue":"3","key":"1145_CR28","first-page":"1686","volume":"12","author":"F Bachoc","year":"2023","unstructured":"Bachoc F, Gamboa F, Halford M, Loubes J-M, Risser L (2023) Explaining machine learning models using entropic variable projection. Inform Inference A J IMA 12(3):1686\u20131715","journal-title":"Inform Inference A J IMA"},{"key":"1145_CR29","unstructured":"Lundstrom D, Razaviyayn M (2023) Distributing synergy functions: unifying game-theoretic interaction methods for machine-learning explainability. arXiv:2305.03100"},{"key":"1145_CR30","doi-asserted-by":"publisher","DOI":"10.1016\/j.jii.2025.100827","volume":"45","author":"M Huelser","year":"2025","unstructured":"Huelser M, Mueller H, D\u00edaz-Rodr\u00edguez N, Holzinger A (2025) On the disagreement problem in human-in-the-loop federated machine learning. J Industrial Inform Integration 45:100827. https:\/\/doi.org\/10.1016\/j.jii.2025.100827","journal-title":"J Industrial Inform Integration"},{"key":"1145_CR31","unstructured":"Neely M, Schouten SF, Bleeker MJR, Lucic A (2021) Order in the court: explainable ai methods prone to disagreement. arXiv: 2105.03287"},{"key":"1145_CR32","doi-asserted-by":"publisher","unstructured":"Aswani S, Shetty S (2024) Explainable news summarization\u2014analysis and mitigation of disagreement problem. https:\/\/doi.org\/10.48550\/arXiv.2410.18560","DOI":"10.48550\/arXiv.2410.18560"},{"key":"1145_CR33","doi-asserted-by":"publisher","DOI":"10.1007\/s13198-025-02712-9","author":"N Bhardwaj","year":"2025","unstructured":"Bhardwaj N, Parashar G (2025) The disagreement dilemma in explainable AI: can bias reduction bridge the gap. Intl J Syst Assurance Eng Mgmt. https:\/\/doi.org\/10.1007\/s13198-025-02712-9","journal-title":"Intl J Syst Assurance Eng Mgmt"},{"key":"1145_CR34","unstructured":"Poiret C, Grigis A, Thomas J, Noulhiane M (2023) Can we agree? On the rashomon effect and the reliability of post-hoc explainable AI. arXiv:2308.07247"},{"key":"1145_CR35","unstructured":"Munoz C, Costa K, Modenesi B, Koshiyama A (2023) Local and global explainability metrics for machine learning predictions. arXiv:2302.12094"},{"key":"1145_CR36","unstructured":"Flora M, Potvin C, McGovern A, Handler S (2022) Comparing explanation methods for traditional machine learning models part 2: quantifying model explainability faithfulness and improvements with dimensionality reduction. arXiv:2211.10378"},{"key":"1145_CR37","unstructured":"Li S, Deng Q, Barnard AS (2024) Exagree: towards explanation agreement in explainable machine learning. Accessed 12 Jan 2026 https:\/\/arxiv.org\/abs\/2411.01956"},{"key":"1145_CR38","doi-asserted-by":"publisher","unstructured":"Gaurav D, Tiwari S (2023) Interpretability vs explainability: the black box of machine learning. In: 2023 Intl Conf Comput Sci Inform Tech Eng (ICCoSITE), pp. 523\u2013528 . https:\/\/doi.org\/10.1109\/ICCoSITE57641.2023.10127717","DOI":"10.1109\/ICCoSITE57641.2023.10127717"},{"issue":"1","key":"1145_CR39","doi-asserted-by":"publisher","first-page":"8984","DOI":"10.1038\/s41598-023-35795-0","volume":"13","author":"RO Alabi","year":"2023","unstructured":"Alabi RO, Elmusrati M, Leivo I, Almangush A, M\u00e4kitie AA (2023) Machine learning explainability in nasopharyngeal cancer survival using lime and shap. Sci Rep 13(1):8984","journal-title":"Sci Rep"},{"key":"1145_CR40","doi-asserted-by":"crossref","unstructured":"Bounds CP, Uddin M, Desai S (2023) Tuning of turbulence model closure coefficients using an explainability based machine learning algorithm. Technical report, SAE Technical Paper.","DOI":"10.4271\/2023-01-0562"},{"key":"1145_CR41","unstructured":"Hinterleitner A, Bartz-Beielstein T (2025) Tuning for trustworthiness\u2013balancing performance and explanation consistency in neural network optimization. Accessed 12 Jan 2026 https:\/\/arxiv.org\/abs\/2505.07910"},{"key":"1145_CR42","unstructured":"Poh RLT, Keoh SL, Li L (2025) The state of post-hoc local XAI techniques for image processing: challenges and motivations.Accessed 12 Jan 2026 https:\/\/arxiv.org\/abs\/2501.06253"},{"key":"1145_CR43","doi-asserted-by":"crossref","unstructured":"Schwarzschild A, Cembalest M, Rao K, Hines K, Dickerson J (2023) Reckoning with the disagreement problem: Explanation consensus as a training objective. In: Proc 2023 AAAI\/ACM Conf on AI, Ethics Soc, pp. 662\u2013678","DOI":"10.1145\/3600211.3604687"},{"key":"1145_CR44","unstructured":"Hu L, Jiang M, Dong J, Liu X, He Z (2024) Interpretable clustering: a survey. Accessed 12 Jan 2026 https:\/\/arxiv.org\/abs\/2409.00743"},{"key":"1145_CR45","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2025.111364","volume":"162","author":"L Hu","year":"2025","unstructured":"Hu L, Jiang M, Dong J, Liu X, He Z (2025) Interpretable categorical data clustering via hypothesis testing. Pattern Recogn 162:111364","journal-title":"Pattern Recogn"},{"key":"1145_CR46","doi-asserted-by":"publisher","unstructured":"Siddhartha M (2020) Heart disease dataset (comprehensive). IEEE Dataport . https:\/\/doi.org\/10.21227\/dz4t-cm36","DOI":"10.21227\/dz4t-cm36"},{"key":"1145_CR47","doi-asserted-by":"publisher","unstructured":"Bartley C (2016) Replication data for south african heart disease. Harvard Dataverse. https:\/\/doi.org\/10.7910\/DVN\/76SIQD","DOI":"10.7910\/DVN\/76SIQD"},{"key":"1145_CR48","unstructured":"Requests D (2023) National Health and Nutrition Examination Survey (NHANES) National Cardiovascular Disease Surveillance System. Centers for Disease Control and Prevention. Accessed 12 Jan 2026 https:\/\/www.cdc.gov\/nchs\/nhanes\/"},{"key":"1145_CR49","unstructured":"Sigillito V (1990) Pima Indians diabetes database dataset. Accessed 12 Jan 2026 https:\/\/www.openml.org\/search?type=data&sort=runs&id=37&status=active"},{"key":"1145_CR50","unstructured":"Albert Bifet EI (2009) Airlines dataset. Accessed 12 Jan 2026 https:\/\/www.openml.org\/search?type=data&sort=runs&id=1169&status=active"},{"key":"1145_CR51","unstructured":"(USGS), UGS (2014) USFS: forest cover types dataset. Accessed 12 Jan 2026 https:\/\/www.openml.org\/search?type=data&sort=runs&id=180&status=active"},{"key":"1145_CR52","unstructured":"Rami Mustafa A Mohammad, FT LeeMcCluskey (2016) Phishing Websites Dataset. Accessed 12 Jan 2026 https:\/\/www.openml.org\/search?type=data&sort=runs&id=4534&status=active"},{"key":"1145_CR53","unstructured":"Yeh I-C (2009) Default of Credit card clients. UCI Machine Learning Repository. Accessed 12 Jan 2026 https:\/\/archive.ics.uci.edu\/dataset\/350\/default+of+credit+card+clients"},{"key":"1145_CR54","unstructured":"ML O (2017) Titanic dataset. Accessed 12 Jan 2026 https:\/\/www.openml.org\/search?type=data&sort=runs&id=40704&status=active"},{"key":"1145_CR55","unstructured":"Aeberhard S, Forina M (1992) Wine. UCI machine learning repository. Accessed 12 Jan 2026 https:\/\/archive.ics.uci.edu\/dataset\/109\/wine"},{"issue":"1","key":"1145_CR56","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1007\/s10994-020-05896-2","volume":"110","author":"D Bertsimas","year":"2021","unstructured":"Bertsimas D, Orfanoudaki A, Wiberg H (2021) Interpretable clustering: an optimization approach. Mach Learn 110(1):89\u2013138","journal-title":"Mach Learn"}],"container-title":["Evolutionary Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12065-026-01145-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s12065-026-01145-y","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12065-026-01145-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,16]],"date-time":"2026-03-16T10:08:42Z","timestamp":1773655722000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s12065-026-01145-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2]]},"references-count":56,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,2]]}},"alternative-id":["1145"],"URL":"https:\/\/doi.org\/10.1007\/s12065-026-01145-y","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-4835453\/v1","asserted-by":"object"}]},"ISSN":["1864-5909","1864-5917"],"issn-type":[{"value":"1864-5909","type":"print"},{"value":"1864-5917","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2]]},"assertion":[{"value":"31 July 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 December 2025","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 January 2026","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 February 2026","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors of this paper certify that they have no affiliations with or involvement in any organization or entity with any financial interest (such as honoraria; educational grants; participation in speakers\u2019 bureaus; membership, employment, consultancies, stock ownership, or other equity interest; and expert testimony or patent-licensing arrangements), or non-financial interest (such as personal or professional relationships, affiliations, knowledge or beliefs) in the subject matter or materials discussed in this manuscript.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"27"}}