{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:09:50Z","timestamp":1760242190462,"version":"build-2065373602"},"publisher-location":"Cham","reference-count":29,"publisher":"Springer Nature Switzerland","isbn-type":[{"value":"9783032083265","type":"print"},{"value":"9783032083272","type":"electronic"}],"license":[{"start":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T00:00:00Z","timestamp":1760227200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T00:00:00Z","timestamp":1760227200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Convolutional Neural Networks (CNNs), such as VGG and ResNet, have been widely used for image classification for several years. Numerous explainable AI (XAI) algorithms, including Grad-CAM and XRAI, have been proposed to enhance interpretability in this domain. However, a persistent challenge lies in quantitatively comparing different XAI algorithms, variants of the same algorithm, or combinations of CNN models and XAI algorithms. In this work, we introduce XAIEV \u2013 a versatile framework for computationally evaluating the quality of saliency-map-based XAI algorithms. This framework includes (A) a benchmark dataset (traffic sign recognition) with a known ground truth and (B) a software toolbox designed to facilitate the evaluation pipeline. The pipeline consists of four steps: (1) model training, (2) applying XAI algorithms to generate weighted saliency maps, (3) generating new test images with varying percentages of \u201cimportant\u201d pixels removed or retained, and (4) statistically evaluating accuracy changes on these test images and comparison to the ground truth. Based on this statistical evaluation, we define an Accuracy-Sensitivity Quotient (ASQ) as a novel quality metric for XAI algorithms applied to image classification. Using the XAIEV framework, we compare various combinations of CNN architectures (\u201cSimpleCNN\u201d (custom model), VGG, ResNet, ConvNext) with multiple XAI algorithms (Grad-CAM, XRAI, LIME, PRISM). Our numerical results reveal that the performance of XAI algorithms is highly dependent on the underlying CNN model.<\/jats:p>","DOI":"10.1007\/978-3-032-08327-2_12","type":"book-chapter","created":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:06:48Z","timestamp":1760206008000},"page":"250-263","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["XAIEV \u2013 A Framework for\u00a0the\u00a0Evaluation of\u00a0XAI-Algorithms for\u00a0Image Classification"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7462-771X","authenticated-orcid":false,"given":"Carsten","family":"Knoll","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Julian","family":"Ullrich","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas","family":"Manjooran","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-3522-2246","authenticated-orcid":false,"given":"Kilian","family":"G\u00f6ller","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-9227-9496","authenticated-orcid":false,"given":"Haadia","family":"Amjad","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7436-0103","authenticated-orcid":false,"given":"Ronald","family":"Tetzlaff","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8389-8869","authenticated-orcid":false,"given":"Steffen","family":"Seitz","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,10,12]]},"reference":[{"key":"12_CR1","first-page":"15784","volume":"35","author":"C Agarwal","year":"2022","unstructured":"Agarwal, C., et al.: OpenXAI: towards a transparent evaluation of post hoc model explanations. Adv. Neural. Inf. Process. Syst. 35, 15784\u201315799 (2022)","journal-title":"Adv. Neural. Inf. Process. Syst."},{"key":"12_CR2","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1016\/j.inffus.2021.11.008","volume":"81","author":"L Arras","year":"2022","unstructured":"Arras, L., Osman, A., Samek, W.: CLEVR-XAI: a benchmark dataset for the ground truth evaluation of neural network explanations. Inform. Fusion 81, 14\u201340 (2022)","journal-title":"Inform. Fusion"},{"key":"12_CR3","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., Fei-Fei, L.: ImageNet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248\u2013255 (2009)","DOI":"10.1109\/CVPR.2009.5206848"},{"issue":"2","key":"12_CR4","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1023\/B:VISI.0000022288.19776.77","volume":"59","author":"PF Felzenszwalb","year":"2004","unstructured":"Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient graph-based image segmentation. Inter. J. Comput. Vis. 59(2), 167\u2013181 (2004)","journal-title":"Inter. J. Comput. Vis."},{"key":"12_CR5","unstructured":"He, K., Zhang, X., Ren, S., Sun, J.: Deep Residual Learning for Image Recognition. CoRR arXiv: 1512.03385 (2015)"},{"issue":"34","key":"12_CR6","first-page":"1","volume":"24","author":"A Hedstr\u00f6m","year":"2023","unstructured":"Hedstr\u00f6m, A., et al.: Quantus: an explainable AI toolkit for responsible evaluation of neural network explanations and beyond. J. Mach. Learn. Res. 24(34), 1\u201311 (2023)","journal-title":"J. Mach. Learn. Res."},{"key":"12_CR7","doi-asserted-by":"crossref","unstructured":"Hesse, R., Schaub-Meyer, S., Roth, S.: Funnybirds: a synthetic vision dataset for a part-based analysis of explainable AI methods. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision, pp. 3981\u20133991 (2023)","DOI":"10.1109\/ICCV51070.2023.00368"},{"key":"12_CR8","doi-asserted-by":"crossref","unstructured":"Houben, S., Stallkamp, J., Salmen, J., Schlipsing, M., Igel, C.: Detection of traffic signs in real-world images: the german traffic sign detection benchmark. In: International Joint Conference on Neural Networks, vol. 1288 (2013)","DOI":"10.1109\/IJCNN.2013.6706807"},{"key":"12_CR9","doi-asserted-by":"crossref","unstructured":"Kapishnikov, A., Bolukbasi, T., Vi\u00e9gas, F., Terry, M.: XRAI: better attributions through regions. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision, pp. 4948\u20134957 (2019)","DOI":"10.1109\/ICCV.2019.00505"},{"key":"12_CR10","unstructured":"Knoll, C., Ullrich, J., Manjooran, T.: Framework for the Evaluation of XAI Algorithms (XAIEV) - Source Repository on GitHub (2025). https:\/\/github.com\/cknoll\/xaiev\/"},{"key":"12_CR11","unstructured":"Kokhlikyan, N. et al.: Captum: A unified and generic model interpretability library for PyTorch. arXiv: 2009.07896 (2020)"},{"key":"12_CR12","doi-asserted-by":"crossref","unstructured":"Liu, Z. et al.: Swin Transformer: Hierarchical Vision Transformer using Shifted Windows. arXiv: 2103.14030 (2021)","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"12_CR13","doi-asserted-by":"crossref","unstructured":"Liu, Z., Mao, H., Wu, C.-Y., Feichtenhofer, C., Darrell, T., Xie, S.: A ConvNet for the 2020s. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 11976\u201311986 (2022)","DOI":"10.1109\/CVPR52688.2022.01167"},{"key":"12_CR14","doi-asserted-by":"crossref","unstructured":"M\u00fcller, R.: How explainable AI affects human performance: a systematic review of the behavioural consequences of saliency maps. In: International Journal of Human\u2013Computer Interaction, pp. 1\u201332 (2024)","DOI":"10.31219\/osf.io\/ms2kv"},{"key":"12_CR15","doi-asserted-by":"crossref","unstructured":"M\u00fcller, R., D\u00fcrschmidt, M., Ullrich, J., Knoll, C., Weber, S., Seitz, S.: Do humans and convolutional neural networks attend to similar areas during scene classification: effects of task and image type. Appli. Sci. 14(6) (2024)","DOI":"10.3390\/app14062648"},{"issue":"4","key":"12_CR16","doi-asserted-by":"publisher","first-page":"2371","DOI":"10.1080\/10447318.2024.2323263","volume":"41","author":"R M\u00fcller","year":"2025","unstructured":"M\u00fcller, R., Ullrich, M.T.J., Seitz, S., Knoll, C.: Interpretability is in the eye of the beholder: human versus artificial classification of image segments generated by humans versus XAI. Inter. J. Hum. Comput. Interact. 41(4), 2371\u20132393 (2025)","journal-title":"Inter. J. Hum. Comput. Interact."},{"key":"12_CR17","doi-asserted-by":"publisher","first-page":"124962","DOI":"10.1109\/ACCESS.2023.3330442","volume":"11","author":"L Nanni","year":"2023","unstructured":"Nanni, L., Loreggia, A., Barcellona, L., Ghidoni, S.: Building ensemble of deep networks: convolutional networks and transformers. IEEE Access 11, 124962\u2013124974 (2023)","journal-title":"IEEE Access"},{"key":"12_CR18","doi-asserted-by":"crossref","unstructured":"Ribeiro, M. T., Singh, S., Guestrin, C.: Why Should I Trust You?\": Explaining the Predictions of Any Classifier. arXiv: 1602.04938 (2016)","DOI":"10.18653\/v1\/N16-3020"},{"issue":"11","key":"12_CR19","doi-asserted-by":"publisher","first-page":"2660","DOI":"10.1109\/TNNLS.2016.2599820","volume":"28","author":"W Samek","year":"2016","unstructured":"Samek, W., Binder, A., Montavon, G., Lapuschkin, S., M\u00fcller, K.-R.: Evaluating the visualization of what a deep neural network has learned. IEEE Trans. Neural Netw. Learn. Syst. 28(11), 2660\u20132673 (2016)","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"12_CR20","doi-asserted-by":"crossref","unstructured":"Saranya, A., Subhashini, R.: A systematic review of explainable artificial intelligence models and applications: recent developments and future trends. Decision Analytics J. 7 (2023)","DOI":"10.1016\/j.dajour.2023.100230"},{"key":"12_CR21","doi-asserted-by":"crossref","unstructured":"Selvaraju, R. R., Das, A., Vedantam, R., Cogswell, M., Parikh, D., Batra, D.: Grad-CAM: Why did you say that? Visual Explanations from Deep Networks via Gradient-based Localization. arXiv: 1610.02391 (2016)","DOI":"10.1109\/ICCV.2017.74"},{"key":"12_CR22","unstructured":"Simonyan, K., Zisserman, A.: Very Deep Convolutional Networks for Large- Scale Image Recognition. arXiv: 1409.1556 (2014)"},{"key":"12_CR23","unstructured":"Sundararajan, M., Taly, A., Yan, Q.: Axiomatic Attribution for Deep Networks, arXiv: 1703.01365 (2017)"},{"key":"12_CR24","doi-asserted-by":"crossref","unstructured":"Szandaa, T.: Enhancing Deep Neural Network Saliency Visualizations with Gradual Extrapolation. arXiv: 2104.04945 (2021)","DOI":"10.1109\/ACCESS.2021.3093824"},{"key":"12_CR25","doi-asserted-by":"publisher","first-page":"749","DOI":"10.1007\/978-3-031-08751-6_54","volume-title":"Computational Science \u2013 ICCS 2022","author":"T Szandaa","year":"2022","unstructured":"Szandaa, T., Maciejewski, H.: PRISM: principal image sections mapping. In: Groen, D., de Mulatier, C., Paszynski, M., Krzhizhanovskaya, V.V., Dongarra, J.J., Sloot, P.M.A. (eds.) Computational Science \u2013 ICCS 2022, pp. 749\u2013760. Springer International Publishing, Cham (2022). https:\/\/doi.org\/10.1007\/978-3-031-08751-6_54"},{"key":"12_CR26","unstructured":"Yang, H., Wang, W., Cao, Z., Duan, Z., Liu, X.: InDL: A New Dataset and Benchmark for In-Diagram Logic Interpretation based on Visual Illusion (2023). arXiv: 2305.17716"},{"issue":"8","key":"12_CR27","doi-asserted-by":"publisher","first-page":"1546","DOI":"10.1109\/TPAMI.2014.2299799","volume":"36","author":"AR Zamir","year":"2014","unstructured":"Zamir, A.R., Shah, M.: Image geo-localization based on multiple nearest neighbor feature matching using generalized graphs. IEEE Trans. Pattern Anal. Mach. Intell. 36(8), 1546\u20131558 (2014)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"12_CR28","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"818","DOI":"10.1007\/978-3-319-10590-1_53","volume-title":"Computer Vision \u2013 ECCV 2014","author":"MD Zeiler","year":"2014","unstructured":"Zeiler, M.D., Fergus, R.: Visualizing and understanding convolutional networks. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8689, pp. 818\u2013833. Springer, Cham (2014). https:\/\/doi.org\/10.1007\/978-3-319-10590-1_53"},{"key":"12_CR29","doi-asserted-by":"crossref","unstructured":"Zhou, B., Khosla, A., Lapedriza, \u00c0., Oliva, A., Torralba, A.: Learning Deep Features for Discriminative Localization. arXiv: 1512.04150 (2015)","DOI":"10.1109\/CVPR.2016.319"}],"container-title":["Communications in Computer and Information Science","Explainable Artificial Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-032-08327-2_12","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:06:56Z","timestamp":1760206016000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-032-08327-2_12"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,12]]},"ISBN":["9783032083265","9783032083272"],"references-count":29,"URL":"https:\/\/doi.org\/10.1007\/978-3-032-08327-2_12","relation":{},"ISSN":["1865-0929","1865-0937"],"issn-type":[{"value":"1865-0929","type":"print"},{"value":"1865-0937","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,12]]},"assertion":[{"value":"12 October 2025","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"The authors have no competing interests to declare that are relevant to the content of this article.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Disclosure of Interests"}},{"value":"xAI","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"World Conference on Explainable Artificial Intelligence","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Istanbul","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"T\u00fcrkiye","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2025","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"9 July 2025","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"11 July 2025","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"3","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"xai2025","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/xaiworldconference.com\/2025\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}}]}}