{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,14]],"date-time":"2026-10-14T11:11:48Z","timestamp":1791976308062,"version":"4.4.0"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,8,7]],"date-time":"2025-08-07T00:00:00Z","timestamp":1754524800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,8,7]],"date-time":"2025-08-07T00:00:00Z","timestamp":1754524800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"OsloMet - Oslo Metropolitan University"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Complex artificial intelligence models, like deep neural networks, have shown exceptional capabilities to detect early-stage polyps and tumors in the gastrointestinal tract. These technologies are already beginning to assist gastroenterologists in the endoscopy suite. To understand how these complex models work and their limitations, model explanations can be useful. Moreover, medical doctors specialized in gastroenterology can provide valuable feedback on the model explanations. This study explores three different explainable artificial intelligence methods for explaining a deep neural network detecting gastrointestinal abnormalities. The model explanations are presented to gastroenterologists. Furthermore, the clinical applicability of the explanation methods from the healthcare personnel\u2019s perspective is discussed. Our findings indicate that the explanation methods are not meeting the requirements for clinical use, but that they can provide valuable information to researchers and model developers. Higher quality datasets and careful considerations regarding how the explanations are presented might lead to solutions that are more welcome in the clinic.<\/jats:p>","DOI":"10.1038\/s41598-025-14408-y","type":"journal-article","created":{"date-parts":[[2025,8,7]],"date-time":"2025-08-07T04:44:32Z","timestamp":1754541872000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Exploring the clinical value of concept-based AI explanations in gastrointestinal disease detection"],"prefix":"10.1038","volume":"15","author":[{"given":"Andrea M.","family":"Stor\u00e5s","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maximilian","family":"Dreyer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Frederik","family":"Pahde","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sebastian","family":"Lapuschkin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wojciech","family":"Samek","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"P\u00e5l","family":"Halvorsen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thomas","family":"de Lange","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuichi","family":"Mori","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Hann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tyler M.","family":"Berzin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sravanthi","family":"Parasa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael A.","family":"Riegler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,8,7]]},"reference":[{"issue":"01","key":"14408_CR1","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1055\/s-0035-1569580","volume":"48","author":"MD Rutter","year":"2016","unstructured":"Rutter, M. D. et al. The European Society of Gastrointestinal Endoscopy quality improvement initiative: developing performance measures. Endoscopy. 48(01), 81\u201389. https:\/\/doi.org\/10.1055\/s-0035-1569580 (2016).","journal-title":"Endoscopy."},{"issue":"12","key":"14408_CR2","doi-asserted-by":"publisher","first-page":"1923","DOI":"10.1136\/gutjnl-2016-312044","volume":"65","author":"CJ Rees","year":"2016","unstructured":"Rees, C. J. et al. UK key performance indicators and quality assurance standards for colonoscopy. Gut. 65(12), 1923\u20131929. https:\/\/doi.org\/10.1136\/gutjnl-2016-312044 (2016).","journal-title":"Gut."},{"issue":"1","key":"14408_CR3","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1097\/00008469-200402000-00011","volume":"13","author":"P Rozen","year":"2004","unstructured":"Rozen, P. Cancer of the gastrointestinal tract: early detection or early prevention?. Eur. J. Cancer Prev. 13(1), 71\u201375 (2004).","journal-title":"Eur. J. Cancer Prev."},{"key":"14408_CR4","doi-asserted-by":"publisher","unstructured":"Levin, B. et al. Screening and Surveillance for the Early Detection of Colorectal Cancer and Adenomatous Polyps, 2008: A Joint Guideline from the American Cancer Society, the US Multi-Society Task Force on Colorectal Cancer, and the American College of Radiology. CA: A Cancer Journal for Clinicians. 58(3), 130\u2013160. https:\/\/doi.org\/10.3322\/CA.2007.0018 (2008).","DOI":"10.3322\/CA.2007.0018"},{"issue":"1","key":"14408_CR5","doi-asserted-by":"publisher","first-page":"S92","DOI":"10.1038\/bjc.2015.48","volume":"112","author":"R Neal","year":"2015","unstructured":"Neal, R. et al. Is increased time to diagnosis and treatment in symptomatic cancer associated with poorer outcomes?. Syst. Rev. Br. J. Cancer 112(1), S92\u2013S107. https:\/\/doi.org\/10.1038\/bjc.2015.48 (2015).","journal-title":"Syst. Rev. Br. J. Cancer"},{"issue":"7","key":"14408_CR6","doi-asserted-by":"publisher","first-page":"610","DOI":"10.1038\/s42256-021-00338-7","volume":"3","author":"AJ DeGrave","year":"2021","unstructured":"DeGrave, A. J., Janizek, J. D. & Lee, S. I. AI for radiographic COVID-19 detection selects shortcuts over signal. Nat. Mach. Intell. 3(7), 610\u2013619. https:\/\/doi.org\/10.1038\/s42256-021-00338-7 (2021).","journal-title":"Nat. Mach. Intell."},{"key":"14408_CR7","doi-asserted-by":"crossref","unstructured":"Pahde, F., Dreyer, M., Samek, W. & Lapuschkin, S. Reveal to Revise: An Explainable AI Life Cycle for Iterative Bias Correction of Deep Models. In: Medical Image Computing and Computer Assisted Intervention \u2013 MICCAI 2023: 26th International Conference, Vancouver, BC, Canada, October 8\u201312, (2023), Proceedings, Part II. Berlin, Heidelberg: Springer-Verlag; 2023. p. 596\u2013606.","DOI":"10.1007\/978-3-031-43895-0_56"},{"key":"14408_CR8","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2021.102305","volume":"75","author":"B Cassidy","year":"2022","unstructured":"Cassidy, B., Kendrick, C., Brodzicki, A., Jaworek-Korjakowska, J. & Yap, M. H. Analysis of the ISIC image datasets: Usage, benchmarks and recommendations. Med. Image Anal. 75, 102305. https:\/\/doi.org\/10.1016\/j.media.2021.102305 (2022).","journal-title":"Med. Image Anal.."},{"key":"14408_CR9","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2024.102472","volume":"110","author":"NA Wani","year":"2024","unstructured":"Wani, N. A., Kumar, R., Mamta, Bedi J. & Rida, I. Explainable AI-driven IoMT fusion: Unravelling techniques, opportunities, and challenges with Explainable AI in healthcare. Inf. Fusion 110, 102472. https:\/\/doi.org\/10.1016\/j.inffus.2024.102472 (2024).","journal-title":"Inf. Fusion"},{"key":"14408_CR10","unstructured":"Lundberg, SM. & Lee, SI. A Unified Approach to Interpreting Model Predictions. In: Guyon I, Luxburg UV, Bengio S, Wallach H, Fergus R, Vishwanathan S, et al., editors. Adv. Neural Inf. Process. Syst.. vol.\u00a030. Curran Associates, Inc.; 2017. p. 4765\u20134774. Available from: https:\/\/proceedings.neurips.cc\/paper\/2017\/file\/8a20a8621978632d76c43dfd28b67767-Paper.pdf."},{"key":"14408_CR11","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2023.107879","volume":"243","author":"NA Wani","year":"2024","unstructured":"Wani, N. A., Kumar, R. & Bedi, J. DeepXplainer: An interpretable deep learning based approach for lung cancer detection using explainable artificial intelligence. Comput. Methods Programs Biomed. 243, 107879. https:\/\/doi.org\/10.1016\/j.cmpb.2023.107879 (2024).","journal-title":"Comput. Methods Programs Biomed."},{"key":"14408_CR12","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2024.108939","volume":"136","author":"NA Wani","year":"2024","unstructured":"Wani, N. A., Kumar, R. & Bedi, J. Harnessing Fusion Modeling for Enhanced Breast Cancer Classification through Interpretable Artificial Intelligence and In-Depth Explanations. Eng. Appl. Artif. Intell. 136, 108939. https:\/\/doi.org\/10.1016\/j.engappai.2024.108939 (2024).","journal-title":"Eng. Appl. Artif. Intell."},{"issue":"1","key":"14408_CR13","doi-asserted-by":"publisher","first-page":"1504","DOI":"10.1109\/TCE.2024.3419814","volume":"71","author":"NA Wani","year":"2025","unstructured":"Wani, N. A., Bedi, J., Kumar, R., Khan, M. A. & Rida, I. Synergizing Fusion Modeling for Accurate Cardiac Prediction Through Explainable Artificial Intelligence. IEEE Trans. Consum. Electron. 71(1), 1504\u20131512. https:\/\/doi.org\/10.1109\/TCE.2024.3419814 (2025).","journal-title":"IEEE Trans. Consum. Electron."},{"key":"14408_CR14","doi-asserted-by":"crossref","unstructured":"Selvaraju, RR., Cogswell, M., Das, A., Vedantam, R., Parikh, D. & Batra, D. Grad-CAM: Visual Explanations From Deep Networks via Gradient-Based Localization. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV); (2017). p. 618\u2013626. Available from: https:\/\/openaccess.thecvf.com\/content_ICCV_2017\/papers\/Selvaraju_Grad-CAM_Visual_Explanations_ICCV_2017_paper.pdf.","DOI":"10.1109\/ICCV.2017.74"},{"key":"14408_CR15","doi-asserted-by":"publisher","unstructured":"Hicks, S., Stor\u00e5s, A., Riegler, MA., Midoglu, C., Hammou, M., de Lange, T., et al. Visual explanations for polyp detection: How medical doctors assess intrinsic versus extrinsic explanations. PLOS ONE. 19(5), 1\u201315. https:\/\/doi.org\/10.1371\/journal.pone.0304069 (2024).","DOI":"10.1371\/journal.pone.0304069"},{"key":"14408_CR16","unstructured":"Kim, B., Wattenberg, M., Gilmer, J., Cai, C., Wexler, J., Viegas, F., et al. Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV). In: Dy J, Krause A, editors. Proceedings of the 35th International Conference on Machine Learning. vol.\u00a080 of Proceedings of Machine Learning Research. PMLR; p. 2668\u20132677. Available from: https:\/\/proceedings.mlr.press\/v80\/kim18d.html (2018)."},{"issue":"9","key":"14408_CR17","doi-asserted-by":"publisher","first-page":"1006","DOI":"10.1038\/s42256-023-00711-8","volume":"5","author":"R Achtibat","year":"2023","unstructured":"Achtibat, R. et al. From attribution maps to human-understandable explanations through concept relevance propagation. Nat. Mach. Intell. 5(9), 1006\u20131019. https:\/\/doi.org\/10.1038\/s42256-023-00711-8 (2023).","journal-title":"Nat. Mach. Intell."},{"key":"14408_CR18","doi-asserted-by":"publisher","first-page":"2053","DOI":"10.59275\/j.melba.2024-e7fd","volume":"2","author":"AM Stor\u00e5s","year":"2024","unstructured":"Stor\u00e5s, A. M. & Sundgaard, J. V. Looking into Concept Explanation Methods for Diabetic Retinopathy Classification. J. Mach. Learn. Biomed. Imaging. 2, 2053\u20132066. https:\/\/doi.org\/10.59275\/j.melba.2024-e7fd (2024).","journal-title":"J. Mach. Learn. Biomed. Imaging."},{"key":"14408_CR19","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J. Deep Residual Learning for Image Recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2016. p. 770\u2013778.","DOI":"10.1109\/CVPR.2016.90"},{"key":"14408_CR20","doi-asserted-by":"publisher","unstructured":"Borgli, H. et al. HyperKvasir, a comprehensive multi-class image and video dataset for gastrointestinal endoscopy. Sci. Data. 7(1). https:\/\/doi.org\/10.1038\/s41597-020-00622-y (2020).","DOI":"10.1038\/s41597-020-00622-y"},{"key":"14408_CR21","doi-asserted-by":"crossref","unstructured":"Deng, J. et al. ImageNet: A large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition; 248\u2013255 (2009).","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"14408_CR22","doi-asserted-by":"crossref","unstructured":"Dreyer, M., Achtibat, R., Samek, W. & Lapuschkin, S. Understanding the (Extra-)Ordinary: Validating Deep Model Decisions with Prototypical Concept-based Explanations. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops; 2024. p. 3491\u20133501. Available from: https:\/\/openaccess.thecvf.com\/content\/CVPR2024W\/SAIAD\/html\/Dreyer_Understanding_the_Extra-Ordinary_Validating_Deep_Model_Decisions_with_Prototypical_Concept-based_CVPRW_2024_paper.html.","DOI":"10.1109\/CVPRW63382.2024.00353"},{"key":"14408_CR23","unstructured":"Pahde, F. et al. Navigating Neural Space: Revisiting Concept Activation Vectors to Overcome Directional Divergence. Preprint at arXiv: 2202.03482 (2025)."},{"key":"14408_CR24","doi-asserted-by":"publisher","unstructured":"Thambawita, V., Str\u00fcmke, I., Hicks, SA., Halvorsen, P., Parasa, S. & Riegler, MA. Impact of image resolution on deep learning performance in endoscopy image classification: An experimental study using a large dataset of endoscopic images. Diagnostics. 11(12). https:\/\/doi.org\/10.3390\/diagnostics11122183 (2021).","DOI":"10.3390\/diagnostics11122183"},{"key":"14408_CR25","unstructured":"Biecek, P. & Samek, W. Position: explain to question not to justify. In: Proceedings of the 41st International Conference on Machine Learning (ICML\u201924), Vol. 235, 3996\u20134006 (2024)."},{"key":"14408_CR26","unstructured":"Paszke, A.  et al. PyTorch: An Imperative Style, High-Performance Deep Learning Library. In: Wallach H, Larochelle H, Beygelzimer A, d\u2019Alch\u00e9-Buc F, Fox E, Garnett R, editors. Advances in Neural Information Processing Systems. Curran Associates, Inc.; (2019). Available from: https:\/\/proceedings.neurips.cc\/paper\/2019\/file\/bdbca288fee7f92f2bfa9f7012727740-Paper.pdf."},{"key":"14408_CR27","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2020.107332","volume":"110","author":"X Ma","year":"2021","unstructured":"Ma, X. et al. Understanding adversarial attacks on deep learning based medical image analysis systems. Pattern Recognit. 110, 107332. https:\/\/doi.org\/10.1016\/j.patcog.2020.107332 (2021).","journal-title":"Pattern Recognit."},{"key":"14408_CR28","doi-asserted-by":"crossref","unstructured":"Jha, D. et al. Kvasir-Instrument: Diagnostic and therapeutic tool segmentation dataset in Gastrointestinal endoscopy. In: Proceeedings of the International Conference on MultiMedia Modeling (MMM). p. 218\u2013229, (2021).","DOI":"10.1007\/978-3-030-67835-7_19"},{"key":"14408_CR29","doi-asserted-by":"crossref","unstructured":"Jha, D. et al. Kvasir-SEG: A Segmented Polyp Dataset. In: International Conference on Multimedia Modeling. Springer. p. 451\u2013462, (2020).","DOI":"10.1007\/978-3-030-37734-2_37"},{"key":"14408_CR30","doi-asserted-by":"crossref","unstructured":"Zuiderveld, K. Contrast limited adaptive histogram equalization. Graphics gems. 474\u2013485 (1994).","DOI":"10.1016\/B978-0-12-336156-1.50061-6"},{"key":"14408_CR31","doi-asserted-by":"publisher","unstructured":"Buslaev, A. et al. Albumentations: Fast and Flexible Image Augmentations. Information. 11(2). https:\/\/doi.org\/10.3390\/info11020125 (2020).","DOI":"10.3390\/info11020125"},{"key":"14408_CR32","unstructured":"Gildenblat, J. contributors. PyTorch library for CAM methods. GitHub. https:\/\/github.com\/jacobgil\/pytorch-grad-cam (2021)."},{"key":"14408_CR33","unstructured":"Anders, C. J., Neumann, D., Samek, W., M\u00fcller, KR. & Lapuschkin, S. Software for Dataset-wide XAI: From Local Explanations to Global Insights with Zennit, CoRelAy, and ViRelAy. Preprint at arXiv: 2106.13200 (2023)."},{"key":"14408_CR34","unstructured":"TorchVision maintainers and contributors. TorchVision: PyTorch\u2019s Computer Vision library. GitHub. https:\/\/github.com\/pytorch\/vision (2016)."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-14408-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-14408-y","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-14408-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,8]],"date-time":"2025-09-08T22:24:56Z","timestamp":1757370296000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-14408-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,7]]},"references-count":34,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["14408"],"URL":"https:\/\/doi.org\/10.1038\/s41598-025-14408-y","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,8,7]]},"assertion":[{"value":"29 July 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 July 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 August 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"T.M.B. is a consultant for Wision AI, Medtronic, Boston Scientific, RSIP Vision, Magentiq Eye. All the remaining authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"All participants in the model explanation feedback survey had provided written informed consent.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}}],"article-number":"28860"}}