{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,2]],"date-time":"2026-02-02T13:42:35Z","timestamp":1770039755078,"version":"3.49.0"},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2024,3,27]],"date-time":"2024-03-27T00:00:00Z","timestamp":1711497600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,3,27]],"date-time":"2024-03-27T00:00:00Z","timestamp":1711497600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000288","name":"Royal Society","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000288","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Purpose<\/jats:title>\n                <jats:p>Probe-based confocal laser endomicroscopy (pCLE) enables intraoperative tissue characterization with improved resection rates of brain tumours. Although a plethora of deep learning models have been developed for automating tissue characterization, their lack of transparency is a concern. To tackle this issue, techniques like Class Activation Map (CAM) and its variations highlight image regions related to model decisions. However, they often fall short of providing human-interpretable visual explanations for surgical decision support, primarily due to the shattered gradient problem or insufficient theoretical underpinning.\n<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>In this paper, we introduce XRelevanceCAM, an explanation method rooted in a better backpropagation approach, incorporating sensitivity and conservation axioms. This enhanced method offers greater theoretical foundation and effectively mitigates the shattered gradient issue when compared to other CAM variants.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Qualitative and quantitative evaluations are based on ex vivo pCLE data of brain tumours. XRelevanceCAM effectively highlights clinically relevant areas that characterize the tissue type. Specifically, it yields a remarkable 56% improvement over our closest baseline, RelevanceCAM, in the network\u2019s shallowest layer as measured by the mean Intersection over Union (mIoU) metric based on ground-truth annotations (from 18 to 28.07%). Furthermore, a 6% improvement in mIoU is observed when generating the final saliency map from all network layers.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>We introduce a new CAM variation, XRelevanceCAM, for precise identification of clinically important structures in pCLE data. This can aid introperative decision support in brain tumour resection surgery, as validated in our performance study.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s11548-024-03096-0","type":"journal-article","created":{"date-parts":[[2024,3,27]],"date-time":"2024-03-27T17:02:53Z","timestamp":1711558973000},"page":"1061-1073","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["XRelevanceCAM: towards explainable tissue characterization with improved localisation of pathological structures in probe-based confocal laser endomicroscopy"],"prefix":"10.1007","volume":"19","author":[{"given":"Jianzhong","family":"You","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Serine","family":"Ajlouni","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Irini","family":"Kakaletri","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Patra","family":"Charalampaki","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stamatia","family":"Giannarou","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,3,27]]},"reference":[{"key":"3096_CR1","doi-asserted-by":"publisher","unstructured":"Zhou B, Khosla A, Lapedriza A, Oliva A, Torralba A (2016) Learning deep features for discriminative localization. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR). IEEE. https:\/\/doi.org\/10.1109\/CVPR.2016.319","DOI":"10.1109\/CVPR.2016.319"},{"key":"3096_CR2","doi-asserted-by":"crossref","unstructured":"Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D (2017) Grad-CAM: visual explanations from deep networks via gradient-based localization. In: 2017 IEEE international conference on computer vision (ICCV), pp 618\u2013626","DOI":"10.1109\/ICCV.2017.74"},{"key":"3096_CR3","unstructured":"Fu R, Hu Q, Dong X, Guo Y, Gao Y, Li B (2020) Axiom-based Grad-CAM: towards accurate visualization and explanation of CNNs. In: The 31st British machine vision virtual conference. https:\/\/www.bmvc2020-conference.com\/assets\/papers\/0631.pdf"},{"key":"3096_CR4","doi-asserted-by":"publisher","unstructured":"Lee JR, Kim S, Park I, Eo T, Hwang D (2021) Relevance-cam: your model already knows where to look. In: 2021 IEEE\/CVF conference on computer vision and pattern recognition (CVPR). https:\/\/doi.org\/10.1109\/cvpr46437.2021.01470","DOI":"10.1109\/cvpr46437.2021.01470"},{"key":"3096_CR5","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1007\/978-3-030-20893-6_8","volume-title":"Understanding individual decisions of CNNs via contrastive backpropagation","author":"J Gu","year":"2019","unstructured":"Gu J, Yang Y, Tresp V (2019) Understanding individual decisions of CNNs via contrastive backpropagation. Springer, Berlin, pp 119\u2013134. https:\/\/doi.org\/10.1007\/978-3-030-20893-6_8"},{"key":"3096_CR6","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0130140","author":"S Bach","year":"2015","unstructured":"Bach S, Binder A, Montavon G, Klauschen F, M\u00fcller KR, Samek W (2015) On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PLoS ONE. https:\/\/doi.org\/10.1371\/journal.pone.0130140","journal-title":"PLoS ONE"},{"key":"3096_CR7","unstructured":"Balduzzi D, Frean M, Leary L, Lewis JP, Ma KW, McWilliams B (2017) The shattered gradients problem: if resnets are the answer, then what is the question? In: Proceedings of the 34th international conference on machine learning. Sydney, Australia, PMLR70. https:\/\/proceedings.mlr.press\/v70\/balduzzi17b\/balduzzi17b.pdf"},{"key":"3096_CR8","unstructured":"Bengio Y, Courville AC, Vincent P (2012) Unsupervised feature learning and deep learning: a review and new perspectives. CoRR abs\/1206.5538. arXiv:1206.5538"},{"key":"3096_CR9","unstructured":"Springenberg JT, Dosovitskiy A, Brox T, Riedmiller MA (2015) Striving for simplicity: the all convolutional net. In: Bengio Y, LeCun Y (eds) 3rd international conference on learning representations, ICLR 2015, San Diego, CA, USA, May 7\u20139, workshop track proceedings. http:\/\/arxiv.org\/abs\/1412.6806"},{"key":"3096_CR10","doi-asserted-by":"publisher","unstructured":"Li X, Wang W, Hu X, Yang J (2019) Selective kernel networks. In: 2019 IEEE\/CVF conference on computer vision and pattern recognition (CVPR). Los Alamitos, CA, USA: IEEE Computer Society, pp 510\u2013519. https:\/\/doi.org\/10.1109\/CVPR.2019.00060","DOI":"10.1109\/CVPR.2019.00060"},{"key":"3096_CR11","doi-asserted-by":"crossref","unstructured":"Xie S, Girshick R, Doll\u00e1r P, Tu Z, He K (2017) Aggregated residual transformations for deep neural networks. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR), pp 5987\u20135995","DOI":"10.1109\/CVPR.2017.634"},{"key":"3096_CR12","unstructured":"Wightman R PyTorch image models. GitHub. https:\/\/github.com\/rwightman\/pytorch-image-models"},{"key":"3096_CR13","unstructured":"Goodfellow I, Bengio Y, Courville A (2016) Deep learning. MIT Press. http:\/\/www.deeplearningbook.org"},{"key":"3096_CR14","doi-asserted-by":"crossref","unstructured":"Wang H, Wang Z, Du M, Yang F, Zhang Z, Ding S et\u00a0al (2020) Score-CAM: score-weighted visual explanations for convolutional neural networks. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (CVPR) workshops","DOI":"10.1109\/CVPRW50498.2020.00020"},{"issue":"8","key":"3096_CR15","doi-asserted-by":"publisher","first-page":"1187","DOI":"10.1007\/s11548-018-1806-7","volume":"13","author":"Y Li","year":"2018","unstructured":"Li Y, Charalampaki P, Liu Y, Yang GZ, Giannarou S (2018) Context aware decision support in neurosurgical oncology based on an efficient classification of endomicroscopic data. Int J Comput Assist Radiol Surg 13(8):1187\u20131199. https:\/\/doi.org\/10.1007\/s11548-018-1806-7","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"3096_CR16","unstructured":"Kingma DP, Ba J (2015) Adam: a method for stochastic optimization. In: Bengio Y, LeCun Y (eds) 3rd international conference on learning representations, ICLR 2015, San Diego, CA, USA, May 7\u20139, conference track proceedings. http:\/\/arxiv.org\/abs\/1412.6980"},{"key":"3096_CR17","unstructured":"Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G et\u00a0al (2019) PyTorch: an imperative style, high-performance deep learning library. In: Wallach H, Larochelle H, Beygelzimer A, d\u2019 Alch\u00e9-Buc F, Fox E, Garnett R (eds) Advances in neural information processing systems, vol 32. Curran Associates, Inc., pp 8024\u20138035. http:\/\/papers.neurips.cc\/paper\/9015-pytorch-an-imperative-style-high-performance-deep-learning-library.pdf"},{"key":"3096_CR18","unstructured":"Fernandez FG TorchCAM: class activation explorer. GitHub. https:\/\/github.com\/frgfm\/torch-cam"},{"key":"3096_CR19","doi-asserted-by":"crossref","unstructured":"Chattopadhay A, Sarkar A, Howlader P, Balasubramanian VN (2018) Grad-CAM++: generalized gradient-based visual explanations for deep convolutional networks. In: 2018 IEEE winter conference on applications of computer vision (WACV), pp 839\u2013847","DOI":"10.1109\/WACV.2018.00097"},{"key":"3096_CR20","unstructured":"Draelos RL, Carin L Use HiResCAM instead of Grad-CAM for faithful explanations of convolutional neural networks. https:\/\/arxiv.org\/abs\/2011.08891"},{"key":"3096_CR21","doi-asserted-by":"publisher","first-page":"5875","DOI":"10.1109\/tip.2021.3089943","volume":"30","author":"PT Jiang","year":"2021","unstructured":"Jiang PT, Zhang CB, Hou Q, Cheng MM, Wei Y (2021) LayerCAM: exploring hierarchical class activation maps for localization. IEEE Trans Image Process 30:5875\u20135888. https:\/\/doi.org\/10.1109\/tip.2021.3089943","journal-title":"IEEE Trans Image Process"},{"key":"3096_CR22","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR), pp 770\u2013778","DOI":"10.1109\/CVPR.2016.90"},{"key":"3096_CR23","unstructured":"Gal Y, Ghahramani Z (2016) Dropout as a Bayesian approximation: representing model uncertainty in deep learning. In: Balcan MF, Weinberger KQ (eds) Proceedings of the 33rd international conference on machine learning, vol\u00a048 of proceedings of machine learning research. New York, New York, USA: PMLR, pp 1050\u20131059. https:\/\/proceedings.mlr.press\/v48\/gal16.html"},{"issue":"56","key":"3096_CR24","first-page":"1929","volume":"15","author":"N Srivastava","year":"2014","unstructured":"Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15(56):1929\u20131958","journal-title":"J Mach Learn Res"},{"key":"3096_CR25","unstructured":"Adebayo J, Gilmer J, Muelly M, Goodfellow I, Hardt M, Kim B (2018) Sanity checks for saliency maps. In: Proceedings of the 32nd international conference on neural information processing systems. NIPS\u201918. Curran Associates Inc., Red Hook, NY, USA, pp 9525\u20139536"},{"issue":"3","key":"3096_CR26","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","volume":"115","author":"O Russakovsky","year":"2015","unstructured":"Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S et al (2015) ImageNet large scale visual recognition challenge. Int J Comput Vis (IJCV) 115(3):211\u2013252. https:\/\/doi.org\/10.1007\/s11263-015-0816-y","journal-title":"Int J Comput Vis (IJCV)"},{"key":"3096_CR27","doi-asserted-by":"publisher","unstructured":"Rudin C (2019) Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nat Mach Intell 1(5):206\u2013215. https:\/\/doi.org\/10.1038\/s42256-019-0048-x","DOI":"10.1038\/s42256-019-0048-x"},{"key":"3096_CR28","doi-asserted-by":"publisher","unstructured":"Sengupta S, Anastasio MA. Revisiting model self-interpretability in a decision-theoretic way for binary medical image classification. https:\/\/doi.org\/10.48550\/ARXIV.2303.06876. arXiv:2303.06876","DOI":"10.48550\/ARXIV.2303.06876"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03096-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-024-03096-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03096-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,14]],"date-time":"2024-06-14T11:23:48Z","timestamp":1718364228000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-024-03096-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,27]]},"references-count":28,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["3096"],"URL":"https:\/\/doi.org\/10.1007\/s11548-024-03096-0","relation":{},"ISSN":["1861-6429"],"issn-type":[{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,27]]},"assertion":[{"value":"22 January 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 February 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 March 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and\/or national research committee and with the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"Yes.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"Informed consent was obtained from all individual participants included in the study.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}},{"value":"The code is available at the following link: .","order":6,"name":"Ethics","group":{"name":"EthicsHeading","label":"Code availability"}}]}}