{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,19]],"date-time":"2025-12-19T09:52:46Z","timestamp":1766137966208,"version":"3.40.3"},"publisher-location":"Cham","reference-count":40,"publisher":"Springer International Publishing","isbn-type":[{"type":"print","value":"9783031040825"},{"type":"electronic","value":"9783031040832"}],"license":[{"start":{"date-parts":[[2022,1,1]],"date-time":"2022-01-01T00:00:00Z","timestamp":1640995200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,4,17]],"date-time":"2022-04-17T00:00:00Z","timestamp":1650153600000},"content-version":"vor","delay-in-days":106,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Increased explainability in machine learning is traditionally associated with lower performance, <jats:italic>e.g.<\/jats:italic>\u00a0a decision tree is more explainable, but less accurate than a deep neural network. We argue that, in fact, increasing the explainability of a deep classifier can improve its generalization. In this chapter, we survey a line of our published work that demonstrates how spatial and spatiotemporal visual explainability can be obtained, and how such explainability can be used to train models that generalize better on unseen in-domain and out-of-domain samples, refine fine-grained classification predictions, better utilize network capacity, and are more robust to network compression.<\/jats:p>","DOI":"10.1007\/978-3-031-04083-2_13","type":"book-chapter","created":{"date-parts":[[2022,4,16]],"date-time":"2022-04-16T17:03:23Z","timestamp":1650128603000},"page":"255-269","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Beyond the\u00a0Visual Analysis of\u00a0Deep Model Saliency"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3157-0412","authenticated-orcid":false,"given":"Sarah Adel","family":"Bargal","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8924-7402","authenticated-orcid":false,"given":"Andrea","family":"Zunino","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9565-4511","authenticated-orcid":false,"given":"Vitali","family":"Petsiuk","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9954-6294","authenticated-orcid":false,"given":"Jianming","family":"Zhang","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8645-2328","authenticated-orcid":false,"given":"Vittorio","family":"Murino","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0711-4313","authenticated-orcid":false,"given":"Stan","family":"Sclaroff","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5704-7614","authenticated-orcid":false,"given":"Kate","family":"Saenko","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,4,17]]},"reference":[{"doi-asserted-by":"crossref","unstructured":"Bargal, S.A., Zunino, A., Kim, D., Zhang, J., Murino, V., Sclaroff, S.: Excitation backprop for RNNs. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2018)","key":"13_CR1","DOI":"10.1109\/CVPR.2018.00156"},{"unstructured":"Bargal, S.A., et al.: Guided zoom: questioning network evidence for fine-grained classification. In: Proceedings of the British Machine Vision Conference (BMVC) (2019)","key":"13_CR2"},{"doi-asserted-by":"crossref","unstructured":"Bargal, S.A., et al.: Guided zoom: zooming into network evidence to refine fine-grained model decisions. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 01, 1 (2021)","key":"13_CR3","DOI":"10.1109\/TPAMI.2021.3054303"},{"issue":"1","key":"13_CR4","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1007\/s11263-014-0733-5","volume":"111","author":"M Everingham","year":"2015","unstructured":"Everingham, M., Eslami, S.A., Van Gool, L., Williams, C.K., Winn, J., Zisserman, A.: The pascal visual object classes challenge: a retrospective. Int. J. Comput. Vis. (IJCV) 111(1), 98\u2013136 (2015)","journal-title":"Int. J. Comput. Vis. (IJCV)"},{"doi-asserted-by":"crossref","unstructured":"Fu, J., Zheng, H., Mei, T.: Look closer to see better: recurrent attention convolutional neural network for fine-grained image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017)","key":"13_CR5","DOI":"10.1109\/CVPR.2017.476"},{"doi-asserted-by":"crossref","unstructured":"Greff, K., Srivastava, R.K., Koutn\u00edk, J., Steunebrink, B.R., Schmidhuber, J.: LSTM: a search space odyssey. IEEE Trans. Neural Netw. Learn. Syst. (2016)","key":"13_CR6","DOI":"10.1109\/TNNLS.2016.2582924"},{"unstructured":"Griffin, G., Holub, A., Perona, P.: Caltech-256 object category dataset. Technical report 7694, California Institute of Technology (2007). http:\/\/authors.library.caltech.edu\/7694","key":"13_CR7"},{"unstructured":"Hebb, D.O.: The Organization of Behavior: A Neuropsychological Theory. Psychology Press, Hove (2005)","key":"13_CR8"},{"unstructured":"Hinton, G.E., Srivastava, N., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Improving neural networks by preventing co-adaptation of feature detectors. CoRR abs\/1207.0580 (2012)","key":"13_CR9"},{"unstructured":"Jozefowicz, R., Zaremba, W., Sutskever, I.: An empirical exploration of recurrent network architectures. In: Proceedings of the International Conference on Machine Learning (ICML) (2015)","key":"13_CR10"},{"unstructured":"Khosla, A., Jayadevaprakash, N., Yao, B., Li, F.F.: Novel dataset for fine-grained image categorization: Stanford dogs. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshop (CVPRw) (2011)","key":"13_CR11"},{"doi-asserted-by":"crossref","unstructured":"Krause, J., Stark, M., Deng, J., Fei-Fei, L.: 3D object representations for fine-grained categorization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshop (CVPRw) (2013)","key":"13_CR12","DOI":"10.1109\/ICCVW.2013.77"},{"unstructured":"Krizhevsky, A., Hinton, G., et al.: Learning multiple layers of features from tiny images. Citeseer (2009)","key":"13_CR13"},{"unstructured":"Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems (NIPS) (2012)","key":"13_CR14"},{"doi-asserted-by":"crossref","unstructured":"Lin, T.Y., et al.: Microsoft COCO: common objects in context. In: Proceedings of the European Conference on Computer Vision (ECCV) (2014)","key":"13_CR15","DOI":"10.1007\/978-3-319-10602-1_48"},{"unstructured":"Maji, S., Rahtu, E., Kannala, J., Blaschko, M., Vedaldi, A.: Fine-grained visual classification of aircraft. arXiv preprint arXiv:1306.5151 (2013)","key":"13_CR16"},{"unstructured":"Miconi, T., Clune, J., Stanley, K.O.: Differentiable plasticity: training plastic neural networks with backpropagation. arXiv preprint arXiv:1804.02464 (2018)","key":"13_CR17"},{"doi-asserted-by":"crossref","unstructured":"Mittal, D., Bhardwaj, S., Khapra, M.M., Ravindran, B.: Recovering from random pruning: on the plasticity of deep convolutional neural networks. In: Winter Conference on Applications of Computer Vision (2018)","key":"13_CR18","DOI":"10.1109\/WACV.2018.00098"},{"doi-asserted-by":"crossref","unstructured":"Morerio, P., Cavazza, J., Volpi, R., Vidal, R., Murino, V.: Curriculum dropout. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV) (2017)","key":"13_CR19","DOI":"10.1109\/ICCV.2017.383"},{"doi-asserted-by":"crossref","unstructured":"Peng, X., Bai, Q., Xia, X., Huang, Z., Saenko, K., Wang, B.: Moment matching for multi-source domain adaptation. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV) (2019)","key":"13_CR20","DOI":"10.1109\/ICCV.2019.00149"},{"unstructured":"Peng, X., Usman, B., Kaushik, N., Hoffman, J., Wang, D., Saenko, K.: Visda: The visual domain adaptation challenge. arXiv preprint arXiv:1710.06924 (2017)","key":"13_CR21"},{"unstructured":"Petsiuk, V., Das, A., Saenko, K.: RISE: randomized input sampling for explanation of black-box models. In: Proceedings of the British Machine Vision Conference (BMVC) (2018)","key":"13_CR22"},{"doi-asserted-by":"crossref","unstructured":"Petsiuk, V., et al.: Black-box explanation of object detectors via saliency maps. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2021)","key":"13_CR23","DOI":"10.1109\/CVPR46437.2021.01128"},{"unstructured":"Rieger, L., Singh, C., Murdoch, W., Yu, B.: Interpretations are useful: penalizing explanations to align neural networks with prior knowledge. In: International Conference on Machine Learning, pp. 8116\u20138126. PMLR (2020)","key":"13_CR24"},{"doi-asserted-by":"crossref","unstructured":"Ross, A.S., Hughes, M.C., Doshi-Velez, F.: Right for the right reasons: Training differentiable models by constraining their explanations. arXiv preprint arXiv:1703.03717 (2017)","key":"13_CR25","DOI":"10.24963\/ijcai.2017\/371"},{"issue":"8","key":"13_CR26","doi-asserted-by":"publisher","first-page":"476","DOI":"10.1038\/s42256-020-0212-3","volume":"2","author":"P Schramowski","year":"2020","unstructured":"Schramowski, P., et al.: Making deep neural networks right for the right scientific reasons by interacting with their explanations. Nat. Mach. Intell. 2(8), 476\u2013486 (2020)","journal-title":"Nat. Mach. Intell."},{"doi-asserted-by":"crossref","unstructured":"Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-cam: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV) (2017)","key":"13_CR27","DOI":"10.1109\/ICCV.2017.74"},{"unstructured":"Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)","key":"13_CR28"},{"issue":"9","key":"13_CR29","doi-asserted-by":"publisher","first-page":"919","DOI":"10.1038\/78829","volume":"3","author":"S Song","year":"2000","unstructured":"Song, S., Miller, K.D., Abbott, L.F.: Competitive hebbian learning through spike-timing-dependent synaptic plasticity. Nat. Neurosci. 3(9), 919 (2000)","journal-title":"Nat. Neurosci."},{"unstructured":"Soomro, K., Zamir, A.R., Shah, M.: UCF101: A dataset of 101 human actions classes from videos in the wild. arXiv preprint arXiv:1212.0402 (2012)","key":"13_CR30"},{"issue":"1","key":"13_CR31","first-page":"1929","volume":"15","author":"N Srivastava","year":"2014","unstructured":"Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. (JMLR) 15(1), 1929\u20131958 (2014)","journal-title":"J. Mach. Learn. Res. (JMLR)"},{"key":"13_CR32","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1016\/j.inffus.2021.07.008","volume":"77","author":"J Sun","year":"2022","unstructured":"Sun, J., Lapuschkin, S., Samek, W., Binder, A.: Explain and improve: LRP-inference fine-tuning for image captioning models. Inf. Fusion 77, 233\u2013246 (2022)","journal-title":"Inf. Fusion"},{"doi-asserted-by":"crossref","unstructured":"Wei, Y., Feng, J., Liang, X., Cheng, M.M., Zhao, Y., Yan, S.: Object region mining with adversarial erasing: a simple classification to semantic segmentation approach. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017)","key":"13_CR33","DOI":"10.1109\/CVPR.2017.687"},{"unstructured":"Welinder, P., et al.: Caltech-UCSD birds 200. In: Technical Report CNS-TR-2010-001, California Institute of Technology (2010)","key":"13_CR34"},{"doi-asserted-by":"crossref","unstructured":"Yeom, S.K., et al.: Pruning by explaining: a novel criterion for deep neural network pruning. Pattern Recogn. 115, 107899 (2021)","key":"13_CR35","DOI":"10.1016\/j.patcog.2021.107899"},{"doi-asserted-by":"crossref","unstructured":"Zhang, J., Bargal, S.A., Lin, Z., Brandt, J., Shen, X., Sclaroff, S.: Top-down neural attention by excitation backprop. Int. J. Comput. Vis. (IJCV) 126(10), 1084\u20131102 (2018)","key":"13_CR36","DOI":"10.1007\/s11263-017-1059-x"},{"doi-asserted-by":"crossref","unstructured":"Zhang, J., Lin, Z., Brandt, J., Shen, X., Sclaroff, S.: Top-down neural attention by excitation backprop. In: Proceedings of the European Conference on Computer Vision (ECCV) (2016)","key":"13_CR37","DOI":"10.1007\/978-3-319-46493-0_33"},{"doi-asserted-by":"crossref","unstructured":"Zheng, H., Fu, J., Mei, T., Luo, J.: Learning multi-attention convolutional neural network for fine-grained image recognition. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV) (2017)","key":"13_CR38","DOI":"10.1109\/ICCV.2017.557"},{"doi-asserted-by":"crossref","unstructured":"Zunino, A., Bargal, S.A., Morerio, P., Zhang, J., Sclaroff, S., Murino, V.: Excitation Dropout: encouraging plasticity in deep neural networks. Int. J. Comput. Vis. (IJCV) (2021)","key":"13_CR39","DOI":"10.1007\/s11263-020-01422-y"},{"doi-asserted-by":"crossref","unstructured":"Zunino, A., et al.: Explainable deep classification models for domain generalization. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 3233\u20133242 (2021)","key":"13_CR40","DOI":"10.1109\/CVPRW53098.2021.00361"}],"container-title":["Lecture Notes in Computer Science","xxAI - Beyond Explainable AI"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-031-04083-2_13","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,4,16]],"date-time":"2022-04-16T17:12:20Z","timestamp":1650129140000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-031-04083-2_13"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022]]},"ISBN":["9783031040825","9783031040832"],"references-count":40,"URL":"https:\/\/doi.org\/10.1007\/978-3-031-04083-2_13","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"type":"print","value":"0302-9743"},{"type":"electronic","value":"1611-3349"}],"subject":[],"published":{"date-parts":[[2022]]},"assertion":[{"value":"17 April 2022","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"xxAI","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"International Workshop on Extending Explainable AI Beyond Deep Models and Classifiers","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Vienna","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Austria","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2020","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"18 July 2020","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"18 July 2020","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"xxai2020","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/human-centered.ai\/xxai-icml-2020\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}}]}}