{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T09:55:03Z","timestamp":1777110903061,"version":"3.51.4"},"reference-count":199,"publisher":"Springer Science and Business Media LLC","issue":"12","license":[{"start":{"date-parts":[[2022,9,14]],"date-time":"2022-09-14T00:00:00Z","timestamp":1663113600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springer.com\/tdm"},{"start":{"date-parts":[[2022,9,14]],"date-time":"2022-09-14T00:00:00Z","timestamp":1663113600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springer.com\/tdm"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R &D Program of China","doi-asserted-by":"crossref","award":["2021ZD0110303"],"award-info":[{"award-number":["2021ZD0110303"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Knowl Inf Syst"],"published-print":{"date-parts":[[2022,12]]},"DOI":"10.1007\/s10115-022-01756-8","type":"journal-article","created":{"date-parts":[[2022,9,14]],"date-time":"2022-09-14T06:04:39Z","timestamp":1663135479000},"page":"3197-3234","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":398,"title":["Interpretable deep learning: interpretation, interpretability, trustworthiness, and beyond"],"prefix":"10.1007","volume":"64","author":[{"given":"Xuhong","family":"Li","sequence":"first","affiliation":[]},{"given":"Haoyi","family":"Xiong","sequence":"additional","affiliation":[]},{"given":"Xingjian","family":"Li","sequence":"additional","affiliation":[]},{"given":"Xuanyu","family":"Wu","sequence":"additional","affiliation":[]},{"given":"Xiao","family":"Zhang","sequence":"additional","affiliation":[]},{"given":"Ji","family":"Liu","sequence":"additional","affiliation":[]},{"given":"Jiang","family":"Bian","sequence":"additional","affiliation":[]},{"given":"Dejing","family":"Dou","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,9,14]]},"reference":[{"key":"1756_CR1","unstructured":"Abadi M, Agarwal A, Barham P, Brevdo E, Chen Z, Citro C, Corrado GS, Davis A, Dean J, Devin M, Ghemawat S, Goodfellow I, Harp A, Irving G, Isard M, Jia Y, Jozefowicz R, Kaiser L, Kudlur M, Levenberg J, Man\u00e9 D, Monga R, Moore S, Murray D, Olah C, Schuster M, Shlens J, Steiner B, Sutskever I, Talwar K, Tucker P, Vanhoucke V, Vasudevan V, Vi\u00e9gas F, Vinyals O, Warden P, Wattenberg M, Wicke M, Yu Y, Zheng X (2015) TensorFlow: large-scale machine learning on heterogeneous systems. Software available from tensorflow.org"},{"key":"1756_CR2","doi-asserted-by":"crossref","unstructured":"Abnar S, Zuidema WH (2020) Quantifying attention flow in transformers. In: Jurafsky D, Chai J, Schluter N, Tetreault JR (eds) Proceedings of the 58th annual meeting of the association for computational linguistics, ACL. Association for Computational Linguistics","DOI":"10.18653\/v1\/2020.acl-main.385"},{"key":"1756_CR3","unstructured":"Adebayo J, Gilmer J, Muelly M, Goodfellow IJ, Hardt M, Kim B (2018) Sanity checks for saliency maps. In: Bengio S, Wallach HM, Larochelle H, Grauman K, Cesa-Bianchi N, Garnett R (eds) Advances in neural information processing systems 31: annual conference on neural information processing systems 2018 (NeurIPS 2018), December 3\u20138, 2018, Montr\u00e9al, Canada, pp 9525\u20139536 (2018)"},{"key":"1756_CR4","unstructured":"Adebayo J, Muelly M, Liccardi I, Kim B (2020) Debugging tests for model explanations. In: Larochelle H, Ranzato M, Hadsell R, Balcan M-F, Lin H-T (eds) Advances in neural information processing systems 33: annual conference on neural information processing systems 2020 (NeurIPS 2020), December 6\u201312, 2020"},{"key":"1756_CR5","unstructured":"Agarwal R, Melnick L, Frosst N, Zhang X, Lengerich BJ, Caruana R, Hinton GE (2021) Neural additive models: interpretable machine learning with neural nets. In: Ranzato M, Beygelzimer A, Dauphin YN, Liang P, Vaughan JW (eds) Advances in neural information processing systems 34: annual conference on neural information processing systems 2021 (NeurIPS 2021), December 6\u201314, 2021, pp 4699\u20134711 (2021)"},{"key":"1756_CR6","unstructured":"Ahern I, Noack A, Guzman-Nateras L, Dou D, Li B, Huan J (2019) Normlime: a new feature importance metric for explaining deep neural networks. CoRR, arXiv:1909.04200"},{"key":"1756_CR7","doi-asserted-by":"crossref","unstructured":"Ahn J, Kwak S (2018) Learning pixel-level semantic affinity with image-level supervision for weakly supervised semantic segmentation. In: 2018 IEEE conference on computer vision and pattern recognition (CVPR 2018), Salt Lake City, UT, USA, June 18\u201322, 2018. Computer Vision Foundation\/IEEE Computer Society, pp 4981\u20134990","DOI":"10.1109\/CVPR.2018.00523"},{"key":"1756_CR8","unstructured":"Alvarez-Melis D, Jaakkola TS (2018) On the robustness of interpretability methods. CoRR arXiv:1806.08049"},{"key":"1756_CR9","unstructured":"Ancona M, Ceolini E, \u00d6ztireli C, Gross M (2018) Towards better understanding of gradient-based attribution methods for deep neural networks. In: 6th International conference on learning representations (ICLR 2018), Vancouver, BC, Canada, April 30\u2013May 3, 2018, conference track proceedings. OpenReview.net"},{"issue":"1","key":"1756_CR10","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1177\/0278364919887447","volume":"39","author":"M Andrychowicz","year":"2020","unstructured":"Andrychowicz M, Baker B, Chociej M, J\u00f3zefowicz R, McGrew B, Pachocki J, Petron A, Plappert M, Powell G, Ray A, Schneider J, Sidor S, Tobin J, Welinder P, Weng L, Zaremba W (2020) Learning dexterous in-hand manipulation. Int J Robot Res 39(1):66","journal-title":"Int J Robot Res"},{"key":"1756_CR11","unstructured":"Antor\u00e1n J, Bhatt U, Adel T, Weller A, Hern\u00e1ndez-Lobato JM (2021) Getting a CLUE: a method for explaining uncertainty estimates. In: 9th International conference on learning representations (ICLR 2021), virtual event, Austria, May 3\u20137, 2021. OpenReview.net"},{"key":"1756_CR12","unstructured":"Andr\u00e9 A, Barbara H (2019) On the computation of counterfactual explanations\u2014a survey. CoRR, arXiv:1911.07749 (2019)"},{"issue":"6","key":"1756_CR13","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1109\/MSP.2017.2743240","volume":"34","author":"K Arulkumaran","year":"2017","unstructured":"Arulkumaran K, Deisenroth MP, Brundage M, Bharath AA (2017) Deep reinforcement learning: a brief survey. IEEE Signal Process Mag 34(6):26\u201338","journal-title":"IEEE Signal Process Mag"},{"key":"1756_CR14","doi-asserted-by":"crossref","unstructured":"Atanasova P, Simonsen JG, Lioma C, Augenstein I (2020) Generating fact checking explanations. In: Jurafsky D, Chai J, Schluter N, Tetreault JR (eds) Proceedings of the 58th annual meeting of the association for computational linguistics (ACL). Association for Computational Linguistics","DOI":"10.18653\/v1\/2020.acl-main.656"},{"key":"1756_CR15","unstructured":"Atrey A, Clary K, Jensen DD (2020) Exploratory not explanatory: counterfactual analysis of saliency maps for deep reinforcement learning. In: 8th International conference on learning representations (ICLR 2020), Addis Ababa, Ethiopia, April 26\u201330, 2020. OpenReview.net"},{"key":"1756_CR16","first-page":"66","volume":"6","author":"S Bach","year":"2015","unstructured":"Bach S, Binder A, Montavon G, Klauschen F, M\u00fcller K-R, Samek W (2015) On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PLoS ONE 6:66","journal-title":"PLoS ONE"},{"key":"1756_CR17","unstructured":"Bahdanau D, Cho K, Bengio Y (2015) Neural machine translation by jointly learning to align and translate. In: Bengio Y, LeCun Y (eds) International conference on learning representations"},{"key":"1756_CR18","unstructured":"Bajaj M, Chu L, Xue ZY, Pei J, Wang L, Lam PC-H, Zhang Y (2021) Robust counterfactual explanations on graph neural networks. In: Ranzato MA, Beygelzimer A, Dauphin YN, Liang P, Vaughan JW (eds) Advances in neural information processing systems 34: annual conference on neural information processing systems 2021 (NeurIPS 2021), December 6\u201314, 2021, virtual, pp 5644\u20135655"},{"key":"1756_CR19","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1145\/245108.245124","volume":"6","author":"M Balabanovi\u0107","year":"1997","unstructured":"Balabanovi\u0107 M, Shoham Y (1997) Fab: content-based, collaborative recommendation. Commun ACM 6:66","journal-title":"Commun ACM"},{"key":"1756_CR20","unstructured":"Baldassarre F, Azizpour H (2019) Explainability techniques for graph convolutional networks. CoRR, arXiv:1905.13686"},{"key":"1756_CR21","unstructured":"Baldock RJN, Maennel H, Neyshabur B (2021) Deep learning through the lens of example difficulty. In: Ranzato MA, Beygelzimer A, Dauphin YN, Liang P, Vaughan JW (eds) Advances in neural information processing systems 34: annual conference on neural information processing systems 2021 (NeurIPS 2021), December 6\u201314, 2021, virtual, pp 10876\u201310889"},{"key":"1756_CR22","doi-asserted-by":"crossref","unstructured":"Bansal N, Agarwal C, Nguyen A (2020) SAM: the sensitivity of attribution methods to hyperparameters. In: 2020 IEEE\/CVF conference on computer vision and pattern recognition (CVPR 2020), Seattle, WA, USA, June 13\u201319, 2020, pp 8670\u20138680. Computer Vision Foundation\/IEEE","DOI":"10.1109\/CVPR42600.2020.00870"},{"key":"1756_CR23","doi-asserted-by":"crossref","unstructured":"Barbalau A, Cosma A, Ionescu RT, Popescu M (2020) A generic and model-agnostic exemplar synthetization framework for explainable AI. In: Hutter F, Kersting K, Lijffijt J, Valera I (eds) Machine learning and knowledge discovery in databases\u2014European conference, ECML PKDD 2020, Ghent, Belgium, September 14\u201318, 2020, Proceedings, Part II, volume 12458 of lecture notes in computer science. Springer, pp 190\u2013205","DOI":"10.1007\/978-3-030-67661-2_12"},{"key":"1756_CR24","doi-asserted-by":"crossref","unstructured":"Bau D, Zhou B, Khosla A, Oliva A, Torralba A (2017) Network dissection: quantifying interpretability of deep visual representations. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR 2017), Honolulu, HI, USA, July 21\u201326, 2017. IEEE Computer Society, pp 3319\u20133327","DOI":"10.1109\/CVPR.2017.354"},{"key":"1756_CR25","unstructured":"Bau D, Zhu J-Y, Strobelt H, Zhou B, Tenenbaum JB, Freeman WT, Torralba A (2019) GAN dissection: visualizing and understanding generative adversarial networks. In: 7th International conference on learning representations (ICLR 2019), New Orleans, LA, USA, May 6\u20139, 2019. OpenReview.net (2019)"},{"key":"1756_CR26","first-page":"66","volume":"6","author":"J Bien","year":"2011","unstructured":"Bien J, Tibshirani R (2011) Prototype selection for interpretable classification. Ann Appl Stat 6:66","journal-title":"Ann Appl Stat"},{"key":"1756_CR27","doi-asserted-by":"crossref","unstructured":"Binder A, Montavon G, Lapuschkin S, M\u00fcller K-R, Samek W (2016) Layer-wise relevance propagation for neural networks with local renormalization layers. In: Villa AEP, Masulli P, Rivero AP (eds) Artificial neural networks and machine learning\u2014ICANN 2016\u201425th international conference on artificial neural networks, Barcelona, Spain, September 6\u20139, 2016, Proceedings, Part II, volume 9887 of lecture notes in computer science. Springer, pp 63\u201371","DOI":"10.1007\/978-3-319-44781-0_8"},{"key":"1756_CR28","unstructured":"Carlini N, Erlingsson \u00da, Papernot N (2019) Distribution density, tails, and outliers in machine learning: metrics and applications. CoRR, arXiv:1910.13427"},{"key":"1756_CR29","first-page":"66","volume":"6","author":"DV Carvalho","year":"2019","unstructured":"Carvalho DV, Pereira EM, Cardoso JS (2019) Machine learning interpretability: a survey on methods and metrics. Electronics 6:66","journal-title":"Electronics"},{"key":"1756_CR30","unstructured":"Chakraborty A, Alam M, Dey V, Chattopadhyay A, Mukhopadhyay D (2018) Adversarial attacks and defences: a survey. CoRR, arXiv:1810.00069"},{"key":"1756_CR31","unstructured":"Chang C-H, Creager E, Goldenberg A, Duvenaud D (2019) Explaining image classifiers by counterfactual generation. In: 7th International conference on learning representations (ICLR 2019), New Orleans, LA, USA, May 6\u20139, 2019. OpenReview.net"},{"key":"1756_CR32","doi-asserted-by":"crossref","unstructured":"Chattopadhyay A, Sarkar A, Howlader P, Balasubramanian VN (2018) Grad-CAM++: generalized gradient-based visual explanations for deep convolutional networks. In: 2018 IEEE winter conference on applications of computer vision (WACV 2018), Lake Tahoe, NV, USA, March 12\u201315, 2018. IEEE Computer Society, pp 839\u2013847","DOI":"10.1109\/WACV.2018.00097"},{"key":"1756_CR33","doi-asserted-by":"crossref","unstructured":"Chefer H, Gur S, Wolf L (2021) Generic attention-model explainability for interpreting bi-modal and encoder-decoder transformers. In: 2021 IEEE\/CVF international conference on computer vision (ICCV 2021), Montreal, QC, Canada, October 10\u201317, 2021. IEEE, pp 387\u2013396","DOI":"10.1109\/ICCV48922.2021.00045"},{"key":"1756_CR34","doi-asserted-by":"crossref","unstructured":"Chefer H, Gur S, Wolf L (2021) Transformer interpretability beyond attention visualization. In: IEEE conference on computer vision and pattern recognition (CVPR 2021), virtual, June 19\u201325, 2021. Computer Vision Foundation\/IEEE, pp 782\u2013791","DOI":"10.1109\/CVPR46437.2021.00084"},{"key":"1756_CR35","unstructured":"Chen C, Li O, Tao D, Barnett A, Rudin C, Su J (2019) This looks like that: deep learning for interpretable image recognition. In: Wallach HM, Larochelle H, Beygelzimer A, d\u2019Alch\u00e9-Buc F, Fox EB, Garnett R (eds) Advances in neural information processing systems 32: annual conference on neural information processing systems 2019 (NeurIPS 2019), December 8\u201314, 2019, Vancouver, BC, Canada, pp 8928\u20138939"},{"key":"1756_CR36","doi-asserted-by":"crossref","unstructured":"Chen C, Zhang M, Liu Y, Ma S (2018) Neural attentional rating regression with review-level explanations. In: Champin P-A, Gandon F, Lalmas M, Ipeirotis PG (eds) Proceedings of the 2018 World Wide Web conference on World Wide Web (WWW 2018), Lyon, France, April 23\u201327, 2018. ACM, pp 1583\u20131592","DOI":"10.1145\/3178876.3186070"},{"key":"1756_CR37","unstructured":"Chen X, Liu C, Li B, Lu K, Song D (2017) Targeted backdoor attacks on deep learning systems using data poisoning. CoRR, arXiv:1712.05526"},{"key":"1756_CR38","doi-asserted-by":"crossref","unstructured":"Chen Y, Li B, Yu H, Wu P, Miao C (2021) Hydra: hypergradient data relevance analysis for interpreting deep neural networks. In: Thirty-fifth AAAI conference on artificial intelligence (AAAI 2021), thirty-third conference on innovative applications of artificial intelligence (IAAI 2021), the eleventh symposium on educational advances in artificial intelligence (EAAI 2021), virtual event, February 2\u20139, 2021. AAAI Press, pp 7081\u20137089 (2021)","DOI":"10.1609\/aaai.v35i8.16871"},{"key":"1756_CR39","doi-asserted-by":"crossref","unstructured":"Cheng H-T, Koc L, Harmsen J, Shaked T, Chandra T, Aradhye H, Anderson G, Corrado G, Chai W, Ispir M, Anil R, Haque Z, Hong L, Jain V, Liu X, Shah H (2016) Wide & deep learning for recommender systems. In: Karatzoglou A, Hidasi B, Tikk D, Shalom OS, Roitman H, Shapira B, Rokach L (eds) Proceedings of the 1st workshop on deep learning for recommender systems, DLRS@RecSys 2016, Boston, MA, USA, September 15, 2016. ACM, pp 7\u201310","DOI":"10.1145\/2988450.2988454"},{"key":"1756_CR40","doi-asserted-by":"crossref","unstructured":"Covington P, Adams J, Sargin E (2016) Deep neural networks for youtube recommendations. In: Sen S, Geyer W, Freyne J, Castells P (eds) Proceedings of the 10th ACM conference on recommender systems, Boston, MA, USA, September 15\u201319, 2016. ACM, pp 191\u2013198","DOI":"10.1145\/2959100.2959190"},{"key":"1756_CR41","unstructured":"Croce F, Andriushchenko M, Sehwag V, Debenedetti E, Flammarion N, Chiang M, Mittal P, Hein M (2020) Robustbench: a standardized adversarial robustness benchmark. arXiv preprint arXiv:2010.09670"},{"key":"1756_CR42","unstructured":"Dacrema MF, Cremonesi P, Jannach D (2019) Are we really making much progress? A worrying analysis of recent neural recommendation approaches. In: Bogers T, Said A, Brusilovsky P, Tikk D (eds) Proceedings of the 13th ACM conference on recommender systems (RecSys 2019), Copenhagen, Denmark, September 16\u201320, 2019. ACM, pp 101\u2013109"},{"key":"1756_CR43","doi-asserted-by":"crossref","unstructured":"Deng J, Dong W, Socher R, Li L-J, Li K, Fei-Fei L (2009) Imagenet: a large-scale hierarchical image database. In: 2009 IEEE computer society conference on computer vision and pattern recognition (CVPR 2009), 20\u201325 June 2009, Miami, Florida, USA. IEEE Computer Society, pp 248\u2013255","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"1756_CR44","doi-asserted-by":"crossref","unstructured":"Desai S, Ramaswamy HG (2020) Ablation-CAM: visual explanations for deep convolutional network via gradient-free localization. In: IEEE winter conference on applications of computer vision (WACV 2020), Snowmass Village, CO, USA, March 1\u20135, 2020. IEEE, pp 972\u2013980 (2020)","DOI":"10.1109\/WACV45572.2020.9093360"},{"key":"1756_CR45","unstructured":"Devlin J, Chang M-W, Lee K, Toutanova K (2019) BERT: pre-training of deep bidirectional transformers for language understanding. In: Burstein J, Doran C, Solorio T (eds) Proceedings of the 2019 conference of the North American Chapter of the Association for computational linguistics: human language technologies, NAACL-HLT 2019, Minneapolis, MN, USA, June 2\u20137, 2019, Volume 1 (Long and Short Papers). Association for Computational Linguistics, pp 4171\u20134186"},{"key":"1756_CR46","doi-asserted-by":"crossref","unstructured":"Dong Y, Su H, Zhu J, Zhang B (2017) Improving interpretability of deep neural networks with semantic information. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR 2017), Honolulu, HI, USA, July 21\u201326, 2017. IEEE Computer Society, pp 975\u2013983","DOI":"10.1109\/CVPR.2017.110"},{"key":"1756_CR47","unstructured":"Doshi-Velez F, Kim B (2017) Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608"},{"key":"1756_CR48","unstructured":"Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, Dehghani M, Minderer M, Heigold G, Gelly S, Uszkoreit J, Houlsby N (2021) An image is worth 16x16 words: transformers for image recognition at scale. In: 9th International conference on learning representations (ICLR 2021), virtual event, Austria, May 3\u20137, 2021. OpenReview.net"},{"key":"1756_CR49","unstructured":"Erhan D, Bengio Y, Courville A, Vincent P (2009) Visualizing higher-layer features of a deep network. In: 2018 IEEE international conference on machine learning workshops"},{"key":"1756_CR50","unstructured":"Etmann C, Lunz S, Maass P, Sch\u00f6nlieb C (2019) On the connection between adversarial robustness and saliency map interpretability. In: Chaudhuri K, Salakhutdinov R (eds) Proceedings of the 36th international conference on machine learning (ICML 2019), 9\u201315 June 2019, Long Beach, CA, USA, volume\u00a097 of proceedings of machine learning research (PMLR), pp 1823\u20131832"},{"key":"1756_CR51","unstructured":"Faber L, Moghaddam AK, Wattenhofer R (2020) Contrastive graph neural network explanation. CoRR, arXiv:2010.13663"},{"key":"1756_CR52","doi-asserted-by":"crossref","unstructured":"Feldman V (2020) Does learning require memorization? A short tale about a long tail. In: Makarychev K, Makarychev Y, Tulsiani M, Kamath G, Chuzhoy J (eds) Proceedings of the 52nd annual ACM SIGACT symposium on theory of computing (STOC 2020), Chicago, IL, USA, June 22\u201326, 2020. ACM, pp 954\u2013959","DOI":"10.1145\/3357713.3384290"},{"key":"1756_CR53","unstructured":"Feldman V, Zhang C (2020) What neural networks memorize and why: discovering the long tail via influence estimation. In: Larochelle H, Ranzato MA, Hadsell R, Balcan M-F, Lin H-T (eds) Advances in neural information processing systems 33: annual conference on neural information processing systems 2020 (NeurIPS 2020), December 6\u201312, 2020, virtual"},{"key":"1756_CR54","doi-asserted-by":"crossref","unstructured":"Fong R, Patrick M, Vedaldi A (2019) Understanding deep networks via extremal perturbations and smooth masks. In: 2019 IEEE\/CVF international conference on computer vision (ICCV 2019), Seoul, Korea (South), October 27\u2013November 2, 2019. IEEE, pp 2950\u20132958","DOI":"10.1109\/ICCV.2019.00304"},{"key":"1756_CR55","doi-asserted-by":"crossref","unstructured":"Fong RC, Vedaldi A (2017) Interpretable explanations of black boxes by meaningful perturbation. In: IEEE international conference on computer vision (ICCV 2017), Venice, Italy, October 22\u201329, 2017. IEEE Computer Society, pp 3449\u20133457","DOI":"10.1109\/ICCV.2017.371"},{"key":"1756_CR56","unstructured":"Friedler SA, Roy CD, Scheidegger C, Slack D (2019) Assessing the local interpretability of machine learning models. CoRR, arXiv:1902.03501"},{"key":"1756_CR57","unstructured":"Frosst N, Hinton GE (2017) Distilling a neural network into a soft decision tree. In: Besold TR, Kutz O (eds) Proceedings of the first international workshop on comprehensibility and explanation in AI and ML 2017 co-located with 16th international conference of the Italian Association for artificial intelligence (AI*IA 2017), Bari, Italy, November 16th and 17th, 2017, volume 2071 of CEUR workshop proceedings. CEUR-WS.org"},{"issue":"11","key":"1756_CR58","doi-asserted-by":"publisher","first-page":"665","DOI":"10.1038\/s42256-020-00257-z","volume":"2","author":"R Geirhos","year":"2020","unstructured":"Geirhos R, Jacobsen J-H, Michaelis C, Zemel RS, Brendel W, Bethge M, Wichmann FA (2020) Shortcut learning in deep neural networks. Nat Mach Intell 2(11):665\u2013673","journal-title":"Nat Mach Intell"},{"key":"1756_CR59","unstructured":"Geirhos R, Narayanappa K, Mitzkus B, Thieringer T, Bethge M, Wichmann FA, Brendel W (2021) Partial success in closing the gap between human and machine vision. In: Ranzato MA, Beygelzimer A, Dauphin YN, Liang P, Vaughan JW (eds) Advances in neural information processing systems 34: annual conference on neural information processing systems 2021 (NeurIPS 2021), December 6\u201314, 2021, virtual, pp 23885\u201323899"},{"key":"#cr-split#-1756_CR60.1","unstructured":"Geirhos R, Rubisch P, Michaelis C, Bethge M, Wichmann FA, Brendel W (2019) Imagenet-trained cnns are biased towards texture"},{"key":"#cr-split#-1756_CR60.2","unstructured":"increasing shape bias improves accuracy and robustness. In: 7th International conference on learning representations (ICLR 2019), New Orleans, LA, USA, May 6-9, 2019. OpenReview.net"},{"key":"1756_CR61","doi-asserted-by":"crossref","unstructured":"Ghaeini R, Fern XZ, Tadepalli P (2018) Interpreting recurrent and attention-based neural models: a case study on natural language inference. In: Riloff E, Chiang D, Hockenmaier J, Tsujii J (eds) Proceedings of the 2018 conference on empirical methods in natural language processing. Association for Computational Linguistics","DOI":"10.18653\/v1\/D18-1537"},{"issue":"16","key":"1756_CR62","doi-asserted-by":"publisher","first-page":"1291","DOI":"10.1002\/jcc.24764","volume":"38","author":"GB Goh","year":"2017","unstructured":"Goh GB, Hodas NO, Vishnu A (2017) Deep learning for computational chemistry. J Comput Chem 38(16):1291\u20131307","journal-title":"J Comput Chem"},{"issue":"4","key":"1756_CR63","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1145\/2843948","volume":"6","author":"CA Gomez-Uribe","year":"2016","unstructured":"Gomez-Uribe CA, Hunt N (2016) The netflix recommender system: algorithms, business value, and innovation. ACM Trans Manag Inf Syst 6(4):131\u20131319","journal-title":"ACM Trans Manag Inf Syst"},{"key":"1756_CR64","unstructured":"Goyal Y, Wu Z, Ernst J, Batra D, Parikh D, Lee S (2019) Counterfactual visual explanations. In: Chaudhuri K, Salakhutdinov R (eds) Proceedings of the 36th international conference on machine learning (ICML 2019), 9\u201315 June 2019, Long Beach, CA, USA, volume\u00a097 of proceedings of machine learning research (PMLR), pp 2376\u20132384"},{"key":"1756_CR65","unstructured":"Greydanus S, Koul A, Dodge J, Fern A (2018) Visualizing and understanding Atari agents. In: Dy JG, Krause A (eds) Proceedings of the 35th international conference on machine learning (ICML 2018), Stockholmsm\u00e4ssan, Stockholm, Sweden, July 10\u201315, 2018, volume\u00a080 of proceedings of machine learning research (PMLR), pp 1787\u20131796"},{"key":"1756_CR66","doi-asserted-by":"crossref","unstructured":"Grgic-Hlaca N, Redmiles EM, Gummadi KP, Weller A (2018) Human perceptions of fairness in algorithmic decision making: a case study of criminal risk prediction. In: Champin P-A, Gandon F, Lalmas M, Ipeirotis PG (eds) Proceedings of the 2018 World Wide Web conference on World Wide Web (WWW 2018), Lyon, France, April 23\u201327, 2018. ACM, pp 903\u2013912","DOI":"10.1145\/3178876.3186138"},{"key":"1756_CR67","doi-asserted-by":"crossref","unstructured":"Gu J, Yang Y, Tresp V (2018) Understanding individual decisions of cnns via contrastive backpropagation. In: Jawahar CV, Li H, Mori G, Schindler K (eds) Computer vision\u2014ACCV 2018\u201414th Asian conference on computer vision, Perth, Australia, December 2\u20136, 2018, revised selected papers, Part III, volume 11363 of lecture notes in computer science. Springer, pp 119\u2013134","DOI":"10.1007\/978-3-030-20893-6_8"},{"key":"1756_CR68","unstructured":"Gu T, Dolan-Gavitt B, Garg S (2017) BadNets: identifying vulnerabilities in the machine learning model supply chain. CoRR, arXiv:1708.06733"},{"key":"1756_CR69","doi-asserted-by":"crossref","unstructured":"Guidotti R, Monreale A, Matwin S, Pedreschi D (2019) Black box explanation by learning image exemplars in the latent feature space. In: Brefeld U, Fromont \u00c9, Hotho A, Knobbe AJ, Maathuis MH, Robardet C (eds) Machine learning and knowledge discovery in databases\u2014European conference (ECML PKDD 2019), W\u00fcrzburg, Germany, September 16\u201320, 2019, proceedings, Part I, volume 11906 of lecture notes in computer science. Springer, pp 189\u2013205","DOI":"10.1007\/978-3-030-46150-8_12"},{"key":"1756_CR70","unstructured":"Hendrycks D, Dietterich TG (2019) Benchmarking neural network robustness to common corruptions and perturbations. In: 7th International conference on learning representations (ICLR 2019), New Orleans, LA, USA, May 6\u20139, 2019. OpenReview.net"},{"key":"1756_CR71","unstructured":"Heo J, Joo S, Moon T (2019) Fooling neural network interpretations via adversarial model manipulation. In: Wallach HM, Larochelle H, Beygelzimer A, d\u2019Alch\u00e9-Buc F, Fox EB, Garnett R (eds) Advances in neural information processing systems 32: annual conference on neural information processing systems 2019 (NeurIPS 2019), December 8\u201314, 2019, Vancouver, BC, Canada, pp 2921\u20132932"},{"key":"1756_CR72","doi-asserted-by":"crossref","unstructured":"Herlocker JL, Konstan JA, Riedl J (2000) Explaining collaborative filtering recommendations. In: Kellogg WA, Whittaker S (eds) CSCW 2000, proceeding on the ACM 2000 conference on computer supported cooperative work, Philadelphia, PA, USA, December 2\u20136, 2000. ACM, pp 241\u2013250 (2000)","DOI":"10.1145\/358916.358995"},{"key":"1756_CR73","unstructured":"Hinton GE, Sabour S, Frosst N (2018) Matrix capsules with EM routing. In: 6th International conference on learning representations (ICLR 2018), Vancouver, BC, Canada, April 30\u2013May 3, 2018, conference track proceedings. OpenReview.net"},{"key":"1756_CR74","unstructured":"Hooker S, Erhan D, Kindermans P-J, Kim B (2019) A benchmark for interpretability methods in deep neural networks. In: Wallach HM, Larochelle H, Beygelzimer A, d\u2019Alch\u00e9-Buc F, Fox EB, Garnett R (eds) Advances in neural information processing systems 32: annual conference on neural information processing systems 2019 (NeurIPS 2019), December 8\u201314, 2019, Vancouver, BC, Canada, pp 9734\u20139745"},{"key":"1756_CR75","first-page":"66","volume":"6","author":"K-L Hua","year":"2015","unstructured":"Hua K-L, Hsu C-H, Hidayati SC, Wen-Huang C, Yu-Jen C (2015) Computer-aided classification of lung nodules on computed tomography images via deep learning technique. OncoTargets Ther 6:66","journal-title":"OncoTargets Ther"},{"key":"1756_CR76","unstructured":"Huang Q, Yamada M, Tian Y, Singh D, Yin D, Chang Y (2020) Graphlime: local interpretable model explanations for graph neural networks. CoRR, arXiv:2001.06216"},{"key":"1756_CR77","unstructured":"Ilyas A, Santurkar S, Tsipras D, Engstrom L, Tran B, Madry A (2019) Adversarial examples are not bugs, they are features. In: Wallach HM, Larochelle H, Beygelzimer A, d\u2019Alch\u00e9-Buc F, Fox EB, Garnett R (eds) Advances in neural information processing systems 32: annual conference on neural information processing systems 2019 (NeurIPS 2019), December 8\u201314, 2019, Vancouver, BC, Canada, pp 125\u2013136"},{"key":"1756_CR78","unstructured":"Islam SR, Eberle W, Ghafoor SK (2020) Towards quantification of explainability in explainable artificial intelligence methods. In: Bart\u00e1k R, Bell E (eds) Proceedings of the thirty-third international Florida artificial intelligence research society conference, originally to be held in North Miami Beach, Florida, USA, May 17\u201320, 2020. AAAI Press, pp 75\u201381"},{"key":"1756_CR79","doi-asserted-by":"crossref","unstructured":"Iwana BK, Kuroki R, Uchida S (2019) Explaining convolutional neural networks using softmax gradient layer-wise relevance propagation. In: 2019 IEEE\/CVF international conference on computer vision workshops (ICCV Workshops 2019), Seoul, Korea (South), October 27\u201328, 2019. IEEE, pp 4176\u20134185","DOI":"10.1109\/ICCVW.2019.00513"},{"key":"1756_CR80","doi-asserted-by":"crossref","unstructured":"Iyer R, Li Y, Li H, Lewis M, Sundar R, Sycara KP (2018) Transparency and explanation in deep reinforcement learning neural networks. In: Furman J, Marchant GE, Price H, Rossi F (eds) Proceedings of the 2018 AAAI\/ACM conference on AI, ethics, and society, AIES 2018, New Orleans, LA, USA, February 02\u201303, 2018. ACM, pp 144\u2013150","DOI":"10.1145\/3278721.3278776"},{"key":"1756_CR81","doi-asserted-by":"crossref","unstructured":"Jacovi A, Goldberg Y (2020) Towards faithfully interpretable NLP systems: How should we define and evaluate faithfulness? In: Jurafsky D, Chai J, Schluter N, Tetreault JR (eds) Proceedings of the 58th annual meeting of the association for computational linguistics (ACL 2020), Online, July 5\u201310, 2020. Association for Computational Linguistics, pp 4198\u20134205","DOI":"10.18653\/v1\/2020.acl-main.386"},{"key":"1756_CR82","unstructured":"Jain S, Wallace BC (2019) Attention is not explanation. In: Burstein J, Doran C, Solorio T (eds) Proceedings of the 2019 conference of the North American Chapter of the Association for computational linguistics: human language technologies, NAACL-HLT. Association for Computational Linguistics"},{"key":"1756_CR83","doi-asserted-by":"crossref","unstructured":"Jo T, Nho K, Saykin AJ (2019) Deep learning in Alzheimer\u2019s disease: diagnostic classification and prognostic prediction using neuroimaging data. CoRR, arXiv:1905.00931","DOI":"10.3389\/fnagi.2019.00220"},{"key":"1756_CR84","first-page":"66","volume":"6","author":"J Jumper","year":"2021","unstructured":"Jumper J, Evans R, Pritzel A, Green T, Figurnov M, Ronneberger O, Tunyasuvunakool K, Bates R, \u017d\u00eddek A, Potapenko A et al (2021) Highly accurate protein structure prediction with alphafold. Nature 6:66","journal-title":"Nature"},{"key":"1756_CR85","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1613\/jair.301","volume":"4","author":"LP Kaelbling","year":"1996","unstructured":"Kaelbling LP, Littman ML, Moore AW (1996) Reinforcement learning: a survey. J Artif Intell Res 4:237\u2013285","journal-title":"J Artif Intell Res"},{"key":"1756_CR86","doi-asserted-by":"crossref","unstructured":"Khan A, Huerta EA, Zheng H (2021) Interpretable AI forecasting for numerical relativity waveforms of quasi-circular, spinning, non-precessing binary black hole mergers. CoRR, arXiv:2110.06968","DOI":"10.1103\/PhysRevD.105.024024"},{"key":"1756_CR87","unstructured":"Kim B, Wattenberg M, Gilmer J, Cai CJ, Wexler J, Vi\u00e9gas FB, Sayres R (2018) Interpretability beyond feature attribution: quantitative testing with concept activation vectors (TCAV). In: Dy JG, Krause A (eds) Proceedings of the 35th international conference on machine learning (ICML 2018), Stockholmsm\u00e4ssan, Stockholm, Sweden, July 10\u201315, 2018, volume\u00a080 of Proceedings of machine learning research, pp 2673\u20132682"},{"key":"1756_CR88","doi-asserted-by":"crossref","unstructured":"Kim J-M, Choe J, Akata Z, Oh SJ (2021) Keep CALM and improve visual feature attribution. In: 2021 IEEE\/CVF international conference on computer vision (ICCV 2021), Montreal, QC, Canada, October 10\u201317, 2021. IEEE, pp 8330\u20138340","DOI":"10.1109\/ICCV48922.2021.00824"},{"key":"1756_CR89","unstructured":"Kim J-H, Choo W, Song HO (2020) Puzzle mix: exploiting saliency and local statistics for optimal mixup. In: Proceedings of the 37th international conference on machine learning (ICML 2020), 13\u201318 July 2020, Virtual Event, volume 119 of proceedings of machine learning research (PMLR), pp 5275\u20135285"},{"key":"1756_CR90","unstructured":"Koh PW, Ang K-S, Teo HHK, Liang P (2019) On the accuracy of influence functions for measuring group effects. In: Wallach HM, Larochelle H, Beygelzimer A, d\u2019Alch\u00e9-Buc F, Fox EB, Garnett R (eds) Advances in neural information processing systems 32: annual conference on neural information processing systems 2019 (NeurIPS 2019), December 8\u201314, 2019, Vancouver, BC, Canada, pp 5255\u20135265"},{"key":"1756_CR91","unstructured":"Koh PW, Liang P (2017) Understanding black-box predictions via influence functions. In: Precup D, Teh YW (eds) Proceedings of the 34th international conference on machine learning (ICML 2017), Sydney, NSW, Australia, 6\u201311 August 2017, volume\u00a070 of proceedings of machine learning research (PMLR), pp 1885\u20131894"},{"key":"1756_CR92","doi-asserted-by":"crossref","unstructured":"Kontschieder P, Fiterau M, Criminisi A, Bul\u00f2 SR (2015) Deep neural decision forests. In: 2015 IEEE international conference on computer vision (ICCV 2015), Santiago, Chile, December 7\u201313, 2015. IEEE Computer Society, pp 1467\u20131475","DOI":"10.1109\/ICCV.2015.172"},{"key":"1756_CR93","doi-asserted-by":"crossref","unstructured":"Kumar S, Talukdar PP (2020) NILE: natural language inference with faithful natural language explanations. In: Jurafsky D, Chai J, Schluter N, Tetreault JR (eds) Proceedings of the 58th annual meeting of the association for computational linguistics. Association for Computational Linguistics (ACL)","DOI":"10.18653\/v1\/2020.acl-main.771"},{"key":"1756_CR94","unstructured":"Lage I, Chen E, He J, Narayanan M, Kim B, Gershman S, Doshi-Velez F (2019) An evaluation of the human-interpretability of explanation. CoRR, arXiv:1902.00006"},{"key":"#cr-split#-1756_CR95.1","doi-asserted-by":"crossref","unstructured":"Lai B, Gong X (2017) Saliency guided end-to-end learning for weakly supervised object detection. In: Sierra C","DOI":"10.24963\/ijcai.2017\/285"},{"key":"#cr-split#-1756_CR95.2","unstructured":"(ed) Proceedings of the twenty-sixth international joint conference on artificial intelligence (IJCAI 2017), Melbourne, Australia, August 19-25, 2017, pp 2053-2059. ijcai.org"},{"key":"1756_CR96","unstructured":"Lakkaraju H, Kamar E, Caruana R, Leskovec J (2017) Interpretable & explorable approximations of black box models. CoRR, arXiv:1707.01154"},{"key":"1756_CR97","doi-asserted-by":"crossref","unstructured":"Laugel T, Lesot M-J, Marsala C, Renard X, Detyniecki M (2019) Unjustified classification regions and counterfactual explanations in machine learning. In: Brefeld U, Fromont \u00c9, Hotho A, Knobbe AJ, Maathuis MH, Robardet C (eds) Machine learning and knowledge discovery in databases\u2014European conference (ECML PKDD 2019), W\u00fcrzburg, Germany, September 16\u201320, 2019, Proceedings, Part II, volume 11907 of lecture notes in computer science. Springer, pp 37\u201354","DOI":"10.1007\/978-3-030-46147-8_3"},{"issue":"7553","key":"1756_CR98","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y LeCun","year":"2015","unstructured":"LeCun Y, Bengio Y, Hinton GE (2015) Deep learning. Nature 521(7553):436\u2013444","journal-title":"Nature"},{"key":"1756_CR99","first-page":"39:1","volume":"17","author":"S Levine","year":"2016","unstructured":"Levine S, Finn C, Darrell T, Abbeel P (2016) End-to-end training of deep visuomotor policies. J Mach Learn Res 17:39:1-39:40","journal-title":"J Mach Learn Res"},{"issue":"4\u20135","key":"1756_CR100","doi-asserted-by":"publisher","first-page":"421","DOI":"10.1177\/0278364917710318","volume":"37","author":"S Levine","year":"2018","unstructured":"Levine S, Pastor P, Krizhevsky A, Ibarz J, Quillen D (2018) Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collection. Int J Robot Res 37(4\u20135):421\u2013436","journal-title":"Int J Robot Res"},{"key":"1756_CR101","doi-asserted-by":"crossref","unstructured":"Li B, Qi P, Liu B, Di S, Liu J, Pei J, Yi J, Zhou B (2021) Trustworthy AI: from principles to practices. CoRR, arXiv:2110.01167","DOI":"10.1145\/3555803"},{"key":"1756_CR102","doi-asserted-by":"crossref","unstructured":"Li C, Quan C, Peng L, Qi Y, Deng Y, Wu L (2019) A capsule network for recommendation and explaining what you like and dislike. In: Piwowarski B, Chevalier M, Gaussier \u00c9, Maarek Y, Nie J-Y, Scholer F (eds) Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval (SIGIR 2019), Paris, France, July 21\u201325, 2019. ACM, pp 275\u2013284","DOI":"10.1145\/3331184.3331216"},{"key":"1756_CR103","doi-asserted-by":"crossref","unstructured":"Li O, Liu H, Chen C, Rudin C (2018) Deep learning for case-based reasoning through prototypes: a neural network that explains its predictions. In: McIlraith SA, Weinberger KQ (eds) Proceedings of the thirty-second AAAI conference on artificial intelligence (AAAI-18), the 30th innovative applications of artificial intelligence (IAAI-18), and the 8th AAAI symposium on educational advances in artificial intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2\u20137, 2018. AAAI Press, pp 3530\u20133537","DOI":"10.1609\/aaai.v32i1.11771"},{"key":"1756_CR104","unstructured":"Li X, Xiong H, Huang S, Ji S, Dou D (2021) Cross-model consensus of explanations and beyond for image classification models: an empirical study. CoRR, arXiv:2109.00707"},{"key":"1756_CR105","unstructured":"Li Y (2017) Deep reinforcement learning: an overview. CoRR, arXiv:1701.07274"},{"key":"1756_CR106","doi-asserted-by":"crossref","unstructured":"Lin Y-S, Lee W-C, Celik ZB (2021) What do you see? Evaluation of explainable artificial intelligence (XAI) interpretability through neural backdoors. In: Zhu F, Ooi BC, Miao C (eds) KDD \u201921: the 27th ACM SIGKDD conference on knowledge discovery and data mining, virtual event, Singapore, August 14\u201318, 2021. ACM, pp 1027\u20131035","DOI":"10.1145\/3447548.3467213"},{"issue":"10","key":"1756_CR107","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1145\/3233231","volume":"61","author":"ZC Lipton","year":"2018","unstructured":"Lipton ZC (2018) The mythos of model interpretability. Commun ACM 61(10):36\u201343","journal-title":"Commun ACM"},{"key":"1756_CR108","doi-asserted-by":"crossref","unstructured":"Litjens G, Kooi T, Bejnordi BE, Adiyoso Setio AA, Ciompi F, Ghafoorian M, van\u00a0der Laak JAWM, van Ginneken B, S\u00e1nchez CI (2017) A survey on deep learning in medical image analysis. Med Image Anal 42:60\u201388","DOI":"10.1016\/j.media.2017.07.005"},{"key":"1756_CR109","doi-asserted-by":"crossref","unstructured":"Liu H, Yin Q, Wang WY (2019) Towards explainable NLP: a generative explanation framework for text classification. In: Korhonen A, Traum DR, M\u00e0rquez L (eds) Proceedings of the 57th conference of the association for computational linguistics. Association for Computational Linguistics (ACL)","DOI":"10.18653\/v1\/P19-1560"},{"key":"1756_CR110","unstructured":"Lundberg SM, Lee S-I (2017) A unified approach to interpreting model predictions. In: Guyon I, von Luxburg U, Bengio S, Wallach HM, Fergus R, Vishwanathan SVN, Garnett R (eds) Advances in neural information processing systems 30: annual conference on neural information processing systems 2017, December 4\u20139 (2017), Long Beach, CA, USA, pp 4765\u20134774"},{"key":"1756_CR111","unstructured":"Luo D, Cheng W, Xu D, Yu W, Zong B, Chen H, Zhang X (2020) Parameterized explainer for graph neural network. In: Larochelle H, Ranzato MA, Hadsell R, Balcan M-F, Lin H-T (eds) Advances in neural information processing systems 33: annual conference on neural information processing systems 2020 (NeurIPS 2020), December 6\u201312, 2020, virtual"},{"key":"1756_CR112","first-page":"66","volume":"6","author":"Y Ma","year":"2019","unstructured":"Ma Y, Yu D, Wu T, Wang H (2019) Paddlepaddle: an open-source deep learning platform from industrial practice. Front Data Comput 6:66","journal-title":"Front Data Comput"},{"key":"1756_CR113","doi-asserted-by":"crossref","unstructured":"Mahendran A, Vedaldi A (2015) Understanding deep image representations by inverting them. In: IEEE conference on computer vision and pattern recognition (CVPR 2015), Boston, MA, USA, June 7\u201312, 2015. IEEE Computer Society, pp 5188\u20135196","DOI":"10.1109\/CVPR.2015.7299155"},{"key":"1756_CR114","unstructured":"Margeloiu A, Simidjievski N, Jamnik M, Weller A (2020) Improving interpretability in medical imaging diagnosis using adversarial training. CoRR, arXiv:2012.01166"},{"key":"1756_CR115","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.artint.2018.07.007","volume":"267","author":"T Miller","year":"2019","unstructured":"Miller T (2019) Explanation in artificial intelligence: insights from the social sciences. Artif Intell 267:1\u201338","journal-title":"Artif Intell"},{"key":"1756_CR116","doi-asserted-by":"crossref","unstructured":"Ming Y, Xu P, Qu H, Ren L (2019) Interpretable and steerable sequence learning via prototypes. In: Teredesai A, Kumar V, Li Y, Rosales R, Terzi E, Karypis G (eds) Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining (KDD 2019), Anchorage, AK, USA, August 4\u20138, 2019. ACM, pp 903\u2013913","DOI":"10.1145\/3292500.3330908"},{"issue":"7540","key":"1756_CR117","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1038\/nature14236","volume":"518","author":"V Mnih","year":"2015","unstructured":"Mnih V, Kavukcuoglu K, Silver D, Rusu AA, Veness J, Bellemare MG, Graves A, Riedmiller MA, Fidjeland A, Ostrovski G, Petersen S, Beattie C, Sadik A, Antonoglou I, King H, Kumaran D, Wierstra D, Legg S, Hassabis D (2015) Human-level control through deep reinforcement learning. Nature 518(7540):529\u2013533","journal-title":"Nature"},{"key":"1756_CR118","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1016\/j.patcog.2016.11.008","volume":"65","author":"G Montavon","year":"2017","unstructured":"Montavon G, Lapuschkin S, Binder A, Samek W, M\u00fcller K-R (2017) Explaining nonlinear classification decisions with deep Taylor decomposition. Pattern Recognit 65:211\u2013222","journal-title":"Pattern Recognit"},{"key":"1756_CR119","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.dsp.2017.10.011","volume":"73","author":"G Montavon","year":"2018","unstructured":"Montavon G, Samek W, M\u00fcller K-R (2018) Methods for interpreting and understanding deep neural networks. Digit Signal Process 73:1\u201315","journal-title":"Digit Signal Process"},{"issue":"1","key":"1756_CR120","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1145\/3400051.3400058","volume":"22","author":"R Moraffah","year":"2020","unstructured":"Moraffah R, Karami M, Guo R, Raglin A, Liu H (2020) Causal interpretability for machine learning\u2014problems, methods and evaluation. SIGKDD Explor 22(1):18\u201333","journal-title":"SIGKDD Explor"},{"key":"1756_CR121","doi-asserted-by":"crossref","unstructured":"Mothilal RK, Sharma A, Tan C (2020) Explaining machine learning classifiers through diverse counterfactual explanations. In: Hildebrandt M, Castillo C, Celis LE, Ruggieri S, Taylor L, Zanfir-Fortuna G (eds) FAT* \u201920: conference on fairness, accountability, and transparency, Barcelona, Spain, January 27\u201330, 2020. ACM, pp 607\u2013617","DOI":"10.1145\/3351095.3372850"},{"key":"1756_CR122","doi-asserted-by":"crossref","unstructured":"Murdoch WJ, Singh C, Kumbier K, Abbasi-Asl R, Yu B (2019) Interpretable machine learning: definitions, methods, and applications. CoRR, arXiv:1901.04592","DOI":"10.1073\/pnas.1900654116"},{"key":"1756_CR123","doi-asserted-by":"crossref","unstructured":"Nam W-J, Gur S, Choi J, Wolf L, Lee S-W (2020) Relative attributing propagation: interpreting the comparative contributions of individual units in deep neural networks. In: The thirty-fourth AAAI conference on artificial intelligence (AAAI 2020), the thirty-second innovative applications of artificial intelligence conference (IAAI 2020), the tenth AAAI symposium on educational advances in artificial intelligence, (EAAI 2020), New York, NY, USA, February 7\u201312, 2020. AAAI Press, pp 2501\u20132508","DOI":"10.1609\/aaai.v34i03.5632"},{"key":"1756_CR124","unstructured":"Nguyen AM, Dosovitskiy A, Yosinski J, Brox T, Clune J (2016) Synthesizing the preferred inputs for neurons in neural networks via deep generator networks. In: Lee DD, Sugiyama M, von Luxburg U, Guyon I, Garnett R (eds) Advances in neural information processing systems 29: annual conference on neural information processing systems 2016, December 5\u201310, 2016, Barcelona, Spain, pp 3387\u20133395"},{"key":"1756_CR125","unstructured":"Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G, Killeen T, Lin Z, Gimelshein N, Antiga L, Desmaison A, K\u00f6pf A, Yang EZ, DeVito Z, Raison M, Tejani A, Chilamkurthy S, Steiner B, Fang L, Bai J, Chintala S (2019) Pytorch: an imperative style, high-performance deep learning library. In: Wallach HM, Larochelle H, Beygelzimer A, d\u2019Alch\u00e9-Buc F, Fox EB, Garnett R (eds) Advances in neural information processing systems 32: annual conference on neural information processing systems 2019, (NeurIPS 2019), December 8\u201314, 2019, Vancouver, BC, Canada, pp 8024\u20138035"},{"key":"1756_CR126","first-page":"66","volume":"6","author":"J Pearl","year":"2009","unstructured":"Pearl J et al (2009) Causal inference in statistics: an overview. Stat Surv 6:66","journal-title":"Stat Surv"},{"key":"1756_CR127","unstructured":"Petsiuk V, Das A, Saenko K (2018) RISE: randomized input sampling for explanation of black-box models. In: British machine vision conference 2018 (BMVC 2018), Newcastle, UK, September 3\u20136, 2018. BMVA Press, p 151 (2018)"},{"key":"1756_CR128","unstructured":"Pleiss G, Zhang T, Elenberg ER, Weinberger KQ (2020) Identifying mislabeled data using the area under the margin ranking. In: Larochelle H, Ranzato MA, Hadsell R, Balcan M-F, Lin H-T (eds) Advances in neural information processing systems 33: annual conference on neural information processing systems 2020 (NeurIPS 2020), December 6\u201312, 2020, virtual"},{"key":"1756_CR129","unstructured":"Plumb G, Al-Shedivat M, Cabrera \u00c1A, Perer A, Xing EP, Talwalkar A (2020) Regularizing black-box models for improved interpretability. In: Larochelle H, Ranzato MA, Hadsell R, Balcan M-F, Lin H-T (eds) Advances in neural information processing systems 33: annual conference on neural information processing systems 2020 (NeurIPS 2020), December 6\u201312, 2020, virtual"},{"key":"1756_CR130","unstructured":"Plumb G, Molitor D, Talwalkar A (2018) Model agnostic supervised local explanations. In: Bengio S, Wallach HM, Larochelle H, Grauman K, Cesa-Bianchi N, Garnett R (eds) Advances in neural information processing systems 31: annual conference on neural information processing systems 2018 (NeurIPS 2018), December 3\u20138, 2018, Montr\u00e9al, Canada, pp 2520\u20132529"},{"key":"1756_CR131","unstructured":"Plumerault A, Borgne HL, Hudelot C (2020) Controlling generative models with continuous factors of variations. In: 8th International conference on learning representations (ICLR 2020), Addis Ababa, Ethiopia, April 26\u201330, 2020. OpenReview.net"},{"key":"1756_CR132","doi-asserted-by":"crossref","unstructured":"Pope PE, Kolouri S, Rostami M, Martin CE, Hoffmann H (2019) Explainability methods for graph convolutional neural networks. In: IEEE conference on computer vision and pattern recognition (CVPR 2019), Long Beach, CA, USA, June 16\u201320, 2019. Computer Vision Foundation\/IEEE, pp 10772\u201310781","DOI":"10.1109\/CVPR.2019.01103"},{"key":"1756_CR133","doi-asserted-by":"crossref","unstructured":"Preuer K, Klambauer G, Rippmann F, Hochreiter S, Unterthiner T (2019) Interpretable deep learning in drug discovery. In: Samek W, Montavon G, Vedaldi A, Hansen LK, M\u00fcller K-R (eds) Explainable AI: interpreting, explaining and visualizing deep learning, volume 11700 of lecture notes in computer science. Springer, pp 331\u2013345","DOI":"10.1007\/978-3-030-28954-6_18"},{"key":"1756_CR134","doi-asserted-by":"crossref","unstructured":"Puiutta E, Veith EMSP (2020) Explainable reinforcement learning: a survey. In: Holzinger A, Kieseberg P, Tjoa AM, Weippl ER (eds) Machine learning and knowledge extraction\u20144th IFIP TC 5, TC 12, WG 8.4, WG 8.9, WG 12.9 international cross-domain conference, CD-MAKE 2020, Dublin, Ireland, August 25\u201328, 2020, proceedings, volume 12279 of lecture notes in computer science. Springer, pp 77\u201395","DOI":"10.1007\/978-3-030-57321-8_5"},{"key":"1756_CR135","unstructured":"Puri N, Verma S, Gupta P, Kayastha D, Deshmukh S, Krishnamurthy B, Singh S (2020) Explain your move: understanding agent actions using specific and relevant feature attribution. In: 8th International conference on learning representations (ICLR 2020), Addis Ababa, Ethiopia, April 26\u201330, 2020. OpenReview.net"},{"key":"1756_CR136","first-page":"6","volume":"6","author":"P Rajpurkar","year":"2020","unstructured":"Rajpurkar P, O\u2019Connell C, Schechter A, Asnani N, Li J, Kiani A, Ball RL, Mendelson M, Maartens G, van Hoving DJ et al (2020) Chexaid: deep learning assistance for physician diagnosis of tuberculosis using chest x-rays in patients with HIV. NPJ Digit Med 6:6","journal-title":"NPJ Digit Med"},{"key":"1756_CR137","doi-asserted-by":"crossref","unstructured":"Ribeiro MT, Singh S, Guestrin C (2016) \u201cWhy should I trust you?\u201d: explaining the predictions of any classifier. In: Krishnapuram B, Shah M, Smola AJ, Aggarwal CC, Shen D, Rastogi R (eds) Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, San Francisco, CA, USA, August 13\u201317, 2016. ACM, pp 1135\u20131144","DOI":"10.1145\/2939672.2939778"},{"key":"1756_CR138","doi-asserted-by":"crossref","unstructured":"Ribeiro MT, Singh S, Guestrin C (2018) Anchors: high-precision model-agnostic explanations. In: McIlraith SA, Weinberger KQ (eds) Proceedings of the thirty-second AAAI conference on artificial intelligence (AAAI-18), the 30th innovative applications of artificial intelligence (IAAI-18), and the 8th AAAI symposium on educational advances in artificial intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2\u20137, 2018. AAAI Press, pp 1527\u20131535","DOI":"10.1609\/aaai.v32i1.11491"},{"key":"1756_CR139","doi-asserted-by":"crossref","unstructured":"Ricci F, Rokach L, Shapira B (2011) Introduction to recommender systems handbook. In: Ricci F, Rokach L, Shapira B, Kantor PB (eds) Recommender systems handbook. Springer, pp 1\u201335","DOI":"10.1007\/978-0-387-85820-3_1"},{"key":"1756_CR140","doi-asserted-by":"crossref","unstructured":"Ross AS, Doshi-Velez F (2018) Improving the adversarial robustness and interpretability of deep neural networks by regularizing their input gradients. In: McIlraith SA, Weinberger KQ (eds) Proceedings of the thirty-second AAAI conference on artificial intelligence (AAAI-18), the 30th innovative applications of artificial intelligence (IAAI-18), and the 8th AAAI symposium on educational advances in artificial intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2\u20137, 2018. AAAI Press, pp 1660\u20131669","DOI":"10.1609\/aaai.v32i1.11504"},{"key":"1756_CR141","first-page":"66","volume":"6","author":"C Rudin","year":"2019","unstructured":"Rudin C (2019) Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nat Mach Intell 6:66","journal-title":"Nat Mach Intell"},{"key":"1756_CR142","unstructured":"Sabour S, Frosst N, Hinton GE (2017) Dynamic routing between capsules. In: Guyon I, von Luxburg U, Bengio S, Wallach HM, Fergus R, Vishwanathan SVN, Garnett R (eds) Advances in neural information processing systems 30: annual conference on neural information processing systems 2017, December 4\u20139, 2017, Long Beach, CA, USA, pp 3856\u20133866"},{"issue":"11","key":"1756_CR143","doi-asserted-by":"publisher","first-page":"2660","DOI":"10.1109\/TNNLS.2016.2599820","volume":"28","author":"W Samek","year":"2017","unstructured":"Samek W, Binder A, Montavon G, Lapuschkin S, M\u00fcller K-R (2017) Evaluating the visualization of what a deep neural network has learned. IEEE Trans Neural Netw Learn Syst 28(11):2660\u20132673","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"issue":"3","key":"1756_CR144","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1109\/JPROC.2021.3060483","volume":"109","author":"W Samek","year":"2021","unstructured":"Samek W, Montavon G, Lapuschkin S, Anders CJ, M\u00fcller K-R (2021) Explaining deep neural networks and beyond: a review of methods and applications. Proc IEEE 109(3):247\u2013278","journal-title":"Proc IEEE"},{"issue":"2","key":"1756_CR145","doi-asserted-by":"publisher","first-page":"336","DOI":"10.1007\/s11263-019-01228-7","volume":"128","author":"RR Selvaraju","year":"2020","unstructured":"Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D (2020) Grad-CAM: visual explanations from deep networks via gradient-based localization. Int J Comput Vis 128(2):336\u2013359","journal-title":"Int J Comput Vis"},{"key":"1756_CR146","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2019.101758","volume":"102","author":"S Sengupta","year":"2020","unstructured":"Sengupta S, Singh A, Leopold HA, Gulati T, Lakshminarayanan V (2020) Ophthalmic diagnosis using deep learning with fundus images\u2014a critical review. Artif Intell Med 102:101758","journal-title":"Artif Intell Med"},{"key":"1756_CR147","doi-asserted-by":"crossref","unstructured":"Seo S, Huang J, Yang H, Liu Y (2017) Interpretable convolutional neural networks with dual local and global attention for review rating prediction. In: Cremonesi P, Ricci F, Berkovsky S, Tuzhilin A (eds) Proceedings of the eleventh ACM conference on recommender systems (RecSys 2017), Como, Italy, August 27\u201331, 2017. ACM, pp 297\u2013305","DOI":"10.1145\/3109859.3109890"},{"key":"1756_CR148","doi-asserted-by":"crossref","unstructured":"Serrano S, Smith NA (2019) Is attention interpretable? In: Korhonen A, Traum DR, M\u00e0rquez L (eds) Proceedings of the 57th conference of the association for computational linguistics. Association for Computational Linguistics (ACL)","DOI":"10.18653\/v1\/P19-1282"},{"key":"1756_CR149","doi-asserted-by":"crossref","unstructured":"Shen Y, Zhou B (2021) Closed-form factorization of latent semantics in gans. In: IEEE conference on computer vision and pattern recognition (CVPR 2021), virtual, June 19\u201325, 2021. Computer Vision Foundation\/IEEE, pp 1532\u20131540","DOI":"10.1109\/CVPR46437.2021.00158"},{"key":"1756_CR150","unstructured":"Shrikumar A, Greenside P, Kundaje A (2017) Learning important features through propagating activation differences. In: Precup D, Teh YW (eds) Proceedings of the 34th international conference on machine learning (ICML 2017), Sydney, NSW, Australia, 6\u201311 August 2017, volume\u00a070 of proceedings of machine learning research (PMLR), pp 3145\u20133153"},{"issue":"7587","key":"1756_CR151","doi-asserted-by":"publisher","first-page":"484","DOI":"10.1038\/nature16961","volume":"529","author":"D Silver","year":"2016","unstructured":"Silver D, Huang A, Maddison CJ, Guez A, Sifre L, van den Driessche G, Schrittwieser J, Antonoglou I, Panneershelvam V, Lanctot M, Dieleman S, Grewe D, Nham J, Kalchbrenner N, Sutskever I, Lillicrap TP, Leach M, Kavukcuoglu K, Graepel T, Hassabis D (2016) Mastering the game of go with deep neural networks and tree search. Nature 529(7587):484\u2013489","journal-title":"Nature"},{"issue":"7676","key":"1756_CR152","doi-asserted-by":"publisher","first-page":"354","DOI":"10.1038\/nature24270","volume":"550","author":"D Silver","year":"2017","unstructured":"Silver D, Schrittwieser J, Simonyan K, Antonoglou I, Huang A, Guez A, Hubert T, Baker L, Lai M, Bolton A, Chen Y, Lillicrap TP, Hui F, Sifre L, van den Driessche G, Graepel T, Hassabis D (2017) Mastering the game of go without human knowledge. Nature 550(7676):354\u2013359","journal-title":"Nature"},{"key":"1756_CR153","unstructured":"Simonyan K, Vedaldi A, Zisserman A (2014) Deep inside convolutional networks: visualising image classification models and saliency maps. In: Bengio Y, LeCun Y (eds) 2nd International conference on learning representations (ICLR 2014), Banff, AB, Canada, April 14\u201316, 2014, workshop track proceedings"},{"issue":"6","key":"1756_CR154","doi-asserted-by":"publisher","first-page":"52","DOI":"10.3390\/jimaging6060052","volume":"6","author":"A Singh","year":"2020","unstructured":"Singh A, Sengupta S, Lakshminarayanan V (2020) Explainable deep learning models in medical image analysis. J Imaging 6(6):52","journal-title":"J Imaging"},{"key":"1756_CR155","unstructured":"Smilkov D, Thorat N, Kim B, Vi\u00e9gas FB, Wattenberg M (2017) Smoothgrad: removing noise by adding noise. CoRR, arXiv:1706.03825"},{"key":"1756_CR156","unstructured":"Srinivas S, Fleuret F (2019) Full-gradient representation for neural network visualization. In: Wallach HM, Larochelle H, Beygelzimer A, d\u2019Alch\u00e9-Buc F, Fox EB, Garnett R (eds) Advances in neural information processing systems 32: annual conference on neural information processing systems 2019 (NeurIPS 2019), December 8\u201314, 2019, Vancouver, BC, Canada, pp 4126\u20134135"},{"key":"1756_CR157","first-page":"66","volume":"6","author":"H Strobelt","year":"2019","unstructured":"Strobelt H, Gehrmann S, Behrisch M, Perer A, Pfister H, Rush AM (2019) Seq2seq-vis: a visual debugging tool for sequence-to-sequence models. IEEE Trans Vis Comput Graph 6:66","journal-title":"IEEE Trans Vis Comput Graph"},{"key":"1756_CR158","first-page":"66","volume":"6","author":"H Strobelt","year":"2018","unstructured":"Strobelt H, Gehrmann S, Pfister H, Rush AM (2018) Lstmvis: a tool for visual analysis of hidden state dynamics in recurrent neural networks. IEEE Trans Vis Comput Graph 6:66","journal-title":"IEEE Trans Vis Comput Graph"},{"key":"1756_CR159","unstructured":"Sun Y, Wang S, Li Y-K, Feng S, Chen X, Zhang H, Tian X, Zhu D, Tian H, Wu H (2019) ERNIE: enhanced representation through knowledge integration. CoRR arXiv:1904.09223"},{"key":"1756_CR160","unstructured":"Sundararajan M, Taly A, Yan Q (2017) Axiomatic attribution for deep networks. In: Precup D, Teh YW (eds) Proceedings of the 34th international conference on machine learning (ICML 2017), Sydney, NSW, Australia, 6\u201311 August 2017, volume\u00a070 of proceedings of machine learning research (PMLR), pp 3319\u20133328"},{"key":"1756_CR161","doi-asserted-by":"crossref","unstructured":"Swayamdipta S, Schwartz R, Lourie N, Wang Y, Hajishirzi H, Smith NA, Choi Y (2020) Dataset cartography: mapping and diagnosing datasets with training dynamics. In: Webber B, Cohn T, He Y, Liu Y (eds) Proceedings of the 2020 conference on empirical methods in natural language processing (EMNLP 2020), Online, November 16\u201320, 2020. Association for Computational Linguistics, pp 9275\u20139293","DOI":"10.18653\/v1\/2020.emnlp-main.746"},{"key":"1756_CR162","doi-asserted-by":"crossref","unstructured":"Tang J, Wang K (2018) Personalized top-n sequential recommendation via convolutional sequence embedding. In: Chang Y, Zhai C, Liu Y, Maarek Y (eds) Proceedings of the eleventh ACM international conference on web search and data mining (WSDM 2018), Marina Del Rey, CA, USA, February 5\u20139, 2018. ACM, 565\u2013573","DOI":"10.1145\/3159652.3159656"},{"issue":"11","key":"1756_CR163","doi-asserted-by":"publisher","first-page":"4793","DOI":"10.1109\/TNNLS.2020.3027314","volume":"32","author":"E Tjoa","year":"2021","unstructured":"Tjoa E, Guan C (2021) A survey on explainable artificial intelligence (XAI): toward medical XAI. IEEE Trans Neural Netw Learn Syst 32(11):4793\u20134813","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"1756_CR164","unstructured":"Toneva M, Sordoni A, des Combes RT, Trischler A, Bengio Y, Gordon GJ (2019) An empirical study of example forgetting during deep neural network learning. In: 7th International conference on learning representations (ICLR 2019), New Orleans, LA, USA, May 6\u20139, 2019. OpenReview.net"},{"key":"1756_CR165","unstructured":"Tsipras D, Santurkar S, Engstrom L, Turner A, Madry A (2019) Robustness may be at odds with accuracy. In: 7th International conference on learning representations (ICLR 2019), New Orleans, LA, USA, May 6\u20139, 2019. OpenReview.net"},{"key":"1756_CR166","unstructured":"van\u00a0der Linden I, Haned H, Kanoulas E (2019) Global aggregations of local explanations for black box models. CoRR, arXiv:1907.03039"},{"key":"1756_CR167","unstructured":"Verma S, Dickerson JP, Hines K (2020) Counterfactual explanations for machine learning: a review. CoRR, arXiv:2010.10596"},{"key":"1756_CR168","doi-asserted-by":"crossref","unstructured":"Vinyals O, Babuschkin I, Czarnecki WM, Mathieu M, Dudzik A, Chung J, Choi DH, Powell R, Ewalds T, Georgiev P, Oh J, Horgan D, Kroiss M, Danihelka I, Huang A, Sifre L, Cai T, Agapiou JP, Jaderberg M, Vezhnevets AS, Leblond R, Pohlen T, Dalibard V, Budden D, Sulsky Y, Molloy J, Le Paine T, G\u00fcl\u00e7ehre \u00c7, Wang Z, Pfaff T, Wu Y, Ring R, Yogatama D, W\u00fcnsch D, McKinney K, Smith O, Schaul T, Lillicrap TP, Kavukcuoglu K, Hassabis D, Apps C, Silver D (2019) Grandmaster level in starcraft II using multi-agent reinforcement learning. Nature 575(7782):350\u2013354","DOI":"10.1038\/s41586-019-1724-z"},{"key":"1756_CR169","doi-asserted-by":"crossref","unstructured":"Voita E, Talbot D, Moiseev F, Sennrich R, Titov I (2019) Analyzing multi-head self-attention: specialized heads do the heavy lifting, the rest can be pruned. In: Korhonen A, Traum DR, M\u00e0rquez L (eds) Proceedings of the 57th conference of the Association for Computational Linguistics (ACL 2019), Florence, Italy, July 28\u2013August 2, 2019, Volume 1: Long Papers. Association for Computational Linguistics, pp 5797\u20135808","DOI":"10.18653\/v1\/P19-1580"},{"key":"1756_CR170","unstructured":"Voynov A, Babenko A (2019) RPGAN: gans interpretability via random routing. CoRR, arXiv:1912.10920"},{"key":"1756_CR171","unstructured":"Voynov A, Babenko A (2020) Unsupervised discovery of interpretable directions in the GAN latent space. In: Proceedings of the 37th international conference on machine learning (ICML 2020), 13\u201318 July 2020, virtual event, volume 119 of proceedings of machine learning research (PMLR), pp 9786\u20139796"},{"key":"1756_CR172","unstructured":"Vu MN, Nguyen TDT, Phan N, Gera R, Thai MT (2019) Evaluating explainers via perturbation. CoRR, arXiv:1906.02032"},{"key":"1756_CR173","doi-asserted-by":"crossref","unstructured":"Wachter S, Mittelstadt BD, Russell C (2017) Counterfactual explanations without opening the black box: automated decisions and the GDPR. CoRR, arXiv:1711.00399","DOI":"10.2139\/ssrn.3063289"},{"key":"1756_CR174","doi-asserted-by":"crossref","unstructured":"Wang H, Wang Z, Du M, Yang F, Zhang Z, Ding S, Mardziel P, Hu X (2020) Score-CAM: score-weighted visual explanations for convolutional neural networks. In: 2020 IEEE\/CVF conference on computer vision and pattern recognition (CVPR Workshops 2020), Seattle, WA, USA, June 14\u201319, 2020. Computer Vision Foundation\/IEEE, pp 111\u2013119","DOI":"10.1109\/CVPRW50498.2020.00020"},{"key":"1756_CR175","unstructured":"Welinder P, Branson S, Mita T, Wah C, Schroff F, Belongie S, Perona P (2010) Caltech-UCSD birds 200. Technical Report CNS-TR-2010-001, California Institute of Technology"},{"key":"1756_CR176","unstructured":"Wickramanayake S, Hsu W, Lee M-L (2021) Explanation-based data augmentation for image classification. In: Ranzato MA, Beygelzimer A, Dauphin YN, Liang P, Vaughan JW (eds) Advances in neural information processing systems 34: annual conference on neural information processing systems 2021 (NeurIPS 2021), December 6\u201314, 2021, virtual, pp 20929\u201320940"},{"key":"1756_CR177","doi-asserted-by":"crossref","unstructured":"Wiegreffe S, Pinter Y (2019) Attention is not not explanation. In: Inui K, Jiang J, Ng V, Wan X (eds) Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP). Association for Computational Linguistics","DOI":"10.18653\/v1\/D19-1002"},{"key":"1756_CR178","doi-asserted-by":"crossref","unstructured":"Woo S, Park J, Lee J-Y, Kweon IS (2018) CBAM: convolutional block attention module. In: Ferrari V, Hebert M, Sminchisescu C, Weiss Y (eds) Computer vision\u2014ECCV 2018\u201415th European conference, Munich, Germany, September 8\u201314, 2018, proceedings, Part VII, volume 11211 of lecture notes in computer science. Springer, pp 3\u201319","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"1756_CR179","unstructured":"Xu G, Duong TD, Li Q, Liu S, Wang X (2020) Causality learning: a new perspective for interpretable machine learning. CoRR, arXiv:2006.16789"},{"issue":"5","key":"1756_CR180","doi-asserted-by":"publisher","first-page":"1451","DOI":"10.1007\/s11263-020-01429-5","volume":"129","author":"C Yang","year":"2021","unstructured":"Yang C, Shen Y, Zhou B (2021) Semantic hierarchy emerges in deep generative representations for scene synthesis. Int J Comput Vis 129(5):1451\u20131466","journal-title":"Int J Comput Vis"},{"key":"1756_CR181","unstructured":"Yang M, Kim B (2019) Benchmarking attribution methods with relative feature importance"},{"key":"1756_CR182","doi-asserted-by":"crossref","unstructured":"Yao Y, Chen T, Xie G-S, Zhang C, Shen F, Wu Q, Tang Z, Zhang J (2021) Non-salient region object mining for weakly supervised semantic segmentation. In: IEEE conference on computer vision and pattern recognition (CVPR 2021), virtual, June 19\u201325, 2021. Computer Vision Foundation\/IEEE, pp 2623\u20132632","DOI":"10.1109\/CVPR46437.2021.00265"},{"key":"1756_CR183","unstructured":"Yeh C-K, Hsieh C-Y, Suggala AS, Inouye DI, Ravikumar P (2019) On the (in)fidelity and sensitivity of explanations. In: Wallach HM, Larochelle H, Beygelzimer A, d\u2019Alch\u00e9-Buc F, Fox EB, Garnett R (eds) Advances in neural information processing systems 32: annual conference on neural information processing systems 2019 (NeurIPS 2019), December 8\u201314, 2019, Vancouver, BC, Canada, pp 10965\u201310976"},{"key":"1756_CR184","unstructured":"Ying Z, Bourgeois D, You J, Zitnik M, Leskovec J (2019) Gnnexplainer: generating explanations for graph neural networks. In: Wallach HM, Larochelle H, Beygelzimer A, d\u2019Alch\u00e9-Buc F, Fox EB, Garnett R (eds) Advances in neural information processing systems 32: annual conference on neural information processing systems 2019 (NeurIPS 2019), December 8\u201314, 2019, Vancouver, BC, Canada, pp 9240\u20139251"},{"key":"1756_CR185","unstructured":"Yuan T, Li X, Xiong H, Cao H, Dou D (2021) Explaining information flow inside vision transformers using Markov chain. In: Neural information processing systems XAI4Debugging workshop"},{"key":"1756_CR186","unstructured":"Zagoruyko S, Komodakis N (2017) Paying more attention to attention: improving the performance of convolutional neural networks via attention transfer. In: 5th International conference on learning representations (ICLR 2017), Toulon, France, April 24\u201326, 2017, conference track proceedings. OpenReview.net"},{"issue":"3","key":"1756_CR187","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1145\/3446776","volume":"64","author":"C Zhang","year":"2021","unstructured":"Zhang C, Bengio S, Hardt M, Recht B, Vinyals O (2021) Understanding deep learning (still) requires rethinking generalization. Commun ACM 64(3):107\u2013115","journal-title":"Commun ACM"},{"key":"1756_CR188","unstructured":"Zhang H, Ciss\u00e9 M, Dauphin YN, Lopez-Paz D (2018) Mixup: beyond empirical risk minimization. In: 6th International conference on learning representations (ICLR 2018), Vancouver, BC, Canada, April 30\u2013May 3, 2018, conference track proceedings. OpenReview.net"},{"issue":"10","key":"1756_CR189","doi-asserted-by":"publisher","first-page":"1084","DOI":"10.1007\/s11263-017-1059-x","volume":"126","author":"J Zhang","year":"2018","unstructured":"Zhang J, Bargal SA, Lin Z, Brandt J, Shen X, Sclaroff S (2018) Top-down neural attention by excitation backprop. Int J Comput Vis 126(10):1084\u20131102","journal-title":"Int J Comput Vis"},{"key":"1756_CR190","doi-asserted-by":"crossref","unstructured":"Zhang Q, Cao R, Shi F, Wu YN, Zhu S-C (2018) Interpreting CNN knowledge via an explanatory graph. In: McIlraith SA, Weinberger KQ (eds) Proceedings of the thirty-second AAAI conference on artificial intelligence (AAAI-18), the 30th innovative applications of artificial intelligence (IAAI-18), and the 8th AAAI symposium on educational advances in artificial intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2\u20137, 2018. AAAI Press, pp 4454\u20134463","DOI":"10.1609\/aaai.v32i1.11819"},{"key":"1756_CR191","doi-asserted-by":"crossref","unstructured":"Zhang Q, Wu YN, Zhu S-C (2018) Interpretable convolutional neural networks. In: 2018 IEEE conference on computer vision and pattern recognition (CVPR 2018), Salt Lake City, UT, USA, June 18\u201322, 2018. Computer Vision Foundation\/IEEE Computer Society, pp 8827\u20138836","DOI":"10.1109\/CVPR.2018.00920"},{"key":"1756_CR192","doi-asserted-by":"crossref","unstructured":"Zhang Q, Yang Y, Ma H, Wu YN (2019) Interpreting cnns via decision trees. In: IEEE conference on computer vision and pattern recognition (CVPR 2019), Long Beach, CA, USA, June 16\u201320, 2019. Computer Vision Foundation\/IEEE, pp 6261\u20136270","DOI":"10.1109\/CVPR.2019.00642"},{"issue":"1","key":"1756_CR193","first-page":"51","volume":"52","author":"S Zhang","year":"2019","unstructured":"Zhang S, Yao L, Sun A, Tay Y (2019) Deep learning based recommender system: a survey and new perspectives. ACM Comput Surv 52(1):51\u2013538","journal-title":"ACM Comput Surv"},{"key":"1756_CR194","unstructured":"Zhang T, Zhu Z (2019) Interpreting adversarially trained convolutional neural networks. In: Chaudhuri K, Salakhutdinov R (eds) Proceedings of the 36th international conference on machine learning (ICML 2019), 9\u201315 June 2019, Long Beach, California, USA, volume\u00a097 of proceedings of machine learning research (PMLR), pp 7502\u20137511"},{"issue":"1","key":"1756_CR195","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1561\/1500000066","volume":"14","author":"Y Zhang","year":"2020","unstructured":"Zhang Y, Chen X (2020) Explainable recommendation: a survey and new perspectives. Found Trends Inf Retr 14(1):1\u2013101","journal-title":"Found Trends Inf Retr"},{"key":"1756_CR196","doi-asserted-by":"crossref","unstructured":"Zhao G, Zhou B, Wang K, Jiang R, Xu M (2018) Respond-CAM: analyzing deep models for 3d imaging data by visualizations. In: Frangi AF, Schnabel JA, Davatzikos C, Alberola-L\u00f3pez C, Fichtinger G (eds) Medical image computing and computer assisted intervention\u2014MICCAI 2018\u201421st international conference, Granada, Spain, September 16\u201320, 2018, proceedings, Part I, volume 11070 of lecture notes in computer science. Springer, pp 485\u2013492","DOI":"10.1007\/978-3-030-00928-1_55"},{"key":"1756_CR197","doi-asserted-by":"crossref","unstructured":"Zhou B, Khosla A, Lapedriza \u00c0, Oliva A, Torralba A (2016) Learning deep features for discriminative localization. In: 2016 IEEE conference on computer vision and pattern recognition, (CVPR 2016), Las Vegas, NV, USA, June 27\u201330, 2016. IEEE Computer Society, pp 2921\u20132929","DOI":"10.1109\/CVPR.2016.319"}],"container-title":["Knowledge and Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10115-022-01756-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10115-022-01756-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10115-022-01756-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,21]],"date-time":"2022-10-21T17:17:30Z","timestamp":1666372650000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10115-022-01756-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,14]]},"references-count":199,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["1756"],"URL":"https:\/\/doi.org\/10.1007\/s10115-022-01756-8","relation":{},"ISSN":["0219-1377","0219-3116"],"issn-type":[{"value":"0219-1377","type":"print"},{"value":"0219-3116","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,14]]},"assertion":[{"value":"18 March 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 August 2022","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 August 2022","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 September 2022","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}