{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T20:34:50Z","timestamp":1773174890467,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":28,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,8,14]],"date-time":"2021-08-14T00:00:00Z","timestamp":1628899200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"name":"Institute for Information & communications Technology Planning & Evaluation","award":["2019-0-00075"],"award-info":[{"award-number":["2019-0-00075"]}]},{"name":"Institute for Information & communications Technology Planning & Evaluation","award":["2017-0-01779"],"award-info":[{"award-number":["2017-0-01779"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,8,14]]},"DOI":"10.1145\/3447548.3467346","type":"proceedings-article","created":{"date-parts":[[2021,8,12]],"date-time":"2021-08-12T06:12:05Z","timestamp":1628748725000},"page":"158-166","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Interpreting Internal Activation Patterns in Deep Temporal Neural Networks by Finding Prototypes"],"prefix":"10.1145","author":[{"given":"Sohee","family":"Cho","sequence":"first","affiliation":[{"name":"KAIST, Seongnam, Republic of Korea"}]},{"given":"Wonjoon","family":"Chang","sequence":"additional","affiliation":[{"name":"KAIST, Seongnam, Republic of Korea"}]},{"given":"Ginkyeng","family":"Lee","sequence":"additional","affiliation":[{"name":"Ulsan National Institute of Science and Technology, Ulsan, Republic of Korea"}]},{"given":"Jaesik","family":"Choi","sequence":"additional","affiliation":[{"name":"KAIST & INEEJI, Seongnam, Republic of Korea"}]}],"member":"320","published-online":{"date-parts":[[2021,8,14]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.12"},{"key":"e_1_3_2_1_2_1","volume-title":"On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation. PLOS ONE 10 (07","author":"Bach Sebastian","year":"2015","unstructured":"Sebastian Bach , Alexander Binder , Gregoire Montavon , Frederick Klauschen , Klaus-Robert Muller , and Wojciech Samek . 2015. On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation. PLOS ONE 10 (07 2015 ), 1--46. https:\/\/doi.org\/10.1371\/journal.pone.0130140 10.1371\/journal.pone.0130140 Sebastian Bach, Alexander Binder, Gregoire Montavon, Frederick Klauschen, Klaus-Robert Muller, and Wojciech Samek. 2015. On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation. PLOS ONE 10 (07 2015), 1--46. https:\/\/doi.org\/10.1371\/journal.pone.0130140"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.354"},{"key":"e_1_3_2_1_4_1","volume-title":"Gan dissection: Visualizing and understanding generative adversarial networks. arXiv preprint arXiv:1811.10597","author":"Bau David","year":"2018","unstructured":"David Bau , Jun-Yan Zhu , Hendrik Strobelt , Bolei Zhou , Joshua B Tenenbaum , William T Freeman , and Antonio Torralba . 2018. Gan dissection: Visualizing and understanding generative adversarial networks. arXiv preprint arXiv:1811.10597 ( 2018 ). David Bau, Jun-Yan Zhu, Hendrik Strobelt, Bolei Zhou, Joshua B Tenenbaum, William T Freeman, and Antonio Torralba. 2018. Gan dissection: Visualizing and understanding generative adversarial networks. arXiv preprint arXiv:1811.10597 (2018)."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1214\/11-AOAS495"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-44781-0_8"},{"key":"e_1_3_2_1_7_1","volume-title":"Explaining image classifiers by counterfactual generation. arXiv preprint arXiv:1807.08024","author":"Chang Chun-Hao","year":"2018","unstructured":"Chun-Hao Chang , Elliot Creager , Anna Goldenberg , and David Duvenaud . 2018. Explaining image classifiers by counterfactual generation. arXiv preprint arXiv:1807.08024 ( 2018 ). Chun-Hao Chang, Elliot Creager, Anna Goldenberg, and David Duvenaud. 2018. Explaining image classifiers by counterfactual generation. arXiv preprint arXiv:1807.08024 (2018)."},{"key":"e_1_3_2_1_8_1","unstructured":"Yanping Chen Eamonn Keogh Bing Hu Nurjahan Begum Anthony Bagnall Abdullah Mueen and Gustavo Batista. 2015. The UCR Time Series Classification Archive. www.cs.ucr.edu\/~eamonn\/time_series_data\/.  Yanping Chen Eamonn Keogh Bing Hu Nurjahan Begum Anthony Bagnall Abdullah Mueen and Gustavo Batista. 2015. The UCR Time Series Classification Archive. www.cs.ucr.edu\/~eamonn\/time_series_data\/."},{"key":"e_1_3_2_1_9_1","volume-title":"Jimeng Sun, Joshua Kulas, Andy Schuetz, and Walter Stewart.","author":"Choi Edward","year":"2016","unstructured":"Edward Choi , Mohammad Taha Bahadori , Jimeng Sun, Joshua Kulas, Andy Schuetz, and Walter Stewart. 2016 . Retain : An interpretable predictive model for healthcare using reverse time attention mechanism. In Advances in Neural Information Processing Systems . 3504--3512. Edward Choi, Mohammad Taha Bahadori, Jimeng Sun, Joshua Kulas, Andy Schuetz, and Walter Stewart. 2016. Retain: An interpretable predictive model for healthcare using reverse time attention mechanism. In Advances in Neural Information Processing Systems. 3504--3512."},{"key":"e_1_3_2_1_10_1","unstructured":"Dheeru Dua and Casey Graff. 2017. UCI Machine Learning Repository. http: \/\/archive.ics.uci.edu\/ml  Dheeru Dua and Casey Graff. 2017. UCI Machine Learning Repository. http: \/\/archive.ics.uci.edu\/ml"},{"key":"e_1_3_2_1_11_1","first-page":"2","article-title":"A Dual Approach to Scalable Verification of Deep Networks","volume":"1","author":"Dvijotham Krishnamurthy","year":"2018","unstructured":"Krishnamurthy Dvijotham , Robert Stanforth , Sven Gowal , Timothy A Mann , and Pushmeet Kohli . 2018 . A Dual Approach to Scalable Verification of Deep Networks .. In UAI , Vol. 1. 2 . Krishnamurthy Dvijotham, Robert Stanforth, Sven Gowal, Timothy A Mann, and Pushmeet Kohli. 2018. A Dual Approach to Scalable Verification of Deep Networks.. In UAI, Vol. 1. 2.","journal-title":"UAI"},{"key":"e_1_3_2_1_12_1","first-page":"723","article-title":"A kernel two-sample test","volume":"13","author":"Gretton Arthur","year":"2012","unstructured":"Arthur Gretton , Karsten M Borgwardt , Malte J Rasch , Bernhard Sch\u00f6lkopf , and Alexander Smola . 2012 . A kernel two-sample test . The Journal of Machine Learning Research 13 , 1 (2012), 723 -- 773 . Arthur Gretton, Karsten M Borgwardt, Malte J Rasch, Bernhard Sch\u00f6lkopf, and Alexander Smola. 2012. A kernel two-sample test. The Journal of Machine Learning Research 13, 1 (2012), 723--773.","journal-title":"The Journal of Machine Learning Research"},{"key":"e_1_3_2_1_13_1","volume-title":"XAI-Explainable artificial intelligence. Science Robotics 4, 37","author":"Gunning David","year":"2019","unstructured":"David Gunning , Mark Stefik , Jaesik Choi , Timothy Miller , Simone Stumpf , and Guang-Zhong Yang . 2019. XAI-Explainable artificial intelligence. Science Robotics 4, 37 ( 2019 ). David Gunning, Mark Stefik, Jaesik Choi, Timothy Miller, Simone Stumpf, and Guang-Zhong Yang. 2019. XAI-Explainable artificial intelligence. Science Robotics 4, 37 (2019)."},{"key":"e_1_3_2_1_14_1","volume-title":"Saehoon Kim, Juho Lee, Kwang Joon Kim, Eunho Yang, and Sung Ju Hwang.","author":"Heo Jay","year":"2018","unstructured":"Jay Heo , Hae Beom Lee , Saehoon Kim, Juho Lee, Kwang Joon Kim, Eunho Yang, and Sung Ju Hwang. 2018 . Uncertainty-aware attention for reliable interpretation and prediction. In Advances in Neural Information Processing Systems . 909--918. Jay Heo, Hae Beom Lee, Saehoon Kim, Juho Lee, Kwang Joon Kim, Eunho Yang, and Sung Ju Hwang. 2018. Uncertainty-aware attention for reliable interpretation and prediction. In Advances in Neural Information Processing Systems. 909--918."},{"key":"e_1_3_2_1_15_1","volume-title":"An Efficient Explorative Sampling Considering the Generative Boundaries of Deep Generative Neural Networks. arXiv preprint arXiv:1912.05827","author":"Jeon Giyoung","year":"2019","unstructured":"Giyoung Jeon , Haedong Jeong , and Jaesik Choi . 2019. An Efficient Explorative Sampling Considering the Generative Boundaries of Deep Generative Neural Networks. arXiv preprint arXiv:1912.05827 ( 2019 ). Giyoung Jeon, Haedong Jeong, and Jaesik Choi. 2019. An Efficient Explorative Sampling Considering the Generative Boundaries of Deep Generative Neural Networks. arXiv preprint arXiv:1912.05827 (2019)."},{"key":"e_1_3_2_1_16_1","unstructured":"Been Kim Rajiv Khanna and Oluwasanmi O Koyejo. 2016. Examples are not enough learn to criticize! criticism for interpretability. In Advances in neural information processing systems. 2280--2288.  Been Kim Rajiv Khanna and Oluwasanmi O Koyejo. 2016. Examples are not enough learn to criticize! criticism for interpretability. In Advances in neural information processing systems. 2280--2288."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3206025.3206039"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2016.11.008"},{"key":"e_1_3_2_1_20_1","volume-title":"Relative Attributing Propagation: Interpreting the Comparative Contributions of Individual Units in Deep Neural Networks. arXiv preprint arXiv:1904.00605","author":"Nam Woo-Jeoung","year":"2019","unstructured":"Woo-Jeoung Nam , Jaesik Choi , and Seong-Whan Lee . 2019. Relative Attributing Propagation: Interpreting the Comparative Contributions of Individual Units in Deep Neural Networks. arXiv preprint arXiv:1904.00605 ( 2019 ). Woo-Jeoung Nam, Jaesik Choi, and Seong-Whan Lee. 2019. Relative Attributing Propagation: Interpreting the Comparative Contributions of Individual Units in Deep Neural Networks. arXiv preprint arXiv:1904.00605 (2019)."},{"key":"e_1_3_2_1_21_1","volume-title":"An analysis of approximations for maximizing submodular set functions-I. Mathematical programming 14, 1","author":"Nemhauser George L","year":"1978","unstructured":"George L Nemhauser , LaurenceAWolsey, and Marshall L Fisher . 1978. An analysis of approximations for maximizing submodular set functions-I. Mathematical programming 14, 1 ( 1978 ), 265--294. George L Nemhauser, LaurenceAWolsey, and Marshall L Fisher. 1978. An analysis of approximations for maximizing submodular set functions-I. Mathematical programming 14, 1 (1978), 265--294."},{"key":"e_1_3_2_1_22_1","volume-title":"Wavenet: A generative model for raw audio. arXiv preprint arXiv:1609.03499","author":"van den Oord Aaron","year":"2016","unstructured":"Aaron van den Oord , Sander Dieleman , Heiga Zen , Karen Simonyan , Oriol Vinyals , Alex Graves , Nal Kalchbrenner , Andrew Senior , and Koray Kavukcuoglu . 2016 . Wavenet: A generative model for raw audio. arXiv preprint arXiv:1609.03499 (2016). Aaron van den Oord, Sander Dieleman, Heiga Zen, Karen Simonyan, Oriol Vinyals, Alex Graves, Nal Kalchbrenner, Andrew Senior, and Koray Kavukcuoglu. 2016. Wavenet: A generative model for raw audio. arXiv preprint arXiv:1609.03499 (2016)."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-28954-6"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.74"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5555\/3305890.3306006"},{"key":"e_1_3_2_1_26_1","volume-title":"Striving for simplicity: The all convolutional net. arXiv preprint arXiv:1412.6806","author":"Springenberg Jost Tobias","year":"2014","unstructured":"Jost Tobias Springenberg , Alexey Dosovitskiy , Thomas Brox , and Martin Riedmiller . 2014. Striving for simplicity: The all convolutional net. arXiv preprint arXiv:1412.6806 ( 2014 ). Jost Tobias Springenberg, Alexey Dosovitskiy, Thomas Brox, and Martin Riedmiller. 2014. Striving for simplicity: The all convolutional net. arXiv preprint arXiv:1412.6806 (2014)."},{"key":"e_1_3_2_1_27_1","volume-title":"Time series classification from scratch with deep neural networks: A strong baseline. In 2017 International joint conference on neural networks (IJCNN)","author":"Wang Zhiguang","unstructured":"Zhiguang Wang , Weizhong Yan , and Tim Oates . 2017. Time series classification from scratch with deep neural networks: A strong baseline. In 2017 International joint conference on neural networks (IJCNN) . IEEE , 1578--1585. Zhiguang Wang, Weizhong Yan, and Tim Oates. 2017. Time series classification from scratch with deep neural networks: A strong baseline. In 2017 International joint conference on neural networks (IJCNN). IEEE, 1578--1585."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.12328"}],"event":{"name":"KDD '21: The 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining","location":"Virtual Event Singapore","acronym":"KDD '21","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"]},"container-title":["Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447548.3467346","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3447548.3467346","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:23Z","timestamp":1750191503000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447548.3467346"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,14]]},"references-count":28,"alternative-id":["10.1145\/3447548.3467346","10.1145\/3447548"],"URL":"https:\/\/doi.org\/10.1145\/3447548.3467346","relation":{},"subject":[],"published":{"date-parts":[[2021,8,14]]},"assertion":[{"value":"2021-08-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}