{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T04:59:15Z","timestamp":1776056355026,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":46,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,8,20]],"date-time":"2020-08-20T00:00:00Z","timestamp":1597881600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Science Foundation","award":["DBI-2028361,IIS-1714741, IIS-1715940, IIS-1845081, IIS-1900990"],"award-info":[{"award-number":["DBI-2028361,IIS-1714741, IIS-1715940, IIS-1845081, IIS-1900990"]}]},{"DOI":"10.13039\/100000185","name":"Defense Advanced Research Projects Agency","doi-asserted-by":"publisher","award":["N66001-17-2-4031"],"award-info":[{"award-number":["N66001-17-2-4031"]}],"id":[{"id":"10.13039\/100000185","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,8,23]]},"DOI":"10.1145\/3394486.3403085","type":"proceedings-article","created":{"date-parts":[[2020,8,20]],"date-time":"2020-08-20T23:17:27Z","timestamp":1597965447000},"page":"430-438","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":238,"title":["XGNN: Towards Model-Level Explanations of Graph Neural Networks"],"prefix":"10.1145","author":[{"given":"Hao","family":"Yuan","sequence":"first","affiliation":[{"name":"Texas A&M University, College Station, TX, USA"}]},{"given":"Jiliang","family":"Tang","sequence":"additional","affiliation":[{"name":"Michigan State University, East Lansing, MI, USA"}]},{"given":"Xia","family":"Hu","sequence":"additional","affiliation":[{"name":"Texas A&M University, College Station, TX, USA"}]},{"given":"Shuiwang","family":"Ji","sequence":"additional","affiliation":[{"name":"Texas A&M University, College Station, TX, USA"}]}],"member":"320","published-online":{"date-parts":[[2020,8,20]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"An introduction to systems biology: design principles of biological circuits","author":"Alon Uri","unstructured":"Uri Alon . 2006. An introduction to systems biology: design principles of biological circuits . Chapman and Hall\/CRC. Uri Alon. 2006. An introduction to systems biology: design principles of biological circuits .Chapman and Hall\/CRC."},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1038\/nrg2102"},{"key":"e_1_3_2_2_3_1","volume-title":"On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PloS one","author":"Bach Sebastian","year":"2015","unstructured":"Sebastian Bach , Alexander Binder , Gr\u00e9goire Montavon , Frederick Klauschen , Klaus-Robert M\u00fcller , and Wojciech Samek . 2015. On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PloS one , Vol. 10 , 7 ( 2015 ). Sebastian Bach, Alexander Binder, Gr\u00e9goire Montavon, Frederick Klauschen, Klaus-Robert M\u00fcller, and Wojciech Samek. 2015. On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PloS one, Vol. 10, 7 (2015)."},{"key":"e_1_3_2_2_4_1","volume-title":"International Conference on Machine Learning (ICML) Workshops","author":"Baldassarre Federico","year":"2019","unstructured":"Federico Baldassarre and Hossein Azizpour . 2019. Explainability Techniques for Graph Convolutional Networks . In International Conference on Machine Learning (ICML) Workshops , 2019 Workshop on Learning and Reasoning with Graph-Structured Representations . Federico Baldassarre and Hossein Azizpour. 2019. Explainability Techniques for Graph Convolutional Networks. In International Conference on Machine Learning (ICML) Workshops, 2019 Workshop on Learning and Reasoning with Graph-Structured Representations."},{"key":"e_1_3_2_2_5_1","unstructured":"Piotr Dabkowski and Yarin Gal. 2017. Real time image saliency for black box classifiers. In Advances in Neural Information Processing Systems. 6967--6976.  Piotr Dabkowski and Yarin Gal. 2017. Real time image saliency for black box classifiers. In Advances in Neural Information Processing Systems. 6967--6976."},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1021\/jm00106a046"},{"key":"e_1_3_2_2_7_1","volume-title":"Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608","author":"Doshi-Velez Finale","year":"2017","unstructured":"Finale Doshi-Velez and Been Kim . 2017. Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608 ( 2017 ). Finale Doshi-Velez and Been Kim. 2017. Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608 (2017)."},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.371"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330897"},{"key":"e_1_3_2_2_11_1","volume-title":"Graph U-Net. In International conference on machine learning. 2083--2092","author":"Gao Hongyang","year":"2019","unstructured":"Hongyang Gao and Shuiwang Ji . 2019 b . Graph U-Net. In International conference on machine learning. 2083--2092 . Hongyang Gao and Shuiwang Ji. 2019 b. Graph U-Net. In International conference on machine learning. 2083--2092."},{"key":"e_1_3_2_2_12_1","volume-title":"Review and comparison of methods to study the contribution of variables in artificial neural network models. Ecological modelling","author":"Gevrey Muriel","year":"2003","unstructured":"Muriel Gevrey , Ioannis Dimopoulos , and Sovan Lek . 2003. Review and comparison of methods to study the contribution of variables in artificial neural network models. Ecological modelling , Vol. 160 , 3 ( 2003 ), 249--264. Muriel Gevrey, Ioannis Dimopoulos, and Sovan Lek. 2003. Review and comparison of methods to study the contribution of variables in artificial neural network models. Ecological modelling, Vol. 160, 3 (2003), 249--264."},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/3305381.3305512"},{"key":"e_1_3_2_2_14_1","volume-title":"Pedro Luis Cunha Farias, and Al\u00e1n Aspuru-Guzik","author":"Guimaraes Gabriel Lima","year":"2017","unstructured":"Gabriel Lima Guimaraes , Benjamin Sanchez-Lengeling , Carlos Outeiral , Pedro Luis Cunha Farias, and Al\u00e1n Aspuru-Guzik . 2017 . Objective-reinforced generative adversarial networks (ORGAN) for sequence generation models. arXiv preprint arXiv:1705.10843 (2017). Gabriel Lima Guimaraes, Benjamin Sanchez-Lengeling, Carlos Outeiral, Pedro Luis Cunha Farias, and Al\u00e1n Aspuru-Guzik. 2017. Objective-reinforced generative adversarial networks (ORGAN) for sequence generation models. arXiv preprint arXiv:1705.10843 (2017)."},{"key":"e_1_3_2_2_16_1","unstructured":"Will Hamilton Zhitao Ying and Jure Leskovec. 2017. Inductive representation learning on large graphs. In Advances in neural information processing systems. 1024--1034.  Will Hamilton Zhitao Ying and Jure Leskovec. 2017. Inductive representation learning on large graphs. In Advances in neural information processing systems. 1024--1034."},{"key":"e_1_3_2_2_17_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning. 2323--2332","author":"Jin Wengong","year":"2018","unstructured":"Wengong Jin , Regina Barzilay , and Tommi Jaakkola . 2018 . Junction Tree Variational Autoencoder for Molecular Graph Generation . In Proceedings of the 35th International Conference on Machine Learning. 2323--2332 . Wengong Jin, Regina Barzilay, and Tommi Jaakkola. 2018. Junction Tree Variational Autoencoder for Molecular Graph Generation. In Proceedings of the 35th International Conference on Machine Learning. 2323--2332."},{"key":"e_1_3_2_2_18_1","volume-title":"Proceedings of the 3rd International Conference on Learning Representations.","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma and Jimmy Ba . 2014 . Adam: A Method for Stochastic Optimization . In Proceedings of the 3rd International Conference on Learning Representations. Diederik P Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization. In Proceedings of the 3rd International Conference on Learning Representations."},{"key":"e_1_3_2_2_19_1","volume-title":"Proceedings of the International Conference on Learning Representations.","author":"Kipf Thomas N","year":"2017","unstructured":"Thomas N Kipf and Max Welling . 2017 . Semi-supervised classification with graph convolutional networks . In Proceedings of the International Conference on Learning Representations. Thomas N Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_2_2_20_1","volume-title":"Self-Attention Graph Pooling. In International Conference on Machine Learning. 3734--3743","author":"Lee Junhyun","year":"2019","unstructured":"Junhyun Lee , Inyeop Lee , and Jaewoo Kang . 2019 . Self-Attention Graph Pooling. In International Conference on Machine Learning. 3734--3743 . Junhyun Lee, Inyeop Lee, and Jaewoo Kang. 2019. Self-Attention Graph Pooling. In International Conference on Machine Learning. 3734--3743."},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D16-1011"},{"key":"e_1_3_2_2_22_1","volume-title":"Learning deep generative models of graphs. arXiv preprint arXiv:1803.03324","author":"Li Yujia","year":"2018","unstructured":"Yujia Li , Oriol Vinyals , Chris Dyer , Razvan Pascanu , and Peter Battaglia . 2018. Learning deep generative models of graphs. arXiv preprint arXiv:1803.03324 ( 2018 ). Yujia Li, Oriol Vinyals, Chris Dyer, Razvan Pascanu, and Peter Battaglia. 2018. Learning deep generative models of graphs. arXiv preprint arXiv:1803.03324 (2018)."},{"key":"e_1_3_2_2_23_1","volume-title":"Science","volume":"298","author":"Milo Ron","year":"2002","unstructured":"Ron Milo , Shai Shen-Orr , Shalev Itzkovitz , Nadav Kashtan , Dmitri Chklovskii , and Uri Alon . 2002 . Network motifs: simple building blocks of complex networks . Science , Vol. 298 , 5594 (2002), 824--827. Ron Milo, Shai Shen-Orr, Shalev Itzkovitz, Nadav Kashtan, Dmitri Chklovskii, and Uri Alon. 2002. Network motifs: simple building blocks of complex networks. Science, Vol. 298, 5594 (2002), 824--827."},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.374"},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298640"},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.23915\/distill.00007"},{"key":"e_1_3_2_2_27_1","volume-title":"Proceedings of the International Conference on Learning Representations.","author":"Paszke Adam","year":"2017","unstructured":"Adam Paszke , Sam Gross , Soumith Chintala , Gregory Chanan , Edward Yang , Zachary DeVito , Zeming Lin , Alban Desmaison , Luca Antiga , and Adam Lerer . 2017 . Automatic differentiation in PyTorch . In Proceedings of the International Conference on Learning Representations. Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer. 2017. Automatic differentiation in PyTorch. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_2_2_28_1","unstructured":"Spencer L Seager and Michael R Slabaugh. 2013. Chemistry for today: General organic and biochemistry. Cengage learning.  Spencer L Seager and Michael R Slabaugh. 2013. Chemistry for today: General organic and biochemistry. Cengage learning."},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.74"},{"key":"e_1_3_2_2_30_1","volume-title":"Network motifs in the transcriptional regulation network of Escherichia coli. Nature genetics","author":"Shen-Orr Shai S","year":"2002","unstructured":"Shai S Shen-Orr , Ron Milo , Shmoolik Mangan , and Uri Alon . 2002. Network motifs in the transcriptional regulation network of Escherichia coli. Nature genetics , Vol. 31 , 1 ( 2002 ), 64. Shai S Shen-Orr, Ron Milo, Shmoolik Mangan, and Uri Alon. 2002. Network motifs in the transcriptional regulation network of Escherichia coli. Nature genetics, Vol. 31, 1 (2002), 64."},{"key":"e_1_3_2_2_31_1","volume-title":"Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv:1312.6034","author":"Simonyan Karen","year":"2013","unstructured":"Karen Simonyan , Andrea Vedaldi , and Andrew Zisserman . 2013. Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv:1312.6034 ( 2013 ). Karen Simonyan, Andrea Vedaldi, and Andrew Zisserman. 2013. Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv:1312.6034 (2013)."},{"key":"e_1_3_2_2_32_1","volume-title":"Smoothgrad: removing noise by adding noise. arXiv preprint arXiv:1706.03825","author":"Smilkov Daniel","year":"2017","unstructured":"Daniel Smilkov , Nikhil Thorat , Been Kim , Fernanda Vi\u00e9gas , and Martin Wattenberg . 2017. Smoothgrad: removing noise by adding noise. arXiv preprint arXiv:1706.03825 ( 2017 ). Daniel Smilkov, Nikhil Thorat, Been Kim, Fernanda Vi\u00e9gas, and Martin Wattenberg. 2017. Smoothgrad: removing noise by adding noise. arXiv preprint arXiv:1706.03825 (2017)."},{"key":"e_1_3_2_2_33_1","volume-title":"Striving for simplicity: The all convolutional net. arXiv preprint arXiv:1412.6806","author":"Springenberg Jost Tobias","year":"2014","unstructured":"Jost Tobias Springenberg , Alexey Dosovitskiy , Thomas Brox , and Martin Riedmiller . 2014. Striving for simplicity: The all convolutional net. arXiv preprint arXiv:1412.6806 ( 2014 ). Jost Tobias Springenberg, Alexey Dosovitskiy, Thomas Brox, and Martin Riedmiller. 2014. Striving for simplicity: The all convolutional net. arXiv preprint arXiv:1412.6806 (2014)."},{"key":"e_1_3_2_2_34_1","volume-title":"An introduction to data structures and algorithms","author":"Storer James Andrew","unstructured":"James Andrew Storer . 2012. An introduction to data structures and algorithms . Springer Science & Business Media . James Andrew Storer. 2012. An introduction to data structures and algorithms .Springer Science & Business Media."},{"key":"e_1_3_2_2_35_1","unstructured":"Richard S Sutton David A McAllester Satinder P Singh and Yishay Mansour. 2000. Policy gradient methods for reinforcement learning with function approximation. In Advances in neural information processing systems. 1057--1063.  Richard S Sutton David A McAllester Satinder P Singh and Yishay Mansour. 2000. Policy gradient methods for reinforcement learning with function approximation. In Advances in neural information processing systems. 1057--1063."},{"key":"e_1_3_2_2_36_1","volume-title":"Attention-based graph neural network for semi-supervised learning. arXiv preprint arXiv:1803.03735","author":"Thekumparampil Kiran K","year":"2018","unstructured":"Kiran K Thekumparampil , Chong Wang , Sewoong Oh , and Li-Jia Li. 2018. Attention-based graph neural network for semi-supervised learning. arXiv preprint arXiv:1803.03735 ( 2018 ). Kiran K Thekumparampil, Chong Wang, Sewoong Oh, and Li-Jia Li. 2018. Attention-based graph neural network for semi-supervised learning. arXiv preprint arXiv:1803.03735 (2018)."},{"key":"e_1_3_2_2_37_1","volume-title":"Graph Attention Networks. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=rJXMpikCZ","author":"Petar Velivc","year":"2018","unstructured":"Petar Velivc kovi\u0107, Guillem Cucurull , Arantxa Casanova , Adriana Romero , Pietro Lio , and Yoshua Bengio . 2018 . Graph Attention Networks. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=rJXMpikCZ Petar Velivc kovi\u0107, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. 2018. Graph Attention Networks. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=rJXMpikCZ"},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11872"},{"key":"e_1_3_2_2_39_1","volume-title":"International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=ryGs6iA5Km","author":"Xu Keyulu","year":"2019","unstructured":"Keyulu Xu , Weihua Hu , Jure Leskovec , and Stefanie Jegelka . 2019 . How Powerful are Graph Neural Networks? . In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=ryGs6iA5Km Keyulu Xu, Weihua Hu, Jure Leskovec, and Stefanie Jegelka. 2019. How Powerful are Graph Neural Networks?. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=ryGs6iA5Km"},{"key":"e_1_3_2_2_40_1","first-page":"9244","article-title":"GNNExplainer","volume":"32","author":"Ying Zhitao","year":"2019","unstructured":"Zhitao Ying , Dylan Bourgeois , Jiaxuan You , Marinka Zitnik , and Jure Leskovec . 2019 . GNNExplainer : Generating Explanations for Graph Neural Networks. In Advances in Neural Information Processing Systems 32. 9244 -- 9255 . Zhitao Ying, Dylan Bourgeois, Jiaxuan You, Marinka Zitnik, and Jure Leskovec. 2019. GNNExplainer: Generating Explanations for Graph Neural Networks. In Advances in Neural Information Processing Systems 32. 9244--9255.","journal-title":"Generating Explanations for Graph Neural Networks. In Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_2_41_1","unstructured":"Jiaxuan You Bowen Liu Zhitao Ying Vijay Pande and Jure Leskovec. 2018. Graph convolutional policy network for goal-directed molecular graph generation. In Advances in Neural Information Processing Systems. 6410--6421.  Jiaxuan You Bowen Liu Zhitao Ying Vijay Pande and Jure Leskovec. 2018. Graph convolutional policy network for goal-directed molecular graph generation. In Advances in Neural Information Processing Systems. 6410--6421."},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v31i1.10804"},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33015717"},{"key":"e_1_3_2_2_44_1","volume-title":"International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=BJxg_hVtwH","author":"Yuan Hao","year":"2020","unstructured":"Hao Yuan and Shuiwang Ji . 2020 . StructPool: Structured Graph Pooling via Conditional Random Fields . In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=BJxg_hVtwH Hao Yuan and Shuiwang Ji. 2020. StructPool: Structured Graph Pooling via Conditional Random Fields. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=BJxg_hVtwH"},{"key":"e_1_3_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10590-1_53"},{"key":"e_1_3_2_2_46_1","unstructured":"Muhan Zhang and Yixin Chen. 2018. Link prediction based on graph neural networks. In Advances in Neural Information Processing Systems. 5165--5175.  Muhan Zhang and Yixin Chen. 2018. Link prediction based on graph neural networks. In Advances in Neural Information Processing Systems. 5165--5175."},{"key":"e_1_3_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11782"},{"key":"e_1_3_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.319"}],"event":{"name":"KDD '20: The 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining","location":"Virtual Event CA USA","acronym":"KDD '20","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"]},"container-title":["Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3394486.3403085","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3394486.3403085","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3394486.3403085","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:41:38Z","timestamp":1750200098000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3394486.3403085"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,20]]},"references-count":46,"alternative-id":["10.1145\/3394486.3403085","10.1145\/3394486"],"URL":"https:\/\/doi.org\/10.1145\/3394486.3403085","relation":{},"subject":[],"published":{"date-parts":[[2020,8,20]]},"assertion":[{"value":"2020-08-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}