{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,9]],"date-time":"2025-12-09T15:49:03Z","timestamp":1765295343783,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":26,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,10,17]],"date-time":"2022-10-17T00:00:00Z","timestamp":1665964800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"SoBigData-PlusPlus H2020-INFRAIA-2019-1 EU project","award":["871042"],"award-info":[{"award-number":["871042"]}]},{"name":"Fondo Territori Lavoro e Conoscenza CGIL CISL UIL"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,10,17]]},"DOI":"10.1145\/3511808.3557608","type":"proceedings-article","created":{"date-parts":[[2022,10,16]],"date-time":"2022-10-16T01:29:57Z","timestamp":1665883797000},"page":"4389-4393","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["GRETEL: Graph Counterfactual Explanation Evaluation Framework"],"prefix":"10.1145","author":[{"given":"Mario Alfonso","family":"Prado-Romero","sequence":"first","affiliation":[{"name":"Gran Sasso Science Institute, L'Aquila, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Giovanni","family":"Stilo","sequence":"additional","affiliation":[{"name":"Universit\u00e0 degli Studi dell'Aquila, L'Aquila, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,10,17]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447548.3467154"},{"key":"e_1_3_2_1_2_1","volume-title":"Benchmarking and survey of explanation methods for black box models. arXiv preprint arXiv:2102.13076","author":"Bodria Francesco","year":"2021","unstructured":"Francesco Bodria , Fosca Giannotti , Riccardo Guidotti , Francesca Naretto , Dino Pedreschi , and Salvatore Rinzivillo . 2021. Benchmarking and survey of explanation methods for black box models. arXiv preprint arXiv:2102.13076 ( 2021 ). Francesco Bodria, Fosca Giannotti, Riccardo Guidotti, Francesca Naretto, Dino Pedreschi, and Salvatore Rinzivillo. 2021. Benchmarking and survey of explanation methods for black box models. arXiv preprint arXiv:2102.13076 (2021)."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/989791.989795"},{"key":"e_1_3_2_1_4_1","volume-title":"Support-vector networks. Machine learning","author":"Cortes Corinna","year":"1995","unstructured":"Corinna Cortes and Vladimir Vapnik . 1995. Support-vector networks. Machine learning , Vol. 20 , 3 ( 1995 ), 273--297. Corinna Cortes and Vladimir Vapnik. 1995. Support-vector networks. Machine learning, Vol. 20, 3 (1995), 273--297."},{"key":"e_1_3_2_1_5_1","volume-title":"John David Lewis, Qingyang Li, Michael Milham, et al.","author":"Craddock Cameron","year":"2013","unstructured":"Cameron Craddock , Yassine Benhajali , Carlton Chu , Francois Chouinard , Alan Evans , Andr\u00e1s Jakab , Budhachandra Singh Khundrakpam , John David Lewis, Qingyang Li, Michael Milham, et al. 2013 . The neuro bureau preprocessing initiative: open sharing of preprocessed neuroimaging data and derivatives. Frontiers in Neuroinformatics , Vol. 7 (2013). Cameron Craddock, Yassine Benhajali, Carlton Chu, Francois Chouinard, Alan Evans, Andr\u00e1s Jakab, Budhachandra Singh Khundrakpam, John David Lewis, Qingyang Li, Michael Milham, et al. 2013. The neuro bureau preprocessing initiative: open sharing of preprocessed neuroimaging data and derivatives. Frontiers in Neuroinformatics, Vol. 7 (2013)."},{"key":"e_1_3_2_1_6_1","volume-title":"Proceedings of the 31st International Conference on Neural Information Processing Systems. 6970--6979","author":"Dabkowski Piotr","year":"2017","unstructured":"Piotr Dabkowski and Yarin Gal . 2017 . Real time image saliency for black box classifiers . In Proceedings of the 31st International Conference on Neural Information Processing Systems. 6970--6979 . Piotr Dabkowski and Yarin Gal. 2017. Real time image saliency for black box classifiers. In Proceedings of the 31st International Conference on Neural Information Processing Systems. 6970--6979."},{"key":"e_1_3_2_1_7_1","volume-title":"An introduction to ROC analysis. Pattern recognition letters","author":"Fawcett Tom","year":"2006","unstructured":"Tom Fawcett . 2006. An introduction to ROC analysis. Pattern recognition letters , Vol. 27 , 8 ( 2006 ), 861--874. Tom Fawcett. 2006. An introduction to ROC analysis. Pattern recognition letters, Vol. 27, 8 (2006), 861--874."},{"key":"e_1_3_2_1_8_1","volume-title":"A survey of methods for explaining black box models. ACM computing surveys (CSUR)","author":"Guidotti Riccardo","year":"2018","unstructured":"Riccardo Guidotti , Anna Monreale , Salvatore Ruggieri , Franco Turini , Fosca Giannotti , and Dino Pedreschi . 2018. A survey of methods for explaining black box models. ACM computing surveys (CSUR) , Vol. 51 , 5 ( 2018 ), 1--42. Riccardo Guidotti, Anna Monreale, Salvatore Ruggieri, Franco Turini, Fosca Giannotti, and Dino Pedreschi. 2018. A survey of methods for explaining black box models. ACM computing surveys (CSUR), Vol. 51, 5 (2018), 1--42."},{"key":"e_1_3_2_1_9_1","volume-title":"Graphlime: Local interpretable model explanations for graph neural networks. arXiv preprint arXiv:2001.06216","author":"Huang Qiang","year":"2020","unstructured":"Qiang Huang , Makoto Yamada , Yuan Tian , Dinesh Singh , Dawei Yin , and Yi Chang . 2020 . Graphlime: Local interpretable model explanations for graph neural networks. arXiv preprint arXiv:2001.06216 (2020). Qiang Huang, Makoto Yamada, Yuan Tian, Dinesh Singh, Dawei Yin, and Yi Chang. 2020. Graphlime: Local interpretable model explanations for graph neural networks. arXiv preprint arXiv:2001.06216 (2020)."},{"key":"e_1_3_2_1_10_1","volume-title":"Kipf and Max Welling","author":"Thomas","year":"2017","unstructured":"Thomas N. Kipf and Max Welling . 2017 . Semi-Supervised Classification with Graph Convolutional Networks. In 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24--26, 2017, Conference Track Proceedings. OpenReview .net. https:\/\/openreview.net\/forum?id=SJU4ayYgl Thomas N. Kipf and Max Welling. 2017. Semi-Supervised Classification with Graph Convolutional Networks. In 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24--26, 2017, Conference Track Proceedings. OpenReview.net. https:\/\/openreview.net\/forum?id=SJU4ayYgl"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403383"},{"key":"e_1_3_2_1_12_1","unstructured":"Christopher G Lasater etal 2006. Design patterns. Jones & Bartlett Publishers.  Christopher G Lasater et al. 2006. Design patterns. Jones & Bartlett Publishers."},{"key":"e_1_3_2_1_13_1","volume-title":"International Conference on Artificial Intelligence and Statistics. PMLR, 4499--4511","author":"Lucic Ana","year":"2022","unstructured":"Ana Lucic , Maartje A Ter Hoeve , Gabriele Tolomei , Maarten De Rijke , and Fabrizio Silvestri . 2022 . Cf-gnnexplainer: Counterfactual explanations for graph neural networks . In International Conference on Artificial Intelligence and Statistics. PMLR, 4499--4511 . Ana Lucic, Maartje A Ter Hoeve, Gabriele Tolomei, Maarten De Rijke, and Fabrizio Silvestri. 2022. Cf-gnnexplainer: Counterfactual explanations for graph neural networks. In International Conference on Artificial Intelligence and Statistics. PMLR, 4499--4511."},{"key":"e_1_3_2_1_14_1","volume-title":"Parameterized explainer for graph neural network. Advances in neural information processing systems","author":"Luo Dongsheng","year":"2020","unstructured":"Dongsheng Luo , Wei Cheng , Dongkuan Xu , Wenchao Yu , Bo Zong , Haifeng Chen , and Xiang Zhang . 2020. Parameterized explainer for graph neural network. Advances in neural information processing systems , Vol. 33 ( 2020 ), 19620--19631. Dongsheng Luo, Wei Cheng, Dongkuan Xu, Wenchao Yu, Bo Zong, Haifeng Chen, and Xiang Zhang. 2020. Parameterized explainer for graph neural network. Advances in neural information processing systems, Vol. 33 (2020), 19620--19631."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1021\/ci300124c"},{"key":"e_1_3_2_1_16_1","volume-title":"graph2vec: Learning distributed representations of graphs. arXiv preprint arXiv:1707.05005","author":"Narayanan Annamalai","year":"2017","unstructured":"Annamalai Narayanan , Mahinthan Chandramohan , Rajasekar Venkatesan , Lihui Chen , Yang Liu , and Shantanu Jaiswal . 2017. graph2vec: Learning distributed representations of graphs. arXiv preprint arXiv:1707.05005 ( 2017 ). Annamalai Narayanan, Mahinthan Chandramohan, Rajasekar Venkatesan, Lihui Chen, Yang Liu, and Shantanu Jaiswal. 2017. graph2vec: Learning distributed representations of graphs. arXiv preprint arXiv:1707.05005 (2017)."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN52387.2021.9534266"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.1983.6313167"},{"key":"e_1_3_2_1_19_1","volume-title":"Markus Hagenbuchner, and Gabriele Monfardini.","author":"Scarselli Franco","year":"2008","unstructured":"Franco Scarselli , Marco Gori , Ah Chung Tsoi , Markus Hagenbuchner, and Gabriele Monfardini. 2008 . The graph neural network model. IEEE transactions on neural networks, Vol. 20 , 1 (2008), 61--80. Franco Scarselli, Marco Gori, Ah Chung Tsoi, Markus Hagenbuchner, and Gabriele Monfardini. 2008. The graph neural network model. IEEE transactions on neural networks, Vol. 20, 1 (2008), 61--80."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.74"},{"key":"e_1_3_2_1_21_1","volume-title":"Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv:1312.6034","author":"Simonyan Karen","year":"2013","unstructured":"Karen Simonyan , Andrea Vedaldi , and Andrew Zisserman . 2013. Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv:1312.6034 ( 2013 ). Karen Simonyan, Andrea Vedaldi, and Andrew Zisserman. 2013. Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv:1312.6034 (2013)."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1021\/ci00057a005"},{"key":"e_1_3_2_1_23_1","volume-title":"Model agnostic generation of counterfactual explanations for molecules. Chemical science","author":"Wellawatte Geemi P","year":"2022","unstructured":"Geemi P Wellawatte , Aditi Seshadri , and Andrew D White . 2022. Model agnostic generation of counterfactual explanations for molecules. Chemical science , Vol. 13 , 13 ( 2022 ), 3697--3705. Geemi P Wellawatte, Aditi Seshadri, and Andrew D White. 2022. Model agnostic generation of counterfactual explanations for molecules. Chemical science, Vol. 13, 13 (2022), 3697--3705."},{"key":"e_1_3_2_1_24_1","volume-title":"Gnnexplainer: Generating explanations for graph neural networks. Advances in neural information processing systems","author":"Ying Zhitao","year":"2019","unstructured":"Zhitao Ying , Dylan Bourgeois , Jiaxuan You , Marinka Zitnik , and Jure Leskovec . 2019 . Gnnexplainer: Generating explanations for graph neural networks. Advances in neural information processing systems , Vol. 32 (2019). Zhitao Ying, Dylan Bourgeois, Jiaxuan You, Marinka Zitnik, and Jure Leskovec. 2019. Gnnexplainer: Generating explanations for graph neural networks. Advances in neural information processing systems, Vol. 32 (2019)."},{"key":"e_1_3_2_1_25_1","volume-title":"Explainability in graph neural networks: A taxonomic survey. arXiv preprint arXiv:2012.15445","author":"Yuan Hao","year":"2020","unstructured":"Hao Yuan , Haiyang Yu , Shurui Gui , and Shuiwang Ji. 2020. Explainability in graph neural networks: A taxonomic survey. arXiv preprint arXiv:2012.15445 ( 2020 ). Hao Yuan, Haiyang Yu, Shurui Gui, and Shuiwang Ji. 2020. Explainability in graph neural networks: A taxonomic survey. arXiv preprint arXiv:2012.15445 (2020)."},{"key":"e_1_3_2_1_26_1","volume-title":"International Conference on Machine Learning. PMLR, 12241--12252","author":"Yuan Hao","year":"2021","unstructured":"Hao Yuan , Haiyang Yu , Jie Wang , Kang Li , and Shuiwang Ji . 2021 . On explainability of graph neural networks via subgraph explorations . In International Conference on Machine Learning. PMLR, 12241--12252 . Hao Yuan, Haiyang Yu, Jie Wang, Kang Li, and Shuiwang Ji. 2021. On explainability of graph neural networks via subgraph explorations. In International Conference on Machine Learning. PMLR, 12241--12252."}],"event":{"name":"CIKM '22: The 31st ACM International Conference on Information and Knowledge Management","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGIR ACM Special Interest Group on Information Retrieval"],"location":"Atlanta GA USA","acronym":"CIKM '22"},"container-title":["Proceedings of the 31st ACM International Conference on Information & Knowledge Management"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3511808.3557608","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3511808.3557608","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:51:09Z","timestamp":1750182669000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3511808.3557608"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,17]]},"references-count":26,"alternative-id":["10.1145\/3511808.3557608","10.1145\/3511808"],"URL":"https:\/\/doi.org\/10.1145\/3511808.3557608","relation":{},"subject":[],"published":{"date-parts":[[2022,10,17]]},"assertion":[{"value":"2022-10-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}