{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T09:17:53Z","timestamp":1775639873707,"version":"3.50.1"},"reference-count":77,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2024,6,4]],"date-time":"2024-06-04T00:00:00Z","timestamp":1717459200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2024,6,30]]},"abstract":"<jats:p>Vulnerability detectors based on deep learning\u00a0(DL) models have proven their effectiveness in recent years. However, the shroud of opacity surrounding the decision-making process of these detectors makes it difficult for security analysts to comprehend. To address this, various explanation approaches have been proposed to explain the predictions by highlighting important features, which have been demonstrated effective in domains such as computer vision and natural language processing. Unfortunately, there is still a lack of in-depth evaluation of vulnerability-critical features, such as fine-grained vulnerability-related code lines, learned and understood by these explanation approaches. In this study, we first evaluate the performance of ten explanation approaches for vulnerability detectors based on graph and sequence representations, measured by two quantitative metrics including fidelity and vulnerability line coverage rate. Our results show that fidelity alone is insufficent for evaluating these approaches, as fidelity incurs significant fluctuations across different datasets and detectors. We subsequently check the precision of the vulnerability-related code lines reported by the explanation approaches, and find poor accuracy in this task among all of them. This can be attributed to the inefficiency of explainers in selecting important features and the presence of irrelevant artifacts learned by DL-based detectors.<\/jats:p>","DOI":"10.1145\/3641543","type":"journal-article","created":{"date-parts":[[2024,2,1]],"date-time":"2024-02-01T04:06:02Z","timestamp":1706760362000},"page":"1-33","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Beyond Fidelity: Explaining Vulnerability Localization of Learning-Based Detectors"],"prefix":"10.1145","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1792-9396","authenticated-orcid":false,"given":"Baijun","family":"Cheng","sequence":"first","affiliation":[{"name":"Peking University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-5035-2206","authenticated-orcid":false,"given":"Shengming","family":"Zhao","sequence":"additional","affiliation":[{"name":"University of Alberta, Edmonton, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3977-6573","authenticated-orcid":false,"given":"Kailong","family":"Wang","sequence":"additional","affiliation":[{"name":"Huazhong University of Science and Technology, Wuhan China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-1346-7335","authenticated-orcid":false,"given":"Meizhen","family":"Wang","sequence":"additional","affiliation":[{"name":"Huazhong University of Science and Technology, Wuhan, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6390-9890","authenticated-orcid":false,"given":"Guangdong","family":"Bai","sequence":"additional","affiliation":[{"name":"University of Queensland, Saint Lucia, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9080-6865","authenticated-orcid":false,"given":"Ruitao","family":"Feng","sequence":"additional","affiliation":[{"name":"University of New South Wales, Sydney, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5064-5286","authenticated-orcid":false,"given":"Yao","family":"Guo","sequence":"additional","affiliation":[{"name":"Peking University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8621-2420","authenticated-orcid":false,"given":"Lei","family":"Ma","sequence":"additional","affiliation":[{"name":"University of Alberta, Edmonton, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1100-8633","authenticated-orcid":false,"given":"Haoyu","family":"Wang","sequence":"additional","affiliation":[{"name":"Huazhong University of Science and Technology, Wuhan, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,6,4]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"Coverity. 2020. Retrieved from https:\/\/scan.coverity.com\/"},{"key":"e_1_3_2_3_2","unstructured":"RATS. 2014. Retrieved from https:\/\/code.google.com\/archive\/p\/rough-auditing-tool-for-security\/"},{"key":"e_1_3_2_4_2","unstructured":"Infer. 2020. Retrieved from https:\/\/fbinfer.com\/"},{"key":"e_1_3_2_5_2","unstructured":"Clang static analyzer. 2020. Retrieved from https:\/\/clang-analyzer.llvm.org\/scan-build.html"},{"key":"e_1_3_2_6_2","unstructured":"HP Fortify. 2020. Retrieved from https:\/\/www.hpfod.com\/"},{"key":"e_1_3_2_7_2","unstructured":"Checkmarx. 2020. Retrieved from https:\/\/www.checkmarx.com\/"},{"key":"e_1_3_2_8_2","doi-asserted-by":"crossref","unstructured":"Yulei Sui and Jingling Xue. 2016. SVF: Interprocedural static value-flow analysis in LLVM. In CC\u201916. 265\u2013266. Retrieved from https:\/\/github.com\/unsw-corg\/SVF.","DOI":"10.1145\/2892208.2892235"},{"key":"e_1_3_2_9_2","first-page":"10197","volume-title":"Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, December 8-14, 2019, Vancouver, BC, Canada","author":"Zhou Yaqin","year":"2019","unstructured":"Yaqin Zhou, Shangqing Liu, Jing Kai Siow, Xiaoning Du, and Yang Liu. 2019. Devign: Effective vulnerability identification by learning comprehensive program semantics via graph neural networks. In Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, December 8-14, 2019, Vancouver, BC, Canada. Hanna M. Wallach, Hugo Larochelle, Alina Beygelzimer, Florence d\u2019Alch\u00e9-Buc, Emily B. Fox, and Roman Garnett (Eds.). 10197\u201310207."},{"key":"e_1_3_2_10_2","doi-asserted-by":"crossref","unstructured":"Saikat Chakraborty Rahul Krishna Yangruibo Ding and Baishakhi Ray. 2022. Deep learning based vulnerability detection: Are we there yet? IEEE Transactions on Software Engineering 48 9 (2022) 3280\u20133296.","DOI":"10.1109\/TSE.2021.3087402"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468597"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/3436877"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/TDSC.2021.3051525"},{"key":"e_1_3_2_14_2","unstructured":"Zhen Li Deqing Zou Shouhuai Xu Xinyu Ou Hai Jin Sujuan Wang Zhijun Deng and Yuyi Zhong. 2018. Vuldeepecker: A deep learning-based system for vulnerability detection. In 25th Annual Network and Distributed System Security Symposium NDSS 2018 San Diego California USA February 18-21 2018. The Internet Society."},{"key":"e_1_3_2_15_2","unstructured":"Yueming Wu Deqing Zou Shihan Dou Wei Yang Duo Xu and Hai Jin. 2022. Vulcnn: An image-inspired scalable vulnerability detection system. In 2022 IEEE\/ACM 44th International Conference on Software Engineering (ICSE\u201922) 2365\u20132376."},{"key":"e_1_3_2_16_2","doi-asserted-by":"crossref","unstructured":"Rebecca Russell Louis Kim Lei Hamilton Tomo Lazovich Jacob Harer Onur Ozdemir Paul Ellingwood and Marc McConley. 2018. Automated vulnerability detection in source code using deep representation learning. In 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA\u201918) 757\u2013762.","DOI":"10.1109\/ICMLA.2018.00120"},{"key":"e_1_3_2_17_2","unstructured":"Zhitao Ying Dylan Bourgeois Jiaxuan You Marinka Zitnik and Jure Leskovec. 2019. Gnnexplainer: Generating explanations for graph neural networks. In Advances in Neural Information Processing Systems H. Wallach H. Larochelle A. Beygelzimer F. d\u2019Alch\u00e9-Buc E. Fox and R. Garnett (Eds.). Vol. 32. Curran Associates Inc."},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/WACV.2018.00097"},{"key":"e_1_3_2_19_2","doi-asserted-by":"crossref","unstructured":"Deqing Zou Yawei Zhu Shouhuai Xu Zhen Li Hai Jin and Hengkai Ye. 2021. Interpreting deep learning-based vulnerability detector predictions based on heuristic searching. ACM Transactions on Software Engineering and Methodology 30 2 (2021) 1\u201331.","DOI":"10.1145\/3429444"},{"key":"e_1_3_2_20_2","unstructured":"Kumar Abhishek and Deeksha Kamath. 2022. Attribution-based XAI methods in computer vision: A Review. arXiv:2211.14736. Retrieved from https:\/\/arxiv.org\/abs\/2211.14736"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/3546577"},{"key":"e_1_3_2_22_2","unstructured":"Dongsheng Luo Wei Cheng Dongkuan Xu Wenchao Yu Bo Zong Haifeng Chen and Xiang Zhang. 2020. Parameterized explainer for graph neural network. In Proceedings of the 34th International Conference on Neural Information Processing Systems (NIPS\u201920). Vol. 33 Curran Associates Inc. Red Hook NY 19620\u201319631."},{"key":"e_1_3_2_23_2","doi-asserted-by":"crossref","unstructured":"Thomas Schnake Oliver Eberle Jonas Lederer Shinichi Nakajima Kristof T. Sch\u00fctt Klaus-Robert M\u00fcller and Gr\u00e9goire Montavon. 2022. Higher-order explanations of graph neural networks via relevant walks. IEEE Transactions on Pattern Analysis and Machine Intelligence 44 11 (2022) 7581\u20137596.","DOI":"10.1109\/TPAMI.2021.3115452"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01103"},{"key":"e_1_3_2_25_2","first-page":"3145","volume-title":"International Conference on Machine Learning","author":"Shrikumar Avanti","year":"2017","unstructured":"Avanti Shrikumar, Peyton Greenside, and Anshul Kundaje. 2017. Learning important features through propagating activation differences. In International Conference on Machine Learning. PMLR, 3145\u20133153."},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-5221"},{"key":"e_1_3_2_27_2","unstructured":"Scott M. Lundberg and Su-In Lee. 2017. A unified approach to interpreting model predictions. In Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS\u201917) Curran Associates Inc. Red Hook NY 4768\u20134777."},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3533767.3534371"},{"key":"e_1_3_2_30_2","doi-asserted-by":"crossref","unstructured":"Huanting Wang Guixin Ye Zhanyong Tang Shin Hwei Tan Songfang Huang Dingyi Fang Yansong Feng Lizhong Bian and Zheng Wang. 2021. Combining graph-based learning with automated data collection for code vulnerability detection. IEEE Transactions on Information Forensics and Security 16 (2021) 1943\u20131958.","DOI":"10.1109\/TIFS.2020.3044773"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/3524842.3527949"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3524842.3528452"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE52982.2021.00054"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/TDSC.2021.3076142"},{"key":"e_1_3_2_35_2","unstructured":"Tomas Mikolov Ilya Sutskever Kai Chen Greg S. Corrado and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems C. J. Burges L. Bottou M. Welling Z. Ghahramani and K. Q. Weinberger (Eds.). Vol. 26 Curran Associates Inc. 3111\u20133119."},{"key":"e_1_3_2_36_2","unstructured":"Yujia Li Daniel Tarlow Marc Brockschmidt and Richard S. Zemel. 2016. Gated graph sequence neural networks. In 4th International Conference on Learning Representations (ICLR\u201916) San Juan and Puerto Rico (Eds.)."},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2014.44"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"key":"e_1_3_2_39_2","unstructured":"Kyunghyun Cho Bart van Merri\u00ebnboer Dzmitry Bahdanau and Yoshua Bengio. 2014. On the properties of neural machine translation: Encoder-decoder approaches. In Proceedings of SSST-8 Eighth Workshop on Syntax Semantics and Structure in Statistical Translation Association for Computational Linguistics Doha 103\u2013111."},{"key":"e_1_3_2_40_2","unstructured":"Thomas N. Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. In 5th International Conference on Learning Representations ICLR 2017 Toulon France April 24-26 2017 Conference Track Proceedings ICLR\u201917 2017."},{"key":"e_1_3_2_41_2","first-page":"1188","volume-title":"International Conference on Machine Learning","author":"Le Quoc","year":"2014","unstructured":"Quoc Le and Tomas Mikolov. 2014. Distributed representations of sentences and documents. In International Conference on Machine Learning. PMLR, 1188\u20131196."},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2005.06.042"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_3_2_44_2","unstructured":"Xiao Cheng Xu Nie Ningke Li Haoyu Wang Zheng Zheng and Yulei Sui. 2022. How about bug-triggering paths?-understanding and characterizing learning-based vulnerability detectors. IEEE Transactions on Dependable and Secure Computing 1\u201318."},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/p15-1150"},{"key":"e_1_3_2_46_2","unstructured":"Hao Yuan Haiyang Yu Shurui Gui and Shuiwang Ji. 2023. Explainability in graph neural networks: A taxonomic survey. IEEE Transactions on Pattern Analysis and Machine Intelligence 45 5 (2023) 5782\u20135799."},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.74"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1900654116"},{"key":"e_1_3_2_49_2","unstructured":"Software Assurance Reference Dataset. 2017. Retrieved from https:\/\/samate.nist.gov\/SARD\/index.php"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3379597.3387501"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-90403-0_9"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-SEIP52600.2021.00020"},{"key":"e_1_3_2_53_2","doi-asserted-by":"crossref","unstructured":"Roland Croft M. Ali Babar and M. Mehdi Kholoosi. 2023. Data quality for software vulnerability datasets. In IEEE\/ACM 45th International Conference on Software Engineering (ICSE\u201923) 121\u2013133.","DOI":"10.1109\/ICSE48619.2023.00022"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597926.3598037"},{"key":"e_1_3_2_55_2","unstructured":"Joern 2014. https:\/\/github.com\/joernio\/joern"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/3474369.3486866"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.findings-emnlp.139"},{"key":"e_1_3_2_58_2","volume-title":"Proceedings of the 29th IEEE International Conference on Software Analysis, Evolution and Reengineering","author":"Kai Siow Jing","year":"2022","unstructured":"Siow Jing Kai, Liu Shangqing, Xie Xiaofei, Meng Guozhu, and Liu Yang. 2022. Learning program semantics with code representations: An empirical study. In Proceedings of the 29th IEEE International Conference on Software Analysis, Evolution and Reengineering."},{"key":"e_1_3_2_59_2","unstructured":"Yuqiang Sun Daoyuan Wu Yue Xue Han Liu Haijun Wang Zhengzi Xu Xiaofei Xie and Yang Liu. 2023. Gptscan: Detecting logic vulnerabilities in smart contracts by combining gpt with program analysis. arXiv preprint arXiv:2308.03314."},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASE56229.2023.00073"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.23915\/distill.00007"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403085"},{"key":"e_1_3_2_63_2","doi-asserted-by":"crossref","unstructured":"Qiang Huang Makoto Yamada Yuan Tian Dinesh Singh and Yi Chang. 2023. Graphlime: Local interpretable model explanations for graph neural networks. IEEE Transactions on Knowledge and Data Engineering 35 7 (2023) 6968\u20136972.","DOI":"10.1109\/TKDE.2022.3187455"},{"key":"e_1_3_2_64_2","unstructured":"Minh N. Vu and My T. Thai. 2020. Pgm-explainer: probabilistic graphical model explanations for graph neural networks. In Proceedings of the 34th International Conference on Neural Information Processing Systems (NIPS\u201920) Curran Associates Inc. Red Hook NY."},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1145\/3461702.3462562"},{"key":"e_1_3_2_66_2","first-page":"12241","volume-title":"International Conference on Machine Learning","author":"Yuan Hao","year":"2021","unstructured":"Hao Yuan, Haiyang Yu, Jie Wang, Kang Li, and Shuiwang Ji. 2021. On explainability of graph neural networks via subgraph explorations. In International Conference on Machine Learning. PMLR, 12241\u201312252."},{"key":"e_1_3_2_67_2","unstructured":"Thorben Funke Megha Khosla and Avishek Anand. 2021. Hard masking for explaining graph neural networks. In Proceedings of the 2021 International Conference on Learning Representations (ICLR\u201921)."},{"key":"e_1_3_2_68_2","unstructured":"Xiang Wang Yingxin Wu An Zhang Xiangnan He and Tat-seng Chua. 2020. Causal screening to interpret graph neural networks. (2020)."},{"key":"e_1_3_2_69_2","unstructured":"Michael Sejr Schlichtkrull Nicola De Cao and Ivan Titov. 2021. Interpreting graph neural networks for NLP with differentiable edge masking. In 9th International Conference on Learning Representations (ICLR \u201921 Virtual Event Austria May 3-7 2021) OpenReview.net 2021."},{"key":"e_1_3_2_70_2","unstructured":"Baijun Cheng Kailong Wang Cuiyun Gao Xiapu Luo Yulei Sui Li Li Yao Guo Xiangqun Chen and Haoyu Wang. 2024. The vulnerability is in the details: Locating fine-grained information of vulnerable code identified by graph-based detectors. arXiv preprint arXiv:2401.02737."},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2020.3023177"},{"key":"e_1_3_2_72_2","doi-asserted-by":"crossref","unstructured":"Chanathip Pornprasit and Chakkrit Kla Tantithamthavorn. 2021. Jitline: A simpler better faster finer-grained just-in-time defect prediction. In IEEE\/ACM 18th International Conference on Mining Software Repositories (MSR\u201921) IEEE 369\u2013379.","DOI":"10.1109\/MSR52588.2021.00049"},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1109\/DSA52907.2021.00017"},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASE51524.2021.9678763"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1109\/RAISE.2019.00016"},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468539"},{"key":"e_1_3_2_77_2","doi-asserted-by":"publisher","DOI":"10.1145\/3520312.3534869"},{"key":"e_1_3_2_78_2","doi-asserted-by":"publisher","DOI":"10.1145\/3597926.3598145"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3641543","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3641543","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T22:50:16Z","timestamp":1750287016000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3641543"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,4]]},"references-count":77,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2024,6,30]]}},"alternative-id":["10.1145\/3641543"],"URL":"https:\/\/doi.org\/10.1145\/3641543","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,4]]},"assertion":[{"value":"2023-07-09","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-01-03","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-06-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}