{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,5]],"date-time":"2025-11-05T11:29:38Z","timestamp":1762342178457,"version":"3.41.0"},"reference-count":49,"publisher":"Association for Computing Machinery (ACM)","issue":"OOPSLA2","license":[{"start":{"date-parts":[[2023,10,16]],"date-time":"2023-10-16T00:00:00Z","timestamp":1697414400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100017052","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["No. 62032010 and No. 62202220"],"award-info":[{"award-number":["No. 62032010 and No. 62202220"]}],"id":[{"id":"10.13039\/100017052","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Program. Lang."],"published-print":{"date-parts":[[2023,10,16]]},"abstract":"<jats:p>This paper introduces a novel method, called WheaCha, for explaining the predictions of code models. Similar to attribution methods, WheaCha seeks to identify input features that are responsible for a particular prediction that models make. On the other hand, it differs from attribution methods in crucial ways. Specifically, WheaCha separates an input program into \"wheat\" (i.e., defining features that are the reason for which models predict the label that they predict) and the rest \"chaff\" for any given prediction. We realize WheaCha in a tool, HuoYan, and use it to explain four prominent code models: code2vec, seq-GNN, GGNN, and CodeBERT. Results show that (1) HuoYan is efficient \u2014 taking on average under twenty seconds to compute wheat for an input program in an end-to-end fashion (i.e., including model prediction time); (2) the wheat that all models use to make predictions is predominantly comprised of simple syntactic or even lexical properties (i.e., identifier names); (3) neither the latest explainability methods for code models (i.e., SIVAND and CounterFactual Explanations) nor the most noteworthy attribution methods (i.e., Integrated Gradients and SHAP) can precisely capture wheat. Finally, we set out to demonstrate the usefulness of WheaCha, in particular, we assess if WheaCha\u2019s explanations can help end users to identify defective code models (e.g., trained on mislabeled data or learned spurious correlations from biased data). We find that, with WheaCha, users achieve far higher accuracy in identifying faulty models than SIVAND, CounterFactual Explanations, Integrated Gradients and SHAP.<\/jats:p>","DOI":"10.1145\/3622826","type":"journal-article","created":{"date-parts":[[2023,10,16]],"date-time":"2023-10-16T15:41:29Z","timestamp":1697470889000},"page":"801-827","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["An Explanation Method for Models of Code"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7216-6929","authenticated-orcid":false,"given":"Yu","family":"Wang","sequence":"first","affiliation":[{"name":"Nanjing University, Nanjing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0844-5023","authenticated-orcid":false,"given":"Ke","family":"Wang","sequence":"additional","affiliation":[{"name":"Visa Research, Palo Alto, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4794-1652","authenticated-orcid":false,"given":"Linzhang","family":"Wang","sequence":"additional","affiliation":[{"name":"Nanjing University, Nanjing, China"}]}],"member":"320","published-online":{"date-parts":[[2023,10,16]]},"reference":[{"volume-title":"Advances in Neural Information Processing Systems","author":"Adebayo Julius","unstructured":"Julius Adebayo , Michael Muelly , Ilaria Liccardi , and Been Kim . 2020. Debugging Tests for Model Explanations . In Advances in Neural Information Processing Systems , H. Larochelle, M. Ranzato, R. Hadsell, M.F. Balcan, and H. Lin (Eds.) ( NeurIPS \u201920, Vol. 33). Curran Associates, Inc., 700\u2013 712 . Julius Adebayo, Michael Muelly, Ilaria Liccardi, and Been Kim. 2020. Debugging Tests for Model Explanations. In Advances in Neural Information Processing Systems, H. Larochelle, M. Ranzato, R. Hadsell, M.F. Balcan, and H. Lin (Eds.) (NeurIPS \u201920, Vol. 33). Curran Associates, Inc., 700\u2013712.","key":"e_1_2_2_1_1"},{"key":"e_1_2_2_2_1","volume-title":"International Conference on Learning Representations (ICLR \u201918)","author":"Allamanis Miltiadis","year":"2018","unstructured":"Miltiadis Allamanis , Marc Brockschmidt , and Mahmoud Khademi . 2018 . Learning to Represent Programs with Graphs . In International Conference on Learning Representations (ICLR \u201918) . Miltiadis Allamanis, Marc Brockschmidt, and Mahmoud Khademi. 2018. Learning to Represent Programs with Graphs. In International Conference on Learning Representations (ICLR \u201918)."},{"key":"e_1_2_2_3_1","volume-title":"International Conference on Machine Learning (ICML \u201916)","author":"Allamanis Miltiadis","year":"2016","unstructured":"Miltiadis Allamanis , Hao Peng , and Charles Sutton . 2016 . A Convolutional Attention Network for Extreme Summarization of Source Code . In International Conference on Machine Learning (ICML \u201916) . Miltiadis Allamanis, Hao Peng, and Charles Sutton. 2016. A Convolutional Attention Network for Extreme Summarization of Source Code. In International Conference on Machine Learning (ICML \u201916)."},{"key":"e_1_2_2_4_1","volume-title":"International Conference on Learning Representations (ICLR \u201919)","author":"Alon Uri","year":"2019","unstructured":"Uri Alon , Omer Levy , and Eran Yahav . 2019 . code2seq: Generating Sequences from Structured Representations of Code . In International Conference on Learning Representations (ICLR \u201919) . Uri Alon, Omer Levy, and Eran Yahav. 2019. code2seq: Generating Sequences from Structured Representations of Code. In International Conference on Learning Representations (ICLR \u201919)."},{"doi-asserted-by":"publisher","key":"e_1_2_2_5_1","DOI":"10.1145\/3290353"},{"doi-asserted-by":"publisher","key":"e_1_2_2_6_1","DOI":"10.1371\/journal.pone.0130140"},{"doi-asserted-by":"publisher","key":"e_1_2_2_7_1","DOI":"10.1145\/3360585"},{"doi-asserted-by":"publisher","key":"e_1_2_2_8_1","DOI":"10.1038\/s41746-019-0105-1"},{"key":"e_1_2_2_9_1","volume-title":"International Conference on Learning Representations (ICLR \u201915)","author":"Bahdanau Dzmitry","year":"2015","unstructured":"Dzmitry Bahdanau , Kyunghyun Cho , and Yoshua Bengio . 2015 . Neural machine translation by jointly learning to align and translate . In International Conference on Learning Representations (ICLR \u201915) . Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In International Conference on Learning Representations (ICLR \u201915)."},{"doi-asserted-by":"publisher","key":"e_1_2_2_10_1","DOI":"10.1145\/3412815.3416889"},{"key":"e_1_2_2_11_1","volume-title":"Computer Aided Verification: 32nd International Conference, CAV 2020, Los Angeles, CA, USA, July 21\u201324, 2020, Proceedings, Part II. 587\u2013610","author":"Chen Yanju","year":"2020","unstructured":"Yanju Chen , Chenglong Wang , Osbert Bastani , Isil Dillig , and Yu Feng . 2020 . Program synthesis using deduction-guided reinforcement learning . In Computer Aided Verification: 32nd International Conference, CAV 2020, Los Angeles, CA, USA, July 21\u201324, 2020, Proceedings, Part II. 587\u2013610 . Yanju Chen, Chenglong Wang, Osbert Bastani, Isil Dillig, and Yu Feng. 2020. Program synthesis using deduction-guided reinforcement learning. In Computer Aided Verification: 32nd International Conference, CAV 2020, Los Angeles, CA, USA, July 21\u201324, 2020, Proceedings, Part II. 587\u2013610."},{"doi-asserted-by":"publisher","key":"e_1_2_2_12_1","DOI":"10.1109\/TSE.2019.2940179"},{"key":"e_1_2_2_13_1","volume-title":"Counterfactual Explanations for Models of Code. In 2022 IEEE\/ACM 44th International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP). 125\u2013134","author":"Cito J\u00fcrgen","year":"2022","unstructured":"J\u00fcrgen Cito , Isil Dillig , Vijayaraghavan Murali , and Satish Chandra . 2022 . Counterfactual Explanations for Models of Code. In 2022 IEEE\/ACM 44th International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP). 125\u2013134 . J\u00fcrgen Cito, Isil Dillig, Vijayaraghavan Murali, and Satish Chandra. 2022. Counterfactual Explanations for Models of Code. In 2022 IEEE\/ACM 44th International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP). 125\u2013134."},{"key":"e_1_2_2_14_1","volume-title":"International Conference on Learning Representations (ICLR \u201919)","author":"Dinella Elizabeth","year":"2019","unstructured":"Elizabeth Dinella , Hanjun Dai , Ziyang Li , Mayur Naik , Le Song , and Ke Wang . 2019 . Hoppity: Learning Graph Transformations to Detect and Fix Bugs in Programs . In International Conference on Learning Representations (ICLR \u201919) . Elizabeth Dinella, Hanjun Dai, Ziyang Li, Mayur Naik, Le Song, and Ke Wang. 2019. Hoppity: Learning Graph Transformations to Detect and Fix Bugs in Programs. In International Conference on Learning Representations (ICLR \u201919)."},{"doi-asserted-by":"publisher","key":"e_1_2_2_15_1","DOI":"10.18653\/v1\/2020.findings-emnlp.139"},{"key":"e_1_2_2_16_1","volume-title":"Structured Neural Summarization. In International Conference on Learning Representations (ICLR \u201919)","author":"Fernandes Patrick","year":"2019","unstructured":"Patrick Fernandes , Miltiadis Allamanis , and Marc Brockschmidt . 2019 . Structured Neural Summarization. In International Conference on Learning Representations (ICLR \u201919) . Patrick Fernandes, Miltiadis Allamanis, and Marc Brockschmidt. 2019. Structured Neural Summarization. In International Conference on Learning Representations (ICLR \u201919)."},{"doi-asserted-by":"publisher","key":"e_1_2_2_17_1","DOI":"10.1145\/3591227"},{"doi-asserted-by":"publisher","key":"e_1_2_2_18_1","DOI":"10.5555\/3020548.3020580"},{"doi-asserted-by":"publisher","key":"e_1_2_2_19_1","DOI":"10.5555\/3454287.3455160"},{"unstructured":"Hamel Husain Ho-Hsiang Wu Tiferet Gazit Miltiadis Allamanis and Marc Brockschmidt. 2019. CodeSearchNet challenge: Evaluating the state of semantic code search. arXiv preprint arXiv:1909.09436. \t\t\t\t  Hamel Husain Ho-Hsiang Wu Tiferet Gazit Miltiadis Allamanis and Marc Brockschmidt. 2019. CodeSearchNet challenge: Evaluating the state of semantic code search. arXiv preprint arXiv:1909.09436.","key":"e_1_2_2_20_1"},{"key":"e_1_2_2_21_1","volume-title":"Gated Graph Sequence Neural Networks. In International Conference on Learning Representations (ICLR \u201916)","author":"Li Yujia","year":"2016","unstructured":"Yujia Li , Richard Zemel , Marc Brockschmidt , and Daniel Tarlow . 2016 . Gated Graph Sequence Neural Networks. In International Conference on Learning Representations (ICLR \u201916) . Yujia Li, Richard Zemel, Marc Brockschmidt, and Daniel Tarlow. 2016. Gated Graph Sequence Neural Networks. In International Conference on Learning Representations (ICLR \u201916)."},{"volume-title":"Advances in Neural Information Processing Systems","author":"Lundberg Scott M","unstructured":"Scott M Lundberg and Su-In Lee . 2017. A Unified Approach to Interpreting Model Predictions . In Advances in Neural Information Processing Systems , I. Guyon, U. Von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.). 30, Curran Associates, Inc. . Scott M Lundberg and Su-In Lee. 2017. A Unified Approach to Interpreting Model Predictions. In Advances in Neural Information Processing Systems, I. Guyon, U. Von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.). 30, Curran Associates, Inc..","key":"e_1_2_2_22_1"},{"doi-asserted-by":"publisher","key":"e_1_2_2_23_1","DOI":"10.1109\/ICSE48619.2023.00211"},{"key":"e_1_2_2_24_1","volume-title":"International Conference on Learning Representations (ICLR \u201921)","author":"Odena Augustus","year":"2021","unstructured":"Augustus Odena , Kensen Shi , David Bieber , Rishabh Singh , Charles Sutton , and Hanjun Dai . 2021 . BUSTLE: Bottom-Up program synthesis through learning-guided exploration . In International Conference on Learning Representations (ICLR \u201921) . Augustus Odena, Kensen Shi, David Bieber, Rishabh Singh, Charles Sutton, and Hanjun Dai. 2021. BUSTLE: Bottom-Up program synthesis through learning-guided exploration. In International Conference on Learning Representations (ICLR \u201921)."},{"doi-asserted-by":"publisher","key":"e_1_2_2_25_1","DOI":"10.1145\/3468264.3468623"},{"doi-asserted-by":"publisher","key":"e_1_2_2_26_1","DOI":"10.1145\/3276517"},{"doi-asserted-by":"publisher","key":"e_1_2_2_27_1","DOI":"10.1016\/j.infsof.2021.106552"},{"doi-asserted-by":"publisher","key":"e_1_2_2_28_1","DOI":"10.1145\/3468264.3468539"},{"doi-asserted-by":"publisher","key":"e_1_2_2_29_1","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_2_2_30_1","volume-title":"International Conference on Learning Representations (ICLR \u201922)","author":"Shi Kensen","year":"2022","unstructured":"Kensen Shi , Hanjun Dai , Kevin Ellis , and Charles Sutton . 2022 . CrossBeam: Learning to Search in Bottom-Up Program Synthesis . In International Conference on Learning Representations (ICLR \u201922) . Kensen Shi, Hanjun Dai, Kevin Ellis, and Charles Sutton. 2022. CrossBeam: Learning to Search in Bottom-Up Program Synthesis. In International Conference on Learning Representations (ICLR \u201922)."},{"key":"e_1_2_2_31_1","volume-title":"Proceedings of the 34th International Conference on Machine Learning -","volume":"70","author":"Shrikumar Avanti","year":"2017","unstructured":"Avanti Shrikumar , Peyton Greenside , and Anshul Kundaje . 2017 . Learning Important Features through Propagating Activation Differences . In Proceedings of the 34th International Conference on Machine Learning - Volume 70 (ICML \u201917). JMLR.org, 3145\u20133153. Avanti Shrikumar, Peyton Greenside, and Anshul Kundaje. 2017. Learning Important Features through Propagating Activation Differences. In Proceedings of the 34th International Conference on Machine Learning - Volume 70 (ICML \u201917). JMLR.org, 3145\u20133153."},{"unstructured":"Avanti Shrikumar Peyton Greenside Anna Shcherbina and Anshul Kundaje. 2016. Not just a black box: Learning important features through propagating activation differences. arXiv preprint arXiv:1605.01713. \t\t\t\t  Avanti Shrikumar Peyton Greenside Anna Shcherbina and Anshul Kundaje. 2016. Not just a black box: Learning important features through propagating activation differences. arXiv preprint arXiv:1605.01713.","key":"e_1_2_2_32_1"},{"key":"e_1_2_2_33_1","volume-title":"In Workshop at International Conference on Learning Representations (ICLR \u201914)","author":"Simonyan Karen","year":"2014","unstructured":"Karen Simonyan , Andrea Vedaldi , and Andrew Zisserman . 2014 . Deep inside convolutional networks: Visualising image classification models and saliency maps . In In Workshop at International Conference on Learning Representations (ICLR \u201914) . Karen Simonyan, Andrea Vedaldi, and Andrew Zisserman. 2014. Deep inside convolutional networks: Visualising image classification models and saliency maps. In In Workshop at International Conference on Learning Representations (ICLR \u201914)."},{"key":"e_1_2_2_34_1","volume-title":"Proceedings of the 34th International Conference on Machine Learning -","volume":"70","author":"Sundararajan Mukund","year":"2017","unstructured":"Mukund Sundararajan , Ankur Taly , and Qiqi Yan . 2017 . Axiomatic Attribution for Deep Networks . In Proceedings of the 34th International Conference on Machine Learning - Volume 70 (ICML \u201917). JMLR.org, 3319\u20133328. Mukund Sundararajan, Ankur Taly, and Qiqi Yan. 2017. Axiomatic Attribution for Deep Networks. In Proceedings of the 34th International Conference on Machine Learning - Volume 70 (ICML \u201917). JMLR.org, 3319\u20133328."},{"doi-asserted-by":"publisher","key":"e_1_2_2_35_1","DOI":"10.1145\/3468264.3468545"},{"key":"e_1_2_2_36_1","volume-title":"2021 36th IEEE\/ACM International Conference on Automated Software Engineering (ASE \u201921)","author":"Tantithamthavorn Chakkrit Kla","year":"2021","unstructured":"Chakkrit Kla Tantithamthavorn and Jirayus Jiarpakdee . 2021 . Explainable ai for software engineering . In 2021 36th IEEE\/ACM International Conference on Automated Software Engineering (ASE \u201921) . 1\u20132. Chakkrit Kla Tantithamthavorn and Jirayus Jiarpakdee. 2021. Explainable ai for software engineering. In 2021 36th IEEE\/ACM International Conference on Automated Software Engineering (ASE \u201921). 1\u20132."},{"key":"e_1_2_2_37_1","volume-title":"Dynamic Neural Program Embedding for Program Repair. In International Conference on Learning Representations (ICLR \u201918)","author":"Wang Ke","year":"2018","unstructured":"Ke Wang , Rishabh Singh , and Zhendong Su . 2018 . Dynamic Neural Program Embedding for Program Repair. In International Conference on Learning Representations (ICLR \u201918) . Ke Wang, Rishabh Singh, and Zhendong Su. 2018. Dynamic Neural Program Embedding for Program Repair. In International Conference on Learning Representations (ICLR \u201918)."},{"doi-asserted-by":"publisher","key":"e_1_2_2_38_1","DOI":"10.1145\/3385412.3385999"},{"doi-asserted-by":"publisher","key":"e_1_2_2_39_1","DOI":"10.1145\/3428205"},{"volume-title":"Advances in Neural Information Processing Systems, S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh (Eds.) (NeurIPS \u201922","author":"Yang Jingkang","unstructured":"Jingkang Yang , Pengyun Wang , Dejian Zou , Zitang Zhou , Kunyuan Ding , WENXUAN PENG , Haoqi Wang , Guangyao Chen , Bo Li , Yiyou Sun , Xuefeng Du , Kaiyang Zhou , Wayne Zhang , Dan Hendrycks , Yixuan Li , and Ziwei Liu . 2022. OpenOOD: Benchmarking Generalized Out-of-Distribution Detection . In Advances in Neural Information Processing Systems, S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh (Eds.) (NeurIPS \u201922 , Vol. 35). Curran Associates, Inc., 32598\u2013 32611 . Jingkang Yang, Pengyun Wang, Dejian Zou, Zitang Zhou, Kunyuan Ding, WENXUAN PENG, Haoqi Wang, Guangyao Chen, Bo Li, Yiyou Sun, Xuefeng Du, Kaiyang Zhou, Wayne Zhang, Dan Hendrycks, Yixuan Li, and Ziwei Liu. 2022. OpenOOD: Benchmarking Generalized Out-of-Distribution Detection. In Advances in Neural Information Processing Systems, S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh (Eds.) (NeurIPS \u201922, Vol. 35). Curran Associates, Inc., 32598\u201332611.","key":"e_1_2_2_40_1"},{"doi-asserted-by":"publisher","key":"e_1_2_2_41_1","DOI":"10.1145\/3510003.3510146"},{"doi-asserted-by":"publisher","key":"e_1_2_2_42_1","DOI":"10.1145\/3428230"},{"key":"e_1_2_2_43_1","volume-title":"2011 International Conference on Computer Vision (ICCV \u201911)","author":"Zeiler Matthew D","year":"2011","unstructured":"Matthew D Zeiler , Graham W Taylor , and Rob Fergus . 2011 . Adaptive deconvolutional networks for mid and high level feature learning . In 2011 International Conference on Computer Vision (ICCV \u201911) . 2018\u20132025. Matthew D Zeiler, Graham W Taylor, and Rob Fergus. 2011. Adaptive deconvolutional networks for mid and high level feature learning. In 2011 International Conference on Computer Vision (ICCV \u201911). 2018\u20132025."},{"doi-asserted-by":"publisher","key":"e_1_2_2_44_1","DOI":"10.1145\/318774.318946"},{"doi-asserted-by":"publisher","key":"e_1_2_2_45_1","DOI":"10.1109\/32.988498"},{"volume-title":"Advances in Neural Information Processing Systems","author":"Zhang Xin","unstructured":"Xin Zhang , Armando Solar-Lezama , and Rishabh Singh . 2018. Interpreting Neural Network Judgments via Minimal, Stable, and Symbolic Corrections . In Advances in Neural Information Processing Systems , S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett (Eds.) ( NeurIPS \u201918, Vol. 31). Curran Associates, Inc.. Xin Zhang, Armando Solar-Lezama, and Rishabh Singh. 2018. Interpreting Neural Network Judgments via Minimal, Stable, and Symbolic Corrections. In Advances in Neural Information Processing Systems, S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett (Eds.) (NeurIPS \u201918, Vol. 31). Curran Associates, Inc..","key":"e_1_2_2_46_1"},{"doi-asserted-by":"publisher","key":"e_1_2_2_47_1","DOI":"10.1609\/aaai.v24i1.7671"},{"doi-asserted-by":"publisher","key":"e_1_2_2_48_1","DOI":"10.1145\/3501256"},{"key":"e_1_2_2_49_1","volume-title":"Visualizing Deep Neural Network Decisions: Prediction Difference Analysis. In International Conference on Learning Representations (ICLR \u201917)","author":"Zintgraf Luisa M","year":"2017","unstructured":"Luisa M Zintgraf , Taco S Cohen , Tameem Adel , and Max Welling . 2017 . Visualizing Deep Neural Network Decisions: Prediction Difference Analysis. In International Conference on Learning Representations (ICLR \u201917) . Luisa M Zintgraf, Taco S Cohen, Tameem Adel, and Max Welling. 2017. Visualizing Deep Neural Network Decisions: Prediction Difference Analysis. In International Conference on Learning Representations (ICLR \u201917)."}],"container-title":["Proceedings of the ACM on Programming Languages"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3622826","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3622826","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:37:04Z","timestamp":1750178224000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3622826"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,16]]},"references-count":49,"journal-issue":{"issue":"OOPSLA2","published-print":{"date-parts":[[2023,10,16]]}},"alternative-id":["10.1145\/3622826"],"URL":"https:\/\/doi.org\/10.1145\/3622826","relation":{},"ISSN":["2475-1421"],"issn-type":[{"type":"electronic","value":"2475-1421"}],"subject":[],"published":{"date-parts":[[2023,10,16]]},"assertion":[{"value":"2023-10-16","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}