{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T05:13:13Z","timestamp":1784178793509,"version":"3.55.0"},"reference-count":71,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2023,2,7]],"date-time":"2023-02-07T00:00:00Z","timestamp":1675728000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"crossref","award":["2020AAA0107000"],"award-info":[{"award-number":["2020AAA0107000"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Collaborative Innovation Center of Novel Software Technology and Industrialization"},{"name":"NSF","award":["1947135"],"award-info":[{"award-number":["1947135"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Inf. Syst."],"published-print":{"date-parts":[[2023,7,31]]},"abstract":"<jats:p>Neural graph collaborative filtering has received great recent attention due to its power of encoding the high-order neighborhood via the backbone graph neural networks. However, their robustness against noisy user-item interactions remains largely unexplored. Existing work on robust collaborative filtering mainly improves the robustness by denoising the graph structure, while recent progress in other fields has shown that directly adding adversarial perturbations in the embedding space can significantly improve the model robustness. In this work, we propose to improve the robustness of neural graph collaborative filtering via both denoising in the structure space and perturbing in the embedding space. Specifically, in the structure space, we measure the reliability of interactions and further use it to affect the message propagation process of the backbone graph neural networks; in the embedding space, we add in-distribution perturbations by mimicking the behavior of adversarial attacks and further combine it with contrastive learning to improve the performance. Extensive experiments have been conducted on four benchmark datasets to evaluate the effectiveness and efficiency of the proposed approach. The results demonstrate that the proposed approach outperforms the recent neural graph collaborative filtering methods especially when there are injected noisy interactions in the training data.<\/jats:p>","DOI":"10.1145\/3568396","type":"journal-article","created":{"date-parts":[[2022,10,17]],"date-time":"2022-10-17T13:06:34Z","timestamp":1666011994000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":62,"title":["Towards Robust Neural Graph Collaborative Filtering via Structure Denoising and Embedding Perturbation"],"prefix":"10.1145","volume":"41","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9034-7013","authenticated-orcid":false,"given":"Haibo","family":"Ye","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu Province, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6120-6892","authenticated-orcid":false,"given":"Xinjie","family":"Li","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu Province, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6913-6542","authenticated-orcid":false,"given":"Yuan","family":"Yao","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, Jiangsu Province, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4405-3887","authenticated-orcid":false,"given":"Hanghang","family":"Tong","sequence":"additional","affiliation":[{"name":"University of Illinois Urbana-Champaign, Urbana, IL, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,2,7]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/1367497.1367618"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3411905"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3462968"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3462868"},{"key":"e_1_3_3_6_2","article-title":"Bias and debias in recommender system: A survey and future directions","author":"Chen Jiawei","year":"2020","unstructured":"Jiawei Chen, Hande Dong, Xiang Wang, Fuli Feng, Meng Wang, and Xiangnan He. 2020. Bias and debias in recommender system: A survey and future directions. arXiv preprint arXiv:2010.03240 (2020).","journal-title":"arXiv preprint arXiv:2010.03240"},{"key":"e_1_3_3_7_2","first-page":"27","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Chen Lei","year":"2020","unstructured":"Lei Chen, Le Wu, Richang Hong, Kun Zhang, and Meng Wang. 2020. Revisiting graph based collaborative filtering: A linear residual graph convolutional network approach. In Proceedings of the AAAI Conference on Artificial Intelligence. 27\u201334."},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403170"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/2020408.2020579"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3298689.3347031"},{"key":"e_1_3_3_11_2","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Dai Hanjun","year":"2018","unstructured":"Hanjun Dai, Hui Li, Tian Tian, Xin Huang, Lin Wang, Jun Zhu, and Le Song. 2018. Adversarial attack on graph structured data. In Proceedings of the International Conference on Machine Learning."},{"key":"e_1_3_3_12_2","first-page":"231","volume-title":"Proceedings of KDD Cup 2011","author":"Gantner Zeno","year":"2012","unstructured":"Zeno Gantner, Lucas Drumond, Christoph Freudenthaler, and Lars Schmidt-Thieme. 2012. Personalized ranking for non-uniformly sampled items. In Proceedings of KDD Cup 2011. PMLR, 231\u2013247."},{"key":"e_1_3_3_13_2","article-title":"Self-guided learning to denoise for robust recommendation","author":"Gao Yunjun","year":"2022","unstructured":"Yunjun Gao, Yuntao Du, Yujia Hu, Lu Chen, Xinjun Zhu, Ziquan Fang, and Baihua Zheng. 2022. Self-guided learning to denoise for robust recommendation. arXiv preprint arXiv:2204.06832 (2022).","journal-title":"arXiv preprint arXiv:2204.06832"},{"key":"e_1_3_3_14_2","first-page":"2766","volume-title":"Proceedings of the International Joint Conference on Artificial Intelligence","author":"Gori Marco","year":"2007","unstructured":"Marco Gori, Augusto Pucci, V. Roma, and I. Siena. 2007. ItemRank: A random-walk based scoring algorithm for recommender engines. In Proceedings of the International Joint Conference on Artificial Intelligence. 2766\u20132771."},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-012-9364-9"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/2827872"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401063"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052569"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/2396761.2396780"},{"key":"e_1_3_3_20_2","first-page":"2968","volume-title":"Proceedings of the Web Conference","author":"Hsu Cheng","year":"2021","unstructured":"Cheng Hsu and Cheng-Te Li. 2021. RetaGNN: Relational temporal attentive graph neural networks for holistic sequential recommendation. In Proceedings of the Web Conference. 2968\u20132979."},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2008.22"},{"key":"e_1_3_3_22_2","doi-asserted-by":"crossref","first-page":"665","DOI":"10.1145\/3447548.3467408","volume-title":"Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining","author":"Huang Tinglin","year":"2021","unstructured":"Tinglin Huang, Yuxiao Dong, Ming Ding, Zhen Yang, Wenzheng Feng, Xinyu Wang, and Jie Tang. 2021. MixGCF: An improved training method for graph neural network-based recommender systems. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. 665\u2013674."},{"key":"e_1_3_3_23_2","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1145\/3331184.3331269","volume-title":"Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Jagerman Rolf","year":"2019","unstructured":"Rolf Jagerman, Harrie Oosterhuis, and Maarten de Rijke. 2019. To model or to intervene: A comparison of counterfactual and online learning to rank from user interactions. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. 15\u201324."},{"key":"e_1_3_3_24_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Kipf Thomas N.","year":"2017","unstructured":"Thomas N. Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_3_25_2","first-page":"689","volume-title":"Proceedings of the World Wide Web Conference","author":"Liang Dawen","year":"2018","unstructured":"Dawen Liang, Rahul G. Krishnan, Matthew D. Hoffman, and Tony Jebara. 2018. Variational autoencoders for collaborative filtering. In Proceedings of the World Wide Web Conference. 689\u2013698."},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3411884"},{"key":"e_1_3_3_27_2","first-page":"2320","volume-title":"Proceedings of the ACM Web Conference","author":"Lin Zihan","year":"2022","unstructured":"Zihan Lin, Changxin Tian, Yupeng Hou, and Wayne Xin Zhao. 2022. Improving graph collaborative filtering with neighborhood-enriched contrastive learning. In Proceedings of the ACM Web Conference. 2320\u20132329."},{"key":"e_1_3_3_28_2","first-page":"1296","volume-title":"Proceedings of the Web Conference","author":"Liu Fan","year":"2021","unstructured":"Fan Liu, Zhiyong Cheng, Lei Zhu, Zan Gao, and Liqiang Nie. 2021. Interest-aware message-passing GCN for recommendation. In Proceedings of the Web Conference. 1296\u20131305."},{"key":"e_1_3_3_29_2","first-page":"435","volume-title":"Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval","author":"Lu Hongyu","year":"2018","unstructured":"Hongyu Lu, Min Zhang, and Shaoping Ma. 2018. Between clicks and satisfaction: Study on multi-phase user preferences and satisfaction for online news reading. In Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval. 435\u2013444."},{"key":"e_1_3_3_30_2","first-page":"1253","volume-title":"Proceedings of the 30th ACM International Conference on Information & Knowledge Management","author":"Mao Kelong","year":"2021","unstructured":"Kelong Mao, Jieming Zhu, Xi Xiao, Biao Lu, Zhaowei Wang, and Xiuqiang He. 2021. UltraGCN: Ultra simplification of graph convolutional networks for recommendation. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management. 1253\u20131262."},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/2766462.2767755"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.soc.27.1.415"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401098"},{"key":"e_1_3_3_34_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Miyato Takeru","year":"2017","unstructured":"Takeru Miyato, Andrew M. Dai, and Ian Goodfellow. 2017. Adversarial training methods for semi-supervised text classification. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_3_35_2","doi-asserted-by":"crossref","first-page":"494","DOI":"10.1007\/3-540-46146-9_49","volume-title":"Proceedings of the Database and Expert Systems Applications Conference","author":"O\u2019Mahony Michael P.","year":"2002","unstructured":"Michael P. O\u2019Mahony, Neil J. Hurley, and Guenole C. M. Silvestre. 2002. Promoting recommendations: An attack on collaborative filtering. In Proceedings of the Database and Expert Systems Applications Conference. 494\u2013503."},{"key":"e_1_3_3_36_2","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1145\/1639714.1639720","volume-title":"Proceedings of the 3rd ACM Conference on Recommender Systems","author":"Park Seung-Taek","year":"2009","unstructured":"Seung-Taek Park and Wei Chu. 2009. Pairwise preference regression for cold-start recommendation. In Proceedings of the 3rd ACM Conference on Recommender Systems. 21\u201328."},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380112"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/3382764"},{"key":"e_1_3_3_39_2","article-title":"BPR: Bayesian personalized ranking from implicit feedback","author":"Rendle Steffen","year":"2012","unstructured":"Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2012. BPR: Bayesian personalized ranking from implicit feedback. arXiv preprint arXiv:1205.2618 (2012).","journal-title":"arXiv preprint arXiv:1205.2618"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-85820-3_1"},{"key":"e_1_3_3_41_2","article-title":"Adversarial training for free!","volume":"32","author":"Shafahi Ali","year":"2019","unstructured":"Ali Shafahi, Mahyar Najibi, Mohammad Amin Ghiasi, Zheng Xu, John Dickerson, Christoph Studer, Larry S. Davis, Gavin Taylor, and Tom Goldstein. 2019. Adversarial training for free!Adv. Neural Inf. Process. Syst. 32 (2019).","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1155\/2009\/421425"},{"key":"e_1_3_3_43_2","first-page":"593","volume-title":"Proceedings of the Web Conference","author":"Sun Jianing","year":"2021","unstructured":"Jianing Sun, Zhaoyue Cheng, Saba Zuberi, Felipe P\u00e9rez, and Maksims Volkovs. 2021. HGCF: Hyperbolic graph convolution networks for collaborative filtering. In Proceedings of the Web Conference. 593\u2013601."},{"key":"e_1_3_3_44_2","first-page":"arXiv\u20131807","article-title":"Representation learning with contrastive predictive coding","author":"Oord Aaron Van den","year":"2018","unstructured":"Aaron Van den Oord, Yazhe Li, and Oriol Vinyals. 2018. Representation learning with contrastive predictive coding. arXiv e-prints (2018), arXiv\u20131807. http:\/\/arxiv.org\/abs\/1807.03748.","journal-title":"arXiv e-prints"},{"issue":"3","key":"e_1_3_3_45_2","first-page":"4","article-title":"Deep graph infomax.","volume":"2","author":"Velickovic Petar","year":"2019","unstructured":"Petar Velickovic, William Fedus, William L. Hamilton, Pietro Li\u00f2, Yoshua Bengio, and R. Devon Hjelm. 2019. Deep graph infomax.ICLR (Poster) 2, 3 (2019), 4.","journal-title":"ICLR (Poster)"},{"key":"e_1_3_3_46_2","first-page":"82","volume-title":"Proceedings of the SIAM International Conference on Data Mining (SDM\u201921)","author":"Wang Jianling","year":"2021","unstructured":"Jianling Wang, Kaize Ding, Ziwei Zhu, and James Caverlee. 2021. Session-based recommendation with hypergraph attention networks. In Proceedings of the SIAM International Conference on Data Mining (SDM\u201921). SIAM, 82\u201390."},{"key":"e_1_3_3_47_2","first-page":"4644","volume-title":"Proceedings of the 30th International Joint Conference on Artificial Intelligence (IJCAI Survey Track)","author":"Wang Shoujin","year":"2021","unstructured":"Shoujin Wang, Liang Hu, Yan Wang, Xiangnan He, Quan Z. Sheng, Mehmet A. Orgun, Longbing Cao, Francesco Ricci, and Philip S. Yu. 2021. Graph learning based recommender systems: A review. In Proceedings of the 30th International Joint Conference on Artificial Intelligence (IJCAI Survey Track). 4644\u20134652."},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/3437963.3441800"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3462962"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331267"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401137"},{"key":"e_1_3_3_52_2","first-page":"2015","volume-title":"Proceedings of the ACM Web Conference","author":"Wang Yu","year":"2022","unstructured":"Yu Wang, Xin Xin, Zaiqiao Meng, Joemon M. Jose, Fuli Feng, and Xiangnan He. 2022. Learning robust recommenders through cross-model agreement. In Proceedings of the ACM Web Conference. 2015\u20132025."},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3474085.3475446"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3298689.3347037"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3462862"},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/2835776.2835837"},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2020.2978386"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i5.16578"},{"key":"e_1_3_3_59_2","first-page":"2519","volume-title":"Proceedings of the 29th International Conference on International Joint Conferences on Artificial Intelligence","author":"Xie Ruobing","year":"2021","unstructured":"Ruobing Xie, Cheng Ling, Yalong Wang, Rui Wang, Feng Xia, and Leyu Lin. 2021. Deep feedback network for recommendation. In Proceedings of the 29th International Conference on International Joint Conferences on Artificial Intelligence. 2519\u20132525."},{"key":"e_1_3_3_60_2","first-page":"3961","volume-title":"Proceedings of the International Joint Conference on Artificial Intelligence","author":"Xu Kaidi","year":"2019","unstructured":"Kaidi Xu, Hongge Chen, Sijia Liu, Pin-Yu Chen, Tsui-Wei Weng, Mingyi Hong, and Xue Lin. 2019. Topology attack and defense for graph neural networks: An optimization perspective. In Proceedings of the International Joint Conference on Artificial Intelligence. 3961\u20133967."},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3462928"},{"key":"e_1_3_3_62_2","doi-asserted-by":"publisher","DOI":"10.1145\/3447548.3467340"},{"key":"e_1_3_3_63_2","first-page":"413","volume-title":"Proceedings of the Web Conference","author":"Yu Junliang","year":"2021","unstructured":"Junliang Yu, Hongzhi Yin, Jundong Li, Qinyong Wang, Nguyen Quoc Viet Hung, and Xiangliang Zhang. 2021. Self-supervised multi-channel hypergraph convolutional network for social recommendation. In Proceedings of the Web Conference. 413\u2013424."},{"key":"e_1_3_3_64_2","volume-title":"Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Yu Junliang","year":"2022","unstructured":"Junliang Yu, Hongzhi Yin, Xin Xia, Tong Chen, Lizhen Cui, and Nguyen Quoc Viet Hung. 2022. Are graph augmentations necessary? Simple graph contrastive learning for recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval."},{"key":"e_1_3_3_65_2","first-page":"10936","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Yu Wenhui","year":"2020","unstructured":"Wenhui Yu and Zheng Qin. 2020. Graph convolutional network for recommendation with low-pass collaborative filters. In Proceedings of the International Conference on Machine Learning. PMLR, 10936\u201310945."},{"key":"e_1_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401155"},{"key":"e_1_3_3_67_2","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3412095"},{"key":"e_1_3_3_68_2","doi-asserted-by":"publisher","DOI":"10.1145\/3459637.3482016"},{"key":"e_1_3_3_69_2","first-page":"401","volume-title":"Proceedings of the Web Conference","author":"Zheng Yu","year":"2021","unstructured":"Yu Zheng, Chen Gao, Liang Chen, Depeng Jin, and Yong Li. 2021. DGCN: Diversified recommendation with graph convolutional networks. In Proceedings of the Web Conference. 401\u2013412."},{"key":"e_1_3_3_70_2","first-page":"2461","volume-title":"Proceedings of the Conference on Knowledge Discovery and Data Mining","author":"Zou Xu","year":"2021","unstructured":"Xu Zou, Qinkai Zheng, Yuxiao Dong, Xinyu Guan, Evgeny Kharlamov, Jialiang Lu, and Jie Tang. 2021. TDGIA: Effective injection attacks on graph neural networks. In Proceedings of the Conference on Knowledge Discovery and Data Mining. 2461\u20132471."},{"key":"e_1_3_3_71_2","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3220078"},{"key":"e_1_3_3_72_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Z\u00fcgner Daniel","year":"2019","unstructured":"Daniel Z\u00fcgner and Stephan G\u00fcnnemann. 2019. Adversarial attacks on graph neural networks via meta learning. In Proceedings of the International Conference on Learning Representations."}],"container-title":["ACM Transactions on Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3568396","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3568396","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:51:33Z","timestamp":1750182693000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3568396"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,7]]},"references-count":71,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,7,31]]}},"alternative-id":["10.1145\/3568396"],"URL":"https:\/\/doi.org\/10.1145\/3568396","relation":{},"ISSN":["1046-8188","1558-2868"],"issn-type":[{"value":"1046-8188","type":"print"},{"value":"1558-2868","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,7]]},"assertion":[{"value":"2022-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-10-12","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-02-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}