{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,7]],"date-time":"2026-02-07T19:32:29Z","timestamp":1770492749875,"version":"3.49.0"},"reference-count":58,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2023,9,11]],"date-time":"2023-09-11T00:00:00Z","timestamp":1694390400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001321","name":"National Research Foundation","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100001321","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Monetary Authority of Singapore Postgraduate Scholarship"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2023,9,30]]},"abstract":"<jats:p>User interfaces (UI) of desktop, web, and mobile applications involve a hierarchy of objects (e.g., applications, screens, view class, and other types of design objects) with multimodal (e.g., textual and visual) and positional (e.g., spatial location, sequence order, and hierarchy level) attributes. We can therefore represent a set of application UIs as a heterogeneous network with multimodal and positional attributes. Such a network not only represents how users understand the visual layout of UIs but also influences how users would interact with applications through these UIs. To model the UI semantics well for different UI annotation, search, and evaluation tasks, this article proposes the novel Heterogeneous Attention-based Multimodal Positional (HAMP) graph neural network model. HAMP combines graph neural networks with the scaled dot-product attention used in transformers to learn the embeddings of heterogeneous nodes and associated multimodal and positional attributes in a unified manner. HAMP is evaluated with classification and regression tasks conducted on three distinct real-world datasets. Our experiments demonstrate that HAMP significantly out-performs other state-of-the-art models on such tasks. To further provide interpretations of the contribution of heterogeneous network information for understanding the relationships between the UI structure and prediction tasks, we propose Adaptive HAMP (AHAMP), which adaptively learns the importance of different edges linking different UI objects. Our experiments demonstrate AHAMP\u2019s superior performance over HAMP on a number of tasks, and its ability to provide interpretations of the contribution of multimodal and positional attributes, as well as heterogeneous network information to different tasks.<\/jats:p>","DOI":"10.1145\/3578522","type":"journal-article","created":{"date-parts":[[2022,12,23]],"date-time":"2022-12-23T13:07:57Z","timestamp":1671800877000},"page":"1-31","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Learning and Understanding User Interface Semantics from Heterogeneous Networks with Multimodal and Positional Attributes"],"prefix":"10.1145","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5922-8956","authenticated-orcid":false,"given":"Gary","family":"Ang","sequence":"first","affiliation":[{"name":"Singapore Management University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0065-8665","authenticated-orcid":false,"given":"Ee-Peng","family":"Lim","sequence":"additional","affiliation":[{"name":"Singapore Management University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,9,11]]},"reference":[{"key":"e_1_3_2_2_2","volume-title":"Proceedings of the 35th Conference on Uncertainty in Artificial Intelligence","author":"Abu-El-Haija Sami","year":"2019","unstructured":"Sami Abu-El-Haija, Amol Kapoor, Bryan Perozzi, and Joonseok Lee. 2019. N-GCN: Multi-scale graph convolution for semi-supervised node classification. In Proceedings of the 35th Conference on Uncertainty in Artificial Intelligence."},{"key":"e_1_3_2_3_2","volume-title":"Proceedings of the ACM International Conference on Intelligent User Interfaces","author":"Ang Gary","year":"2021","unstructured":"Gary Ang and Ee-Peng Lim. 2021. Learning network-based multi-modal mobile user interface embeddings. In Proceedings of the ACM International Conference on Intelligent User Interfaces."},{"key":"e_1_3_2_4_2","article-title":"Relational inductive biases, deep learning, and graph networks","author":"Battaglia Peter W.","year":"2018","unstructured":"Peter W. Battaglia, Jessica B. Hamrick, Victor Bapst, Alvaro Sanchez-Gonzalez, Vin\u00edcius Flores Zambaldi, Mateusz Malinowski, Andrea Tacchetti, David Raposo, Adam Santoro, Ryan Faulkner, \u00c7aglar G\u00fcl\u00e7ehre, H. Francis Song, Andrew J. Ballard, Justin Gilmer, George E. Dahl, Ashish Vaswani, Kelsey R. Allen, Charles Nash, Victoria Langston, Chris Dyer, Nicolas Heess, Daan Wierstra, Pushmeet Kohli, Matthew Botvinick, Oriol Vinyals, Yujia Li, and Razvan Pascanu. 2018. Relational inductive biases, deep learning, and graph networks. Computing Research Repository (CoRR) abs\/1806.01261 (2018).","journal-title":"Computing Research Repository (CoRR)"},{"key":"e_1_3_2_5_2","doi-asserted-by":"crossref","DOI":"10.1145\/3411764.3445762","article-title":"VINS: Visual search for mobile user interface design","author":"Bunian Sara","year":"2021","unstructured":"Sara Bunian, Kai Li, Chaima Jemmali, Casper Harteveld, Yun Fu, and Magy Seif El-Nasr. 2021. VINS: Visual search for mobile user interface design. ACM Conference on Human Factors in Computing Systems (CHI'21). 423:1--423:14.","journal-title":"ACM Conference on Human Factors in Computing Systems (CHI'21)"},{"key":"e_1_3_2_6_2","volume-title":"Proceedings of the ACM International Conference on Knowledge Discovery and Data Mining","author":"Cen Yukuo","year":"2019","unstructured":"Yukuo Cen, Xu Zou, Jianwei Zhang, Hongxia Yang, Jingren Zhou, and Jie Tang. 2019. Representation learning for attributed multiplex heterogeneous network. In Proceedings of the ACM International Conference on Knowledge Discovery and Data Mining."},{"key":"e_1_3_2_7_2","article-title":"Gallery D.C.: Design search and knowledge discovery through auto-created GUI component gallery","author":"Chen Chunyang","year":"2019","unstructured":"Chunyang Chen, Sidong Feng, Zhenchang Xing, Linda Liu, Shengdong Zhao, and Jinshui Wang. 2019. Gallery D.C.: Design search and knowledge discovery through auto-created GUI component gallery. Proc. ACM Hum. Comput. Interact. 3, CSCW (2019), 180:1--180:22.","journal-title":"Proc. ACM Hum. Comput. Interact."},{"key":"e_1_3_2_8_2","volume-title":"Proceedings of the ACM International Conference on Intelligent User Interfaces","author":"Chen Chun-Fu (Richard)","year":"2017","unstructured":"Chun-Fu (Richard) Chen, Marco Pistoia, Conglei Shi, Paolo Girolami, Joseph W. Ligman, and Yong Wang. 2017. UI X-ray: Interactive mobile UI testing based on computer vision. In Proceedings of the ACM International Conference on Intelligent User Interfaces."},{"key":"e_1_3_2_9_2","volume-title":"Proceedings of the ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering","author":"Chen Jieshan","year":"2020","unstructured":"Jieshan Chen, Mulong Xie, Zhenchang Xing, Chunyang Chen, Xiwei Xu, Liming Zhu, and Guoqiang Li. 2020. Object detection for graphical user interface: Old fashioned or deep learning or a combination?. In Proceedings of the ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering."},{"key":"e_1_3_2_10_2","volume-title":"Proceedings of the ACM Symposium on User Interface Software and Technology","author":"Deka Biplab","year":"2017","unstructured":"Biplab Deka, Zifeng Huang, Chad Franzen, Joshua Hibschman, Daniel Afergan, Yang Li, Jeffrey Nichols, and Ranjitha Kumar. 2017. Rico: A mobile app dataset for building data-driven design applications. In Proceedings of the ACM Symposium on User Interface Software and Technology."},{"key":"e_1_3_2_11_2","volume-title":"Proceedings of the ACM International Conference on Knowledge Discovery and Data Mining","author":"Dong Yuxiao","year":"2017","unstructured":"Yuxiao Dong, Nitesh V. Chawla, and Ananthram Swami. 2017. metapath2vec: Scalable representation learning for heterogeneous networks. In Proceedings of the ACM International Conference on Knowledge Discovery and Data Mining."},{"key":"e_1_3_2_12_2","article-title":"A generalization of transformer networks to graphs","author":"Dwivedi Vijay Prakash","year":"2021","unstructured":"Vijay Prakash Dwivedi and Xavier Bresson. 2021. A generalization of transformer networks to graphs. Computing Research Repository (CoRR) abs\/2012.09699 (2020).","journal-title":"Computing Research Repository (CoRR)"},{"key":"e_1_3_2_13_2","volume-title":"Proceedings of the ACM International Conference on Knowledge Discovery and Data Mining","author":"Gao Hongyang","year":"2019","unstructured":"Hongyang Gao and Shuiwang Ji. 2019. Graph representation learning via hard and channel-wise attention networks. In Proceedings of the ACM International Conference on Knowledge Discovery and Data Mining."},{"key":"e_1_3_2_14_2","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Gilmer Justin","year":"2017","unstructured":"Justin Gilmer, Samuel S. Schoenholz, Patrick F. Riley, Oriol Vinyals, and George E. Dahl. 2017. Neural message passing for quantum chemistry. In Proceedings of the International Conference on Machine Learning."},{"issue":"7","key":"e_1_3_2_15_2","first-page":"2973","article-title":"Neural decomposition of time-series data for effective generalization","volume":"29","author":"Godfrey Luke B.","year":"2018","unstructured":"Luke B. Godfrey and Michael S. Gashler. 2018. Neural decomposition of time-series data for effective generalization. IEEE Transactions on Neural Networks and Learning Systems 29, 7 (2018), 2973\u20132985.","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"key":"e_1_3_2_16_2","article-title":"DynGEM: Deep embedding method for dynamic graphs","author":"Goyal Palash","year":"2018","unstructured":"Palash Goyal, Nitin Kamra, Xinran He, and Yan Liu. 2018. DynGEM: Deep embedding method for dynamic graphs. Computing Research Repository (CoRR) abs\/1805.11273 (2018).","journal-title":"Computing Research Repository (CoRR)"},{"key":"e_1_3_2_17_2","volume-title":"Proceedings of the ACM International Conference on Intelligent User Interfaces","author":"Greenstein-Messica Asnat","year":"2017","unstructured":"Asnat Greenstein-Messica, Lior Rokach, and Michael Friedman. 2017. Session-based recommendations using item embedding. In Proceedings of the ACM International Conference on Intelligent User Interfaces."},{"key":"e_1_3_2_18_2","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems","author":"Hajiramezanali Ehsan","year":"2019","unstructured":"Ehsan Hajiramezanali, Arman Hasanzadeh, Krishna R. Narayanan, Nick Duffield, Mingyuan Zhou, and Xiaoning Qian. 2019. Variational graph recurrent neural networks. In Proceedings of the Annual Conference on Neural Information Processing Systems."},{"key":"e_1_3_2_19_2","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems","author":"Hamilton William L.","year":"2017","unstructured":"William L. Hamilton, Zhitao Ying, and Jure Leskovec. 2017. Inductive representation learning on large graphs. In Proceedings of the Annual Conference on Neural Information Processing Systems."},{"key":"e_1_3_2_20_2","volume-title":"Proceedings of the ACM Conference on Research and Development in Information Retrieval","author":"He Xiangnan","year":"2020","unstructured":"Xiangnan He, Kuan Deng, Xiang Wang, Yan Li, YongDong Zhang, and Meng Wang. 2020. LightGCN: Simplifying and powering graph convolution network for recommendation. In Proceedings of the ACM Conference on Research and Development in Information Retrieval."},{"key":"e_1_3_2_21_2","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"He Zecheng","year":"2021","unstructured":"Zecheng He, Srinivas Sunkara, Xiaoxue Zang, Ying Xu, Lijuan Liu, Nevan Wichers, Gabriel Schubiner, Ruby B. Lee, and Jindong Chen. 2021. ActionBert: Leveraging user actions for semantic understanding of user interfaces. In Proceedings of the AAAI Conference on Artificial Intelligence."},{"key":"e_1_3_2_22_2","article-title":"How to represent part-whole hierarchies in a neural network","author":"Hinton Geoffrey E.","year":"2021","unstructured":"Geoffrey E. Hinton. 2021. How to represent part-whole hierarchies in a neural network. Computing Research Repository (CoRR) abs\/2102.12627 (2021).","journal-title":"Computing Research Repository (CoRR)"},{"key":"e_1_3_2_23_2","volume-title":"Proceedings of the World Wide Web Conference","author":"Hu Ziniu","year":"2020","unstructured":"Ziniu Hu, Yuxiao Dong, Kuansan Wang, and Yizhou Sun. 2020. Heterogeneous graph transformer. In Proceedings of the World Wide Web Conference."},{"key":"e_1_3_2_24_2","volume-title":"Proceedings of the ACM Conference on Human Factors in Computing Systems","author":"Huang Forrest","year":"2019","unstructured":"Forrest Huang, John F. Canny, and Jeffrey Nichols. 2019. Swire: Sketch-based user interface retrieval. In Proceedings of the ACM Conference on Human Factors in Computing Systems."},{"key":"e_1_3_2_25_2","volume-title":"Proceedings of the ACM Conference on Research and Development in Information Retrieval","author":"Huang Wentao","year":"2020","unstructured":"Wentao Huang, Yuchen Li, Yuan Fang, Ju Fan, and Hongxia Yang. 2020. BiANE: Bipartite attributed network embedding. In Proceedings of the ACM Conference on Research and Development in Information Retrieval."},{"key":"e_1_3_2_26_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Kingma Diederik P.","year":"2014","unstructured":"Diederik P. Kingma and Max Welling. 2014. Auto-encoding variational bayes. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_2_27_2","volume-title":"Proceedings of the NIPS Workshop on Bayesian Deep Learning","author":"Kipf Thomas N.","year":"2016","unstructured":"Thomas N. Kipf and Max Welling. 2016. Variational graph auto-encoders. In Proceedings of the NIPS Workshop on Bayesian Deep Learning."},{"key":"e_1_3_2_28_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Kipf Thomas N.","year":"2017","unstructured":"Thomas N. Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_2_29_2","volume-title":"Proceedings of the ACM Conference on Human Factors in Computing Systems","author":"Lee Chunggi","year":"2020","unstructured":"Chunggi Lee, Sanghoon Kim, Dongyun Han, Hongjun Yang, Young-Woo Park, Bum Chul Kwon, and Sungahn Ko. 2020. GUIComp: A GUI design assistant with real-time, multi-faceted feedback. In Proceedings of the ACM Conference on Human Factors in Computing Systems."},{"key":"e_1_3_2_30_2","volume-title":"Proceedings of the International Conference on Human-Computer Interaction with Mobile Devices and Services","author":"Leiva Luis A.","year":"2020","unstructured":"Luis A. Leiva, Asutosh Hota, and Antti Oulasvirta. 2020. Enrico: A dataset for topic modeling of mobile UI designs. In Proceedings of the International Conference on Human-Computer Interaction with Mobile Devices and Services."},{"key":"e_1_3_2_31_2","volume-title":"Proceedings of the ACM Conference on Human Factors in Computing Systems","author":"Li Toby Jia-Jun","year":"2021","unstructured":"Toby Jia-Jun Li, Lindsay Popowski, Tom M. Mitchell, and Brad A. Myers. 2021. Screen2Vec: Semantic embedding of GUI screens and GUI components. In Proceedings of the ACM Conference on Human Factors in Computing Systems."},{"key":"e_1_3_2_32_2","article-title":"A survey of explainable graph neural networks: Taxonomy and evaluation metrics","author":"Li Yiqiao","year":"2022","unstructured":"Yiqiao Li, Jianlong Zhou, Sunny Verma, and Fang Chen. 2022. A survey of explainable graph neural networks: Taxonomy and evaluation metrics. Computing Research Repository (CoRR) abs\/2207.12599 (2022).","journal-title":"Computing Research Repository (CoRR)"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3186150"},{"key":"e_1_3_2_34_2","article-title":"K-core based temporal graph convolutional network for dynamic graphsz","author":"Liu J.","year":"2022","unstructured":"J. Liu, C. Xu, C. Yin, W. Wu, and Y. Song. 2022. K-core based temporal graph convolutional network for dynamic graphsz. IEEE Trans. Knowl. Data Eng. 34, 8 (2022), 3841--3853.","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"e_1_3_2_35_2","volume-title":"Proceedings of the ACM Symposium on User Interface Software and Technology","author":"Liu Thomas F.","year":"2018","unstructured":"Thomas F. Liu, Mark Craft, Jason Situ, Ersin Yumer, Radomir Mech, and Ranjitha Kumar. 2018. Learning design semantics for mobile apps. In Proceedings of the ACM Symposium on User Interface Software and Technology. Berlin, Germany."},{"key":"e_1_3_2_36_2","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems","author":"Luo Dongsheng","year":"2020","unstructured":"Dongsheng Luo, Wei Cheng, Dongkuan Xu, Wenchao Yu, Bo Zong, Haifeng Chen, and Xiang Zhang. 2020. Parameterized explainer for graph neural network. In Proceedings of the Annual Conference on Neural Information Processing Systems."},{"key":"e_1_3_2_37_2","volume-title":"Proceedings of the ACM International Conference on Web Search and Data Mining","author":"Meng Zaiqiao","year":"2019","unstructured":"Zaiqiao Meng, Shangsong Liang, Hongyan Bao, and Xiangliang Zhang. 2019. Co-embedding attributed networks. In Proceedings of the ACM International Conference on Web Search and Data Mining."},{"key":"e_1_3_2_38_2","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems","author":"Meng Zaiqiao","year":"2019","unstructured":"Zaiqiao Meng, Shangsong Liang, Jinyuan Fang, and Teng Xiao. 2019. Semi-supervisedly co-embedding attributed networks. In Proceedings of the Annual Conference on Neural Information Processing Systems."},{"key":"e_1_3_2_39_2","article-title":"DesignScape: Design with interactive layout suggestions","author":"O\u2019Donovan Peter","year":"2015","unstructured":"Peter O\u2019Donovan, A. Agarwala, and Aaron Hertzmann. 2015. DesignScape: Design with interactive layout suggestions. In Proceedings of the ACM Conference on Human Factors in Computing Systems.","journal-title":"In Proceedings of the ACM Conference on Human Factors in Computing Systems"},{"key":"e_1_3_2_40_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Oreshkin Boris N.","year":"2020","unstructured":"Boris N. Oreshkin, Dmitri Carpov, Nicolas Chapados, and Yoshua Bengio. 2020. N-BEATS: Neural basis expansion analysis for interpretable time series forecasting. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i04.5984"},{"key":"e_1_3_2_42_2","article-title":"StyleMeUp: Towards style-agnostic sketch-based image retrieval","author":"Sain Aneeshan","year":"2021","unstructured":"Aneeshan Sain, Ayan Kumar Bhunia, Yongxin Yang, Tao Xiang, and Yi-Zhe Song. 2021. StyleMeUp: Towards style-agnostic sketch-based image retrieval. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition.","journal-title":"In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition"},{"key":"e_1_3_2_43_2","volume-title":"Proceedings of the International Semantic Web Conference","author":"Schlichtkrull Michael Sejr","year":"2018","unstructured":"Michael Sejr Schlichtkrull, Thomas N. Kipf, Peter Bloem, Rianne van den Berg, Ivan Titov, and Max Welling. 2018. Modeling relational data with graph convolutional networks. In Proceedings of the International Semantic Web Conference."},{"key":"e_1_3_2_44_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Shang Chao","year":"2021","unstructured":"Chao Shang, Jie Chen, and Jinbo Bi. 2021. Discrete graph structure learning for forecasting multiple time series. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_2_45_2","article-title":"Graph convolutional matrix completion","author":"Berg Rianne van den","year":"2017","unstructured":"Rianne van den Berg, Thomas N. Kipf, and Max Welling. 2017. Graph convolutional matrix completion. Computing Research Repository (CoRR) abs\/1706.02263 (2017).","journal-title":"Computing Research Repository (CoRR)"},{"key":"e_1_3_2_46_2","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Proceedings of the Annual Conference on Neural Information Processing Systems."},{"key":"e_1_3_2_47_2","article-title":"Graph attention networks","author":"Veli\u010dkovi\u0107 Petar","year":"2018","unstructured":"Petar Veli\u010dkovi\u0107, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Li\u00f2, and Yoshua Bengio. 2018. Graph attention networks. In Proceedings of the International Conference on Learning Representations.","journal-title":"In Proceedings of the International Conference on Learning Representations"},{"key":"e_1_3_2_48_2","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems","author":"Vu Minh N.","year":"2020","unstructured":"Minh N. Vu and My T. Thai. 2020. PGM-explainer: Probabilistic graphical model explanations for graph neural networks. In Proceedings of the Annual Conference on Neural Information Processing Systems."},{"key":"e_1_3_2_49_2","volume-title":"Proceedings of the ACM Conference on Research and Development in Information Retrieval","author":"Wang Xiang","year":"2019","unstructured":"Xiang Wang, Xiangnan He, Meng Wang, Fuli Feng, and Tat-Seng Chua. 2019. Neural graph collaborative filtering. In Proceedings of the ACM Conference on Research and Development in Information Retrieval."},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313562"},{"key":"e_1_3_2_51_2","volume-title":"Proceedings of the ACM SIGSOFT International Symposium on Software Testing and Analysis","author":"White Thomas D.","year":"2019","unstructured":"Thomas D. White, Gordon Fraser, and Guy J. Brown. 2019. Improving random GUI testing with image-based widget detection. In Proceedings of the ACM SIGSOFT International Symposium on Software Testing and Analysis."},{"key":"e_1_3_2_52_2","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Wu Felix","year":"2019","unstructured":"Felix Wu, Amauri H. Souza Jr., Tianyi Zhang, Christopher Fifty, Tao Yu, and Kilian Q. Weinberger. 2019. Simplifying graph convolutional networks. In Proceedings of the International Conference on Machine Learning."},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2951637"},{"key":"e_1_3_2_54_2","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Xu Keyulu","year":"2018","unstructured":"Keyulu Xu, Chengtao Li, Yonglong Tian, Tomohiro Sonobe, Ken-ichi Kawarabayashi, and Stefanie Jegelka. 2018. Representation learning on graphs with jumping knowledge networks. In Proceedings of the International Conference on Machine Learning."},{"key":"e_1_3_2_55_2","volume-title":"Proceedings of the Annual Meeting of the Association for Computational Linguistics","author":"Yao Shaowei","year":"2020","unstructured":"Shaowei Yao, Tianming Wang, and Xiaojun Wan. 2020. Heterogeneous graph transformer for graph-to-sequence learning. In Proceedings of the Annual Meeting of the Association for Computational Linguistics."},{"key":"e_1_3_2_56_2","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems","author":"Ying Zhitao","year":"2019","unstructured":"Zhitao Ying, Dylan Bourgeois, Jiaxuan You, Marinka Zitnik, and Jure Leskovec. 2019. GNNExplainer: Generating explanations for graph neural networks. In Proceedings of the Annual Conference on Neural Information Processing Systems."},{"key":"e_1_3_2_57_2","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems","author":"Ying Zhitao","year":"2018","unstructured":"Zhitao Ying, Jiaxuan You, Christopher Morris, Xiang Ren, William L. Hamilton, and Jure Leskovec. 2018. Hierarchical graph representation learning with differentiable pooling. In Proceedings of the Annual Conference on Neural Information Processing Systems."},{"key":"e_1_3_2_58_2","article-title":"Explainability in graph neural networks: A taxonomic survey","author":"Yuan Hao","year":"2020","unstructured":"Hao Yuan, Haiyang Yu, Shurui Gui, and Shuiwang Ji. 2020. Explainability in graph neural networks: A taxonomic survey. Computing Research Repository (CoRR) abs\/2012.15445 (2020).","journal-title":"Computing Research Repository (CoRR)"},{"key":"e_1_3_2_59_2","volume-title":"Proceedings of the ACM Conference on Human Factors in Computing Systems","author":"Zhang Xiaoyi","year":"2021","unstructured":"Xiaoyi Zhang, Lilian de Greef, Amanda Swearngin, Samuel White, Kyle I. Murray, Lisa Yu, Qi Shan, Jeffrey Nichols, Jason Wu, Chris Fleizach, Aaron Everitt, and Jeffrey P. Bigham. 2021. Screen recognition: Creating accessibility metadata for mobile applications from pixels. In Proceedings of the ACM Conference on Human Factors in Computing Systems."}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3578522","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3578522","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:08:37Z","timestamp":1750183717000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3578522"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,11]]},"references-count":58,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,9,30]]}},"alternative-id":["10.1145\/3578522"],"URL":"https:\/\/doi.org\/10.1145\/3578522","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"value":"2160-6455","type":"print"},{"value":"2160-6463","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,11]]},"assertion":[{"value":"2022-06-19","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-11-20","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-09-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}