{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T13:27:42Z","timestamp":1781098062425,"version":"3.54.1"},"reference-count":35,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2023,4,7]],"date-time":"2023-04-07T00:00:00Z","timestamp":1680825600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"crossref","award":["2021ZD0111902"],"award-info":[{"award-number":["2021ZD0111902"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62072015, U21B2038, U1811463, and 61906011"],"award-info":[{"award-number":["62072015, U21B2038, U1811463, and 61906011"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Beijing Municipal Science and Technology","award":["KM202010005014"],"award-info":[{"award-number":["KM202010005014"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2023,6,30]]},"abstract":"<jats:p>Graph neural networks (GNNs) have been widely used for graph structure learning and achieved excellent performance in tasks such as node classification and link prediction. Real-world graph networks imply complex and various semantic information and are often referred to as heterogeneous information networks (HINs). Previous GNNs have laboriously modeled heterogeneous graph networks with pairwise relations, in which the semantic information representation for learning is incomplete and severely hinders node embedded learning. Therefore, the conventional graph structure cannot satisfy the demand for information discovery in HINs. In this article, we propose an end-to-end hypergraph transformer neural network (HGTN) that exploits the communication abilities between different types of nodes and hyperedges to learn higher-order relations and discover semantic information. Specifically, attention mechanisms weigh the importance of semantic information hidden in original HINs to generate useful meta-paths. Meanwhile, our method develops a multi-scale attention module to aggregate node embeddings in higher-order neighborhoods. We evaluate the proposed model with node classification tasks on six datasets: DBLP, ACM, IBDM, Reuters, STUD-BJUT, and Citeseer. Experiments on a large number of benchmarks show the advantages of HGTN.<\/jats:p>","DOI":"10.1145\/3565028","type":"journal-article","created":{"date-parts":[[2022,9,27]],"date-time":"2022-09-27T11:22:52Z","timestamp":1664277772000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":30,"title":["Hypergraph Transformer Neural Networks"],"prefix":"10.1145","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7540-530X","authenticated-orcid":false,"given":"Mengran","family":"Li","sequence":"first","affiliation":[{"name":"Beijing Key Laboratory of Multimedia and Intelligent Software Technology, Faculty of Information Technology, Beijing Institute of Artificial Intelligence, Beijing University of Technology"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6650-6790","authenticated-orcid":false,"given":"Yong","family":"Zhang","sequence":"additional","affiliation":[{"name":"Beijing Key Laboratory of Multimedia and Intelligent Software Technology, Faculty of Information Technology, Beijing Institute of Artificial Intelligence, Beijing University of Technology"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8450-625X","authenticated-orcid":false,"given":"Xiaoyong","family":"Li","sequence":"additional","affiliation":[{"name":"Beijing Key Laboratory of Multimedia and Intelligent Software Technology, Faculty of Information Technology, Beijing Institute of Artificial Intelligence, Beijing University of Technology, Chaoyang, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6118-454X","authenticated-orcid":false,"given":"Yuchen","family":"Zhang","sequence":"additional","affiliation":[{"name":"Beijing Key Laboratory of Multimedia and Intelligent Software Technology, Faculty of Information Technology, Beijing Institute of Artificial Intelligence, Beijing University of Technology, Chaoyang, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3121-1823","authenticated-orcid":false,"given":"Baocai","family":"Yin","sequence":"additional","affiliation":[{"name":"Beijing Key Laboratory of Multimedia and Intelligent Software Technology, Faculty of Information Technology, Beijing Institute of Artificial Intelligence, Beijing University of Technology, Chaoyang, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,4,7]]},"reference":[{"key":"e_1_3_2_2_2","first-page":"1400","volume-title":"Proceedings of the International Conference on World Wide Web","author":"Bo Deyu","year":"2020","unstructured":"Deyu Bo, Xiao Wang, Chuan Shi, Meiqi Zhu, Emiao Lu, and Peng Cui. 2020. Structural deep clustering network. In Proceedings of the International Conference on World Wide Web. 1400\u20131410."},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/3336191.3371834"},{"key":"e_1_3_2_4_2","first-page":"135","volume-title":"Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining","author":"Dong Yuxiao","year":"2017","unstructured":"Yuxiao Dong, Nitesh V. Chawla, and Ananthram Swami. 2017. metapath2vec: Scalable representation learning for heterogeneous networks. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 135\u2013144."},{"key":"e_1_3_2_5_2","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/j.eswa.2019.01.044","article-title":"Classification by multi-semantic meta path and active weight learning in heterogeneous information networks","volume":"123","author":"Du Yongping","year":"2019","unstructured":"Yongping Du, Wenyang Guo, Jingxuan Liu, and Changqing Yao. 2019. Classification by multi-semantic meta path and active weight learning in heterogeneous information networks. Expert Systems with Applications 123, C (2019), 227\u2013236.","journal-title":"Expert Systems with Applications"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33013558"},{"key":"e_1_3_2_7_2","first-page":"1797","volume-title":"Proceedings of the ACM on Conference on Information and Knowledge Management","author":"Fu Tao-yang","year":"2017","unstructured":"Tao-yang Fu, Wang-Chien Lee, and Zhen Lei. 2017. Hin2vec: Explore meta-paths in heterogeneous information networks for representation learning. In Proceedings of the ACM on Conference on Information and Knowledge Management. 1797\u20131806."},{"key":"e_1_3_2_8_2","article-title":"Hypergraph learning: Methods and practices","author":"Gao Yue","year":"2020","unstructured":"Yue Gao, Zizhao Zhang, Haojie Lin, Xibin Zhao, Shaoyi Du, and Changqing Zou. 2020. Hypergraph learning: Methods and practices. IEEE Transactions on Pattern Analysis and Machine Intelligence 44, 5 (2020), 2548\u20132566.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"e_1_3_2_9_2","first-page":"4132","volume-title":"Proceedings of the Association for the Advance of Artificial Intelligence","volume":"34","author":"Hong Huiting","year":"2020","unstructured":"Huiting Hong, Hantao Guo, Yucheng Lin, Xiaoqing Yang, Zang Li, and Jieping Ye. 2020. An attention-based graph neural network for heterogeneous structural learning. In Proceedings of the Association for the Advance of Artificial Intelligence, Vol. 34. 4132\u20134139."},{"key":"e_1_3_2_10_2","first-page":"2704","volume-title":"Proceedings of the International Conference on World Wide Web","author":"Hu Ziniu","year":"2020","unstructured":"Ziniu Hu, Yuxiao Dong, Kuansan Wang, and Yizhou Sun. 2020. Heterogeneous graph transformer. In Proceedings of the International Conference on World Wide Web. 2704\u20132710."},{"key":"e_1_3_2_11_2","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/978-3-030-18590-9_27","volume-title":"Proceedings of the International Conference on Database Systems for Advanced Applications","author":"Huang Jie","year":"2019","unstructured":"Jie Huang, Chuan Chen, Fanghua Ye, Jiajing Wu, Zibin Zheng, and Guohui Ling. 2019. Hyper2vec: Biased random walk for hyper-network embedding. In Proceedings of the International Conference on Database Systems for Advanced Applications. 273\u2013277."},{"key":"e_1_3_2_12_2","first-page":"449","volume-title":"Proceedings of the ACM International Conference on Information and Knowledge Management","author":"Huang Jie","year":"2019","unstructured":"Jie Huang, Xin Liu, and Yangqiu Song. 2019. Hyper-path-based representation learning for hyper-networks. In Proceedings of the ACM International Conference on Information and Knowledge Management. 449\u2013458."},{"key":"e_1_3_2_13_2","first-page":"2635","volume-title":"Proceedings of the International Joint Conference on Artificial Intelligence","author":"Jiang Jianwen","year":"2019","unstructured":"Jianwen Jiang, Yuxuan Wei, Yifan Feng, Jingxuan Cao, and Yue Gao. 2019. Dynamic hypergraph neural networks. In Proceedings of the International Joint Conference on Artificial Intelligence. 2635\u20132641."},{"key":"e_1_3_2_14_2","unstructured":"Thomas N. Kipf and Max Welling. 2016. Semi-Supervised Classification with Graph Convolutional Networks. arXiv:1609.02907. Retrieved from https:\/\/arxiv.org\/abs\/1609.02907."},{"key":"e_1_3_2_15_2","first-page":"2703","volume-title":"Proceedings of the ACM International Conference on Information and Knowledge Management","author":"Li Ao","year":"2019","unstructured":"Ao Li, Zhou Qin, Runshi Liu, Yiqun Yang, and Dong Li. 2019. Spam review detection with graph convolutional networks. In Proceedings of the ACM International Conference on Information and Knowledge Management. 2703\u20132711."},{"key":"e_1_3_2_16_2","unstructured":"Renjie Liao Marc Brockschmidt Daniel Tarlow Alexander L. Gaunt Raquel Urtasun and Richard S. Zemel. 2018. Graph partition neural networks for semi-supervised classification. (2018)."},{"key":"e_1_3_2_17_2","unstructured":"Tomas Mikolov Kai Chen Greg Corrado and Jeffrey Dean. 2013. Efficient Estimation of Word Representations in Vector Space. arXiv:1301.3781. Retrieved from https:\/\/arxiv.org\/abs\/1301.3781."},{"key":"e_1_3_2_18_2","doi-asserted-by":"crossref","first-page":"701","DOI":"10.1145\/2623330.2623732","volume-title":"Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining","author":"Perozzi Bryan","year":"2014","unstructured":"Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. Deepwalk: Online learning of social representations. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 701\u2013710."},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2022.3142771"},{"key":"e_1_3_2_20_2","article-title":"Spatiotemporal co-attention recurrent neural networks for human-skeleton motion prediction","author":"Shu Xiangbo","year":"2021","unstructured":"Xiangbo Shu, Liyan Zhang, Guo-Jun Qi, Wei Liu, and Jinhui Tang. 2021. Spatiotemporal co-attention recurrent neural networks for human-skeleton motion prediction. IEEE Transactions on Pattern Analysis and Machine Intelligence 44, 6 (2021), 3300\u20133315.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"e_1_3_2_21_2","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1145\/2809695.2809718","volume-title":"Proceedings of the ACM Conference on Embedded Networked Sensor Systems","author":"Stisen Allan","year":"2015","unstructured":"Allan Stisen, Henrik Blunck, Sourav Bhattacharya, Thor Siiger Prentow, Mikkel Baun Kj\u00e6rgaard, Anind Dey, Tobias Sonne, and Mads M\u00f8ller Jensen. 2015. Smart devices are different: Assessing and mitigatingmobile sensing heterogeneities for activity recognition. In Proceedings of the ACM Conference on Embedded Networked Sensor Systems. 127\u2013140."},{"key":"e_1_3_2_22_2","first-page":"725","volume-title":"Proceedings of the ACM International Conference on Web Search and Data Mining","author":"Sun Xiangguo","year":"2021","unstructured":"Xiangguo Sun, Hongzhi Yin, Bo Liu, Hongxu Chen, Jiuxin Cao, Yingxia Shao, and Nguyen Quoc Viet Hung. 2021. Heterogeneous hypergraph embedding for graph classification. In Proceedings of the ACM International Conference on Web Search and Data Mining. 725\u2013733."},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.14778\/3402707.3402736"},{"key":"e_1_3_2_24_2","first-page":"1067","volume-title":"Proceedings of the International Conference on World Wide Web","author":"Tang Jian","year":"2015","unstructured":"Jian Tang, Meng Qu, Mingzhe Wang, Ming Zhang, Jun Yan, and Qiaozhu Mei. 2015. Line: Large-scale information network embedding. In Proceedings of the International Conference on World Wide Web. 1067\u20131077."},{"key":"e_1_3_2_25_2","unstructured":"Petar Veli\u010dkovi\u0107 Guillem Cucurull Arantxa Casanova Adriana Romero Pietro Lio and Yoshua Bengio. 2017. Graph Attention Networks. arXiv:1710.10903. Retrieved from https:\/\/arxiv.org\/abs\/1710.10903."},{"key":"e_1_3_2_26_2","doi-asserted-by":"crossref","first-page":"968","DOI":"10.1145\/3292500.3330836","volume-title":"Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery & Data Mining","author":"Wang Hongwei","year":"2019","unstructured":"Hongwei Wang, Fuzheng Zhang, Mengdi Zhang, Jure Leskovec, Miao Zhao, Wenjie Li, and Zhongyuan Wang. 2019. Knowledge-aware graph neural networks with label smoothness regularization for recommender systems. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 968\u2013977."},{"key":"e_1_3_2_27_2","first-page":"2022","volume-title":"Proceedings of the International Conference on World Wide Web","author":"Wang Xiao","year":"2019","unstructured":"Xiao Wang, Houye Ji, Chuan Shi, Bai Wang, Yanfang Ye, Peng Cui, and Philip S. Yu. 2019. Heterogeneous graph attention network. In Proceedings of the International Conference on World Wide Web. 2022\u20132032."},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2020.2978386"},{"issue":"1","key":"e_1_3_2_29_2","first-page":"1","article-title":"Graph neural networks in node classification: Survey and evaluation","volume":"33","author":"Xiao Shunxin","year":"2022","unstructured":"Shunxin Xiao, Shiping Wang, Yuanfei Dai, and Wenzhong Guo. 2022. Graph neural networks in node classification: Survey and evaluation. Machine Vision and Applications 33, 1 (2022), 1\u201319.","journal-title":"Machine Vision and Applications"},{"key":"e_1_3_2_30_2","first-page":"1511","volume-title":"Proceedings of the International Conference on Neural Information Processing Systems","author":"Yadati Naganand","year":"2019","unstructured":"Naganand Yadati, Madhav Nimishakavi, Prateek Yadav, Vikram Nitin, Anand Louis, and Partha Talukdar. 2019. HyperGCN: A new method of training graph convolutional networks on hypergraphs. In Proceedings of the International Conference on Neural Information Processing Systems. 1511\u20131522."},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2020.2997869"},{"key":"e_1_3_2_32_2","first-page":"974","volume-title":"Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery & Data Mining","author":"Ying Rex","year":"2018","unstructured":"Rex Ying, Ruining He, Kaifeng Chen, Pong Eksombatchai, William L. Hamilton, and Jure Leskovec. 2018. Graph convolutional neural networks for web-scale recommender systems. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 974\u2013983."},{"key":"e_1_3_2_33_2","first-page":"11983","article-title":"Graph transformer networks","volume":"32","author":"Yun Seongjun","year":"2019","unstructured":"Seongjun Yun, Minbyul Jeong, Raehyun Kim, Jaewoo Kang, and Hyunwoo J. Kim. 2019. Graph transformer networks. In Proceedings of the International Conference on Neural Information Processing Systems, Vol. 32. 11983\u201311993.","journal-title":"Proceedings of the International Conference on Neural Information Processing Systems"},{"key":"e_1_3_2_34_2","article-title":"Personalized graph neural networks with attention mechanism for session-aware recommendation","author":"Zhang Mengqi","year":"2020","unstructured":"Mengqi Zhang, Shu Wu, Meng Gao, Xin Jiang, Ke Xu, and Liang Wang. 2020. Personalized graph neural networks with attention mechanism for session-aware recommendation. IEEE Transactions on Knowledge and Data Engineering 34, 8 (2020), 3946\u20133957.","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"e_1_3_2_35_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Zhang R.","year":"2020","unstructured":"R. Zhang, Y. Zou, and J. Ma. 2020. Hyper-SAGNN: A self-attention based graph neural network for hypergraphs. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.aiopen.2021.01.001"}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3565028","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3565028","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:02:52Z","timestamp":1750186972000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3565028"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,7]]},"references-count":35,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2023,6,30]]}},"alternative-id":["10.1145\/3565028"],"URL":"https:\/\/doi.org\/10.1145\/3565028","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"value":"1556-4681","type":"print"},{"value":"1556-472X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,7]]},"assertion":[{"value":"2021-12-15","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-09-21","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-04-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}