{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,23]],"date-time":"2026-07-23T08:10:49Z","timestamp":1784794249686,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":61,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,8,14]],"date-time":"2022-08-14T00:00:00Z","timestamp":1660435200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61836013"],"award-info":[{"award-number":["61836013"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Science Foundation for Distinguished Young Scholars","award":["61825602"],"award-info":[{"award-number":["61825602"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,8,14]]},"DOI":"10.1145\/3534678.3539321","type":"proceedings-article","created":{"date-parts":[[2022,8,12]],"date-time":"2022-08-12T19:06:12Z","timestamp":1660331172000},"page":"594-604","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":537,"title":["GraphMAE: Self-Supervised Masked Graph Autoencoders"],"prefix":"10.1145","author":[{"given":"Zhenyu","family":"Hou","sequence":"first","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiao","family":"Liu","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yukuo","family":"Cen","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuxiao","family":"Dong","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongxia","family":"Yang","sequence":"additional","affiliation":[{"name":"DAMO Academy, Alibaba Group, Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chunjie","family":"Wang","sequence":"additional","affiliation":[{"name":"BirenTech Research, Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jie","family":"Tang","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,8,14]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Hangbo Bao Li Dong and Furu Wei. 2021. BEiT: BERT Pre-Training of Image Transformers. In NeurIPS."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1961189.1961199"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"crossref","unstructured":"Ganqu Cui Jie Zhou Cheng Yang and Zhiyuan Liu. 2020. Adaptive graph encoder for attributed graph embedding. In SIGKDD.","DOI":"10.1145\/3394486.3403140"},{"key":"e_1_3_2_1_4_1","volume-title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In NAACL. 4171--4186.","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In NAACL. 4171--4186."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1009778005914"},{"key":"e_1_3_2_1_6_1","unstructured":"Alberto Garcia Duran and Mathias Niepert. 2017. Learning graph representations with embedding propagation. In NeurIPS."},{"key":"e_1_3_2_1_7_1","unstructured":"Justin Gilmer Samuel S Schoenholz Patrick F Riley Oriol Vinyals and George E Dahl. 2017. Neural message passing for quantum chemistry. In ICML."},{"key":"e_1_3_2_1_8_1","volume-title":"Zhaohan Daniel Guo, Mohammad Gheshlaghi Azar, et al.","author":"Grill Jean-Bastien","year":"2020","unstructured":"Jean-Bastien Grill, Florian Strub, Florent Altch\u00e9, Corentin Tallec, Pierre H Richemond, Elena Buchatskaya, Carl Doersch, Bernardo Avila Pires, Zhaohan Daniel Guo, Mohammad Gheshlaghi Azar, et al. 2020. Bootstrap your own latent: A new approach to self-supervised learning. In NeurIPS."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"crossref","unstructured":"Aditya Grover and Jure Leskovec. 2016. node2vec: Scalable feature learning for networks. In SIGKDD.","DOI":"10.1145\/2939672.2939754"},{"key":"e_1_3_2_1_10_1","unstructured":"William L Hamilton Rex Ying and Jure Leskovec. 2017. Inductive representation learning on large graphs. In NeurIPS."},{"key":"e_1_3_2_1_11_1","unstructured":"Kaveh Hassani and Amir Hosein Khasahmadi. 2020. Contrastive multi-view representation learning on graphs. In ICML."},{"key":"e_1_3_2_1_12_1","volume-title":"Masked autoencoders are scalable vision learners. arXiv preprint arXiv:2111.06377","author":"He Kaiming","year":"2021","unstructured":"Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Doll\u00e1r, and Ross Girshick. 2021. Masked autoencoders are scalable vision learners. arXiv preprint arXiv:2111.06377 (2021)."},{"key":"e_1_3_2_1_13_1","unstructured":"Kaiming He Haoqi Fan Yuxin Wu Saining Xie and Ross Girshick. 2020. Momentum contrast for unsupervised visual representation learning. In CVPR."},{"key":"e_1_3_2_1_14_1","unstructured":"Geoffrey E Hinton and Richard S Zemel. 1994. Autoencoders minimum description length and Helmholtz free energy. In NeurIPS."},{"key":"e_1_3_2_1_15_1","unstructured":"Weihua Hu Matthias Fey Marinka Zitnik Yuxiao Dong Hongyu Ren Bowen Liu Michele Catasta and Jure Leskovec. 2020. Open graph benchmark: Datasets for machine learning on graphs. In NeurIPS."},{"key":"e_1_3_2_1_16_1","unstructured":"WHu B Liu J Gomes MZitnik P Liang V Pande and J Leskovec. 2020. Strategies For Pre-training Graph Neural Networks. In ICLR."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403237"},{"key":"e_1_3_2_1_18_1","volume-title":"Self-supervised learning on graphs: Deep insights and new direction. arXiv preprint arXiv:2006.10141","author":"Jin Wei","year":"2020","unstructured":"Wei Jin, Tyler Derr, Haochen Liu, YiqiWang, SuhangWang, Zitao Liu, and Jiliang Tang. 2020. Self-supervised learning on graphs: Deep insights and new direction. arXiv preprint arXiv:2006.10141 (2020)."},{"key":"e_1_3_2_1_19_1","unstructured":"Zekarias T Kefato and Sarunas Girdzijauskas. 2021. Self-supervised Graph Neural Networks without explicit negative sampling. In WWW."},{"key":"e_1_3_2_1_20_1","volume-title":"Variational graph auto-encoders. arXiv preprint arXiv:1611.07308","author":"Kipf Thomas N","year":"2016","unstructured":"Thomas N Kipf and Max Welling. 2016. Variational graph auto-encoders. arXiv preprint arXiv:1611.07308 (2016)."},{"key":"e_1_3_2_1_21_1","volume-title":"Kipf and Max Welling","author":"Thomas","year":"2017","unstructured":"Thomas N. Kipf and Max Welling. 2017. Semi-Supervised Classification with Graph Convolutional Networks. In ICLR."},{"key":"e_1_3_2_1_22_1","unstructured":"Tsung-Yi Lin Priya Goyal Ross Girshick Kaiming He and Piotr Doll\u00e1r. 2017. Focal loss for dense object detection. In ICCV."},{"key":"e_1_3_2_1_23_1","volume-title":"Self-supervised learning: Generative or contrastive. TKDE","author":"Liu Xiao","year":"2021","unstructured":"Xiao Liu, Fanjin Zhang, Zhenyu Hou, Li Mian, Zhaoyu Wang, Jing Zhang, and Jie Tang. 2021. Self-supervised learning: Generative or contrastive. TKDE (2021)."},{"key":"e_1_3_2_1_24_1","volume-title":"Graph-based neural network models with multiple self-supervised auxiliary tasks. Pattern Recognition Letters","author":"Manessi Franco","year":"2021","unstructured":"Franco Manessi and Alessandro Rozza. 2021. Graph-based neural network models with multiple self-supervised auxiliary tasks. Pattern Recognition Letters (2021)."},{"key":"e_1_3_2_1_25_1","volume-title":"graph2vec: Learning distributed representations of graphs. arXiv preprint arXiv:1707.05005","author":"Narayanan Annamalai","year":"2017","unstructured":"Annamalai Narayanan, Mahinthan Chandramohan, Rajasekar Venkatesan, Lihui Chen, Yang Liu, and Shantanu Jaiswal. 2017. graph2vec: Learning distributed representations of graphs. arXiv preprint arXiv:1707.05005 (2017)."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"crossref","unstructured":"S Pan R Hu G Long J Jiang L Yao and C Zhang. 2018. Adversarially regularized graph autoencoder for graph embedding. In IJCAI.","DOI":"10.24963\/ijcai.2018\/362"},{"key":"e_1_3_2_1_27_1","volume-title":"Kyuewang Lee, and Jin Young Choi.","author":"Park Jiwoong","year":"2019","unstructured":"Jiwoong Park, Minsik Lee, Hyung Jin Chang, Kyuewang Lee, and Jin Young Choi. 2019. Symmetric graph convolutional autoencoder for unsupervised graph representation learning. In ICCV."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2623330.2623732"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403168"},{"key":"e_1_3_2_1_30_1","unstructured":"Alec Radford Jeff Wu Rewon Child David Luan Dario Amodei and Ilya Sutskever. 2019. Language Models are Unsupervised Multitask Learners. (2019)."},{"key":"e_1_3_2_1_31_1","volume-title":"Graph Attention Auto-Encoders","author":"Salehi Amin","unstructured":"Amin Salehi and Hasan Davulcu. 2020. Graph Attention Auto-Encoders. In ICTAI. IEEE."},{"key":"e_1_3_2_1_32_1","volume-title":"Kurt Mehlhorn, and Karsten M Borgwardt.","author":"Shervashidze Nino","year":"2011","unstructured":"Nino Shervashidze, Pascal Schweitzer, Erik Jan Van Leeuwen, Kurt Mehlhorn, and Karsten M Borgwardt. 2011. Weisfeiler-Lehman graph kernels. JMLR (2011)."},{"key":"e_1_3_2_1_33_1","volume-title":"ZINC 15--ligand discovery for everyone. Journal of chemical information and modeling","author":"Sterling Teague","year":"2015","unstructured":"Teague Sterling and John J Irwin. 2015. ZINC 15--ligand discovery for everyone. Journal of chemical information and modeling (2015), 2324--2337."},{"key":"e_1_3_2_1_34_1","unstructured":"Fan-Yun Sun Jordan Hoffman Vikas Verma and Jian Tang. 2019. InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximization. In ICLR."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2736277.2741093"},{"key":"e_1_3_2_1_36_1","unstructured":"Mingyue Tang Carl Yang and Pan Li. 2022. Graph Auto-Encoder via Neighborhood Wasserstein Reconstruction. In ICLR."},{"key":"e_1_3_2_1_37_1","volume-title":"R\u00e9mi Munos, Petar Velickovic, and Michal Valko.","author":"Thakoor Shantanu","year":"2022","unstructured":"Shantanu Thakoor, Corentin Tallec, Mohammad Gheshlaghi Azar, R\u00e9mi Munos, Petar Velickovic, and Michal Valko. 2022. Large-Scale Representation Learning on Graphs via Bootstrapping. In ICLR."},{"key":"e_1_3_2_1_38_1","unstructured":"Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez Lukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. In NeurIPS."},{"key":"e_1_3_2_1_39_1","unstructured":"Petar Velickovic Guillem Cucurull Arantxa Casanova Adriana Romero Pietro Li\u00f2 and Yoshua Bengio. 2018. Graph Attention Networks. In ICLR."},{"key":"e_1_3_2_1_40_1","unstructured":"Petar Velickovic William Fedus William L Hamilton Pietro Li\u00f2 Yoshua Bengio and R Devon Hjelm. 2018. Deep Graph Infomax. In ICLR."},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"crossref","unstructured":"Pascal Vincent Hugo Larochelle Yoshua Bengio and Pierre-Antoine Manzagol. 2008. Extracting and composing robust features with denoising autoencoders. In ICML.","DOI":"10.1145\/1390156.1390294"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132847.3132967"},{"key":"e_1_3_2_1_43_1","volume-title":"MoleculeNet: a benchmark for molecular machine learning. Chemical science","author":"Wu Zhenqin","year":"2018","unstructured":"Zhenqin Wu, Bharath Ramsundar, Evan N Feinberg, Joseph Gomes, Caleb Geniesse, Aneesh S Pappu, Karl Leswing, and Vijay Pande. 2018. MoleculeNet: a benchmark for molecular machine learning. Chemical science (2018), 513--530."},{"key":"e_1_3_2_1_44_1","unstructured":"Dongkuan Xu Wei Cheng Dongsheng Luo Haifeng Chen and Xiang Zhang. 2021. InfoGCL: Information-Aware Graph Contrastive Learning. NeurIPS."},{"key":"e_1_3_2_1_45_1","unstructured":"Keyulu Xu Weihua Hu Jure Leskovec and Stefanie Jegelka. 2019. How powerful are graph neural networks?. In ICLR."},{"key":"e_1_3_2_1_46_1","unstructured":"Minghao Xu Hang Wang Bingbing Ni Hongyu Guo and Jian Tang. 2021. Selfsupervised graph-level representation learning with local and global structure. In ICML."},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"crossref","unstructured":"Pinar Yanardag and SVN Vishwanathan. 2015. Deep graph kernels. In KDD.","DOI":"10.1145\/2783258.2783417"},{"key":"e_1_3_2_1_48_1","unstructured":"Zhilin Yang William Cohen and Ruslan Salakhudinov. 2016. Revisiting semisupervised learning with graph embeddings. In ICML."},{"key":"e_1_3_2_1_49_1","volume-title":"Xlnet: Generalized autoregressive pretraining for language understanding. NeurIPS 32","author":"Yang Zhilin","year":"2019","unstructured":"Zhilin Yang, Zihang Dai, Yiming Yang, Jaime Carbonell, Russ R Salakhutdinov, and Quoc V Le. 2019. Xlnet: Generalized autoregressive pretraining for language understanding. NeurIPS 32 (2019)."},{"key":"e_1_3_2_1_50_1","unstructured":"Zhitao Ying Jiaxuan You Christopher Morris Xiang Ren Will Hamilton and Jure Leskovec. 2018. Hierarchical graph representation learning with differentiable pooling. In NeurIPS."},{"key":"e_1_3_2_1_51_1","unstructured":"Jiaxuan You Bowen Liu Rex Ying Vijay Pande and Jure Leskovec. 2018. Graph convolutional policy network for goal-directed molecular graph generation. In NeurIPS."},{"key":"e_1_3_2_1_52_1","volume-title":"Graphrnn: Generating realistic graphs with deep auto-regressive models. In ICML. PMLR, 5708--5717.","author":"You Jiaxuan","year":"2018","unstructured":"Jiaxuan You, Rex Ying, Xiang Ren, William Hamilton, and Jure Leskovec. 2018. Graphrnn: Generating realistic graphs with deep auto-regressive models. In ICML. PMLR, 5708--5717."},{"key":"e_1_3_2_1_53_1","unstructured":"Yuning You Tianlong Chen Yang Shen and Zhangyang Wang. 2021. Graph Contrastive Learning Automated. In ICML."},{"key":"e_1_3_2_1_54_1","unstructured":"Yuning You Tianlong Chen Yongduo Sui Ting Chen Zhangyang Wang and Yang Shen. 2020. Graph contrastive learning with augmentations. In NeurIPS."},{"key":"e_1_3_2_1_55_1","unstructured":"Yuning You Tianlong Chen Zhangyang Wang and Yang Shen. 2020. When does self-supervision help graph convolutional networks?. In ICML."},{"key":"e_1_3_2_1_56_1","doi-asserted-by":"crossref","unstructured":"Jiaqi Zeng and Pengtao Xie. 2021. Contrastive self-supervised learning for graph classification. In AAAI.","DOI":"10.1609\/aaai.v35i12.17293"},{"key":"e_1_3_2_1_57_1","unstructured":"Hengrui Zhang Qitian Wu Junchi Yan David Wipf and Philip S Yu. 2021. From canonical correlation analysis to self-supervised graph neural networks. In NeurIPS."},{"key":"e_1_3_2_1_58_1","unstructured":"Shichang Zhang Yozen Liu Yizhou Sun and Neil Shah. 2022. Graph-less Neural Networks: Teaching Old MLPs New Tricks Via Distillation. In ICLR."},{"key":"e_1_3_2_1_59_1","volume-title":"Self-supervised training of graph convolutional networks. arXiv preprint arXiv:2006.02380","author":"Zhu Qikui","year":"2020","unstructured":"Qikui Zhu, Bo Du, and Pingkun Yan. 2020. Self-supervised training of graph convolutional networks. arXiv preprint arXiv:2006.02380 (2020)."},{"key":"e_1_3_2_1_60_1","volume-title":"Deep graph contrastive representation learning. arXiv preprint arXiv:2006.04131","author":"Zhu Yanqiao","year":"2020","unstructured":"Yanqiao Zhu, Yichen Xu, Feng Yu, Qiang Liu, Shu Wu, and Liang Wang. 2020. Deep graph contrastive representation learning. arXiv preprint arXiv:2006.04131 (2020)."},{"key":"e_1_3_2_1_61_1","unstructured":"Yanqiao Zhu Yichen Xu Feng Yu Qiang Liu Shu Wu and Liang Wang. 2021. Graph contrastive learning with adaptive augmentation. In WWW."}],"event":{"name":"KDD '22: The 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining","location":"Washington DC USA","acronym":"KDD '22","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"]},"container-title":["Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3534678.3539321","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3534678.3539321","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:02:47Z","timestamp":1750186967000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3534678.3539321"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,14]]},"references-count":61,"alternative-id":["10.1145\/3534678.3539321","10.1145\/3534678"],"URL":"https:\/\/doi.org\/10.1145\/3534678.3539321","relation":{},"subject":[],"published":{"date-parts":[[2022,8,14]]},"assertion":[{"value":"2022-08-14","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}