{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,9]],"date-time":"2026-06-09T16:16:31Z","timestamp":1781021791763,"version":"3.54.1"},"reference-count":188,"publisher":"Association for Computing Machinery (ACM)","issue":"11","funder":[{"DOI":"10.13039\/100000028","name":"Semiconductor Research Corporation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000028","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2026,8,30]]},"abstract":"<jats:p>Graph neural networks (GNNs) are emerging for machine learning research on graph-structured data. GNNs achieve state-of-the-art performance on many tasks, but they face scalability challenges when it comes to real-world applications that have numerous data and strict latency requirements. Many studies have been conducted on how to accelerate GNNs in an effort to address these challenges. These acceleration techniques touch on various aspects of the GNN pipeline, from smart training and inference algorithms to efficient systems and customized hardware. As the amount of research on GNN acceleration has grown rapidly, there lacks a systematic treatment to provide a unified view and address the complexity of relevant works. In this survey, we provide a taxonomy of GNN acceleration, review the existing approaches, and suggest future research directions. Our taxonomic treatment of GNN acceleration connects the existing works and sets the stage for further development in this area.<\/jats:p>","DOI":"10.1145\/3805796","type":"journal-article","created":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T21:12:54Z","timestamp":1774645974000},"page":"1-36","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["A Survey on Graph Neural Network Acceleration: Algorithms, Systems, and Customized Hardware"],"prefix":"10.1145","volume":"58","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0954-5018","authenticated-orcid":false,"given":"Shichang","family":"Zhang","sequence":"first","affiliation":[{"name":"Computer Science Department, University of California Los Angeles","place":["Los Angeles, United States"]},{"name":"Harvard University","place":["Los Angeles, United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1156-3306","authenticated-orcid":false,"given":"Atefeh","family":"Sohrabizadeh","sequence":"additional","affiliation":[{"name":"University of California Los Angeles","place":["Los Angeles, United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2295-3481","authenticated-orcid":false,"given":"Cheng","family":"Wan","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology","place":["Atlanta, United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-1263-9270","authenticated-orcid":false,"given":"Zijie","family":"Huang","sequence":"additional","affiliation":[{"name":"University of California Los Angeles","place":["Los Angeles, United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-8818-739X","authenticated-orcid":false,"given":"Ziniu","family":"Hu","sequence":"additional","affiliation":[{"name":"University of California Los Angeles","place":["Los Angeles, United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9741-9929","authenticated-orcid":false,"given":"Yewen","family":"Wang","sequence":"additional","affiliation":[{"name":"University of California Los Angeles","place":["Los Angeles, United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5946-203X","authenticated-orcid":false,"given":"Yingyan (Celine)","family":"Lin","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology","place":["Atlanta, United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2887-6963","authenticated-orcid":false,"given":"Jason","family":"Cong","sequence":"additional","affiliation":[{"name":"University of California Los Angeles","place":["Los Angeles, United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1812-6843","authenticated-orcid":false,"given":"Yizhou","family":"Sun","sequence":"additional","affiliation":[{"name":"University of California Los Angeles","place":["Los Angeles, United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,4,25]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3477141"},{"key":"e_1_3_1_3_2","volume-title":"International Conference on Learning Representations","author":"Alon Uri","year":"2021","unstructured":"Uri Alon and Eran Yahav. 2021. On the bottleneck of graph neural networks and its practical implications. In International Conference on Learning Representations. Retrieved from https:\/\/openreview.net\/forum?id=i80OPhOCVH2"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00937"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN52387.2021.9533429"},{"key":"e_1_3_1_6_2","first-page":"748","volume-title":"International Conference on Machine Learning","author":"Beaini Dominique","year":"2021","unstructured":"Dominique Beaini, Saro Passaro, Vincent L\u00e9tourneau, Will Hamilton, Gabriele Corso, and Pietro Li\u00f2. 2021. Directional graph networks. In International Conference on Machine Learning. PMLR, 748\u2013758."},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/237814.237827"},{"key":"e_1_3_1_8_2","article-title":"Estimating or propagating gradients through stochastic neurons for conditional computation","author":"Bengio Yoshua","year":"2013","unstructured":"Yoshua Bengio, Nicholas L\u00e9onard, and Aaron Courville. 2013. Estimating or propagating gradients through stochastic neurons for conditional computation. arXiv preprint arXiv:1308.3432 (2013).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_9_2","unstructured":"Gecia Bravo Hermsdorff and Lee Gunderson. 2019. A unifying framework for spectrum-preserving graph sparsification and coarsening. In Advances in Neural Information Processing Systems H. Wallach H. Larochelle A. Beygelzimer F. d\u2019 Alch\u00e9-Buc E. Fox and R. Garnett (Eds.). Vol. 32 Curran Associates Inc. Retrieved from https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2019\/file\/cd474f6341aeffd65f93084d0dae3453-Paper.pdf"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/1150402.1150464"},{"key":"e_1_3_1_11_2","volume-title":"International Conference on Learning Representations","author":"Cai Chen","year":"2021","unstructured":"Chen Cai, Dingkang Wang, and Yusu Wang. 2021. Graph Coarsening with Neural Networks. In International Conference on Learning Representations."},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/3572848.3577528"},{"key":"e_1_3_1_13_2","unstructured":"Jie Chen Tengfei Ma and Cao Xiao. 2018. FastGCN: Fast learning with graph convolutional networks via importance sampling. In International Conference on Learning Representations. Retrieved from https:\/\/openreview.net\/forum?id=rytstxWAW"},{"key":"e_1_3_1_14_2","unstructured":"Jianfei Chen Jun Zhu and Le Song. 2018. Stochastic training of graph convolutional networks with variance reduction. In Proceedings of the 35th International Conference on Machine Learning (Proceedings of Machine Learning Research) Jennifer Dy and Andreas Krause (Eds.). Vol. 80 PMLR 942\u2013950."},{"key":"e_1_3_1_15_2","series-title":"Proceedings of Machine Learning Research","first-page":"1725","volume-title":"Proceedings of the 37th International Conference on Machine Learning","volume":"119","author":"Chen Ming","year":"2020","unstructured":"Ming Chen, Zhewei Wei, Zengfeng Huang, Bolin Ding, and Yaliang Li. 2020. Simple and Deep Graph Convolutional Networks. In Proceedings of the 37th International Conference on Machine Learning(Proceedings of Machine Learning Research, Vol. 119). PMLR, 1725\u20131735."},{"key":"e_1_3_1_16_2","first-page":"578","volume-title":"13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18)","author":"Chen Tianqi","year":"2018","unstructured":"Tianqi Chen, Thierry Moreau, Ziheng Jiang, Lianmin Zheng, Eddie Yan, Haichen Shen, et\u00a0al. 2018. \\(\\lbrace\\) TVM \\(\\rbrace\\) : An automated \\(\\lbrace\\) end-to-end \\(\\rbrace\\) optimizing compiler for deep learning. In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18). 578\u2013594."},{"key":"e_1_3_1_17_2","first-page":"1695","volume-title":"International Conference on Machine Learning","author":"Chen Tianlong","year":"2021","unstructured":"Tianlong Chen, Yongduo Sui, Xuxi Chen, Aston Zhang, and Zhangyang Wang. 2021. A unified lottery ticket hypothesis for graph neural networks. In International Conference on Machine Learning. PMLR, 1695\u20131706."},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","unstructured":"Xiaobing Chen Yuke Wang Xinfeng Xie Xing Hu Abanti Basak Ling Liang Mingyu Yan Lei Deng Yufei Ding Zidong Du and Yuan Xie. 2022. Rubik: A hierarchical architecture for efficient graph neural network training. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 41 4 (2022) 936\u2013949. DOI:10.1109\/TCAD.2021.3079142","DOI":"10.1109\/TCAD.2021.3079142"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2021\/314"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3007787.3001177"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/3400302.3415610"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330925"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.14778\/2824032.2824077"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403192"},{"key":"e_1_3_1_25_2","first-page":"13260","article-title":"Principal neighbourhood aggregation for graph nets","volume":"33","author":"Corso Gabriele","year":"2020","unstructured":"Gabriele Corso, Luca Cavalleri, Dominique Beaini, Pietro Li\u00f2, and Petar Veli\u010dkovi\u0107. 2020. Principal neighbourhood aggregation for graph nets. Advances in Neural Information Processing Systems 33 (2020), 13260\u201313271.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_26_2","first-page":"933","volume-title":"International Conference on Machine Learning","author":"Dauphin Yann N.","year":"2017","unstructured":"Yann N. Dauphin, Angela Fan, Michael Auli, and David Grangier. 2017. Language modeling with gated convolutional networks. In International Conference on Machine Learning. PMLR, 933\u2013941."},{"key":"e_1_3_1_27_2","volume-title":"International Conference on Learning Representations","author":"Deng Chenhui","year":"2020","unstructured":"Chenhui Deng, Zhiqiang Zhao, Yongyu Wang, Zhiru Zhang, and Zhuo Feng. 2020. GraphZoom: A Multi-level Spectral Approach for Accurate and Scalable Graph Embedding. In International Conference on Learning Representations."},{"key":"e_1_3_1_28_2","doi-asserted-by":"crossref","unstructured":"Xiang Deng and Zhongfei Zhang. 2021. Graph-Free Knowledge Distillation for Graph Neural Networks. arxiv:2105.07519 [cs.LG]","DOI":"10.24963\/ijcai.2021\/320"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3459637.3481916"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.23919\/DATE58400.2024.10546762"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","unstructured":"Jialin Dong Da Zheng Lin F. Yang and George Karypis. 2021. Global neighbor sampling for mixed CPU-GPU training on giant graphs. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining (KDD\u201921). Association for Computing Machinery Virtual Event Singapore 289\u2013299. DOI:10.1145\/3447548.3467437","DOI":"10.1145\/3447548.3467437"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2020\/677"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3411903"},{"key":"e_1_3_1_34_2","unstructured":"Steven K. Esser Jeffrey L. McKinstry Deepika Bablani Rathinakumar Appuswamy and Dharmendra S. Modha. 2020. Learned step size quantization. In International Conference on Learning Representations. Retrieved from https:\/\/openreview.net\/forum?id=rkgO66VKDS"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICTAI50040.2020.00198"},{"key":"e_1_3_1_36_2","volume-title":"ICLR Workshop on Representation Learning on Graphs and Manifolds","author":"Fey Matthias","year":"2019","unstructured":"Matthias Fey and Jan E. Lenssen. 2019. Fast graph representation learning with pytorch geometric. In ICLR Workshop on Representation Learning on Graphs and Manifolds."},{"key":"e_1_3_1_37_2","first-page":"3294","volume-title":"International Conference on Machine Learning","author":"Fey Matthias","year":"2021","unstructured":"Matthias Fey, Jan E. Lenssen, Frank Weichert, and Jure Leskovec. 2021. Gnnautoscale: Scalable and expressive graph neural networks via historical embeddings. In International Conference on Machine Learning. PMLR, 3294\u20133304."},{"key":"e_1_3_1_38_2","unstructured":"Jonathan Frankle and Michael Carbin. 2018. The lottery ticket hypothesis: Finding sparse trainable neural networks. arXiv:1803.03635 (2018)."},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403386"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3502181.3531467"},{"key":"e_1_3_1_41_2","first-page":"551","volume-title":"15th  \\(\\lbrace\\) USENIX \\(\\rbrace\\)  Symposium on Operating Systems Design and Implementation ( \\(\\lbrace\\) OSDI \\(\\rbrace\\)  21)","author":"Gandhi Swapnil","year":"2021","unstructured":"Swapnil Gandhi and Anand Padmanabha Iyer. 2021. P3: Distributed deep graph learning at scale. In 15th \\(\\lbrace\\) USENIX \\(\\rbrace\\) Symposium on Operating Systems Design and Implementation ( \\(\\lbrace\\) OSDI \\(\\rbrace\\) 21). 551\u2013568."},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/MICRO50266.2020.00079"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3466752.3480113"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3700434"},{"key":"e_1_3_1_45_2","first-page":"1263","volume-title":"International Conference on Machine Learning","author":"Gilmer Justin","year":"2017","unstructured":"Justin Gilmer, Samuel S. Schoenholz, Patrick F. Riley, Oriol Vinyals, and George E. Dahl. 2017. Neural message passing for quantum chemistry. In International Conference on Machine Learning. PMLR, 1263\u20131272."},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3600006.3613168"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939754"},{"key":"e_1_3_1_48_2","series-title":"Proceedings of Machine Learning Research","first-page":"12012","volume-title":"Proceedings of the 40th International Conference on Machine Learning","volume":"202","author":"Guo Zhichun","year":"2023","unstructured":"Zhichun Guo, William Shiao, Shichang Zhang, Yozen Liu, Nitesh V. Chawla, Neil Shah, and Tong Zhao. 2023. Linkless link prediction via relational distillation. In Proceedings of the 40th International Conference on Machine Learning(Proceedings of Machine Learning Research, Vol. 202). Andreas Krause, Emma Brunskill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato, and Jonathan Scarlett (Eds.). PMLR, 12012\u201312033."},{"key":"e_1_3_1_49_2","first-page":"1737","volume-title":"International Conference on Machine Learning","author":"Gupta Suyog","year":"2015","unstructured":"Suyog Gupta, Ankur Agrawal, Kailash Gopalakrishnan, and Pritish Narayanan. 2015. Deep learning with limited numerical precision. In International Conference on Machine Learning. PMLR, 1737\u20131746."},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1109\/HPCA57654.2024.00019"},{"key":"e_1_3_1_51_2","first-page":"1024","volume-title":"Advances in Neural Information Processing Systems","author":"Hamilton Will","year":"2017","unstructured":"Will Hamilton, Zhitao Ying, and Jure Leskovec. 2017. Inductive representation learning on large graphs. In Advances in Neural Information Processing Systems. 1024\u20131034."},{"key":"e_1_3_1_52_2","unstructured":"Will Hamilton Zhitao Ying and Jure Leskovec. 2017. Inductive representation learning on large graphs. In Advances in Neural Information Processing Systems I. Guyon U. Von Luxburg S. Bengio H. Wallach R. Fergus S. Vishwanathan and R. Garnett (Eds.). Vol. 30 Curran Associates Inc. Retrieved from https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2017\/file\/5dd9db5e033da9c6fb5ba83c7a7ebea9-Paper.pdf"},{"key":"e_1_3_1_53_2","article-title":"Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding","author":"Han Song","year":"2015","unstructured":"Song Han, Huizi Mao, and William J. Dally. 2015. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv preprint arXiv:1510.00149 (2015).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.5555\/2969239.2969366"},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/MICRO50266.2020.00040"},{"key":"e_1_3_1_56_2","unstructured":"Geoffrey Hinton Oriol Vinyals and Jeff Dean. 2015. Distilling the Knowledge in a Neural Network. arxiv:1503.02531 [stat.ML]"},{"key":"e_1_3_1_57_2","article-title":"OGB-LSC: A large-scale challenge for machine learning on graphs","author":"Hu Weihua","year":"2021","unstructured":"Weihua Hu, Matthias Fey, Hongyu Ren, Maho Nakata, Yuxiao Dong, and Jure Leskovec. 2021. OGB-LSC: A large-scale challenge for machine learning on graphs. arXiv preprint arXiv:2103.09430 (2021).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_58_2","article-title":"Open graph benchmark: Datasets for machine learning on graphs","author":"Hu Weihua","year":"2020","unstructured":"Weihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong, Hongyu Ren, Bowen Liu, Michele Catasta, and Jure Leskovec. 2020. Open graph benchmark: Datasets for machine learning on graphs. CoRR (2020). arXiv:2005.00687","journal-title":"CoRR"},{"key":"e_1_3_1_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/SC41405.2020.00075"},{"key":"e_1_3_1_60_2","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380027"},{"key":"e_1_3_1_61_2","unstructured":"Wenbing Huang Tong Zhang Yu Rong and Junzhou Huang. 2018. Adaptive sampling towards fast graph representation learning. In Advances in Neural Information Processing Systems S. Bengio H. Wallach H. Larochelle K. Grauman N. Cesa-Bianchi and R. Garnett (Eds.). Vol. 31 Curran Associates Inc. Retrieved from https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2018\/file\/01eee509ee2f68dc6014898c309e86bf-Paper.pdf"},{"key":"e_1_3_1_62_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.acl-long.36"},{"key":"e_1_3_1_63_2","volume-title":"Advances in Neural Information Processing Systems","author":"Huang Zijie","year":"2020","unstructured":"Zijie Huang, Yizhou Sun, and Wei Wang. 2020. Learning continuous system dynamics from irregularly-sampled partial observations. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_1_64_2","doi-asserted-by":"publisher","DOI":"10.1145\/3447548.3467385"},{"key":"e_1_3_1_65_2","doi-asserted-by":"publisher","DOI":"10.1145\/3447548.3467256"},{"key":"e_1_3_1_66_2","volume-title":"MindSpore","year":"2020","unstructured":"Huawei. 2020. MindSpore. Retrieved from https:\/\/e.huawei.com\/en\/products\/cloud-computing-dc\/atlas\/mindspore"},{"issue":"187","key":"e_1_3_1_67_2","first-page":"1","article-title":"Quantized neural networks: Training neural networks with low precision weights and activations","volume":"18","author":"Hubara Itay","year":"2018","unstructured":"Itay Hubara, Matthieu Courbariaux, Daniel Soudry, Ran El-Yaniv, and Yoshua Bengio. 2018. Quantized neural networks: Training neural networks with low precision weights and activations. Journal of Machine Learning Research 18, 187 (2018), 1\u201330. Retrieved from http:\/\/jmlr.org\/papers\/v18\/16-456.html","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_1_68_2","doi-asserted-by":"publisher","unstructured":"Amin Javari Zhankui He Zijie Huang Raj Jeetu and Kevin Chen-Chuan Chang. 2020. Weakly supervised attention for hashtag recommendation using graph data. In Proceedings of The Web Conference 2020 (WWW\u201920). Association for Computing Machinery Taipei Taiwan 1038\u20131048. DOI:10.1145\/3366423.3380182","DOI":"10.1145\/3366423.3380182"},{"key":"e_1_3_1_69_2","unstructured":"Zhihao Jia Sina Lin Mingyu Gao Matei Zaharia and Alex Aiken. 2020. Improving the accuracy scalability and performance of graph neural networks with roc. In Proceedings of Machine Learning and Systems I. Dhillon D. Papailiopoulos and V. Sze (Eds.). 2 (2020) 187\u2013198. Retrieved from https:\/\/proceedings.mlsys.org\/paper_files\/paper\/2020\/file\/91fc23ceccb664ebb0cf4257e1ba9c51-Paper.pdf"},{"key":"e_1_3_1_70_2","doi-asserted-by":"publisher","unstructured":"Dejun Jiang Zhenxing Wu Chang-Yu Hsieh Guangyong Chen Ben Liao Zhe Wang Chao Shen Dongsheng Cao Jian Wu and Tingjun Hou. 2021. Could graph neural networks learn better molecular representation for drug discovery? A comparison study of descriptor-based and graph-based models. Journal of Cheminformatics 13 1 (February 2021) 12. DOI:10.1186\/s13321-020-00479-8","DOI":"10.1186\/s13321-020-00479-8"},{"key":"e_1_3_1_71_2","doi-asserted-by":"publisher","unstructured":"Weiwei Jiang and Jiayun Luo. 2022. Graph neural network for traffic forecasting: A survey. Expert Systems with Applications 207 (2022) 117921. DOI:10.1016\/j.eswa.2022.117921","DOI":"10.1016\/j.eswa.2022.117921"},{"key":"e_1_3_1_72_2","doi-asserted-by":"publisher","DOI":"10.1145\/3534678.3539429"},{"key":"e_1_3_1_73_2","unstructured":"Wei Jin Lingxiao Zhao Shichang Zhang Yozen Liu Jiliang Tang and Neil Shah. 2022. Graph condensation for graph neural networks. In International Conference on Learning Representations. Retrieved from https:\/\/openreview.net\/forum?id=WLEx3Jo4QaB"},{"key":"e_1_3_1_74_2","unstructured":"Tim Kaler Nickolas Stathas Anne Ouyang Alexandros-Stavros Iliopoulos Tao Schardl Charles E. Leiserson and Jie Chen. 2022. Accelerating training and inference of graph neural networks with fast sampling and pipelining. In Proceedings of Machine Learning and Systems D. Marculescu Y. Chi and C. Wu (Eds.). 4 (2022) 172\u2013189. Retrieved from https:\/\/proceedings.mlsys.org\/paper_files\/paper\/2022\/file\/afacc5db3e0e85b446e6c7727cd7dca5-Paper.pdf"},{"key":"e_1_3_1_75_2","doi-asserted-by":"publisher","DOI":"10.1137\/S1064827595287997"},{"key":"e_1_3_1_76_2","doi-asserted-by":"publisher","DOI":"10.1002\/j.1538-7305.1970.tb01770.x"},{"key":"e_1_3_1_77_2","article-title":"Semi-supervised classification with graph convolutional networks","author":"Kipf Thomas N.","year":"2016","unstructured":"Thomas N. Kipf and Max Welling. 2016. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_78_2","unstructured":"Raghuraman Krishnamoorthi. 2018. Quantizing deep convolutional networks for efficient inference: A whitepaper. arXiv:1806.08342 (2018)."},{"key":"e_1_3_1_79_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISCA52012.2021.00013"},{"key":"e_1_3_1_80_2","first-page":"6437","volume-title":"International Conference on Machine Learning","author":"Li Guohao","year":"2021","unstructured":"Guohao Li, Matthias M\u00fcller, Bernard Ghanem, and Vladlen Koltun. 2021. Training graph neural networks with 1000 layers. In International Conference on Machine Learning. PMLR, 6437\u20136449."},{"key":"e_1_3_1_81_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-47426-3_22"},{"key":"e_1_3_1_82_2","doi-asserted-by":"publisher","DOI":"10.1145\/3400302.3415645"},{"key":"e_1_3_1_83_2","doi-asserted-by":"publisher","DOI":"10.1109\/TC.2020.3014632"},{"key":"e_1_3_1_84_2","article-title":"A comprehensive survey on distributed training of graph neural networks","author":"Lin Haiyang","year":"2022","unstructured":"Haiyang Lin, Mingyu Yan, Xiaochun Ye, Dongrui Fan, Shirui Pan, Wenguang Chen, and Yuan Xie. 2022. A comprehensive survey on distributed training of graph neural networks. arXiv preprint arXiv:2211.05368 (2022).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_85_2","doi-asserted-by":"publisher","DOI":"10.1109\/DAC18074.2021.9586250"},{"key":"e_1_3_1_86_2","doi-asserted-by":"publisher","DOI":"10.1145\/3419111.3421281"},{"key":"e_1_3_1_87_2","doi-asserted-by":"publisher","DOI":"10.1145\/3489517.3530479"},{"key":"e_1_3_1_88_2","article-title":"Bgl: Gpu-efficient gnn training by optimizing graph data i\/o and preprocessing","author":"Liu Tianfeng","year":"2021","unstructured":"Tianfeng Liu, Yangrui Chen, Dan Li, Chuan Wu, Yibo Zhu, Jun He, Yanghua Peng, Hongzheng Chen, Hongzhi Chen, and Chuanxiong Guo. 2021. Bgl: Gpu-efficient gnn training by optimizing graph data i\/o and preprocessing. arXiv preprint arXiv:2112.08541 (2021).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_89_2","doi-asserted-by":"publisher","DOI":"10.1109\/JAS.2021.1004311"},{"key":"e_1_3_1_90_2","unstructured":"Ziqi Liu Zhengwei Wu Zhiqiang Zhang Jun Zhou Shuang Yang Le Song and Yuan Qi. 2020. Bandit samplers for training graph neural networks. In Advances in Neural Information Processing Systems H. Larochelle M. Ranzato R. Hadsell M. F. Balcan and H. Lin (Eds.). Vol. 33 Curran Associates Inc. 6878\u20136888. Retrieved from https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2020\/file\/4cea2358d3cc5f8cd32397ca9bc51b94-Paper.pdf"},{"key":"e_1_3_1_91_2","doi-asserted-by":"publisher","DOI":"10.1145\/3447548.3467429"},{"issue":"116","key":"e_1_3_1_92_2","first-page":"1","article-title":"Graph reduction with spectral and cut guarantees.","volume":"20","author":"Loukas Andreas","year":"2019","unstructured":"Andreas Loukas. 2019. Graph reduction with spectral and cut guarantees. J. Mach. Learn. Res. 20, 116 (2019), 1\u201342.","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_3_1_93_2","series-title":"Proceedings of Machine Learning Research","first-page":"3237","volume-title":"Proceedings of the 35th International Conference on Machine Learning","volume":"80","author":"Loukas Andreas","year":"2018","unstructured":"Andreas Loukas and Pierre Vandergheynst. 2018. Spectrally approximating large graphs with smaller graphs. In Proceedings of the 35th International Conference on Machine Learning(Proceedings of Machine Learning Research, Vol. 80). PMLR, 3237\u20133246."},{"key":"e_1_3_1_94_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCD56317.2022.00049"},{"key":"e_1_3_1_95_2","first-page":"443","volume-title":"2019 USENIX Annual Technical Conference (USENIX ATC 19)","author":"Ma Lingxiao","year":"2019","unstructured":"Lingxiao Ma, Zhi Yang, Youshan Miao, Jilong Xue, Ming Wu, Lidong Zhou, and Yafei Dai. 2019. \\(\\lbrace\\) NeuGraph \\(\\rbrace\\) : Parallel deep neural network computation on large graphs. In 2019 USENIX Annual Technical Conference (USENIX ATC 19). 443\u2013458."},{"key":"e_1_3_1_96_2","first-page":"443","volume-title":"2019 USENIX Annual Technical Conference (USENIX ATC 19)","author":"Ma Lingxiao","year":"2019","unstructured":"Lingxiao Ma, Zhi Yang, Youshan Miao, Jilong Xue, Ming Wu, Lidong Zhou, and Yafei Dai. 2019. \\(\\lbrace\\) NeuGraph \\(\\rbrace\\) : Parallel deep neural network computation on large graphs. In 2019 USENIX Annual Technical Conference (USENIX ATC 19). 443\u2013458."},{"key":"e_1_3_1_97_2","volume-title":"An Introduction to Information Retrieval","author":"Manning Christopher D.","year":"2009","unstructured":"Christopher D. Manning. 2009. An Introduction to Information Retrieval. Cambridge University Press."},{"key":"e_1_3_1_98_2","doi-asserted-by":"publisher","DOI":"10.1145\/3459637.3482291"},{"key":"e_1_3_1_99_2","doi-asserted-by":"publisher","unstructured":"Diego Marcheggiani and Ivan Titov. 2017. Encoding sentences with graph convolutional networks for semantic role labeling. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics Copenhagen Denmark 1506\u20131515. DOI:10.18653\/v1\/D17-1159","DOI":"10.18653\/v1\/D17-1159"},{"key":"e_1_3_1_100_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-021-03544-w"},{"key":"e_1_3_1_101_2","doi-asserted-by":"publisher","DOI":"10.1145\/1298306.1298311"},{"key":"e_1_3_1_102_2","first-page":"533","volume-title":"15th USENIX Symposium on Operating Systems Design and Implementation (OSDI 21)","author":"Mohoney Jason","year":"2021","unstructured":"Jason Mohoney, Roger Waleffe, Henry Xu, Theodoros Rekatsinas, and Shivaram Venkataraman. 2021. Marius: Learning massive graph embeddings on a single machine. In 15th USENIX Symposium on Operating Systems Design and Implementation (OSDI 21). USENIX Association, 533\u2013549."},{"key":"e_1_3_1_103_2","unstructured":"Hesham Mostafa. 2022. Sequential aggregation and rematerialization: Distributed full-batch training of graph neural networks on large graphs. In Proceedings of Machine Learning and Systems D. Marculescu Y. Chi and C. Wu (Eds.). 4 (2022) 265\u2013275. Retrieved from https:\/\/proceedings.mlsys.org\/paper_files\/paper\/2022\/file\/1d781258d409a6efc66cd1aa14a1681c-Paper.pdf"},{"key":"e_1_3_1_104_2","article-title":"A white paper on neural network quantization","author":"Nagel Markus","year":"2021","unstructured":"Markus Nagel, Marios Fournarakis, Rana Ali Amjad, Yelysei Bondarenko, Mart van Baalen, and Tijmen Blankevoort. 2021. A white paper on neural network quantization. arXiv preprint arXiv:2106.08295 (2021).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_105_2","doi-asserted-by":"publisher","DOI":"10.1145\/3620665.3640426"},{"key":"e_1_3_1_106_2","doi-asserted-by":"publisher","DOI":"10.14778\/3538598.3538614"},{"key":"e_1_3_1_107_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"key":"e_1_3_1_108_2","doi-asserted-by":"publisher","DOI":"10.1145\/2623330.2623732"},{"key":"e_1_3_1_109_2","volume-title":"The Fourth Learning on Graphs Conference","author":"Qin Zongyue","year":"2025","unstructured":"Zongyue Qin, Shichang Zhang, Mingxuan Ju, Tong Zhao, Neil Shah, and Yizhou Sun. 2025. Weak models can be good teachers: A case study on link prediction with MLPs. In The Fourth Learning on Graphs Conference."},{"key":"e_1_3_1_110_2","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS49936.2021.00034"},{"key":"e_1_3_1_111_2","volume-title":"International Conference on Learning Representations","author":"Ramezani Morteza","year":"2022","unstructured":"Morteza Ramezani, Weilin Cong, Mehrdad Mahdavi, Mahmut Kandemir, and Anand Sivasubramaniam. 2022. Learn locally, correct globally: A distributed algorithm for training graph neural networks. In International Conference on Learning Representations."},{"key":"e_1_3_1_112_2","doi-asserted-by":"publisher","DOI":"10.1109\/72.248452"},{"key":"e_1_3_1_113_2","doi-asserted-by":"publisher","DOI":"10.5555\/829576"},{"key":"e_1_3_1_114_2","article-title":"Recent advances in recurrent neural networks","author":"Salehinejad Hojjat","year":"2017","unstructured":"Hojjat Salehinejad, Sharan Sankar, Joseph Barfett, Errol Colak, and Shahrokh Valaee. 2017. Recent advances in recurrent neural networks. arXiv preprint arXiv:1801.01078 (2017).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_115_2","first-page":"8459","volume-title":"International Conference on Machine Learning","author":"Sanchez-Gonzalez Alvaro","year":"2020","unstructured":"Alvaro Sanchez-Gonzalez, Jonathan Godwin, Tobias Pfaff, Rex Ying, Jure Leskovec, and Peter Battaglia. 2020. Learning to simulate complex physics with graph networks. In International Conference on Machine Learning. PMLR, 8459\u20138468."},{"key":"e_1_3_1_116_2","article-title":"FlowGNN: A dataflow architecture for universal graph neural network inference via multi-queue streaming","author":"Sarkar Rishov","year":"2022","unstructured":"Rishov Sarkar, Stefan Abi-Karam, Yuqi He, Lakshmi Sathidevi, and Cong Hao. 2022. FlowGNN: A dataflow architecture for universal graph neural network inference via multi-queue streaming. arXiv preprint arXiv:2204.13103 (2022).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_117_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-93417-4_38"},{"key":"e_1_3_1_118_2","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v29i3.2157"},{"key":"e_1_3_1_119_2","doi-asserted-by":"publisher","DOI":"10.1145\/3469379.3469387"},{"key":"e_1_3_1_120_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0808904106"},{"key":"e_1_3_1_121_2","article-title":"Distributed graph neural network training: A survey","author":"Shao Yingxia","year":"2022","unstructured":"Yingxia Shao, Hongzheng Li, Xizhi Gu, Hongbo Yin, Yawen Li, Xupeng Miao, Wentao Zhang, Bin Cui, and Lei Chen. 2022. Distributed graph neural network training: A survey. arXiv preprint arXiv:2211.00216 (2022).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_122_2","volume-title":"2022 59th ACM\/IEEE Design Automation Conference (DAC)","author":"Sohrabizadeh Atefeh","year":"2022","unstructured":"Atefeh Sohrabizadeh, Yunsheng Bai, Yizhou Sun, and Jason Cong. 2022. Automated accelerator optimization aided by graph neural networks. In 2022 59th ACM\/IEEE Design Automation Conference (DAC)."},{"key":"e_1_3_1_123_2","doi-asserted-by":"publisher","DOI":"10.1109\/CICC53496.2022.9772832"},{"key":"e_1_3_1_124_2","doi-asserted-by":"publisher","DOI":"10.1145\/3373087.3375321"},{"key":"e_1_3_1_125_2","doi-asserted-by":"publisher","DOI":"10.1145\/3494534"},{"key":"e_1_3_1_126_2","doi-asserted-by":"publisher","DOI":"10.1145\/3490422.3502357"},{"key":"e_1_3_1_127_2","doi-asserted-by":"publisher","DOI":"10.1109\/HPCA.2018.00052"},{"key":"e_1_3_1_128_2","doi-asserted-by":"publisher","DOI":"10.1137\/080734029"},{"key":"e_1_3_1_129_2","doi-asserted-by":"publisher","DOI":"10.1137\/090771430"},{"key":"e_1_3_1_130_2","doi-asserted-by":"publisher","DOI":"10.1109\/MICRO50266.2020.00068"},{"key":"e_1_3_1_131_2","article-title":"Degree-quant: Quantization-aware training for graph neural networks","author":"Tailor Shyam A.","year":"2020","unstructured":"Shyam A. Tailor, Javier Fernandez-Marques, and Nicholas D. Lane. 2020. Degree-quant: Quantization-aware training for graph neural networks. arXiv preprint arXiv:2008.05000 (2020).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_132_2","volume-title":"15th USENIX Symposium on Operating Systems Design and Implementation (OSDI 21)","author":"Thorpe John","year":"2021","unstructured":"John Thorpe, Yifan Qiao, Jonathan Eyolfson, Shen Teng, et\u00a0al. 2021. Dorylus: Affordable, scalable, and accurate \\(\\lbrace\\) GNN \\(\\rbrace\\) training with distributed \\(\\lbrace\\) CPU \\(\\rbrace\\) servers and serverless threads. In 15th USENIX Symposium on Operating Systems Design and Implementation (OSDI 21)."},{"key":"e_1_3_1_133_2","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS47924.2020.00100"},{"key":"e_1_3_1_134_2","doi-asserted-by":"publisher","DOI":"10.5555\/3433701.3433794"},{"key":"e_1_3_1_135_2","article-title":"Graph attention networks","author":"Veli\u010dkovi\u0107 Petar","year":"2017","unstructured":"Petar Veli\u010dkovi\u0107, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. 2017. Graph attention networks. arXiv preprint arXiv:1710.10903 (2017).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_136_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11222-007-9033-z"},{"key":"e_1_3_1_137_2","article-title":"MariusGNN: Resource-efficient out-of-core training of graph neural networks","author":"Waleffe Roger","year":"2022","unstructured":"Roger Waleffe, Jason Mohoney, Theodoros Rekatsinas, and Shivaram Venkataraman. 2022. MariusGNN: Resource-efficient out-of-core training of graph neural networks. arXiv preprint arXiv:2202.02365 (2022).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_138_2","unstructured":"Cheng Wan Youjie Li Ang Li Nam Sung Kim and Yingyan Lin. 2022. BNS-GCN: Efficient full-graph training of graph convolutional networks with partition-parallelism and random boundary node sampling. In Proceedings of Machine Learning and Systems D. Marculescu Y. Chi and C. Wu (Eds.). 4 (2022) 673\u2013693. Retrieved from https:\/\/proceedings.mlsys.org\/paper_files\/paper\/2022\/file\/676638b91bc90529e09b22e58abb01d6-Paper.pdf"},{"key":"e_1_3_1_139_2","article-title":"PipeGCN: Efficient full-graph training of graph convolutional networks with pipelined feature communication","author":"Wan Cheng","year":"2022","unstructured":"Cheng Wan, Youjie Li, Cameron R. Wolfe, Anastasios Kyrillidis, Nam Sung Kim, and Yingyan Lin. 2022. PipeGCN: Efficient full-graph training of graph convolutional networks with pipelined feature communication. arXiv preprint arXiv:2203.10428 (2022).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_140_2","doi-asserted-by":"publisher","DOI":"10.1145\/3431920.3439292"},{"key":"e_1_3_1_141_2","article-title":"Deep graph library: A graph-centric, highly-performant package for graph neural networks","author":"Wang Minjie","year":"2019","unstructured":"Minjie Wang, Da Zheng, Zihao Ye, Quan Gan, Mufei Li, Xiang Song, et\u00a0al. 2019. Deep graph library: A graph-centric, highly-performant package for graph neural networks. arXiv preprint arXiv:1909.01315 (2019).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_142_2","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3462934"},{"key":"e_1_3_1_143_2","first-page":"515","volume-title":"15th USENIX Symposium on Operating Systems Design and Implementation (OSDI 21)","author":"Wang Yuke","year":"2021","unstructured":"Yuke Wang, Boyuan Feng, Gushu Li, Shuangchen Li, Lei Deng, Yuan Xie, and Yufei Ding. 2021. \\(\\lbrace\\) GNNAdvisor \\(\\rbrace\\) : An adaptive and efficient runtime system for \\(\\lbrace\\) GNN \\(\\rbrace\\) acceleration on \\(\\lbrace\\) GPUs \\(\\rbrace\\) . In 15th USENIX Symposium on Operating Systems Design and Implementation (OSDI 21). 515\u2013531."},{"key":"e_1_3_1_144_2","doi-asserted-by":"publisher","DOI":"10.1145\/3326362"},{"key":"e_1_3_1_145_2","article-title":"PIGEON: Optimizing CUDA code generator for end-to-end training and inference of relational graph neural networks","author":"Wu Kun","year":"2023","unstructured":"Kun Wu, Mert Hidayeto\u011flu, Xiang Song, Sitao Huang, Da Zheng, Israt Nisa, and Wen-mei Hwu. 2023. PIGEON: Optimizing CUDA code generator for end-to-end training and inference of relational graph neural networks. arXiv preprint arXiv:2301.06284 (2023).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_146_2","article-title":"Graph neural networks in recommender systems: a survey","author":"Wu Shiwen","year":"2020","unstructured":"Shiwen Wu, Fei Sun, Wentao Zhang, Xu Xie, and Bin Cui. 2020. Graph neural networks in recommender systems: a survey. ACM Computing Surveys (CSUR) (2020).","journal-title":"ACM Computing Surveys (CSUR)"},{"key":"e_1_3_1_147_2","doi-asserted-by":"publisher","DOI":"10.1145\/3447786.3456247"},{"key":"e_1_3_1_148_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403118"},{"key":"e_1_3_1_149_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01070"},{"key":"e_1_3_1_150_2","unstructured":"Zhiqiang Xie Minjie Wang Zihao Ye Zheng Zhang and Rui Fan. 2022. Graphiler: Optimizing graph neural networks with message passing data flow graph. In Proceedings of Machine Learning and Systems D. Marculescu Y. Chi and C. Wu (Eds.). 4 (2022) 515\u2013528. Retrieved from https:\/\/proceedings.mlsys.org\/paper_files\/paper\/2022\/file\/a1126573153ad7e9f44ba80e99316482-Paper.pdf"},{"key":"e_1_3_1_151_2","article-title":"How powerful are graph neural networks?","author":"Xu Keyulu","year":"2018","unstructured":"Keyulu Xu, Weihua Hu, Jure Leskovec, and Stefanie Jegelka. 2018. How powerful are graph neural networks? arXiv preprint arXiv:1810.00826 (2018).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_152_2","unstructured":"Zhongwen Xu Hado P van Hasselt and David Silver. 2018. Meta-gradient reinforcement learning. In Advances in Neural Information Processing Systems S. Bengio H. Wallach H. Larochelle K. Grauman N. Cesa-Bianchi and R. Garnett (Eds.). Vol. 31 Curran Associates Inc. Retrieved from https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2018\/file\/2715518c875999308842e3455eda2fe3-Paper.pdf"},{"key":"e_1_3_1_153_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403236"},{"key":"e_1_3_1_154_2","doi-asserted-by":"publisher","DOI":"10.1109\/HPCA47549.2020.00012"},{"key":"e_1_3_1_155_2","doi-asserted-by":"publisher","DOI":"10.1145\/3442381.3450068"},{"key":"e_1_3_1_156_2","doi-asserted-by":"publisher","DOI":"10.1145\/3492321.3519557"},{"key":"e_1_3_1_157_2","unstructured":"Shuwen Yang Ziyao Li Guojie Song and Lingsheng Cai. 2021. Deep molecular representation learning via fusing physical and chemical information. In Advances in Neural Information Processing Systems M. Ranzato A. Beygelzimer Y. Dauphin P. S. Liang and J. Wortman Vaughan (Eds.). Vol. 34 Curran Associates Inc. 16346\u201316357. Retrieved from https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2021\/file\/884d247c6f65a96a7da4d1105d584ddd-Paper.pdf"},{"key":"e_1_3_1_158_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00710"},{"key":"e_1_3_1_159_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2021\/455"},{"key":"e_1_3_1_160_2","article-title":"SparseTIR: Composable abstractions for sparse compilation in deep learning","author":"Ye Zihao","year":"2022","unstructured":"Zihao Ye, Ruihang Lai, Junru Shao, Tianqi Chen, and Luis Ceze. 2022. SparseTIR: Composable abstractions for sparse compilation in deep learning. arXiv preprint arXiv:2207.04606 (2022).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_161_2","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3219890"},{"key":"e_1_3_1_162_2","unstructured":"Zhitao Ying Jiaxuan You Christopher Morris Xiang Ren Will Hamilton and Jure Leskovec. 2018. Hierarchical graph representation learning with differentiable pooling. In Advances in Neural Information Processing Systems S. Bengio H. Wallach H. Larochelle K. Grauman N. Cesa-Bianchi and R. Garnett (Eds.). Vol. 31 Curran Associates Inc. Retrieved from https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2018\/file\/e77dbaf6759253c7c6d0efc5690369c7-Paper.pdf"},{"key":"e_1_3_1_163_2","doi-asserted-by":"publisher","DOI":"10.1109\/HPCA53966.2022.00041"},{"key":"e_1_3_1_164_2","article-title":"Early-bird GCNs: Graph-network co-optimization towards more efficient GCN training and inference via drawing early-bird lottery tickets","author":"You Haoran","year":"2021","unstructured":"Haoran You, Zhihan Lu, Zijian Zhou, Yonggan Fu, and Yingyan Lin. 2021. Early-bird GCNs: Graph-network co-optimization towards more efficient GCN training and inference via drawing early-bird lottery tickets. arXiv preprint arXiv:2103.00794 (2021).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_165_2","first-page":"25684","volume-title":"International Conference on Machine Learning","author":"Yu Haiyang","year":"2022","unstructured":"Haiyang Yu, Limei Wang, Bokun Wang, Meng Liu, Tianbao Yang, and Shuiwang Ji. 2022. Graphfm: Improving large-scale gnn training via feature momentum. In International Conference on Machine Learning. PMLR, 25684\u201325701."},{"key":"e_1_3_1_166_2","doi-asserted-by":"publisher","DOI":"10.1145\/3373087.3375312"},{"key":"e_1_3_1_167_2","unstructured":"Hanqing Zeng Muhan Zhang Yinglong Xia Ajitesh Srivastava Andrey Malevich Rajgopal Kannan Viktor Prasanna Long Jin and Ren Chen. 2021. Decoupling the depth and scope of graph neural networks. In Advances in Neural Information Processing Systems M. Ranzato A. Beygelzimer Y. Dauphin P. S. Liang and J. Wortman Vaughan (Eds.). Vol. 34 Curran Associates Inc. 19665\u201319679. Retrieved from https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2021\/file\/a378383b89e6719e15cd1aa45478627c-Paper.pdf"},{"key":"e_1_3_1_168_2","article-title":"Graphsaint: Graph sampling based inductive learning method","author":"Zeng Hanqing","year":"2019","unstructured":"Hanqing Zeng, Hongkuan Zhou, Ajitesh Srivastava, Rajgopal Kannan, and Viktor Prasanna. 2019. Graphsaint: Graph sampling based inductive learning method. arXiv preprint arXiv:1907.04931 (2019).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_169_2","doi-asserted-by":"publisher","unstructured":"Hanqing Zeng Hongkuan Zhou Ajitesh Srivastava Rajgopal Kannan and Viktor Prasanna. 2021. Accurate efficient and scalable training of graph neural networks. Journal of Parallel and Distributed Computing 147 (2021) 166\u2013183. DOI:10.1016\/j.jpdc.2020.08.011","DOI":"10.1016\/j.jpdc.2020.08.011"},{"key":"e_1_3_1_170_2","doi-asserted-by":"publisher","DOI":"10.1109\/FCCM51124.2021.00012"},{"key":"e_1_3_1_171_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASAP49362.2020.00019"},{"key":"e_1_3_1_172_2","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330961"},{"key":"e_1_3_1_173_2","unstructured":"Hengrui Zhang Zhongming Yu Guohao Dai Guyue Huang Yufei Ding Yuan Xie and Yu Wang. 2022. Understanding GNN computational graph: A coordinated computation IO and memory perspective. In Proceedings of Machine Learning and Systems D. Marculescu Y. Chi and C. Wu (Eds.). 4 (2022) 467\u2013484. Retrieved from https:\/\/proceedings.mlsys.org\/paper_files\/paper\/2022\/file\/b559156047e50cf316207249d0b5a6c5-Paper.pdf"},{"key":"e_1_3_1_174_2","article-title":"Star-gcn: Stacked and reconstructed graph convolutional networks for recommender systems","author":"Zhang Jiani","year":"2019","unstructured":"Jiani Zhang, Xingjian Shi, Shenglin Zhao, and Irwin King. 2019. Star-gcn: Stacked and reconstructed graph convolutional networks for recommender systems. arXiv preprint arXiv:1905.13129 (2019).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_175_2","unstructured":"Shichang Zhang Yozen Liu Yizhou Sun and Neil Shah. 2022. Graph-less neural networks: Teaching old MLPs new tricks via distillation. In International Conference on Learning Representations. Retrieved from https:\/\/openreview.net\/forum?id=4p6_5HBWPCw"},{"key":"e_1_3_1_176_2","doi-asserted-by":"publisher","DOI":"10.1145\/3240765.3240801"},{"key":"e_1_3_1_177_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCAD51958.2021.9643549"},{"key":"e_1_3_1_178_2","unstructured":"Yiren Zhao Duo Wang Daniel Bates Robert Mullins Mateja Jamnik and Pietro Lio. 2020. Learned low precision graph neural networks. arXiv preprint arXiv:2009.09232 (2020)."},{"key":"e_1_3_1_179_2","first-page":"11458","volume-title":"International Conference on Machine Learning","author":"Zheng Cheng","year":"2020","unstructured":"Cheng Zheng, Bo Zong, Wei Cheng, Dongjin Song, Jingchao Ni, Wenchao Yu, Haifeng Chen, and Wei Wang. 2020. Robust graph representation learning via neural sparsification. In International Conference on Machine Learning. PMLR, 11458\u201311468."},{"key":"e_1_3_1_180_2","doi-asserted-by":"publisher","DOI":"10.1109\/IA351965.2020.00011"},{"key":"e_1_3_1_181_2","article-title":"Distributed hybrid CPU and GPU training for graph neural networks on billion-scale graphs","author":"Zheng Da","year":"2021","unstructured":"Da Zheng, Xiang Song, Chengru Yang, Dominique LaSalle, Qidong Su, Minjie Wang, Chao Ma, and George Karypis. 2021. Distributed hybrid CPU and GPU training for graph neural networks on billion-scale graphs. arXiv preprint arXiv:2112.15345 (2021).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_182_2","article-title":"Cold brew: Distilling graph node representations with incomplete or missing neighborhoods","author":"Zheng Wenqing","year":"2021","unstructured":"Wenqing Zheng, Edward W. Huang, Nikhil Rao, Sumeet Katariya, Zhangyang Wang, and Karthik Subbian. 2021. Cold brew: Distilling graph node representations with incomplete or missing neighborhoods. arXiv preprint arXiv:2111.04840 (2021).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_183_2","article-title":"Accelerating large scale real-time GNN inference using channel pruning","author":"Zhou Hongkuan","year":"2021","unstructured":"Hongkuan Zhou, Ajitesh Srivastava, Hanqing Zeng, Rajgopal Kannan, and Viktor Prasanna. 2021. Accelerating large scale real-time GNN inference using channel pruning. arXiv preprint arXiv:2105.04528 (2021).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_184_2","article-title":"TGL: A general framework for temporal GNN training on billion-scale graphs","author":"Zhou Hongkuan","year":"2022","unstructured":"Hongkuan Zhou, Da Zheng, Israt Nisa, Vasileios Ioannidis, Xiang Song, and George Karypis. 2022. TGL: A general framework for temporal GNN training on billion-scale graphs. arXiv preprint arXiv:2203.14883 (2022).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_185_2","article-title":"GNNear: Accelerating full-batch training of graph neural networks with near-memory processing","author":"Zhou Zhe","year":"2021","unstructured":"Zhe Zhou, Cong Li, Xuechao Wei, Xiaoyang Wang, and Guangyu Sun. 2021. GNNear: Accelerating full-batch training of graph neural networks with near-memory processing. Proceedings of the International Conference on Parallel Architectures and Compilation Techniques (2021). Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:251589539","journal-title":"Proceedings of the International Conference on Parallel Architectures and Compilation Techniques"},{"key":"e_1_3_1_186_2","doi-asserted-by":"publisher","DOI":"10.1109\/DAC18074.2021.9586181"},{"key":"e_1_3_1_187_2","article-title":"Aligraph: A comprehensive graph neural network platform","author":"Zhu Rong","year":"2019","unstructured":"Rong Zhu, Kun Zhao, Hongxia Yang, Wei Lin, Chang Zhou, Baole Ai, Yong Li, and Jingren Zhou. 2019. Aligraph: A comprehensive graph neural network platform. arXiv preprint arXiv:1902.08730 (2019).","journal-title":"arXiv preprint"},{"key":"e_1_3_1_188_2","doi-asserted-by":"publisher","unstructured":"Marinka Zitnik and Jure Leskovec. 2017. Predicting multicellular function through multi-layer tissue networks. Bioinformatics 33 14 (July 2017) i190\u2013i198. DOI:10.1093\/bioinformatics\/btx252","DOI":"10.1093\/bioinformatics\/btx252"},{"key":"e_1_3_1_189_2","unstructured":"Difan Zou Ziniu Hu Yewen Wang Song Jiang Yizhou Sun and Quanquan Gu. 2019. Layer-dependent importance sampling for training deep and large graph convolutional networks. In Advances in Neural Information Processing Systems H. Wallach H. Larochelle A. Beygelzimer F. d\u2019 Alch\u00e9-Buc E. Fox and R. Garnett (Eds.). Vol. 32 Curran Associates Inc. Retrieved from https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2019\/file\/91ba4a4478a66bee9812b0804b6f9d1b-Paper.pdf"}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3805796","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,27]],"date-time":"2026-04-27T09:31:18Z","timestamp":1777282278000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3805796"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,25]]},"references-count":188,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2026,8,30]]}},"alternative-id":["10.1145\/3805796"],"URL":"https:\/\/doi.org\/10.1145\/3805796","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,25]]},"assertion":[{"value":"2023-11-11","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-03-24","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-04-25","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}