{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,4]],"date-time":"2026-07-04T10:27:29Z","timestamp":1783160849529,"version":"3.54.6"},"reference-count":79,"publisher":"Association for Computing Machinery (ACM)","issue":"3","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2023,11]]},"abstract":"<jats:p>Existing Graph Neural Network (GNN) training frameworks have been designed to help developers easily create performant GNN implementations. However, most existing GNN frameworks assume that the input graphs are static, but ignore that most real-world graphs are constantly evolving. Though many dynamic GNN models have emerged to learn from evolving graphs, the training process of these dynamic GNNs is dramatically different from traditional GNNs in that it captures both the spatial and temporal dependencies of graph updates. This poses new challenges for designing dynamic GNN training frameworks. First, the traditional batched training method fails to capture real-time structural evolution information. Second, the time-dependent nature makes parallel training hard to design. Third, it lacks system supports for users to efficiently implement dynamic GNNs. In this paper, we present NeutronStream, a framework for training dynamic GNN models. NeutronStream abstracts the input dynamic graph into a chronologically updated stream of events and processes the stream with an optimized sliding window to incrementally capture the spatial-temporal dependencies of events. Furthermore, NeutronStream provides a parallel execution engine to tackle the sequential event processing challenge to achieve high performance. NeutronStream also integrates a built-in graph storage structure that supports dynamic updates and provides a set of easy-to-use APIs that allow users to express their dynamic GNNs. Our experimental results demonstrate that, compared to state-of-the-art dynamic GNN implementations, NeutronStream achieves speedups ranging from 1.48X to 5.87X and an average accuracy improvement of 3.97%.<\/jats:p>","DOI":"10.14778\/3632093.3632108","type":"journal-article","created":{"date-parts":[[2024,1,20]],"date-time":"2024-01-20T11:26:31Z","timestamp":1705749991000},"page":"455-468","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":15,"title":["NeutronStream: A Dynamic GNN Training Framework with Sliding Window for Graph Streams"],"prefix":"10.14778","volume":"17","author":[{"given":"Chaoyi","family":"Chen","sequence":"first","affiliation":[{"name":"Northeastern University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dechao","family":"Gao","sequence":"additional","affiliation":[{"name":"Northeastern University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yanfeng","family":"Zhang","sequence":"additional","affiliation":[{"name":"Northeastern University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qiange","family":"Wang","sequence":"additional","affiliation":[{"name":"Northeastern University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhenbo","family":"Fu","sequence":"additional","affiliation":[{"name":"Northeastern University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xuecang","family":"Zhang","sequence":"additional","affiliation":[{"name":"Huawei Technologies Co., Ltd."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junhua","family":"Zhu","sequence":"additional","affiliation":[{"name":"Huawei Technologies Co., Ltd."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu","family":"Gu","sequence":"additional","affiliation":[{"name":"Northeastern University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ge","family":"Yu","sequence":"additional","affiliation":[{"name":"Northeastern University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,1,20]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"[n.d.]. https:\/\/github.com\/Harryi0\/dyrep_torch.git."},{"key":"e_1_2_1_2_1","unstructured":"[n.d.]. https:\/\/github.com\/uoguelph-mlrg\/LDG.git."},{"key":"e_1_2_1_3_1","unstructured":"[n.d.]. https:\/\/github.com\/alge24\/DyGNN.git."},{"key":"e_1_2_1_4_1","unstructured":"[n.d.]. Github. https:\/\/www.gharchive.org\/."},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation","author":"Abadi Martin","year":"2016","unstructured":"Martin Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, Manjunath Kudlur, Josh Levenberg, Rajat Monga, Sherry Moore, Derek G. Murray, Benoit Steiner, Paul Tucker, Vijay Vasudevan, Pete Warden, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng. 2016. TensorFlow: A System for Large-Scale Machine Learning. In Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation (Savannah, GA, USA) (OSDI'16). USENIX Association, USA, 265--283."},{"key":"e_1_2_1_6_1","unstructured":"Micha\u00ebl Defferrard Xavier Bresson and Pierre Vandergheynst. 2016. Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering. In NIPS."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-005-0046-3"},{"key":"e_1_2_1_8_1","doi-asserted-by":"crossref","unstructured":"Wenqi Fan Yao Ma Qing Li Yuan He Eric Zhao Jiliang Tang and Dawei Yin. 2019. Graph neural networks for social recommendation. In The world wide web conference. 417--426.","DOI":"10.1145\/3308558.3313488"},{"key":"e_1_2_1_9_1","volume-title":"Fast graph representation learning with PyTorch Geometric. arXiv preprint arXiv:1903.02428","author":"Fey Matthias","year":"2019","unstructured":"Matthias Fey and Jan Eric Lenssen. 2019. Fast graph representation learning with PyTorch Geometric. arXiv preprint arXiv:1903.02428 (2019)."},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1145\/3604437.3604442","article-title":"Sortledton: a Universal Graph Data Structure","volume":"52","author":"Fuchs Per","year":"2023","unstructured":"Per Fuchs, Domagoj Margan, and Jana Giceva. 2023. Sortledton: a Universal Graph Data Structure. SIGMOD Rec. 52, 1 (2023), 17--25.","journal-title":"SIGMOD Rec."},{"key":"e_1_2_1_11_1","volume-title":"15th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2021","author":"Gandhi Swapnil","year":"2021","unstructured":"Swapnil Gandhi and Anand Padmanabha Iyer. 2021. P3: Distributed Deep Graph Learning at Scale. In 15th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2021, July 14--16, 2021, Angela Demke Brown and Jay R. Lorch (Eds.). USENIX Association, 551--568."},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the 17th International Conference on World Wide Web, WWW 2008","author":"G\u00f3mez Vicen\u00e7","year":"2008","unstructured":"Vicen\u00e7 G\u00f3mez, Andreas Kaltenbrunner, and Vicente L\u00f3pez. 2008. Statistical analysis of the social network and discussion threads in slashdot. In Proceedings of the 17th International Conference on World Wide Web, WWW 2008, Beijing, China, April 21--25, 2008, Jinpeng Huai, Robin Chen, Hsiao-Wuen Hon, Yunhao Liu, Wei-Ying Ma, Andrew Tomkins, and Xiaodong Zhang (Eds.). ACM, 645--654."},{"key":"e_1_2_1_13_1","volume-title":"DynGEM: Deep Embedding Method for Dynamic Graphs. CoRR abs\/1805.11273","author":"Goyal Palash","year":"2018","unstructured":"Palash Goyal, Nitin Kamra, Xinran He, and Yan Liu. 2018. DynGEM: Deep Embedding Method for Dynamic Graphs. CoRR abs\/1805.11273 (2018). arXiv:1805.11273 http:\/\/arxiv.org\/abs\/1805.11273"},{"key":"e_1_2_1_14_1","volume-title":"GRADES-NDA '22: Proceedings of the 5th ACM SIGMOD Joint International Workshop on Graph Data Management Experiences & Systems (GRADES) and Network Data Analytics (NDA)","author":"Guan Mingyu","year":"2022","unstructured":"Mingyu Guan, Anand Padmanabha Iyer, and Taesoo Kim. 2022. DynaGraph: dynamic graph neural networks at scale. In GRADES-NDA '22: Proceedings of the 5th ACM SIGMOD Joint International Workshop on Graph Data Management Experiences & Systems (GRADES) and Network Data Analytics (NDA), Philadelphia, Pennsylvania, USA, 12 June 2022, Vasiliki Kalavri and Semih Salihoglu (Eds.). ACM, 6:1--6:10."},{"key":"e_1_2_1_15_1","volume-title":"Inductive representation learning on large graphs. Advances in neural information processing systems 30","author":"Hamilton Will","year":"2017","unstructured":"Will Hamilton, Zhitao Ying, and Jure Leskovec. 2017. Inductive representation learning on large graphs. Advances in neural information processing systems 30 (2017)."},{"key":"e_1_2_1_16_1","volume-title":"In Proceedings of Machine Learning and Systems.","author":"Jia Zhihao","year":"2020","unstructured":"Zhihao Jia, Sina Lin, Mingyu Gao, Matei Zaharia, and Alex Aiken. 2020. Improving the Accuracy, Scalability, and Performance of Graph Neural Networks with Roc. In In Proceedings of Machine Learning and Systems."},{"key":"e_1_2_1_17_1","first-page":"1","article-title":"Representation Learning for Dynamic Graphs: A Survey","volume":"21","author":"Kazemi Seyed Mehran","year":"2020","unstructured":"Seyed Mehran Kazemi, Rishab Goel, Kshitij Jain, Ivan Kobyzev, Akshay Sethi, Peter Forsyth, and Pascal Poupart. 2020. Representation Learning for Dynamic Graphs: A Survey. J. Mach. Learn. Res. 21, 70 (2020), 1--73.","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_2_1_18_1","volume-title":"Kipf and Max Welling","author":"Thomas","year":"2017","unstructured":"Thomas N. Kipf and Max Welling. 2017. Semi-Supervised Classification with Graph Convolutional Networks. In 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24--26, 2017, Conference Track Proceedings. OpenReview.net. https:\/\/openreview.net\/forum?id=SJU4ayYgl"},{"key":"e_1_2_1_19_1","doi-asserted-by":"crossref","first-page":"e0247936","DOI":"10.1371\/journal.pone.0247936","article-title":"Learning temporal attention in dynamic graphs with bilinear interactions","volume":"16","author":"Knyazev Boris","year":"2021","unstructured":"Boris Knyazev, Carolyn Augusta, and Graham W Taylor. 2021. Learning temporal attention in dynamic graphs with bilinear interactions. Plos one 16, 3 (2021), e0247936.","journal-title":"Plos one"},{"key":"e_1_2_1_20_1","volume-title":"Learning dynamic embeddings from temporal interactions. arXiv preprint arXiv:1812.02289","author":"Kumar Srijan","year":"2018","unstructured":"Srijan Kumar, Xikun Zhang, and Jure Leskovec. 2018. Learning dynamic embeddings from temporal interactions. arXiv preprint arXiv:1812.02289 (2018)."},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the 22nd International Conference on World Wide Web (Rio de Janeiro, Brazil) (WWW '13 Companion). Association for Computing Machinery","author":"Kunegis J\u00e9r\u00f4me","year":"2013","unstructured":"J\u00e9r\u00f4me Kunegis. 2013. KONECT: The Koblenz Network Collection. In Proceedings of the 22nd International Conference on World Wide Web (Rio de Janeiro, Brazil) (WWW '13 Companion). Association for Computing Machinery, New York, NY, USA, 1343--1350. 10.1145\/2487788.2488173"},{"key":"e_1_2_1_22_1","doi-asserted-by":"crossref","first-page":"1053","DOI":"10.14778\/3447689.3447708","article-title":"Teseo and the Analysis of Structural Dynamic Graphs","volume":"14","author":"Leo Dean De","year":"2021","unstructured":"Dean De Leo and Peter A. Boncz. 2021. Teseo and the Analysis of Structural Dynamic Graphs. Proc. VLDB Endow. 14, 6 (2021), 1053--1066.","journal-title":"Proc. VLDB Endow."},{"key":"e_1_2_1_23_1","volume-title":"arXiv preprint arXiv:2203.16123","author":"Li Hongzheng","year":"2022","unstructured":"Hongzheng Li, Yingxia Shao, Junping Du, Bin Cui, and Lei Chen. 2022. An I\/O-efficient disk-based graph system for scalable second-order random walk of large graphs. arXiv preprint arXiv:2203.16123 (2022)."},{"key":"e_1_2_1_24_1","doi-asserted-by":"crossref","first-page":"1332","DOI":"10.14778\/3583140.3583150","article-title":"Zebra: When Temporal Graph Neural Networks Meet Temporal Personalized PageRank","volume":"16","author":"Li Yiming","year":"2023","unstructured":"Yiming Li, Yanyan Shen, Lei Chen, and Mingxuan Yuan. 2023. Zebra: When Temporal Graph Neural Networks Meet Temporal Personalized PageRank. Proceedings of the VLDB Endowment 16, 6 (2023), 1332--1345.","journal-title":"Proceedings of the VLDB Endowment"},{"key":"e_1_2_1_25_1","volume-title":"Learning deep generative models of graphs. arXiv preprint arXiv:1803.03324","author":"Li Yujia","year":"2018","unstructured":"Yujia Li, Oriol Vinyals, Chris Dyer, Razvan Pascanu, and Peter Battaglia. 2018. Learning deep generative models of graphs. arXiv preprint arXiv:1803.03324 (2018)."},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of ICLR'16","author":"Li Yujia","year":"2016","unstructured":"Yujia Li, Richard Zemel, Marc Brockschmidt, and Daniel Tarlow. 2016. Gated Graph Sequence Neural Networks. In Proceedings of ICLR'16."},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the 28th ACM international conference on information and knowledge management. 469--478","author":"Lu Yuanfu","year":"2019","unstructured":"Yuanfu Lu, Xiao Wang, Chuan Shi, Philip S Yu, and Yanfang Ye. 2019. Temporal network embedding with micro-and macro-dynamics. In Proceedings of the 28th ACM international conference on information and knowledge management. 469--478."},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 719--728","author":"Ma Yao","year":"2020","unstructured":"Yao Ma, Ziyi Guo, Zhaocun Ren, Jiliang Tang, and Dawei Yin. 2020. Streaming graph neural networks. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 719--728."},{"key":"e_1_2_1_29_1","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1109\/MPRV.2011.79","article-title":"Sensing the\" health state\" of a community","volume":"11","author":"Madan Anmol","year":"2011","unstructured":"Anmol Madan, Manuel Cebrian, Sai Moturu, Katayoun Farrahi, et al. 2011. Sensing the\" health state\" of a community. IEEE Pervasive Computing 11, 4 (2011), 36--45.","journal-title":"IEEE Pervasive Computing"},{"key":"e_1_2_1_30_1","volume-title":"EMNLP 2017-Conference on Empirical Methods in Natural Language Processing, Proceedings. 1506--1515","author":"Marcheggiani D","year":"2017","unstructured":"D Marcheggiani and I Titov. 2017. Encoding sentences with graph convolutional networks for semantic role labeling. In EMNLP 2017-Conference on Empirical Methods in Natural Language Processing, Proceedings. 1506--1515."},{"key":"e_1_2_1_31_1","volume-title":"HET: scaling out huge embedding model training via cache-enabled distributed framework. arXiv preprint arXiv:2112.07221","author":"Miao Xupeng","year":"2021","unstructured":"Xupeng Miao, Hailin Zhang, Yining Shi, Xiaonan Nie, Zhi Yang, Yangyu Tao, and Bin Cui. 2021. HET: scaling out huge embedding model training via cache-enabled distributed framework. arXiv preprint arXiv:2112.07221 (2021)."},{"key":"e_1_2_1_32_1","volume-title":"P2CG: a privacy preserving collaborative graph neural network training framework. The VLDB Journal","author":"Miao Xupeng","year":"2022","unstructured":"Xupeng Miao, Wentao Zhang, Yuezihan Jiang, Fangcheng Fu, Yingxia Shao, Lei Chen, Yangyu Tao, Gang Cao, and Bin Cui. 2022. P2CG: a privacy preserving collaborative graph neural network training framework. The VLDB Journal (2022), 1--20."},{"key":"e_1_2_1_33_1","volume-title":"Lasagne: A multi-layer graph convolutional network framework via node-aware deep architecture","author":"Miao Xupeng","year":"2021","unstructured":"Xupeng Miao, Wentao Zhang, Yingxia Shao, Bin Cui, Lei Chen, Ce Zhang, and Jiawei Jiang. 2021. Lasagne: A multi-layer graph convolutional network framework via node-aware deep architecture. IEEE Transactions on Knowledge and Data Engineering (2021)."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2206.03469"},{"key":"e_1_2_1_35_1","volume-title":"Geometric Matrix Completion with Recurrent Multi-Graph Neural Networks. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017","author":"Monti Federico","year":"2017","unstructured":"Federico Monti, Michael M. Bronstein, and Xavier Bresson. 2017. Geometric Matrix Completion with Recurrent Multi-Graph Neural Networks. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4--9, 2017, Long Beach, CA, USA, Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett (Eds.). 3697--3707."},{"key":"e_1_2_1_36_1","volume-title":"Continuous-Time Dynamic Network Embeddings. In Companion of the The Web Conference 2018 on The Web Conference 2018, WWW 2018","author":"Nguyen Giang Hoang","year":"2018","unstructured":"Giang Hoang Nguyen, John Boaz Lee, Ryan A. Rossi, Nesreen K. Ahmed, Eunyee Koh, and Sungchul Kim. 2018. Continuous-Time Dynamic Network Embeddings. In Companion of the The Web Conference 2018 on The Web Conference 2018, WWW 2018, Lyon, France, April 23--27, 2018, Pierre-Antoine Champin, Fabien Gandon, Mounia Lalmas, and Panagiotis G. Ipeirotis (Eds.). ACM, 969--976. 10.1145\/3184558.3191526"},{"key":"e_1_2_1_37_1","doi-asserted-by":"crossref","first-page":"8770","DOI":"10.1002\/int.22967","article-title":"Sparse-Dyn: Sparse dynamic graph multirepresentation learning via event-based sparse temporal attention network","volume":"37","author":"Pang Yan","year":"2022","unstructured":"Yan Pang, Ai Shan, Zhen Wang, Mengyu Wang, Jianwei Li, Ji Zhang, Teng Huang, and Chao Liu. 2022. Sparse-Dyn: Sparse dynamic graph multirepresentation learning via event-based sparse temporal attention network. International Journal of Intelligent Systems 37, 11 (2022), 8770--8789.","journal-title":"International Journal of Intelligent Systems"},{"key":"e_1_2_1_38_1","volume-title":"Leiserson","author":"Pareja Aldo","year":"2020","unstructured":"Aldo Pareja, Giacomo Domeniconi, Jie Chen, Tengfei Ma, Toyotaro Suzumura, Hiroki Kanezashi, Tim Kaler, Tao B. Schardl, and Charles E. Leiserson. 2020. EvolveGCN: Evolving Graph Convolutional Networks for Dynamic Graphs. In The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020, The Thirty-Second Innovative Applications of Artificial Intelligence Conference, IAAI 2020, The Tenth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2020, New York, NY, USA, February 7--12, 2020. AAAI Press, 5363--5370. https:\/\/ojs.aaai.org\/index.php\/AAAI\/article\/view\/5984"},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2019","author":"Park Namyong","year":"2019","unstructured":"Namyong Park, Andrey Kan, Xin Luna Dong, Tong Zhao, and Christos Faloutsos. 2019. Estimating Node Importance in Knowledge Graphs Using Graph Neural Networks. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2019, Anchorage, AK, USA, August 4--8, 2019, Ankur Teredesai, Vipin Kumar, Ying Li, R\u00f3mer Rosales, Evimaria Terzi, and George Karypis (Eds.). ACM, 596--606."},{"key":"e_1_2_1_40_1","doi-asserted-by":"crossref","first-page":"2626","DOI":"10.14778\/3551793.3551819","article-title":"Ginex: SSD-enabled Billion-scale Graph Neural Network Training on a Single Machine via Provably Optimal In-memory Caching","volume":"15","author":"Park Yeonhong","year":"2022","unstructured":"Yeonhong Park, Sunhong Min, and Jae W. Lee. 2022. Ginex: SSD-enabled Billion-scale Graph Neural Network Training on a Single Machine via Provably Optimal In-memory Caching. Proc. VLDB Endow. 15, 11 (2022), 2626--2639.","journal-title":"Proc. VLDB Endow."},{"key":"e_1_2_1_41_1","volume-title":"Proceedings of the 33rd International Conference on Neural Information Processing Systems. 8026--8037","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al. 2019. PyTorch: an imperative style, high-performance deep learning library. In Proceedings of the 33rd International Conference on Neural Information Processing Systems. 8026--8037."},{"key":"e_1_2_1_42_1","doi-asserted-by":"crossref","first-page":"1937","DOI":"10.14778\/3538598.3538614","article-title":"SANCUS: Staleness-Aware Communication-Avoiding Full-Graph Decentralized Training in Large-Scale Graph Neural Networks","volume":"15","author":"Peng Jingshu","year":"2022","unstructured":"Jingshu Peng, Zhao Chen, Yingxia Shao, Yanyan Shen, Lei Chen, and Jiannong Cao. 2022. SANCUS: Staleness-Aware Communication-Avoiding Full-Graph Decentralized Training in Large-Scale Graph Neural Networks. Proc. VLDB Endow. 15, 9 (2022), 1937--1950.","journal-title":"Proc. VLDB Endow."},{"key":"e_1_2_1_43_1","volume-title":"2021 IEEE International Conference on Data Mining (ICDM 21)","author":"Peng Jingshu","year":"2021","unstructured":"Jingshu Peng, Yanyan Shen, and Lei Chen. 2021. GraphANGEL: Adaptive aNd Structure-Aware Sampling on Graph NEuraL Networks. In 2021 IEEE International Conference on Data Mining (ICDM 21). 479--488."},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, SIGIR 2020","author":"Qin Jiarui","year":"2020","unstructured":"Jiarui Qin, Weinan Zhang, Xin Wu, Jiarui Jin, Yuchen Fang, and Yong Yu. 2020. User Behavior Retrieval for Click-Through Rate Prediction. In Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, SIGIR 2020, Virtual Event, China, July 25--30, 2020, Jimmy X. Huang, Yi Chang, Xueqi Cheng, Jaap Kamps, Vanessa Murdock, Ji-Rong Wen, and Yiqun Liu (Eds.). ACM, 2347--2356."},{"key":"e_1_2_1_45_1","volume-title":"Temporal graph networks for deep learning on dynamic graphs. arXiv preprint arXiv:2006.10637","author":"Rossi Emanuele","year":"2020","unstructured":"Emanuele Rossi, Ben Chamberlain, Fabrizio Frasca, Davide Eynard, Federico Monti, and Michael Bronstein. 2020. Temporal graph networks for deep learning on dynamic graphs. arXiv preprint arXiv:2006.10637 (2020)."},{"key":"e_1_2_1_46_1","volume-title":"Ahmed","author":"Rossi Ryan A.","year":"2015","unstructured":"Ryan A. Rossi and Nesreen K. Ahmed. 2015. The Network Data Repository with Interactive Graph Analytics and Visualization. In AAAI. https:\/\/networkrepository.com"},{"key":"e_1_2_1_47_1","volume-title":"Oliver Kiss, Ferenc B\u00e9res, Guzm\u00e1n L\u00f3pez, Nicolas Collignon, and Rik Sarkar.","author":"Rozemberczki Benedek","year":"2021","unstructured":"Benedek Rozemberczki, Paul Scherer, Yixuan He, George Panagopoulos, Alexander Riedel, Maria Sinziana Astefanoaei, Oliver Kiss, Ferenc B\u00e9res, Guzm\u00e1n L\u00f3pez, Nicolas Collignon, and Rik Sarkar. 2021. PyTorch Geometric Temporal: Spatiotemporal Signal Processing with Neural Machine Learning Models. In CIKM '21: The 30th ACM International Conference on Information and Knowledge Management, Virtual Event, Queensland, Australia, November 1 - 5, 2021, Gianluca Demartini, Guido Zuccon, J. Shane Culpepper, Zi Huang, and Hanghang Tong (Eds.). ACM, 4564--4573."},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of the 13th International Conference on Web Search and Data Mining. 519--527","author":"Sankar Aravind","year":"2020","unstructured":"Aravind Sankar, Yanhong Wu, Liang Gou, Wei Zhang, and Hao Yang. 2020. Dysat: Deep neural representation learning on dynamic graphs via self-attention networks. In Proceedings of the 13th International Conference on Web Search and Data Mining. 519--527."},{"key":"e_1_2_1_49_1","volume-title":"European semantic web conference","author":"Schlichtkrull Michael","unstructured":"Michael Schlichtkrull, Thomas N Kipf, Peter Bloem, Rianne van den Berg, Ivan Titov, and Max Welling. 2018. Modeling relational data with graph convolutional networks. In European semantic web conference. Springer, 593--607."},{"key":"e_1_2_1_50_1","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1109\/TCAD.2021.3052138","article-title":"Cambricon-G: A Polyvalent Energy-Efficient Accelerator for Dynamic Graph Neural Networks","volume":"41","author":"Song Xinkai","year":"2022","unstructured":"Xinkai Song, Tian Zhi, Zhe Fan, Zhenxing Zhang, Xi Zeng, Wei Li, Xing Hu, Zidong Du, Qi Guo, and Yunji Chen. 2022. Cambricon-G: A Polyvalent Energy-Efficient Accelerator for Dynamic Graph Neural Networks. IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 41, 1 (2022), 116--128.","journal-title":"IEEE Trans. Comput. Aided Des. Integr. Circuits Syst."},{"key":"e_1_2_1_51_1","unstructured":"Rakshit S. Trivedi Mehrdad Farajtabar Prasenjeet Biswal and Hongyuan Zha. 2019. DyRep: Learning Representations over Dynamic Graphs. In ICLR."},{"key":"e_1_2_1_52_1","volume-title":"Graph Attention Networks. In International Conference on Learning Representations.","author":"Veli\u010dkovi\u0107 Petar","year":"2018","unstructured":"Petar Veli\u010dkovi\u0107, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Li\u00f2, and Yoshua Bengio. 2018. Graph Attention Networks. In International Conference on Learning Representations."},{"key":"e_1_2_1_53_1","volume-title":"PiPAD: Pipelined and Parallel Dynamic GNN Training on GPUs. arXiv preprint arXiv:2301.00391","author":"Wang Chunyang","year":"2023","unstructured":"Chunyang Wang, Desen Sun, and Yuebin Bai. 2023. PiPAD: Pipelined and Parallel Dynamic GNN Training on GPUs. arXiv preprint arXiv:2301.00391 (2023)."},{"key":"e_1_2_1_54_1","volume-title":"Database Systems for Advanced Applications: 28th International Conference, DASFAA","author":"Wang Liping","year":"2023","unstructured":"Liping Wang, Yanyan Shen, and Lei Chen. [n.d.]. TE-DyGE: Temporal Evolution-Enhanced Dynamic Graph Embedding Network. In Database Systems for Advanced Applications: 28th International Conference, DASFAA 2023, Tianjin, China, April 17--20, 2023, Proceedings, Part III. 183--198."},{"key":"e_1_2_1_55_1","volume-title":"Highly-Performant Package for Graph Neural Networks. arXiv preprint arXiv:1909.01315","author":"Wang Minjie","year":"2019","unstructured":"Minjie Wang, Da Zheng, Zihao Ye, Quan Gan, Mufei Li, Xiang Song, Jinjing Zhou, Chao Ma, Lingfan Yu, Yu Gai, Tianjun Xiao, Tong He, George Karypis, Jinyang Li, and Zheng Zhang. 2019. Deep Graph Library: A Graph-Centric, Highly-Performant Package for Graph Neural Networks. arXiv preprint arXiv:1909.01315 (2019)."},{"key":"e_1_2_1_56_1","volume-title":"NeutronStar:Distributed GNN Training with Hybrid Dependency Management. In ACM International Conference on Management of Data (SIGMOD 22)","author":"Wang Qiange","year":"2022","unstructured":"Qiange Wang, Yangfeng Zhang, Hao Wang, Chaoyi Chen, Xiaodong Zhang, and Ge Yu. 2022. NeutronStar:Distributed GNN Training with Hybrid Dependency Management. In ACM International Conference on Management of Data (SIGMOD 22). 770--778."},{"key":"e_1_2_1_57_1","volume-title":"APAN: Asynchronous Propagation Attention Network for Real-time Temporal Graph Embedding. In SIGMOD '21: International Conference on Management of Data","author":"Wang Xuhong","year":"2021","unstructured":"Xuhong Wang, Ding Lyu, Mengjian Li, Yang Xia, Qi Yang, Xinwen Wang, Xinguang Wang, Ping Cui, Yupu Yang, Bowen Sun, and Zhenyu Guo. 2021. APAN: Asynchronous Propagation Attention Network for Real-time Temporal Graph Embedding. In SIGMOD '21: International Conference on Management of Data, Virtual Event, China, June 20--25, 2021, Guoliang Li, Zhanhuai Li, Stratos Idreos, and Divesh Srivastava (Eds.). ACM, 2628--2638."},{"key":"e_1_2_1_58_1","volume-title":"Dynamic graph cnn for learning on point clouds. ACM Transactions on Graphics (tog) 38, 5","author":"Wang Yue","year":"2019","unstructured":"Yue Wang, Yongbin Sun, Ziwei Liu, Sanjay E Sarma, Michael M Bronstein, and Justin M Solomon. 2019. Dynamic graph cnn for learning on point clouds. ACM Transactions on Graphics (tog) 38, 5 (2019), 1--12."},{"key":"e_1_2_1_59_1","volume-title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, IJCAI 2018","author":"Wang Zhouxia","year":"2018","unstructured":"Zhouxia Wang, Tianshui Chen, Jimmy S. J. Ren, Weihao Yu, Hui Cheng, and Liang Lin. 2018. Deep Reasoning with Knowledge Graph for Social Relationship Understanding. In Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, IJCAI 2018, July 13--19, 2018, Stockholm, Sweden, J\u00e9r\u00f4me Lang (Ed.). ijcai.org, 1021--1028."},{"key":"e_1_2_1_60_1","volume-title":"Graph Neural Networks in Recommender Systems: A Survey. arXiv preprint arXiv:2011.02260","author":"Wu Shiwen","year":"2020","unstructured":"Shiwen Wu, Wentao Zhang, Fei Sun, and Bin Cui. 2020. Graph Neural Networks in Recommender Systems: A Survey. arXiv preprint arXiv:2011.02260 (2020)."},{"key":"e_1_2_1_61_1","volume-title":"EuroSys '21: Sixteenth European Conference on Computer Systems","author":"Wu Yidi","year":"2021","unstructured":"Yidi Wu, Kaihao Ma, Zhenkun Cai, Tatiana Jin, Boyang Li, Chengguang Zheng, James Cheng, and Fan Yu. 2021. Seastar: vertex-centric programming for graph neural networks. In EuroSys '21: Sixteenth European Conference on Computer Systems, Online Event, United Kingdom, April 26--28, 2021, Antonio Barbalace, Pramod Bhatotia, Lorenzo Alvisi, and Cristian Cadar (Eds.). ACM, 359--375."},{"key":"e_1_2_1_62_1","volume-title":"A comprehensive survey on graph neural networks","author":"Wu Zonghan","year":"2020","unstructured":"Zonghan Wu, Shirui Pan, Fengwen Chen, Guodong Long, Chengqi Zhang, and S Yu Philip. 2020. A comprehensive survey on graph neural networks. IEEE transactions on neural networks and learning systems 32, 1 (2020), 4--24."},{"key":"e_1_2_1_63_1","volume-title":"Inductive representation learning on temporal graphs. arXiv preprint arXiv:2002.07962","author":"Xu Da","year":"2020","unstructured":"Da Xu, Chuanwei Ruan, Evren Korpeoglu, Sushant Kumar, and Kannan Achan. 2020. Inductive representation learning on temporal graphs. arXiv preprint arXiv:2002.07962 (2020)."},{"key":"e_1_2_1_64_1","volume-title":"International Conference on Learning Representations.","author":"Xu Keyulu","year":"2018","unstructured":"Keyulu Xu, Weihua Hu, Jure Leskovec, and Stefanie Jegelka. 2018. How Powerful are Graph Neural Networks?. In International Conference on Learning Representations."},{"key":"e_1_2_1_65_1","volume-title":"EuroSys '22: Seventeenth European Conference on Computer Systems","author":"Yang Jianbang","year":"2022","unstructured":"Jianbang Yang, Dahai Tang, Xiaoniu Song, Lei Wang, Qiang Yin, Rong Chen, Wenyuan Yu, and Jingren Zhou. 2022. GNNLab: a factored system for sample-based GNN training over GPUs. In EuroSys '22: Seventeenth European Conference on Computer Systems, Rennes, France, April 5 - 8, 2022, Y\u00e9rom-David Bromberg, Anne-Marie Kermarrec, and Christos Kozyrakis (Eds.). ACM, 417--434."},{"key":"e_1_2_1_66_1","volume-title":"Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 2383--2392","author":"Yin Hongbo","year":"2022","unstructured":"Hongbo Yin, Yingxia Shao, Xupeng Miao, Yawen Li, and Bin Cui. 2022. Scalable Graph Sampling on GPUs with Compressed Graph. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 2383--2392."},{"key":"e_1_2_1_67_1","volume-title":"Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2018","author":"Ying Rex","year":"2018","unstructured":"Rex Ying, Ruining He, Kaifeng Chen, Pong Eksombatchai, William L. Hamilton, and Jure Leskovec. 2018. Graph Convolutional Neural Networks for Web-Scale Recommender Systems. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2018, London, UK, August 19--23, 2018, Yike Guo and Faisal Farooq (Eds.). ACM, 974--983."},{"key":"e_1_2_1_68_1","volume-title":"Hierarchical graph representation learning with differentiable pooling. Advances in neural information processing systems 31","author":"Ying Zhitao","year":"2018","unstructured":"Zhitao Ying, Jiaxuan You, Christopher Morris, Xiang Ren, Will Hamilton, and Jure Leskovec. 2018. Hierarchical graph representation learning with differentiable pooling. Advances in neural information processing systems 31 (2018)."},{"key":"e_1_2_1_69_1","volume-title":"Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 793--803","author":"Zhang Chuxu","year":"2019","unstructured":"Chuxu Zhang, Dongjin Song, Chao Huang, Ananthram Swami, and Nitesh V Chawla. 2019. Heterogeneous graph neural network. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 793--803."},{"key":"e_1_2_1_70_1","volume-title":"Proceedings of the ACM Web Conference 2022. 1817","author":"Zhang Wentao","year":"2022","unstructured":"Wentao Zhang, Yu Shen, Zheyu Lin, Yang Li, Xiaosen Li, Wen Ouyang, Yangyu Tao, Zhi Yang, and Bin Cui. 2022. Pasca: A graph neural architecture search system under the scalable paradigm. In Proceedings of the ACM Web Conference 2022. 1817--1828."},{"key":"e_1_2_1_71_1","volume-title":"Feature-Oriented Sampling for Fast and Scalable GNN Training. In 2022 IEEE International Conference on Data Mining (ICDM). 723--732","author":"Zhang Xin","year":"2022","unstructured":"Xin Zhang, Yanyan Shen, and Lei Chen. 2022. Feature-Oriented Sampling for Fast and Scalable GNN Training. In 2022 IEEE International Conference on Data Mining (ICDM). 723--732."},{"key":"e_1_2_1_72_1","volume-title":"DUCATI: A Dual-Cache Training System for Graph Neural Networks on Giant Graphs with GPU. In ACM International Conference on Management of Data (SIGMOD 23)","author":"Zhang Xin","year":"2023","unstructured":"Xin Zhang, Yanyan Shen, Yingxia Shao, and Lei Chen. 2023. DUCATI: A Dual-Cache Training System for Graph Neural Networks on Giant Graphs with GPU. In ACM International Conference on Management of Data (SIGMOD 23). 479--488."},{"key":"e_1_2_1_73_1","doi-asserted-by":"crossref","first-page":"1228","DOI":"10.14778\/3514061.3514069","article-title":"ByteGNN: Efficient Graph Neural Network Training at Large Scale","volume":"15","author":"Zheng Chenguang","year":"2022","unstructured":"Chenguang Zheng, Hongzhi Chen, Yuxuan Cheng, Zhezheng Song, Yifan Wu, Changji Li, James Cheng, Hao Yang, and Shuai Zhang. 2022. ByteGNN: Efficient Graph Neural Network Training at Large Scale. Proc. VLDB Endow. 15, 6 (2022), 1228--1242.","journal-title":"Proc. VLDB Endow."},{"key":"e_1_2_1_74_1","volume-title":"DistDGL: Distributed Graph Neural Network Training for Billion-Scale Graphs. arXiv preprint arXiv","author":"Zheng Da","year":"2010","unstructured":"Da Zheng, Chao Ma, Minjie Wang, Jinjing Zhou, Qidong Su, Xiang Song, Quan Gan, Zheng Zhang, and George Karypis. 2020. DistDGL: Distributed Graph Neural Network Training for Billion-Scale Graphs. arXiv preprint arXiv 2010.05337 (2020)."},{"key":"e_1_2_1_75_1","doi-asserted-by":"crossref","first-page":"1572","DOI":"10.14778\/3529337.3529342","article-title":"TGL: A General Framework for Temporal GNN Training onBillion-Scale Graphs","volume":"15","author":"Zhou Hongkuan","year":"2022","unstructured":"Hongkuan Zhou, Da Zheng, Israt Nisa, Vassilis N. Ioannidis, Xiang Song, and George Karypis. 2022. TGL: A General Framework for Temporal GNN Training onBillion-Scale Graphs. Proc. VLDB Endow. 15, 8 (2022), 1572--1580.","journal-title":"Proc. VLDB Endow."},{"key":"e_1_2_1_76_1","doi-asserted-by":"crossref","first-page":"2094","DOI":"10.14778\/3352063.3352127","article-title":"AliGraph: A Comprehensive Graph Neural Network Platform","volume":"12","author":"Zhu Rong","year":"2019","unstructured":"Rong Zhu, Kun Zhao, Hongxia Yang, Wei Lin, Chang Zhou, Baole Ai, Yong Li, and Jingren Zhou. 2019. AliGraph: A Comprehensive Graph Neural Network Platform. In Proceedings of the VLDB Endowment 12, 12 (2019), 2094--2105.","journal-title":"Proceedings of the VLDB Endowment"},{"key":"e_1_2_1_77_1","doi-asserted-by":"crossref","first-page":"1020","DOI":"10.14778\/3384345.3384351","article-title":"LiveGraph: A Transactional Graph Storage System with Purely Sequential Adjacency List Scans","volume":"13","author":"Zhu Xiaowei","year":"2020","unstructured":"Xiaowei Zhu, Marco Serafini, Xiaosong Ma, Ashraf Aboulnaga, Wenguang Chen, and Guanyu Feng. 2020. LiveGraph: A Transactional Graph Storage System with Purely Sequential Adjacency List Scans. Proc. VLDB Endow. 13, 7 (2020), 1020--1034.","journal-title":"Proc. VLDB Endow."},{"key":"e_1_2_1_78_1","volume-title":"Encoder-Decoder Architecture for Supervised Dynamic Graph Learning: A Survey. CoRR abs\/2203.10480","author":"Zhu Yuecai","year":"2022","unstructured":"Yuecai Zhu, Fuyuan Lyu, Chengming Hu, Xi Chen, and Xue Liu. 2022. Encoder-Decoder Architecture for Supervised Dynamic Graph Learning: A Survey. CoRR abs\/2203.10480 (2022)."},{"key":"e_1_2_1_79_1","volume-title":"Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining. 2857--2866","author":"Zuo Yuan","year":"2018","unstructured":"Yuan Zuo, Guannan Liu, Hao Lin, Jia Guo, Xiaoqian Hu, and Junjie Wu. 2018. Embedding temporal network via neighborhood formation. In Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining. 2857--2866."}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3632093.3632108","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,20]],"date-time":"2024-01-20T11:35:04Z","timestamp":1705750504000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3632093.3632108"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11]]},"references-count":79,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,11]]}},"alternative-id":["10.14778\/3632093.3632108"],"URL":"https:\/\/doi.org\/10.14778\/3632093.3632108","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2023,11]]},"assertion":[{"value":"2024-01-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}