{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,22]],"date-time":"2026-07-22T16:42:58Z","timestamp":1784738578412,"version":"3.55.0"},"reference-count":76,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2022,5,3]],"date-time":"2022-05-03T00:00:00Z","timestamp":1651536000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Science Foundation","award":["IIS-184981"],"award-info":[{"award-number":["IIS-184981"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2022,8,31]]},"abstract":"<jats:p>Distributed surveillance systems have the ability to detect, track, and snapshot objects moving around in a certain space. The systems generate video data from multiple personal devices or street cameras. Intelligent video-analysis models are needed to learn dynamic representation of the objects for detection and tracking. Can we exploit the structural and dynamic information without storing the spatiotemporal video data at a central server that leads to a violation of user privacy? In this work, we introduce Federated Dynamic Graph Neural Network (Feddy), a distributed and secured framework to learn the object representations from graph sequences: (1) It aggregates structural information from nearby objects in the current graph as well as dynamic information from those in the previous graph. It uses a self-supervised loss of predicting the trajectories of objects. (2) It is trained in a federated learning manner. The centrally located server sends the model to user devices. Local models on the respective user devices learn and periodically send their learning to the central server without ever exposing the user\u2019s data to server. (3) Studies showed that the aggregated parameters could be inspected though decrypted when broadcast to clients for model synchronizing, after the server performed a weighted average. We design an appropriate aggregation mechanism of secure aggregation primitives that can protect the security and privacy in federated learning with scalability. Experiments on four video camera datasets as well as simulation demonstrate that Feddy achieves great effectiveness and security.<\/jats:p>","DOI":"10.1145\/3501808","type":"journal-article","created":{"date-parts":[[2022,2,4]],"date-time":"2022-02-04T22:33:18Z","timestamp":1644013998000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":28,"title":["Federated Dynamic Graph Neural Networks with Secure Aggregation for Video-based Distributed Surveillance"],"prefix":"10.1145","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3009-519X","authenticated-orcid":false,"given":"Meng","family":"Jiang","sequence":"first","affiliation":[{"name":"University of Notre Dame, Notre Dame, IN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Taeho","family":"Jung","sequence":"additional","affiliation":[{"name":"University of Notre Dame, Notre Dame, IN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ryan","family":"Karl","sequence":"additional","affiliation":[{"name":"University of Notre Dame, Notre Dame, IN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tong","family":"Zhao","sequence":"additional","affiliation":[{"name":"University of Notre Dame, Notre Dame, IN"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,5,3]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/2976749.2978318"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-47989-6_15"},{"key":"e_1_3_2_4_2","volume-title":"Transitioning the Use of Cryptographic Algorithms and Key Lengths","author":"Barker Elaine","year":"2018","unstructured":"Elaine Barker and Allen Roginsky. 2018. Transitioning the Use of Cryptographic Algorithms and Key Lengths. Technical Report. National Institute of Standards and Technology."},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/2873069"},{"key":"e_1_3_2_6_2","article-title":"Towards federated learning at scale: System design","author":"Bonawitz Keith","year":"2019","unstructured":"Keith Bonawitz, Hubert Eichner, Wolfgang Grieskamp, Dzmitry Huba, Alex Ingerman, Vladimir Ivanov, Chloe Kiddon, Jakub Konecny, Stefano Mazzocchi, H. Brendan McMahan, et\u00a0al. 2019. Towards federated learning at scale: System design. arXiv preprint arXiv:1902.01046 (2019).","journal-title":"arXiv preprint arXiv:1902.01046"},{"key":"e_1_3_2_7_2","volume-title":"Proceedings of the NIPS Workshop on Private Multi-party Machine Learning","author":"Bonawitz Keith","year":"2016","unstructured":"Keith Bonawitz, Vladimir Ivanov, Ben Kreuter, Antonio Marcedone, H. Brendan McMahan, Sarvar Patel, Daniel Ramage, Aaron Segal, and Karn Seth. 2016. Practical secure aggregation for federated learning on user-held data. In Proceedings of the NIPS Workshop on Private Multi-party Machine Learning."},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3133956.3133982"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1007\/BFb0054851"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-56614-6_6"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2006.55"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-34621-8_16"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2019.2909473"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-44598-6_14"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-11799-2_12"},{"key":"e_1_3_2_16_2","first-page":"3844","volume-title":"Proceedings of the Conference on Advances in Neural Information Processing Systems","author":"Defferrard Micha\u00ebl","year":"2016","unstructured":"Micha\u00ebl Defferrard, Xavier Bresson, and Pierre Vandergheynst. 2016. Convolutional neural networks on graphs with fast localized spectral filtering. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 3844\u20133852."},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611972740.21"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/2810103.2813677"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-48000-7_4"},{"key":"e_1_3_2_20_2","first-page":"1024","volume-title":"Proceedings of the Conference on Advances in Neural Information Processing Systems","author":"Hamilton Will","year":"2017","unstructured":"Will Hamilton, Zhitao Ying, and Jure Leskovec. 2017. Inductive representation learning on large graphs. In Proceedings of the Conference on Advances in Neural Information Processing Systems. 1024\u20131034."},{"key":"e_1_3_2_21_2","article-title":"Representation learning on graphs: Methods and applications","author":"Hamilton William L.","year":"2017","unstructured":"William L. Hamilton, Rex Ying, and Jure Leskovec. 2017. Representation learning on graphs: Methods and applications. arXiv preprint arXiv:1709.05584 (2017).","journal-title":"arXiv preprint arXiv:1709.05584"},{"key":"e_1_3_2_22_2","article-title":"Private federated learning on vertically partitioned data via entity resolution and additively homomorphic encryption","author":"Hardy Stephen","year":"2017","unstructured":"Stephen Hardy, Wilko Henecka, Hamish Ivey-Law, Richard Nock, Giorgio Patrini, Guillaume Smith, and Brian Thorne. 2017. Private federated learning on vertically partitioned data via entity resolution and additively homomorphic encryption. arXiv preprint arXiv:1711.10677 (2017).","journal-title":"arXiv preprint arXiv:1711.10677"},{"key":"e_1_3_2_23_2","article-title":"FedGraphNN: A federated learning system and benchmark for graph neural networks","author":"He Chaoyang","year":"2021","unstructured":"Chaoyang He, Keshav Balasubramanian, Emir Ceyani, Yu Rong, Peilin Zhao, Junzhou Huang, Murali Annavaram, and Salman Avestimehr. 2021. FedGraphNN: A federated learning system and benchmark for graph neural networks. arXiv preprint arXiv:2104.07145 (2021).","journal-title":"arXiv preprint arXiv:2104.07145"},{"key":"e_1_3_2_24_2","article-title":"Deep convolutional networks on graph-structured data","author":"Henaff Mikael","year":"2015","unstructured":"Mikael Henaff, Joan Bruna, and Yann LeCun. 2015. Deep convolutional networks on graph-structured data. arXiv preprint arXiv:1506.05163 (2015).","journal-title":"arXiv preprint arXiv:1506.05163"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2020.2991416"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3357384.3357909"},{"key":"e_1_3_2_27_2","article-title":"Federated dynamic GNN with secure aggregation","author":"Jiang Meng","year":"2020","unstructured":"Meng Jiang, Taeho Jung, Ryan Karl, and Tong Zhao. 2020. Federated dynamic GNN with secure aggregation. arXiv preprint arXiv:2009.07351 (2020).","journal-title":"arXiv preprint arXiv:2009.07351"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-39884-1_10"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/TDSC.2016.2577034"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/TDSC.2014.2309134"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/INFCOM.2013.6567071"},{"key":"e_1_3_2_32_2","article-title":"Federated optimization: Distributed optimization beyond the datacenter","author":"Kone\u010dn\u1ef3 Jakub","year":"2015","unstructured":"Jakub Kone\u010dn\u1ef3, Brendan McMahan, and Daniel Ramage. 2015. Federated optimization: Distributed optimization beyond the datacenter. arXiv preprint arXiv:1511.03575 (2015).","journal-title":"arXiv preprint arXiv:1511.03575"},{"key":"e_1_3_2_33_2","article-title":"Federated learning: Strategies for improving communication efficiency","author":"Kone\u010dn\u1ef3 Jakub","year":"2016","unstructured":"Jakub Kone\u010dn\u1ef3, H. Brendan McMahan, Felix X. Yu, Peter Richt\u00e1rik, Ananda Theertha Suresh, and Dave Bacon. 2016. Federated learning: Strategies for improving communication efficiency. arXiv preprint arXiv:1610.05492 (2016).","journal-title":"arXiv preprint arXiv:1610.05492"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330895"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3132847.3132919"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330847"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.448"},{"key":"e_1_3_2_38_2","article-title":"Diffusion convolutional recurrent neural network: Data-driven traffic forecasting","author":"Li Yaguang","year":"2017","unstructured":"Yaguang Li, Rose Yu, Cyrus Shahabi, and Yan Liu. 2017. Diffusion convolutional recurrent neural network: Data-driven traffic forecasting. arXiv preprint arXiv:1707.01926 (2017).","journal-title":"arXiv preprint arXiv:1707.01926"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-57048-8_6"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11271"},{"key":"e_1_3_2_41_2","article-title":"Dynamic graph convolutional networks","author":"Manessi Franco","year":"2017","unstructured":"Franco Manessi, Alessandro Rozza, and Mario Manzo. 2017. Dynamic graph convolutional networks. arXiv preprint arXiv:1704.06199 (2017).","journal-title":"arXiv preprint arXiv:1704.06199"},{"key":"e_1_3_2_42_2","article-title":"Communication-efficient learning of deep networks from decentralized data","author":"McMahan H. Brendan","year":"2016","unstructured":"H. Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, et\u00a0al. 2016. Communication-efficient learning of deep networks from decentralized data. arXiv preprint arXiv:1602.05629 (2016).","journal-title":"arXiv preprint arXiv:1602.05629"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2019.00029"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3243734.3243760"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2019.00065"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3184558.3191526"},{"key":"e_1_3_2_47_2","first-page":"2014","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Niepert Mathias","year":"2016","unstructured":"Mathias Niepert, Mohamed Ahmed, and Konstantin Kutzkov. 2016. Learning convolutional neural networks for graphs. In Proceedings of the International Conference on Machine Learning. 2014\u20132023."},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i04.5984"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3459637.3482252"},{"key":"e_1_3_2_50_2","volume-title":"Proceedings of the 36th International Conference on Machine Learning","author":"Qu Meng","year":"2019","unstructured":"Meng Qu, Yoshua Bengio, and Jian Tang. 2019. GMNN: Graph Markov neural networks. In Proceedings of the 36th International Conference on Machine Learning."},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-63076-8_13"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46484-8_33"},{"key":"e_1_3_2_53_2","article-title":"Dynamic graph representation learning via self-attention networks","author":"Sankar Aravind","year":"2018","unstructured":"Aravind Sankar, Yanhong Wu, Liang Gou, Wei Zhang, and Hao Yang. 2018. Dynamic graph representation learning via self-attention networks. arXiv preprint arXiv:1812.09430 (2018).","journal-title":"arXiv preprint arXiv:1812.09430"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-93417-4_38"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-04167-0_33"},{"key":"e_1_3_2_56_2","first-page":"1","volume-title":"Proc. NDSS","author":"Shi Elaine","year":"2011","unstructured":"Elaine Shi, T. H. Hubert Chan, Eleanor Rieffel, Richard Chow, and Dawn Song. 2011. Privacy-preserving aggregation of time-series data. In Proc. NDSS, Vol. 2. Citeseer, 1\u201317."},{"issue":"1","key":"e_1_3_2_57_2","article-title":"Federated topic discovery: A semantic consistent approach","volume":"1","author":"Shi Yexuan","year":"2020","unstructured":"Yexuan Shi, Yongxin Tong, Zhiyang Su, Di Jiang, Zimu Zhou, and Wenbin Zhang. 2020. Federated topic discovery: A semantic consistent approach. IEEE Intell. Syst. 1, 1 (2020).","journal-title":"IEEE Intell. Syst."},{"key":"e_1_3_2_58_2","article-title":"Adversarial attack and defense on graph data: A survey","author":"Sun Lichao","year":"2018","unstructured":"Lichao Sun, Yingtong Dou, Carl Yang, Ji Wang, Philip S. Yu, Lifang He, and Bo Li. 2018. Adversarial attack and defense on graph data: A survey. arXiv preprint arXiv:1812.10528 (2018).","journal-title":"arXiv preprint arXiv:1812.10528"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-59419-0_54"},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigData47090.2019.9005465"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2020.2993966"},{"key":"e_1_3_2_62_2","article-title":"Demystifying membership inference attacks in machine learning as a service","author":"Truex Stacey","year":"2019","unstructured":"Stacey Truex, Ling Liu, Mehmet Emre Gursoy, Lei Yu, and Wenqi Wei. 2019. Demystifying membership inference attacks in machine learning as a service. IEEE Trans. Serv. Comput. 14, 6 (2019), 2073\u20132089.","journal-title":"IEEE Trans. Serv. Comput."},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1049\/ip-vis:20041147"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403308"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i04.6096"},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2020.2988575"},{"key":"e_1_3_2_67_2","article-title":"FedGNN: Federated graph neural network for privacy-preserving recommendation","author":"Wu Chuhan","year":"2021","unstructured":"Chuhan Wu, Fangzhao Wu, Yang Cao, Yongfeng Huang, and Xing Xie. 2021. FedGNN: Federated graph neural network for privacy-preserving recommendation. arXiv preprint arXiv:2102.04925 (2021).","journal-title":"arXiv preprint arXiv:2102.04925"},{"key":"e_1_3_2_68_2","volume-title":"Proceedings of the International Joint Conference on Artificial Intelligence","author":"Yang Carl","year":"2021","unstructured":"Carl Yang, Haonan Wang, Ke Zhang, and Lichao Sun. 2021. Secure network release with link privacy. In Proceedings of the International Joint Conference on Artificial Intelligence."},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.1145\/3298981"},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cosrev.2018.03.001"},{"key":"e_1_3_2_71_2","article-title":"Spatio-temporal graph convolutional networks: A deep learning framework for traffic forecasting","author":"Yu Bing","year":"2017","unstructured":"Bing Yu, Haoteng Yin, and Zhanxing Zhu. 2017. Spatio-temporal graph convolutional networks: A deep learning framework for traffic forecasting. arXiv preprint arXiv:1709.04875 (2017).","journal-title":"arXiv preprint arXiv:1709.04875"},{"key":"e_1_3_2_72_2","first-page":"493","volume-title":"Proceedings of the USENIX Annual Technical Conference (USENIX ATC\u201920)","author":"Zhang Chengliang","year":"2020","unstructured":"Chengliang Zhang, Suyi Li, Junzhe Xia, Wei Wang, Feng Yan, and Yang Liu. 2020. BatchCrypt: Efficient homomorphic encryption for cross-silo federated learning. In Proceedings of the USENIX Annual Technical Conference (USENIX ATC\u201920). 493\u2013506."},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3411979"},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2021.3102609"},{"key":"e_1_3_2_75_2","article-title":"Privacy-preserving graph neural network for node classification","author":"Zhou Jun","year":"2020","unstructured":"Jun Zhou, Chaochao Chen, Longfei Zheng, Xiaolin Zheng, Bingzhe Wu, Ziqi Liu, and Li Wang. 2020. Privacy-preserving graph neural network for node classification. arXiv preprint arXiv:2005.11903 (2020).","journal-title":"arXiv preprint arXiv:2005.11903"},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11257"},{"key":"e_1_3_2_77_2","article-title":"Multi-objective evolutionary federated learning","author":"Zhu Hangyu","year":"2020","unstructured":"Hangyu Zhu and Yaochu Jin. 2020. Multi-objective evolutionary federated learning. IEEE Trans. Neural Netw. Learn. Syst. 31, 4 (2020), 1310\u20131322.","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3501808","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3501808","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:09:48Z","timestamp":1750183788000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3501808"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,3]]},"references-count":76,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,8,31]]}},"alternative-id":["10.1145\/3501808"],"URL":"https:\/\/doi.org\/10.1145\/3501808","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"value":"2157-6904","type":"print"},{"value":"2157-6912","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,3]]},"assertion":[{"value":"2021-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-05-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}