{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,10]],"date-time":"2026-08-10T01:25:19Z","timestamp":1786325119341,"version":"build-2736575974"},"reference-count":198,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2025,1,24]],"date-time":"2025-01-24T00:00:00Z","timestamp":1737676800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"NSFC and Hong Kong RGC Collaborative Research Scheme","award":["62321166652"],"award-info":[{"award-number":["62321166652"]}]},{"DOI":"10.13039\/501100021171","name":"Guangdong Basic and Applied Basic Research Foundation","doi-asserted-by":"crossref","award":["2022A1515010374"],"award-info":[{"award-number":["2022A1515010374"]}],"id":[{"id":"10.13039\/501100021171","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Hong Kong RGC Theme based Research Scheme","award":["T43-513\/23-N"],"award-info":[{"award-number":["T43-513\/23-N"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2025,5,31]]},"abstract":"<jats:p>Distributed machine learning on edges is widely used in intelligent transportation, smart home, industrial manufacturing, and underground pipe network monitoring to achieve low latency and real time data processing and prediction. However, the presence of a large number of sensing and edge devices with limited computing, storage, and communication capabilities prevents the deployment of huge machine learning models and hinders its application. At the same time, although distributed machine learning on edges forms an emerging and rapidly growing research area, there has not been a systematic survey on this topic. The article begins by detailing the challenges of distributed machine learning in edge environments, such as limited node resources, data heterogeneity, privacy, security issues, and summarizes common metrics for model optimization. We then present a detailed analysis of parallelism patterns, distributed architectures, and model communication and aggregation schemes in edge computing. we subsequently present a comprehensive classification and intensive description of node resource-constrained processing, heterogeneous data processing, attacks and protection of privacy. The article ends by summarizing the applications of distributed machine learning in edge computing and presenting problems and challenges for further research.<\/jats:p>","DOI":"10.1145\/3708495","type":"journal-article","created":{"date-parts":[[2024,12,13]],"date-time":"2024-12-13T10:52:51Z","timestamp":1734087171000},"page":"1-37","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":37,"title":["Distributed Machine Learning in Edge Computing: Challenges, Solutions and Future Directions"],"prefix":"10.1145","volume":"57","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0730-8994","authenticated-orcid":false,"given":"Jingke","family":"Tu","sequence":"first","affiliation":[{"name":"South China University of Technology, Guangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8732-3675","authenticated-orcid":false,"given":"Lei","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Software Engineering, South China University of Technology, Guangzhou China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2725-2529","authenticated-orcid":false,"given":"Jiannong","family":"Cao","sequence":"additional","affiliation":[{"name":"Dept. of Computing, The Hong Kong Polytechnic University, Hong Kong Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,1,24]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP40776.2020.9054634"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00399"},{"key":"e_1_3_1_4_2","article-title":"Revisit multimodal meta-learning through the lens of multi-task learning","volume":"34","author":"Abdollahzadeh Milad","year":"2021","unstructured":"Milad Abdollahzadeh, Touba Malekzadeh, and Ngai-Man Man Cheung. 2021. Revisit multimodal meta-learning through the lens of multi-task learning. Advances in Neural Information Processing Systems 34 (2021), 14632\u201314644.","journal-title":"Advances in Neural Information Processing Systems"},{"issue":"2","key":"e_1_3_1_5_2","first-page":"23","article-title":"Palmprint recognition via bandlet, ridgelet, wavelet and neural network","volume":"3","author":"Abukmeil Mohanad AM","year":"2015","unstructured":"Mohanad AM Abukmeil, Hatem Elaydi, and Mohammed Alhanjouri. 2015. Palmprint recognition via bandlet, ridgelet, wavelet and neural network. Journal of Computer Sciences and Applications 3, 2 (2015), 23\u201328.","journal-title":"Journal of Computer Sciences and Applications"},{"key":"e_1_3_1_6_2","first-page":"21","volume-title":"International Conference on Machine Learning","author":"Acar Durmus Alp Emre","year":"2021","unstructured":"Durmus Alp Emre Acar, Yue Zhao, Ruizhao Zhu, Ramon Matas, Matthew Mattina, Paul Whatmough, and Venkatesh Saligrama. 2021. Debiasing model updates for improving personalized federated training. In International Conference on Machine Learning. PMLR, 21\u201331."},{"key":"e_1_3_1_7_2","article-title":"Distributed delayed stochastic optimization","volume":"24","author":"Agarwal Alekh","year":"2011","unstructured":"Alekh Agarwal and John C. Duchi. 2011. Distributed delayed stochastic optimization. Advances in Neural Information Processing Systems 24 (2011), 873\u2013881.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_8_2","article-title":"Do deep nets really need to be deep?","volume":"27","author":"Ba Jimmy","year":"2014","unstructured":"Jimmy Ba and Rich Caruana. 2014. Do deep nets really need to be deep? Advances in Neural Information Processing Systems 27 (2014), 2654\u20132662.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_9_2","first-page":"2938","volume-title":"International Conference on Artificial Intelligence and Statistics","author":"Bagdasaryan Eugene","year":"2020","unstructured":"Eugene Bagdasaryan, Andreas Veit, Yiqing Hua, Deborah Estrin, and Vitaly Shmatikov. 2020. How to backdoor federated learning. In International Conference on Artificial Intelligence and Statistics. PMLR, 2938\u20132948."},{"key":"e_1_3_1_10_2","article-title":"Generative vs. discriminative: Rethinking the meta-continual learning","volume":"34","author":"Banayeeanzade Mohammadamin","year":"2021","unstructured":"Mohammadamin Banayeeanzade, Rasoul Mirzaiezadeh, Hosein Hasani, and Mahdieh Soleymani. 2021. Generative vs. discriminative: Rethinking the meta-continual learning. Advances in Neural Information Processing Systems 34 (2021), 21592\u201321604.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00812"},{"key":"e_1_3_1_12_2","article-title":"A little is enough: Circumventing defenses for distributed learning","volume":"33","author":"Baruch Gilad","year":"2019","unstructured":"Gilad Baruch, Moran Baruch, and Yoav Goldberg. 2019. A little is enough: Circumventing defenses for distributed learning. Advances in Neural Information Processing Systems 33 (2019), 8635\u20138645.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3429252"},{"key":"e_1_3_1_14_2","article-title":"Machine learning with adversaries: Byzantine tolerant gradient descent","volume":"30","author":"Blanchard Peva","year":"2017","unstructured":"Peva Blanchard, El Mahdi El Mhamdi, Rachid Guerraoui, and Julien Stainer. 2017. Machine learning with adversaries: Byzantine tolerant gradient descent. Advances in Neural Information Processing Systems 30, 31 (2017), 118\u2013128.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/IITA.2008.143"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i8.16861"},{"key":"e_1_3_1_17_2","unstructured":"Bryant Chen Wilka Carvalho Nathalie Baracaldo Heiko Ludwig Benjamin Edwards Taesung Lee Ian Molloy and Biplav Srivastava. 2018. Detecting backdoor attacks on deep neural networks by activation clustering. arXiv preprint arXiv:1811.03728 (2018)."},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/3638531"},{"key":"e_1_3_1_19_2","first-page":"903","volume-title":"International Conference on Machine Learning","author":"Chen Lingjiao","year":"2018","unstructured":"Lingjiao Chen, Hongyi Wang, Zachary Charles, and Dimitris Papailiopoulos. 2018. Draco: Byzantine-resilient distributed training via redundant gradients. In International Conference on Machine Learning. PMLR, 903\u2013912."},{"key":"e_1_3_1_20_2","unstructured":"Mingqing Chen Rajiv Mathews Tom Ouyang and Fran\u00e7oise Beaufays. 2019. Federated learning of out-of-vocabulary words. arXiv preprint arXiv:1903.10635 (2019)."},{"key":"e_1_3_1_21_2","unstructured":"W. Chenshen L. Herranz L. Xialei X. Liu Y. Wang J. van de Weijer and B. Raducanu. 2018. Memory replay GANs: Learning to generate images from new categories without forgetting. Advances in Neural Information Processing Systems 32 (2018) 5966\u20135976."},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00145-019-09319-x"},{"key":"e_1_3_1_23_2","first-page":"1964","volume-title":"International Conference on Machine Learning","author":"Choquette-Choo Christopher A","year":"2021","unstructured":"Christopher A Choquette-Choo, Florian Tramer, Nicholas Carlini, and Nicolas Papernot. 2021. Label-only membership inference attacks. In International Conference on Machine Learning. PMLR, 1964\u20131974."},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2019.00363"},{"key":"e_1_3_1_25_2","first-page":"2089","volume-title":"International Conference on Machine Learning","author":"Collins Liam","year":"2021","unstructured":"Liam Collins, Hamed Hassani, Aryan Mokhtari, and Sanjay Shakkottai. 2021. Exploiting shared representations for personalized federated learning. In International Conference on Machine Learning. PMLR, 2089\u20132099."},{"key":"e_1_3_1_26_2","first-page":"16481","article-title":"Gan memory with no forgetting","volume":"33","author":"Cong Yulai","year":"2020","unstructured":"Yulai Cong, Miaoyun Zhao, Jianqiao Li, Sijia Wang, and Lawrence Carin. 2020. Gan memory with no forgetting. Advances in Neural Information Processing Systems 33 (2020), 16481\u201316494.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2021.3107783"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2020.2973705"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2020.2976475"},{"key":"e_1_3_1_30_2","unstructured":"Michael Diskin Alexey Bukhtiyarov Max Ryabinin Lucile Saulnier Anton Sinitsin Dmitry Popov Dmitry V. Pyrkin Maxim Kashirin Alexander Borzunov and Albert Villanovadel Moral. 2021. Distributed deep learning in open collaborations. Advances in Neural Information Processing Systems 34 (2021) 7879\u20137897."},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i6.16669"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/MM.2021.3091475"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58565-5_6"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2020.3009406"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigData52589.2021.9671980"},{"key":"e_1_3_1_36_2","unstructured":"Aysegul Dundar Jonghoon Jin and Eugenio Culurciello. 2015. Convolutional clustering for unsupervised learning. arXiv preprint arXiv:1511.06241 (2015)."},{"key":"e_1_3_1_37_2","first-page":"1605","volume-title":"29th USENIX Security Symposium (USENIX Security 20)","author":"Fang Minghong","year":"2020","unstructured":"Minghong Fang, Xiaoyu Cao, Jinyuan Jia, and Neil Gong. 2020. Local model poisoning attacks to \\(\\lbrace\\) byzantine-robust \\(\\rbrace\\) federated learning. In 29th USENIX Security Symposium (USENIX Security 20). 1605\u20131622."},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.2016.2525015"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.3390\/s22072665"},{"key":"e_1_3_1_40_2","first-page":"1126","volume-title":"International Conference on Machine Learning","author":"Finn Chelsea","year":"2017","unstructured":"Chelsea Finn, Pieter Abbeel, and Sergey Levine. 2017. Model-agnostic meta-learning for fast adaptation of deep networks. In International Conference on Machine Learning. PMLR, 1126\u20131135."},{"key":"e_1_3_1_41_2","unstructured":"Sebastian Flennerhag Andrei A Rusu Razvan Pascanu Francesco Visin Hujun Yin and Raia Hadsell. 2019. Meta-learning with warped gradient descent. arXiv preprint arXiv:1909.00025 (2019)."},{"key":"e_1_3_1_42_2","first-page":"17","volume-title":"23rd USENIX Security Symposium (USENIX Security 14)","author":"Fredrikson Matthew","year":"2014","unstructured":"Matthew Fredrikson, Eric Lantz, Somesh Jha, Simon Lin, David Page, and Thomas Ristenpart. 2014. Privacy in pharmacogenetics: An \\(\\lbrace\\) End-to-End \\(\\rbrace\\) case study of personalized warfarin dosing. In 23rd USENIX Security Symposium (USENIX Security 14). 17\u201332."},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2737792"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00987"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/3359789.3359790"},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/IoTDI49375.2020.00025"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2019.2911165"},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1006\/jpdc.1994.1085"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10107-014-0846-1"},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3229762.3229763"},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00495"},{"key":"e_1_3_1_52_2","unstructured":"Jean-Bastien Grill Florian Strub Florent Altch\u00e9 Corentin Tallec Pierre Richemond Elena Buchatskaya Carl Doersch Bernardo Avila Pires Zhaohan Guo and Mohammad Gheshlaghi Azar. 2020. Bootstrap your own latent-a new approach to self-supervised learning. Advances in Neural Information Processing Systems 33 (2020) 21271\u201321284."},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00501"},{"key":"e_1_3_1_54_2","unstructured":"Rachid Guerraoui and S\u00e9bastien Rouault. 2018. The hidden vulnerability of distributed learning in byzantium. Advances in International Conference on Machine Learning 31 (2018) 3521\u20133530."},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1002\/spe.2509"},{"key":"e_1_3_1_56_2","unstructured":"Nirupam Gupta Shuo Liu and Nitin H. Vaidya. 2020. Byzantine fault-tolerant distributed machine learning using stochastic gradient descent (sgd) and norm-based comparative gradient elimination (cge). arXiv preprint arXiv:2008.04699 (2020)."},{"key":"e_1_3_1_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2020.3046440"},{"key":"e_1_3_1_58_2","article-title":"Learning both weights and connections for efficient neural network","volume":"28","author":"Han Song","year":"2015","unstructured":"Song Han, Jeff Pool, John Tran, and William Dally. 2015. Learning both weights and connections for efficient neural network. Advances in Neural Information Processing Systems 28 (2015), 1135\u20131143.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_59_2","doi-asserted-by":"crossref","unstructured":"Aaron Harlap Deepak Narayanan Amar Phanishayee Vivek Seshadri Nikhil Devanur Greg Ganger and Phil Gibbons. 2018. Pipedream: Fast and efficient pipeline parallel dnn training. arXiv preprint arXiv:1806.03377 (2018).","DOI":"10.1145\/3341301.3359646"},{"key":"e_1_3_1_60_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00975"},{"key":"e_1_3_1_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.155"},{"key":"e_1_3_1_62_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-22496-7_5"},{"key":"e_1_3_1_63_2","unstructured":"Geoffrey Hinton. 2015. Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531 (2015)."},{"key":"e_1_3_1_64_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.1127647"},{"key":"e_1_3_1_65_2","article-title":"More effective distributed ml via a stale synchronous parallel parameter server","volume":"26","author":"Ho Qirong","year":"2013","unstructured":"Qirong Ho, James Cipar, Henggang Cui, Seunghak Lee, Jin Kyu Kim, Phillip B. Gibbons, Garth A. Gibson, Greg Ganger, and Eric P. Xing. 2013. More effective distributed ml via a stale synchronous parallel parameter server. Advances in Neural Information Processing Systems 26 (2013), 1223\u20131231.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_66_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00092"},{"key":"e_1_3_1_67_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00378"},{"key":"e_1_3_1_68_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2019.103291"},{"key":"e_1_3_1_69_2","article-title":"Optimizing reusable knowledge for continual learning via metalearning","volume":"34","author":"Hurtado Julio","year":"2021","unstructured":"Julio Hurtado, Alain Raymond, and Alvaro Soto. 2021. Optimizing reusable knowledge for continual learning via metalearning. Advances in Neural Information Processing Systems 34 (2021), 14150\u201314162.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_70_2","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2018.00057"},{"key":"e_1_3_1_71_2","unstructured":"Eunjeong Jeong Seungeun Oh Hyesung Kim Jihong Park Mehdi Bennis and Seong-Lyun Kim. 2018. Communication-efficient on-device machine learning: Federated distillation and augmentation under non-iid private data. arXiv preprint arXiv:1811.11479 (2018)."},{"key":"e_1_3_1_72_2","unstructured":"Ghassen Jerfel Erin Grant Thomas L Griffiths and Katherine Heller. 2018. Online gradient-based mixtures for transfer modulation in meta-learning. arXiv preprint arXiv:1812.06080 (2018)."},{"key":"e_1_3_1_73_2","first-page":"2279","volume-title":"ICML","author":"Jia Zhihao","year":"2018","unstructured":"Zhihao Jia, Sina Lin, Charles R Qi, and Alex Aiken. 2018. Exploring hidden dimensions in parallelizing convolutional neural networks. In ICML. 2279\u20132288."},{"key":"e_1_3_1_74_2","first-page":"5132","volume-title":"International Conference on Machine Learning","author":"Karimireddy Sai Praneeth","year":"2020","unstructured":"Sai Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank Reddi, Sebastian Stich, and Ananda Theertha Suresh. 2020. Scaffold: Stochastic controlled averaging for federated learning. In International Conference on Machine Learning. PMLR, 5132\u20135143."},{"key":"e_1_3_1_75_2","first-page":"22443","article-title":"Achieving forgetting prevention and knowledge transfer in continual learning","volume":"34","author":"Ke Zixuan","year":"2021","unstructured":"Zixuan Ke, Bing Liu, Nianzu Ma, Hu Xu, and Lei Shu. 2021. Achieving forgetting prevention and knowledge transfer in continual learning. Advances in Neural Information Processing Systems 34 (2021), 22443\u201322456.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_76_2","article-title":"Paraphrasing complex network: Network compression via factor transfer","volume":"31","author":"Kim Jangho","year":"2018","unstructured":"Jangho Kim, SeongUk Park, and Nojun Kwak. 2018. Paraphrasing complex network: Network compression via factor transfer. Advances in Neural Information Processing Systems 31, 32 (2018), 2765\u20132774.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_77_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1611835114"},{"key":"e_1_3_1_78_2","unstructured":"Alex Krizhevsky. 2014. One weird trick for parallelizing convolutional neural networks. arXiv preprint arXiv:1404.5997 (2014)."},{"key":"e_1_3_1_79_2","unstructured":"Namhoon Lee Thalaiyasingam Ajanthan and Philip HS Torr. 2018. Snip: Single-shot network pruning based on connection sensitivity. arXiv preprint arXiv:1810.02340 (2018)."},{"key":"e_1_3_1_80_2","unstructured":"Seunghyun Lee and Byung Cheol Song. 2019. Graph-based knowledge distillation by multi-head attention network. arXiv preprint arXiv:1907.02226 (2019)."},{"key":"e_1_3_1_81_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01231-1_21"},{"key":"e_1_3_1_82_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2019.8683546"},{"key":"e_1_3_1_83_2","article-title":"Data poisoning attacks on factorization-based collaborative filtering","volume":"29","author":"Li Bo","year":"2016","unstructured":"Bo Li, Yining Wang, Aarti Singh, and Yevgeniy Vorobeychik. 2016. Data poisoning attacks on factorization-based collaborative filtering. Advances in Neural Information Processing Systems 29 (2016), 1893\u20131901.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_84_2","unstructured":"Hao Li Asim Kadav Igor Durdanovic Hanan Samet and Hans Peter Graf. 2016. Pruning filters for efficient convnets. arXiv preprint arXiv:1608.08710 (2016)."},{"key":"e_1_3_1_85_2","article-title":"Communication efficient distributed machine learning with the parameter server","volume":"27","author":"Li Mu","year":"2014","unstructured":"Mu Li, David G Andersen, Alexander J. Smola, and Kai Yu. 2014. Communication efficient distributed machine learning with the parameter server. Advances in Neural Information Processing Systems 27 (2014), 19\u201327.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_86_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00292"},{"issue":"7","key":"e_1_3_1_87_2","first-page":"1725","article-title":"Breaking (global) barriers in parallel stochastic optimization with wait-avoiding group averaging","volume":"32","author":"Li Shigang","year":"2020","unstructured":"Shigang Li, Tal Ben-Nun, Giorgi Nadiradze, Salvatore Di Girolamo, Nikoli Dryden, Dan Alistarh, and Torsten Hoefler. 2020. Breaking (global) barriers in parallel stochastic optimization with wait-avoiding group averaging. IEEE Transactions on Parallel and Distributed Systems 32, 7 (2020), 1725\u20131739.","journal-title":"IEEE Transactions on Parallel and Distributed Systems"},{"key":"e_1_3_1_88_2","unstructured":"Tian Li Maziar Sanjabi Ahmad Beirami and Virginia Smith. 2019. Fair resource allocation in federated learning. arXiv preprint arXiv:1905.10497 (2019)."},{"key":"e_1_3_1_89_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-32692-0_16"},{"key":"e_1_3_1_90_2","article-title":"Anti-backdoor learning: Training clean models on poisoned data","volume":"34","author":"Li Yige","year":"2021","unstructured":"Yige Li, Xixiang Lyu, Nodens Koren, Lingjuan Lyu, Bo Li, and Xingjun Ma. 2021. Anti-backdoor learning: Training clean models on poisoned data. Advances in Neural Information Processing Systems 34 (2021), 14900\u201314912.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_91_2","unstructured":"Yige Li Xixiang Lyu Nodens Koren Lingjuan Lyu Bo Li and Xingjun Ma. 2021. Neural attention distillation: Erasing backdoor triggers from deep neural networks. arXiv preprint arXiv:2101.05930 (2021)."},{"key":"e_1_3_1_92_2","article-title":"Can decentralized algorithms outperform centralized algorithms? A case study for decentralized parallel stochastic gradient descent","volume":"30","author":"Lian Xiangru","year":"2017","unstructured":"Xiangru Lian, Ce Zhang, Huan Zhang, Cho-Jui Hsieh, Wei Zhang, and Ji Liu. 2017. Can decentralized algorithms outperform centralized algorithms? A case study for decentralized parallel stochastic gradient descent. Advances in Neural Information Processing Systems 30 (2017), 5331\u20135341.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_93_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00160"},{"key":"e_1_3_1_94_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00290"},{"key":"e_1_3_1_95_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICC40277.2020.9148862"},{"key":"e_1_3_1_96_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i10.17054"},{"key":"e_1_3_1_97_2","doi-asserted-by":"publisher","DOI":"10.1145\/3147234.3148101"},{"key":"e_1_3_1_98_2","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2019.2942190"},{"key":"e_1_3_1_99_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2020.2973651"},{"key":"e_1_3_1_100_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE51399.2021.00023"},{"key":"e_1_3_1_101_2","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3220007"},{"key":"e_1_3_1_102_2","doi-asserted-by":"publisher","DOI":"10.1145\/3460120.3484533"},{"key":"e_1_3_1_103_2","unstructured":"Yishay Mansour Mehryar Mohri Jae Ro and Ananda Theertha Suresh. 2020. Three approaches for personalization with applications to federated learning. arXiv preprint arXiv:2002.10619 (2020)."},{"key":"e_1_3_1_104_2","first-page":"1273","volume-title":"Artificial Intelligence and Statistics","author":"McMahan Brendan","year":"2017","unstructured":"Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Aguera y Arcas. 2017. Communication-efficient learning of deep networks from decentralized data. In Artificial Intelligence and Statistics. PMLR, 1273\u20131282."},{"key":"e_1_3_1_105_2","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2019.00029"},{"key":"e_1_3_1_106_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2019.8683438"},{"key":"e_1_3_1_107_2","doi-asserted-by":"publisher","DOI":"10.1145\/3448016.3452773"},{"key":"e_1_3_1_108_2","doi-asserted-by":"publisher","DOI":"10.1145\/3469029"},{"key":"e_1_3_1_109_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i10.17093"},{"key":"e_1_3_1_110_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00141"},{"key":"e_1_3_1_111_2","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2019.00065"},{"key":"e_1_3_1_112_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDCS.2019.00080"},{"key":"e_1_3_1_113_2","doi-asserted-by":"publisher","DOI":"10.1145\/3372224.3419188"},{"key":"e_1_3_1_114_2","unstructured":"Aaron van den Oord Yazhe Li and Oriol Vinyals. 2018. Representation learning with contrastive predictive coding. arXiv preprint arXiv:1807.03748 (2018)."},{"issue":"11","key":"e_1_3_1_115_2","first-page":"1","article-title":"Accelerating deep convolutional neural networks using specialized hardware","volume":"2","author":"Ovtcharov Kalin","year":"2015","unstructured":"Kalin Ovtcharov, Olatunji Ruwase, Joo-Young Kim, Jeremy Fowers, Karin Strauss, and Eric S. Chung. 2015. Accelerating deep convolutional neural networks using specialized hardware. Microsoft Research Whitepaper 2, 11 (2015), 1\u20134.","journal-title":"Microsoft Research Whitepaper"},{"key":"e_1_3_1_116_2","doi-asserted-by":"publisher","DOI":"10.1145\/3052973.3053009"},{"key":"e_1_3_1_117_2","article-title":"Learning student-friendly teacher networks for knowledge distillation","volume":"34","author":"Park Dae Young","year":"2021","unstructured":"Dae Young Park, Moon-Hyun Cha, Daesin Kim, and Bohyung Han. 2021. Learning student-friendly teacher networks for knowledge distillation. Advances in Neural Information Processing Systems 34 (2021), 13292\u201313303.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_118_2","first-page":"7510","volume-title":"International Conference on Machine Learning","author":"Park Seong-Jin","year":"2020","unstructured":"Seong-Jin Park, Seungju Han, Ji-Won Baek, Insoo Kim, Juhwan Song, Hae Beom Lee, Jae-Joon Han, and Sung Ju Hwang. 2020. Meta variance transfer: Learning to augment from the others. In International Conference on Machine Learning. PMLR, 7510\u20137520."},{"key":"e_1_3_1_119_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01252-6_17"},{"key":"e_1_3_1_120_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpdc.2008.09.002"},{"key":"e_1_3_1_121_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2019.07.069"},{"key":"e_1_3_1_122_2","article-title":"DETOX: A redundancy-based framework for faster and more robust gradient aggregation","volume":"32","author":"Rajput Shashank","year":"2019","unstructured":"Shashank Rajput, Hongyi Wang, Zachary Charles, and Dimitris Papailiopoulos. 2019. DETOX: A redundancy-based framework for faster and more robust gradient aggregation. Advances in Neural Information Processing Systems 32, 33 (2019), 10320\u201310330.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_123_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.587"},{"key":"e_1_3_1_124_2","unstructured":"Sashank Reddi Zachary Charles Manzil Zaheer Zachary Garrett Keith Rush Jakub Kone\u010dn\u1ef3 Sanjiv Kumar and H. Brendan McMahan. 2020. Adaptive federated optimization. arXiv preprint arXiv:2003.00295 (2020)."},{"key":"e_1_3_1_125_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2919736"},{"key":"e_1_3_1_126_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2019.8793544"},{"key":"e_1_3_1_127_2","unstructured":"Ronald L. Rivest Len Adleman and Michael L. Dertouzos. 1978. On data banks and privacy homomorphisms. Foundations of Secure Computation 4 11 (1978) 169\u2013180."},{"key":"e_1_3_1_128_2","unstructured":"Adriana Romero Nicolas Ballas Samira Ebrahimi Kahou Antoine Chassang Carlo Gatta and Yoshua Bengio. 2014. Fitnets: Hints for thin deep nets. arXiv preprint arXiv:1412.6550 (2014)."},{"key":"e_1_3_1_129_2","first-page":"18195","article-title":"Moshpit sgd: Communication-efficient decentralized training on heterogeneous unreliable devices","volume":"34","author":"Ryabinin Max","year":"2021","unstructured":"Max Ryabinin, Eduard Gorbunov, Vsevolod Plokhotnyuk, and Gennady Pekhimenko. 2021. Moshpit sgd: Communication-efficient decentralized training on heterogeneous unreliable devices. Advances in Neural Information Processing Systems 34 (2021), 18195\u201318211.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_130_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2020.3015958"},{"key":"e_1_3_1_131_2","volume-title":"Federated Learning for Intrusion Detection Systems in Medical Cyber-Physical Systems","author":"Schneble William","year":"2018","unstructured":"William Schneble. 2018. Federated Learning for Intrusion Detection Systems in Medical Cyber-Physical Systems. Ph.D. Dissertation."},{"key":"e_1_3_1_132_2","unstructured":"Ari Seff Alex Beatson Daniel Suo and Han Liu. 2017. Continual learning in generative adversarial nets. arXiv preprint arXiv:1705.08395 (2017)."},{"key":"e_1_3_1_133_2","unstructured":"Alexander Sergeev and Mike Del Balso. 2018. Horovod: Fast and easy distributed deep learning in TensorFlow. arXiv preprint arXiv:1802.05799 (2018)."},{"key":"e_1_3_1_134_2","unstructured":"Noam Shazeer Azalia Mirhoseini Krzysztof Maziarz Andy Davis Quoc Le Geoffrey Hinton and Jeff Dean. 2017. Outrageously large neural networks: The sparsely-gated mixture-of-experts layer. arXiv preprint arXiv:1701.06538 (2017)."},{"key":"e_1_3_1_135_2","article-title":"Continual learning with deep generative replay","volume":"30","author":"Shin Hanul","year":"2017","unstructured":"Hanul Shin, Jung Kwon Lee, Jaehong Kim, and Jiwon Kim. 2017. Continual learning with deep generative replay. Advances in Neural Information Processing Systems 30, 31 (2017), 2994\u20133003.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_136_2","unstructured":"Jaewoong Shin Hae Beom Lee Boqing Gong and Sung Ju Hwang. 2021. Large-scale meta-learning with continual trajectory shifting. arXiv preprint arXiv:2102.07215 (2021)."},{"key":"e_1_3_1_137_2","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2017.41"},{"key":"e_1_3_1_138_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISBI.2019.8759317"},{"key":"e_1_3_1_139_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.01503"},{"key":"e_1_3_1_140_2","article-title":"Prototypical networks for few-shot learning","volume":"30","author":"Snell Jake","year":"2017","unstructured":"Jake Snell, Kevin Swersky, and Richard Zemel. 2017. Prototypical networks for few-shot learning. Advances in Neural Information Processing Systems 30, 31 (2017), 4080\u20134090.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_141_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE48307.2020.00021"},{"key":"e_1_3_1_142_2","unstructured":"Sebastian U. Stich. 2018. Local SGD converges fast and communicates little. arXiv preprint arXiv:1805.09767 (2018)."},{"key":"e_1_3_1_143_2","first-page":"21394","article-title":"Personalized federated learning with moreau envelopes","volume":"33","author":"Dinh Canh T","year":"2020","unstructured":"Canh T Dinh, Nguyen Tran, and Josh Nguyen. 2020. Personalized federated learning with moreau envelopes. Advances in Neural Information Processing Systems 33 (2020), 21394\u201321405.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_144_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01220"},{"key":"e_1_3_1_145_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58621-8_45"},{"key":"e_1_3_1_146_2","first-page":"601","volume-title":"25th USENIX Security Symposium (USENIX Security 16)","author":"Tram\u00e8r Florian","year":"2016","unstructured":"Florian Tram\u00e8r, Fan Zhang, Ari Juels, Michael K Reiter, and Thomas Ristenpart. 2016. Stealing machine learning models via prediction \\(\\lbrace\\) APIs \\(\\rbrace\\) . In 25th USENIX Security Symposium (USENIX Security 16). 601\u2013618."},{"key":"e_1_3_1_147_2","doi-asserted-by":"publisher","DOI":"10.1145\/3377454"},{"key":"e_1_3_1_148_2","article-title":"Multimodal model-agnostic meta-learning via task-aware modulation","volume":"32","author":"Vuorio Risto","year":"2019","unstructured":"Risto Vuorio, Shao-Hua Sun, Hexiang Hu, and Joseph J. Lim. 2019. Multimodal model-agnostic meta-learning via task-aware modulation. Advances in Neural Information Processing Systems 32, 33 (2019), 1\u201312.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_149_2","unstructured":"Jianyu Wang Vinayak Tantia Nicolas Ballas and Michael Rabbat. 2019. SlowMo: Improving communication-efficient distributed SGD with slow momentum. arXiv preprint arXiv:1910.00643 (2019)."},{"key":"e_1_3_1_150_2","first-page":"10717","volume-title":"International Conference on Machine Learning","author":"Wang Wenxiao","year":"2021","unstructured":"Wenxiao Wang, Minghao Chen, Shuai Zhao, Long Chen, Jinming Hu, Haifeng Liu, Deng Cai, Xiaofei He, and Wei Liu. 2021. Accelerate cnns from three dimensions: A comprehensive pruning framework. In International Conference on Machine Learning. PMLR, 10717\u201310726."},{"key":"e_1_3_1_151_2","unstructured":"Wenxiao Wang Shuai Zhao Minghao Chen Jinming Hu Deng Cai and Haifeng Liu. 2019. DBP: Discrimination based block-level pruning for deep model acceleration. arXiv preprint arXiv:1912.10178 (2019)."},{"key":"e_1_3_1_152_2","doi-asserted-by":"crossref","unstructured":"Zi Wang. 2021. Data-free knowledge distillation with soft targeted transfer set synthesis. Proceedings of the AAAI Conference on Artificial Intelligence 35 11 (2021).","DOI":"10.1609\/aaai.v35i11.17228"},{"key":"e_1_3_1_153_2","first-page":"10675","volume-title":"International Conference on Machine Learning","author":"Wang Zi","year":"2021","unstructured":"Zi Wang. 2021. Zero-shot knowledge distillation from a decision-based black-box model. In International Conference on Machine Learning. PMLR, 10675\u201310685."},{"key":"e_1_3_1_154_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.01467"},{"key":"e_1_3_1_155_2","unstructured":"Zidu Wang Xuexin Liu Long Huang Yunqing Chen Yufei Zhang Zhikang Lin and Rui Wang. 2021. Model pruning based on quantified similarity of feature maps."},{"key":"e_1_3_1_156_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2020.2988575"},{"key":"e_1_3_1_157_2","article-title":"Learning structured sparsity in deep neural networks","volume":"29","author":"Wen Wei","year":"2016","unstructured":"Wei Wen, Chunpeng Wu, Yandan Wang, Yiran Chen, and Hai Li. 2016. Learning structured sparsity in deep neural networks. Advances in Neural Information Processing Systems 29, 30 (2016), 2082\u20132090.","journal-title":"Advances in Neural Information Processing Systems"},{"issue":"1","key":"e_1_3_1_158_2","first-page":"1","article-title":"Communication-efficient federated learning via knowledge distillation","volume":"13","author":"Wu Chuhan","year":"2022","unstructured":"Chuhan Wu, Fangzhao Wu, Lingjuan Lyu, Yongfeng Huang, and Xing Xie. 2022. Communication-efficient federated learning via knowledge distillation. Nature Communications 13, 1 (2022), 1\u20138.","journal-title":"Nature Communications"},{"key":"e_1_3_1_159_2","doi-asserted-by":"crossref","unstructured":"Hongda Wu and Ping Wang. 2022. Node selection toward faster convergence for federated learning on Non-IID data. IEEE Transactions on Network Science and Engineering 9 5 (2022) 3099\u20133111.","DOI":"10.1109\/TNSE.2022.3146399"},{"key":"e_1_3_1_160_2","doi-asserted-by":"publisher","DOI":"10.1145\/3659205"},{"key":"e_1_3_1_161_2","volume-title":"International Conference on Learning Representations","author":"Xie Chulin","year":"2019","unstructured":"Chulin Xie, Keli Huang, Pin-Yu Chen, and Bo Li. 2019. Dba: Distributed backdoor attacks against federated learning. In International Conference on Learning Representations."},{"key":"e_1_3_1_162_2","first-page":"261","volume-title":"Uncertainty in Artificial Intelligence","author":"Xie Cong","year":"2020","unstructured":"Cong Xie, Oluwasanmi Koyejo, and Indranil Gupta. 2020. Fall of empires: Breaking byzantine-tolerant sgd by inner product manipulation. In Uncertainty in Artificial Intelligence. PMLR, 261\u2013270."},{"key":"e_1_3_1_163_2","first-page":"10495","volume-title":"International Conference on Machine Learning","author":"Xie Cong","year":"2020","unstructured":"Cong Xie, Sanmi Koyejo, and Indranil Gupta. 2020. Zeno++: Robust fully asynchronous sgd. In International Conference on Machine Learning. PMLR, 10495\u201310503."},{"key":"e_1_3_1_164_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00303"},{"key":"e_1_3_1_165_2","doi-asserted-by":"publisher","DOI":"10.1145\/3423211.3425693"},{"key":"e_1_3_1_166_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00748"},{"key":"e_1_3_1_167_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2021.3052195"},{"key":"e_1_3_1_168_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2022.3144994"},{"key":"e_1_3_1_169_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.643"},{"key":"e_1_3_1_170_2","first-page":"10670","volume-title":"International Conference on Machine Learning","author":"Yang Yibo","year":"2020","unstructured":"Yibo Yang, Robert Bamler, and Stephan Mandt. 2020. Variational bayesian quantization. In International Conference on Machine Learning. PMLR, 10670\u201310680."},{"key":"e_1_3_1_171_2","doi-asserted-by":"publisher","DOI":"10.1145\/3319535.3354261"},{"key":"e_1_3_1_172_2","first-page":"11887","volume-title":"International Conference on Machine Learning","author":"Yao Huaxiu","year":"2021","unstructured":"Huaxiu Yao, Long-Kai Huang, Linjun Zhang, Ying Wei, Li Tian, James Zou, Junzhou Huang, et\u00a0al. 2021. Improving generalization in meta-learning via task augmentation. In International Conference on Machine Learning. PMLR, 11887\u201311897."},{"key":"e_1_3_1_173_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2968399"},{"key":"e_1_3_1_174_2","first-page":"10820","volume-title":"International Conference on Machine Learning","author":"Ye Mao","year":"2020","unstructured":"Mao Ye, Chengyue Gong, Lizhen Nie, Denny Zhou, Adam Klivans, and Qiang Liu. 2020. Good subnetworks provably exist: Pruning via greedy forward selection. In International Conference on Machine Learning. PMLR, 10820\u201310830."},{"key":"e_1_3_1_175_2","first-page":"16409","article-title":"Greedy optimization provably wins the lottery: Logarithmic number of winning tickets is enough","volume":"33","author":"Ye Mao","year":"2020","unstructured":"Mao Ye, Lemeng Wu, and Qiang Liu. 2020. Greedy optimization provably wins the lottery: Logarithmic number of winning tickets is enough. Advances in Neural Information Processing Systems 33 (2020), 16409\u201316420.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_176_2","first-page":"5650","volume-title":"International Conference on Machine Learning","author":"Yin Dong","year":"2018","unstructured":"Dong Yin, Yudong Chen, Ramchandran Kannan, and Peter Bartlett. 2018. Byzantine-robust distributed learning: Towards optimal statistical rates. In International Conference on Machine Learning. PMLR, 5650\u20135659."},{"key":"e_1_3_1_177_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00874"},{"key":"e_1_3_1_178_2","unstructured":"Jaehong Yoon Saehoon Kim Eunho Yang and Sung Ju Hwang. 2019. Scalable and order-robust continual learning with additive parameter decomposition. arXiv:1902.09432. Retrieved from https:\/\/arxiv.org\/abs\/1902.09432"},{"key":"e_1_3_1_179_2","unstructured":"Jaehong Yoon Eunho Yang Jeongtae Lee and Sung Ju Hwang. 2017. Lifelong learning with dynamically expandable networks. arXiv:1708.01547. Retrieved from https:\/\/arxiv.org\/abs\/1708.01547"},{"key":"e_1_3_1_180_2","doi-asserted-by":"publisher","DOI":"10.14722\/ndss.2020.24178"},{"key":"e_1_3_1_181_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33015693"},{"key":"e_1_3_1_182_2","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2019.00019"},{"key":"e_1_3_1_183_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00701"},{"key":"e_1_3_1_184_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00958"},{"key":"e_1_3_1_185_2","unstructured":"Tao Yu Eugene Bagdasaryan and Vitaly Shmatikov. 2020. Salvaging federated learning by local adaptation. arXiv:2002.04758. Retrieved from https:\/\/arxiv.org\/abs\/2002.04758"},{"key":"e_1_3_1_186_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.15"},{"key":"e_1_3_1_187_2","doi-asserted-by":"crossref","unstructured":"Chenrui Zhang and Yuxin Peng. 2018. Better and faster: Knowledge transfer from multiple self-supervised learning tasks via graph distillation for video classification. arXiv:1804.10069. Retrieved from https:\/\/arxiv.org\/abs\/1804.10069","DOI":"10.24963\/ijcai.2018\/158"},{"key":"e_1_3_1_188_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.01227"},{"key":"e_1_3_1_189_2","first-page":"5288","volume-title":"30th Chinese Control Conference","author":"Zhang Guangming","year":"2011","unstructured":"Guangming Zhang, Ning Li, and Shaoyuan Li. 2011. Data-driven process monitoring method based on dynamic component analysis. In 30th Chinese Control Conference. IEEE, 5288\u20135293."},{"key":"e_1_3_1_190_2","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3379992"},{"key":"e_1_3_1_191_2","doi-asserted-by":"publisher","DOI":"10.1109\/TrustCom\/BigDataSE.2019.00057"},{"issue":"7","key":"e_1_3_1_192_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3464419","article-title":"Edge learning: The enabling technology for distributed big data analytics in the edge","volume":"54","author":"Zhang Jie","year":"2021","unstructured":"Jie Zhang, Zhihao Qu, Chenxi Chen, Haozhao Wang, Yufeng Zhan, Baoliu Ye, and Song Guo. 2021. Edge learning: The enabling technology for distributed big data analytics in the edge. ACM Computing Surveys (CSUR) 54, 7 (2021), 1\u201336.","journal-title":"ACM Computing Surveys (CSUR)"},{"key":"e_1_3_1_193_2","unstructured":"S. Zhang A Sohrabizadeh C. Wan Z. Huang Z. Hu Y. Wang Y. Li J. Cong and Y. Sun. A survey on graph neural network acceleration: Algorithms systems and customized hardware. arXiv 2023. arXiv:2306.14052. Retrieved from https:\/\/arxiv.org\/abs\/2306.14052"},{"key":"e_1_3_1_194_2","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611976236.41"},{"key":"e_1_3_1_195_2","doi-asserted-by":"crossref","unstructured":"Zhao Zhang Yan Zhang Sheng Li Guangcan Liu Dan Zeng Shuicheng Yan and Meng Wang. 2019. Flexible auto-weighted local-coordinate concept factorization: A robust framework for unsupervised clustering. IEEE Transactions on Knowledge and Data Engineering 33 4 (2019) 1523\u20131539.","DOI":"10.1109\/TKDE.2019.2940576"},{"key":"e_1_3_1_196_2","unstructured":"Yue Zhao Meng Li Liangzhen Lai Naveen Suda Damon Civin and Vikas Chandra. 2018. Federated learning with non-iid data. arXiv:1806.00582. Retrieved from https:\/\/arxiv.org\/abs\/1806.00582"},{"key":"e_1_3_1_197_2","unstructured":"Yang Zhao Jun Zhao Linshan Jiang Rui Tan and Dusit Niyato. 2020. Mobile edge computing blockchain and reputation-based crowdsourcing IoT federated learning: A secure decentralized and privacy-preserving system. arXiv preprint arXiv:1906.10893."},{"key":"e_1_3_1_198_2","first-page":"177","volume-title":"2021 USENIX Annual Technical Conference (USENIX ATC 21)","author":"Zhou Qihua","year":"2021","unstructured":"Qihua Zhou, Song Guo, Zhihao Qu, Jingcai Guo, Zhenda Xu, Jiewei Zhang, Tao Guo, Boyuan Luo, and Jingren Zhou. 2021. Octo: \\(\\lbrace\\) INT8 \\(\\rbrace\\) training with loss-aware compensation and backward quantization for tiny on-device learning. In 2021 USENIX Annual Technical Conference (USENIX ATC 21). 177\u2013191."},{"key":"e_1_3_1_199_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00487"}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3708495","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3708495","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:09:54Z","timestamp":1750295394000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3708495"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,24]]},"references-count":198,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2025,5,31]]}},"alternative-id":["10.1145\/3708495"],"URL":"https:\/\/doi.org\/10.1145\/3708495","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,24]]},"assertion":[{"value":"2023-04-04","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-11-04","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-01-24","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}