{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,13]],"date-time":"2026-09-13T12:54:38Z","timestamp":1789304078017,"version":"build-2803163510"},"publisher-location":"New York, NY, USA","reference-count":32,"publisher":"ACM","license":[{"start":{"date-parts":[[2025,3,30]],"date-time":"2025-03-30T00:00:00Z","timestamp":1743292800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"King Abdullah University of Science and Technology (KAUST) Office of Research Administration (ORA)","award":["ORA-CRG2020- 4382"],"award-info":[{"award-number":["ORA-CRG2020- 4382"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,3,30]]},"DOI":"10.1145\/3721146.3721932","type":"proceedings-article","created":{"date-parts":[[2025,4,1]],"date-time":"2025-04-01T13:42:05Z","timestamp":1743514925000},"page":"216-229","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Global-QSGD: Allreduce-Compatible Quantization for Distributed Learning with Theoretical Guarantees"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8117-9422","authenticated-orcid":false,"given":"Jihao","family":"Xin","sequence":"first","affiliation":[{"name":"KAUST, Thuwal, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5051-4283","authenticated-orcid":false,"given":"Marco","family":"Canini","sequence":"additional","affiliation":[{"name":"KAUST, Thuwal, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4380-5848","authenticated-orcid":false,"given":"Peter","family":"Richt\u00e1rik","sequence":"additional","affiliation":[{"name":"KAUST, Thuwal, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0619-9260","authenticated-orcid":false,"given":"Samuel","family":"Horv\u00e1th","sequence":"additional","affiliation":[{"name":"MBZUAI, Abu Dhabi, United Arab Emirates"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,4]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation","author":"Abadi Mart\u00edn","year":"2016","unstructured":"Mart\u00edn Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, Manjunath Kudlur, Josh Levenberg, Rajat Monga, Sherry Moore, Derek G. Murray, Benoit Steiner, Paul Tucker, Vijay Vasudevan, Pete Warden, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng. 2016. TensorFlow: a system for large-scale machine learning. In Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation (Savannah, GA, USA) (OSDI'16). USENIX Association, USA, 265--283."},{"key":"e_1_3_2_1_2_1","volume-title":"Proceedings of Machine Learning and Systems, D. Marculescu, Y. Chi, and C. Wu (Eds.)","volume":"4","author":"Agarwal Saurabh","year":"2022","unstructured":"Saurabh Agarwal, Hongyi Wang, Shivaram Venkataraman, and Dimitris Papailiopoulos. 2022. On the Utility of Gradient Compression in Distributed Training Systems. In Proceedings of Machine Learning and Systems, D. Marculescu, Y. Chi, and C. Wu (Eds.), Vol. 4. mlsys.org, Santa Clara, CA, USA, 652--672. https:\/\/proceedings.mlsys.org\/paper_files\/paper\/2022\/file\/773862fcc2e29f650d68960ba5bd1101-Paper.pdf"},{"key":"e_1_3_2_1_3_1","volume-title":"Proceedings of the 31st International Conference on Neural Information Processing Systems","author":"Alistarh Dan","year":"2017","unstructured":"Dan Alistarh, Demjan Grubic, Jerry Z. Li, Ryota Tomioka, and Milan Vojnovic. 2017. QSGD: communication-efficient SGD via gradient quantization and encoding. In Proceedings of the 31st International Conference on Neural Information Processing Systems (Long Beach, California, USA) (NIPS'17). Curran Associates Inc., Red Hook, NY, USA, 1707--1718."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.5555\/3327345.3327497"},{"key":"e_1_3_2_1_5_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning, ICML (Proceedings of Machine Learning Research","volume":"568","author":"Bernstein Jeremy","year":"2018","unstructured":"Jeremy Bernstein, Yu-Xiang Wang, Kamyar Azizzadenesheli, and Animashree Anandkumar. 2018. SIGNSGD: Compressed Optimisation for Non-Convex Problems. In Proceedings of the 35th International Conference on Machine Learning, ICML (Proceedings of Machine Learning Research, Vol. 80), Jennifer G. Dy and Andreas Krause (Eds.). PMLR, Stockholmsm\u00e4ssan, Stockholm, Sweden, 559--568. http:\/\/proceedings.mlr.press\/v80\/bernstein18a.html"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/PDP52278.2021.00025"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00607-021-01029-2"},{"key":"e_1_3_2_1_9_1","volume-title":"Proceedings of the 26th International Conference on Neural Information Processing Systems -","volume":"1","author":"Dean Jeffrey","unstructured":"Jeffrey Dean, Greg S. Corrado, Rajat Monga, Kai Chen, Matthieu Devin, Quoc V. Le, Mark Z. Mao, Marc'Aurelio Ranzato, Andrew Senior, Paul Tucker, Ke Yang, and Andrew Y. Ng. 2012. Large scale distributed deep networks. In Proceedings of the 26th International Conference on Neural Information Processing Systems - Volume 1 (Lake Tahoe, Nevada) (NIPS'12). Curran Associates Inc., Red Hook, NY, USA, 1223--1231."},{"key":"e_1_3_2_1_10_1","article-title":"A Simple Convergence Proof of Adam and Adagrad","volume":"2022","author":"D\u00e9fossez Alexandre","year":"2022","unstructured":"Alexandre D\u00e9fossez, Leon Bottou, Francis Bach, and Nicolas Usunier. 2022. A Simple Convergence Proof of Adam and Adagrad. Transactions on Machine Learning Research 2022, 1 (2022). https:\/\/openreview.net\/forum?id=ZPQhzTSWA7","journal-title":"Transactions on Machine Learning Research"},{"key":"e_1_3_2_1_11_1","volume-title":"Quantization and Coordinate Descent. In Proceedings of the Twenty Third International Conference on Artificial Intelligence and Statistics (Proceedings of Machine Learning Research","volume":"690","author":"Gorbunov Eduard","year":"2020","unstructured":"Eduard Gorbunov, Filip Hanzely, and Peter Richtarik. 2020. A Unified Theory of SGD: Variance Reduction, Sampling, Quantization and Coordinate Descent. In Proceedings of the Twenty Third International Conference on Artificial Intelligence and Statistics (Proceedings of Machine Learning Research, Vol. 108), Silvia Chiappa and Roberto Calandra (Eds.). PMLR, Virtual, Sicily, Italy, 680--690. https:\/\/proceedings.mlr.press\/v108\/gorbunov20a.html"},{"key":"e_1_3_2_1_12_1","volume-title":"9th International Conference on Learning Representations, ICLR. Open-Review.net","author":"Horv\u00e1th Samuel","year":"2021","unstructured":"Samuel Horv\u00e1th and Peter Richt\u00e1rik. 2021. A Better Alternative to Error Feedback for Communication-Efficient Distributed Learning. In 9th International Conference on Learning Representations, ICLR. Open-Review.net, Virtual Event, Austria. https:\/\/openreview.net\/forum?id=vYVI1CHPaQg"},{"key":"e_1_3_2_1_13_1","volume-title":"Proceedings of Mathematical and Scientific Machine Learning (Proceedings of Machine Learning Research","volume":"141","author":"Horv\u00f3th Samuel","year":"2022","unstructured":"Samuel Horv\u00f3th, Chen-Yu Ho, Ludovit Horvath, Atal Narayan Sahu, Marco Canini, and Peter Richtarik. 2022. Natural Compression for Distributed Deep Learning. In Proceedings of Mathematical and Scientific Machine Learning (Proceedings of Machine Learning Research, Vol. 190), Bin Dong, Qianxiao Li, Lei Wang, and Zhi-Qin John Xu (Eds.). PMLR, Beijing, China, 129--141. https:\/\/proceedings.mlr.press\/v190\/horvoth22a.html"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1080\/10556788.2024.2358790"},{"key":"e_1_3_2_1_15_1","volume-title":"International Conference on Machine Learning. PMLR, PMLR","author":"Karimireddy Sai Praneeth","year":"2019","unstructured":"Sai Praneeth Karimireddy, Quentin Rebjock, Sebastian Stich, and Martin Jaggi. 2019. Error feedback fixes signsgd and other gradient compression schemes. In International Conference on Machine Learning. PMLR, PMLR, Long Beach, California, USA, 3252--3261."},{"key":"e_1_3_2_1_16_1","volume-title":"International conference on machine learning. PMLR, PMLR","author":"Koloskova Anastasia","year":"2019","unstructured":"Anastasia Koloskova, Sebastian Stich, and Martin Jaggi. 2019. Decentralized stochastic optimization and gossip algorithms with compressed communication. In International conference on machine learning. PMLR, PMLR, Long Beach, California, USA, 3478--3487."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.3389\/fams.2018.00062"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2020.3003307"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2640087.2644155"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3503221.3508399"},{"key":"e_1_3_2_1_21_1","volume-title":"Proceedings of Machine Learning and Systems, P. Gibbons, G. Pekhimenko, and C. De Sa (Eds.)","volume":"6","author":"Markov Ilia","year":"2024","unstructured":"Ilia Markov, Kaveh Alim, Elias Frantar, and Dan Alistarh. 2024. L-GreCo: Layerwise-adaptive Gradient Compression For Efficient Data-parallel Deep Learning. In Proceedings of Machine Learning and Systems, P. Gibbons, G. Pekhimenko, and C. De Sa (Eds.), Vol. 6. mlsys.org, Santa Clara, USA, 312--324. https:\/\/proceedings.mlsys.org\/paper_files\/paper\/2024\/file\/9069a8976ff06f6443e7f4172990a580-Paper-Conference.pdf"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2017.7966324"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3458817.3476209"},{"key":"e_1_3_2_1_24_1","volume-title":"Proceedings of the 35th International Conference on Neural Information Processing Systems (NIPS '21)","author":"Richt\u00e1rik Peter","year":"2021","unstructured":"Peter Richt\u00e1rik, Igor Sokolov, and Ilyas Fatkhullin. 2021. EF21: a new, simpler, theoretically better, and practically faster error feedback. In Proceedings of the 35th International Conference on Neural Information Processing Systems (NIPS '21). Curran Associates Inc., Red Hook, NY, USA, Article 335, 13 pages."},{"key":"e_1_3_2_1_25_1","volume-title":"Scaling Distributed Machine Learning with In-Network Aggregation. In 18th USENIX Symposium on Networked Systems Design and Implementation (NSDI 21)","author":"Sapio Amedeo","year":"2021","unstructured":"Amedeo Sapio, Marco Canini, Chen-Yu Ho, Jacob Nelson, Panos Kalnis, Changhoon Kim, Arvind Krishnamurthy, Masoud Moshref, Dan Ports, and Peter Richtarik. 2021. Scaling Distributed Machine Learning with In-Network Aggregation. In 18th USENIX Symposium on Networked Systems Design and Implementation (NSDI 21). USENIX Association, virtual, 785--808. https:\/\/www.usenix.org\/conference\/nsdi21\/presentation\/sapio"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.21437\/INTERSPEECH.2014-274"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.5555\/3327345.3327357"},{"key":"e_1_3_2_1_28_1","volume-title":"Proceedings of the 34th International Conference on Machine Learning -","volume":"70","author":"Suresh Ananda Theertha","year":"2017","unstructured":"Ananda Theertha Suresh, Felix X. Yu, Sanjiv Kumar, and H. Brendan McMahan. 2017. Distributed mean estimation with limited communication. In Proceedings of the 34th International Conference on Machine Learning - Volume 70 (Sydney, NSW, Australia) (ICML'17). JMLR.org, Sydney NSW Australia, 3329--3337."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1177\/1094342005051521"},{"key":"e_1_3_2_1_30_1","volume-title":"Proceedings of the 33rd International Conference on Neural Information Processing Systems. Curran Associates Inc.","author":"Vogels Thijs","year":"2019","unstructured":"Thijs Vogels, Sai Praneeth Karimireddy, and Martin Jaggi. 2019. PowerSGD: practical low-rank gradient compression for distributed optimization. In Proceedings of the 33rd International Conference on Neural Information Processing Systems. Curran Associates Inc., Red Hook, NY, USA, Article 1278, 10 pages."},{"key":"e_1_3_2_1_31_1","first-page":"9850","article-title":"Atomo: Communication-efficient learning via atomic sparsification","volume":"31","author":"Wang Hongyi","year":"2018","unstructured":"Hongyi Wang, Scott Sievert, Shengchao Liu, Zachary Charles, Dimitris Papailiopoulos, and Stephen Wright. 2018. Atomo: Communication-efficient learning via atomic sparsification. Advances in Neural Information Processing Systems (NeurIPS) 31 (2018), 9850--9861.","journal-title":"Advances in Neural Information Processing Systems (NeurIPS)"},{"key":"e_1_3_2_1_32_1","volume-title":"Proceedings of the 31st International Conference on Neural Information Processing Systems","author":"Wen Wei","year":"2017","unstructured":"Wei Wen, Cong Xu, Feng Yan, Chunpeng Wu, Yandan Wang, Yiran Chen, and Hai Li. 2017. TernGrad: ternary gradients to reduce communication in distributed deep learning. In Proceedings of the 31st International Conference on Neural Information Processing Systems (Long Beach, California, USA) (NIPS'17). Curran Associates Inc., Red Hook, NY, USA, 1508--1518."},{"key":"e_1_3_2_1_33_1","first-page":"12593","article-title":"Cser: Communication-efficient sgd with error reset","volume":"33","author":"Xie Cong","year":"2020","unstructured":"Cong Xie, Shuai Zheng, Sanmi Koyejo, Indranil Gupta, Mu Li, and Haibin Lin. 2020. Cser: Communication-efficient sgd with error reset. Advances in Neural Information Processing Systems 33 (2020), 12593--12603.","journal-title":"Advances in Neural Information Processing Systems"}],"event":{"name":"EuroMLSys '25: 5th Workshop on Machine Learning and Systems","location":"World Trade Center Rotterdam Netherlands","acronym":"EuroMLSys '25","sponsor":["SIGOPS ACM Special Interest Group on Operating Systems"]},"container-title":["Proceedings of the 5th Workshop on Machine Learning and Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3721146.3721932","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3721146.3721932","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T21:57:39Z","timestamp":1750283859000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3721146.3721932"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,30]]},"references-count":32,"alternative-id":["10.1145\/3721146.3721932","10.1145\/3721146"],"URL":"https:\/\/doi.org\/10.1145\/3721146.3721932","relation":{},"subject":[],"published":{"date-parts":[[2025,3,30]]},"assertion":[{"value":"2025-04-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}