{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,23]],"date-time":"2026-03-23T23:03:14Z","timestamp":1774306994450,"version":"3.50.1"},"reference-count":33,"publisher":"Informa UK Limited","issue":"5","content-domain":{"domain":["www.tandfonline.com"],"crossmark-restriction":true},"short-container-title":["Optimization Methods and Software"],"published-print":{"date-parts":[[2025,9,3]]},"DOI":"10.1080\/10556788.2024.2322095","type":"journal-article","created":{"date-parts":[[2024,3,14]],"date-time":"2024-03-14T07:26:11Z","timestamp":1710401171000},"page":"1153-1180","update-policy":"https:\/\/doi.org\/10.1080\/tandf_crossmark_01","source":"Crossref","is-referenced-by-count":22,"title":["Decentralized gradient tracking with local steps"],"prefix":"10.1080","volume":"40","author":[{"given":"Yue","family":"Liu","sequence":"first","affiliation":[{"name":"University of Toronto","place":["Toronto, Canada"]}]},{"given":"Tao","family":"Lin","sequence":"additional","affiliation":[{"name":"Westlake University","place":["Zhejiang, People's Republic of China"]}]},{"given":"Anastasia","family":"Koloskova","sequence":"additional","affiliation":[{"name":"EPFL","place":["Ecublens, Switzerland"]}]},{"given":"Sebastian U.","family":"Stich","sequence":"additional","affiliation":[{"name":"CISPA Helmholtz Center for Information Security","place":["Saarbr\u00fccken, Germany"]}]}],"member":"301","published-online":{"date-parts":[[2024,3,14]]},"reference":[{"key":"e_1_3_3_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.automatica.2020.109003"},{"key":"e_1_3_3_3_1","unstructured":"Chen et\u00a0al. Accelerating gossip SGD with periodic global averaging in ICML 2021."},{"key":"e_1_3_3_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2012.2211477"},{"key":"e_1_3_3_5_1","unstructured":"P. Goyal P. Doll\u00e1r R.B. Girshick P. Noordhuis L. Wesolowski A. Kyrola A. Tulloch Y. Jia and K. He Accurate large minibatch SGD: Training ImageNet in 1 hour arXiv preprint arXiv:1706.02677 2017."},{"key":"e_1_3_3_6_1","unstructured":"F. Haddadpour M.M. Kamani M. Mahdavi and V. Cadambe Local SGD with periodic averaging: Tighter analysis and adaptive synchronization in NeurIPS 2019."},{"key":"e_1_3_3_7_1","unstructured":"K. Hsieh A. Phanishayee O. Mutlu and P. Gibbons The non-IID data quagmire of decentralized machine learning in ICML 2020."},{"key":"e_1_3_3_8_1","unstructured":"S. Ioffe and C. Szegedy Batch normalization: Accelerating deep network training by reducing internal covariate shift in ICML 2015."},{"key":"e_1_3_3_9_1","doi-asserted-by":"publisher","DOI":"10.1561\/2200000083"},{"key":"e_1_3_3_10_1","unstructured":"S.P. Karimireddy S. Kale M. Mohri S. Reddi S.U. Stich and A.T. Suresh SCAFFOLD: Stochastic controlled averaging for federated learning in ICML 2020."},{"key":"e_1_3_3_11_1","unstructured":"A. Koloskova T. Lin and S. Stich An improved analysis of gradient tracking for decentralized machine learning in NeurIPS 2021."},{"key":"e_1_3_3_12_1","unstructured":"A. Koloskova T. Lin S.U. Stich and M. Jaggi Decentralized deep learning with arbitrary communication compression in ICLR 2020."},{"key":"e_1_3_3_13_1","unstructured":"A. Koloskova N. Loizou S. Boreiri M. Jaggi and S. Stich A unified theory of decentralized SGD with changing topology and local updates in ICML 2020."},{"key":"e_1_3_3_14_1","unstructured":"A. Koloskova S. Stich and M. Jaggi Decentralized stochastic optimization and gossip algorithms with compressed communication in ICML 2019."},{"key":"e_1_3_3_15_1","unstructured":"J. Kone\u010dny H.B. McMahan F.X. Yu P. Richt\u00e1rik A.T. Suresh and D. Bacon Federated learning: Strategies for improving communication efficiency arXiv preprint arXiv:1610.05492 2016."},{"key":"e_1_3_3_16_1","unstructured":"B. Li S. Cen Y. Chen and Y. Chi Communication-efficient distributed optimization in networks with gradient tracking and variance reduction in AISTATS 2020."},{"key":"e_1_3_3_17_1","doi-asserted-by":"crossref","unstructured":"M. Li D.G. Andersen A.J. Smola and K. Yu Communication efficient distributed machine learning with the parameter server in NeurIPS 2014.","DOI":"10.1145\/2640087.2644155"},{"key":"e_1_3_3_18_1","unstructured":"T. Li A.K. Sahu M. Zaheer M. Sanjabi A. Talwalkar and V. Smith Federated optimization in heterogeneous networks in MLSys 2020."},{"key":"e_1_3_3_19_1","unstructured":"X. Lian C. Zhang H. Zhang C.J. Hsieh W. Zhang and J. Liu Can decentralized algorithms outperform centralized algorithms? A case study for decentralized parallel stochastic gradient descent in NeurIPS 2017."},{"key":"e_1_3_3_20_1","unstructured":"X. Lian W. Zhang C. Zhang and J. Liu Asynchronous decentralized parallel stochastic gradient descent in ICML 2018."},{"key":"e_1_3_3_21_1","unstructured":"T. Lin S.U. Stich K.K. Patel and M. Jaggi Don't use large mini-batches use local SGD in ICLR 2020."},{"key":"e_1_3_3_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSIPN.2016.2524588"},{"key":"e_1_3_3_23_1","unstructured":"B. McMahan E. Moore D. Ramage S. Hampson and B.A. y Arcas Communication-efficient learning of deep networks from decentralized data in AISTATS. PMLR 2017 pp. 1273\u20131282."},{"key":"e_1_3_3_24_1","doi-asserted-by":"publisher","DOI":"10.1137\/16M1084316"},{"key":"e_1_3_3_25_1","doi-asserted-by":"publisher","DOI":"10.1137\/070704277"},{"key":"e_1_3_3_26_1","doi-asserted-by":"crossref","unstructured":"S. Pu and A. Nedic A distributed stochastic gradient tracking method in ICDC 2018.","DOI":"10.1109\/CDC.2018.8618708"},{"key":"e_1_3_3_27_1","doi-asserted-by":"publisher","DOI":"10.1137\/14096668X"},{"key":"e_1_3_3_28_1","unstructured":"S.U. Stich Local SGD converges fast and communicates little in ICLR 2019."},{"key":"e_1_3_3_29_1","unstructured":"H. Tang X. Lian M. Yan C. Zhang and J. Liu D2: Decentralized training over decentralized data in ICML 2018."},{"key":"e_1_3_3_30_1","unstructured":"J.N. Tsitsiklis Problems in decentralized decision making and computation Tech. Rep. Massachusetts Inst of Tech Cambridge Lab for Information and Decision Systems 1984."},{"key":"e_1_3_3_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2020.3031071"},{"key":"e_1_3_3_32_1","doi-asserted-by":"crossref","unstructured":"Y. You Z. Zhang C.J. Hsieh J. Demmel and K. Keutzer ImageNet training in minutes in ICPP 2018.","DOI":"10.1145\/3225058.3225069"},{"key":"e_1_3_3_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2020.3011640"},{"key":"e_1_3_3_34_1","unstructured":"J. Zhang and K. You Decentralized stochastic gradient tracking for non-convex empirical risk minimization arXiv preprint (2019). Available at: arXiv:1909.02712 2019."}],"container-title":["Optimization Methods and Software"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.tandfonline.com\/doi\/pdf\/10.1080\/10556788.2024.2322095","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,30]],"date-time":"2025-10-30T16:06:12Z","timestamp":1761840372000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/10556788.2024.2322095"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,14]]},"references-count":33,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2025,9,3]]}},"alternative-id":["10.1080\/10556788.2024.2322095"],"URL":"https:\/\/doi.org\/10.1080\/10556788.2024.2322095","relation":{},"ISSN":["1055-6788","1029-4937"],"issn-type":[{"value":"1055-6788","type":"print"},{"value":"1029-4937","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,14]]},"assertion":[{"value":"The publishing and review policy for this title is described in its Aims & Scope.","order":1,"name":"peerreview_statement","label":"Peer Review Statement"},{"value":"http:\/\/www.tandfonline.com\/action\/journalInformation?show=aimsScope&journalCode=goms20","URL":"http:\/\/www.tandfonline.com\/action\/journalInformation?show=aimsScope&journalCode=goms20","order":2,"name":"aims_and_scope_url","label":"Aim & Scope"},{"value":"2022-09-30","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-02-11","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-03-14","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}