{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,5]],"date-time":"2026-09-05T03:12:34Z","timestamp":1788577954027,"version":"build-2803163510"},"publisher-location":"New York, NY, USA","reference-count":34,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,8,3]],"date-time":"2020-08-03T00:00:00Z","timestamp":1596412800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,8,3]]},"DOI":"10.1145\/3411029.3411037","type":"proceedings-article","created":{"date-parts":[[2020,8,11]],"date-time":"2020-08-11T12:10:28Z","timestamp":1597147828000},"page":"52-57","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":23,"title":["RAT - Resilient Allreduce Tree for Distributed Machine Learning"],"prefix":"10.1145","author":[{"given":"Xinchen","family":"Wan","sequence":"first","affiliation":[{"name":"Hong Kong University of Science and Technology"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hong","family":"Zhang","sequence":"additional","affiliation":[{"name":"UC Berkley"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hao","family":"Wang","sequence":"additional","affiliation":[{"name":"Hong Kong University of Science and Technology"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shuihai","family":"Hu","sequence":"additional","affiliation":[{"name":"Clustar"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junxue","family":"Zhang","sequence":"additional","affiliation":[{"name":"Hong Kong University of Science and Technology"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kai","family":"Chen","sequence":"additional","affiliation":[{"name":"Hong Kong University of Science and Technology and Peng Cheng Lab"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,8,11]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"OSDI","author":"Abadi Martin","year":"2016","unstructured":"Martin Abadi , Paul Barham , Jianmin Chen , Zhifeng Chen , Andy Davis , Jeffrey Dean , Matthieu Devin , Sanjay Ghemawat , Geoffrey Irving , Michael Isard , 2016 . Tensorflow: A system for large-scale machine learning . In OSDI 2016. Martin Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, 2016. Tensorflow: A system for large-scale machine learning. In OSDI 2016."},{"key":"e_1_3_2_1_2_1","volume-title":"NIPS","author":"Alistarh Dan","year":"2017","unstructured":"Dan Alistarh , Demjan Grubic , Jerry Li , Ryota Tomioka , and Milan Vojnovic . 2017 . QSGD: Communication-efficient SGD via gradient quantization and encoding . In NIPS 2017. Dan Alistarh, Demjan Grubic, Jerry Li, Ryota Tomioka, and Milan Vojnovic. 2017. QSGD: Communication-efficient SGD via gradient quantization and encoding. In NIPS 2017."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2486001.2486031"},{"key":"e_1_3_2_1_4_1","volume-title":"NSDI","author":"Bai Wei","year":"2015","unstructured":"Wei Bai , Li Chen , Kai Chen , Dongsu Han , Chen Tian , and Hao Wang . 2015 . Information-agnostic flow scheduling for commodity data centers . In NSDI 2015. Wei Bai, Li Chen, Kai Chen, Dongsu Han, Chen Tian, and Hao Wang. 2015. Information-agnostic flow scheduling for commodity data centers. In NSDI 2015."},{"key":"e_1_3_2_1_5_1","unstructured":"Kashif Bilal Samee\u00a0Ullah Khan Joanna Kolodziej Limin Zhang Khizar Hayat Sajjad\u00a0Ahmad Madani Nasro Min-Allah Lizhe Wang and Dan Chen. [n.d.]. A Comparative Study Of Data Center Network Architectures.  Kashif Bilal Samee\u00a0Ullah Khan Joanna Kolodziej Limin Zhang Khizar Hayat Sajjad\u00a0Ahmad Madani Nasro Min-Allah Lizhe Wang and Dan Chen. [n.d.]. A Comparative Study Of Data Center Network Architectures."},{"key":"e_1_3_2_1_6_1","volume-title":"Mxnet: A flexible and efficient machine learning library for heterogeneous distributed systems. arXiv preprint arXiv:1512.01274(2015).","author":"Chen Tianqi","year":"2015","unstructured":"Tianqi Chen , Mu Li , Yutian Li , Min Lin , Naiyan Wang , Minjie Wang , Tianjun Xiao , Bing Xu , Chiyuan Zhang , and Zheng Zhang . 2015 . Mxnet: A flexible and efficient machine learning library for heterogeneous distributed systems. arXiv preprint arXiv:1512.01274(2015). Tianqi Chen, Mu Li, Yutian Li, Min Lin, Naiyan Wang, Minjie Wang, Tianjun Xiao, Bing Xu, Chiyuan Zhang, and Zheng Zhang. 2015. Mxnet: A flexible and efficient machine learning library for heterogeneous distributed systems. arXiv preprint arXiv:1512.01274(2015)."},{"key":"e_1_3_2_1_7_1","volume-title":"SysML","author":"Cho Minsik","year":"2019","unstructured":"Minsik Cho , Ulrich Finkler , and David Kung . 2019. BlueConnect: Novel Hierarchical All-Reduce on Multi-tired Network for Deep Learning . In SysML 2019 . Minsik Cho, Ulrich Finkler, and David Kung. 2019. BlueConnect: Novel Hierarchical All-Reduce on Multi-tired Network for Deep Learning. In SysML 2019."},{"key":"e_1_3_2_1_8_1","volume-title":"Efficient Coflow Scheduling Without Prior Knowledge. In SIGCOMM","author":"Chowdhury Mosharaf","year":"2015","unstructured":"Mosharaf Chowdhury and Ion Stoica . 2015 . Efficient Coflow Scheduling Without Prior Knowledge. In SIGCOMM 2015. Mosharaf Chowdhury and Ion Stoica. 2015. Efficient Coflow Scheduling Without Prior Knowledge. In SIGCOMM 2015."},{"key":"e_1_3_2_1_9_1","volume-title":"Proceedings of the Workshop on Network Meets AI & ML","author":"Geng Jinkun","year":"2018","unstructured":"Jinkun Geng , Dan Li , Yang Cheng , Shuai Wang , and Junfeng Li . 2018 . HiPS: Hierarchical parameter synchronization in large-scale distributed machine learning . In Proceedings of the Workshop on Network Meets AI & ML 2018. Jinkun Geng, Dan Li, Yang Cheng, Shuai Wang, and Junfeng Li. 2018. HiPS: Hierarchical parameter synchronization in large-scale distributed machine learning. In Proceedings of the Workshop on Network Meets AI & ML 2018."},{"key":"e_1_3_2_1_11_1","unstructured":"Priya Goyal Piotr Doll\u00e1r Ross Girshick Pieter Noordhuis Lukasz Wesolowski Aapo Kyrola Andrew Tulloch Yangqing Jia and Kaiming He. 2017. Accurate large minibatch sgd: Training imagenet in 1 hour. arXiv preprint arXiv:1706.02677(2017).  Priya Goyal Piotr Doll\u00e1r Ross Girshick Pieter Noordhuis Lukasz Wesolowski Aapo Kyrola Andrew Tulloch Yangqing Jia and Kaiming He. 2017. Accurate large minibatch sgd: Training imagenet in 1 hour. arXiv preprint arXiv:1706.02677(2017)."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"crossref","unstructured":"Albert Greenberg James Hamilton David\u00a0A Maltz and Parveen Patel. 2008. The cost of a cloud: research problems in data center networks.  Albert Greenberg James Hamilton David\u00a0A Maltz and Parveen Patel. 2008. The cost of a cloud: research problems in data center networks.","DOI":"10.1145\/1496091.1496103"},{"key":"e_1_3_2_1_13_1","unstructured":"Sayed\u00a0Hadi Hashemi Sangeetha\u00a0Abdu Jyothi and Roy\u00a0H Campbell. 2018. TicTac: Accelerating distributed deep learning with communication scheduling. arXiv preprint arXiv:1803.03288(2018).  Sayed\u00a0Hadi Hashemi Sangeetha\u00a0Abdu Jyothi and Roy\u00a0H Campbell. 2018. TicTac: Accelerating distributed deep learning with communication scheduling. arXiv preprint arXiv:1803.03288(2018)."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/HPCA.2018.00059"},{"key":"e_1_3_2_1_15_1","volume-title":"Deep Residual Learning for Image Recognition. In CVPR","author":"He Kaiming","year":"2016","unstructured":"Kaiming He , Xiangyu Zhang , Shaoqing Ren , and Jian Sun . 2016 . Deep Residual Learning for Image Recognition. In CVPR 2016. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep Residual Learning for Image Recognition. In CVPR 2016."},{"key":"e_1_3_2_1_16_1","volume-title":"NIPS","author":"Ho Qirong","year":"2013","unstructured":"Qirong Ho , James Cipar , Henggang Cui , Seunghak Lee , Jin\u00a0Kyu Kim , Phillip\u00a0 B Gibbons , Garth\u00a0 A Gibson , Greg Ganger , and Eric\u00a0 P Xing . 2013 . More effective distributed ml via a stale synchronous parallel parameter server . In NIPS 2013. Qirong Ho, James Cipar, Henggang Cui, Seunghak Lee, Jin\u00a0Kyu Kim, Phillip\u00a0B Gibbons, Garth\u00a0A Gibson, Greg Ganger, and Eric\u00a0P Xing. 2013. More effective distributed ml via a stale synchronous parallel parameter server. In NIPS 2013."},{"key":"e_1_3_2_1_17_1","volume-title":"NSDI","author":"Hsieh Kevin","year":"2017","unstructured":"Kevin Hsieh , Aaron Harlap , Nandita Vijaykumar , Dimitris Konomis , Gregory\u00a0 R Ganger , Phillip\u00a0 B Gibbons , and Onur Mutlu . 2017 . Gaia: Geo-distributed machine learning approaching {LAN} speeds . In NSDI 2017. Kevin Hsieh, Aaron Harlap, Nandita Vijaykumar, Dimitris Konomis, Gregory\u00a0R Ganger, Phillip\u00a0B Gibbons, and Onur Mutlu. 2017. Gaia: Geo-distributed machine learning approaching {LAN} speeds. In NSDI 2017."},{"key":"e_1_3_2_1_18_1","volume-title":"SysML","author":"Jayarajan Anand","year":"2019","unstructured":"Anand Jayarajan , Jinliang Wei , Garth Gibson , Alexandra Fedorova , and Gennady Pekhimenko . 2019. Priority-based parameter propagation for distributed DNN training . In SysML 2019 . Anand Jayarajan, Jinliang Wei, Garth Gibson, Alexandra Fedorova, and Gennady Pekhimenko. 2019. Priority-based parameter propagation for distributed DNN training. In SysML 2019."},{"key":"e_1_3_2_1_19_1","volume-title":"Caffe: Convolutional Architecture for Fast Feature Embedding. arXiv preprint arXiv:1408.5093(2014).","author":"Jia Yangqing","year":"2014","unstructured":"Yangqing Jia , Evan Shelhamer , Jeff Donahue , Sergey Karayev , Jonathan Long , Ross Girshick , Sergio Guadarrama , and Trevor Darrell . 2014 . Caffe: Convolutional Architecture for Fast Feature Embedding. arXiv preprint arXiv:1408.5093(2014). Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick, Sergio Guadarrama, and Trevor Darrell. 2014. Caffe: Convolutional Architecture for Fast Feature Embedding. arXiv preprint arXiv:1408.5093(2014)."},{"key":"e_1_3_2_1_20_1","volume-title":"ISCA","author":"Kim John","year":"2017","unstructured":"John Kim , William\u00a0 J Dally , and Dennis Abts . 2017 . Flattened butterfly: a cost-efficient topology for high-radix networks . In ISCA 2007. John Kim, William\u00a0J Dally, and Dennis Abts. 2017. Flattened butterfly: a cost-efficient topology for high-radix networks. In ISCA 2007."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/2685048.2685095"},{"key":"e_1_3_2_1_22_1","volume-title":"NIPS","author":"Lian Xiangru","year":"2015","unstructured":"Xiangru Lian , Yijun Huang , Yuncheng Li , and Ji Liu . 2015 . Asynchronous parallel stochastic gradient for nonconvex optimization . In NIPS 2015. Xiangru Lian, Yijun Huang, Yuncheng Li, and Ji Liu. 2015. Asynchronous parallel stochastic gradient for nonconvex optimization. In NIPS 2015."},{"key":"e_1_3_2_1_23_1","volume-title":"ICLR","author":"Lin Yujun","year":"2018","unstructured":"Yujun Lin , Song Han , Huizi Mao , Yu Wang , and William\u00a0 J Dally . 2018 . Deep gradient compression: Reducing the communication bandwidth for distributed training . In ICLR 2018. Yujun Lin, Song Han, Huizi Mao, Yu Wang, and William\u00a0J Dally. 2018. Deep gradient compression: Reducing the communication bandwidth for distributed training. In ICLR 2018."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267809.3267840"},{"key":"e_1_3_2_1_25_1","volume-title":"SysML","author":"Luo Liang","year":"2020","unstructured":"Liang Luo , Peter West , Jacob Nelson , Arvind Krishnamurthy , and Luis Ceze . 2020. PLink: Efficient Cloud-based Training with Topology-aware Dynamic Hierarchical Aggregation . In SysML 2020 . Liang Luo, Peter West, Jacob Nelson, Arvind Krishnamurthy, and Luis Ceze. 2020. PLink: Efficient Cloud-based Training with Topology-aware Dynamic Hierarchical Aggregation. In SysML 2020."},{"key":"e_1_3_2_1_26_1","volume-title":"HotCloud","author":"Mai Luo","year":"2015","unstructured":"Luo Mai , Chuntao Hong , and Paolo Costa . 2015. Optimizing network performance in distributed machine learning . In HotCloud 2015 . Luo Mai, Chuntao Hong, and Paolo Costa. 2015. Optimizing network performance in distributed machine learning. In HotCloud 2015."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341301.3359646"},{"key":"e_1_3_2_1_28_1","unstructured":"Adam Paszke Sam Gross Soumith Chintala Gregory Chanan Edward Yang Zachary DeVito Zeming Lin Alban Desmaison Luca Antiga and Adam Lerer. 2017. Automatic differentiation in pytorch. (2017).  Adam Paszke Sam Gross Soumith Chintala Gregory Chanan Edward Yang Zachary DeVito Zeming Lin Alban Desmaison Luca Antiga and Adam Lerer. 2017. Automatic differentiation in pytorch. (2017)."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341301.3359642"},{"key":"e_1_3_2_1_30_1","unstructured":"Alexander Sergeev and Mike Del\u00a0Balso. 2018. Horovod: fast and easy distributed deep learning in TensorFlow. arXiv preprint arXiv:1802.05799(2018).  Alexander Sergeev and Mike Del\u00a0Balso. 2018. Horovod: fast and easy distributed deep learning in TensorFlow. arXiv preprint arXiv:1802.05799(2018)."},{"key":"e_1_3_2_1_31_1","unstructured":"Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556(2014).  Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556(2014)."},{"key":"e_1_3_2_1_32_1","volume-title":"Stream: Decentralized Opportunistic Inter-Coflows Scheduling for Datacenter Networks. In IEEE International Conference on Network Protocols (ICNP)","author":"Susanto Hengky","year":"2016","unstructured":"Hengky Susanto , Hao Jin , and Kai Chen . 2016 . Stream: Decentralized Opportunistic Inter-Coflows Scheduling for Datacenter Networks. In IEEE International Conference on Network Protocols (ICNP) 2016. Hengky Susanto, Hao Jin, and Kai Chen. 2016. Stream: Decentralized Opportunistic Inter-Coflows Scheduling for Datacenter Networks. In IEEE International Conference on Network Protocols (ICNP) 2016."},{"key":"e_1_3_2_1_33_1","volume-title":"NIPS","author":"Wang Songtao","year":"2018","unstructured":"Songtao Wang , Dan Li , Yang Cheng , Jinkun Geng , Yanshu Wang , Shuai Wang , Shu-Tao Xia , and Jianping Wu . 2018 . Bml: A high-performance, low-cost gradient synchronization algorithm for dml training . In NIPS 2018. Songtao Wang, Dan Li, Yang Cheng, Jinkun Geng, Yanshu Wang, Shuai Wang, Shu-Tao Xia, and Jianping Wu. 2018. Bml: A high-performance, low-cost gradient synchronization algorithm for dml training. In NIPS 2018."},{"key":"e_1_3_2_1_34_1","volume-title":"OSDI","author":"Xiao Wencong","year":"2018","unstructured":"Wencong Xiao , Romil Bhardwaj , Ramachandran Ramjee , Muthian Sivathanu , Nipun Kwatra , Zhenhua Han , Pratyush Patel , Xuan Peng , Hanyu Zhao , Quanlu Zhang , 2018 . Gandiva: Introspective cluster scheduling for deep learning . In OSDI 2018. Wencong Xiao, Romil Bhardwaj, Ramachandran Ramjee, Muthian Sivathanu, Nipun Kwatra, Zhenhua Han, Pratyush Patel, Xuan Peng, Hanyu Zhao, Quanlu Zhang, 2018. Gandiva: Introspective cluster scheduling for deep learning. In OSDI 2018."},{"key":"e_1_3_2_1_35_1","volume-title":"CODA: Toward Automatically Identifying and Scheduling Coflows in the Dark. In SIGCOMM","author":"Zhang Hong","year":"2016","unstructured":"Hong Zhang , Li Chen , Bairen Yi , Kai Chen , Mosharaf Chowdhury , and Yanhui Geng . 2016 . CODA: Toward Automatically Identifying and Scheduling Coflows in the Dark. In SIGCOMM 2016. Hong Zhang, Li Chen, Bairen Yi, Kai Chen, Mosharaf Chowdhury, and Yanhui Geng. 2016. CODA: Toward Automatically Identifying and Scheduling Coflows in the Dark. In SIGCOMM 2016."}],"event":{"name":"APNet '20: 4th Asia-Pacific Workshop on Networking","location":"Seoul Republic of Korea","acronym":"APNet '20"},"container-title":["4th Asia-Pacific Workshop on Networking"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411029.3411037","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3411029.3411037","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:28:12Z","timestamp":1750181292000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411029.3411037"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,3]]},"references-count":34,"alternative-id":["10.1145\/3411029.3411037","10.1145\/3411029"],"URL":"https:\/\/doi.org\/10.1145\/3411029.3411037","relation":{},"subject":[],"published":{"date-parts":[[2020,8,3]]},"assertion":[{"value":"2020-08-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}