{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:35:08Z","timestamp":1750221308724,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":29,"publisher":"ACM","license":[{"start":{"date-parts":[[2017,11,12]],"date-time":"2017-11-12T00:00:00Z","timestamp":1510444800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2017,11,12]]},"DOI":"10.1145\/3146347.3146350","type":"proceedings-article","created":{"date-parts":[[2017,10,31]],"date-time":"2017-10-31T12:31:37Z","timestamp":1509453097000},"page":"1-8","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["An Efficient Task-based All-Reduce for Machine Learning Applications"],"prefix":"10.1145","author":[{"given":"Zhenyu","family":"Li","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Warwick Coventry, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James","family":"Davis","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Warwick Coventry, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stephen","family":"Jarvis","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Warwick Coventry, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,11,12]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI)","author":"Abadi Mart\u00edn","year":"2016","unstructured":"Mart\u00edn Abadi , Paul Barham , Jianmin Chen , Zhifeng Chen , Andy Davis , Jeffrey Dean , Matthieu Devin , Sanjay Ghemawat , Geoffrey Irving , Michael Isard , 2016 . TensorFlow: A system for large-scale machine learning . In Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI) . Savannah, Georgia, USA. Mart\u00edn Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, et al. 2016. TensorFlow: A system for large-scale machine learning. In Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI). Savannah, Georgia, USA."},{"key":"e_1_3_2_1_2_1","volume-title":"Sparse Communication for Distributed Gradient Descent. arXiv preprint arXiv:1704.05021","author":"Aji Alham Fikri","year":"2017","unstructured":"Alham Fikri Aji and Kenneth Heafield . 2017. Sparse Communication for Distributed Gradient Descent. arXiv preprint arXiv:1704.05021 ( 2017 ). Alham Fikri Aji and Kenneth Heafield. 2017. Sparse Communication for Distributed Gradient Descent. arXiv preprint arXiv:1704.05021 (2017)."},{"key":"e_1_3_2_1_3_1","volume-title":"Apache flink: Stream and batch processing in a single engine. Data Engineering 38, 4","author":"Carbone Paris","year":"2015","unstructured":"Paris Carbone , Asterios Katsifodimos , Stephan Ewen , Volker Markl , Seif Haridi , and Kostas Tzoumas . 2015. Apache flink: Stream and batch processing in a single engine. Data Engineering 38, 4 ( 2015 ). Paris Carbone, Asterios Katsifodimos, Stephan Ewen, Volker Markl, Seif Haridi, and Kostas Tzoumas. 2015. Apache flink: Stream and batch processing in a single engine. Data Engineering 38, 4 (2015)."},{"key":"e_1_3_2_1_4_1","first-page":"571","article-title":"Project Adam: Building an Efficient and Scalable Deep Learning Training System","volume":"14","author":"Chilimbi Trishul M","year":"2014","unstructured":"Trishul M Chilimbi , Yutaka Suzue , Johnson Apacible , and Karthik Kalyanaraman . 2014 . Project Adam: Building an Efficient and Scalable Deep Learning Training System .. In OSDI , Vol. 14. 571 -- 582 . Trishul M Chilimbi, Yutaka Suzue, Johnson Apacible, and Karthik Kalyanaraman. 2014. Project Adam: Building an Efficient and Scalable Deep Learning Training System.. In OSDI, Vol. 14. 571--582.","journal-title":"OSDI"},{"volume-title":"n.d.. https:\/\/code.google.com\/archive\/p\/cuda-convnet\/. (n.d.). [Online","year":"2017","key":"e_1_3_2_1_5_1","unstructured":"cuda convnet. n.d.. https:\/\/code.google.com\/archive\/p\/cuda-convnet\/. (n.d.). [Online ; Accessed 01- August - 2017 ]. cuda convnet. n.d.. https:\/\/code.google.com\/archive\/p\/cuda-convnet\/. (n.d.). [Online; Accessed 01-August-2017]."},{"key":"e_1_3_2_1_6_1","unstructured":"Jeffrey Dean Greg Corrado Rajat Monga Kai Chen Matthieu Devin Mark Mao Andrew Senior Paul Tucker Ke Yang Quoc V Le etal 2012. Large scale distributed deep networks. In Advances in neural information processing systems. 1223--1231.  Jeffrey Dean Greg Corrado Rajat Monga Kai Chen Matthieu Devin Mark Mao Andrew Senior Paul Tucker Ke Yang Quoc V Le et al. 2012. Large scale distributed deep networks. In Advances in neural information processing systems. 1223--1231."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1327452.1327492"},{"key":"e_1_3_2_1_8_1","volume-title":"https:\/\/github.com\/apache\/spark\/pull\/506. (2014). [Online","author":"Github Spark","year":"2017","unstructured":"Spark Github . 2014. [WIP][SPARK-1485][MLLIB] Implement Butterfly AllReduce . https:\/\/github.com\/apache\/spark\/pull\/506. (2014). [Online ; Accessed 01- August - 2017 ]. Spark Github. 2014. [WIP][SPARK-1485][MLLIB] Implement Butterfly AllReduce. https:\/\/github.com\/apache\/spark\/pull\/506. (2014). [Online; Accessed 01-August-2017]."},{"key":"e_1_3_2_1_9_1","unstructured":"ImageNet. n.d.. http:\/\/www.image-net.org\/. (n.d.). [Online; Accessed 01-August-2017].  ImageNet. n.d.. http:\/\/www.image-net.org\/. (n.d.). [Online; Accessed 01-August-2017]."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1272996.1273005"},{"key":"e_1_3_2_1_11_1","volume-title":"Caffe: Convolutional Architecture for Fast Feature Embedding. arXiv preprint arXiv:1408.5093","author":"Jia Yangqing","year":"2014","unstructured":"Yangqing Jia , Evan Shelhamer , Jeff Donahue , Sergey Karayev , Jonathan Long , Ross Girshick , Sergio Guadarrama , and Trevor Darrell . 2014 . Caffe: Convolutional Architecture for Fast Feature Embedding. arXiv preprint arXiv:1408.5093 (2014). Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick, Sergio Guadarrama, and Trevor Darrell. 2014. Caffe: Convolutional Architecture for Fast Feature Embedding. arXiv preprint arXiv:1408.5093 (2014)."},{"key":"e_1_3_2_1_12_1","volume-title":"n.d.. CIFAR-10 dataset. https:\/\/www.cs.toronto.edu\/~kriz\/cifar.html. (n.d.). [Online","author":"Krizhevsky Alex","year":"2017","unstructured":"Alex Krizhevsky , Vinod Nair , and Geoffrey Hinton . n.d.. CIFAR-10 dataset. https:\/\/www.cs.toronto.edu\/~kriz\/cifar.html. (n.d.). [Online ; Accessed 01- August - 2017 ]. Alex Krizhevsky, Vinod Nair, and Geoffrey Hinton. n.d.. CIFAR-10 dataset. https:\/\/www.cs.toronto.edu\/~kriz\/cifar.html. (n.d.). [Online; Accessed 01-August-2017]."},{"key":"e_1_3_2_1_13_1","unstructured":"Alex Krizhevsky Ilya Sutskever and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems. 1097--1105.  Alex Krizhevsky Ilya Sutskever and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems. 1097--1105."},{"volume-title":"Proceedings of the 25th International Conference on Neural Information Processing Systems (NIPS'12)","author":"Krizhevsky Alex","key":"e_1_3_2_1_14_1","unstructured":"Alex Krizhevsky , Ilya Sutskever , and Geoffrey E. Hinton . 2012. ImageNet Classification with Deep Convolutional Neural Networks . In Proceedings of the 25th International Conference on Neural Information Processing Systems (NIPS'12) . Curran Associates Inc., USA, 1097--1105. http:\/\/dl.acm.org\/citation.cfm?id=2999134.2999257 Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. ImageNet Classification with Deep Convolutional Neural Networks. In Proceedings of the 25th International Conference on Neural Information Processing Systems (NIPS'12). Curran Associates Inc., USA, 1097--1105. http:\/\/dl.acm.org\/citation.cfm?id=2999134.2999257"},{"key":"e_1_3_2_1_15_1","unstructured":"Yann Lecun. n.d.. LeNet-5 convolutional neural networks. http:\/\/yann.lecun.com\/exdb\/lenet\/. (n.d.). [Online; Accessed 01-August-2017].  Yann Lecun. n.d.. LeNet-5 convolutional neural networks. http:\/\/yann.lecun.com\/exdb\/lenet\/. (n.d.). [Online; Accessed 01-August-2017]."},{"key":"e_1_3_2_1_16_1","unstructured":"Yann Lecun Corinna Cortes and Christopher J.C. Burges. n.d.. The MNIST dataset. http:\/\/yann.lecun.com\/exdb\/mnist\/. (n.d.). [Online; Accessed 01-August-2017].  Yann Lecun Corinna Cortes and Christopher J.C. Burges. n.d.. The MNIST dataset. http:\/\/yann.lecun.com\/exdb\/mnist\/. (n.d.). [Online; Accessed 01-August-2017]."},{"key":"e_1_3_2_1_17_1","volume-title":"Sparknet: Training deep networks in spark. arXiv preprint arXiv:1511.06051","author":"Moritz Philipp","year":"2015","unstructured":"Philipp Moritz , Robert Nishihara , Ion Stoica , and Michael I Jordan . 2015 . Sparknet: Training deep networks in spark. arXiv preprint arXiv:1511.06051 (2015). Philipp Moritz, Robert Nishihara, Ion Stoica, and Michael I Jordan. 2015. Sparknet: Training deep networks in spark. arXiv preprint arXiv:1511.06051 (2015)."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2517349.2522738"},{"key":"e_1_3_2_1_19_1","unstructured":"BID Data Project. n.d.. http:\/\/bid.berkeley.edu\/BIDdata\/overview\/. (n.d.). [Online; Accessed 01-August-2017].  BID Data Project. n.d.. http:\/\/bid.berkeley.edu\/BIDdata\/overview\/. (n.d.). [Online; Accessed 01-August-2017]."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-24685-5_1"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30218-6_13"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.14778\/1920841.1920931"},{"volume-title":"European Parallel Virtual Machine\/Message Passing Interface Users\u00e2\u0102&Zacute","author":"Thakur Rajeev","key":"e_1_3_2_1_23_1","unstructured":"Rajeev Thakur and William D Gropp . 2003. Improving the performance of collective operations in MPICH . In European Parallel Virtual Machine\/Message Passing Interface Users\u00e2\u0102&Zacute ; Group Meeting. Springer , 257--267. Rajeev Thakur and William D Gropp. 2003. Improving the performance of collective operations in MPICH. In European Parallel Virtual Machine\/Message Passing Interface Users\u00e2\u0102Ź Group Meeting. Springer, 257--267."},{"key":"e_1_3_2_1_24_1","volume-title":"Theano: A Python framework for fast computation of mathematical expressions. arXiv e-prints abs\/1605.02688 (May","author":"Team Theano Development","year":"2016","unstructured":"Theano Development Team . 2016 . Theano: A Python framework for fast computation of mathematical expressions. arXiv e-prints abs\/1605.02688 (May 2016). http:\/\/arxiv.org\/abs\/1605.02688 Theano Development Team. 2016. Theano: A Python framework for fast computation of mathematical expressions. arXiv e-prints abs\/1605.02688 (May 2016). http:\/\/arxiv.org\/abs\/1605.02688"},{"key":"e_1_3_2_1_25_1","unstructured":"Torch. n.d.. http:\/\/torch.ch\/. (n.d.). [Online; Accessed 01-August-2017].  Torch. n.d.. http:\/\/torch.ch\/. (n.d.). [Online; Accessed 01-August-2017]."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2595641"},{"key":"e_1_3_2_1_27_1","volume-title":"Proceedings of the 9th USENIX conference on Networked Systems Design and Implementation. USENIX Association, 2--2.","author":"Zaharia Matei","year":"2012","unstructured":"Matei Zaharia , Mosharaf Chowdhury , Tathagata Das , Ankur Dave , Justin Ma , Murphy McCauley , Michael J Franklin , Scott Shenker , and Ion Stoica . 2012 . Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing . In Proceedings of the 9th USENIX conference on Networked Systems Design and Implementation. USENIX Association, 2--2. Matei Zaharia, Mosharaf Chowdhury, Tathagata Das, Ankur Dave, Justin Ma, Murphy McCauley, Michael J Franklin, Scott Shenker, and Ion Stoica. 2012. Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing. In Proceedings of the 9th USENIX conference on Networked Systems Design and Implementation. USENIX Association, 2--2."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611972832.87"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPP.2014.36"}],"event":{"name":"SC '17: The International Conference for High Performance Computing, Networking, Storage and Analysis","sponsor":["SIGHPC ACM Special Interest Group on High Performance Computing, Special Interest Group on High Performance Computing","IEEE CS"],"location":"Denver CO USA","acronym":"SC '17"},"container-title":["Proceedings of the Machine Learning on HPC Environments"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3146347.3146350","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3146347.3146350","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:13:33Z","timestamp":1750212813000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3146347.3146350"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,11,12]]},"references-count":29,"alternative-id":["10.1145\/3146347.3146350","10.1145\/3146347"],"URL":"https:\/\/doi.org\/10.1145\/3146347.3146350","relation":{},"subject":[],"published":{"date-parts":[[2017,11,12]]},"assertion":[{"value":"2017-11-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}