{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:40:08Z","timestamp":1750203608990,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":25,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,4,20]],"date-time":"2020-04-20T00:00:00Z","timestamp":1587340800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100007515","name":"National Science Foundation","doi-asserted-by":"publisher","award":["CNS-1816887, CCF-1763747"],"award-info":[{"award-number":["CNS-1816887, CCF-1763747"]}],"id":[{"id":"10.13039\/100007515","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,4,20]]},"DOI":"10.1145\/3358960.3379141","type":"proceedings-article","created":{"date-parts":[[2020,5,4]],"date-time":"2020-05-04T07:48:26Z","timestamp":1588578506000},"page":"76-87","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Throughput Prediction of Asynchronous SGD in TensorFlow"],"prefix":"10.1145","author":[{"given":"Zhuojin","family":"Li","sequence":"first","affiliation":[{"name":"University of Southern California, Los Angeles, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wumo","family":"Yan","sequence":"additional","affiliation":[{"name":"University of Southern California, Los Angeles, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marco","family":"Paolieri","sequence":"additional","affiliation":[{"name":"University of Southern California, Los Angeles, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Leana","family":"Golubchik","sequence":"additional","affiliation":[{"name":"University of Southern California, Los Angeles, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,4,20]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"TensorFlow: A System for Large-Scale Machine Learning. In OSDI'16","author":"Abadi M.","year":"2016","unstructured":"M. Abadi 2016 . TensorFlow: A System for Large-Scale Machine Learning. In OSDI'16 . 265--283. M. Abadi et al. 2016. TensorFlow: A System for Large-Scale Machine Learning. In OSDI'16. 265--283."},{"key":"e_1_3_2_1_2_1","volume-title":"S. Kandula, E. Boutin, and R. Fonseca.","author":"Ferguson A.","year":"2012","unstructured":"A. Ferguson , P. Bod'i k , S. Kandula, E. Boutin, and R. Fonseca. 2012 . Jockey: guaranteed job latency in data parallel clusters. In EuroSys' 12. 99--112. A. Ferguson, P. Bod'i k, S. Kandula, E. Boutin, and R. Fonseca. 2012. Jockey: guaranteed job latency in data parallel clusters. In EuroSys'12. 99--112."},{"key":"e_1_3_2_1_3_1","unstructured":"gRPC. 2019. Homepage. https:\/\/grpc.io.  gRPC. 2019. Homepage. https:\/\/grpc.io."},{"key":"e_1_3_2_1_4_1","unstructured":"S. Hashemi S. Jyothi and R. Campbell. 2019. TicTac: Accelerating distributed deep learning with communication scheduling. In SysML'19.  S. Hashemi S. Jyothi and R. Campbell. 2019. TicTac: Accelerating distributed deep learning with communication scheduling. In SysML'19."},{"volume-title":"Deep Residual Learning for Image Recognition. In CVPR'16","author":"He K.","key":"e_1_3_2_1_5_1","unstructured":"K. He , X. Zhang , S. Ren , and J. Sun . 2016 . Deep Residual Learning for Image Recognition. In CVPR'16 . 770--778. K. He, X. Zhang, S. Ren, and J. Sun. 2016. Deep Residual Learning for Image Recognition. In CVPR'16. 770--778."},{"volume-title":"Yield: End-Host Traffic Scheduling for Distributed Deep Learning with TensorLights. In IPDPSW'19","author":"Huang X.","key":"e_1_3_2_1_6_1","unstructured":"X. Huang , A. Chen , and T. Ng . 2019. Green, Yellow , Yield: End-Host Traffic Scheduling for Distributed Deep Learning with TensorLights. In IPDPSW'19 . 430--437. X. Huang, A. Chen, and T. Ng. 2019. Green, Yellow, Yield: End-Host Traffic Scheduling for Distributed Deep Learning with TensorLights. In IPDPSW'19. 430--437."},{"volume-title":"ImageNet Classification with Deep Convolutional Neural Networks. In NIPS'12","author":"Krizhevsky A.","key":"e_1_3_2_1_7_1","unstructured":"A. Krizhevsky , I. Sutskever , and G. Hinton . 2012 . ImageNet Classification with Deep Convolutional Neural Networks. In NIPS'12 . 1106--1114. A. Krizhevsky, I. Sutskever, and G. Hinton. 2012. ImageNet Classification with Deep Convolutional Neural Networks. In NIPS'12. 1106--1114."},{"key":"e_1_3_2_1_8_1","volume-title":"Nature","volume":"521","author":"LeCun Y.","year":"2015","unstructured":"Y. LeCun , Y. Bengio , and G. Hinton . 2015. Deep learning . Nature , Vol. 521 , 7553 ( 2015 ), 436--444. Y. LeCun, Y. Bengio, and G. Hinton. 2015. Deep learning. Nature, Vol. 521, 7553 (2015), 436--444."},{"volume-title":"Scaling Distributed Machine Learning with the Parameter Server. In OSDI'14","author":"Li M.","key":"e_1_3_2_1_9_1","unstructured":"M. Li , D. Andersen , J. Park , A. Smola , A. Ahmed , V. Josifovski , J. Long , E. Shekita , and B. Su . 2014 . Scaling Distributed Machine Learning with the Parameter Server. In OSDI'14 . 583--598. M. Li, D. Andersen, J. Park, A. Smola, A. Ahmed, V. Josifovski, J. Long, E. Shekita, and B. Su. 2014. Scaling Distributed Machine Learning with the Parameter Server. In OSDI'14. 583--598."},{"volume-title":"MASCOTS'18","author":"Lin S.","key":"e_1_3_2_1_10_1","unstructured":"S. Lin , M. Paolieri , C. Chou , and L. Golubchik . 2018. A Model-Based Approach to Streamlining Distributed Training for Asynchronous SGD . In MASCOTS'18 . 306--318. S. Lin, M. Paolieri, C. Chou, and L. Golubchik. 2018. A Model-Based Approach to Streamlining Distributed Training for Asynchronous SGD. In MASCOTS'18. 306--318."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2916550"},{"key":"e_1_3_2_1_12_1","unstructured":"Y. Peng Y. Bao Y. Chen C. Wu and C. Guo. 2018. Optimus: an efficient dynamic resource scheduler for deep learning clusters. In EuroSys'18. 3:1--3:14.  Y. Peng Y. Bao Y. Chen C. Wu and C. Guo. 2018. Optimus: an efficient dynamic resource scheduler for deep learning clusters. In EuroSys'18. 3:1--3:14."},{"volume-title":"Paleo: A Performance Model for Deep Neural Networks. In ICLR'2017","author":"Qi H.","key":"e_1_3_2_1_13_1","unstructured":"H. Qi , E. Sparks , and A. Talwalkar . 2017 . Paleo: A Performance Model for Deep Neural Networks. In ICLR'2017 . H. Qi, E. Sparks, and A. Talwalkar. 2017. Paleo: A Performance Model for Deep Neural Networks. In ICLR'2017."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"crossref","unstructured":"S. Shi Q. Wang and X. Chu. 2018. Performance Modeling and Evaluation of Distributed Deep Learning Frameworks on GPUs. In DASC\/PiCom\/DataCom\/CyberSciTech'18. 949--957.  S. Shi Q. Wang and X. Chu. 2018. Performance Modeling and Evaluation of Distributed Deep Learning Frameworks on GPUs. In DASC\/PiCom\/DataCom\/CyberSciTech'18. 949--957.","DOI":"10.1109\/DASC\/PiCom\/DataCom\/CyberSciTec.2018.000-4"},{"volume-title":"Very Deep Convolutional Networks for Large-Scale Image Recognition. In ICLR'15","author":"Simonyan K.","key":"e_1_3_2_1_15_1","unstructured":"K. Simonyan and A. Zisserman . 2015 . Very Deep Convolutional Networks for Large-Scale Image Recognition. In ICLR'15 . K. Simonyan and A. Zisserman. 2015. Very Deep Convolutional Networks for Large-Scale Image Recognition. In ICLR'15."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"crossref","unstructured":"C. Szegedy S. Ioffe V. Vanhoucke and A. Alemi. 2017. Inception-v4 Inception-ResNet and the Impact of Residual Connections on Learning. In AAAI'17. 4278--4284.  C. Szegedy S. Ioffe V. Vanhoucke and A. Alemi. 2017. Inception-v4 Inception-ResNet and the Impact of Residual Connections on Learning. In AAAI'17. 4278--4284.","DOI":"10.1609\/aaai.v31i1.11231"},{"volume-title":"CVPR'15","author":"Szegedy C.","key":"e_1_3_2_1_17_1","unstructured":"C. Szegedy , W. Liu , Y. Jia , P. Sermanet , S. Reed , D. Anguelov , D. Erhan , V. Vanhoucke , and A. Rabinovich . 2015. Going deeper with convolutions . In CVPR'15 . 1--9. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. 2015. Going deeper with convolutions. In CVPR'15. 1--9."},{"volume-title":"Rethinking the Inception Architecture for Computer Vision. In CVPR'16","author":"Szegedy C.","key":"e_1_3_2_1_18_1","unstructured":"C. Szegedy , V. Vanhoucke , S. Ioffe , J. Shlens , and Z. Wojna . 2016 . Rethinking the Inception Architecture for Computer Vision. In CVPR'16 . 2818--2826. C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna. 2016. Rethinking the Inception Architecture for Computer Vision. In CVPR'16. 2818--2826."},{"key":"e_1_3_2_1_19_1","unstructured":"TCPDUMP. 2019. Homepage. http:\/\/www.tcpdump.org.  TCPDUMP. 2019. Homepage. http:\/\/www.tcpdump.org."},{"volume-title":"Modeling Scalability of Distributed Machine Learning. In ICDE'17","author":"Ulanov A.","key":"e_1_3_2_1_20_1","unstructured":"A. Ulanov , A. Simanovsky , and M. Marwah . 2017 . Modeling Scalability of Distributed Machine Learning. In ICDE'17 . 1249--1254. A. Ulanov, A. Simanovsky, and M. Marwah. 2017. Modeling Scalability of Distributed Machine Learning. In ICDE'17. 1249--1254."},{"volume-title":"Ernest: Efficient Performance Prediction for Large-Scale Advanced Analytics. In NSDI'16","author":"Venkataraman S.","key":"e_1_3_2_1_21_1","unstructured":"S. Venkataraman , Z. Yang , M. Franklin , B. Recht , and I. Stoica . 2016 . Ernest: Efficient Performance Prediction for Large-Scale Advanced Analytics. In NSDI'16 . 363--378. S. Venkataraman, Z. Yang, M. Franklin, B. Recht, and I. Stoica. 2016. Ernest: Efficient Performance Prediction for Large-Scale Advanced Analytics. In NSDI'16. 363--378."},{"key":"e_1_3_2_1_22_1","unstructured":"Wireshark. 2019. Homepage. http:\/\/www.wireshark.org.  Wireshark. 2019. Homepage. http:\/\/www.wireshark.org."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2744878"},{"volume-title":"Performance Modeling and Scalability Optimization of Distributed Deep Learning Systems. In SIGKDD'15","author":"Yan F.","key":"e_1_3_2_1_24_1","unstructured":"F. Yan , O. Ruwase , Y. He , and T. Chilimbi . 2015 . Performance Modeling and Scalability Optimization of Distributed Deep Learning Systems. In SIGKDD'15 . 1355--1364. F. Yan, O. Ruwase, Y. He, and T. Chilimbi. 2015. Performance Modeling and Scalability Optimization of Distributed Deep Learning Systems. In SIGKDD'15. 1355--1364."},{"volume-title":"Cynthia: Cost-Efficient Cloud Resource Provisioning for Predictable Distributed Deep Neural Network Training. In ICPP'19","author":"Zheng H.","key":"e_1_3_2_1_25_1","unstructured":"H. Zheng , F. Xu , L. Chen , Z. Zhou , and F. Liu . 2019 . Cynthia: Cost-Efficient Cloud Resource Provisioning for Predictable Distributed Deep Neural Network Training. In ICPP'19 . 86:1--86:11. H. Zheng, F. Xu, L. Chen, Z. Zhou, and F. Liu. 2019. Cynthia: Cost-Efficient Cloud Resource Provisioning for Predictable Distributed Deep Neural Network Training. In ICPP'19. 86:1--86:11."}],"event":{"name":"ICPE '20: ACM\/SPEC International Conference on Performance Engineering","sponsor":["SIGMETRICS ACM Special Interest Group on Measurement and Evaluation","SIGSOFT ACM Special Interest Group on Software Engineering"],"location":"Edmonton AB Canada","acronym":"ICPE '20"},"container-title":["Proceedings of the ACM\/SPEC International Conference on Performance Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3358960.3379141","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3358960.3379141","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:23:39Z","timestamp":1750202619000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3358960.3379141"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,20]]},"references-count":25,"alternative-id":["10.1145\/3358960.3379141","10.1145\/3358960"],"URL":"https:\/\/doi.org\/10.1145\/3358960.3379141","relation":{},"subject":[],"published":{"date-parts":[[2020,4,20]]},"assertion":[{"value":"2020-04-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}