{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:19:12Z","timestamp":1750220352878,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":47,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,11,4]],"date-time":"2021-11-04T00:00:00Z","timestamp":1635984000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF (National Science Foundation)","doi-asserted-by":"publisher","award":["CNS-1718980, CNS-1801884, CNS-1815525"],"award-info":[{"award-number":["CNS-1718980, CNS-1801884, CNS-1815525"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,11,10]]},"DOI":"10.1145\/3484266.3487384","type":"proceedings-article","created":{"date-parts":[[2021,11,4]],"date-time":"2021-11-04T22:31:15Z","timestamp":1636065075000},"page":"221-228","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["MXDAG"],"prefix":"10.1145","author":[{"given":"Weitao","family":"Wang","sequence":"first","affiliation":[{"name":"Rice University"}]},{"given":"Sushovan","family":"Das","sequence":"additional","affiliation":[{"name":"Rice University"}]},{"given":"Xinyu Crystal","family":"Wu","sequence":"additional","affiliation":[{"name":"Rice University"}]},{"given":"Zhuang","family":"Wang","sequence":"additional","affiliation":[{"name":"Rice University"}]},{"given":"Ang","family":"Chen","sequence":"additional","affiliation":[{"name":"Rice University"}]},{"given":"T. S. Eugene","family":"Ng","sequence":"additional","affiliation":[{"name":"Rice University"}]}],"member":"320","published-online":{"date-parts":[[2021,11,4]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2807591.2807636"},{"key":"e_1_3_2_1_2_1","volume-title":"ACM SIGCOMM","author":"P. Bod\u00edk","year":"2012","unstructured":"P. Bod\u00edk et al. Surviving failures in bandwidth-constrained datacenters . In ACM SIGCOMM , 2012 . P. Bod\u00edk et al. Surviving failures in bandwidth-constrained datacenters. In ACM SIGCOMM, 2012."},{"key":"e_1_3_2_1_3_1","volume-title":"Apache flink: Stream and batch processing in a single engine. Bulletin of the IEEE Computer Society Technical Committee on Data Engineering, 36(4)","author":"Carbone P.","year":"2015","unstructured":"P. Carbone , A. Katsifodimos , S. Ewen , V. Markl , S. Haridi , and K. Tzoumas . Apache flink: Stream and batch processing in a single engine. Bulletin of the IEEE Computer Society Technical Committee on Data Engineering, 36(4) , 2015 . P. Carbone, A. Katsifodimos, S. Ewen, V. Markl, S. Haridi, and K. Tzoumas. Apache flink: Stream and batch processing in a single engine. Bulletin of the IEEE Computer Society Technical Committee on Data Engineering, 36(4), 2015."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3419111.3421286"},{"key":"e_1_3_2_1_5_1","volume":"201","author":"Chowdhury M.","unstructured":"M. Chowdhury , S. Kandula , and I. Stoica . Leveraging endpoint flexibility in data-intensive clusters. In ACM SIGCOMM Computer Communication Review , 201 3. M. Chowdhury, S. Kandula, and I. Stoica. Leveraging endpoint flexibility in data-intensive clusters. In ACM SIGCOMM Computer Communication Review, 2013.","journal-title":"ACM SIGCOMM Computer Communication Review"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2390231.2390237"},{"key":"e_1_3_2_1_7_1","volume":"201","author":"Chowdhury M.","unstructured":"M. Chowdhury and I. Stoica . Efficient coflow scheduling without prior knowledge. ACM SIGCOMM Computer Communication Review , 201 5. M. Chowdhury and I. Stoica. Efficient coflow scheduling without prior knowledge. ACM SIGCOMM Computer Communication Review, 2015.","journal-title":"ACM SIGCOMM Computer Communication Review"},{"key":"e_1_3_2_1_8_1","volume":"201","author":"Chowdhury M.","unstructured":"M. Chowdhury , M. Zaharia , J. Ma , M. I. Jordan , and I. Stoica . Managing data transfers in computer clusters with orchestra. ACM SIGCOMM Computer Communication Review , 201 1. M. Chowdhury, M. Zaharia, J. Ma, M. I. Jordan, and I. Stoica. Managing data transfers in computer clusters with orchestra. ACM SIGCOMM Computer Communication Review, 2011.","journal-title":"ACM SIGCOMM Computer Communication Review"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2619239.2626315"},{"key":"e_1_3_2_1_10_1","volume-title":"USENIX NSDI","author":"Condie T.","year":"2010","unstructured":"T. Condie , N. Conway , P. Alvaro , J. M. Hellerstein , K. Elmeleegy , and R. Sears . Mapreduce online . In USENIX NSDI , 2010 . T. Condie, N. Conway, P. Alvaro, J. M. Hellerstein, K. Elmeleegy, and R. Sears. Mapreduce online. In USENIX NSDI, 2010."},{"key":"e_1_3_2_1_11_1","volume":"201","author":"Dogar F. R.","unstructured":"F. R. Dogar , T. Karagiannis , H. Ballani , and A. Rowstron . Decentralized task-aware scheduling for data center networks. ACM SIGCOMM Computer Communication Review , 201 4. F. R. Dogar, T. Karagiannis, H. Ballani, and A. Rowstron. Decentralized task-aware scheduling for data center networks. ACM SIGCOMM Computer Communication Review, 2014.","journal-title":"ACM SIGCOMM Computer Communication Review"},{"key":"e_1_3_2_1_12_1","first-page":"361","volume-title":"Improved bounds for acyclic job shop scheduling","author":"Feige U.","year":"2002","unstructured":"U. Feige and C. Scheideler . Improved bounds for acyclic job shop scheduling . Springer Combinatorica , pages 361 -- 399 , 2002 . U. Feige and C. Scheideler. Improved bounds for acyclic job shop scheduling. Springer Combinatorica, pages 361--399, 2002."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2019.8737415"},{"key":"e_1_3_2_1_14_1","volume-title":"USENIX OSDI","author":"Gog I.","year":"2016","unstructured":"I. Gog , M. Schwarzkopf , A. Gleave , R. N. Watson , and S. Hand . Firmament: Fast, centralized cluster scheduling at scale . In USENIX OSDI , 2016 . I. Gog, M. Schwarzkopf, A. Gleave, R. N. Watson, and S. Hand. Firmament: Fast, centralized cluster scheduling at scale. In USENIX OSDI, 2016."},{"key":"e_1_3_2_1_15_1","volume":"201","author":"Grandl R.","unstructured":"R. Grandl , G. Ananthanarayanan , S. Kandula , S. Rao , and A. Akella . Multi-resource packing for cluster schedulers. ACM SIGCOMM Computer Communication Review , 201 4. R. Grandl, G. Ananthanarayanan, S. Kandula, S. Rao, and A. Akella. Multi-resource packing for cluster schedulers. ACM SIGCOMM Computer Communication Review, 2014.","journal-title":"ACM SIGCOMM Computer Communication Review"},{"key":"e_1_3_2_1_16_1","volume-title":"USENIX OSDI","author":"Grandl R.","year":"2016","unstructured":"R. Grandl , M. Chowdhury , A. Akella , and G. Ananthanarayanan . Altruistic scheduling in multi-resource clusters . In USENIX OSDI , 2016 . R. Grandl, M. Chowdhury, A. Akella, and G. Ananthanarayanan. Altruistic scheduling in multi-resource clusters. In USENIX OSDI, 2016."},{"key":"e_1_3_2_1_17_1","volume-title":"USENIX OSDI","author":"Grandl R.","year":"2016","unstructured":"R. Grandl , S. Kandula , S. Rao , A. Akella , and J. Kulkarni . Graphene: Packing and dependency-aware scheduling for data-parallel clusters . In USENIX OSDI , 2016 . R. Grandl, S. Kandula, S. Rao, A. Akella, and J. Kulkarni. Graphene: Packing and dependency-aware scheduling for data-parallel clusters. In USENIX OSDI, 2016."},{"key":"e_1_3_2_1_18_1","volume-title":"USENIX NSDI","author":"Gu J.","year":"2019","unstructured":"J. Gu , M. Chowdhury , K. G. Shin , Y. Zhu , M. Jeon , J. Qian , H. Liu , and C. Guo . Tiresias: A gpu cluster manager for distributed deep learning . In USENIX NSDI , 2019 . J. Gu, M. Chowdhury, K. G. Shin, Y. Zhu, M. Jeon, J. Qian, H. Liu, and C. Guo. Tiresias: A gpu cluster manager for distributed deep learning. In USENIX NSDI, 2019."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3326285.3329071"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1272996.1273005"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2785956.2787488"},{"key":"e_1_3_2_1_22_1","volume-title":"USENIX OSDI","author":"Jiang Y.","year":"2020","unstructured":"Y. Jiang , Y. Zhu , C. Lan , B. Yi , Y. Cui , and C. Guo . A unified architecture for accelerating distributed dnn training in heterogeneous gpu\/cpu clusters . In USENIX OSDI , 2020 . Y. Jiang, Y. Zhu, C. Lan, B. Yi, Y. Cui, and C. Guo. A unified architecture for accelerating distributed dnn training in heterogeneous gpu\/cpu clusters. In USENIX OSDI, 2020."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/2685048.2685095"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2942358.2942367"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3401025.3401731"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267809.3267840"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341302.3342080"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/FOCS.2008.36"},{"key":"e_1_3_2_1_29_1","volume-title":"USENIX OSDI","author":"Narayanan D.","year":"2020","unstructured":"D. Narayanan , K. Santhanam , F. Kazhamiaka , A. Phanishayee , and M. Zaharia . Heterogeneity-aware cluster scheduling policies for deep learning workloads . In USENIX OSDI , 2020 . D. Narayanan, K. Santhanam, F. Kazhamiaka, A. Phanishayee, and M. Zaharia. Heterogeneity-aware cluster scheduling policies for deep learning workloads. In USENIX OSDI, 2020."},{"key":"e_1_3_2_1_30_1","volume-title":"USENIX ATC","author":"Park J. H.","year":"2020","unstructured":"J. H. Park , G. Yun , M. Y. Chang , N. T. Nguyen , S. Lee , J. Choi , S. H. Noh , and Y.-r. Choi . Hetpipe : Enabling large dnn training on (whimpy) heterogeneous gpu clusters through integration of pipelined model parallelism and data parallelism . In USENIX ATC , 2020 . J. H. Park, G. Yun, M. Y. Chang, N. T. Nguyen, S. Lee, J. Choi, S. H. Noh, and Y.-r. Choi. Hetpipe: Enabling large dnn training on (whimpy) heterogeneous gpu clusters through integration of pipelined model parallelism and data parallelism. In USENIX ATC, 2020."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3190508.3190517"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341301.3359642"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2742790"},{"key":"e_1_3_2_1_34_1","volume-title":"Horovod: fast and easy distributed deep learning in tensorflow. arXiv preprint","author":"Sergeev A.","year":"2018","unstructured":"A. Sergeev and M. Del Balso . Horovod: fast and easy distributed deep learning in tensorflow. arXiv preprint , 2018 . A. Sergeev and M. Del Balso. Horovod: fast and easy distributed deep learning in tensorflow. arXiv preprint, 2018."},{"key":"e_1_3_2_1_35_1","volume-title":"Numpywren: Serverless linear algebra. arXiv preprint","author":"Shankar V.","year":"2018","unstructured":"V. Shankar , K. Krauth , Q. Pu , E. Jonas , S. Venkataraman , I. Stoica , B. Recht , and J. Ragan-Kelley . Numpywren: Serverless linear algebra. arXiv preprint , 2018 . V. Shankar, K. Krauth, Q. Pu, E. Jonas, S. Venkataraman, I. Stoica, B. Recht, and J. Ragan-Kelley. Numpywren: Serverless linear algebra. arXiv preprint, 2018."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1551609.1551632"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3295500.3356152"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2523616.2523633"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2741948.2741964"},{"key":"e_1_3_2_1_40_1","volume-title":"IEEE TPDS","author":"Rahman M.","year":"2016","unstructured":"M. Wasi-ur Rahman , N. S. Islam , X. Lu , and D. K. Panda . A comprehensive study of mapreduce over lustre for intermediate data placement and shuffle strategies on hpc clusters . IEEE TPDS , 2016 . M. Wasi-ur Rahman, N. S. Islam, X. Lu, and D. K. Panda. A comprehensive study of mapreduce over lustre for intermediate data placement and shuffle strategies on hpc clusters. IEEE TPDS, 2016."},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2015.56"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3225058.3225091"},{"key":"e_1_3_2_1_43_1","volume-title":"USENIX HotCloud","author":"Zaharia M.","year":"2010","unstructured":"M. Zaharia , M. Chowdhury , M. J. Franklin , S. Shenker , I. Stoica , : Cluster computing with working sets . USENIX HotCloud , 2010 . M. Zaharia, M. Chowdhury, M. J. Franklin, S. Shenker, I. Stoica, et al. Spark: Cluster computing with working sets. USENIX HotCloud, 2010."},{"key":"e_1_3_2_1_44_1","volume-title":"USENIX NSDI","author":"Zhang H.","year":"2021","unstructured":"H. Zhang , Y. Tang , A. Khandelwal , J. Chen , and I. Stoica . Caerus: Nimble task scheduling for serverless analytics . In USENIX NSDI , 2021 . H. Zhang, Y. Tang, A. Khandelwal, J. Chen, and I. Stoica. Caerus: Nimble task scheduling for serverless analytics. In USENIX NSDI, 2021."},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCC.2014.2379096"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3405671.3405810"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2016.86"}],"event":{"name":"HotNets '21: The 20th ACM Workshop on Hot Topics in Networks","sponsor":["SIGCOMM ACM Special Interest Group on Data Communication"],"location":"Virtual Event United Kingdom","acronym":"HotNets '21"},"container-title":["Proceedings of the Twentieth ACM Workshop on Hot Topics in Networks"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3484266.3487384","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/abs\/10.1145\/3484266.3487384","content-type":"text\/html","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3484266.3487384","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3484266.3487384","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:13Z","timestamp":1750191433000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3484266.3487384"}},"subtitle":["A Hybrid Abstraction for Emerging Applications"],"short-title":[],"issued":{"date-parts":[[2021,11,4]]},"references-count":47,"alternative-id":["10.1145\/3484266.3487384","10.1145\/3484266"],"URL":"https:\/\/doi.org\/10.1145\/3484266.3487384","relation":{},"subject":[],"published":{"date-parts":[[2021,11,4]]},"assertion":[{"value":"2021-11-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}