{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T16:22:33Z","timestamp":1790094153409,"version":"4.0.1"},"publisher-location":"New York, NY, USA","reference-count":101,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,5,8]],"date-time":"2023-05-08T00:00:00Z","timestamp":1683504000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,5,8]]},"DOI":"10.1145\/3552326.3587451","type":"proceedings-article","created":{"date-parts":[[2023,5,5]],"date-time":"2023-05-05T13:33:02Z","timestamp":1683293582000},"page":"851-866","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":43,"title":["Egeria: Efficient DNN Training with Knowledge-Guided Layer Freezing"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7289-8751","authenticated-orcid":false,"given":"Yiding","family":"Wang","sequence":"first","affiliation":[{"name":"Hong Kong University of Science and Technology, Clear Water Bay, Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3442-4656","authenticated-orcid":false,"given":"Decang","family":"Sun","sequence":"additional","affiliation":[{"name":"Hong Kong University of Science and Technology, Clear Water Bay, Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2587-6028","authenticated-orcid":false,"given":"Kai","family":"Chen","sequence":"additional","affiliation":[{"name":"Hong Kong University of Science and Technology, Clear Water Bay, Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-0472-107X","authenticated-orcid":false,"given":"Fan","family":"Lai","sequence":"additional","affiliation":[{"name":"University of Michigan, Ann Arbor, United States of America"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0884-6740","authenticated-orcid":false,"given":"Mosharaf","family":"Chowdhury","sequence":"additional","affiliation":[{"name":"University of Michigan, Ann Arbor, United States of America"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,5,8]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"CIFAR-10 benchmark leaderboard. https:\/\/paperswithcode.com\/sota\/image-classification-on-cifar-10.  CIFAR-10 benchmark leaderboard. https:\/\/paperswithcode.com\/sota\/image-classification-on-cifar-10."},{"key":"e_1_3_2_1_2_1","volume-title":"International Conference on Learning Representations","author":"Achille Alessandro","year":"2018","unstructured":"Alessandro Achille , Matteo Rovere , and Stefano Soatto . Critical learning periods in deep networks . In International Conference on Learning Representations , 2018 . Alessandro Achille, Matteo Rovere, and Stefano Soatto. Critical learning periods in deep networks. In International Conference on Learning Representations, 2018."},{"key":"e_1_3_2_1_3_1","first-page":"3","article-title":"Adaptive gradient communication via critical learning regime identification","author":"Agarwal Saurabh","year":"2021","unstructured":"Saurabh Agarwal , Hongyi Wang , Kangwook Lee , Shivaram Venkataraman , and Dimitris Papailiopoulos . Adaptive gradient communication via critical learning regime identification . Proceedings of Machine Learning and Systems , 3 , 2021 . Saurabh Agarwal, Hongyi Wang, Kangwook Lee, Shivaram Venkataraman, and Dimitris Papailiopoulos. Adaptive gradient communication via critical learning regime identification. Proceedings of Machine Learning and Systems, 3, 2021.","journal-title":"Proceedings of Machine Learning and Systems"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i05.6229"},{"key":"e_1_3_2_1_5_1","unstructured":"Amazon. Amazon EC2 P3dn instances. https:\/\/aws.amazon.com\/ec2\/instance-types\/p3\/.  Amazon. Amazon EC2 P3dn instances. https:\/\/aws.amazon.com\/ec2\/instance-types\/p3\/."},{"key":"e_1_3_2_1_6_1","volume-title":"6th International Conference on Learning Representations, ICLR","author":"Anil Rohan","year":"2018","unstructured":"Rohan Anil , Gabriel Pereyra , Alexandre Passos , Robert Ormandi , George E Dahl , and Geoffrey E Hinton . Large scale distributed neural network training through online distillation . In 6th International Conference on Learning Representations, ICLR , 2018 . Rohan Anil, Gabriel Pereyra, Alexandre Passos, Robert Ormandi, George E Dahl, and Geoffrey E Hinton. Large scale distributed neural network training through online distillation. In 6th International Conference on Learning Representations, ICLR, 2018."},{"key":"e_1_3_2_1_7_1","first-page":"499","volume-title":"14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20)","author":"Bai Zhihao","year":"2020","unstructured":"Zhihao Bai , Zhen Zhang , Yibo Zhu , and Xin Jin . Pipeswitch : Fast pipelined context switching for deep learning applications . In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20) , pages 499 -- 514 , November 2020 . Zhihao Bai, Zhen Zhang, Yibo Zhu, and Xin Jin. Pipeswitch: Fast pipelined context switching for deep learning applications. In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20), pages 499--514, November 2020."},{"key":"e_1_3_2_1_8_1","volume-title":"Accelerating deep learning inference via learned caches. arXiv preprint arXiv:2101.07344","author":"Balasubramanian Arjun","year":"2021","unstructured":"Arjun Balasubramanian , Adarsh Kumar , Yuhan Liu , Han Cao , Shivaram Venkataraman , and Aditya Akella . Accelerating deep learning inference via learned caches. arXiv preprint arXiv:2101.07344 , 2021 . Arjun Balasubramanian, Adarsh Kumar, Yuhan Liu, Han Cao, Shivaram Venkataraman, and Aditya Akella. Accelerating deep learning inference via learned caches. arXiv preprint arXiv:2101.07344, 2021."},{"key":"e_1_3_2_1_9_1","volume-title":"Findings of the 2016 conference on machine translation. In Proceedings of the First Conference on Machine Translation","volume":"2","author":"Bojar Ond\u0159ej","year":"2016","unstructured":"Ond\u0159ej Bojar , Rajen Chatterjee , Christian Federmann , Yvette Graham , Barry Haddow , Matthias Huck , Antonio Jimeno Yepes , Philipp Koehn , Varvara Logacheva , Christof Monz , Findings of the 2016 conference on machine translation. In Proceedings of the First Conference on Machine Translation : Volume 2 , Shared Task Papers, pages 131--198 , 2016 . Ond\u0159ej Bojar, Rajen Chatterjee, Christian Federmann, Yvette Graham, Barry Haddow, Matthias Huck, Antonio Jimeno Yepes, Philipp Koehn, Varvara Logacheva, Christof Monz, et al. Findings of the 2016 conference on machine translation. In Proceedings of the First Conference on Machine Translation: Volume 2, Shared Task Papers, pages 131--198, 2016."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-7908-2604-3_16"},{"key":"e_1_3_2_1_11_1","volume-title":"FreezeOut: Accelerate training by progressively freezing layers. arXiv preprint arXiv:1706.04983","author":"Brock Andrew","year":"2017","unstructured":"Andrew Brock , Theodore Lim , James M Ritchie , and Nick Weston . FreezeOut: Accelerate training by progressively freezing layers. arXiv preprint arXiv:1706.04983 , 2017 . Andrew Brock, Theodore Lim, James M Ritchie, and Nick Weston. FreezeOut: Accelerate training by progressively freezing layers. arXiv preprint arXiv:1706.04983, 2017."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDCS51616.2021.00010"},{"key":"e_1_3_2_1_13_1","volume-title":"Rethinking atrous convolution for semantic image segmentation. arXiv preprint arXiv:1706.05587","author":"Chen Liang-Chieh","year":"2017","unstructured":"Liang-Chieh Chen , George Papandreou , Florian Schroff , and Hartwig Adam . Rethinking atrous convolution for semantic image segmentation. arXiv preprint arXiv:1706.05587 , 2017 . Liang-Chieh Chen, George Papandreou, Florian Schroff, and Hartwig Adam. Rethinking atrous convolution for semantic image segmentation. arXiv preprint arXiv:1706.05587, 2017."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/3454287.3455058"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"crossref","unstructured":"Moheb Costandi. Neuroplasticity. MIT Press 2016.  Moheb Costandi. Neuroplasticity. MIT Press 2016.","DOI":"10.7551\/mitpress\/10499.001.0001"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_3_2_1_17_1","volume-title":"BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805","author":"Devlin Jacob","year":"2018","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 , 2018 . Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805, 2018."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-009-0275-4"},{"key":"e_1_3_2_1_19_1","unstructured":"L. Fei-Fei A. Karpathy and J. Johnson. Cs231n: Convolutional neural networks for visual recognition: Annealing the learning rate.  L. Fei-Fei A. Karpathy and J. Johnson. Cs231n: Convolutional neural networks for visual recognition: Annealing the learning rate."},{"key":"e_1_3_2_1_20_1","unstructured":"L. Fei-Fei A. Karpathy and J. Johnson. Cs231n: Convolutional neural networks for visual recognition: Transfer learning.  L. Fei-Fei A. Karpathy and J. Johnson. Cs231n: Convolutional neural networks for visual recognition: Transfer learning."},{"key":"e_1_3_2_1_21_1","first-page":"485","volume-title":"16th USENIX Symposium on Networked Systems Design and Implementation (NSDI 19)","author":"Gu Juncheng","year":"2019","unstructured":"Juncheng Gu , Mosharaf Chowdhury , Kang G. Shin , Yibo Zhu , Myeongjae Jeon , Junjie Qian , Hongqiang Liu , and Chuanxiong Guo . Tiresias : A GPU cluster manager for distributed deep learning . In 16th USENIX Symposium on Networked Systems Design and Implementation (NSDI 19) , pages 485 -- 500 , Boston, MA , 2019 . Juncheng Gu, Mosharaf Chowdhury, Kang G. Shin, Yibo Zhu, Myeongjae Jeon, Junjie Qian, Hongqiang Liu, and Chuanxiong Guo. Tiresias: A GPU cluster manager for distributed deep learning. In 16th USENIX Symposium on Networked Systems Design and Implementation (NSDI 19), pages 485--500, Boston, MA, 2019."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00494"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00272"},{"key":"e_1_3_2_1_24_1","volume-title":"Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv preprint arXiv:1510.00149","author":"Han Song","year":"2015","unstructured":"Song Han , Huizi Mao , and William J Dally . Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv preprint arXiv:1510.00149 , 2015 . Song Han, Huizi Mao, and William J Dally. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv preprint arXiv:1510.00149, 2015."},{"key":"e_1_3_2_1_25_1","volume-title":"Proceedings of Machine Learning and Systems, MLSys","author":"Hashemi Sayed Hadi","year":"2019","unstructured":"Sayed Hadi Hashemi , Sangeetha Abdu Jyothi , and Roy H Campbell . TicTac : Accelerating distributed deep learning with communication scheduling . In Proceedings of Machine Learning and Systems, MLSys , 2019 . Sayed Hadi Hashemi, Sangeetha Abdu Jyothi, and Roy H Campbell. TicTac: Accelerating distributed deep learning with communication scheduling. In Proceedings of Machine Learning and Systems, MLSys, 2019."},{"key":"e_1_3_2_1_26_1","series-title":"Proceedings of Machine Learning Research","first-page":"4150","volume-title":"Proceedings of the 38th International Conference on Machine Learning","author":"He Chaoyang","year":"2021","unstructured":"Chaoyang He , Shen Li , Mahdi Soltanolkotabi , and Salman Avestimehr . Pipetransformer: Automated elastic pipelining for distributed training of large-scale models . In Marina Meila and Tong Zhang, editors, Proceedings of the 38th International Conference on Machine Learning , volume 139 of Proceedings of Machine Learning Research , pages 4150 -- 4159 . PMLR , 18--24 Jul 2021 . Chaoyang He, Shen Li, Mahdi Soltanolkotabi, and Salman Avestimehr. Pipetransformer: Automated elastic pipelining for distributed training of large-scale models. In Marina Meila and Tong Zhang, editors, Proceedings of the 38th International Conference on Machine Learning, volume 139 of Proceedings of Machine Learning Research, pages 4150--4159. PMLR, 18--24 Jul 2021."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46493-0_38"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33013779"},{"key":"e_1_3_2_1_29_1","volume-title":"NIPS Deep Learning and Representation Learning Workshop","author":"Hinton Geoffrey","year":"2015","unstructured":"Geoffrey Hinton , Oriol Vinyals , and Jeffrey Dean . Distilling the knowledge in a neural network . In NIPS Deep Learning and Representation Learning Workshop , 2015 . Geoffrey Hinton, Oriol Vinyals, and Jeffrey Dean. Distilling the knowledge in a neural network. In NIPS Deep Learning and Representation Learning Workshop, 2015."},{"key":"e_1_3_2_1_30_1","volume-title":"NeurIPS 2018 Workshop on Systems for ML","author":"Hoffer Elad","year":"2018","unstructured":"Elad Hoffer , Berry Weinstein , Itay Hubara , Sergei Gofman , and Daniel Soudry . Infer2train : leveraging inference for better training of deep networks . In NeurIPS 2018 Workshop on Systems for ML , 2018 . Elad Hoffer, Berry Weinstein, Itay Hubara, Sergei Gofman, and Daniel Soudry. Infer2train: leveraging inference for better training of deep networks. In NeurIPS 2018 Workshop on Systems for ML, 2018."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1031"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3384419.3430769"},{"key":"e_1_3_2_1_33_1","volume-title":"Dehao Chen, HyoukJoong Lee, Jiquan Ngiam, Quoc V Le, Yonghui Wu, et al. Gpipe: Efficient training of giant neural networks using pipeline parallelism. arXiv preprint arXiv:1811.06965","author":"Huang Yanping","year":"2018","unstructured":"Yanping Huang , Youlong Cheng , Ankur Bapna , Orhan Firat , Mia Xu Chen , Dehao Chen, HyoukJoong Lee, Jiquan Ngiam, Quoc V Le, Yonghui Wu, et al. Gpipe: Efficient training of giant neural networks using pipeline parallelism. arXiv preprint arXiv:1811.06965 , 2018 . Yanping Huang, Youlong Cheng, Ankur Bapna, Orhan Firat, Mia Xu Chen, Dehao Chen, HyoukJoong Lee, Jiquan Ngiam, Quoc V Le, Yonghui Wu, et al. Gpipe: Efficient training of giant neural networks using pipeline parallelism. arXiv preprint arXiv:1811.06965, 2018."},{"key":"e_1_3_2_1_34_1","unstructured":"Intel. oneDNN library. https:\/\/01.org\/oneDNN\/.  Intel. oneDNN library. https:\/\/01.org\/oneDNN\/."},{"key":"e_1_3_2_1_35_1","volume-title":"Advances in Neural Information Processing Systems (NeurIPs)","author":"Ivkin Nikita","year":"2019","unstructured":"Nikita Ivkin , Daniel Rothchild , Enayat Ullah , Vladimir Braverman , Ion Stoica , and Raman Arora . Communication-efficient distributed sgd with sketching . In Advances in Neural Information Processing Systems (NeurIPs) , 2019 . Nikita Ivkin, Daniel Rothchild, Enayat Ullah, Vladimir Braverman, Ion Stoica, and Raman Arora. Communication-efficient distributed sgd with sketching. In Advances in Neural Information Processing Systems (NeurIPs), 2019."},{"key":"e_1_3_2_1_36_1","first-page":"2","article-title":"Priority-based parameter propagation for distributed DNN training. In Proceedings of Machine Learning and Systems 2019, MLSys 2019, Stanford","volume":"31","author":"Jayarajan Anand","year":"2019","unstructured":"Anand Jayarajan , Jinliang Wei , Garth Gibson , Alexandra Fedorova , and Gennady Pekhimenko . Priority-based parameter propagation for distributed DNN training. In Proceedings of Machine Learning and Systems 2019, MLSys 2019, Stanford , CA, USA, March 31 - April 2 , 2019 , 2019. Anand Jayarajan, Jinliang Wei, Garth Gibson, Alexandra Fedorova, and Gennady Pekhimenko. Priority-based parameter propagation for distributed DNN training. In Proceedings of Machine Learning and Systems 2019, MLSys 2019, Stanford, CA, USA, March 31 - April 2, 2019, 2019.","journal-title":"CA, USA, March"},{"key":"e_1_3_2_1_37_1","first-page":"947","volume-title":"2019 USENIX Annual Technical Conference (USENIX ATC 19)","author":"Jeon Myeongjae","year":"2019","unstructured":"Myeongjae Jeon , Shivaram Venkataraman , Amar Phanishayee , Junjie Qian , Wencong Xiao , and Fan Yang . Analysis of large-scale multi-tenant GPU clusters for DNN training workloads . In 2019 USENIX Annual Technical Conference (USENIX ATC 19) , pages 947 -- 960 , 2019 . Myeongjae Jeon, Shivaram Venkataraman, Amar Phanishayee, Junjie Qian, Wencong Xiao, and Fan Yang. Analysis of large-scale multi-tenant GPU clusters for DNN training workloads. In 2019 USENIX Annual Technical Conference (USENIX ATC 19), pages 947--960, 2019."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341301.3359630"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.5555\/3488766.3488792"},{"key":"e_1_3_2_1_40_1","unstructured":"Keras. Earlystopping. https:\/\/keras.io\/api\/callbacks\/early_stopping\/.  Keras. Earlystopping. https:\/\/keras.io\/api\/callbacks\/early_stopping\/."},{"key":"e_1_3_2_1_41_1","unstructured":"Keras. Transfer learning & fine-tuning. https:\/\/keras.io\/guides\/transfer_learning\/.  Keras. Transfer learning & fine-tuning. https:\/\/keras.io\/guides\/transfer_learning\/."},{"key":"e_1_3_2_1_42_1","volume-title":"Learning multiple layers of features from tiny images. Technical report","author":"Krizhevsky Alex","year":"2009","unstructured":"Alex Krizhevsky . Learning multiple layers of features from tiny images. Technical report , University of Toronto , 2009 . Alex Krizhevsky. Learning multiple layers of features from tiny images. Technical report, University of Toronto, 2009."},{"key":"e_1_3_2_1_43_1","volume-title":"USENIX Symposium on Networked Systems Design and Implementation (NSDI)","author":"Lai Fan","year":"2023","unstructured":"Fan Lai , Yinwei Dai , Harsha V. Madhyastha , and Mosharaf Chowdhury . Modelkeeper : Accelerating dnn training via automated training warmup . In USENIX Symposium on Networked Systems Design and Implementation (NSDI) , 2023 . Fan Lai, Yinwei Dai, Harsha V. Madhyastha, and Mosharaf Chowdhury. Modelkeeper: Accelerating dnn training via automated training warmup. In USENIX Symposium on Networked Systems Design and Implementation (NSDI), 2023."},{"key":"e_1_3_2_1_44_1","first-page":"11814","volume-title":"International Conference on Machine Learning","author":"Lai Fan","year":"2022","unstructured":"Fan Lai , Yinwei Dai , Sanjay Singapuram , Jiachen Liu , Xiangfeng Zhu , Harsha Madhyastha , and Mosharaf Chowdhury . Fedscale : Benchmarking model and system performance of federated learning at scale . In International Conference on Machine Learning , pages 11814 -- 11827 . PMLR, 2022 . Fan Lai, Yinwei Dai, Sanjay Singapuram, Jiachen Liu, Xiangfeng Zhu, Harsha Madhyastha, and Mosharaf Chowdhury. Fedscale: Benchmarking model and system performance of federated learning at scale. In International Conference on Machine Learning, pages 11814--11827. PMLR, 2022."},{"key":"e_1_3_2_1_45_1","first-page":"19","volume-title":"OSDI","author":"Lai Fan","year":"2021","unstructured":"Fan Lai , Xiangfeng Zhu , Harsha V Madhyastha , and Mosharaf Chowdhury . Oort : Efficient federated learning via guided participant selection . In OSDI , pages 19 -- 35 , 2021 . Fan Lai, Xiangfeng Zhu, Harsha V Madhyastha, and Mosharaf Chowdhury. Oort: Efficient federated learning via guided participant selection. In OSDI, pages 19--35, 2021."},{"key":"e_1_3_2_1_46_1","volume-title":"What would elsa do? freezing layers during transformer fine-tuning. arXiv preprint arXiv:1911.03090","author":"Lee Jaejun","year":"2019","unstructured":"Jaejun Lee , Raphael Tang , and Jimmy Lin . What would elsa do? freezing layers during transformer fine-tuning. arXiv preprint arXiv:1911.03090 , 2019 . Jaejun Lee, Raphael Tang, and Jimmy Lin. What would elsa do? freezing layers during transformer fine-tuning. arXiv preprint arXiv:1911.03090, 2019."},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00206"},{"key":"e_1_3_2_1_48_1","first-page":"5958","volume-title":"Proceedings of the 37th International Conference on Machine Learning, volume 119 of Proceedings of Machine Learning Research","author":"Li Zhuohan","year":"2020","unstructured":"Zhuohan Li , Eric Wallace , Sheng Shen , Kevin Lin , Kurt Keutzer , Dan Klein , and Joey Gonzalez . Train large, then compress: Rethinking model size for efficient training and inference of transformers . In Proceedings of the 37th International Conference on Machine Learning, volume 119 of Proceedings of Machine Learning Research , pages 5958 -- 5968 . PMLR, 13--18 Jul 2020 . Zhuohan Li, Eric Wallace, Sheng Shen, Kevin Lin, Kurt Keutzer, Dan Klein, and Joey Gonzalez. Train large, then compress: Rethinking model size for efficient training and inference of transformers. In Proceedings of the 37th International Conference on Machine Learning, volume 119 of Proceedings of Machine Learning Research, pages 5958--5968. PMLR, 13--18 Jul 2020."},{"key":"e_1_3_2_1_49_1","first-page":"33","article-title":"Tiny deep learning on iot devices","author":"Lin Ji","year":"2020","unstructured":"Ji Lin , Wei-Ming Chen , Yujun Lin , Chuang Gan , and Song Han . Mcunet : Tiny deep learning on iot devices . Advances in Neural Information Processing Systems , 33 , 2020 . Ji Lin, Wei-Ming Chen, Yujun Lin, Chuang Gan, and Song Han. Mcunet: Tiny deep learning on iot devices. Advances in Neural Information Processing Systems, 33, 2020.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_50_1","volume-title":"International Conference on Learning Representations","author":"Lin Yujun","year":"2018","unstructured":"Yujun Lin , Song Han , Huizi Mao , Yu Wang , and Bill Dally . Deep gradient compression: Reducing the communication bandwidth for distributed training . In International Conference on Learning Representations , 2018 . Yujun Lin, Song Han, Huizi Mao, Yu Wang, and Bill Dally. Deep gradient compression: Reducing the communication bandwidth for distributed training. In International Conference on Learning Representations, 2018."},{"key":"e_1_3_2_1_51_1","volume-title":"Autofreeze: Automatically freezing model blocks to accelerate fine-tuning. arXiv preprint arXiv:2102.01386","author":"Liu Yuhan","year":"2021","unstructured":"Yuhan Liu , Saurabh Agarwal , and Shivaram Venkataraman . Autofreeze: Automatically freezing model blocks to accelerate fine-tuning. arXiv preprint arXiv:2102.01386 , 2021 . Yuhan Liu, Saurabh Agarwal, and Shivaram Venkataraman. Autofreeze: Automatically freezing model blocks to accelerate fine-tuning. arXiv preprint arXiv:2102.01386, 2021."},{"key":"e_1_3_2_1_52_1","first-page":"97","volume-title":"International conference on machine learning","author":"Long Mingsheng","year":"2015","unstructured":"Mingsheng Long , Yue Cao , Jianmin Wang , and Michael Jordan . Learning transferable features with deep adaptation networks . In International conference on machine learning , pages 97 -- 105 . PMLR, 2015 . Mingsheng Long, Yue Cao, Jianmin Wang, and Michael Jordan. Learning transferable features with deep adaptation networks. In International conference on machine learning, pages 97--105. PMLR, 2015."},{"key":"e_1_3_2_1_53_1","volume-title":"Sgdr: Stochastic gradient descent with warm restarts. arXiv preprint arXiv:1608.03983","author":"Loshchilov Ilya","year":"2016","unstructured":"Ilya Loshchilov and Frank Hutter . Sgdr: Stochastic gradient descent with warm restarts. arXiv preprint arXiv:1608.03983 , 2016 . Ilya Loshchilov and Frank Hutter. Sgdr: Stochastic gradient descent with warm restarts. arXiv preprint arXiv:1608.03983, 2016."},{"key":"e_1_3_2_1_54_1","unstructured":"Robert M. Love. taskset(1) --- Linux manual page. https:\/\/man7.org\/linux\/man-pages\/man1\/taskset.1.html.  Robert M. Love. taskset(1) --- Linux manual page. https:\/\/man7.org\/linux\/man-pages\/man1\/taskset.1.html."},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM48880.2022.9796752"},{"key":"e_1_3_2_1_56_1","first-page":"5","volume-title":"ICML 2015 AutoML Workshop","volume":"238","author":"Maclaurin Dougal","year":"2015","unstructured":"Dougal Maclaurin , David Duvenaud , and Ryan P Adams . Autograd : Effortless gradients in numpy . In ICML 2015 AutoML Workshop , volume 238 , page 5 , 2015 . Dougal Maclaurin, David Duvenaud, and Ryan P Adams. Autograd: Effortless gradients in numpy. In ICML 2015 AutoML Workshop, volume 238, page 5, 2015."},{"key":"e_1_3_2_1_57_1","first-page":"289","volume-title":"17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20)","author":"Mahajan Kshiteej","year":"2020","unstructured":"Kshiteej Mahajan , Arjun Balasubramanian , Arjun Singhvi , Shivaram Venkataraman , Aditya Akella , Amar Phanishayee , and Shuchi Chawla . Themis : Fair and efficient GPU cluster scheduling . In 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20) , pages 289 -- 304 , Santa Clara, CA , 2020 . Kshiteej Mahajan, Arjun Balasubramanian, Arjun Singhvi, Shivaram Venkataraman, Aditya Akella, Amar Phanishayee, and Shuchi Chawla. Themis: Fair and efficient GPU cluster scheduling. In 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20), pages 289--304, Santa Clara, CA, 2020."},{"key":"e_1_3_2_1_58_1","volume-title":"Analyzing and mitigating data stalls in dnn training. arXiv preprint arXiv:2007.06775","author":"Mohan Jayashree","year":"2020","unstructured":"Jayashree Mohan , Amar Phanishayee , Ashish Raniwala , and Vijay Chidambaram . Analyzing and mitigating data stalls in dnn training. arXiv preprint arXiv:2007.06775 , 2020 . Jayashree Mohan, Amar Phanishayee, Ashish Raniwala, and Vijay Chidambaram. Analyzing and mitigating data stalls in dnn training. arXiv preprint arXiv:2007.06775, 2020."},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.14778\/3446095.3446100"},{"key":"e_1_3_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.5555\/3327345.3327475"},{"key":"e_1_3_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341301.3359646"},{"key":"e_1_3_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-4009"},{"key":"e_1_3_2_1_63_1","first-page":"2427","volume-title":"International Conference on Machine Learning","author":"Pan Xingyuan","year":"2016","unstructured":"Xingyuan Pan and Vivek Srikumar . Expressiveness of rectifier networks . In International Conference on Machine Learning , pages 2427 -- 2435 , 2016 . Xingyuan Pan and Vivek Srikumar. Expressiveness of rectifier networks. In International Conference on Machine Learning, pages 2427--2435, 2016."},{"key":"e_1_3_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.emnlp-main.30"},{"key":"e_1_3_2_1_65_1","volume-title":"Carbon emissions and large neural network training. arXiv preprint arXiv:2104.10350","author":"Patterson David","year":"2021","unstructured":"David Patterson , Joseph Gonzalez , Quoc Le , Chen Liang , Lluis-Miquel Munguia , Daniel Rothchild , David So , Maud Texier , and Jeff Dean . Carbon emissions and large neural network training. arXiv preprint arXiv:2104.10350 , 2021 . David Patterson, Joseph Gonzalez, Quoc Le, Chen Liang, Lluis-Miquel Munguia, Daniel Rothchild, David So, Maud Texier, and Jeff Dean. Carbon emissions and large neural network training. arXiv preprint arXiv:2104.10350, 2021."},{"key":"e_1_3_2_1_66_1","unstructured":"Yanghua Peng and ByteScheduler team. ByteScheduler issues. https:\/\/github.com\/bytedance\/byteps\/issues?q=label%3Abytescheduler.  Yanghua Peng and ByteScheduler team. ByteScheduler issues. https:\/\/github.com\/bytedance\/byteps\/issues?q=label%3Abytescheduler."},{"key":"e_1_3_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341301.3359642"},{"key":"e_1_3_2_1_68_1","unstructured":"PyTorch. PyTorch autograd mechanics. https:\/\/pytorch.org\/docs\/stable\/notes\/autograd.html.  PyTorch. PyTorch autograd mechanics. https:\/\/pytorch.org\/docs\/stable\/notes\/autograd.html."},{"key":"e_1_3_2_1_69_1","unstructured":"PyTorch. PyTorch DataLoader. https:\/\/pytorch.org\/docs\/stable\/data.html#torch.utils.data.DataLoader.  PyTorch. PyTorch DataLoader. https:\/\/pytorch.org\/docs\/stable\/data.html#torch.utils.data.DataLoader."},{"key":"e_1_3_2_1_70_1","unstructured":"PyTorch. PyTorch Vision. https:\/\/github.com\/pytorch\/vision.  PyTorch. PyTorch Vision. https:\/\/github.com\/pytorch\/vision."},{"key":"e_1_3_2_1_71_1","unstructured":"PyTorch. Transfer learning for computer vision tutorial. https:\/\/pytorch.org\/tutorials\/beginner\/transfer_learning_tutorial.html.  PyTorch. Transfer learning for computer vision tutorial. https:\/\/pytorch.org\/tutorials\/beginner\/transfer_learning_tutorial.html."},{"issue":"8","key":"e_1_3_2_1_72_1","first-page":"9","article-title":"Language models are unsupervised multitask learners","volume":"1","author":"Radford Alec","year":"2019","unstructured":"Alec Radford , Jeffrey Wu , Rewon Child , David Luan , Dario Amodei , and Ilya Sutskever . Language models are unsupervised multitask learners . OpenAI blog , 1 ( 8 ): 9 , 2019 . Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. Language models are unsupervised multitask learners. OpenAI blog, 1(8):9, 2019.","journal-title":"OpenAI blog"},{"key":"e_1_3_2_1_73_1","volume-title":"Svcca: Singular vector canonical correlation analysis for deep understanding and improvement. network, 200(200):200","author":"Raghu Maithra","year":"2017","unstructured":"Maithra Raghu , Justin Gilmer , Jason Yosinski , and Jascha Sohl-Dickstein . Svcca: Singular vector canonical correlation analysis for deep understanding and improvement. network, 200(200):200 , 2017 . Maithra Raghu, Justin Gilmer, Jason Yosinski, and Jascha Sohl-Dickstein. Svcca: Singular vector canonical correlation analysis for deep understanding and improvement. network, 200(200):200, 2017."},{"key":"e_1_3_2_1_74_1","volume-title":"100,000+ questions for machine comprehension of text. arXiv preprint arXiv:1606.05250","author":"Rajpurkar Pranav","year":"2016","unstructured":"Pranav Rajpurkar , Jian Zhang , Konstantin Lopyrev , and Percy Liang . Squad : 100,000+ questions for machine comprehension of text. arXiv preprint arXiv:1606.05250 , 2016 . Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. Squad: 100,000+ questions for machine comprehension of text. arXiv preprint arXiv:1606.05250, 2016."},{"key":"e_1_3_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00349"},{"key":"e_1_3_2_1_76_1","volume-title":"Antoine Chassang, Carlo Gatta, and Yoshua Bengio. Fitnets: Hints for thin deep nets. arXiv preprint arXiv:1412.6550","author":"Romero Adriana","year":"2014","unstructured":"Adriana Romero , Nicolas Ballas , Samira Ebrahimi Kahou , Antoine Chassang, Carlo Gatta, and Yoshua Bengio. Fitnets: Hints for thin deep nets. arXiv preprint arXiv:1412.6550 , 2014 . Adriana Romero, Nicolas Ballas, Samira Ebrahimi Kahou, Antoine Chassang, Carlo Gatta, and Yoshua Bengio. Fitnets: Hints for thin deep nets. arXiv preprint arXiv:1412.6550, 2014."},{"key":"e_1_3_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00474"},{"key":"e_1_3_2_1_78_1","unstructured":"Scikit-learn. Early stopping of stochastic gradient descent. https:\/\/scikit-learn.org\/stable\/auto_examples\/linear_model\/plot_sgd_early_stopping.html.  Scikit-learn. Early stopping of stochastic gradient descent. https:\/\/scikit-learn.org\/stable\/auto_examples\/linear_model\/plot_sgd_early_stopping.html."},{"key":"e_1_3_2_1_79_1","volume-title":"Reservoir transformer. arXiv preprint arXiv:2012.15045","author":"Shen Sheng","year":"2020","unstructured":"Sheng Shen , Alexei Baevski , Ari S Morcos , Kurt Keutzer , Michael Auli , and Douwe Kiela . Reservoir transformer. arXiv preprint arXiv:2012.15045 , 2020 . Sheng Shen, Alexei Baevski, Ari S Morcos, Kurt Keutzer, Michael Auli, and Douwe Kiela. Reservoir transformer. arXiv preprint arXiv:2012.15045, 2020."},{"key":"e_1_3_2_1_80_1","first-page":"464","volume-title":"Cyclical learning rates for training neural networks. In 2017 IEEE winter conference on applications of computer vision (WACV)","author":"Smith Leslie N","year":"2017","unstructured":"Leslie N Smith . Cyclical learning rates for training neural networks. In 2017 IEEE winter conference on applications of computer vision (WACV) , pages 464 -- 472 . IEEE , 2017 . Leslie N Smith. Cyclical learning rates for training neural networks. In 2017 IEEE winter conference on applications of computer vision (WACV), pages 464--472. IEEE, 2017."},{"key":"e_1_3_2_1_81_1","unstructured":"TensorFlow. TensorFlow stateless dropout. https:\/\/www.tensorflow.org\/api_docs\/python\/tf\/nn\/experimental\/stateless_dropout.  TensorFlow. TensorFlow stateless dropout. https:\/\/www.tensorflow.org\/api_docs\/python\/tf\/nn\/experimental\/stateless_dropout."},{"key":"e_1_3_2_1_82_1","unstructured":"TensorFlow. TensorFlow stateless random image transformations. https:\/\/www.tensorflow.org\/tutorials\/images\/data_augmentation#random_transformations.  TensorFlow. TensorFlow stateless random image transformations. https:\/\/www.tensorflow.org\/tutorials\/images\/data_augmentation#random_transformations."},{"key":"e_1_3_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00145"},{"key":"e_1_3_2_1_84_1","volume-title":"Attention is all you need. arXiv preprint arXiv:1706.03762","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan N Gomez , Lukasz Kaiser , and Illia Polosukhin . Attention is all you need. arXiv preprint arXiv:1706.03762 , 2017 . Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin. Attention is all you need. arXiv preprint arXiv:1706.03762, 2017."},{"key":"e_1_3_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICNP55882.2022.9940348"},{"key":"e_1_3_2_1_86_1","volume-title":"Domain-specific communication optimization for distributed DNN training. arXiv preprint arXiv:2008.08445","author":"Wang Hao","year":"2020","unstructured":"Hao Wang , Jingrong Chen , Xinchen Wan , Han Tian , Jiacheng Xia , Gaoxiong Zeng , Weiyan Wang , Kai Chen , Wei Bai , and Junchen Jiang . Domain-specific communication optimization for distributed DNN training. arXiv preprint arXiv:2008.08445 , 2020 . Hao Wang, Jingrong Chen, Xinchen Wan, Han Tian, Jiacheng Xia, Gaoxiong Zeng, Weiyan Wang, Kai Chen, Wei Bai, and Junchen Jiang. Domain-specific communication optimization for distributed DNN training. arXiv preprint arXiv:2008.08445, 2020."},{"key":"e_1_3_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM48880.2022.9796688"},{"key":"e_1_3_2_1_88_1","first-page":"1508","volume-title":"Proceedings of the 31st International Conference on Neural Information Processing Systems","author":"Wen Wei","year":"2017","unstructured":"Wei Wen , Cong Xu , Feng Yan , Chunpeng Wu , Yandan Wang , Yiran Chen , and Hai Li. Terngrad : ternary gradients to reduce communication in distributed deep learning . In Proceedings of the 31st International Conference on Neural Information Processing Systems , pages 1508 -- 1518 , 2017 . Wei Wen, Cong Xu, Feng Yan, Chunpeng Wu, Yandan Wang, Yiran Chen, and Hai Li. Terngrad: ternary gradients to reduce communication in distributed deep learning. In Proceedings of the 31st International Conference on Neural Information Processing Systems, pages 1508--1518, 2017."},{"key":"e_1_3_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-demos.6"},{"key":"e_1_3_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1109\/HPCA.2019.00048"},{"key":"e_1_3_2_1_91_1","doi-asserted-by":"crossref","unstructured":"Xueli Xiao Thosini Bamunu Mudiyanselage Chunyan Ji Jie Hu and Yi Pan. Fast deep learning training through intelligently freezing layers. In 2019 International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData) pages 1225--1232. IEEE 2019.  Xueli Xiao Thosini Bamunu Mudiyanselage Chunyan Ji Jie Hu and Yi Pan. Fast deep learning training through intelligently freezing layers. In 2019 International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData) pages 1225--1232. IEEE 2019.","DOI":"10.1109\/iThings\/GreenCom\/CPSCom\/SmartData.2019.00205"},{"key":"e_1_3_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1145\/3300061.3345448"},{"key":"e_1_3_2_1_93_1","volume-title":"Tacc: A full-stack cloud computing infrastructure for machine learning tasks. arXiv preprint arXiv:2110.01556","author":"Xu Kaiqiang","year":"2021","unstructured":"Kaiqiang Xu , Xinchen Wan , Hao Wang , Zhenghang Ren , Xudong Liao , Decang Sun , Chaoliang Zeng , and Kai Chen . Tacc: A full-stack cloud computing infrastructure for machine learning tasks. arXiv preprint arXiv:2110.01556 , 2021 . Kaiqiang Xu, Xinchen Wan, Hao Wang, Zhenghang Ren, Xudong Liao, Decang Sun, Chaoliang Zeng, and Kai Chen. Tacc: A full-stack cloud computing infrastructure for machine learning tasks. arXiv preprint arXiv:2110.01556, 2021."},{"key":"e_1_3_2_1_94_1","first-page":"3","article-title":"Asynchronous pipeline parallel dnn training","author":"Yang Bowen","year":"2021","unstructured":"Bowen Yang , Jian Zhang , Jonathan Li , Christopher R\u00e9 , Christopher Aberger , and Christopher De Sa. Pipemare : Asynchronous pipeline parallel dnn training . Proceedings of Machine Learning and Systems , 3 , 2021 . Bowen Yang, Jian Zhang, Jonathan Li, Christopher R\u00e9, Christopher Aberger, and Christopher De Sa. Pipemare: Asynchronous pipeline parallel dnn training. Proceedings of Machine Learning and Systems, 3, 2021.","journal-title":"Proceedings of Machine Learning and Systems"},{"key":"e_1_3_2_1_95_1","first-page":"3320","volume-title":"Advances in Neural Information Processing Systems 27","author":"Yosinski Jason","year":"2014","unstructured":"Jason Yosinski , Jeff Clune , Yoshua Bengio , and Hod Lipson . How transferable are features in deep neural networks? In Z. Ghahramani, M. Welling, C. Cortes, N. D. Lawrence, and K. Q. Weinberger, editors , Advances in Neural Information Processing Systems 27 , pages 3320 -- 3328 . Curran Associates, Inc. , 2014 . Jason Yosinski, Jeff Clune, Yoshua Bengio, and Hod Lipson. How transferable are features in deep neural networks? In Z. Ghahramani, M. Welling, C. Cortes, N. D. Lawrence, and K. Q. Weinberger, editors, Advances in Neural Information Processing Systems 27, pages 3320--3328. Curran Associates, Inc., 2014."},{"key":"e_1_3_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10590-1_53"},{"key":"e_1_3_2_1_97_1","volume-title":"6th Asia-Pacific Workshop on Networking (APNet)","author":"Zeng Chaoliang","year":"2022","unstructured":"Chaoliang Zeng , Xiaodian Cheng , Han Tian , Hao Wang , and Kai Chen . Herald : An embedding scheduler for distributed embedding model training . 6th Asia-Pacific Workshop on Networking (APNet) , 2022 . Chaoliang Zeng, Xiaodian Cheng, Han Tian, Hao Wang, and Kai Chen. Herald: An embedding scheduler for distributed embedding model training. 6th Asia-Pacific Workshop on Networking (APNet), 2022."},{"key":"e_1_3_2_1_98_1","volume-title":"Are all layers created equal? arXiv preprint arXiv:1902.01996","author":"Zhang Chiyuan","year":"2019","unstructured":"Chiyuan Zhang , Samy Bengio , and Yoram Singer . Are all layers created equal? arXiv preprint arXiv:1902.01996 , 2019 . Chiyuan Zhang, Samy Bengio, and Yoram Singer. Are all layers created equal? arXiv preprint arXiv:1902.01996, 2019."},{"key":"e_1_3_2_1_99_1","first-page":"181","volume-title":"2017 USENIX Annual Technical Conference (USENIX ATC 17)","author":"Zhang Hao","year":"2017","unstructured":"Hao Zhang , Zeyu Zheng , Shizhen Xu , Wei Dai , Qirong Ho , Xiaodan Liang , Zhiting Hu , Jinliang Wei , Pengtao Xie , and Eric P. Xing . Poseidon: An efficient communication architecture for distributed deep learning on GPU clusters . In 2017 USENIX Annual Technical Conference (USENIX ATC 17) , pages 181 -- 193 , 2017 . Hao Zhang, Zeyu Zheng, Shizhen Xu, Wei Dai, Qirong Ho, Xiaodan Liang, Zhiting Hu, Jinliang Wei, Pengtao Xie, and Eric P. Xing. Poseidon: An efficient communication architecture for distributed deep learning on GPU clusters. In 2017 USENIX Annual Technical Conference (USENIX ATC 17), pages 181--193, 2017."},{"key":"e_1_3_2_1_100_1","volume-title":"Advances in Neural Information Processing Systems","volume":"32","author":"Zhang Jiong","year":"2019","unstructured":"Jiong Zhang , Hsiang-Fu Yu , and Inderjit S Dhillon . Autoassist : A framework to accelerate training of deep neural networks . In Advances in Neural Information Processing Systems , volume 32 , 2019 . Jiong Zhang, Hsiang-Fu Yu, and Inderjit S Dhillon. Autoassist: A framework to accelerate training of deep neural networks. In Advances in Neural Information Processing Systems, volume 32, 2019."},{"key":"e_1_3_2_1_101_1","volume-title":"Neural architecture search with reinforcement learning. arXiv preprint arXiv:1611.01578","author":"Zoph Barret","year":"2016","unstructured":"Barret Zoph and Quoc V Le . Neural architecture search with reinforcement learning. arXiv preprint arXiv:1611.01578 , 2016 . Barret Zoph and Quoc V Le. Neural architecture search with reinforcement learning. arXiv preprint arXiv:1611.01578, 2016."}],"event":{"name":"EuroSys '23: Eighteenth European Conference on Computer Systems","location":"Rome Italy","acronym":"EuroSys '23","sponsor":["SIGOPS ACM Special Interest Group on Operating Systems"]},"container-title":["Proceedings of the Eighteenth European Conference on Computer Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3552326.3587451","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3552326.3587451","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T12:47:40Z","timestamp":1750164460000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3552326.3587451"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,8]]},"references-count":101,"alternative-id":["10.1145\/3552326.3587451","10.1145\/3552326"],"URL":"https:\/\/doi.org\/10.1145\/3552326.3587451","relation":{},"subject":[],"published":{"date-parts":[[2023,5,8]]},"assertion":[{"value":"2023-05-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}