{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,3]],"date-time":"2026-03-03T06:35:40Z","timestamp":1772519740375,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":83,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,4,17]],"date-time":"2021-04-17T00:00:00Z","timestamp":1618617600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/L01503X\/1"],"award-info":[{"award-number":["EP\/L01503X\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,4,19]]},"DOI":"10.1145\/3445814.3446753","type":"proceedings-article","created":{"date-parts":[[2021,4,11]],"date-time":"2021-04-11T17:06:26Z","timestamp":1618160786000},"page":"915-927","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Neural architecture search as program transformation exploration"],"prefix":"10.1145","author":[{"given":"Jack","family":"Turner","sequence":"first","affiliation":[{"name":"University of Edinburgh, UK"}]},{"given":"Elliot J.","family":"Crowley","sequence":"additional","affiliation":[{"name":"University of Edinburgh, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1619-5052","authenticated-orcid":false,"given":"Michael F. P.","family":"O'Boyle","sequence":"additional","affiliation":[{"name":"University of Edinburgh, UK"}]}],"member":"320","published-online":{"date-parts":[[2021,4,17]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"USENIX Symposium on Operating Systems Design and Implementation.","author":"Abadi Mart\u00edn","year":"2016","unstructured":"Mart\u00edn Abadi , Paul Barham , Jianmin Chen , Zhifeng Chen , Andy Davis , Jeffrey Dean , Matthieu Devin , Sanjay Ghemawat , Geoffrey Irving , Michael Isard , 2016 . Tensorflow: A system for large-scale machine learning . In USENIX Symposium on Operating Systems Design and Implementation. Mart\u00edn Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, et al\\mbox. 2016. Tensorflow: A system for large-scale machine learning. In USENIX Symposium on Operating Systems Design and Implementation."},{"key":"e_1_3_2_1_2_1","volume-title":"Zero-Cost Proxies for Lightweight NAS. arXiv preprint arXiv:2101.08134","author":"Abdelfattah Mohamed S","year":"2021","unstructured":"Mohamed S Abdelfattah , Abhinav Mehrotra , \\ Lukasz Dudziak , and Nicholas D Lane . 2021. Zero-Cost Proxies for Lightweight NAS. arXiv preprint arXiv:2101.08134 ( 2021 ). Mohamed S Abdelfattah, Abhinav Mehrotra, \\Lukasz Dudziak, and Nicholas D Lane. 2021. Zero-Cost Proxies for Lightweight NAS. arXiv preprint arXiv:2101.08134 (2021)."},{"key":"e_1_3_2_1_3_1","unstructured":"Lei Jimmy Ba and Rich Caruana. 2014. Do Deep Nets Really Need to be Deep?. In Advances in Neural Information Processing Systems.  Lei Jimmy Ba and Rich Caruana. 2014. Do Deep Nets Really Need to be Deep?. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3317550.3321441"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1375581.1375595"},{"key":"e_1_3_2_1_6_1","volume-title":"Proceedings of COMPSTAT'2010","year":"2010","unstructured":"L\\'eon Bottou. 2010 . Large-scale machine learning with stochastic gradient descent . In Proceedings of COMPSTAT'2010 . Springer, 177?186. L\\'eon Bottou. 2010. Large-scale machine learning with stochastic gradient descent. In Proceedings of COMPSTAT'2010. Springer, 177?186."},{"key":"e_1_3_2_1_7_1","unstructured":"Liang-Chieh Chen Maxwell Collins Yukun Zhu George Papandreou Barret Zoph Florian Schroff Hartwig Adam and Jon Shlens. 2018. Searching for efficient multi-scale architectures for dense image prediction. In Advances in Neural Information Processing Systems.  Liang-Chieh Chen Maxwell Collins Yukun Zhu George Papandreou Barret Zoph Florian Schroff Hartwig Adam and Jon Shlens. 2018. Searching for efficient multi-scale architectures for dense image prediction. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/IISWC.2012.6402898"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2541940.2541967"},{"key":"e_1_3_2_1_10_1","volume-title":"USENIX Symposium on Operating Systems Design and Implementation.","author":"Chen Tianqi","year":"2018","unstructured":"Tianqi Chen , Thierry Moreau , Ziheng Jiang , Lianmin Zheng , Eddie Yan , Haichen Shen , Meghan Cowan , Leyuan Wang , Yuwei Hu , Luis Ceze , 2018 . $\\$TVM$\\$: An automated end-to-end optimizing compiler for deep learning . In USENIX Symposium on Operating Systems Design and Implementation. Tianqi Chen, Thierry Moreau, Ziheng Jiang, Lianmin Zheng, Eddie Yan, Haichen Shen, Meghan Cowan, Leyuan Wang, Yuwei Hu, Luis Ceze, et al\\mbox. 2018. $\\$TVM$\\$: An automated end-to-end optimizing compiler for deep learning. In USENIX Symposium on Operating Systems Design and Implementation."},{"key":"e_1_3_2_1_11_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.","year":"2017","unstructured":"Fran\\ccois Chollet. 2017 . Xception: Deep Learning with Depthwise Separable Convolutions . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Fran\\ccois Chollet. 2017. Xception: Deep Learning with Depthwise Separable Convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_3_2_1_12_1","volume-title":"Visual Wake Words Dataset. arXiv preprint arXiv:1906.05721","author":"Chowdhery Aakanksha","year":"2019","unstructured":"Aakanksha Chowdhery , Pete Warden , Jonathon Shlens , Andrew Howard , and Rocky Rhodes . 2019. Visual Wake Words Dataset. arXiv preprint arXiv:1906.05721 ( 2019 ). Aakanksha Chowdhery, Pete Warden, Jonathon Shlens, Andrew Howard, and Rocky Rhodes. 2019. Visual Wake Words Dataset. arXiv preprint arXiv:1906.05721 (2019)."},{"key":"e_1_3_2_1_14_1","volume-title":"Pruning neural networks: is it time to nip it in the bud? arXiv preprint arXiv:1810.04622","author":"Crowley Elliot J","year":"2018","unstructured":"Elliot J Crowley , Jack Turner , Amos Storkey , and Michael O'Boyle . 2018. Pruning neural networks: is it time to nip it in the bud? arXiv preprint arXiv:1810.04622 ( 2018 ). Elliot J Crowley, Jack Turner, Amos Storkey, and Michael O'Boyle. 2018. Pruning neural networks: is it time to nip it in the bud? arXiv preprint arXiv:1810.04622 (2018)."},{"key":"e_1_3_2_1_15_1","volume-title":"Adam Procter, and Tristan J. Webb.","author":"Cyphers Scott","year":"2018","unstructured":"Scott Cyphers , Arjun K. Bansal , Anahita Bhiwandiwalla , Jayaram Bobba , Matthew Brookhart , Avijit Chakraborty , Will Constable , Christian Convey , Leona Cook , Omar Kanawi , Robert Kimball , Jason Knight , Nikolay Korovaiko , Varun Kumar , Yixing Lao , Christopher R. Lishka , Jaikrishnan Menon , Jennifer Myers , Sandeep Aswath Narayana , Adam Procter, and Tristan J. Webb. 2018 . Intel nGraph: An Intermediate Representation, Compiler, and Executor for Deep Learning . arXiv preprint arXiv:1801.08058 (2018). Scott Cyphers, Arjun K. Bansal, Anahita Bhiwandiwalla, Jayaram Bobba, Matthew Brookhart, Avijit Chakraborty, Will Constable, Christian Convey, Leona Cook, Omar Kanawi, Robert Kimball, Jason Knight, Nikolay Korovaiko, Varun Kumar, Yixing Lao, Christopher R. Lishka, Jaikrishnan Menon, Jennifer Myers, Sandeep Aswath Narayana, Adam Procter, and Tristan J. Webb. 2018. Intel nGraph: An Intermediate Representation, Compiler, and Executor for Deep Learning. arXiv preprint arXiv:1801.08058 (2018)."},{"key":"e_1_3_2_1_16_1","unstructured":"Misha Denil Babak Shakibi Laurent Dinh Ranzato Marc'Aurelio and Nando de Freitas. 2013. Predicting parameters in deep learning. In Advances in Neural Information Processing Systems.  Misha Denil Babak Shakibi Laurent Dinh Ranzato Marc'Aurelio and Nando de Freitas. 2013. Predicting parameters in deep learning. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_1_17_1","volume-title":"International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=HJxyZkBKDr","author":"Dong Xuanyi","year":"2020","unstructured":"Xuanyi Dong and Yi Yang . 2020 . NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Search . In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=HJxyZkBKDr Xuanyi Dong and Yi Yang. 2020. NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Search. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=HJxyZkBKDr"},{"key":"e_1_3_2_1_18_1","volume-title":"Diesel: DSL for Linear Algebra and Neural Net Computations on GPUs. In In International Workshop on Machine Learning and Programming Languages.","author":"Elango Venmugil","year":"2018","unstructured":"Venmugil Elango , Norm Rubin , Mahesh Ravishankar , Hariharan Sandanagobalane , and Vinod Grover . 2018 . Diesel: DSL for Linear Algebra and Neural Net Computations on GPUs. In In International Workshop on Machine Learning and Programming Languages. Venmugil Elango, Norm Rubin, Mahesh Ravishankar, Hariharan Sandanagobalane, and Vinod Grover. 2018. Diesel: DSL for Linear Algebra and Neural Net Computations on GPUs. In In International Workshop on Machine Learning and Programming Languages."},{"key":"e_1_3_2_1_19_1","volume-title":"Frank Hutter, et al\\mbox.","author":"Elsken Thomas","year":"2019","unstructured":"Thomas Elsken , Jan Hendrik Metzen , Frank Hutter, et al\\mbox. 2019 . Neural Architecture Search . Thomas Elsken, Jan Hendrik Metzen, Frank Hutter, et al\\mbox. 2019. Neural Architecture Search."},{"key":"e_1_3_2_1_20_1","volume-title":"Perforatedcnns: Acceleration through elimination of redundant convolutions. arXiv preprint arXiv:1504.08362","author":"Figurnov Michael","year":"2015","unstructured":"Michael Figurnov , Aijan Ibraimova , Dmitry Vetrov , and Pushmeet Kohli . 2015 . Perforatedcnns: Acceleration through elimination of redundant convolutions. arXiv preprint arXiv:1504.08362 (2015). Michael Figurnov, Aijan Ibraimova, Dmitry Vetrov, and Pushmeet Kohli. 2015. Perforatedcnns: Acceleration through elimination of redundant convolutions. arXiv preprint arXiv:1504.08362 (2015)."},{"key":"e_1_3_2_1_21_1","volume-title":"International Conference on Learning Representations.","author":"Frankle Jonathan","year":"2019","unstructured":"Jonathan Frankle and Michael Carbin . 2019 . The lottery ticket hypothesis: Finding sparse, trainable neural networks . In International Conference on Learning Representations. Jonathan Frankle and Michael Carbin. 2019. The lottery ticket hypothesis: Finding sparse, trainable neural networks. In International Conference on Learning Representations."},{"key":"e_1_3_2_1_22_1","volume-title":"The State of Sparsity in Deep Neural Networks. arXiv preprint arXiv:1902.09574","author":"Gale Trevor","year":"2019","unstructured":"Trevor Gale , Erich Elsen , and Sara Hooker . 2019. The State of Sparsity in Deep Neural Networks. arXiv preprint arXiv:1902.09574 ( 2019 ). Trevor Gale, Erich Elsen, and Sara Hooker. 2019. The State of Sparsity in Deep Neural Networks. arXiv preprint arXiv:1902.09574 (2019)."},{"key":"e_1_3_2_1_23_1","volume-title":"Optimizing Grouped Convolutions on Edge Devices. In 2020 IEEE 31st International Conference on Application-specific Systems, Architectures and Processors (ASAP). IEEE, 189?196","author":"Gibson Perry","year":"2020","unstructured":"Perry Gibson , Jos\\'e Cano, Jack Turner , Elliot J Crowley , Michael O? Boyle , and Amos Storkey . 2020 . Optimizing Grouped Convolutions on Edge Devices. In 2020 IEEE 31st International Conference on Application-specific Systems, Architectures and Processors (ASAP). IEEE, 189?196 . Perry Gibson, Jos\\'e Cano, Jack Turner, Elliot J Crowley, Michael O?Boyle, and Amos Storkey. 2020. Optimizing Grouped Convolutions on Edge Devices. In 2020 IEEE 31st International Conference on Application-specific Systems, Architectures and Processors (ASAP). IEEE, 189?196."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10766-006-0012-3"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2694344.2694351"},{"key":"e_1_3_2_1_26_1","unstructured":"Aditya Sharad Golatkar Alessandro Achille and Stefano Soatto. 2019. Time matters in regularizing deep networks: Weight decay and data augmentation affect early learning dynamics matter little near convergence. In Advances in Neural Information Processing Systems. 10678?10688.  Aditya Sharad Golatkar Alessandro Achille and Stefano Soatto. 2019. Time matters in regularizing deep networks: Weight decay and data augmentation affect early learning dynamics matter little near convergence. In Advances in Neural Information Processing Systems. 10678?10688."},{"key":"e_1_3_2_1_27_1","volume-title":"International Workshop on Polyhedral Compilation Techniques.","author":"Grosser Tobias","year":"2011","unstructured":"Tobias Grosser , Hongbin Zheng , Raghesh Aloor , Andreas Simb\u00fcrger , Armin Gr\u00f6\u00dflinger , and Louis-No\u00ebl Pouchet . 2011 . Polly-Polyhedral optimization in LLVM . In International Workshop on Polyhedral Compilation Techniques. Tobias Grosser, Hongbin Zheng, Raghesh Aloor, Andreas Simb\u00fcrger, Armin Gr\u00f6\u00dflinger, and Louis-No\u00ebl Pouchet. 2011. Polly-Polyhedral optimization in LLVM. In International Workshop on Polyhedral Compilation Techniques."},{"key":"e_1_3_2_1_28_1","volume-title":"International Conference on Learning Representations.","author":"Han Song","unstructured":"Song Han , Huizi Mao , and William J. Dally . 2016. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding . In International Conference on Learning Representations. Song Han, Huizi Mao, and William J. Dally. 2016. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. In International Conference on Learning Representations."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01234-2_48"},{"key":"e_1_3_2_1_31_1","volume-title":"Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531","author":"Hinton Geoffrey","year":"2015","unstructured":"Geoffrey Hinton , Oriol Vinyals , and Jeff Dean . 2015. Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531 ( 2015 ). Geoffrey Hinton, Oriol Vinyals, and Jeff Dean. 2015. Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531 (2015)."},{"key":"e_1_3_2_1_32_1","volume-title":"MobileNets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861","author":"Howard Andrew G.","year":"2017","unstructured":"Andrew G. Howard , Menglong Zhu , Bo Chen , Dmitry Kalenichenko , Weijun Wang , Tobias Weyand , Marco Andreetto , and Hartwig Adam . 2017. MobileNets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 ( 2017 ). Andrew G. Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, and Hartwig Adam. 2017. MobileNets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 (2017)."},{"key":"e_1_3_2_1_33_1","volume-title":"Weinberger","author":"Huang Gao","year":"2018","unstructured":"Gao Huang , Schichen Liu , Laurens van der Maaten , and Kilian Q . Weinberger . 2018 . CondenseNet: An Efficient DenseNet using Learned Group Convolutions . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Gao Huang, Schichen Liu, Laurens van der Maaten, and Kilian Q. Weinberger. 2018. CondenseNet: An Efficient DenseNet using Learned Group Convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.243"},{"key":"e_1_3_2_1_35_1","volume-title":"\\mbox","author":"Huang Yanping","year":"2019","unstructured":"Yanping Huang , Youlong Cheng , Ankur Bapna , Orhan Firat , Dehao Chen , Mia Chen , HyoukJoong Lee , Jiquan Ngiam , Quoc V Le , Yonghui Wu , \\mbox . 2019 . Gpipe : Efficient training of giant neural networks using pipeline parallelism. In Advances in Neural Information Processing Systems . Yanping Huang, Youlong Cheng, Ankur Bapna, Orhan Firat, Dehao Chen, Mia Chen, HyoukJoong Lee, Jiquan Ngiam, Quoc V Le, Yonghui Wu, et al\\mbox. 2019. Gpipe: Efficient training of giant neural networks using pipeline parallelism. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.633"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341301.3359630"},{"key":"e_1_3_2_1_39_1","volume-title":"Deep learning. Nature 521, 7553","author":"LeCun Yann","year":"2015","unstructured":"Yann LeCun , Yoshua Bengio , and Geoffrey Hinton . 2015. Deep learning. Nature 521, 7553 ( 2015 ), 436. Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. 2015. Deep learning. Nature 521, 7553 (2015), 436."},{"key":"e_1_3_2_1_40_1","volume-title":"Solla","author":"LeCun Yann","year":"1989","unstructured":"Yann LeCun , John S. Denker , and Sara A . Solla . 1989 . Optimal Brain Damage. In Advances in Neural Information Processing Systems . Yann LeCun, John S. Denker, and Sara A. Solla. 1989. Optimal Brain Damage. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_1_41_1","volume-title":"International Conference on Learning Representations.","author":"Lee Namhoon","unstructured":"Namhoon Lee , Thalaiyasingam Ajanthan , and Philip H. S. Torr . 2019. SNIP: Single-shot network pruning based on connection sensitivity . In International Conference on Learning Representations. Namhoon Lee, Thalaiyasingam Ajanthan, and Philip H. S. Torr. 2019. SNIP: Single-shot network pruning based on connection sensitivity. In International Conference on Learning Representations."},{"key":"e_1_3_2_1_42_1","volume-title":"International Conference on Learning Representations.","author":"Li Hao","year":"2017","unstructured":"Hao Li , Asim Kadav , Igor Durdanovic , Hanan Samet , and Hans Peter Graf . 2017 . Pruning filters for efficient convnets . In International Conference on Learning Representations. Hao Li, Asim Kadav, Igor Durdanovic, Hanan Samet, and Hans Peter Graf. 2017. Pruning filters for efficient convnets. In International Conference on Learning Representations."},{"key":"e_1_3_2_1_43_1","volume-title":"Random search and reproducibility for neural architecture search. arXiv preprint arXiv:1902.07638","author":"Li Liam","year":"2019","unstructured":"Liam Li and Ameet Talwalkar . 2019. Random search and reproducibility for neural architecture search. arXiv preprint arXiv:1902.07638 ( 2019 ). Liam Li and Ameet Talwalkar. 2019. Random search and reproducibility for neural architecture search. arXiv preprint arXiv:1902.07638 (2019)."},{"key":"e_1_3_2_1_44_1","volume-title":"DARTS: Differentiable Architecture Search. In International Conference on Learning Representations.","author":"Liu Hanxiao","year":"2019","unstructured":"Hanxiao Liu , Karen Simonyan , and Yiming Yang . 2019 . DARTS: Differentiable Architecture Search. In International Conference on Learning Representations. Hanxiao Liu, Karen Simonyan, and Yiming Yang. 2019. DARTS: Differentiable Architecture Search. In International Conference on Learning Representations."},{"key":"e_1_3_2_1_45_1","unstructured":"Renqian Luo Fei Tian Tao Qin Enhong Chen and Tie-Yan Liu. 2018. Neural architecture optimization. In Advances in Neural Information Processing Systems.  Renqian Luo Fei Tian Tao Qin Enhong Chen and Tie-Yan Liu. 2018. Neural architecture optimization. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_1_46_1","volume-title":"Neural Architecture Search without Training. arXiv preprint arXiv:2006.04647","author":"Mellor Joseph","year":"2020","unstructured":"Joseph Mellor , Jack Turner , Amos Storkey , and Elliot J Crowley . 2020. Neural Architecture Search without Training. arXiv preprint arXiv:2006.04647 ( 2020 ). Joseph Mellor, Jack Turner, Amos Storkey, and Elliot J Crowley. 2020. Neural Architecture Search without Training. arXiv preprint arXiv:2006.04647 (2020)."},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-23702-7_24"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3366428.3380771"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01152"},{"key":"e_1_3_2_1_50_1","volume-title":"Pruning Convolutional Neural Networks for Resource Efficient Inference. In International Conference on Learning Representations.","author":"Molchanov Pavlo","year":"2017","unstructured":"Pavlo Molchanov , Stephen Tyree , Tero Karras , Timo Aila , and Jan Kautz . 2017 . Pruning Convolutional Neural Networks for Resource Efficient Inference. In International Conference on Learning Representations. Pavlo Molchanov, Stephen Tyree, Tero Karras, Timo Aila, and Jan Kautz. 2017. Pruning Convolutional Neural Networks for Resource Efficient Inference. In International Conference on Learning Representations."},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2694344.2694364"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2786805.2786807"},{"key":"e_1_3_2_1_53_1","volume-title":"Accelerating Deep Neural Networks with Spatial Bottleneck Modules. arXiv preprint arXiv:1809.02601","author":"Peng Junran","year":"2018","unstructured":"Junran Peng , Lingxi Xie , Zhaoxiang Zhang , Tieniu Tan , and Jingdong Wang . 2018. Accelerating Deep Neural Networks with Spatial Bottleneck Modules. arXiv preprint arXiv:1809.02601 ( 2018 ). Junran Peng, Lingxi Xie, Zhaoxiang Zhang, Tieniu Tan, and Jingdong Wang. 2018. Accelerating Deep Neural Networks with Spatial Bottleneck Modules. arXiv preprint arXiv:1809.02601 (2018)."},{"key":"e_1_3_2_1_54_1","volume-title":"International Conference on Machine Learning.","author":"Pham Hieu","year":"2018","unstructured":"Hieu Pham , Melody Y. Guan , Barret Zoph , Quoc V. Le , and Jeff Dean . 2018 . Efficient neural architecture search via parameter sharing . In International Conference on Machine Learning. Hieu Pham, Melody Y. Guan, Barret Zoph, Quoc V. Le, and Jeff Dean. 2018. Efficient neural architecture search via parameter sharing. In International Conference on Machine Learning."},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3107953"},{"key":"e_1_3_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/IISWC47752.2019.9042000"},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2491956.2462176"},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/1183401.1183447"},{"key":"e_1_3_2_1_60_1","volume-title":"Deep learning in neural networks: An overview. Neural networks 61","author":"Schmidhuber J\u00fcrgen","year":"2015","unstructured":"J\u00fcrgen Schmidhuber . 2015. Deep learning in neural networks: An overview. Neural networks 61 ( 2015 ), 85?117. J\u00fcrgen Schmidhuber. 2015. Deep learning in neural networks: An overview. Neural networks 61 (2015), 85?117."},{"key":"e_1_3_2_1_61_1","volume-title":"Evaluating the Search Phase of Neural Architecture Search. arXiv preprint arXiv:1902.08142","author":"Sciuto Christian","year":"2019","unstructured":"Christian Sciuto , Kaicheng Yu , Martin Jaggi , Claudiu Musat , and Mathieu Salzmann . 2019. Evaluating the Search Phase of Neural Architecture Search. arXiv preprint arXiv:1902.08142 ( 2019 ). Christian Sciuto, Kaicheng Yu, Martin Jaggi, Claudiu Musat, and Mathieu Salzmann. 2019. Evaluating the Search Phase of Neural Architecture Search. arXiv preprint arXiv:1902.08142 (2019)."},{"key":"e_1_3_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/2025113.2025133"},{"key":"e_1_3_2_1_63_1","volume-title":"The evolved transformer. arXiv preprint arXiv:1901.11117","author":"So David R","year":"2019","unstructured":"David R So , Chen Liang , and Quoc V Le. 2019. The evolved transformer. arXiv preprint arXiv:1901.11117 ( 2019 ). David R So, Chen Liang, and Quoc V Le. 2019. The evolved transformer. arXiv preprint arXiv:1901.11117 (2019)."},{"key":"e_1_3_2_1_64_1","volume-title":"International Symposium on Code Generation and Optimization.","author":"Steuwer Michel","year":"2017","unstructured":"Michel Steuwer , Toomas Remmelg , and Christophe Dubach . 2017 . Lift: a functional data-parallel IR for high-performance GPU code generation . In International Symposium on Code Generation and Optimization. Michel Steuwer, Toomas Remmelg, and Christophe Dubach. 2017. Lift: a functional data-parallel IR for high-performance GPU code generation. In International Symposium on Code Generation and Optimization."},{"key":"e_1_3_2_1_65_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.","author":"Tan Mingxing","unstructured":"Mingxing Tan , Bo Chen , Ruoming Pang , Vijay Vasudevan , Mark Sandler , Andrew Howard , and Quoc V. Le . 2019. MnasNet: Platform-aware neural architecture search for mobile . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Mingxing Tan, Bo Chen, Ruoming Pang, Vijay Vasudevan, Mark Sandler, Andrew Howard, and Quoc V. Le. 2019. MnasNet: Platform-aware neural architecture search for mobile. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_3_2_1_66_1","volume-title":"EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. In International Conference on Machine Learning.","author":"Tan Mingxing","unstructured":"Mingxing Tan and Quoc V. Le . 2019 . EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. In International Conference on Machine Learning. Mingxing Tan and Quoc V. Le. 2019. EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. In International Conference on Machine Learning."},{"key":"e_1_3_2_1_67_1","unstructured":"Lucas Theis Iryna Korshunova Alykhan Tejani and Ferenc Husz\\'ar. 2018. Faster gaze prediction with dense networks and Fisher pruning.  Lucas Theis Iryna Korshunova Alykhan Tejani and Ferenc Husz\\'ar. 2018. Faster gaze prediction with dense networks and Fisher pruning."},{"key":"e_1_3_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3315508.3329973"},{"key":"e_1_3_2_1_69_1","volume-title":"International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=SklkDkSFPB","author":"Turner Jack","year":"2020","unstructured":"Jack Turner , Elliot J. Crowley , Michael O'Boyle , Amos Storkey , and Gavin Gray . 2020 . BlockSwap: Fisher-guided Block Substitution for Network Compression on a Budget . In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=SklkDkSFPB Jack Turner, Elliot J. Crowley, Michael O'Boyle, Amos Storkey, and Gavin Gray. 2020. BlockSwap: Fisher-guided Block Substitution for Network Compression on a Budget. In International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=SklkDkSFPB"},{"key":"e_1_3_2_1_70_1","volume-title":"Distilling with performance enhanced students. arXiv preprint arXiv:1810.10460","author":"Turner Jack","year":"2018","unstructured":"Jack Turner , Elliot J Crowley , Valentin Radu , Jos\\'e Cano, Amos Storkey , and Michael O'Boyle . 2018. Distilling with performance enhanced students. arXiv preprint arXiv:1810.10460 ( 2018 ). Jack Turner, Elliot J Crowley, Valentin Radu, Jos\\'e Cano, Amos Storkey, and Michael O'Boyle. 2018. Distilling with performance enhanced students. arXiv preprint arXiv:1810.10460 (2018)."},{"key":"e_1_3_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1007\/11688839_16"},{"key":"e_1_3_2_1_72_1","volume-title":"Tensor Comprehensions: Framework-Agnostic High-Performance Machine Learning Abstractions. arXiv preprint arXiv:1802.04730","author":"Vasilache Nicolas","year":"2018","unstructured":"Nicolas Vasilache , Oleksandr Zinenko , Theodoros Theodoridis , Priya Goyal , Zachary DeVito , William S. Moses , Sven Verdoolaege , Andrew Adams , and Albert Cohen . 2018 . Tensor Comprehensions: Framework-Agnostic High-Performance Machine Learning Abstractions. arXiv preprint arXiv:1802.04730 (2018). Nicolas Vasilache, Oleksandr Zinenko, Theodoros Theodoridis, Priya Goyal, Zachary DeVito, William S. Moses, Sven Verdoolaege, Andrew Adams, and Albert Cohen. 2018. Tensor Comprehensions: Framework-Agnostic High-Performance Machine Learning Abstractions. arXiv preprint arXiv:1802.04730 (2018)."},{"key":"e_1_3_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-15582-6_49"},{"key":"e_1_3_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/2400682.2400713"},{"key":"e_1_3_2_1_75_1","volume-title":"International Workshop on Polyhedral Compilation Techniques.","author":"Verdoolaege Sven","year":"2014","unstructured":"Sven Verdoolaege , Serge Guelton , Tobias Grosser , and Albert Cohen . 2014 . Schedule trees . In International Workshop on Polyhedral Compilation Techniques. Sven Verdoolaege, Serge Guelton, Tobias Grosser, and Albert Cohen. 2014. Schedule trees. In International Workshop on Polyhedral Compilation Techniques."},{"key":"e_1_3_2_1_76_1","volume-title":"A survey on neural architecture search. arXiv preprint arXiv:1905.01392","author":"Wistuba Martin","year":"2019","unstructured":"Martin Wistuba , Ambrish Rawat , and Tejaswini Pedapati . 2019. A survey on neural architecture search. arXiv preprint arXiv:1905.01392 ( 2019 ). Martin Wistuba, Ambrish Rawat, and Tejaswini Pedapati. 2019. A survey on neural architecture search. arXiv preprint arXiv:1905.01392 (2019)."},{"key":"e_1_3_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01099"},{"key":"e_1_3_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.634"},{"key":"e_1_3_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01249-6_18"},{"key":"e_1_3_2_1_80_1","volume-title":"Nikhil Bhagdikar, Stephen Richardson, Shahar Kvatinsky, Jonathan Ragan-Kelley, Ardavan Pedram, and Mark Horowitz.","author":"Yang Xuan","year":"2016","unstructured":"Xuan Yang , Jing Pu , Blaine Burton Rister , Nikhil Bhagdikar, Stephen Richardson, Shahar Kvatinsky, Jonathan Ragan-Kelley, Ardavan Pedram, and Mark Horowitz. 2016 . A Systematic Approach to Blocking Convolutional Neural Networks . arXiv preprint arXiv:1606.04209 (2016). Xuan Yang, Jing Pu, Blaine Burton Rister, Nikhil Bhagdikar, Stephen Richardson, Shahar Kvatinsky, Jonathan Ragan-Kelley, Ardavan Pedram, and Mark Horowitz. 2016. A Systematic Approach to Blocking Convolutional Neural Networks. arXiv preprint arXiv:1606.04209 (2016)."},{"key":"e_1_3_2_1_81_1","volume-title":"Nas-bench-101: Towards reproducible neural architecture search. arXiv preprint arXiv:1902.09635","author":"Ying Chris","year":"2019","unstructured":"Chris Ying , Aaron Klein , Esteban Real , Eric Christiansen , Kevin Murphy , and Frank Hutter . 2019. Nas-bench-101: Towards reproducible neural architecture search. arXiv preprint arXiv:1902.09635 ( 2019 ). Chris Ying, Aaron Klein, Esteban Real, Eric Christiansen, Kevin Murphy, and Frank Hutter. 2019. Nas-bench-101: Towards reproducible neural architecture search. arXiv preprint arXiv:1902.09635 (2019)."},{"key":"e_1_3_2_1_82_1","volume-title":"NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Search. arXiv preprint arXiv:2001.10422","author":"Zela Arber","year":"2020","unstructured":"Arber Zela , Julien Siems , and Frank Hutter . 2020. NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Search. arXiv preprint arXiv:2001.10422 ( 2020 ). Arber Zela, Julien Siems, and Frank Hutter. 2020. NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Search. arXiv preprint arXiv:2001.10422 (2020)."},{"key":"e_1_3_2_1_83_1","volume-title":"Stripe: Tensor Compilation via the Nested Polyhedral Model. arXiv preprint arXiv:1903.06498","author":"Zerrell Tim","year":"2019","unstructured":"Tim Zerrell and Jeremy Bruestle . 2019 . Stripe: Tensor Compilation via the Nested Polyhedral Model. arXiv preprint arXiv:1903.06498 (2019). Tim Zerrell and Jeremy Bruestle. 2019. Stripe: Tensor Compilation via the Nested Polyhedral Model. arXiv preprint arXiv:1903.06498 (2019)."},{"key":"e_1_3_2_1_84_1","volume-title":"Ameer Haj-Ali, Yida Wang, Jun Yang, Danyang Zhuo, Koushik Sen, et al\\mbox.","author":"Zheng Lianmin","year":"2020","unstructured":"Lianmin Zheng , Chengfan Jia , Minmin Sun , Zhao Wu , Cody Hao Yu , Ameer Haj-Ali, Yida Wang, Jun Yang, Danyang Zhuo, Koushik Sen, et al\\mbox. 2020 . Ansor : Generating High-Performance Tensor Programs for Deep Learning . arXiv preprint arXiv:2006.06762 (2020). Lianmin Zheng, Chengfan Jia, Minmin Sun, Zhao Wu, Cody Hao Yu, Ameer Haj-Ali, Yida Wang, Jun Yang, Danyang Zhuo, Koushik Sen, et al\\mbox. 2020. Ansor: Generating High-Performance Tensor Programs for Deep Learning. arXiv preprint arXiv:2006.06762 (2020)."},{"key":"e_1_3_2_1_85_1","volume-title":"Randomized accuracy-aware program transformations for efficient approximate computations. ACM SIGPLAN Notices 47, 1","author":"Zhu Zeyuan Allen","year":"2012","unstructured":"Zeyuan Allen Zhu , Sasa Misailovic , Jonathan A Kelner , and Martin Rinard . 2012. Randomized accuracy-aware program transformations for efficient approximate computations. ACM SIGPLAN Notices 47, 1 ( 2012 ), 441?454. Zeyuan Allen Zhu, Sasa Misailovic, Jonathan A Kelner, and Martin Rinard. 2012. Randomized accuracy-aware program transformations for efficient approximate computations. ACM SIGPLAN Notices 47, 1 (2012), 441?454."},{"key":"e_1_3_2_1_86_1","volume-title":"International Conference on Learning Representations.","author":"Zoph Barret","unstructured":"Barret Zoph and Quoc V. Le . 2017. Neural architecture search with reinforcement learning . In International Conference on Learning Representations. Barret Zoph and Quoc V. Le. 2017. Neural architecture search with reinforcement learning. In International Conference on Learning Representations."}],"event":{"name":"ASPLOS '21: 26th ACM International Conference on Architectural Support for Programming Languages and Operating Systems","location":"Virtual USA","acronym":"ASPLOS '21","sponsor":["SIGPLAN ACM Special Interest Group on Programming Languages"]},"container-title":["Proceedings of the 26th ACM International Conference on Architectural Support for Programming Languages and Operating Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3445814.3446753","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3445814.3446753","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:33Z","timestamp":1750195473000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3445814.3446753"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,17]]},"references-count":83,"alternative-id":["10.1145\/3445814.3446753","10.1145\/3445814"],"URL":"https:\/\/doi.org\/10.1145\/3445814.3446753","relation":{},"subject":[],"published":{"date-parts":[[2021,4,17]]},"assertion":[{"value":"2021-04-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}