{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:30:17Z","timestamp":1750221017472,"version":"3.41.0"},"reference-count":38,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2019,7,25]],"date-time":"2019-07-25T00:00:00Z","timestamp":1564012800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGOPS Oper. Syst. Rev."],"published-print":{"date-parts":[[2019,7,25]]},"abstract":"<jats:p>While decision-makings in systems are commonly solved with explicit rules and heuristics, machine learning (ML) and deep learning (DL) have been driving a paradigm shift in modern system design. Based on our decade of experience in operationalizing a large production cloud system, Web Search, learning fills the gap in comprehending and taming the system design and operation complexity. However, rather than just improving specific ML\/DL algorithms or system features, we posit that the key to unlocking the full potential of learning-augmented systems is a principled methodology promoting learning-and-system co-design. On this basis, we present the AutoSys, a common framework for the development of learning-augmented systems.<\/jats:p>","DOI":"10.1145\/3352020.3352031","type":"journal-article","created":{"date-parts":[[2019,7,26]],"date-time":"2019-07-26T13:17:18Z","timestamp":1564147038000},"page":"68-74","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["The Case for Learning-and-System Co-design"],"prefix":"10.1145","volume":"53","author":[{"given":"Chieh-Jan","family":"Mike Liang","sequence":"first","affiliation":[{"name":"Microsoft Research, Redmond, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hui","family":"Xue","sequence":"additional","affiliation":[{"name":"Microsoft Research, Redmond, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mao","family":"Yang","sequence":"additional","affiliation":[{"name":"Microsoft Research, Redmond, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lidong","family":"Zhou","sequence":"additional","affiliation":[{"name":"Microsoft Research, Redmond, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,7,25]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"https:\/\/cloud.google.com\/tpu\/","author":"Cloud","year":"2018","unstructured":"Cloud TPU. https:\/\/cloud.google.com\/tpu\/ , 2018 . Cloud TPU. https:\/\/cloud.google.com\/tpu\/, 2018."},{"doi-asserted-by":"publisher","key":"e_1_2_1_2_1","DOI":"10.1145\/3308774.3308778"},{"doi-asserted-by":"publisher","key":"e_1_2_1_3_1","DOI":"10.1145\/3035918.3064029"},{"key":"e_1_2_1_4_1","volume-title":"NSDI. USENIX","author":"Alipourfard Omid","year":"2017","unstructured":"Omid Alipourfard , Hongqiang Harry Liu , Jianshu Chen , Shivaram Venkataraman , Minlan Yu , and Ming Zhang . CherryPick : Adaptively Unearthing the Best Cloud Configurations for Big Data Analytics . In NSDI. USENIX , 2017 . Omid Alipourfard, Hongqiang Harry Liu, Jianshu Chen, Shivaram Venkataraman, Minlan Yu, and Ming Zhang. CherryPick: Adaptively Unearthing the Best Cloud Configurations for Big Data Analytics. In NSDI. USENIX, 2017."},{"key":"e_1_2_1_5_1","volume-title":"Klaus Obermayer. Advances in Neural Information Processing Systems 15: Proceedings of the 2002 Conference","volume":"15","author":"Becker Suzanna","year":"2003","unstructured":"Suzanna Becker , Sebastian Thrun , and Klaus Obermayer. Advances in Neural Information Processing Systems 15: Proceedings of the 2002 Conference , volume 15 . MIT Press , 2003 . Suzanna Becker, Sebastian Thrun, and Klaus Obermayer. Advances in Neural Information Processing Systems 15: Proceedings of the 2002 Conference, volume 15. MIT Press, 2003."},{"doi-asserted-by":"publisher","key":"e_1_2_1_6_1","DOI":"10.1145\/2043164.2018471"},{"key":"e_1_2_1_7_1","volume-title":"NIPS","author":"Bergstra James","year":"2011","unstructured":"James Bergstra , Remi Bardenet , Yoshua Bengio , and Balazs Kegl . Algorithms for Hyper-Parameter Optimization . In NIPS , 2011 . James Bergstra, Remi Bardenet, Yoshua Bengio, and Balazs Kegl. Algorithms for Hyper-Parameter Optimization. In NIPS, 2011."},{"key":"e_1_2_1_8_1","volume":"198","author":"Bird D. L.","unstructured":"D. L. Bird and C. U. Munoz . Automatic Generation of Random Selfchecking Test Cases. IBM Systems Journal , 198 3. D. L. Bird and C. U. Munoz. Automatic Generation of Random Selfchecking Test Cases. IBM Systems Journal, 1983.","journal-title":"Random Selfchecking Test Cases. IBM Systems Journal"},{"key":"e_1_2_1_9_1","volume-title":"NIPS","author":"Bottou Leon","year":"2003","unstructured":"Leon Bottou and Yann Le Cun . Large Scale Online Learning . In NIPS , 2003 . Leon Bottou and Yann Le Cun. Large Scale Online Learning. In NIPS, 2003."},{"key":"e_1_2_1_10_1","volume-title":"ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware. arXiv preprint arXiv:1812.00332","author":"Cai Han","year":"2018","unstructured":"Han Cai , Ligeng Zhu , and Song Han . ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware. arXiv preprint arXiv:1812.00332 , 2018 . Han Cai, Ligeng Zhu, and Song Han. ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware. arXiv preprint arXiv:1812.00332, 2018."},{"doi-asserted-by":"publisher","key":"e_1_2_1_11_1","DOI":"10.1145\/3132747.3132772"},{"key":"e_1_2_1_12_1","doi-asserted-by":"crossref","DOI":"10.21236\/ADA461187","volume-title":"Self-* Storage: Brick-based Storage with Automated Administration. Technical report","author":"Ganger Gregory R.","year":"2003","unstructured":"Gregory R. Ganger , John D. Strunk , and Andrew J. Klosterman . Self-* Storage: Brick-based Storage with Automated Administration. Technical report , Carnegie Mellon University , 2003 . Gregory R. Ganger, John D. Strunk, and Andrew J. Klosterman. Self-* Storage: Brick-based Storage with Automated Administration. Technical report, Carnegie Mellon University, 2003."},{"doi-asserted-by":"publisher","key":"e_1_2_1_13_1","DOI":"10.1145\/2043556.2043582"},{"key":"e_1_2_1_14_1","volume-title":"CoRR","author":"Hashemi Milad","year":"2018","unstructured":"Milad Hashemi , Kevin Swersky , Jamie A. Smith , Grant Ayers , Heiner Litz , Jichuan Chang , Christos Kozyrakis , and Parthasarathy Ranganathan . Learning Memory Access Patterns . CoRR , 2018 . Milad Hashemi, Kevin Swersky, Jamie A. Smith, Grant Ayers, Heiner Litz, Jichuan Chang, Christos Kozyrakis, and Parthasarathy Ranganathan. Learning Memory Access Patterns. CoRR, 2018."},{"doi-asserted-by":"publisher","key":"e_1_2_1_15_1","DOI":"10.1007\/978-3-642-25566-3_40"},{"key":"e_1_2_1_16_1","volume-title":"FAST. USENIX","author":"Jiang Weihang","year":"2009","unstructured":"Weihang Jiang , Chongfeng Hu , Shankar Pasupathy , Arkady Kanevsky , Zhenmin Li , and Yuanyuan Zhou . Understanding Customer Problem Troubleshooting from Storage System Logs . In FAST. USENIX , 2009 . Weihang Jiang, Chongfeng Hu, Shankar Pasupathy, Arkady Kanevsky, Zhenmin Li, and Yuanyuan Zhou. Understanding Customer Problem Troubleshooting from Storage System Logs. In FAST. USENIX, 2009."},{"doi-asserted-by":"publisher","key":"e_1_2_1_17_1","DOI":"10.1145\/3183713.3196909"},{"key":"e_1_2_1_18_1","volume-title":"ATC. USENIX","author":"Li Zhao Lucis","year":"2018","unstructured":"Zhao Lucis Li , Chieh-Jan Mike Liang , Wenjia He , Lianjie Zhu , Wenjun Dai , Jin Jiang , and Guangzhong Sun . Metis : Robustly Optimizing Tail Latencies of Cloud Systems . In ATC. USENIX , 2018 . Zhao Lucis Li, Chieh-Jan Mike Liang, Wenjia He, Lianjie Zhu, Wenjun Dai, Jin Jiang, and Guangzhong Sun. Metis: Robustly Optimizing Tail Latencies of Cloud Systems. In ATC. USENIX, 2018."},{"key":"e_1_2_1_19_1","volume-title":"MobiCom. ACM","author":"Mike Liang Chieh-Jan","year":"2014","unstructured":"Chieh-Jan Mike Liang , Nicholas D. Lane , Niels Brouwers , Li Lyna Zhang , Borje Karlsson , Hao Liu , Yan Liu , Jun Tang , Xiang Shan , Ranveer Chandra , and Feng Zhao . Caiipa : Automated Large-scale Mobile App Testing through Contextual Fuzzing . In MobiCom. ACM , 2014 . Chieh-Jan Mike Liang, Nicholas D. Lane, Niels Brouwers, Li Lyna Zhang, Borje Karlsson, Hao Liu, Yan Liu, Jun Tang, Xiang Shan, Ranveer Chandra, and Feng Zhao. Caiipa: Automated Large-scale Mobile App Testing through Contextual Fuzzing. In MobiCom. ACM, 2014."},{"doi-asserted-by":"publisher","key":"e_1_2_1_20_1","DOI":"10.1145\/3098822.3098843"},{"doi-asserted-by":"publisher","key":"e_1_2_1_21_1","DOI":"10.1145\/1148170.1148246"},{"key":"e_1_2_1_22_1","volume-title":"ICLR","author":"Mirhoseini Azalia","year":"2018","unstructured":"Azalia Mirhoseini , Anna Goldie , Hieu Pham , Benoit Steiner , Quoc V. Le , and Jeff Dean . A Hierarchical Model for Device Placement . In ICLR , 2018 . Azalia Mirhoseini, Anna Goldie, Hieu Pham, Benoit Steiner, Quoc V. Le, and Jeff Dean. A Hierarchical Model for Device Placement. In ICLR, 2018."},{"key":"e_1_2_1_23_1","volume-title":"CoRR","author":"Mirhoseini Azalia","year":"2017","unstructured":"Azalia Mirhoseini , Hieu Pham , Quoc V. Le , Benoit Steiner , Rasmus Larsen , Yuefeng Zhou , Naveen Kumar , Mohammad Norouzi , Samy Bengio , and Jeff Dean . Device Placement Optimization with Reinforcement Learning . CoRR , 2017 . Azalia Mirhoseini, Hieu Pham, Quoc V. Le, Benoit Steiner, Rasmus Larsen, Yuefeng Zhou, Naveen Kumar, Mohammad Norouzi, Samy Bengio, and Jeff Dean. Device Placement Optimization with Reinforcement Learning. CoRR, 2017."},{"doi-asserted-by":"publisher","key":"e_1_2_1_24_1","DOI":"10.1145\/3209978.3210127"},{"doi-asserted-by":"publisher","key":"e_1_2_1_25_1","DOI":"10.1109\/MESOCA.2011.6049037"},{"doi-asserted-by":"publisher","key":"e_1_2_1_26_1","DOI":"10.1145\/361598.361623"},{"doi-asserted-by":"publisher","key":"e_1_2_1_27_1","DOI":"10.1145\/1327452.1327491"},{"key":"e_1_2_1_28_1","volume-title":"Efficient Neural Architecture Search via Parameter Sharing. arXiv preprint arXiv:1802.03268","author":"Pham Hieu","year":"2018","unstructured":"Hieu Pham , Melody Y Guan , Barret Zoph , Quoc V Le , and Jeff Dean . Efficient Neural Architecture Search via Parameter Sharing. arXiv preprint arXiv:1802.03268 , 2018 . Hieu Pham, Melody Y Guan, Barret Zoph, Quoc V Le, and Jeff Dean. Efficient Neural Architecture Search via Parameter Sharing. arXiv preprint arXiv:1802.03268, 2018."},{"doi-asserted-by":"publisher","key":"e_1_2_1_29_1","DOI":"10.1145\/1985793.1985812"},{"doi-asserted-by":"publisher","key":"e_1_2_1_30_1","DOI":"10.1023\/A:1007331723572"},{"key":"e_1_2_1_31_1","volume-title":"Freitas. Taking the Human Out of the Loop: A Review of Bayesian Optimization. Proceedings of the IEEE","author":"Shahriari B.","year":"2016","unstructured":"B. Shahriari , K. Swersky , Z. Wang , R. P. Adams , and N. de Freitas. Taking the Human Out of the Loop: A Review of Bayesian Optimization. Proceedings of the IEEE , 2016 . B. Shahriari, K. Swersky, Z. Wang, R. P. Adams, and N. de Freitas. Taking the Human Out of the Loop: A Review of Bayesian Optimization. Proceedings of the IEEE, 2016."},{"key":"e_1_2_1_32_1","volume-title":"Berkeley","author":"Stoica Ion","year":"2017","unstructured":"Ion Stoica , Dawn Song , Raluca Ada Popa , David A. Patterson , Michael W. Mahoney , Randy H. Katz , Anthony D. Joseph , Michael Jordan , Joseph M. Hellerstein , Joseph Gonzalez , Ken Goldberg , Ali Ghodsi , David E. Culler , and Pieter Abbeel . A Berkeley View of Systems Challenges for AI. Technical report , Berkeley , 2017 . Ion Stoica, Dawn Song, Raluca Ada Popa, David A. Patterson, Michael W. Mahoney, Randy H. Katz, Anthony D. Joseph, Michael Jordan, Joseph M. Hellerstein, Joseph Gonzalez, Ken Goldberg, Ali Ghodsi, David E. Culler, and Pieter Abbeel. A Berkeley View of Systems Challenges for AI. Technical report, Berkeley, 2017."},{"key":"e_1_2_1_33_1","volume-title":"Mnasnet: Platform-aware Neural Architecture Search for Mobile. arXiv preprint arXiv:1807.11626","author":"Tan Mingxing","year":"2018","unstructured":"Mingxing Tan , Bo Chen , Ruoming Pang , Vijay Vasudevan , and Quoc V Le . Mnasnet: Platform-aware Neural Architecture Search for Mobile. arXiv preprint arXiv:1807.11626 , 2018 . Mingxing Tan, Bo Chen, Ruoming Pang, Vijay Vasudevan, and Quoc V Le. Mnasnet: Platform-aware Neural Architecture Search for Mobile. arXiv preprint arXiv:1807.11626, 2018."},{"key":"e_1_2_1_34_1","volume-title":"Machine Learning for Networking: Workflow, Advances and Opportunities","author":"Wang Mowei","year":"2018","unstructured":"Mowei Wang , Yong Cui , Xin Wang , Shihan Xiao , and Junchen Jiang . Machine Learning for Networking: Workflow, Advances and Opportunities . IEEE Network , 2018 . Mowei Wang, Yong Cui, Xin Wang, Shihan Xiao, and Junchen Jiang. Machine Learning for Networking: Workflow, Advances and Opportunities. IEEE Network, 2018."},{"key":"e_1_2_1_35_1","volume-title":"NSDI. USENIX","author":"Yang Junfeng","year":"2009","unstructured":"Junfeng Yang , Tisheng Chen , Ming Wu , Zhilei Xu , Xuezheng Liu , Haoxiang Lin , Mao Yang , Fan Long , Lintao Zhang , and Lidong Zhou . MODIST : Transparent Model Checking of Unmodified Distributed Systems . In NSDI. USENIX , 2009 . Junfeng Yang, Tisheng Chen, Ming Wu, Zhilei Xu, Xuezheng Liu, Haoxiang Lin, Mao Yang, Fan Long, Lintao Zhang, and Lidong Zhou. MODIST: Transparent Model Checking of Unmodified Distributed Systems. In NSDI. USENIX, 2009."},{"doi-asserted-by":"publisher","key":"e_1_2_1_36_1","DOI":"10.1145\/2043556.2043572"},{"doi-asserted-by":"publisher","key":"e_1_2_1_37_1","DOI":"10.5555\/3155562.3155568"},{"doi-asserted-by":"publisher","key":"e_1_2_1_38_1","DOI":"10.1145\/2568225.2568251"}],"container-title":["ACM SIGOPS Operating Systems Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3352020.3352031","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3352020.3352031","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:26:15Z","timestamp":1750206375000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3352020.3352031"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,25]]},"references-count":38,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,7,25]]}},"alternative-id":["10.1145\/3352020.3352031"],"URL":"https:\/\/doi.org\/10.1145\/3352020.3352031","relation":{},"ISSN":["0163-5980"],"issn-type":[{"type":"print","value":"0163-5980"}],"subject":[],"published":{"date-parts":[[2019,7,25]]},"assertion":[{"value":"2019-07-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}