{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,5]],"date-time":"2026-08-05T18:08:11Z","timestamp":1785953291510,"version":"3.56.0"},"publisher-location":"New York, NY, USA","reference-count":42,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,2,22]],"date-time":"2022-02-22T00:00:00Z","timestamp":1645488000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,2,28]]},"DOI":"10.1145\/3503222.3507709","type":"proceedings-article","created":{"date-parts":[[2022,2,22]],"date-time":"2022-02-22T20:49:01Z","timestamp":1645562941000},"page":"768-781","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":143,"title":["INFless: a native serverless system for low-latency, high-throughput inference"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2222-393X","authenticated-orcid":false,"given":"Yanan","family":"Yang","sequence":"first","affiliation":[{"name":"Tianjin University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laiping","family":"Zhao","sequence":"additional","affiliation":[{"name":"Tianjin University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yiming","family":"Li","sequence":"additional","affiliation":[{"name":"Tianjin University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Huanyu","family":"Zhang","sequence":"additional","affiliation":[{"name":"Tianjin University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jie","family":"Li","sequence":"additional","affiliation":[{"name":"Tianjin University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mingyang","family":"Zhao","sequence":"additional","affiliation":[{"name":"Tianjin University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xingzhen","family":"Chen","sequence":"additional","affiliation":[{"name":"58.com, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Keqiu","family":"Li","sequence":"additional","affiliation":[{"name":"Tianjin University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,2,22]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/IISWC.2016.7581275"},{"key":"e_1_3_2_2_2_1","unstructured":"AILab. 2019. Deep learning inference. https:\/\/github.com\/wuba\/dl_inference"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/SC41405.2020.00073"},{"key":"e_1_3_2_2_4_1","unstructured":"AWS. 2020. Serverless Application Lens: Alexa Skills. https:\/\/docs.aws.amazon.com\/wellarchitected\/latest\/serverless-applications-lens\/alexa-skills.html"},{"key":"e_1_3_2_2_5_1","unstructured":"Microsoft Azure. 2020. Azure Functions\u2014Serverless Architecture. https:\/\/azure.microsoft.com\/en-us\/services\/functions\/"},{"key":"e_1_3_2_2_6_1","volume-title":"Zhuangwei Kang, Hongyang Sun, Aniruddha Gokhale, and Gabor Karsai.","author":"Bhattacharjee Anirban","year":"2019","unstructured":"Anirban Bhattacharjee, Ajay Dev Chhokra, Zhuangwei Kang, Hongyang Sun, Aniruddha Gokhale, and Gabor Karsai. 2019. BARISTA: Efficient and Scalable Serverless Serving System for Deep Learning Prediction Services. CoRR, abs\/1904.01576 (2019), arxiv:1904.01576. arxiv:1904.01576"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSAI.2018.8599486"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2017.2699184"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCI-CC.2017.8109757"},{"key":"e_1_3_2_2_10_1","unstructured":"Fran\u00e7ois Chollet. 2015. Keras. https:\/\/keras.io"},{"key":"e_1_3_2_2_11_1","volume-title":"Clipper: A Low-Latency Online Prediction Serving System. In 14th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2017","author":"Crankshaw Daniel","year":"2017","unstructured":"Daniel Crankshaw, Xin Wang, Giulio Zhou, Michael J. Franklin, Joseph E. Gonzalez, and Ion Stoica. 2017. Clipper: A Low-Latency Online Prediction Serving System. In 14th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2017, Boston, MA, USA, March 27-29, 2017, Aditya Akella and Jon Howell (Eds.). USENIX Association, 613\u2013627. https:\/\/www.usenix.org\/conference\/nsdi17\/technical-sessions\/presentation\/crankshaw"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3419111.3421284"},{"key":"e_1_3_2_2_14_1","unstructured":"NVIDIA Docker. 2018. https:\/\/github.com\/ NVIDIA\/nvidia-docker\/"},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3373376.3378512"},{"key":"e_1_3_2_2_16_1","volume-title":"Maximilian Schwinger, Johannes Grohmann, Nikolas Herbst, Cristina L. Abad, and Alexandru Iosup.","author":"Eismann Simon","year":"2020","unstructured":"Simon Eismann, Joel Scheuner, Erwin Van Eyk, Maximilian Schwinger, Johannes Grohmann, Nikolas Herbst, Cristina L. Abad, and Alexandru Iosup. 2020. A Review of Serverless Use Cases and their Characteristics. CoRR, abs\/2008.11110 (2020), arxiv:2008.11110. arxiv:2008.11110"},{"key":"e_1_3_2_2_17_1","unstructured":"A. Ellis.. 2020. OpenFaas. https:\/\/docs.openfaas.com\/"},{"key":"e_1_3_2_2_18_1","unstructured":"Google. 2018. Tensorflow serving benchmarks. https:\/\/github.com\/tensorflow\/serving"},{"key":"e_1_3_2_2_19_1","unstructured":"Google. 2020. Google Cloud Functions. https:\/\/cloud.google.com\/functions\/"},{"key":"e_1_3_2_2_20_1","unstructured":"GoogleCloud. 2020. Serverless Optical Character Recognition (OCR) Tutorial. https:\/\/cloud.google.com\/functions\/docs\/tutorials\/ocr"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3135974.3135993"},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3423211.3425683"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_2_2_24_1","unstructured":"IBM. 2020. Openwhisk. https:\/\/www.ibm.com\/cloud-computing\/bluemix\/openwhisk"},{"key":"e_1_3_2_2_25_1","unstructured":"AWS Lambda. 2015. Serverless Compute - Amazon Web Services. https:\/\/aws.amazon.com\/lambda\/"},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3342195.3387547"},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/MM.2020.2974843"},{"key":"e_1_3_2_2_28_1","unstructured":"Philipp Muens. 2020. Serverless Facebook Messenger Bot. https:\/\/github.com\/pmuens\/serverless-facebook-messenger-bot"},{"key":"e_1_3_2_2_29_1","unstructured":"NVIDIA. 2018. NVIDIA Turing Architecture Whitepaper. https:\/\/www.nvidia.com\/content\/dam\/en-zz\/Solutions\/design-visualization\/technologies\/turing-architecture\/NVIDIA-Turing-Architecture-Whitepaper.pdf"},{"key":"e_1_3_2_2_30_1","volume-title":"SOCK: Rapid Task Provisioning with Serverless-Optimized Containers. In 2018 USENIX Annual Technical Conference, USENIX ATC 2018","author":"Oakes Edward","year":"2018","unstructured":"Edward Oakes, Leon Yang, Dennis Zhou, Kevin Houck, Tyler Harter, Andrea C. Arpaci-Dusseau, and Remzi H. Arpaci-Dusseau. 2018. SOCK: Rapid Task Provisioning with Serverless-Optimized Containers. In 2018 USENIX Annual Technical Conference, USENIX ATC 2018, Boston, MA, USA, July 11-13, 2018, Haryadi S. Gunawi and Benjamin Reed (Eds.). USENIX Association, 57\u201370. https:\/\/www.usenix.org\/conference\/atc18\/presentation\/oakes"},{"key":"e_1_3_2_2_31_1","volume-title":"High-Performance ML Serving. CoRR, abs\/1712.06139","author":"Olston Christopher","year":"2017","unstructured":"Christopher Olston, Noah Fiedel, Kiril Gorovoy, Jeremiah Harmsen, Li Lao, Fangwei Li, Vinu Rajashekhar, Sukriti Ramesh, and Jordan Soyke. 2017. TensorFlow-Serving: Flexible, High-Performance ML Serving. CoRR, abs\/1712.06139 (2017), arxiv:1712.06139. arxiv:1712.06139"},{"key":"e_1_3_2_2_32_1","unstructured":"Jongsoo Park Maxim Naumov Protonu Basu Summer Deng Aravind Kalaiah Daya Shanker Khudia James Law Parth Malani Andrey Malevich Nadathur Satish Juan Pino Martin Schatz Alexander Sidorov Viswanath Sivakumar Andrew Tulloch Xiaodong Wang Yiming Wu Hector Yuen Utku Diril Dmytro Dzhulgakov Kim M. Hazelwood Bill Jia Yangqing Jia Lin Qiao Vijay Rao Nadav Rotem Sungjoo Yoo and Mikhail Smelyanskiy. 2018. Deep Learning Inference in Facebook Data Centers: Characterization Performance Optimizations and Hardware Implications. CoRR abs\/1811.09886 (2018) arxiv:1811.09886. arxiv:1811.09886"},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.5244\/C.29.41"},{"key":"e_1_3_2_2_34_1","volume-title":"High-Performance Deep Learning Library. In Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas K\u00f6pf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019. PyTorch: An Imperative Style, High-Performance Deep Learning Library. In Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, 8-14 December 2019, Vancouver, BC, Canada, Hanna M. Wallach, Hugo Larochelle, Alina Beygelzimer, Florence d\u2019Alch\u00e9-Buc, Emily B. Fox, and Roman Garnett (Eds.). 8024\u20138035. http:\/\/papers.nips.cc\/paper\/9015-pytorch-an-imperative-style-high-performance-deep-learning-library"},{"key":"e_1_3_2_2_35_1","volume-title":"INFaasCache: Keeping serverless computing alive with greedy-dual caching: Managed & Model-less Inference Serving. CoRR, abs\/1905.13348","author":"Romero Francisco","year":"2019","unstructured":"Francisco Romero, Qian Li, Neeraja J. Yadwadkar, and Christos Kozyrakis. 2019. INFaasCache: Keeping serverless computing alive with greedy-dual caching: Managed & Model-less Inference Serving. CoRR, abs\/1905.13348 (2019), arxiv:1905.13348. arxiv:1905.13348"},{"key":"e_1_3_2_2_36_1","volume-title":"2020 USENIX Annual Technical Conference, USENIX ATC 2020","author":"Shahrad Mohammad","year":"2020","unstructured":"Mohammad Shahrad, Rodrigo Fonseca, I\u00f1igo Goiri, Gohar Chaudhry, Paul Batum, Jason Cooke, Eduardo Laureano, Colby Tresness, Mark Russinovich, and Ricardo Bianchini. 2020. Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud Provider. In 2020 USENIX Annual Technical Conference, USENIX ATC 2020, July 15-17, 2020, Ada Gavrilovska and Erez Zadok (Eds.). USENIX Association, 205\u2013218. https:\/\/www.usenix.org\/conference\/atc20\/presentation\/shahrad"},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341301.3359658"},{"key":"e_1_3_2_2_38_1","volume-title":"Hellerstein","author":"Sreekanti Vikram","year":"2020","unstructured":"Vikram Sreekanti, Harikaran Subbaraj, Chenggang Wu, Joseph E. Gonzalez, and Joseph M. Hellerstein. 2020. Optimizing Prediction Serving on Low-Latency Serverless Dataflow. CoRR, abs\/2007.05832 (2020), arxiv:2007.05832. arxiv:2007.05832"},{"key":"e_1_3_2_2_39_1","volume-title":"Peeking Behind the Curtains of Serverless Platforms. In 2018 USENIX Annual Technical Conference, USENIX ATC 2018","author":"Wang Liang","year":"2018","unstructured":"Liang Wang, Mengyuan Li, Yinqian Zhang, Thomas Ristenpart, and Michael M. Swift. 2018. Peeking Behind the Curtains of Serverless Platforms. In 2018 USENIX Annual Technical Conference, USENIX ATC 2018, Boston, MA, USA, July 11-13, 2018, Haryadi S. Gunawi and Benjamin Reed (Eds.). USENIX Association, 133\u2013146. https:\/\/www.usenix.org\/conference\/atc18\/presentation\/wang-liang"},{"key":"e_1_3_2_2_40_1","doi-asserted-by":"publisher","unstructured":"Tianyi Yu Qingyuan Liu Dong Du Yubin Xia Binyu Zang Ziqian Lu Pingchao Yang Chenggang Qin and Haibo Chen. 2020. Characterizing Serverless Platforms with ServerlessBench. https:\/\/doi.org\/10.1145\/3419111.3421280 10.1145\/3419111.3421280","DOI":"10.1145\/3419111.3421280"},{"key":"e_1_3_2_2_41_1","volume-title":"SLO-Aware Machine Learning Inference Serving. In 2019 USENIX Annual Technical Conference (USENIX ATC 19)","author":"Zhang Chengliang","year":"2019","unstructured":"Chengliang Zhang, Minchen Yu, Wei Wang, and Feng Yan. 2019. MArk: Exploiting Cloud Services for Cost-Effective, SLO-Aware Machine Learning Inference Serving. In 2019 USENIX Annual Technical Conference (USENIX ATC 19). USENIX Association, Renton, WA. 1049\u20131062. isbn:978-1-939133-03-8 https:\/\/www.usenix.org\/conference\/atc19\/presentation\/zhang-chengliang"},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/SSCI44817.2019.9003100"}],"event":{"name":"ASPLOS '22: 27th ACM International Conference on Architectural Support for Programming Languages and Operating Systems","location":"Lausanne Switzerland","acronym":"ASPLOS '22","sponsor":["SIGPLAN ACM Special Interest Group on Programming Languages","SIGOPS ACM Special Interest Group on Operating Systems","SIGARCH ACM Special Interest Group on Computer Architecture","SIGBED ACM Special Interest Group on Embedded Systems"]},"container-title":["Proceedings of the 27th ACM International Conference on Architectural Support for Programming Languages and Operating Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3503222.3507709","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3503222.3507709","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:11:39Z","timestamp":1750191099000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3503222.3507709"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,22]]},"references-count":42,"alternative-id":["10.1145\/3503222.3507709","10.1145\/3503222"],"URL":"https:\/\/doi.org\/10.1145\/3503222.3507709","relation":{},"subject":[],"published":{"date-parts":[[2022,2,22]]},"assertion":[{"value":"2022-02-22","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}