{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,20]],"date-time":"2025-12-20T22:06:04Z","timestamp":1766268364746,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":33,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,2,25]],"date-time":"2022-02-25T00:00:00Z","timestamp":1645747200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100011185","name":"Institute of Software, Chinese Academy of Sciences","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100011185","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100011332","name":"University of Chinese Academy of Sciences","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100011332","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,2,25]]},"DOI":"10.1145\/3516807.3516820","type":"proceedings-article","created":{"date-parts":[[2022,2,25]],"date-time":"2022-02-25T16:11:34Z","timestamp":1645805494000},"page":"45-57","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["EOP: efficient operator partition for deep learning inference over edge servers"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0939-2381","authenticated-orcid":false,"given":"Yuanjia","family":"Xu","sequence":"first","affiliation":[{"name":"University of Chinese Academy of Sciences, China \/ Institute of Software at Chinese Academy of Sciences, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7903-5879","authenticated-orcid":false,"given":"Heng","family":"Wu","sequence":"additional","affiliation":[{"name":"Institute of Software at Chinese Academy of Sciences, China \/ Nanjing Institute of Software Technology, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0237-5100","authenticated-orcid":false,"given":"Wenbo","family":"Zhang","sequence":"additional","affiliation":[{"name":"Institute of Software at Chinese Academy of Sciences, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9254-6331","authenticated-orcid":false,"given":"Yi","family":"Hu","sequence":"additional","affiliation":[{"name":"University of Chinese Academy of Sciences, China \/ Institute of Software at Chinese Academy of Sciences, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,2,25]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"[n. d.]. Pytorch text. https:\/\/pytorch.org\/text\/stable\/index.html  [n. d.]. Pytorch text. https:\/\/pytorch.org\/text\/stable\/index.html"},{"key":"e_1_3_2_1_2_1","unstructured":"[n. d.]. TVM. https:\/\/github.com\/apache\/tvm  [n. d.]. TVM. https:\/\/github.com\/apache\/tvm"},{"key":"e_1_3_2_1_3_1","unstructured":"[n. d.]. Tvm relay testing. https:\/\/tvm.apache.org\/docs\/api\/python\/relay\/testing.html  [n. d.]. Tvm relay testing. https:\/\/tvm.apache.org\/docs\/api\/python\/relay\/testing.html"},{"key":"e_1_3_2_1_4_1","volume-title":"Tensorflow: A system for large-scale machine learning. In OSDI. 265\u2013283. https:\/\/doi.org\/10.5555\/3026877.3026899","author":"Abadi Mart\u00edn","year":"2016","unstructured":"Mart\u00edn Abadi , Paul Barham , Jianmin Chen , Zhifeng Chen , Andy Davis , Jeffrey Dean , Matthieu Devin , Sanjay Ghemawat , Geoffrey Irving , and Michael Isard . 2016 . Tensorflow: A system for large-scale machine learning. In OSDI. 265\u2013283. https:\/\/doi.org\/10.5555\/3026877.3026899 10.5555\/3026877.3026899 Mart\u00edn Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, and Michael Isard. 2016. Tensorflow: A system for large-scale machine learning. In OSDI. 265\u2013283. https:\/\/doi.org\/10.5555\/3026877.3026899"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3461648.3463848"},{"key":"#cr-split#-e_1_3_2_1_6_1.1","unstructured":"Tianqi Chen Thierry Moreau Ziheng Jiang Lianmin Zheng Eddie Yan Haichen Shen Meghan Cowan Leyuan Wang Yuwei Hu and Luis Ceze. 2018. $TVM$: An automated end-to-end optimizing compiler for deep learning. In OSDI. 578-594. https:\/\/doi.org\/10.5555\/3291168.3291211 10.5555\/3291168.3291211"},{"key":"#cr-split#-e_1_3_2_1_6_1.2","unstructured":"Tianqi Chen Thierry Moreau Ziheng Jiang Lianmin Zheng Eddie Yan Haichen Shen Meghan Cowan Leyuan Wang Yuwei Hu and Luis Ceze. 2018. $TVM$: An automated end-to-end optimizing compiler for deep learning. In OSDI. 578-594. https:\/\/doi.org\/10.5555\/3291168.3291211"},{"key":"e_1_3_2_1_7_1","volume-title":"14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20)","author":"Gujarati Arpan","year":"2020","unstructured":"Arpan Gujarati , Reza Karimi , Safya Alzayat , Wei Hao , Antoine Kaufmann , Ymir Vigfusson , and Jonathan Mace . 2020 . Serving DNNs like Clockwork: Performance Predictability from the Bottom Up . In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20) . USENIX Association, 443\u2013462. isbn:978-1-939133-19-9 https:\/\/www.usenix.org\/conference\/osdi20\/presentation\/gujarati Arpan Gujarati, Reza Karimi, Safya Alzayat, Wei Hao, Antoine Kaufmann, Ymir Vigfusson, and Jonathan Mace. 2020. Serving DNNs like Clockwork: Performance Predictability from the Bottom Up. In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20). USENIX Association, 443\u2013462. isbn:978-1-939133-19-9 https:\/\/www.usenix.org\/conference\/osdi20\/presentation\/gujarati"},{"key":"e_1_3_2_1_8_1","volume-title":"18th USENIX Symposium on Networked Systems Design and Implementation (NSDI 21)","author":"Guo Peizhen","year":"2021","unstructured":"Peizhen Guo , Bo Hu , and Wenjun Hu . 2021 . Mistify: Automating DNN Model Porting for On-Device Inference at the Edge . In 18th USENIX Symposium on Networked Systems Design and Implementation (NSDI 21) . USENIX Association, 705\u2013719. isbn:978-1-939133-21-2 https:\/\/www.usenix.org\/conference\/nsdi21\/presentation\/guo Peizhen Guo, Bo Hu, and Wenjun Hu. 2021. Mistify: Automating DNN Model Porting for On-Device Inference at the Edge. In 18th USENIX Symposium on Networked Systems Design and Implementation (NSDI 21). USENIX Association, 705\u2013719. isbn:978-1-939133-21-2 https:\/\/www.usenix.org\/conference\/nsdi21\/presentation\/guo"},{"key":"e_1_3_2_1_9_1","unstructured":"Aric Hagberg Pieter Swart and Daniel S Chult. 2008. Exploring network structure dynamics and function using NetworkX. Los Alamos National Lab.(LANL) Los Alamos NM (United States).  Aric Hagberg Pieter Swart and Daniel S Chult. 2008. Exploring network structure dynamics and function using NetworkX. Los Alamos National Lab.(LANL) Los Alamos NM (United States)."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3302424.3303949"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDCS51616.2021.00075"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS49936.2021.00071"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3419111.3421302"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3084689"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3302424.3303950"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS49936.2021.00068"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS47924.2020.00042"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341301.3359646"},{"key":"e_1_3_2_1_19_1","volume-title":"Pytorch: An imperative style, high-performance deep learning library. In Advances in neural information processing systems. 8026\u20138037. https:\/\/doi.org\/10.5555\/3454287.3455008","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke , Sam Gross , Francisco Massa , Adam Lerer , James Bradbury , Gregory Chanan , Trevor Killeen , Zeming Lin , Natalia Gimelshein , and Luca Antiga . 2019 . Pytorch: An imperative style, high-performance deep learning library. In Advances in neural information processing systems. 8026\u20138037. https:\/\/doi.org\/10.5555\/3454287.3455008 10.5555\/3454287.3455008 Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, and Luca Antiga. 2019. Pytorch: An imperative style, high-performance deep learning library. In Advances in neural information processing systems. 8026\u20138037. https:\/\/doi.org\/10.5555\/3454287.3455008"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2019.8683713"},{"key":"e_1_3_2_1_21_1","unstructured":"Joseph Redmon and Ali Farhadi. 2018. Yolov3: An incremental improvement. arXiv preprint arXiv:1804.02767.  Joseph Redmon and Ali Farhadi. 2018. Yolov3: An incremental improvement. arXiv preprint arXiv:1804.02767."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV45572.2020.9093363"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/HPCA47549.2020.00036"},{"key":"e_1_3_2_1_24_1","volume-title":"MLaaS in the Wild: Workload Analysis and Scheduling in Large-Scale Heterogeneous GPU Clusters. In 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI 22)","author":"Weng Qizhen","year":"2022","unstructured":"Qizhen Weng , Wencong Xiao , Yinghao Yu , Wei Wang , Cheng Wang , Jian He , Yong Li , Liping Zhang , Wei Lin , and Yu Ding . 2022 . MLaaS in the Wild: Workload Analysis and Scheduling in Large-Scale Heterogeneous GPU Clusters. In 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI 22) . USENIX Association, Renton, WA. https:\/\/www.usenix.org\/conference\/nsdi22\/presentation\/weng Qizhen Weng, Wencong Xiao, Yinghao Yu, Wei Wang, Cheng Wang, Jian He, Yong Li, Liping Zhang, Wei Lin, and Yu Ding. 2022. MLaaS in the Wild: Workload Analysis and Scheduling in Large-Scale Heterogeneous GPU Clusters. In 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI 22). USENIX Association, Renton, WA. https:\/\/www.usenix.org\/conference\/nsdi22\/presentation\/weng"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Thomas Wolf Lysandre Debut Victor Sanh Julien Chaumond Clement Delangue Anthony Moi Pierric Cistac Tim Rault R\u00e9mi Louf and Morgan Funtowicz. 2019. Huggingface\u2019s transformers: State-of-the-art natural language processing. arXiv preprint arXiv:1910.03771.  Thomas Wolf Lysandre Debut Victor Sanh Julien Chaumond Clement Delangue Anthony Moi Pierric Cistac Tim Rault R\u00e9mi Louf and Morgan Funtowicz. 2019. Huggingface\u2019s transformers: State-of-the-art natural language processing. arXiv preprint arXiv:1910.03771.","DOI":"10.18653\/v1\/2020.emnlp-demos.6"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASAP52443.2021.00023"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3423211.3425675"},{"key":"e_1_3_2_1_28_1","volume-title":"Habitat: A Runtime-Based Computational Performance Predictor for Deep Neural Network Training. In 2021 USENIX Annual Technical Conference (USENIX ATC 21)","author":"Yu Geoffrey X.","year":"2021","unstructured":"Geoffrey X. Yu , Yubo Gao , Pavel Golikov , and Gennady Pekhimenko . 2021 . Habitat: A Runtime-Based Computational Performance Predictor for Deep Neural Network Training. In 2021 USENIX Annual Technical Conference (USENIX ATC 21) . USENIX Association, 503\u2013521. isbn:978-1-939133-23-6 https:\/\/www.usenix.org\/conference\/atc21\/presentation\/yu Geoffrey X. Yu, Yubo Gao, Pavel Golikov, and Gennady Pekhimenko. 2021. Habitat: A Runtime-Based Computational Performance Predictor for Deep Neural Network Training. In 2021 USENIX Annual Technical Conference (USENIX ATC 21). USENIX Association, 503\u2013521. isbn:978-1-939133-23-6 https:\/\/www.usenix.org\/conference\/atc21\/presentation\/yu"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2020.3042320"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2021.3088910"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3458864.3467882"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS49936.2021.00024"}],"event":{"name":"VEE '22: 18th ACM SIGPLAN\/SIGOPS International Conference on Virtual Execution Environments","sponsor":["SIGPLAN ACM Special Interest Group on Programming Languages","SIGOPS ACM Special Interest Group on Operating Systems"],"location":"Virtual Switzerland","acronym":"VEE '22"},"container-title":["Proceedings of the 18th ACM SIGPLAN\/SIGOPS International Conference on Virtual Execution Environments"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3516807.3516820","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3516807.3516820","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:21Z","timestamp":1750191501000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3516807.3516820"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,25]]},"references-count":33,"alternative-id":["10.1145\/3516807.3516820","10.1145\/3516807"],"URL":"https:\/\/doi.org\/10.1145\/3516807.3516820","relation":{},"subject":[],"published":{"date-parts":[[2022,2,25]]},"assertion":[{"value":"2022-02-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}