{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T15:58:09Z","timestamp":1782835089624,"version":"3.54.5"},"publisher-location":"New York, NY, USA","reference-count":27,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,6,18]],"date-time":"2023-06-18T00:00:00Z","timestamp":1687046400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,6,18]]},"DOI":"10.1145\/3597062.3597278","type":"proceedings-article","created":{"date-parts":[[2023,6,21]],"date-time":"2023-06-21T14:52:55Z","timestamp":1687359175000},"page":"1-6","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["The Case for Hierarchical Deep Learning Inference at the Network Edge"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-2451-6780","authenticated-orcid":false,"given":"Ghina","family":"Al-Atat","sequence":"first","affiliation":[{"name":"IMDEA Networks Institute, Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2849-5151","authenticated-orcid":false,"given":"Andrea","family":"Fresa","sequence":"additional","affiliation":[{"name":"IMDEA Networks Institute, Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7220-5353","authenticated-orcid":false,"given":"Adarsh Prasad","family":"Behera","sequence":"additional","affiliation":[{"name":"IMDEA Networks Institute, Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2739-5060","authenticated-orcid":false,"given":"Vishnu Narayanan","family":"Moothedath","sequence":"additional","affiliation":[{"name":"KTH Royal Institute of Technology, Stockholm, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6682-6559","authenticated-orcid":false,"given":"James","family":"Gross","sequence":"additional","affiliation":[{"name":"KTH Royal Institute of Technology, Stockholm, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5127-8497","authenticated-orcid":false,"given":"Jaya Prakash","family":"Champati","sequence":"additional","affiliation":[{"name":"IMDEA Networks Institute, Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,6,21]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Champati","author":"Al-Atat Ghina","year":"2023","unstructured":"Ghina Al-Atat , Andrea Fresa , Adarsh P. Behera , Vishnu N. Moothedath , James Gross , and Jaya P . Champati . 2023 . The Case for Hierarchical Deep Learning Inference at the Network Edge . arXiv:2304.11763 [cs.DC] Ghina Al-Atat, Andrea Fresa, Adarsh P. Behera, Vishnu N. Moothedath, James Gross, and Jaya P. Champati. 2023. The Case for Hierarchical Deep Learning Inference at the Network Edge. arXiv:2304.11763 [cs.DC]"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1101\/2023.02.15.528581"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2020.2976475"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNSM.2021.3116665"},{"key":"e_1_3_2_1_5_1","volume-title":"Proc. ICLR.","author":"Dosovitskiy Alexey","year":"2021","unstructured":"Alexey Dosovitskiy , Lucas Beyer , Alexander Kolesnikov , Dirk Weissenborn , Xiaohua Zhai , Thomas Unterthiner , Mostafa Dehghani , Matthias Minderer , Georg Heigold , Sylvain Gelly , Jakob Uszkoreit , and Neil Houlsby . 2021 . An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale . In Proc. ICLR. Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, and Neil Houlsby. 2021. An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. In Proc. ICLR."},{"key":"e_1_3_2_1_6_1","volume-title":"Proc. Neural Information Processing Systems Datasets and Benchmarks Track (Round 1).","author":"Colby","unstructured":"Colby Banbury et al. 2021. MLPerf Tiny Benchmark . In Proc. Neural Information Processing Systems Datasets and Benchmarks Track (Round 1). Colby Banbury et al. 2021. MLPerf Tiny Benchmark. In Proc. Neural Information Processing Systems Datasets and Benchmarks Track (Round 1)."},{"key":"e_1_3_2_1_7_1","volume-title":"Whatmough","author":"Fedorov Igor","year":"2019","unstructured":"Igor Fedorov , Ryan P. Adams , Matthew Mattina , and Paul N . Whatmough . 2019 . SpArSe: Sparse architecture search for CNNs on resource-constrained microcontrollers. Advances in Neural Information Processing Systems 32 (2019). Igor Fedorov, Ryan P. Adams, Matthew Mattina, and Paul N. Whatmough. 2019. SpArSe: Sparse architecture search for CNNs on resource-constrained microcontrollers. Advances in Neural Information Processing Systems 32 (2019)."},{"key":"e_1_3_2_1_8_1","volume-title":"Champati","author":"Fresa Andrea","year":"2022","unstructured":"Andrea Fresa and Jaya P . Champati . 2022 . An Offloading Algorithm for Maximizing Inference Accuracy on Edge Device in an Edge Intelligence System. In Proc. ACM MSWiM. 15--23. Andrea Fresa and Jaya P. Champati. 2022. An Offloading Algorithm for Maximizing Inference Accuracy on Edge Device in an Edge Intelligence System. In Proc. ACM MSWiM. 15--23."},{"key":"e_1_3_2_1_9_1","volume-title":"Dally","author":"Han Song","year":"2016","unstructured":"Song Han , Huizi Mao , and William J . Dally . 2016 . Deep Compression : Compressing Deep Neural Network with Pruning, Trained Quantization and Huffman Coding. In Proc. ICLR. Song Han, Huizi Mao, and William J. Dally. 2016. Deep Compression: Compressing Deep Neural Network with Pruning, Trained Quantization and Huffman Coding. In Proc. ICLR."},{"key":"e_1_3_2_1_10_1","volume-title":"Proc. ECCV. 815--832","author":"He Yihui","year":"2018","unstructured":"Yihui He , Ji Lin , Zhijian Liu , Hanrui Wang , Li-Jia Li , and Song Han . 2018 . AMC: AutoML for Model Compression and Acceleration on Mobile Devices . In Proc. ECCV. 815--832 . Yihui He, Ji Lin, Zhijian Liu, Hanrui Wang, Li-Jia Li, and Song Han. 2018. AMC: AutoML for Model Compression and Acceleration on Mobile Devices. In Proc. ECCV. 815--832."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2019.8737614"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM48880.2022.9796896"},{"key":"e_1_3_2_1_13_1","unstructured":"Forrest N. Iandola Song Han Matthew W. Moskewicz Khalid Ashraf William J. Dally and Kurt Keutzer. 2016. SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and < 0.5MB model size.  Forrest N. Iandola Song Han Matthew W. Moskewicz Khalid Ashraf William J. Dally and Kurt Keutzer. 2016. SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and < 0.5MB model size."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3037697.3037698"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3093337.3037698"},{"key":"e_1_3_2_1_16_1","volume-title":"Hinton","author":"Krizhevsky Alex","year":"2012","unstructured":"Alex Krizhevsky , Ilya Sutskever , and Geoffrey E . Hinton . 2012 . ImageNet Classification with Deep Convolutional Neural Networks. In Proc. NIPS. 1097--1105. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. ImageNet Classification with Deep Convolutional Neural Networks. In Proc. NIPS. 1097--1105."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2019.2946140"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2017.2682318"},{"key":"e_1_3_2_1_19_1","unstructured":"Vishnu N. Moothedath Jaya P. Champati and James Gross. 2023. Online Algorithms for Hierarchical Inference in Deep Learning applications at the Edge. arXiv:2304.00891  Vishnu N. Moothedath Jaya P. Champati and James Gross. 2023. Online Algorithms for Hierarchical Inference in Deep Learning applications at the Edge. arXiv:2304.00891"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/LCOMM.2020.3034992"},{"key":"e_1_3_2_1_21_1","volume-title":"Proc. Artificial Intelligence Applications and Innovations. 67--78","author":"Njor Emil","year":"2022","unstructured":"Emil Njor , Jan Madsen , and Xenofon Fafoutis . 2022 . A Primer for tinyML Predictive Maintenance: Input and Model Optimisation . In Proc. Artificial Intelligence Applications and Innovations. 67--78 . Emil Njor, Jan Madsen, and Xenofon Fafoutis. 2022. A Primer for tinyML Predictive Maintenance: Input and Model Optimisation. In Proc. Artificial Intelligence Applications and Innovations. 67--78."},{"key":"e_1_3_2_1_22_1","unstructured":"Julius Ruseckas. n.d.. EfficientNet on CIFAR10. https:\/\/juliusruseckas.github.io\/ml\/efficientnet-cifar10.html.  Julius Ruseckas. n.d.. EfficientNet on CIFAR10. https:\/\/juliusruseckas.github.io\/ml\/efficientnet-cifar10.html."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCAS.2020.3005467"},{"key":"e_1_3_2_1_24_1","volume-title":"Proc. IEEE CVPR. 4510--4520","author":"Sandler Mark","year":"2018","unstructured":"Mark Sandler , Andrew G. Howard , Menglong Zhu , Andrey Zhmoginov , and Liang-Chieh Chen . 2018 . MobileNetV2: Inverted Residuals and Linear Bottlenecks . In Proc. IEEE CVPR. 4510--4520 . Mark Sandler, Andrew G. Howard, Menglong Zhu, Andrey Zhmoginov, and Liang-Chieh Chen. 2018. MobileNetV2: Inverted Residuals and Linear Bottlenecks. In Proc. IEEE CVPR. 4510--4520."},{"key":"e_1_3_2_1_25_1","volume-title":"Le","author":"Tan Mingxing","year":"2019","unstructured":"Mingxing Tan and Quoc V . Le . 2019 . EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. In Proc. ICML, Kamalika Chaudhuri and Ruslan Salakhutdinov (Eds.), Vol. 97 . PMLR , 6105--6114. Mingxing Tan and Quoc V. Le. 2019. EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. In Proc. ICML, Kamalika Chaudhuri and Ruslan Salakhutdinov (Eds.), Vol. 97. PMLR, 6105--6114."},{"key":"e_1_3_2_1_26_1","volume-title":"Proc. ICPR. 2464--2469","author":"Teerapittayanon Surat","unstructured":"Surat Teerapittayanon , Bradley McDanel , and H.T. Kung . 2016. BranchyNet: Fast inference via early exiting from deep neural networks . In Proc. ICPR. 2464--2469 . Surat Teerapittayanon, Bradley McDanel, and H.T. Kung. 2016. BranchyNet: Fast inference via early exiting from deep neural networks. In Proc. ICPR. 2464--2469."},{"key":"e_1_3_2_1_27_1","volume-title":"Hello Edge: Keyword Spotting on Microcontrollers. CoRR abs\/1711.07128","author":"Zhang Yundong","year":"2017","unstructured":"Yundong Zhang , Naveen Suda , Liangzhen Lai , and Vikas Chandra . 2017 . Hello Edge: Keyword Spotting on Microcontrollers. CoRR abs\/1711.07128 (2017). Yundong Zhang, Naveen Suda, Liangzhen Lai, and Vikas Chandra. 2017. Hello Edge: Keyword Spotting on Microcontrollers. CoRR abs\/1711.07128 (2017)."}],"event":{"name":"NetAISys '23: 1st International Workshop on Networked AI Systems","location":"Helsinki Finland","acronym":"NetAISys '23","sponsor":["SIGMOBILE ACM Special Interest Group on Mobility of Systems, Users, Data and Computing","SIGOPS ACM Special Interest Group on Operating Systems"]},"container-title":["Proceedings of the 1st International Workshop on Networked AI Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3597062.3597278","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3597062.3597278","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:05Z","timestamp":1750182545000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3597062.3597278"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,18]]},"references-count":27,"alternative-id":["10.1145\/3597062.3597278","10.1145\/3597062"],"URL":"https:\/\/doi.org\/10.1145\/3597062.3597278","relation":{},"subject":[],"published":{"date-parts":[[2023,6,18]]},"assertion":[{"value":"2023-06-21","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}