{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,19]],"date-time":"2026-05-19T12:08:03Z","timestamp":1779192483141,"version":"3.51.4"},"reference-count":211,"publisher":"Association for Computing Machinery (ACM)","issue":"12","license":[{"start":{"date-parts":[[2026,5,19]],"date-time":"2026-05-19T00:00:00Z","timestamp":1779148800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2026,9,30]]},"abstract":"<jats:p>Large language models (LLMs) have advanced rapidly, emerging as versatile tools across fields thanks to their exceptional language understanding, generation, and reasoning capabilities. However, performing LLM inference at the network edge remains challenging due to their large memory and compute demands. This survey outlines the challenges specific to LLM edge inference and provides a comprehensive overview of recent progress, covering system architectures, model optimization and deployment, and resource management and scheduling. By synthesizing state-of-the-art techniques and mapping future directions, this survey aims to unlock the potential of LLMs in resource-constrained edge environments.<\/jats:p>","DOI":"10.1145\/3809166","type":"journal-article","created":{"date-parts":[[2026,4,24]],"date-time":"2026-04-24T11:17:08Z","timestamp":1777029428000},"page":"1-35","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Network Edge Inference for Large Language Models: Principles, Techniques, and Opportunities"],"prefix":"10.1145","volume":"58","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4183-8857","authenticated-orcid":false,"given":"Zhixiong","family":"Chen","sequence":"first","affiliation":[{"name":"Queen Mary University of London","place":["London, United Kingdom of Great Britain and Northern Ireland"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-6232-6057","authenticated-orcid":false,"given":"Bingjie","family":"Zhu","sequence":"additional","affiliation":[{"name":"Xidian University","place":["Xi'an, China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0881-3594","authenticated-orcid":false,"given":"Jiangzhou","family":"Wang","sequence":"additional","affiliation":[{"name":"Southeast University","place":["Nanjing, China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3364-8084","authenticated-orcid":false,"given":"Hyundong","family":"Shin","sequence":"additional","affiliation":[{"name":"Kyung Hee University","place":["Yongin-si, Korea (the Republic of)"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8337-5884","authenticated-orcid":false,"given":"Arumugam","family":"Nallanathan","sequence":"additional","affiliation":[{"name":"Queen Mary University of London","place":["London, United Kingdom of Great Britain and Northern Ireland"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7442-7416","authenticated-orcid":false,"given":"Dusit (Tao)","family":"Niyato","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Nanyang Technological University","place":["Singapore, Singapore"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2026,5,19]]},"reference":[{"key":"e_1_3_2_2_2","article-title":"Splitwiser: Efficient LM inference with constrained resources","author":"Aali Asad","year":"2025","unstructured":"Asad Aali, Adney Cardoza, and Melissa Capo. 2025. Splitwiser: Efficient LM inference with constrained resources. arXiv preprint arXiv:2505.03763 (2025).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_3_2","article-title":"Phi-4 technical report","author":"Abdin Marah","year":"2024","unstructured":"Marah Abdin, Jyoti Aneja, Harkirat Behl, S\u00e9bastien Bubeck, Ronen Eldan, Suriya Gunasekar, Michael Harrison, Russell J. Hewett, Mojan Javaheripi, et\u00a0al. 2024. Phi-4 technical report. arXiv preprint arXiv:2412.08905 (2024).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_4_2","article-title":"Gpt-4 technical report","author":"Achiam Josh","year":"2023","unstructured":"Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, et\u00a0al. 2023. Gpt-4 technical report. arXiv preprint arXiv:2303.08774 (2023).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_5_2","first-page":"117","volume-title":"Proc. USENIX OSDI 24","author":"Agrawal Amey","year":"2024","unstructured":"Amey Agrawal, Nitin Kedia, Ashish Panwar, Jayashree Mohan, Nipun Kwatra, Bhargav Gulavani, et\u00a0al. 2024. Taming throughput-latency tradeoff in LLM inference with sarathi-serve. In Proc. USENIX OSDI 24. 117\u2013134."},{"key":"e_1_3_2_6_2","first-page":"2357","volume-title":"Proc. Conf. North American Chapter of ACL","author":"Amini Aida","year":"2019","unstructured":"Aida Amini, Saadia Gabriel, et\u00a0al. 2019. MathQA: Towards interpretable math word problem solving with operation-based formalisms. In Proc. Conf. North American Chapter of ACL. 2357\u20132367."},{"key":"e_1_3_2_7_2","volume-title":"Core ML Tools","year":"2017","unstructured":"Apple. 2017. Core ML Tools. Retrieved from https:\/\/github.com\/apple\/coremltools"},{"key":"e_1_3_2_8_2","unstructured":"Apple. 2024. Private Cloud Compute: A new frontier for AI privacy in the cloud. Retrieved from https:\/\/security.apple.com\/blog\/private-cloud-compute\/"},{"key":"e_1_3_2_9_2","article-title":"Program synthesis with large language models","author":"Austin Jacob","year":"2021","unstructured":"Jacob Austin, Augustus Odena, Maxwell Nye, Maarten Bosma, Henryk Michalewski, David Dohan, Ellen Jiang, Carrie Cai, et\u00a0al. 2021. Program synthesis with large language models. arXiv preprint arXiv:2108.07732 (2021).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_10_2","article-title":"Beyond efficiency: A systematic survey of resource-efficient large language models","author":"Bai Guangji","year":"2024","unstructured":"Guangji Bai, Zheng Chai, Chen Ling, Shiyu Wang, Jiaying Lu, Nan Zhang, Tingwei Shi, Ziyang Yu, et\u00a0al. 2024. Beyond efficiency: A systematic survey of resource-efficient large language models. arXiv preprint arXiv:2401.00625 (2024).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_11_2","first-page":"4334","volume-title":"Proc. ACL","author":"Bai Haoli","year":"2021","unstructured":"Haoli Bai, Wei Zhang, Lu Hou, Lifeng Shang, Jin Jin, Xin Jiang, Qun Liu, Michael Lyu, and Irwin King. 2021. BinaryBERT: Pushing the limit of BERT quantization. In Proc. ACL. 4334\u20134348."},{"key":"e_1_3_2_12_2","first-page":"3119","volume-title":"Annual Meeting of the ACL","author":"Bai Yushi","year":"2024","unstructured":"Yushi Bai, Xin Lv, Jiajie Zhang, Hongchang Lyu, Jiankai Tang, Zhidian Huang, Zhengxiao Du, et\u00a0al. 2024. LongBench: A bilingual, multitask benchmark for long context understanding. In Annual Meeting of the ACL. 3119\u20133137."},{"key":"e_1_3_2_13_2","first-page":"1","volume-title":"IEEE Int. Conf. Commun. China","author":"Bao Rui","year":"2025","unstructured":"Rui Bao, Nan Xue, Yaping Sun, and Zhiyong Chen. 2025. Dynamic quality-latency aware routing for LLM inference in wireless edge-device networks. In IEEE Int. Conf. Commun. China. 1\u20136."},{"key":"e_1_3_2_14_2","volume-title":"Proc. NeurIPS Workshop: AI and ML for Next-Generation Wireless Commun. and Netw.","author":"Bhattacharjee Payel","year":"2025","unstructured":"Payel Bhattacharjee, Fengwei Tian, et\u00a0al. 2025. Conformal sparsification for bandwidth-efficient edge-cloud speculative decoding. In Proc. NeurIPS Workshop: AI and ML for Next-Generation Wireless Commun. and Netw."},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/2024716.2024718"},{"key":"e_1_3_2_16_2","first-page":"12312","volume-title":"Adv. Neural Infor. Process. Syst.","author":"Borzunov Alexander","year":"2023","unstructured":"Alexander Borzunov, Max Ryabinin, Artem Chumachenko, Dmitry Baranchuk, et\u00a0al. 2023. Distributed inference and fine-tuning of large language models over the internet. In Adv. Neural Infor. Process. Syst. 36 (2023), 12312\u201312331."},{"key":"e_1_3_2_17_2","first-page":"1877","volume-title":"Adv. Neural Infor. Process. Syst.","author":"Brown Tom","year":"2020","unstructured":"Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D. Kaplan, Prafulla Dhariwal, Arvind Neelakantan, et\u00a0al. 2020. Language models are few-shot learners. In Adv. Neural Infor. Process. Syst. 33 (2020), 1877\u20131901."},{"key":"e_1_3_2_18_2","unstructured":"Dave Burke. 2023. A New Foundation for AI on Android. Retrieved from https:\/\/android-developers.googleblog.com\/2023\/12\/a-new-foundation-for-ai-on-android.html"},{"key":"e_1_3_2_19_2","article-title":"Dsformer: Effective compression of text-transformers by dense-sparse weight factorization","author":"Chand Rahul","year":"2023","unstructured":"Rahul Chand, Yashoteja Prabhu, and Pratyush Kumar. 2023. Dsformer: Effective compression of text-transformers by dense-sparse weight factorization. arXiv preprint arXiv:2312.13211 (2023).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_20_2","volume-title":"Proc. ACL","author":"Chen Junyi","year":"2025","unstructured":"Junyi Chen, Shihao Bai, Zaijun Wang, Siyu Wu, Chuheng Du, Hailong Yang, Ruihao Gong, Shengzhong Liu, et\u00a0al. 2025. Pre \\(^{3}\\) : Enabling deterministic pushdown automata for faster structured LLM generation. In Proc. ACL."},{"key":"e_1_3_2_21_2","article-title":"Evaluating large language models trained on code","author":"Chen Mark","year":"2021","unstructured":"Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde De Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, et\u00a0al. 2021. Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374 (2021).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_22_2","first-page":"578","volume-title":"Proc. USENIX OSDI","author":"Chen Tianqi","year":"2018","unstructured":"Tianqi Chen, Thierry Moreau, Ziheng Jiang, Lianmin Zheng, Eddie Yan, Haichen Shen, Meghan Cowan, et\u00a0al. 2018. TVM: An automated end-to-end optimizing compiler for deep learning. In Proc. USENIX OSDI. 578\u2013594."},{"key":"e_1_3_2_23_2","article-title":"Internet of agents: Weaving a web of heterogeneous agents for collaborative intelligence","author":"Chen Weize","year":"2024","unstructured":"Weize Chen, Ziming You, Ran Li, Yitong Guan, Chen Qian, Chenyang Zhao, Cheng Yang, et\u00a0al. 2024. Internet of agents: Weaving a web of heterogeneous agents for collaborative intelligence. arXiv preprint arXiv:2407.07061 (2024).","journal-title":"arXiv preprint"},{"issue":"2","key":"e_1_3_2_24_2","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1631\/FITEE.2400468","article-title":"Adaptive layer splitting for wireless large language model inference in edge computing: a model-based reinforcement learning approach","volume":"26","author":"Chen Yuxuan","year":"2025","unstructured":"Yuxuan Chen et\u00a0al. 2025. Adaptive layer splitting for wireless large language model inference in edge computing: a model-based reinforcement learning approach. Frontiers of Infor. Technol. & Electronic Eng. 26, 2 (2025), 278\u2013292.","journal-title":"Frontiers of Infor. Technol. & Electronic Eng."},{"issue":"6","key":"e_1_3_2_25_2","doi-asserted-by":"crossref","first-page":"3368","DOI":"10.1109\/TCOMM.2023.3261383","article-title":"Knowledge-aided federated learning for energy-limited wireless networks","volume":"71","author":"Chen Zhixiong","year":"2023","unstructured":"Zhixiong Chen, Wenqiang Yi, Yuanwei Liu, and Arumugam Nallanathan. 2023. Knowledge-aided federated learning for energy-limited wireless networks. IEEE Trans. Commun. 71, 6 (2023), 3368\u20133386.","journal-title":"IEEE Trans. Commun."},{"key":"e_1_3_2_26_2","article-title":"Pact: Parameterized clipping activation for quantized neural networks","author":"Choi Jungwook","year":"2018","unstructured":"Jungwook Choi, Zhuo Wang, Swagath Venkataramani, Pierce I-Jen Chuang, et\u00a0al. 2018. Pact: Parameterized clipping activation for quantized neural networks. arXiv preprint arXiv:1805.06085 (2018).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_27_2","article-title":"Think you have solved question answering? Try arc, the ai2 reasoning challenge","author":"Clark Peter","year":"2018","unstructured":"Peter Clark, Isaac Cowhey, Oren Etzioni, Tushar Khot, Ashish Sabharwal, et\u00a0al. 2018. Think you have solved question answering? Try arc, the ai2 reasoning challenge. arXiv preprint arXiv:1803.05457 (2018).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_28_2","article-title":"Training verifiers to solve math word problems","author":"Cobbe Karl","year":"2021","unstructured":"Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, et\u00a0al. 2021. Training verifiers to solve math word problems. arXiv preprint arXiv:2110.14168 (2021).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_29_2","article-title":"Skipdecode: Autoregressive skip decoding with batching and caching for efficient llm inference","author":"Corro Luciano Del","year":"2023","unstructured":"Luciano Del Corro, Allie Del Giorno, Sahaj Agarwal, Bin Yu, et\u00a0al. 2023. Skipdecode: Autoregressive skip decoding with batching and caching for efficient llm inference. arXiv preprint arXiv:2307.02628 (2023).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_30_2","first-page":"30318","volume-title":"Proc. Adv. Neural Infor. Process. Syst. (NeurIPS)","author":"Dettmers Tim","year":"2022","unstructured":"Tim Dettmers, Mike Lewis, Younes Belkada, and Luke Zettlemoyer. 2022. GPT3.int8(): 8-bit Matrix Multiplication for Transformers at Scale. In Proc. Adv. Neural Infor. Process. Syst. (NeurIPS) 35 (2022), 30318\u201330332."},{"key":"e_1_3_2_31_2","article-title":"Spqr: A sparse-quantized representation for near-lossless llm weight compression","author":"Dettmers Tim","year":"2023","unstructured":"Tim Dettmers, Ruslan Svirschevski, Vage Egiazarian, Denis Kuznedelev, et\u00a0al. 2023. Spqr: A sparse-quantized representation for near-lossless llm weight compression. arXiv preprint arXiv:2306.03078 (2023).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_32_2","first-page":"4171","volume-title":"Proc. ACL","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proc. ACL. 4171\u20134186."},{"key":"e_1_3_2_33_2","first-page":"1","volume-title":"Proc. Int. Conf. Learn. Represent. (ICLR)","author":"Ding Dujian","year":"2024","unstructured":"Dujian Ding, Ankur Mallick, Chi Wang, Robert Sim, Subhabrata Mukherjee, Victor Ruhle, et\u00a0al. 2024. Hybrid llm: Cost-efficient and quality-aware query routing. In Proc. Int. Conf. Learn. Represent. (ICLR). 1\u201323."},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","unstructured":"Guangyao Ding Huiguo Gao Shengli Liu and Guanding Yu. 2026. Multi-stage semantic communication for low-latency edge inference. IEEE Transactions on Cognitive Communications and Networking 12 (2026) 267\u2013282. DOI:10.1109\/TCCN.2025.3558066","DOI":"10.1109\/TCCN.2025.3558066"},{"key":"e_1_3_2_35_2","first-page":"1","volume-title":"Proc. IEEE Int. Conf. High Perf. Comput. and Commun. (HPCC)","author":"Ding Yu","year":"2025","unstructured":"Yu Ding, Jingxuan Zhao, Zhengong Cai, et\u00a0al. 2025. Adaptoserve: An efficient system for supporting adaptive chunked-prefills in LLM inference. In Proc. IEEE Int. Conf. High Perf. Comput. and Commun. (HPCC). 1\u20139."},{"key":"e_1_3_2_36_2","article-title":"A survey on in-context learning","author":"Dong Qingxiu","year":"2022","unstructured":"Qingxiu Dong, Lei Li, Damai Dai, Ce Zheng, Jingyuan Ma, Rui Li, Heming Xia, Jingjing Xu, Zhiyong Wu, Tianyu Liu, et\u00a0al. 2022. A survey on in-context learning. arXiv preprint arXiv:2301.00234 (2022).","journal-title":"arXiv preprint"},{"issue":"7","key":"e_1_3_2_37_2","doi-asserted-by":"crossref","first-page":"994","DOI":"10.1109\/TCAD.2012.2185930","article-title":"NVSim: A circuit-level performance, energy, and area model for emerging nonvolatile memory","volume":"31","author":"Dong Xiangyu","year":"2012","unstructured":"Xiangyu Dong, Cong Xu, et\u00a0al. 2012. NVSim: A circuit-level performance, energy, and area model for emerging nonvolatile memory. IEEE Trans. Computer-Aided Design Integr. Circuits Syst. 31, 7 (2012), 994\u20131007.","journal-title":"IEEE Trans. Computer-Aided Design Integr. Circuits Syst."},{"key":"e_1_3_2_38_2","first-page":"12622","volume-title":"Proc. ACL","author":"Elhoushi Mostafa","year":"2024","unstructured":"Mostafa Elhoushi, Akshat Shrivastava, Diana Liskovich, Basil Hosmer, Bram Wasti, Liangzhen Lai, Anas Mahmoud, et\u00a0al. 2024. Layerskip: Enabling early exit inference and self-speculative decoding. In Proc. ACL. 12622\u201312642."},{"key":"e_1_3_2_39_2","article-title":"Learned step size quantization","author":"Esser Steven K.","year":"2019","unstructured":"Steven K. Esser, Jeffrey L. McKinstry, Deepika Bablani, Rathinakumar Appuswamy, and Dharmendra S. Modha. 2019. Learned step size quantization. arXiv preprint arXiv:1902.08153 (2019).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_40_2","volume-title":"Mobile Edge Computing; Market Acceleration; MEC Metrics Best Practice and Guidelines","author":"ISG ETSI","year":"2017","unstructured":"ETSI ISG. 2017. Mobile Edge Computing; Market Acceleration; MEC Metrics Best Practice and Guidelines. ETSI GS MEC-IEG 006 V1.1.1. ETSI. Retrieved from https:\/\/www.etsi.org\/deliver\/etsi_gs\/mec-ieg\/001_099\/006\/01.01.01_60\/gs_mec-ieg006v010101p.pdf"},{"key":"e_1_3_2_41_2","first-page":"431","volume-title":"Proceedings of the 26th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming","author":"Fan Shiqing","year":"2021","unstructured":"Shiqing Fan, Yi Rong, et\u00a0al. 2021. DAPPLE: A pipelined data parallel approach for training large models. In Proceedings of the 26th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming. 431\u2013445."},{"key":"e_1_3_2_42_2","first-page":"1283","volume-title":"Proc. Annual Int. Symp. Comput. Arch. (ISCA)","author":"Feng Jingqi","year":"2025","unstructured":"Jingqi Feng, Yukai Huang, Rui Zhang, et\u00a0al. 2025. WindServe: Efficient phase-disaggregated LLM serving with stream-based dynamic scheduling. In Proc. Annual Int. Symp. Comput. Arch. (ISCA). 1283\u20131295."},{"key":"e_1_3_2_43_2","first-page":"6161","volume-title":"Proc. IEEE Int. Conf. Commun.","author":"Feng Zideng","year":"2025","unstructured":"Zideng Feng, Lu Lu, Qin Li, Yuhao Chai, Zhenyu Zhang, et\u00a0al. 2025. Distributed inference optimization for large language model in edge-cloud collaborative networks. In Proc. IEEE Int. Conf. Commun. 6161\u20136166."},{"key":"e_1_3_2_44_2","first-page":"10323","volume-title":"Proc. Int. Conf. Mach. Learn. (ICML)","author":"Frantar Elias","year":"2023","unstructured":"Elias Frantar and Dan Alistarh. 2023. SparseGPT: Massive language models can be accurately pruned in one-shot. In Proc. Int. Conf. Mach. Learn. (ICML) 202 (2023), 10323\u201310337."},{"key":"e_1_3_2_45_2","doi-asserted-by":"crossref","unstructured":"Aadil Gani Ganie. 2025. Securing AI agents: Implementing role-based access control for industrial applications. arXiv:2509.11431 (2025).","DOI":"10.2139\/ssrn.5204283"},{"key":"e_1_3_2_46_2","first-page":"3356","volume-title":"Proc. EMNLP","author":"Gehman Samuel","year":"2020","unstructured":"Samuel Gehman, Suchin Gururangan, Maarten Sap, et\u00a0al. 2020. RealToxicityPrompts: Evaluating neural toxic degeneration in language models. In Proc. EMNLP. 3356\u20133369."},{"key":"e_1_3_2_47_2","volume-title":"llama.cpp","author":"Gerganov Georgi","year":"2023","unstructured":"Georgi Gerganov. 2023. llama.cpp. Retrieved from https:\/\/github.com\/ggml-org\/llama.cpp"},{"key":"e_1_3_2_48_2","article-title":"Transformer feed-forward layers build predictions by promoting concepts in the vocabulary space","author":"Geva Mor","year":"2022","unstructured":"Mor Geva, Avi Caciularu, Kevin Ro Wang, and Yoav Goldberg. 2022. Transformer feed-forward layers build predictions by promoting concepts in the vocabulary space. arXiv preprint arXiv:2203.14680 (2022).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_49_2","article-title":"Mask-predict: Parallel decoding of conditional masked language models","author":"Ghazvininejad Marjan","year":"2019","unstructured":"Marjan Ghazvininejad, Omer Levy, Yinhan Liu, and Luke Zettlemoyer. 2019. Mask-predict: Parallel decoding of conditional masked language models. arXiv preprint arXiv:1904.09324 (2019).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_50_2","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511841224","volume-title":"Wireless Communications","author":"Goldsmith Andrea","year":"2005","unstructured":"Andrea Goldsmith. 2005. Wireless Communications. Cambridge University Press."},{"key":"e_1_3_2_51_2","article-title":"TokenWeave: Efficient Compute-Communication Overlap for Distributed LLM Inference","author":"Gond Raja","year":"2025","unstructured":"Raja Gond, Nipun Kwatra, and Ramachandran Ramjee. 2025. TokenWeave: Efficient Compute-Communication Overlap for Distributed LLM Inference. arXiv preprint arXiv:2505.11329 (2025).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_52_2","unstructured":"Suchi Gopal. 2024. The AI Gold Rush: Can Utilities Keep Up with the Energy Demand? Retrieved from https:\/\/floodlightglobal.com\/the-ai-gold-rush-can-utilities-keep-up-with-the-energy-demand\/"},{"key":"e_1_3_2_53_2","article-title":"Fully non-autoregressive neural machine translation: Tricks of the trade","author":"Gu Jiatao","year":"2020","unstructured":"Jiatao Gu and Xiang Kong. 2020. Fully non-autoregressive neural machine translation: Tricks of the trade. arXiv preprint arXiv:2012.15833 (2020).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_54_2","volume-title":"Proc. Int. Conf. Learn. Represent. (ICLR)","author":"Gu Yuxian","year":"2024","unstructured":"Yuxian Gu, Li Dong, Furu Wei, and Minlie Huang. 2024. MiniLLM: Knowledge distillation of large language models. In Proc. Int. Conf. Learn. Represent. (ICLR)."},{"key":"e_1_3_2_55_2","volume-title":"Proc. Annual Int. Symp. Comput. Arch.","author":"Guo Cong","year":"2023","unstructured":"Cong Guo, Jiaming Tang, Weiming Hu, Jingwen Leng, Chen Zhang, et\u00a0al. 2023. OliVe: Accelerating large language models via hardware-friendly outlier-victim pair quantization. In Proc. Annual Int. Symp. Comput. Arch."},{"key":"e_1_3_2_56_2","article-title":"DeepSeek-Coder: When the large language model meets programming\u2013the rise of code intelligence","author":"Guo Daya","year":"2024","unstructured":"Daya Guo, Qihao Zhu, Dejian Yang, Zhenda Xie, et\u00a0al. 2024. DeepSeek-Coder: When the large language model meets programming\u2013the rise of code intelligence. arXiv preprint arXiv:2401.14196 (2024).","journal-title":"arXiv preprint"},{"issue":"01","key":"e_1_3_2_57_2","doi-asserted-by":"crossref","first-page":"3723","DOI":"10.1609\/aaai.v33i01.33013723","article-title":"Non-autoregressive neural machine translation with enhanced decoder input","volume":"33","author":"Guo Junliang","year":"2019","unstructured":"Junliang Guo, Xu Tan, Di He, Tao Qin, Linli Xu, and Tie-Yan Liu. 2019. Non-autoregressive neural machine translation with enhanced decoder input. Proc. AAAI 33, 01 (2019), 3723\u20133730.","journal-title":"Proc. AAAI"},{"key":"e_1_3_2_58_2","first-page":"36","volume-title":"Proc. EdgeFM","author":"Hao Zixu","year":"2024","unstructured":"Zixu Hao et\u00a0al. 2024. Hybrid SLM and LLM for edge-cloud collaborative inference. In Proc. EdgeFM. 36\u201341."},{"issue":"12","key":"e_1_3_2_59_2","doi-asserted-by":"crossref","first-page":"11253","DOI":"10.1109\/TMC.2024.3415661","article-title":"Large language models (LLMs) inference offloading and resource allocation in cloud-edge computing: An active inference approach","volume":"23","author":"He Ying","year":"2024","unstructured":"Ying He et\u00a0al. 2024. Large language models (LLMs) inference offloading and resource allocation in cloud-edge computing: An active inference approach. IEEE Trans. Mobile Comput. 23, 12 (2024), 11253\u201311264.","journal-title":"IEEE Trans. Mobile Comput."},{"issue":"14","key":"e_1_3_2_60_2","first-page":"527","article-title":"Network simulations with the ns-3 simulator","volume":"14","author":"Henderson Thomas R.","year":"2008","unstructured":"Thomas R. Henderson, Mathieu Lacage, George F. Riley, Craig Dowell, and Joseph Kopena. 2008. Network simulations with the ns-3 simulator. SIGCOMM Demonstration 14, 14 (2008), 527.","journal-title":"SIGCOMM Demonstration"},{"key":"e_1_3_2_61_2","volume-title":"Proc. Int. Conf. Learn. Represent. (ICLR)","author":"Hendrycks Dan","year":"2021","unstructured":"Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. 2021. Measuring massive multitask language understanding. In Proc. Int. Conf. Learn. Represent. (ICLR)."},{"key":"e_1_3_2_62_2","volume-title":"Proc. Adv. Neural Infor. Process. Syst. (NeurIPS)","author":"Hermann Karl Moritz","year":"2015","unstructured":"Karl Moritz Hermann, Tomas Kocisky, Edward Grefenstette, Lasse Espeholt, et\u00a0al. 2015. Teaching machines to read and comprehend. In Proc. Adv. Neural Infor. Process. Syst. (NeurIPS), Vol. 28."},{"key":"e_1_3_2_63_2","first-page":"14852","volume-title":"Proc. ACL","author":"Ho Namgyu","year":"2023","unstructured":"Namgyu Ho et\u00a0al. 2023. Large language models are reasoning teachers. In Proc. ACL. 14852\u201314882."},{"key":"e_1_3_2_64_2","article-title":"Deepspeed-fastgen: High-throughput text generation for llms via mii and deepspeed-inference","author":"Holmes Connor","year":"2024","unstructured":"Connor Holmes, Masahiro Tanaka, Michael Wyatt, Ammar Ahmad Awan, et\u00a0al. 2024. Deepspeed-fastgen: High-throughput text generation for llms via mii and deepspeed-inference. arXiv preprint arXiv:2401.08671 (2024).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_65_2","article-title":"semi-pd: Towards efficient llm serving via phase-wise disaggregated computation and unified storage","author":"Hong Ke","year":"2025","unstructured":"Ke Hong, Lufang Chen, Zhong Wang, Xiuhong Li, et\u00a0al. 2025. semi-pd: Towards efficient llm serving via phase-wise disaggregated computation and unified storage. arXiv preprint arXiv:2504.19867 (2025).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_66_2","first-page":"1270","volume-title":"Adv. Neural Infor. Process. Syst. (NeurIPS)","author":"Hooper Coleman","year":"2024","unstructured":"Coleman Hooper, Sehoon Kim, Hiva Mohammadzadeh, et\u00a0al. 2024. KVQuant: Towards 10 million context length LLM inference with KV cache quantization. In Adv. Neural Infor. Process. Syst. (NeurIPS) 37 (2024), 1270\u20131303."},{"key":"e_1_3_2_67_2","volume-title":"Proc. Conf. Language Modeling","author":"Hsieh Cheng-Ping","year":"2024","unstructured":"Cheng-Ping Hsieh, Simeng Sun, Samuel Kriman, Shantanu Acharya, Dima Rekesh, Fei Jia, and Boris Ginsburg. 2024. RULER: What\u2019s the Real Context Size of Your Long-Context Language Models?. In Proc. Conf. Language Modeling."},{"key":"e_1_3_2_68_2","first-page":"298","volume-title":"Proc. DSD","author":"Hu Yang","year":"2022","unstructured":"Yang Hu, Connor Imes, Xuanang Zhao, Souvik Kundu, Peter A. Beerel, et\u00a0al. 2022. PipeEdge: Pipeline parallelism for large-scale model inference on heterogeneous edge devices. In Proc. DSD. 298\u2013307."},{"key":"e_1_3_2_69_2","article-title":"Pipeline parallelism for inference on heterogeneous edge computing","author":"Hu Yang","year":"2021","unstructured":"Yang Hu, Connor Imes, Xuanang Zhao, Souvik Kundu, Peter A. Beerel, Stephen P. Crago, and John Paul N. Walters. 2021. Pipeline parallelism for inference on heterogeneous edge computing. arXiv preprint arXiv:2110.14895 (2021).","journal-title":"arXiv preprint"},{"issue":"7","key":"e_1_3_2_70_2","doi-asserted-by":"crossref","first-page":"2195","DOI":"10.1109\/TC.2025.3558009","article-title":"TightLLM: Maximizing throughput for LLM inference via adaptive offloading policy","volume":"74","author":"Hu Yitao","year":"2025","unstructured":"Yitao Hu, Xiulong Liu, Guotao Yang, Linxuan Li, Kai Zeng, et\u00a0al. 2025. TightLLM: Maximizing throughput for LLM inference via adaptive offloading policy. IEEE Trans. Comput. 74, 7 (2025), 2195\u20132209.","journal-title":"IEEE Trans. Comput."},{"issue":"2","key":"e_1_3_2_71_2","doi-asserted-by":"crossref","first-page":"964","DOI":"10.1109\/TGCN.2021.3058657","article-title":"Reconfigurable intelligent surface for green edge inference","volume":"5","author":"Hua Sheng","year":"2021","unstructured":"Sheng Hua, Yong Zhou, Kai Yang, Yuanming Shi, and Kunlun Wang. 2021. Reconfigurable intelligent surface for green edge inference. IEEE Trans. Green Commun. and Netw. 5, 2 (2021), 964\u2013979.","journal-title":"IEEE Trans. Green Commun. and Netw."},{"issue":"8","key":"e_1_3_2_72_2","doi-asserted-by":"crossref","first-page":"4157","DOI":"10.1109\/TWC.2019.2922609","article-title":"Reconfigurable intelligent surfaces for energy efficiency in wireless communication","volume":"18","author":"Huang Chongwen","year":"2019","unstructured":"Chongwen Huang, Alessio Zappone, et\u00a0al. 2019. Reconfigurable intelligent surfaces for energy efficiency in wireless communication. IEEE Trans. Wireless Commun. 18, 8 (2019), 4157\u20134170.","journal-title":"IEEE Trans. Wireless Commun."},{"key":"e_1_3_2_73_2","volume-title":"Optimum","author":"Face Hugging","year":"2021","unstructured":"Hugging Face. 2021. Optimum. Retrieved from https:\/\/github.com\/huggingface\/optimum"},{"key":"e_1_3_2_74_2","article-title":"Qwen2. 5-coder technical report","author":"Hui Binyuan","year":"2024","unstructured":"Binyuan Hui, Jian Yang, Zeyu Cui, Jiaxi Yang, Dayiheng Liu, Lei Zhang, Tianyu Liu, Jiajun Zhang, Bowen Yu, Keming Lu, et\u00a0al. 2024. Qwen2. 5-coder technical report. arXiv preprint arXiv:2409.12186 (2024).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_75_2","volume-title":"Proc. IEEE Conf. Comput. Vis. and Pattern Recog. (CVPR)","author":"Jacob Benoit","year":"2018","unstructured":"Benoit Jacob, Skirmantas Kligys, et\u00a0al. 2018. Quantization and training of neural networks for efficient integer-arithmetic-only inference. In Proc. IEEE Conf. Comput. Vis. and Pattern Recog. (CVPR)."},{"key":"e_1_3_2_76_2","article-title":"Mistral 7B","author":"Jiang Albert Q.","year":"2023","unstructured":"Albert Q. Jiang, Alexandre Sablayrolles, et\u00a0al. 2023. Mistral 7B. arXiv preprint arXiv:2310.06825 (2023).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_77_2","article-title":"Mixtral of experts","author":"Jiang Albert Q.","year":"2024","unstructured":"Albert Q. Jiang, Alexandre Sablayrolles, et\u00a0al. 2024. Mixtral of experts. arXiv preprint arXiv:2401.04088 (2024).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_78_2","article-title":"Neo: Saving gpu memory crisis with cpu offloading for online llm inference","author":"Jiang Xuanlin","year":"2024","unstructured":"Xuanlin Jiang, Yang Zhou, Shiyi Cao, Ion Stoica, and Minlan Yu. 2024. Neo: Saving gpu memory crisis with cpu offloading for online llm inference. arXiv preprint arXiv:2411.01142 (2024).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_79_2","first-page":"3134","volume-title":"Proc. Conf. Empirical Methods in Natural Language Process.","author":"Jiang Yuxin","year":"2023","unstructured":"Yuxin Jiang, Chunkit Chan, Mingyang Chen, and Wei Wang. 2023. Lion: Adversarial distillation of proprietary large language models. In Proc. Conf. Empirical Methods in Natural Language Process. 3134\u20133154."},{"key":"e_1_3_2_80_2","first-page":"21946","volume-title":"Proc. Int. Conf. Machine Learn. (ICML)","author":"Jiang Youhe","year":"2024","unstructured":"Youhe Jiang, Ran Yan, Xiaozhe Yao, Yang Zhou, et\u00a0al. 2024. HexGen: Generative inference of large language model over heterogeneous environment. In Proc. Int. Conf. Machine Learn. (ICML) 235 (2024), 21946\u201321961."},{"key":"e_1_3_2_81_2","article-title":"Large language model partitioning for low-latency inference at the edge","author":"Kafetzis Dimitrios","year":"2025","unstructured":"Dimitrios Kafetzis, Ramin Khalili, and Iordanis Koutsopoulos. 2025. Large language model partitioning for low-latency inference at the edge. arXiv preprint arXiv:2505.02533 (2025).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_82_2","article-title":"Scaling laws for neural language models","author":"Kaplan Jared","year":"2020","unstructured":"Jared Kaplan et\u00a0al. 2020. Scaling laws for neural language models. arXiv preprint arXiv:2001.08361 (2020).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_83_2","article-title":"A comprehensive survey of accelerated generation techniques in large language models","author":"Khoshnoodi Mahsa","year":"2024","unstructured":"Mahsa Khoshnoodi, Vinija Jain, Mingye Gao, Malavika Srikanth, and Aman Chadha. 2024. A comprehensive survey of accelerated generation techniques in large language models. arXiv preprint arXiv:2405.13019 (2024).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_84_2","article-title":"Quantizing deep convolutional networks for efficient inference: A whitepaper","author":"Krishnamoorthi Raghuraman","year":"2018","unstructured":"Raghuraman Krishnamoorthi. 2018. Quantizing deep convolutional networks for efficient inference: A whitepaper. arXiv preprint arXiv:1806.08342 (2018).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_85_2","first-page":"65597","volume-title":"Proc. Adv. Neural Infor. Process. Syst. (NeurIPS)","author":"Kurti\u0107 Eldar","year":"2023","unstructured":"Eldar Kurti\u0107, Elias Frantar, and Dan Alistarh. 2023. ZipLM: Inference-aware structured pruning of language models. In Proc. Adv. Neural Infor. Process. Syst. (NeurIPS) 36 (2023), 65597\u201365617."},{"key":"e_1_3_2_86_2","first-page":"611\u2013\u2013626","volume-title":"Proc. SOSP","author":"Kwon Woosuk","year":"2023","unstructured":"Woosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng, Lianmin Zheng, et\u00a0al. 2023. Efficient memory management for large language model serving with pagedattention. In Proc. SOSP. 611\u2013\u2013626."},{"key":"e_1_3_2_87_2","article-title":"Albert: A lite bert for self-supervised learning of language representations","author":"Lan Zhenzhong","year":"2019","unstructured":"Zhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, and Radu Soricut. 2019. Albert: A lite bert for self-supervised learning of language representations. arXiv preprint arXiv:1909.11942 (2019).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_88_2","volume-title":"Proc. ACM SIGCOMM Workshop on Hot Topics in Netw.","author":"Lantz Bob","year":"2010","unstructured":"Bob Lantz, Brandon Heller, and Nick McKeown. 2010. A network in a laptop: Rapid prototyping for software-defined networks. In Proc. ACM SIGCOMM Workshop on Hot Topics in Netw."},{"issue":"2","key":"e_1_3_2_89_2","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1109\/MCOM.2014.6736761","article-title":"Massive MIMO for next generation wireless systems","volume":"52","author":"Larsson Erik G.","year":"2014","unstructured":"Erik G. Larsson, Ove Edfors, Fredrik Tufvesson, and Thomas L. Marzetta. 2014. Massive MIMO for next generation wireless systems. IEEE Commun. Mag. 52, 2 (2014), 186\u2013195.","journal-title":"IEEE Commun. Mag."},{"key":"e_1_3_2_90_2","article-title":"Deterministic non-autoregressive neural sequence modeling by iterative refinement","author":"Lee Jason","year":"2018","unstructured":"Jason Lee, Elman Mansimov, and Kyunghyun Cho. 2018. Deterministic non-autoregressive neural sequence modeling by iterative refinement. arXiv preprint arXiv:1802.06901 (2018).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_91_2","first-page":"1","volume-title":"Proc. IEEE High Perf. Extreme Comput. Conf. (HPEC)","author":"Li Baolin","year":"2024","unstructured":"Baolin Li, Yankai Jiang, Vijay Gadepally, and Devesh Tiwari. 2024. LLM inference serving: Survey of recent advances and opportunities. In Proc. IEEE High Perf. Extreme Comput. Conf. (HPEC). 1\u20138."},{"key":"e_1_3_2_92_2","first-page":"21799","volume-title":"Proc. Conf. Empirical Methods in Natural Language Process.","author":"Li Baolin","year":"2024","unstructured":"Baolin Li, Yankai Jiang, Vijay Gadepally, and Devesh Tiwari. 2024. Sprout: Green generative AI with carbon-efficient LLM inference. In Proc. Conf. Empirical Methods in Natural Language Process. 21799\u201321813."},{"key":"e_1_3_2_93_2","article-title":"A survey on large language model acceleration based on kv cache management","author":"Li Haoyang","year":"2024","unstructured":"Haoyang Li, Yiming Li, Anxin Tian, Tianhao Tang, and othres. 2024. A survey on large language model acceleration based on kv cache management. arXiv preprint arXiv:2412.19442 (2024).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_94_2","article-title":"Cascadebert: Accelerating inference of pre-trained language models via calibrated complete models cascade","author":"Li Lei","year":"2020","unstructured":"Lei Li, Yankai Lin, Deli Chen, Shuhuai Ren, Peng Li, Jie Zhou, and Xu Sun. 2020. Cascadebert: Accelerating inference of pre-trained language models via calibrated complete models cascade. arXiv preprint arXiv:2012.14682 (2020).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_95_2","first-page":"20852","volume-title":"Proc. Int. Conf. Mach. Learn. (ICML)","author":"Liang Chen","year":"2023","unstructured":"Chen Liang, Simiao Zuo, Qingru Zhang, et\u00a0al. 2023. Less is more: Task-aware layer-wise distillation for language model compression. In Proc. Int. Conf. Mach. Learn. (ICML) 202 (2023), 20852\u201320867."},{"key":"e_1_3_2_96_2","first-page":"87","volume-title":"Proc. Mach. Learn. Syst. (MLSys)","author":"Lin Ji","year":"2024","unstructured":"Ji Lin, Jiaming Tang, Haotian Tang, Shang Yang, and othres. 2024. AWQ: Activation-aware weight quantization for on-device LLM compression and acceleration. In Proc. Mach. Learn. Syst. (MLSys) 6 (2024), 87\u2013100."},{"key":"e_1_3_2_97_2","first-page":"3214","volume-title":"Proc. ACL","author":"Lin Stephanie","year":"2022","unstructured":"Stephanie Lin, Jacob Hilton, and Owain Evans. 2022. TruthfulQA: Measuring how models mimic human falsehoods. In Proc. ACL. 3214\u20133252."},{"key":"e_1_3_2_98_2","article-title":"Deepseek-v3 technical report","author":"Liu Aixin","year":"2024","unstructured":"Aixin Liu, Bei Feng, Bing Xue, Bingxuan Wang, Bochao Wu, Chengda Lu, Chenggang Zhao, Chengqi Deng, Chenyu Zhang, Chong Ruan, et\u00a0al. 2024. Deepseek-v3 technical report. arXiv preprint arXiv:2412.19437 (2024).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_99_2","first-page":"26296","volume-title":"Proc. IEEE CVPR","author":"Liu Haotian","year":"2024","unstructured":"Haotian Liu, Chunyuan Li, Yuheng Li, and Yong Jae Lee. 2024. Improved baselines with visual instruction tuning. In Proc. IEEE CVPR. 26296\u201326306."},{"key":"e_1_3_2_100_2","article-title":"Roberta: A robustly optimized bert pretraining approach","author":"Liu Yinhan","year":"2019","unstructured":"Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, et\u00a0al. 2019. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692 (2019).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_101_2","article-title":"Llm-qat: Data-free quantization aware training for large language models","author":"Liu Zechun","year":"2023","unstructured":"Zechun Liu, Barlas Oguz, Changsheng Zhao, Ernie Chang, Pierre Stock, et\u00a0al. 2023. Llm-qat: Data-free quantization aware training for large language models. arXiv preprint arXiv:2305.17888 (2023).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_102_2","first-page":"22631","volume-title":"Proc. Int. Conf. on Mach. Learn. (ICML)","author":"Longpre Shayne","year":"2023","unstructured":"Shayne Longpre, Le Hou, Tu Vu, Albert Webson, et\u00a0al. 2023. The flan collection: Designing data and methods for effective instruction tuning. In Proc. Int. Conf. on Mach. Learn. (ICML) 202 (2023), 22631\u201322648."},{"issue":"5","key":"e_1_3_2_103_2","doi-asserted-by":"crossref","first-page":"742","DOI":"10.1109\/JSTSP.2014.2317671","article-title":"An overview of massive MIMO: Benefits and challenges","volume":"8","author":"Lu Lu","year":"2014","unstructured":"Lu Lu, Geoffrey Ye Li, A. Lee Swindlehurst, Alexei Ashikhmin, and Rui Zhang. 2014. An overview of massive MIMO: Benefits and challenges. IEEE J. Sel. Topics in Signal Process. 8, 5 (2014), 742\u2013758.","journal-title":"IEEE J. Sel. Topics in Signal Process."},{"key":"e_1_3_2_104_2","first-page":"21702","volume-title":"Proc. Adv. Neural Infor. Process. Syst. (NeurIPS)","author":"Ma Xinyin","year":"2023","unstructured":"Xinyin Ma, Gongfan Fang, and Xinchao Wang. 2023. LLM-pruner: On the structural pruning of large language models. In Proc. Adv. Neural Infor. Process. Syst. (NeurIPS) 36 (2023), 21702\u201321720."},{"key":"e_1_3_2_105_2","doi-asserted-by":"publisher","DOI":"10.1145\/3527155"},{"issue":"2","key":"e_1_3_2_106_2","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/MM.2020.2974843","article-title":"MLPerf: An industry standard benchmark suite for machine learning performance","volume":"40","author":"Mattson Peter","year":"2020","unstructured":"Peter Mattson, Vijay Janapa Reddi, Christine Cheng, Cody Coleman, et\u00a0al. 2020. MLPerf: An industry standard benchmark suite for machine learning performance. IEEE Micro 40, 2 (2020), 8\u201316.","journal-title":"IEEE Micro"},{"key":"e_1_3_2_107_2","first-page":"586","volume-title":"Proc. ASPLOS","author":"Mei Yixuan","year":"2025","unstructured":"Yixuan Mei, Yonghao Zhuang, Xupeng Miao, Juncheng Yang, Zhihao Jia, and Rashmi Vinayak. 2025. Helix: Serving large language models over heterogeneous GPUs and network via max-flow. In Proc. ASPLOS 1 (2025), 586\u2013602."},{"issue":"1","key":"e_1_3_2_108_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3754448","article-title":"Towards efficient generative large language model serving: A survey from algorithms to systems","volume":"58","author":"Miao Xupeng","year":"2025","unstructured":"Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, Xinhao Cheng, Hongyi Jin, et\u00a0al. 2025. Towards efficient generative large language model serving: A survey from algorithms to systems. ACM Comput. Surv. 58, 1 (2025), 1\u201337.","journal-title":"ACM Comput. Surv."},{"key":"e_1_3_2_109_2","first-page":"932","volume-title":"Proc. ASPLOS","author":"Miao Xupeng","year":"2024","unstructured":"Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, and othres. 2024. SpecInfer: Accelerating large language model serving with tree-based speculative inference and verification. In Proc. ASPLOS. 932\u2013949."},{"issue":"6689","key":"e_1_3_2_110_2","doi-asserted-by":"crossref","first-page":"eado7069","DOI":"10.1126\/science.ado7069","article-title":"Debates on the nature of artificial general intelligence","volume":"383","author":"Mitchell Melanie","year":"2024","unstructured":"Melanie Mitchell. 2024. Debates on the nature of artificial general intelligence. Science 383, 6689 (2024), eado7069.","journal-title":"Science"},{"key":"e_1_3_2_111_2","article-title":"Splitllm: Collaborative inference of llms for model placement and throughput optimization","author":"Mudvari Akrit","year":"2024","unstructured":"Akrit Mudvari, Yuang Jiang, and Leandros Tassiulas. 2024. Splitllm: Collaborative inference of llms for model placement and throughput optimization. arXiv preprint arXiv:2410.10759 (2024).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_112_2","first-page":"5356","volume-title":"Proc. ACL","author":"Nadeem Moin","year":"2021","unstructured":"Moin Nadeem, Anna Bethke, and Siva Reddy. 2021. StereoSet: Measuring stereotypical bias in pretrained language models. In Proc. ACL, Chengqing Zong, Fei Xia, Wenjie Li, and Roberto Navigli (Eds.). 5356\u20135371."},{"key":"e_1_3_2_113_2","first-page":"1797","volume-title":"Conf. Empirical Methods in Natural Language Process.","author":"Narayan Shashi","year":"2018","unstructured":"Shashi Narayan and othres. 2018. Don\u2019t give me the details, just the summary! topic-aware convolutional neural networks for extreme summarization. In Conf. Empirical Methods in Natural Language Process. 1797\u20131807."},{"issue":"10","key":"e_1_3_2_114_2","doi-asserted-by":"crossref","first-page":"8581","DOI":"10.1109\/TWC.2022.3167263","article-title":"FedFog: Network-aware optimization of federated learning over wireless fog-cloud systems","volume":"21","author":"Nguyen Van-Dinh","year":"2022","unstructured":"Van-Dinh Nguyen, Symeon Chatzinotas, et\u00a0al. 2022. FedFog: Network-aware optimization of federated learning over wireless fog-cloud systems. IEEE Trans. Wireless Commun. 21, 10 (2022), 8581\u20138599.","journal-title":"IEEE Trans. Wireless Commun."},{"key":"e_1_3_2_115_2","volume-title":"FasterTransformer","author":"Corporation NVIDIA","year":"2021","unstructured":"NVIDIA Corporation. 2021. FasterTransformer. Retrieved from https:\/\/github.com\/NVIDIA\/FasterTransformer"},{"key":"e_1_3_2_116_2","volume-title":"TensorRT-LLM: A TensorRT Toolbox for Optimized Large Language Model Inference","author":"Corporation NVIDIA","year":"2023","unstructured":"NVIDIA Corporation. 2023. TensorRT-LLM: A TensorRT Toolbox for Optimized Large Language Model Inference. Retrieved from https:\/\/github.com\/NVIDIA\/TensorRT-LLM"},{"key":"e_1_3_2_117_2","article-title":"Get started with ONNX Runtime Mobile","author":"Runtime ONNX","year":"2025","unstructured":"ONNX Runtime. 2025. Get started with ONNX Runtime Mobile. Retrieved from https:\/\/onnxruntime.ai\/docs\/get-started\/with-mobile.html","journal-title":"Retrieved from"},{"key":"e_1_3_2_118_2","first-page":"304","volume-title":"Proc. IEEE ISPASS","author":"Parashar Angshuman","year":"2019","unstructured":"Angshuman Parashar, Priyanka Raina, Yakun Sophia Shao, Yu-Hsin Chen, et\u00a0al. 2019. Timeloop: A systematic approach to DNN accelerator evaluation. In Proc. IEEE ISPASS. 304\u2013315."},{"key":"e_1_3_2_119_2","article-title":"A survey on inference engines for large language models: Perspectives on optimization and efficiency","author":"Park Sihyeong","year":"2025","unstructured":"Sihyeong Park, Sungryeol Jeon, Chaelyn Lee, Seokhun Jeon, et\u00a0al. 2025. A survey on inference engines for large language models: Perspectives on optimization and efficiency. arXiv preprint arXiv:2505.01658 (2025).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_120_2","first-page":"118","volume-title":"Proc. ACM\/IEEE Annual Int. Symp. Comput. Arch. (ISCA)","author":"Patel Pratyush","year":"2024","unstructured":"Pratyush Patel, Esha Choukse, Chaojie Zhang, Aashaka Shah, et\u00a0al. 2024. Splitwise: Efficient generative LLM inference using phase splitting. In Proc. ACM\/IEEE Annual Int. Symp. Comput. Arch. (ISCA). 118\u2013132."},{"key":"e_1_3_2_121_2","doi-asserted-by":"crossref","first-page":"3795","DOI":"10.1109\/OJCOMS.2025.3561605","article-title":"A matching game for LLM layer deployment in heterogeneous edge networks","volume":"6","author":"Picano Benedetta","year":"2025","unstructured":"Benedetta Picano, Dinh Thai Hoang, and Diep N. Nguyen. 2025. A matching game for LLM layer deployment in heterogeneous edge networks. IEEE Open J. the Commun. Soc. 6 (2025), 3795\u20133805.","journal-title":"IEEE Open J. the Commun. Soc."},{"key":"e_1_3_2_122_2","doi-asserted-by":"crossref","first-page":"102840","DOI":"10.1016\/j.inffus.2024.102840","article-title":"Federated and edge learning for large language models","volume":"117","author":"Piccialli Francesco","year":"2025","unstructured":"Francesco Piccialli, Diletta Chiaro, Pian Qi, Valerio Bellandi, and Ernesto Damiani. 2025. Federated and edge learning for large language models. Information Fusion 117 (2025), 102840.","journal-title":"Information Fusion"},{"key":"e_1_3_2_123_2","first-page":"100535","volume-title":"Proc. Adv. Neural Infor. Process. Syst. (NeurIPS)","author":"Porian Tomer","year":"2024","unstructured":"Tomer Porian, Mitchell Wortsman, Jenia Jitsev, et\u00a0al. 2024. Resolving discrepancies in compute-optimal scaling of language models. In Proc. Adv. Neural Infor. Process. Syst. (NeurIPS) 37 (2024), 100535\u2013100570."},{"key":"e_1_3_2_124_2","first-page":"7957","volume-title":"Proc. Adv. Neural Infor. Process. Syst. (NeurIPS)","author":"Prabhakar Rohan Baskar","year":"2024","unstructured":"Rohan Baskar Prabhakar, Hengrui Zhang, and David Wentzlaff. 2024. Kraken: Inherently parallel transformers for efficient multi-device inference. In Proc. Adv. Neural Infor. Process. Syst. (NeurIPS) 37 (2024), 7957\u20137980."},{"key":"e_1_3_2_125_2","unstructured":"Formerly Data Protection. 2018. General data protection regulation (GDPR). Intersoft Consulting Accessed in October 24 1 (2018). Retrieved from https:\/\/gdpr-info.eu\/"},{"key":"e_1_3_2_126_2","doi-asserted-by":"publisher","unstructured":"Guanqiao Qu Qiyuan Chen Wei Wei Zheng Lin Xianhao Chen and Kaibin Huang. 2025. Mobile edge intelligence for large language models: A contemporary survey. IEEE Communications Surveys & Tutorials 27 6 (2025) 3820\u20133860. DOI:10.1109\/COMST.2025.3527641","DOI":"10.1109\/COMST.2025.3527641"},{"key":"e_1_3_2_127_2","volume-title":"QAI AppBuilder: Quick AI Application Builder","author":"Inc. Qualcomm Innovation Center,","year":"2024","unstructured":"Qualcomm Innovation Center, Inc.2024. QAI AppBuilder: Quick AI Application Builder. Retrieved from https:\/\/github.com\/quic\/ai-engine-direct-helper"},{"key":"e_1_3_2_128_2","unstructured":"Qualcomm Technologies Inc.2024. Qualcomm Enables Meta Llama 3 to Run on Devices Powered by Snapdragon. Retrieved from https:\/\/www.qualcomm.com\/news\/releases\/2024\/04\/qualcomm-enables-meta-llama-3-to-run-on-devices-powered-by-snapd"},{"issue":"140","key":"e_1_3_2_129_2","first-page":"1","article-title":"Exploring the limits of transfer learning with a unified text-to-text transformer","volume":"21","author":"Raffel Colin","year":"2020","unstructured":"Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, et\u00a0al. 2020. Exploring the limits of transfer learning with a unified text-to-text transformer. J. Mach. Learn. Res. (JMLR) 21, 140 (2020), 1\u201367.","journal-title":"J. Mach. Learn. Res. (JMLR)"},{"key":"e_1_3_2_130_2","first-page":"1","volume-title":"Proc. Int. Conf. High Perfor. Comput., Netw., Storage and Analysis","author":"Rajbhandari Samyam","year":"2020","unstructured":"Samyam Rajbhandari, Jeff Rasley, Olatunji Ruwase, and Yuxiong He. 2020. ZeRO: Memory optimizations toward training trillion parameter models. In Proc. Int. Conf. High Perfor. Comput., Netw., Storage and Analysis. 1\u201316."},{"issue":"2","key":"e_1_3_2_131_2","doi-asserted-by":"crossref","first-page":"1078","DOI":"10.1109\/COMST.2021.3062546","article-title":"Survey on multi-access edge computing security and privacy","volume":"23","author":"Ranaweera Pasika","year":"2021","unstructured":"Pasika Ranaweera, Anca Delia Jurcut, and Madhusanka Liyanage. 2021. Survey on multi-access edge computing security and privacy. IEEE Commun. Surveys Tuts. 23, 2 (2021), 1078\u20131124.","journal-title":"IEEE Commun. Surveys Tuts."},{"key":"e_1_3_2_132_2","doi-asserted-by":"publisher","unstructured":"Abdul Rehman Kamran Ahmad Awan Mahmood Ul Hassan Asadullah Shaikh Ali Alqazzaz and Korhan Cengiz. 2025. CLAF-IoT: Context-Aware LLMs-enhanced authentication framework for internet of things. IEEE Internet of Things Journal 12 14 (2025) 28639\u201328646. DOI:10.1109\/JIOT.2025.3567634","DOI":"10.1109\/JIOT.2025.3567634"},{"key":"e_1_3_2_133_2","first-page":"838","volume-title":"Proc. IEEE Int. Conf. Commun. (ICC)","author":"Ren Jiaqi","year":"2025","unstructured":"Jiaqi Ren, Chao Wang, Yihan Zhong, Shaohua Cao, Danyang Zheng, and Xiaojun Cao. 2025. Towards expert models deployment cost optimization in edge computing networks. In Proc. IEEE Int. Conf. Commun. (ICC). 838\u2013843."},{"key":"e_1_3_2_134_2","volume-title":"Proc. Adv. Neural Infor. Process. Syst. (NeurIPS)","author":"Ren Yi","year":"2019","unstructured":"Yi Ren, Yangjun Ruan, Xu Tan, Tao Qin, Sheng Zhao, Zhou Zhao, and Tie-Yan Liu. 2019. FastSpeech: Fast, robust and controllable text to speech. In Proc. Adv. Neural Infor. Process. Syst. (NeurIPS), Vol. 32."},{"key":"e_1_3_2_135_2","first-page":"5316","volume-title":"Proc. Conf. Empirical Methods in Natural Language Process.","author":"Sahu Gaurav","year":"2023","unstructured":"Gaurav Sahu, Olga Vechtomova, et\u00a0al. 2023. PromptMix: A class boundary augmentation method for large language model distillation. In Proc. Conf. Empirical Methods in Natural Language Process. 5316\u20135327."},{"key":"e_1_3_2_136_2","first-page":"17456","volume-title":"Proc. Adv. Neural Infor. Process. Syst. (NeurIPS)","author":"Schuster Tal","year":"2022","unstructured":"Tal Schuster, Adam Fisch, Jai Gupta, Mostafa Dehghani, Dara Bahri, Vinh Tran, Yi Tay, and Donald Metzler. 2022. Confident adaptive language modeling. In Proc. Adv. Neural Infor. Process. Syst. (NeurIPS) 35 (2022), 17456\u201317472."},{"key":"e_1_3_2_137_2","volume-title":"Proc. Int. Conf. Learn. Represent. (ICLR)","author":"Sharma Pratyusha","year":"2024","unstructured":"Pratyusha Sharma, Jordan T. Ash, and Dipendra Misra. 2024. The truth is in there: Improving reasoning in language models with layer-selective rank reduction. In Proc. Int. Conf. Learn. Represent. (ICLR)."},{"key":"e_1_3_2_138_2","first-page":"1","volume-title":"Proc. IEEE Veh. Technol. Conf. (VTC-Spring)","author":"She Yechao","year":"2024","unstructured":"Yechao She, Tuo Shi, Jianping Wang, and Bin Liu. 2024. Dynamic batching and early-exiting for accurate and timely edge inference. In Proc. IEEE Veh. Technol. Conf. (VTC-Spring). 1\u20136."},{"issue":"05","key":"e_1_3_2_139_2","doi-asserted-by":"crossref","first-page":"8815","DOI":"10.1609\/aaai.v34i05.6409","article-title":"Q-BERT: Hessian based ultra low precision quantization of BERT","volume":"34","author":"Shen Sheng","year":"2020","unstructured":"Sheng Shen, Zhen Dong, Jiayu Ye, Linjian Ma, Zhewei Yao, Amir Gholami, Michael W. Mahoney, and Kurt Keutzer. 2020. Q-BERT: Hessian based ultra low precision quantization of BERT. Proc. AAAI 34, 05 (2020), 8815\u20138821.","journal-title":"Proc. AAAI"},{"key":"e_1_3_2_140_2","first-page":"31094","volume-title":"Proc. Int. Conf. Mach. Learn. (ICML)","author":"Sheng Ying","year":"2023","unstructured":"Ying Sheng, Lianmin Zheng, Binhang Yuan, et\u00a0al. 2023. FlexGen: High-throughput generative inference of large language models with a single GPU. In Proc. Int. Conf. Mach. Learn. (ICML) 202 (2023), 31094\u201331116."},{"key":"e_1_3_2_141_2","article-title":"Megatron-LM: Training multi-billion parameter language models using model parallelism","volume":"1909","author":"Shoeybi Mohammad","year":"2019","unstructured":"Mohammad Shoeybi, Mostofa Patwary, Raul Puri, et\u00a0al. 2019. Megatron-LM: Training multi-billion parameter language models using model parallelism. CoRR abs\/1909.08053 (2019).","journal-title":"CoRR"},{"key":"e_1_3_2_142_2","first-page":"221","volume-title":"Proc. ACL","author":"Simoulin Antoine","year":"2021","unstructured":"Antoine Simoulin and Benoit Crabb\u00e9. 2021. How many layers and why? An analysis of the model depth in transformers. In Proc. ACL. 221\u2013228."},{"key":"e_1_3_2_143_2","volume-title":"Proc. IEEE Int. Conf. Commun. (ICC)","author":"Song Qiuchen","year":"2025","unstructured":"Qiuchen Song, Shusen Jing, Shuai Zhang, Songyang Zhang, and Chuan Huang. 2025. Mixture-of-experts for distributed edge computing with channel-aware gating function. In Proc. IEEE Int. Conf. Commun. (ICC)."},{"key":"e_1_3_2_144_2","first-page":"1348","volume-title":"Proc. IEEE HPCA","author":"Stojkovic Jovan","year":"2025","unstructured":"Jovan Stojkovic, Chaojie Zhang, igo Goiri, Josep Torrellas, and Esha Choukse. 2025. DynamoLLM: Designing LLM inference clusters for performance and energy efficiency. In Proc. IEEE HPCA. 1348\u20131362."},{"key":"e_1_3_2_145_2","volume-title":"Proc. Int. Conf. Learn. Represent. (ICLR)","author":"Sun Mingjie","year":"2024","unstructured":"Mingjie Sun, Zhuang Liu, Anna Bair, and J. Zico Kolter. 2024. A simple and effective pruning approach for large language models. In Proc. Int. Conf. Learn. Represent. (ICLR)."},{"key":"e_1_3_2_146_2","first-page":"30222","volume-title":"Proc. Adv. Neural Infor. Process. Syst. (NeurIPS)","author":"Sun Ziteng","year":"2023","unstructured":"Ziteng Sun, Ananda Theertha Suresh, Jae Hun Ro, et\u00a0al. 2023. SpecTr: Fast speculative decoding via optimal transport. In Proc. Adv. Neural Infor. Process. Syst. (NeurIPS) 36 (2023), 30222\u201330242."},{"key":"e_1_3_2_147_2","first-page":"10880","volume-title":"Proc. ACL","author":"Tao Chaofan","year":"2023","unstructured":"Chaofan Tao, Lu Hou, Haoli Bai, Jiansheng Wei, Xin Jiang, Qun Liu, Ping Luo, and Ngai Wong. 2023. Structured pruning for efficient generative pre-trained language models. In Proc. ACL. 10880\u201310895."},{"key":"e_1_3_2_148_2","article-title":"Gemma: Open models based on gemini research and technology","author":"Team Gemma","year":"2024","unstructured":"Gemma Team, Thomas Mesnard, Cassidy Hardin, et\u00a0al. 2024. Gemma: Open models based on gemini research and technology. arXiv preprint arXiv:2403.08295 (2024).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_149_2","article-title":"Qwen2 technical report","volume":"2","author":"Team Qwen","year":"2024","unstructured":"Qwen Team. 2024. Qwen2 technical report. arXiv preprint arXiv:2407.10671 2 (2024).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_150_2","article-title":"Llama: Open and efficient foundation language models","author":"Touvron Hugo","year":"2023","unstructured":"Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, et\u00a0al. 2023. Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971 (2023).","journal-title":"arXiv preprint"},{"issue":"11","key":"e_1_3_2_151_2","doi-asserted-by":"crossref","first-page":"4038","DOI":"10.1109\/TCAD.2023.3273992","article-title":"AccelTran: A sparsity-aware accelerator for dynamic inference with transformers","volume":"42","author":"Tuli Shikhar","year":"2023","unstructured":"Shikhar Tuli and Niraj K. Jha. 2023. AccelTran: A sparsity-aware accelerator for dynamic inference with transformers. IEEE Trans. Computer-Aided Design Integr. Circuits Syst. 42, 11 (2023), 4038\u20134051.","journal-title":"IEEE Trans. Computer-Aided Design Integr. Circuits Syst."},{"key":"e_1_3_2_152_2","volume-title":"Proc. Adv. Neural Infor. Process. Syst. (NeurIPS)","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Proc. Adv. Neural Infor. Process. Syst. (NeurIPS), Vol. 30."},{"key":"e_1_3_2_153_2","volume-title":"Proc. Int. Conf. Learn. Rep. (ICLR)","author":"Wan Fanqi","year":"2024","unstructured":"Fanqi Wan, Xinting Huang, Deng Cai, Xiaojun Quan, Wei Bi, and Shuming Shi. 2024. Knowledge fusion of large language models. In Proc. Int. Conf. Learn. Rep. (ICLR)."},{"key":"e_1_3_2_154_2","first-page":"801\u2013\u2013817","volume-title":"ACM ASPLOS","author":"Wang Haoran","year":"2024","unstructured":"Haoran Wang, Lei Wang, Haobo Xu, Ying Wang, Yuming Li, and Yinhe Han. 2024. PrimePar: Efficient spatial-temporal tensor partitioning for large transformer model training. In ACM ASPLOS. 801\u2013\u2013817."},{"key":"e_1_3_2_155_2","first-page":"7287","volume-title":"Proc. Annual Meeting of the ACL)","author":"Wang Jue","year":"2022","unstructured":"Jue Wang, Ke Chen, Gang Chen, Lidan Shou, and Julian McAuley. 2022. SkipBERT: Efficient inference with shallow layer skipping. In Proc. Annual Meeting of the ACL). 7287\u20137301."},{"key":"e_1_3_2_156_2","article-title":"Mixture-of-agents enhances large language model capabilities","author":"Wang Junlin","year":"2024","unstructured":"Junlin Wang, Jue Wang, Ben Athiwaratkun, Ce Zhang, and James Zou. 2024. Mixture-of-agents enhances large language model capabilities. arXiv preprint arXiv:2406.04692 (2024).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_157_2","first-page":"5776","volume-title":"Proc. Adv. Neural Infor. Process. Syst. (NeurIPS)","author":"Wang Wenhui","year":"2020","unstructured":"Wenhui Wang, Furu Wei, Li Dong, et\u00a0al. 2020. MiniLM: Deep self-attention distillation for task-agnostic compression of pre-trained transformers. In Proc. Adv. Neural Infor. Process. Syst. (NeurIPS) 33 (2020), 5776\u20135788."},{"key":"e_1_3_2_158_2","article-title":"Self-consistency improves chain of thought reasoning in language models","author":"Wang Xuezhi","year":"2022","unstructured":"Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc Le, Ed Chi, et\u00a0al. 2022. Self-consistency improves chain of thought reasoning in language models. arXiv preprint arXiv:2203.11171 (2022).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_159_2","article-title":"Revisiting slo and goodput metrics in llm serving","author":"Wang Zhibin","year":"2024","unstructured":"Zhibin Wang, Shipeng Li, Yuhang Zhou, Xue Li, Rong Gu, Nguyen Cam-Tu, Chen Tian, and Sheng Zhong. 2024. Revisiting slo and goodput metrics in llm serving. arXiv preprint arXiv:2410.14257 (2024).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_160_2","volume-title":"Proc. Int. Conf. Learn. Represent. (ICLR)","author":"Wei Jason","year":"2022","unstructured":"Jason Wei, Maarten Bosma, Vincent Zhao, Kelvin Guu, Adams Wei Yu, Brian Lester, Nan Du, Andrew M. Dai, and Quoc V. Le. 2022. Finetuned language models are zero-shot learners. In Proc. Int. Conf. Learn. Represent. (ICLR)."},{"key":"e_1_3_2_161_2","first-page":"24824","volume-title":"Advances in Neural Information Processing Systems","author":"Wei Jason","year":"2022","unstructured":"Jason Wei, Xuezhi Wang, Dale Schuurmans, et\u00a0al. 2022. Chain-of-thought prompting elicits reasoning in large language models. In Advances in Neural Information Processing Systems 35 (2022), 24824\u201324837."},{"key":"e_1_3_2_162_2","article-title":"Outlier suppression+: Accurate quantization of large language models by equivalent and optimal shifting and scaling","author":"Wei Xiuying","year":"2023","unstructured":"Xiuying Wei, Yunchen Zhang, Yuhang Li, et\u00a0al. 2023. Outlier suppression+: Accurate quantization of large language models by equivalent and optimal shifting and scaling. arXiv preprint arXiv:2304.09145 (2023).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_163_2","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1145\/3721146.3721953","volume-title":"Proc. Workshop on Machine Learn. and Sys. (EuroMLSys)","author":"Wilhelm Patrick","year":"2025","unstructured":"Patrick Wilhelm, Thorsten Wittkopp, and Odej Kao. 2025. Beyond test-time compute strategies: Advocating energy-per-token in LLM inference. In Proc. Workshop on Machine Learn. and Sys. (EuroMLSys). 208\u2013215."},{"issue":"3","key":"e_1_3_2_164_2","doi-asserted-by":"crossref","first-page":"1950","DOI":"10.1109\/TWC.2020.3037595","article-title":"Fluid antenna systems","volume":"20","author":"Wong Kai-Kit","year":"2021","unstructured":"Kai-Kit Wong et\u00a0al. 2021. Fluid antenna systems. IEEE Trans. Wireless Commun. 20, 3 (2021), 1950\u20131962.","journal-title":"IEEE Trans. Wireless Commun."},{"key":"e_1_3_2_165_2","article-title":"Fast distributed inference serving for large language models","author":"Wu Bingyang","year":"2023","unstructured":"Bingyang Wu, Yinmin Zhong, Zili Zhang, Shengyu Liu, Fangyue Liu, Yuanhang Sun, Gang Huang, Xuanzhe Liu, and Xin Jin. 2023. Fast distributed inference serving for large language models. arXiv preprint arXiv:2305.05920 (2023).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_166_2","first-page":"21275","volume-title":"Proc. Conf. Empirical Methods in Natural Language Process.","author":"Wu Wei","year":"2025","unstructured":"Wei Wu et\u00a0al. 2025. TokenSelect: Efficient long-context inference and length extrapolation for LLMs via dynamic token-level KV cache selection. In Proc. Conf. Empirical Methods in Natural Language Process. 21275\u201321292."},{"key":"e_1_3_2_167_2","article-title":"Arrow: Adaptive scheduling mechanisms for disaggregated LLM inference architecture","author":"Wu Yu","year":"2025","unstructured":"Yu Wu, Tongxuan Liu, Yuting Zeng, Siyu Wu, et\u00a0al. 2025. Arrow: Adaptive scheduling mechanisms for disaggregated LLM inference architecture. arXiv preprint arXiv:2505.11916 (2025).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_168_2","article-title":"Unlocking efficiency in large language model inference: A comprehensive survey of speculative decoding","author":"Xia Heming","year":"2024","unstructured":"Heming Xia, Zhe Yang, Qingxiu Dong, Peiyi Wang, et\u00a0al. 2024. Unlocking efficiency in large language model inference: A comprehensive survey of speculative decoding. arXiv preprint arXiv:2401.07851 (2024).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_169_2","article-title":"Flash-llm: Enabling cost-effective and highly-efficient large generative model inference with unstructured sparsity","author":"Xia Haojun","year":"2023","unstructured":"Haojun Xia, Zhen Zheng, Yuchao Li, Donglin Zhuang, et\u00a0al. 2023. Flash-llm: Enabling cost-effective and highly-efficient large generative model inference with unstructured sparsity. arXiv preprint arXiv:2309.10285 (2023).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_170_2","volume-title":"Proc. Int. Conf. Learn. Represent. (ICLR)","author":"Xia Mengzhou","year":"2024","unstructured":"Mengzhou Xia, Tianyu Gao, Zhiyuan Zeng, and Danqi Chen. 2024. Sheared llama: Accelerating language model pre-training via structured pruning. In Proc. Int. Conf. Learn. Represent. (ICLR)."},{"key":"e_1_3_2_171_2","first-page":"38087","volume-title":"Proc. Int. Conf. Mach. Learn. (ICML)","author":"Xiao Guangxuan","year":"2023","unstructured":"Guangxuan Xiao, Ji Lin, Mickael Seznec, et\u00a0al. 2023. SmoothQuant: Accurate and efficient post-training quantization for large language models. In Proc. Int. Conf. Mach. Learn. (ICML) 202 (2023), 38087\u201338099."},{"key":"e_1_3_2_172_2","article-title":"A novel hat-shaped device-cloud collaborative inference framework for large language models","author":"Xie Zuan","year":"2025","unstructured":"Zuan Xie, Yang Xu, Hongli Xu, Yunming Liao, and Zhiwei Yao. 2025. A novel hat-shaped device-cloud collaborative inference framework for large language models. arXiv preprint arXiv:2503.18989 (2025).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_173_2","article-title":"DeeBERT: Dynamic early exiting for accelerating BERT inference","author":"Xin Ji","year":"2020","unstructured":"Ji Xin, Raphael Tang, Jaejun Lee, Yaoliang Yu, and Jimmy Lin. 2020. DeeBERT: Dynamic early exiting for accelerating BERT inference. arXiv preprint arXiv:2004.12993 (2020).","journal-title":"arXiv preprint"},{"issue":"4","key":"e_1_3_2_174_2","doi-asserted-by":"crossref","first-page":"3256","DOI":"10.1109\/TMC.2024.3513457","article-title":"EdgeLLM: Fast on-device LLM inference with speculative decoding","volume":"24","author":"Xu Daliang","year":"2025","unstructured":"Daliang Xu, Wangsong Yin, Hao Zhang, Xin Jin, et\u00a0al. 2025. EdgeLLM: Fast on-device LLM inference with speculative decoding. IEEE Trans. Mobile Comput. 24, 4 (2025), 3256\u20133273.","journal-title":"IEEE Trans. Mobile Comput."},{"key":"e_1_3_2_175_2","article-title":"On-device language models: A comprehensive review","author":"Xu Jiajun","year":"2024","unstructured":"Jiajun Xu, Zhiyuan Li, Wei Chen, Qun Wang, Xin Gao, Qi Cai, and Ziyuan Ling. 2024. On-device language models: A comprehensive review. arXiv preprint arXiv:2409.00088 (2024).","journal-title":"arXiv preprint"},{"issue":"2","key":"e_1_3_2_176_2","doi-asserted-by":"crossref","first-page":"1127","DOI":"10.1109\/COMST.2024.3353265","article-title":"Unleashing the power of edge-cloud generative AI in mobile networks: A survey of AIGC services","volume":"26","author":"Xu Minrui","year":"2024","unstructured":"Minrui Xu, Hongyang Du, Dusit Niyato, Jiawen Kang, et\u00a0al. 2024. Unleashing the power of edge-cloud generative AI in mobile networks: A survey of AIGC services. IEEE Commun. Surveys Tuts. 26, 2 (2024), 1127\u20131170.","journal-title":"IEEE Commun. Surveys Tuts."},{"key":"e_1_3_2_177_2","doi-asserted-by":"publisher","unstructured":"Xinyi Xu Gang Feng Yijing Liu Shuang Qin Jian Wang and Yunxiang Wang. 2026. Joint inference offloading and model caching for small and large language model collaboration. IEEE Transactions on Mobile Computing 25 2 (2026) 2691\u20132706. DOI:10.1109\/TMC.2025.3608303","DOI":"10.1109\/TMC.2025.3608303"},{"key":"e_1_3_2_178_2","first-page":"483","volume-title":"Proc. ACL","author":"Xue Linting","year":"2021","unstructured":"Linting Xue, Noah Constant, Adam Roberts, Mihir Kale, Rami Al-Rfou, Aditya Siddhant, Aditya Barua, and Colin Raffel. 2021. mT5: A massively multilingual pre-trained text-to-text transformer. In Proc. ACL. 483\u2013498."},{"key":"e_1_3_2_179_2","doi-asserted-by":"publisher","unstructured":"Nan Xue Yaping Sun Zhiyong Chen Meixia Tao Xiaodong Xu Liang Qian Shuguang Cui Wenjun Zhang and Ping Zhang. 2026. WDMoE: Wireless distributed mixture of experts for large language models. IEEE Transactions on Wireless Communications 25 (2026) 559\u2013572. DOI:10.1109\/TWC.2025.3585163","DOI":"10.1109\/TWC.2025.3585163"},{"key":"e_1_3_2_180_2","article-title":"Qwen2. 5-1m technical report","author":"Yang An","year":"2025","unstructured":"An Yang, Bowen Yu, Chengyuan Li, Dayiheng Liu, Fei Huang, Haoyan Huang, Jiandong Jiang, Jianhong Tu, Jianwei Zhang, Jingren Zhou, et\u00a0al. 2025. Qwen2. 5-1m technical report. arXiv preprint arXiv:2501.15383 (2025).","journal-title":"arXiv preprint"},{"issue":"12","key":"e_1_3_2_181_2","doi-asserted-by":"crossref","first-page":"13648","DOI":"10.1109\/TMC.2025.3590969","article-title":"Quality-of-service aware LLM routing for edge computing with multiple experts","volume":"24","author":"Yang Jin","year":"2025","unstructured":"Jin Yang, Qiong Wu, Zhiying Feng, Zhi Zhou, Deke Guo, and Xu Chen. 2025. Quality-of-service aware LLM routing for edge computing with multiple experts. IEEE Trans. Mobile Comput. 24, 12 (2025), 13648\u201313662.","journal-title":"IEEE Trans. Mobile Comput."},{"key":"e_1_3_2_182_2","doi-asserted-by":"publisher","unstructured":"Yang Yang and M. Cenk Gursoy. 2025. Collaborative inference in RIS-assisted MEC networks under computing backlog constraints. IEEE Transactions on Communications 73 11 (2025) 10172\u201310185. DOI:10.1109\/TCOMM.2025.3564727","DOI":"10.1109\/TCOMM.2025.3564727"},{"key":"e_1_3_2_183_2","first-page":"11809","volume-title":"Advances in Neural Information Processing Systems","author":"Yao Shunyu","year":"2023","unstructured":"Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, et\u00a0al. 2023. Tree of thoughts: Deliberate problem solving with large language models. In Advances in Neural Information Processing Systems 36 (2023), 11809\u201311822."},{"key":"e_1_3_2_184_2","volume-title":"The Eleventh International Conference on Learning Representations","author":"Yao Shunyu","year":"2022","unstructured":"Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, et\u00a0al. 2022. React: Synergizing reasoning and acting in language models. In The Eleventh International Conference on Learning Representations."},{"key":"e_1_3_2_185_2","first-page":"27168","volume-title":"Adv. Neural Infor. Process. Sys.","author":"Yao Zhewei","year":"2022","unstructured":"Zhewei Yao, Reza Yazdani Aminabadi, Minjia Zhang, et\u00a0al. 2022. ZeroQuant: Efficient and affordable post-training quantization for large-scale transformers. In Adv. Neural Infor. Process. Sys. 35 (2022), 27168\u201327183."},{"key":"e_1_3_2_186_2","first-page":"1","volume-title":"Proc. IEEE Conf. Comput. Commun. (INFOCOM)","author":"Ye Shengyuan","year":"2025","unstructured":"Shengyuan Ye, Bei Ouyang, Liekang Zeng, et\u00a0al. 2025. Jupiter: Fast and resource-efficient collaborative inference of generative LLMs on edge devices. In Proc. IEEE Conf. Comput. Commun. (INFOCOM). 1\u201310."},{"key":"e_1_3_2_187_2","first-page":"312\u2013\u2013326","volume-title":"Proc. ACM MobiCom","author":"Ye Shengyuan","year":"2024","unstructured":"Shengyuan Ye, Liekang Zeng, Xiaowen Chu, et\u00a0al. 2024. Asteroid: Resource-efficient hybrid pipeline parallelism for collaborative DNN training on heterogeneous edge devices. In Proc. ACM MobiCom. 312\u2013\u2013326."},{"key":"e_1_3_2_188_2","volume-title":"Proc. Annual Conf. Machine Learn. and Sys. (MLSys)","author":"Ye Zihao","year":"2025","unstructured":"Zihao Ye, Lequn Chen, Ruihang Lai, Wuwei Lin, et\u00a0al. 2025. FlashInfer: Efficient and customizable attention engine for LLM inference serving. In Proc. Annual Conf. Machine Learn. and Sys. (MLSys)."},{"key":"e_1_3_2_189_2","first-page":"57101","volume-title":"Proc. Int. Conf. Machine Learn. (ICML)","author":"Yin Lu","year":"2024","unstructured":"Lu Yin, You Wu, Zhenyu Zhang, et\u00a0al. 2024. Outlier weighed layerwise sparsity (OWL): A missing secret sauce for pruning LLMs to high sparsity. In Proc. Int. Conf. Machine Learn. (ICML). 57101\u201357115."},{"key":"e_1_3_2_190_2","first-page":"521","volume-title":"Proc. USENIX OSDI","author":"Yu Gyeong-In","year":"2022","unstructured":"Gyeong-In Yu, Joo Seong Jeong, Geon-Woo Kim, Soojeong Kim, and Byung-Gon Chun. 2022. Orca: A distributed serving system for transformer-based generative models. In Proc. USENIX OSDI. 521\u2013538."},{"key":"e_1_3_2_191_2","article-title":"Asvd: Activation-aware singular value decomposition for compressing large language models","author":"Yuan Zhihang","year":"2023","unstructured":"Zhihang Yuan, Yuzhang Shang, Yue Song, Qiang Wu, Yan Yan, and Guangyu Sun. 2023. Asvd: Activation-aware singular value decomposition for compressing large language models. arXiv preprint arXiv:2312.05821 (2023).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_192_2","first-page":"36","volume-title":"Proc. EMC2-NIPS","author":"Zafrir Ofir","year":"2019","unstructured":"Ofir Zafrir, Guy Boudoukh, et\u00a0al. 2019. Q8BERT: Quantized 8Bit BERT. In Proc. EMC2-NIPS. 36\u201339."},{"key":"e_1_3_2_193_2","first-page":"4791","volume-title":"Proc. ACL","author":"Zellers Rowan","year":"2019","unstructured":"Rowan Zellers, Ari Holtzman, Yonatan Bisk, Ali Farhadi, and Yejin Choi. 2019. HellaSwag: Can a machine really finish your sentence?. In Proc. ACL. 4791\u20134800."},{"issue":"17","key":"e_1_3_2_194_2","doi-asserted-by":"crossref","first-page":"19506","DOI":"10.1609\/aaai.v38i17.29922","article-title":"ConsistentEE: A consistent and hardness-guided early exiting method for accelerating language models inference","volume":"38","author":"Zeng Ziqian","year":"2024","unstructured":"Ziqian Zeng, Yihuai Hong, Hongliang Dai, et\u00a0al. 2024. ConsistentEE: A consistent and hardness-guided early exiting method for accelerating language models inference. Proc. AAAI 38, 17 (Mar.2024), 19506\u201319514.","journal-title":"Proc. AAAI"},{"issue":"1","key":"e_1_3_2_195_2","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1109\/TCC.2024.3350561","article-title":"BatOpt: Optimizing GPU-based deep learning inference using dynamic batch processing","volume":"12","author":"Zhang Deyu","year":"2024","unstructured":"Deyu Zhang, Yunzhen Luo, Yaobo Wang, Xiaoyan Kui, and Ju Ren. 2024. BatOpt: Optimizing GPU-based deep learning inference using dynamic batch processing. IEEE Trans. Cloud Comput. 12, 1 (2024), 174\u2013185.","journal-title":"IEEE Trans. Cloud Comput."},{"key":"e_1_3_2_196_2","volume-title":"Proc. IEEE Int. Conf. Commun. (ICC)","author":"Zhang Kai","year":"2025","unstructured":"Kai Zhang, Hengtao He, Shenghui Song, Jun Zhang, and Khaled B Letaief. 2025. Distributed on-device llm inference with over-the-air computation. In Proc. IEEE Int. Conf. Commun. (ICC)."},{"issue":"10","key":"e_1_3_2_197_2","first-page":"13119","article-title":"EdgeShard: Efficient LLM inference via collaborative edge computing","volume":"12","author":"Zhang Mingjin","year":"2025","unstructured":"Mingjin Zhang, Xiaoming Shen, Jiannong Cao, Zeyang Cui, and Shan Jiang. 2025. EdgeShard: Efficient LLM inference via collaborative edge computing. IEEE Int. Things J. 12, 10 (2025), 13119\u201313131.","journal-title":"IEEE Int. Things J."},{"key":"e_1_3_2_198_2","article-title":"Tinyllama: An open-source small language model","author":"Zhang Peiyuan","year":"2024","unstructured":"Peiyuan Zhang et\u00a0al. 2024. Tinyllama: An open-source small language model. arXiv preprint arXiv:2401.02385 (2024).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_199_2","article-title":"Opt: Open pre-trained transformer language models","author":"Zhang Susan","year":"2022","unstructured":"Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, et\u00a0al. 2022. Opt: Open pre-trained transformer language models. arXiv preprint arXiv:2205.01068 (2022).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_200_2","first-page":"509","volume-title":"Proc. Conf. Empirical Methods in Natural Language Process. (EMNLP)","author":"Zhang Wei","year":"2020","unstructured":"Wei Zhang, Lu Hou, Yichun Yin, Lifeng Shang, Xiao Chen, Xin Jiang, and Qun Liu. 2020. TernaryBERT: Distillation-aware ultra-low bit BERT. In Proc. Conf. Empirical Methods in Natural Language Process. (EMNLP). 509\u2013521."},{"issue":"1","key":"e_1_3_2_201_2","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1109\/TWC.2024.3497923","article-title":"Beyond the cloud: Edge inference for generative large language models in wireless networks","volume":"24","author":"Zhang Xinyuan","year":"2025","unstructured":"Xinyuan Zhang, Jiangtian Nie, et\u00a0al. 2025. Beyond the cloud: Edge inference for generative large language models in wireless networks. IEEE Trans. Wireless Commun. 24, 1 (2025), 643\u2013658.","journal-title":"IEEE Trans. Wireless Commun."},{"key":"e_1_3_2_202_2","first-page":"160","volume-title":"Proc. ACL)","author":"Zhao Junchen","year":"2024","unstructured":"Junchen Zhao, Yurun Song, Simeng Liu, Ian G. Harris, and Sangeetha Abdu Jyothi. 2024. LinguaLinked: Distributed large language model inference on mobile devices. In Proc. ACL). 160\u2013171."},{"key":"e_1_3_2_203_2","first-page":"460\u2013\u2013462","volume-title":"Proc. ACM PPoPP","author":"Zhao Juntao","year":"2024","unstructured":"Juntao Zhao, Borui Wan, Chuan Wu, Yanghua Peng, and Haibin Lin. 2024. POSTER: LLM-PQ:Serving LLM on heterogeneous clusters with phase-aware partition and adaptive quantization. In Proc. ACM PPoPP. 460\u2013\u2013462."},{"key":"e_1_3_2_204_2","volume-title":"Proc. Int. Conf. Wireless Commun. and Signal Process. (WCSP)","author":"Zheng Ce","year":"2025","unstructured":"Ce Zheng and Tingting Yang. 2025. Communication-efficient collaborative LLM inference via distributed speculative decoding. In Proc. Int. Conf. Wireless Commun. and Signal Process. (WCSP)."},{"issue":"4","key":"e_1_3_2_205_2","doi-asserted-by":"crossref","first-page":"2693","DOI":"10.1109\/TWC.2024.3523517","article-title":"Computation-aware offloading for DNN inference tasks in semantic communication assisted MEC systems","volume":"24","author":"Zheng Guangyuan","year":"2025","unstructured":"Guangyuan Zheng, Miaowen Wen, et\u00a0al. 2025. Computation-aware offloading for DNN inference tasks in semantic communication assisted MEC systems. IEEE Trans. Wireless Commun. 24, 4 (2025), 2693\u20132706.","journal-title":"IEEE Trans. Wireless Commun."},{"key":"e_1_3_2_206_2","first-page":"559","volume-title":"Proc. USENIX OSDI","author":"Zheng Lianmin","year":"2022","unstructured":"Lianmin Zheng, Zhuohan Li, Hao Zhang, Yonghao Zhuang, Zhifeng Chen, et\u00a0al. 2022. Alpa: Automating inter- and intra-operator parallelism for distributed deep learning. In Proc. USENIX OSDI. 559\u2013578."},{"issue":"8","key":"e_1_3_2_207_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3719664","article-title":"A review on edge large language models: Design, execution, and applications","volume":"57","author":"Zheng Yue","year":"2025","unstructured":"Yue Zheng, Yuhao Chen, Bin Qian, Xiufang Shi, Yuanchao Shu, and Jiming Chen. 2025. A review on edge large language models: Design, execution, and applications. ACM Comput. Surv. 57, 8 (2025), 1\u201335.","journal-title":"ACM Comput. Surv."},{"key":"e_1_3_2_208_2","first-page":"193","volume-title":"Proc. USENIX OSDI","author":"Zhong Yinmin","year":"2024","unstructured":"Yinmin Zhong, Shengyu Liu, Junda Chen, Jianbo Hu, et\u00a0al. 2024. DistServe: Disaggregating prefill and decoding for goodput-optimized large language model serving. In Proc. USENIX OSDI. 193\u2013210."},{"key":"e_1_3_2_209_2","article-title":"Dynamickv: Task-aware adaptive kv cache compression for long context llms","author":"Zhou Xiabin","year":"2024","unstructured":"Xiabin Zhou, Wenbin Wang, Minyan Zeng, Jiaxian Guo, Xuebo Liu, Li Shen, Min Zhang, and Liang Ding. 2024. Dynamickv: Task-aware adaptive kv cache compression for long context llms. arXiv preprint arXiv:2412.14838 (2024).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_210_2","article-title":"Efficient LLM inference over heterogeneous edge networks with speculative decoding","author":"Zhu Bingjie","year":"2025","unstructured":"Bingjie Zhu, Zhixiong Chen, Liqiang Zhao, Hyundong Shin, and Arumugam Nallanathan. 2025. Efficient LLM inference over heterogeneous edge networks with speculative decoding. arXiv preprint arXiv:2510.11331 (2025).","journal-title":"arXiv preprint"},{"key":"e_1_3_2_211_2","first-page":"6285","volume-title":"Proc. IEEE Int. Conf. Commun. (ICC)","author":"Zhu Bingjie","year":"2025","unstructured":"Bingjie Zhu, Zhixiong Chen, Liqiang Zhao, Hyundong Shin, and Arumugam Nallanathan. 2025. Joint caching and inference for large language models in wireless networks. In Proc. IEEE Int. Conf. Commun. (ICC). 6285\u20136290."},{"key":"e_1_3_2_212_2","first-page":"59062","volume-title":"Proc. Adv. Neural Infor. Process. Syst. (NeurIPS)","author":"Zhu Banghua","year":"2023","unstructured":"Banghua Zhu, Ying Sheng, Lianmin Zheng, Clark Barrett, et\u00a0al. 2023. Towards optimal caching and model selection for large model inference. In Proc. Adv. Neural Infor. Process. Syst. (NeurIPS) 36 (2023), 59062\u201359094."}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3809166","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,19]],"date-time":"2026-05-19T11:38:28Z","timestamp":1779190708000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3809166"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,19]]},"references-count":211,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2026,9,30]]}},"alternative-id":["10.1145\/3809166"],"URL":"https:\/\/doi.org\/10.1145\/3809166","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,19]]},"assertion":[{"value":"2025-11-16","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-04-08","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-05-19","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}