{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T13:06:15Z","timestamp":1780664775903,"version":"3.54.1"},"publisher-location":"New York, NY, USA","reference-count":96,"publisher":"ACM","license":[{"start":{"date-parts":[[2026,4,26]],"date-time":"2026-04-26T00:00:00Z","timestamp":1777161600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2148209"],"award-info":[{"award-number":["2148209"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2212193"],"award-info":[{"award-number":["2212193"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,4,27]]},"DOI":"10.1145\/3767295.3803595","type":"proceedings-article","created":{"date-parts":[[2026,4,24]],"date-time":"2026-04-24T20:20:04Z","timestamp":1777062004000},"page":"899-918","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Reducing the GPU Memory Bottleneck with Lossless Compression for ML"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6565-3764","authenticated-orcid":false,"given":"Aditya K","family":"Kamath","sequence":"first","affiliation":[{"name":"Paul G Allen School of Computer Science and Engineering, University of Washington, Seattle, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9505-9528","authenticated-orcid":false,"given":"Arvind","family":"Krishnamurthy","sequence":"additional","affiliation":[{"name":"Paul G Allen School of Computer Science and Engineering, University of Washington\/Google, Seattle, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5051-4283","authenticated-orcid":false,"given":"Marco","family":"Canini","sequence":"additional","affiliation":[{"name":"King Abdullah University of Science and Technology, Thuwal, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-4748-8524","authenticated-orcid":false,"given":"Simon","family":"Peter","sequence":"additional","affiliation":[{"name":"Paul G Allen School of Computer Science and Engineering, University of Washington, Seattle, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,4,26]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Cuda c++ programming guide: Compressible memory. https:\/\/docs.nvidia.com\/cuda\/cuda-c-programming-guide#compressible-memory."},{"key":"e_1_3_2_1_2_1","unstructured":"Cuda c++ programming guide: Device memory accesses. https:\/\/docs.nvidia.com\/cuda\/cuda-c-programming-guide\/#device-memory-accesses."},{"key":"e_1_3_2_1_3_1","unstructured":"Cuda c++ programming guide: Hardware implementation. https:\/\/docs.nvidia.com\/cuda\/cuda-c-programming-guide\/#hardware-implementation."},{"key":"e_1_3_2_1_4_1","unstructured":"Cuda c++ programming guide: Mapped memory. https:\/\/docs.nvidia.com\/cuda\/cuda-c-programming-guide\/#mapped-memory."},{"key":"e_1_3_2_1_5_1","unstructured":"Dlrm checkpoint. https:\/\/catalog.ngc.nvidia.com\/orgs\/nvidia\/teams\/dle\/models\/dlrm_base_tf2_ckpt_ds-criteo-fl15."},{"key":"e_1_3_2_1_6_1","unstructured":"nvcomp: High-speed data compression using nvidia gpus. https:\/\/developer.nvidia.com\/nvcomp."},{"key":"e_1_3_2_1_7_1","unstructured":"Nvidia a100 tensor core gpu. https:\/\/www.nvidia.com\/content\/dam\/en-zz\/Solutions\/Data-Center\/a100\/pdf\/nvidia-a100-datasheet-us-nvidia-1758950-r4-web.pdf."},{"key":"e_1_3_2_1_8_1","unstructured":"Nvidia h100 tensor core gpu. https:\/\/resources.nvidia.com\/en-us-tensor-core\/nvidia-tensor-core-gpu-datasheet."},{"key":"e_1_3_2_1_9_1","unstructured":"Nvidia v100 tensor core gpu. https:\/\/images.nvidia.com\/content\/technologies\/volta\/pdf\/volta-v100-datasheet-update-us-1165301-r5.pdf."},{"key":"e_1_3_2_1_10_1","unstructured":"Nvlink and nvlink switch. https:\/\/www.nvidia.com\/en-in\/data-center\/nvlink\/."},{"key":"e_1_3_2_1_11_1","unstructured":"Terabyte click logs. https:\/\/labs.criteo.com\/2013\/12\/download-terabyte-click-logs-2\/."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/HPCA51647.2021.00072"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3662010.3663450"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3600006.3613142"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.14778\/3717755.3717776"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3588682"},{"key":"e_1_3_2_1_17_1","volume-title":"International Conference on Learning Representations","author":"Bojchevski Aleksandar","year":"2018","unstructured":"Aleksandar Bojchevski and Stephan G\u00fcnnemann. Deep gaussian embedding of graphs: Unsupervised inductive learning via ranking. In International Conference on Learning Representations, 2018."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2021.04.039"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.14778\/3648160.3648180"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00796"},{"key":"e_1_3_2_1_21_1","first-page":"33972","volume-title":"The trade-offs of model size in large recommendation models: 100gb to 10mb criteo-tb dlrm model","author":"Desai Aditya","unstructured":"Aditya Desai and Anshumali Shrivastava. The trade-offs of model size in large recommendation models: 100gb to 10mb criteo-tb dlrm model. In S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh, editors, Advances in Neural Information Processing Systems, volume 35, pages 33961\u201333972. Curran Associates, Inc., 2022."},{"key":"e_1_3_2_1_22_1","first-page":"30332","volume-title":"8-bit matrix multiplication for transformers at scale","author":"Dettmers Tim","unstructured":"Tim Dettmers, Mike Lewis, Younes Belkada, and Luke Zettlemoyer. Gpt3.int8(): 8-bit matrix multiplication for transformers at scale. In S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh, editors, Advances in Neural Information Processing Systems, volume 35, pages 30318\u201330332. Curran Associates, Inc., 2022."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.52202\/075280-0441"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.52202\/079017-3950"},{"key":"e_1_3_2_1_25_1","first-page":"971","volume-title":"Proceedings of the VLDB Endowment","volume":"9","author":"Elgohary Ahmed","unstructured":"Ahmed Elgohary, Matthias Boehm, Peter J. Haas, Frederick R. Reiss, and Berthold Reinwald. Compressed linear algebra for large-scale machine learning. In Proceedings of the VLDB Endowment, volume 9, page 960\u2013971. VLDB Endowment, August 2016."},{"key":"e_1_3_2_1_26_1","volume-title":"A frequency-aware software cache for large recommendation system embeddings. arXiv preprint arXiv:2208.05321","author":"Fang Jiarui","year":"2022","unstructured":"Jiarui Fang, Geng Zhang, Jiatong Han, Shenggui Li, Zhengda Bian, Yongbin Li, Jin Liu, and Yang You. A frequency-aware software cache for large recommendation system embeddings. arXiv preprint arXiv:2208.05321, 2022."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3452296.3472904"},{"key":"e_1_3_2_1_28_1","first-page":"1435","volume-title":"Networking, Storage and Analysis SC","author":"Feng Hao","year":"2024","unstructured":"Hao Feng, Boyuan Zhang, Fanjiang Ye, Min Si, Ching-Hsiang Chu, Jiannan Tian, Chunxing Yin, Summer Deng, Yuchen Hao, Pavan Balaji, Tong Geng, and Dingwen Tao. Accelerating Communication in Deep Learning Recommendation Model Training with Dual-Level Adaptive Lossy Compression. In 2024 SC24: International Conference for High Performance Computing, Networking, Storage and Analysis SC, pages 1420\u20131435, Los Alamitos, CA, USA, November 2024. IEEE Computer Society."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/MM.2024.3373763"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISCA45697.2020.00084"},{"key":"e_1_3_2_1_31_1","volume-title":"Advances in Neural Information Processing Systems","author":"Hamilton Will","year":"2017","unstructured":"Will Hamilton, Zhitao Ying, and Jure Leskovec. Inductive representation learning on large graphs. In I. Guyon, U. Von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett, editors, Advances in Neural Information Processing Systems, volume 30. Curran Associates, Inc., 2017."},{"key":"e_1_3_2_1_32_1","unstructured":"Mark Harris. How to optimize data transfers in cuda c\/c++. https:\/\/developer.nvidia.com\/blog\/how-optimize-data-transfers-cuda-cc\/."},{"key":"e_1_3_2_1_33_1","series-title":"Proceedings of Machine Learning Research","first-page":"141","volume-title":"Marco Canini, and Peter Richtarik. Natural compression for distributed deep learning. In Proceedings of Mathematical and Scientific Machine Learning","author":"Horv\u00f3th Samuel","unstructured":"Samuel Horv\u00f3th, Chen-Yu Ho, Ludovit Horvath, Atal Narayan Sahu, Marco Canini, and Peter Richtarik. Natural compression for distributed deep learning. In Proceedings of Mathematical and Scientific Machine Learning, volume 190 of Proceedings of Machine Learning Research, pages 129\u2013141. PMLR, 15\u201317 Aug 2022."},{"key":"e_1_3_2_1_34_1","first-page":"22133","volume-title":"Advances in Neural Information Processing Systems","author":"Hu Weihua","unstructured":"Weihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong, Hongyu Ren, Bowen Liu, Michele Catasta, and Jure Leskovec. Open graph benchmark: Datasets for machine learning on graphs. In H. Larochelle, M. Ranzato, R. Hadsell, M.F. Balcan, and H. Lin, editors, Advances in Neural Information Processing Systems, volume 33, pages 22118\u201322133. Curran Associates, Inc., 2020."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/JRPROC.1952.273898"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/HPCA56546.2023.10070983"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2012.290"},{"key":"e_1_3_2_1_38_1","unstructured":"Paresh Kharya. Tensorfloat-32 in the a100 gpu accelerates ai training hpc up to 20x. https:\/\/blogs.nvidia.com\/blog\/tensorfloat-32-precision-format\/."},{"key":"e_1_3_2_1_39_1","volume-title":"Datasets for benchmarking floating-point compressors","author":"Knorr Fabian","year":"2020","unstructured":"Fabian Knorr, Peter Thoman, and Thomas Fahringer. Datasets for benchmarking floating-point compressors, 2020."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3458817.3476224"},{"key":"e_1_3_2_1_41_1","first-page":"1750","volume-title":"Proceedings of the 31st International Conference on Neural Information Processing Systems, NIPS'17","author":"K\u00f6ster Urs","year":"2017","unstructured":"Urs K\u00f6ster, Tristan J. Webb, Xin Wang, Marcel Nassar, Arjun K. Bansal, William H. Constable, O\u011fuz H. Elibol, Scott Gray, Stewart Hall, Luke Hornof, Amir Khosrowshahi, Carey Kloss, Ruby J. Pai, and Naveen Rao. Flexpoint: an adaptive numerical format for efficient training of deep neural networks. In Proceedings of the 31st International Conference on Neural Information Processing Systems, NIPS'17, page 1740\u20131750, Red Hook, NY, USA, 2017. Curran Associates Inc."},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3606376.3593571"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3600006.3613165"},{"key":"e_1_3_2_1_44_1","first-page":"172","volume-title":"18th USENIX Symposium on Operating Systems Design and Implementation (OSDI 24)","author":"Lee Wonbeom","year":"2024","unstructured":"Wonbeom Lee, Jungi Lee, Junghwan Seo, and Jaewoong Sim. InfiniGen: Efficient generative inference of large language models with dynamic KV cache management. In 18th USENIX Symposium on Operating Systems Design and Implementation (OSDI 24), pages 155\u2013172, Santa Clara, CA, July 2024. USENIX Association."},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3300070"},{"key":"e_1_3_2_1_46_1","volume-title":"Minlan Yu. THC: Accelerating Distributed Deep Learning Using Tensor Homomorphic Compression. In USENIX Symposium on Networked Systems Design and Implementation (NSDI)","author":"Li Minghao","year":"2024","unstructured":"Minghao Li, Ran Ben Basat, Shay Vargaftik, ChonLam Lao, Kevin Xu, Michael Mitzenmacher, and Minlan Yu. THC: Accelerating Distributed Deep Learning Using Tensor Homomorphic Compression. In USENIX Symposium on Networked Systems Design and Implementation (NSDI), 2024."},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3605573.3605613"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2463676.2465322"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3605573.3605588"},{"key":"e_1_3_2_1_50_1","unstructured":"Yuan Lin and Vinod Grover. Using cuda warp-level primitives. https:\/\/developer.nvidia.com\/blog\/using-cuda-warp-level-primitives\/."},{"key":"e_1_3_2_1_51_1","volume-title":"William Dally. Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training. In International Conference on Learning Representations","author":"Lin Yujun","year":"2018","unstructured":"Yujun Lin, Song Han, Huizi Mao, Yu Wang, and William Dally. Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training. In International Conference on Learning Representations, 2018."},{"key":"e_1_3_2_1_52_1","first-page":"415","volume-title":"Proceedings of the 11th ACM Symposium on Cloud Computing, SoCC '20","author":"Lin Zhiqi","year":"2020","unstructured":"Zhiqi Lin, Cheng Li, Youshan Miao, Yunxin Liu, and Yinlong Xu. Pagraph: Scaling gnn training on large graphs via computation-aware caching. In Proceedings of the 11th ACM Symposium on Cloud Computing, SoCC '20, page 401\u2013415, New York, NY, USA, 2020. Association for Computing Machinery."},{"key":"e_1_3_2_1_53_1","first-page":"2045","volume-title":"Advances in Neural Information Processing Systems","author":"Liu Shuwen","unstructured":"Shuwen Liu, Bernardo Grau, Ian Horrocks, and Egor Kostylev. Indigo: Gnn-based inductive knowledge graph completion using pair-wise encoding. In M. Ranzato, A. Beygelzimer, Y. Dauphin, P.S. Liang, and J. Wortman Vaughan, editors, Advances in Neural Information Processing Systems, volume 34, pages 2034\u20132045. Curran Associates, Inc., 2021."},{"key":"e_1_3_2_1_54_1","first-page":"118","volume-title":"20th USENIX Symposium on Networked Systems Design and Implementation (NSDI 23)","author":"Liu Tianfeng","year":"2023","unstructured":"Tianfeng Liu, Yangrui Chen, Dan Li, Chuan Wu, Yibo Zhu, Jun He, Yanghua Peng, Hongzheng Chen, Hongzhi Chen, and Chuanxiong Guo. BGL: GPU-Efficient GNN training by optimizing graph data I\/O and preprocessing. In 20th USENIX Symposium on Networked Systems Design and Implementation (NSDI 23), pages 103\u2013118, Boston, MA, April 2023. USENIX Association."},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442381.3449989"},{"key":"e_1_3_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3651890.3672274"},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01126"},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.14778\/3681954.3681968"},{"key":"e_1_3_2_1_59_1","volume-title":"Bifeat: Supercharge gnn training via graph feature quantization. arXiv preprint arXiv:2207.14696","author":"Ma Yuxin","year":"2023","unstructured":"Yuxin Ma, Ping Gong, Jun Yi, Zhewei Yao, Cheng Li, Yuxiong He, and Feng Yan. Bifeat: Supercharge gnn training via graph feature quantization. arXiv preprint arXiv:2207.14696, 2023."},{"key":"e_1_3_2_1_60_1","first-page":"127","volume-title":"Proceedings of the VLDB Endowment","volume":"14","author":"Min Seung Won","unstructured":"Seung Won Min, Vikram Sharma Mailthody, Zaid Qureshi, Jinjun Xiong, Eiman Ebrahimi, and Wen-mei Hwu. Emogi: efficient memoryaccess for out-of-memory graph-traversal in gpus. In Proceedings of the VLDB Endowment, volume 14, page 114\u2013127. VLDB Endowment, October 2020."},{"key":"e_1_3_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3470496.3533727"},{"key":"e_1_3_2_1_62_1","volume-title":"Workshop on Mining and Learning with Graphs","author":"Namata Galileo Mark","year":"2012","unstructured":"Galileo Mark Namata, Ben London, Lise Getoor, and Bert Huang. Query-driven active surveying for collective classification. In Workshop on Mining and Learning with Graphs, 2012."},{"key":"e_1_3_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/InPar.2012.6339599"},{"key":"e_1_3_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3575693.3575748"},{"key":"e_1_3_2_1_65_1","series-title":"Proceedings of Machine Learning Research","first-page":"2930","volume-title":"Proceedings of the 34th International Conference on Machine Learning","author":"Rippel Oren","unstructured":"Oren Rippel and Lubomir Bourdev. Real-time adaptive image compression. In Doina Precup and Yee Whye Teh, editors, Proceedings of the 34th International Conference on Machine Learning, volume 70 of Proceedings of Machine Learning Research, pages 2922\u20132930. PMLR, 06\u201311 Aug 2017."},{"key":"e_1_3_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3076113.3076122"},{"key":"e_1_3_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v29i3.2157"},{"key":"e_1_3_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3469379.3469387"},{"key":"e_1_3_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3514221.3526132"},{"key":"e_1_3_2_1_70_1","series-title":"Proceedings of Machine Learning Research","first-page":"31116","volume-title":"Proceedings of the 40th International Conference on Machine Learning","author":"Sheng Ying","unstructured":"Ying Sheng, Lianmin Zheng, Binhang Yuan, Zhuohan Li, Max Ryabinin, Beidi Chen, Percy Liang, Christopher Re, Ion Stoica, and Ce Zhang. FlexGen: High-throughput generative inference of large language models with a single GPU. In Andreas Krause, Emma Brunskill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato, and Jonathan Scarlett, editors, Proceedings of the 40th International Conference on Machine Learning, volume 202 of Proceedings of Machine Learning Research, pages 31094\u201331116. PMLR, 23\u201329 Jul 2023."},{"key":"e_1_3_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/3600006.3613169"},{"key":"e_1_3_2_1_72_1","first-page":"179","volume-title":"2023 USENIX Annual Technical Conference (USENIX ATC 23)","author":"Sun Jie","year":"2023","unstructured":"Jie Sun, Li Su, Zuocheng Shi, Wenting Shen, Zeke Wang, Lei Wang, Jie Zhang, Yong Li, Wenyuan Yu, Jingren Zhou, and Fei Wu. Legion: Automatically pushing the envelope of Multi-GPU system for Billion-Scale GNN training. In 2023 USENIX Annual Technical Conference (USENIX ATC 23), pages 165\u2013179, Boston, MA, July 2023. USENIX Association."},{"key":"e_1_3_2_1_73_1","unstructured":"Matthieu Tardy and Carter Edwards. Controlling data movement to boost performance on the nvidia ampere architecture. https:\/\/developer.nvidia.com\/blog\/controlling-data-movement-to-boost-performance-on-ampere-architecture\/."},{"key":"e_1_3_2_1_74_1","unstructured":"Gemma Team Thomas Mesnard Cassidy Hardin Robert Dadashi Surya Bhupatiraju Shreya Pathak Laurent Sifre Morgane Rivi\u00e8re Mihir Sanjay Kale Juliette Love Pouya Tafti L\u00e9onard Hussenot Pier Giuseppe Sessa Aakanksha Chowdhery Adam Roberts Aditya Barua Alex Botev Alex Castro-Ros Ambrose Slone Am\u00e9lie H\u00e9liou Andrea Tacchetti Anna Bulanova Antonia Paterson Beth Tsai Bobak Shahriari Charline Le Lan Christopher A. Choquette-Choo Cl\u00e9ment Crepy Daniel Cer Daphne Ippolito David Reid Elena Buchatskaya Eric Ni Eric Noland Geng Yan George Tucker George-Christian Muraru Grigory Rozhdestvenskiy Henryk Michalewski Ian Tenney Ivan Grishchenko Jacob Austin James Keeling Jane Labanowski Jean-Baptiste Lespiau Jeff Stanway Jenny Brennan Jeremy Chen Johan Ferret Justin Chiu Justin Mao-Jones Katherine Lee Kathy Yu Katie Millican Lars Lowe Sjoesund Lisa Lee Lucas Dixon Machel Reid Maciej Miku\u0142a Mateo Wirth Michael Sharman Nikolai Chinaev Nithum Thain Olivier Bachem Oscar Chang Oscar Wahltinez Paige Bailey Paul Michel Petko Yotov Rahma Chaabouni Ramona Comanescu Reena Jana Rohan Anil Ross McIlroy Ruibo Liu Ryan Mullins Samuel L Smith Sebastian Borgeaud Sertan Girgin Sholto Douglas Shree Pandya Siamak Shakeri Soham De Ted Klimenko Tom Hennigan Vlad Feinberg Wojciech Stokowiec Yu hui Chen Zafarali Ahmed Zhitao Gong Tris Warkentin Ludovic Peran Minh Giang Cl\u00e9ment Farabet Oriol Vinyals Jeff Dean Koray Kavukcuoglu Demis Hassabis Zoubin Ghahramani Douglas Eck Joelle Barral Fernando Pereira Eli Collins Armand Joulin Noah Fiedel Evan Senter Alek Andreev and Kathleen Kenealy. Gemma: Open models based on gemini research and technology 2024."},{"key":"e_1_3_2_1_75_1","volume-title":"Advances in Neural Information Processing Systems","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. Attention is all you need. In I. Guyon, U. Von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett, editors, Advances in Neural Information Processing Systems, volume 30. Curran Associates, Inc., 2017."},{"key":"e_1_3_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3552326.3567501"},{"key":"e_1_3_2_1_77_1","volume-title":"International Conference on Learning Representations","author":"Wang Guanhua","year":"2024","unstructured":"Guanhua Wang, Heyang Qin, Sam Ade Jacobs, Xiaoxia Wu, Connor Holmes, Zhewei Yao, Samyam Rajbhandari, Olatunji Ruwase, Feng Yan, Lei Yang, and Yuxiong He. ZeRO++: Extremely Efficient Collective Communication for Large Model Training. In International Conference on Learning Representations, 2024."},{"key":"e_1_3_2_1_78_1","volume-title":"Deep graph library: A graph-centric, highly-performant package for graph neural networks. arXiv preprint arXiv:1909.01315","author":"Wang Minjie","year":"2019","unstructured":"Minjie Wang, Da Zheng, Zihao Ye, Quan Gan, Mufei Li, Xiang Song, Jinjing Zhou, Chao Ma, Lingfan Yu, Yu Gai, Tianjun Xiao, Tong He, George Karypis, Jinyang Li, and Zheng Zhang. Deep graph library: A graph-centric, highly-performant package for graph neural networks. arXiv preprint arXiv:1909.01315, 2019."},{"key":"e_1_3_2_1_79_1","unstructured":"Shibo Wang and Pankaj Kanwar. Bfloat16: The secret to high performance on cloud tpus. https:\/\/cloud.google.com\/blog\/products\/ai-machine-learning\/bfloat16-the-secret-to-high-performance-on-cloud-tpus."},{"key":"e_1_3_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/3523227.3546765"},{"key":"e_1_3_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1145\/3673038.3673067"},{"key":"e_1_3_2_1_82_1","first-page":"960","volume-title":"19th USENIX Symposium on Networked Systems Design and Implementation (NSDI 22)","author":"Weng Qizhen","year":"2022","unstructured":"Qizhen Weng, Wencong Xiao, Yinghao Yu, Wei Wang, Cheng Wang, Jian He, Yong Li, Liping Zhang, Wei Lin, and Yu Ding. MLaaS in the wild: Workload analysis and scheduling in Large-Scale heterogeneous GPU clusters. In 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI 22), pages 945\u2013960, Renton, WA, April 2022. USENIX Association."},{"key":"e_1_3_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1109\/19.492748"},{"key":"e_1_3_2_1_84_1","first-page":"572","volume-title":"Panos Kalnis. GRACE: A Compressed Communication Framework for Distributed Machine Learning. In 2021 IEEE 41st International Conference on Distributed Computing Systems (ICDCS)","author":"Xu Hang","year":"2021","unstructured":"Hang Xu, Chen-Yu Ho, Ahmed M. Abdelmoniem, Aritra Dutta, El Houcine Bergou, Konstantinos Karatsenidis, Marco Canini, and Panos Kalnis. GRACE: A Compressed Communication Framework for Distributed Machine Learning. In 2021 IEEE 41st International Conference on Distributed Computing Systems (ICDCS), pages 561\u2013572, 2021."},{"key":"e_1_3_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1109\/CLUSTER.2015.59"},{"key":"e_1_3_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1145\/3492321.3519557"},{"key":"e_1_3_2_1_87_1","first-page":"64995","volume-title":"A. Oh","author":"Yang Ruihan","unstructured":"Ruihan Yang and Stephan Mandt. Lossy image compression with conditional diffusion models. In A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, and S. Levine, editors, Advances in Neural Information Processing Systems, volume 36, pages 64971\u201364995. Curran Associates, Inc., 2023."},{"key":"e_1_3_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASP-DAC58780.2024.10473883"},{"key":"e_1_3_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3219890"},{"key":"e_1_3_2_1_90_1","first-page":"14","volume-title":"Jinho Lee. SGCN: Exploiting Compressed-Sparse Features in Deep Graph Convolutional Network Accelerators. In 2023 IEEE International Symposium on High-Performance Computer Architecture (HPCA)","author":"Yoo Mingi","year":"2023","unstructured":"Mingi Yoo, Jaeyong Song, Jounghoo Lee, Namhyung Kim, Youngsok Kim, and Jinho Lee. SGCN: Exploiting Compressed-Sparse Features in Deep Graph Convolutional Network Accelerators. In 2023 IEEE International Symposium on High-Performance Computer Architecture (HPCA), pages 1\u201314, Los Alamitos, CA, USA, March 2023. IEEE Computer Society."},{"key":"e_1_3_2_1_91_1","unstructured":"Susan Zhang Stephen Roller Naman Goyal Mikel Artetxe Moya Chen Shuohui Chen Christopher Dewan Mona Diab Xian Li Xi Victoria Lin Todor Mihaylov Myle Ott Sam Shleifer Kurt Shuster Daniel Simig Punit Singh Koura Anjali Sridhar Tianlu Wang and Luke Zettlemoyer. Opt: Open pre-trained transformer language models. arXiv preprint arXiv:2205.01068 2022."},{"key":"e_1_3_2_1_92_1","volume-title":"Proceedings of the ACM on Management of Data","volume":"1","author":"Zhang Xin","year":"2023","unstructured":"Xin Zhang, Yanyan Shen, Yingxia Shao, and Lei Chen. Ducati: A dualcache training system for graph neural networks on giant graphs with the gpu. In Proceedings of the ACM on Management of Data, volume 1, New York, NY, USA, June 2023. Association for Computing Machinery."},{"key":"e_1_3_2_1_93_1","volume-title":"Proceedings of the 37th International Conference on Neural Information Processing Systems, NIPS '23","author":"Zhang Zhenyu","year":"2023","unstructured":"Zhenyu Zhang, Ying Sheng, Tianyi Zhou, Tianlong Chen, Lianmin Zheng, Ruisi Cai, Zhao Song, Yuandong Tian, Christopher R\u00e9, Clark Barrett, Zhangyang Wang, and Beidi Chen. H2o: heavy-hitter oracle for efficient generative inference of large language models. In Proceedings of the 37th International Conference on Neural Information Processing Systems, NIPS '23, Red Hook, NY, USA, 2023. Curran Associates Inc."},{"key":"e_1_3_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.1145\/3552326.3567499"},{"key":"e_1_3_2_1_95_1","first-page":"209","volume-title":"Atom: Low-bit quantization for efficient and accurate llm serving","author":"Zhao Yilong","year":"2024","unstructured":"Yilong Zhao, Chien-Yu Lin, Kan Zhu, Zihao Ye, Lequn Chen, Size Zheng, Luis Ceze, Arvind Krishnamurthy, Tianqi Chen, and Baris Kasikci. Atom: Low-bit quantization for efficient and accurate llm serving. In P. Gibbons, G. Pekhimenko, and C. De Sa, editors, Proceedings of Machine Learning and Systems, volume 6, pages 196\u2013209, 2024."},{"key":"e_1_3_2_1_96_1","unstructured":"Richard Zou. Pytorch tutorial: Custom c++ and cuda operators. https:\/\/pytorch.org\/tutorials\/advanced\/cpp_custom_ops.html."}],"event":{"name":"EUROSYS '26: 21st European Conference on Computer Systems","location":"McEwan Hall\/The University of Edinburgh Edinburgh Scotland UK","acronym":"EUROSYS '26","sponsor":["SIGOPS ACM Special Interest Group on Operating Systems"]},"container-title":["Proceedings of the 21st European Conference on Computer Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/abs\/10.1145\/3767295.3803595","content-type":"text\/html","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3767295.3803595","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3767295.3803595","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T12:20:01Z","timestamp":1780662001000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3767295.3803595"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,26]]},"references-count":96,"alternative-id":["10.1145\/3767295.3803595","10.1145\/3767295"],"URL":"https:\/\/doi.org\/10.1145\/3767295.3803595","relation":{},"subject":[],"published":{"date-parts":[[2026,4,26]]},"assertion":[{"value":"2026-04-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}