{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,5]],"date-time":"2026-11-05T02:48:44Z","timestamp":1793846924689,"version":"4.6.1"},"publisher-location":"New York, NY, USA","reference-count":32,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,3,25]],"date-time":"2023-03-25T00:00:00Z","timestamp":1679702400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,3,25]]},"DOI":"10.1145\/3582016.3582018","type":"proceedings-article","created":{"date-parts":[[2023,3,20]],"date-time":"2023-03-20T16:59:03Z","timestamp":1679331543000},"page":"302-313","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":31,"title":["Graphene: An IR for Optimized Tensor Computations on GPUs"],"prefix":"10.1145","author":[{"given":"Bastian","family":"Hagedorn","sequence":"first","affiliation":[{"name":"NVIDIA, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bin","family":"Fan","sequence":"additional","affiliation":[{"name":"NVIDIA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hanfeng","family":"Chen","sequence":"additional","affiliation":[{"name":"NVIDIA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cris","family":"Cecka","sequence":"additional","affiliation":[{"name":"NVIDIA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Garland","sequence":"additional","affiliation":[{"name":"NVIDIA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vinod","family":"Grover","sequence":"additional","affiliation":[{"name":"NVIDIA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,3,25]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"CUTLASS: Python API, Enhancements, and CUTLASS 3.0 Preview (Announcing the CuTe programming model). https:\/\/static.rainfocus.com\/nvidia\/gtcfall2022\/sess\/1655735950588001cX98\/supmat\/A41131","author":"NVIDIA GTC","year":"2022","unstructured":"NVIDIA GTC Fall 2022. 2022 . CUTLASS: Python API, Enhancements, and CUTLASS 3.0 Preview (Announcing the CuTe programming model). https:\/\/static.rainfocus.com\/nvidia\/gtcfall2022\/sess\/1655735950588001cX98\/supmat\/A41131 NVIDIA GTC Fall 2022. 2022. CUTLASS: Python API, Enhancements, and CUTLASS 3.0 Preview (Announcing the CuTe programming model). https:\/\/static.rainfocus.com\/nvidia\/gtcfall2022\/sess\/1655735950588001cX98\/supmat\/A41131"},{"key":"e_1_3_2_1_2_1","unstructured":"Robert Atkey Michel Steuwer Sam Lindley and Christophe Dubach. 2017. Strategy Preserving Compilation for Parallel Functional Code. \t\t\t\t  Robert Atkey Michel Steuwer Sam Lindley and Christophe Dubach. 2017. Strategy Preserving Compilation for Parallel Functional Code."},{"key":"e_1_3_2_1_3_1","volume-title":"Automatic Kernel Generation for Volta Tensor Cores. CoRR abs\/2006.12645","author":"Bhaskaracharya Somashekaracharya G.","year":"2020","unstructured":"Somashekaracharya G. Bhaskaracharya , Julien Demouth , and Vinod Grover . 2020. Automatic Kernel Generation for Volta Tensor Cores. CoRR abs\/2006.12645 ( 2020 ). arxiv:2006.12645 https:\/\/arxiv.org\/abs\/2006.12645 Somashekaracharya G. Bhaskaracharya, Julien Demouth, and Vinod Grover. 2020. Automatic Kernel Generation for Volta Tensor Cores. CoRR abs\/2006.12645 (2020). arxiv:2006.12645 https:\/\/arxiv.org\/abs\/2006.12645"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3485137"},{"key":"e_1_3_2_1_5_1","volume-title":"TVM: An Automated End-to-End Optimizing Compiler for Deep Learning. In 13th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2018","author":"Chen Tianqi","year":"2018","unstructured":"Tianqi Chen , Thierry Moreau , Ziheng Jiang , Lianmin Zheng , Eddie Q. Yan , Haichen Shen , Meghan Cowan , Leyuan Wang , Yuwei Hu , Luis Ceze , Carlos Guestrin , and Arvind Krishnamurthy . 2018 . TVM: An Automated End-to-End Optimizing Compiler for Deep Learning. In 13th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2018 , Carlsbad, CA, USA , October 8-10, 2018. 578\u2013594. https:\/\/www.usenix.org\/conference\/osdi18\/presentation\/chen Tianqi Chen, Thierry Moreau, Ziheng Jiang, Lianmin Zheng, Eddie Q. Yan, Haichen Shen, Meghan Cowan, Leyuan Wang, Yuwei Hu, Luis Ceze, Carlos Guestrin, and Arvind Krishnamurthy. 2018. TVM: An Automated End-to-End Optimizing Compiler for Deep Learning. In 13th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2018, Carlsbad, CA, USA, October 8-10, 2018. 578\u2013594. https:\/\/www.usenix.org\/conference\/osdi18\/presentation\/chen"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/n19-1423"},{"key":"e_1_3_2_1_7_1","volume-title":"Yong Yu, and Tianqi Chen.","author":"Feng Siyuan","year":"2022","unstructured":"Siyuan Feng , Bohan Hou , Hongyi Jin , Wuwei Lin , Junru Shao , Ruihang Lai , Zihao Ye , Lianmin Zheng , Cody Hao Yu , Yong Yu, and Tianqi Chen. 2022 . TensorIR: An Abstraction for Automatic Tensorized Program Optimization . Siyuan Feng, Bohan Hou, Hongyi Jin, Wuwei Lin, Junru Shao, Ruihang Lai, Zihao Ye, Lianmin Zheng, Cody Hao Yu, Yong Yu, and Tianqi Chen. 2022. TensorIR: An Abstraction for Automatic Tensorized Program Optimization."},{"key":"e_1_3_2_1_8_1","unstructured":"Google. 2017. TensorFlow XLA. https:\/\/www.tensorflow.org\/xla \t\t\t\t  Google. 2017. TensorFlow XLA. https:\/\/www.tensorflow.org\/xla"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3410463.3414632"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/MM.2020.2985963"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/CGO51591.2021.9370308"},{"key":"e_1_3_2_1_12_1","volume-title":"GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding. In 9th International Conference on Learning Representations, ICLR 2021","author":"Lepikhin Dmitry","year":"2021","unstructured":"Dmitry Lepikhin , HyoukJoong Lee , Yuanzhong Xu , Dehao Chen , Orhan Firat , Yanping Huang , Maxim Krikun , Noam Shazeer , and Zhifeng Chen . 2021 . GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding. In 9th International Conference on Learning Representations, ICLR 2021 , Virtual Event, Austria , May 3-7, 2021. OpenReview.net. https:\/\/openreview.net\/forum?id=qrwe7XHTmYb Dmitry Lepikhin, HyoukJoong Lee, Yuanzhong Xu, Dehao Chen, Orhan Firat, Yanping Huang, Maxim Krikun, Noam Shazeer, and Zhifeng Chen. 2021. GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021. OpenReview.net. https:\/\/openreview.net\/forum?id=qrwe7XHTmYb"},{"key":"e_1_3_2_1_13_1","unstructured":"MLIR. 2022. \u2019gpu\u2019 Dialect. https:\/\/mlir.llvm.org\/docs\/Dialects\/GPU\/ \t\t\t\t  MLIR. 2022. \u2019gpu\u2019 Dialect. https:\/\/mlir.llvm.org\/docs\/Dialects\/GPU\/"},{"key":"e_1_3_2_1_14_1","unstructured":"NVIDIA. 2017. Volta Architecture Whitepaper. https:\/\/images.nvidia.com\/content\/volta-architecture\/pdf\/volta-architecture-whitepaper.pdf \t\t\t\t  NVIDIA. 2017. Volta Architecture Whitepaper. https:\/\/images.nvidia.com\/content\/volta-architecture\/pdf\/volta-architecture-whitepaper.pdf"},{"key":"e_1_3_2_1_15_1","unstructured":"NVIDIA. 2018. Turing Architecture Whitepaper. https:\/\/images.nvidia.com\/aem-dam\/en-zz\/Solutions\/design-visualization\/technologies\/turing-architecture\/NVIDIA-Turing-Architecture-Whitepaper.pdf \t\t\t\t  NVIDIA. 2018. Turing Architecture Whitepaper. https:\/\/images.nvidia.com\/aem-dam\/en-zz\/Solutions\/design-visualization\/technologies\/turing-architecture\/NVIDIA-Turing-Architecture-Whitepaper.pdf"},{"key":"e_1_3_2_1_16_1","unstructured":"NVIDIA. 2021. Ampere Architecture Whitepaper. https:\/\/www.nvidia.com\/content\/PDF\/nvidia-ampere-ga-102-gpu-architecture-whitepaper-v2.1.pdf \t\t\t\t  NVIDIA. 2021. Ampere Architecture Whitepaper. https:\/\/www.nvidia.com\/content\/PDF\/nvidia-ampere-ga-102-gpu-architecture-whitepaper-v2.1.pdf"},{"key":"e_1_3_2_1_17_1","unstructured":"NVIDIA. 2022. CUTLASS - CuTe documentation. https:\/\/github.com\/NVIDIA\/cutlass\/tree\/master\/media\/docs\/cute \t\t\t\t  NVIDIA. 2022. CUTLASS - CuTe documentation. https:\/\/github.com\/NVIDIA\/cutlass\/tree\/master\/media\/docs\/cute"},{"key":"e_1_3_2_1_18_1","unstructured":"NVIDIA. 2022. CUTLASS - CuTe Predication. https:\/\/github.com\/NVIDIA\/cutlass\/blob\/master\/media\/docs\/cute\/0y_predication.md \t\t\t\t  NVIDIA. 2022. CUTLASS - CuTe Predication. https:\/\/github.com\/NVIDIA\/cutlass\/blob\/master\/media\/docs\/cute\/0y_predication.md"},{"key":"e_1_3_2_1_19_1","unstructured":"NVIDIA. 2022. PTX ISA. https:\/\/docs.nvidia.com\/cuda\/parallel-thread-execution\/index.html \t\t\t\t  NVIDIA. 2022. PTX ISA. https:\/\/docs.nvidia.com\/cuda\/parallel-thread-execution\/index.html"},{"key":"e_1_3_2_1_20_1","unstructured":"NVIDIA. 2022. PTX ISA - SM70 mma-884-f16. https:\/\/docs.nvidia.com\/cuda\/parallel-thread-execution\/index.html#warp-level-matrix-fragment-mma-884-f16 \t\t\t\t  NVIDIA. 2022. PTX ISA - SM70 mma-884-f16. https:\/\/docs.nvidia.com\/cuda\/parallel-thread-execution\/index.html#warp-level-matrix-fragment-mma-884-f16"},{"key":"e_1_3_2_1_21_1","volume-title":"Mesh-TensorFlow: Deep Learning for Supercomputers. In Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018","author":"Shazeer Noam","year":"2018","unstructured":"Noam Shazeer , Youlong Cheng , Niki Parmar , Dustin Tran , Ashish Vaswani , Penporn Koanantakool , Peter Hawkins , HyoukJoong Lee , Mingsheng Hong , Cliff Young , Ryan Sepassi , and Blake A. Hechtman . 2018 . Mesh-TensorFlow: Deep Learning for Supercomputers. In Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018 , NeurIPS 2018 , December 3-8, 2018, Montr\u00e9al, Canada, Samy Bengio, Hanna M. Wallach, Hugo Larochelle, Kristen Grauman, Nicol\u00f2 Cesa-Bianchi, and Roman Garnett (Eds.). 10435\u201310444. https:\/\/proceedings.neurips.cc\/paper\/2018\/hash\/3a37abdeefe1dab1b30f7c5c7e581b93-Abstract.html Noam Shazeer, Youlong Cheng, Niki Parmar, Dustin Tran, Ashish Vaswani, Penporn Koanantakool, Peter Hawkins, HyoukJoong Lee, Mingsheng Hong, Cliff Young, Ryan Sepassi, and Blake A. Hechtman. 2018. Mesh-TensorFlow: Deep Learning for Supercomputers. In Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018, December 3-8, 2018, Montr\u00e9al, Canada, Samy Bengio, Hanna M. Wallach, Hugo Larochelle, Kristen Grauman, Nicol\u00f2 Cesa-Bianchi, and Roman Garnett (Eds.). 10435\u201310444. https:\/\/proceedings.neurips.cc\/paper\/2018\/hash\/3a37abdeefe1dab1b30f7c5c7e581b93-Abstract.html"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3530390.3532733"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/3049832.3049841"},{"key":"e_1_3_2_1_24_1","unstructured":"Vijay Thakkar Pradeep Ramani Cris Cecka Aniket Shivam Honghao Lu Ethan Yan Jack Kosaian Mark Hoemmen Haicheng Wu Andrew Kerr Matt Nicely Duane Merrill Dustyn Blasig Fengqi Qiao Piotr Majcher Paul Springer Markus Hohnerbach Jin Wang and Manish Gupta. 2023. CUTLASS. https:\/\/github.com\/NVIDIA\/cutlass \t\t\t\t  Vijay Thakkar Pradeep Ramani Cris Cecka Aniket Shivam Honghao Lu Ethan Yan Jack Kosaian Mark Hoemmen Haicheng Wu Andrew Kerr Matt Nicely Duane Merrill Dustyn Blasig Fengqi Qiao Piotr Majcher Paul Springer Markus Hohnerbach Jin Wang and Manish Gupta. 2023. CUTLASS. https:\/\/github.com\/NVIDIA\/cutlass"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3315508.3329973"},{"key":"e_1_3_2_1_26_1","unstructured":"OpenAI Triton. 2022. Triton Instruction Selection Transformation Pass. https:\/\/github.com\/openai\/triton\/blob\/master\/lib\/codegen\/selection\/generator.cc \t\t\t\t  OpenAI Triton. 2022. Triton Instruction Selection Transformation Pass. https:\/\/github.com\/openai\/triton\/blob\/master\/lib\/codegen\/selection\/generator.cc"},{"key":"e_1_3_2_1_27_1","unstructured":"Apache TVM. 2022. Use Tensorize to Leverage Hardware Intrinsics. https:\/\/tvm.apache.org\/docs\/how_to\/work_with_schedules\/tensorize.html \t\t\t\t  Apache TVM. 2022. Use Tensorize to Leverage Hardware Intrinsics. https:\/\/tvm.apache.org\/docs\/how_to\/work_with_schedules\/tensorize.html"},{"key":"e_1_3_2_1_28_1","volume-title":"Composable and Modular Code Generation in MLIR: A Structured and Retargetable Approach to Tensor Compiler Construction. CoRR abs\/2202.03293","author":"Vasilache Nicolas","year":"2022","unstructured":"Nicolas Vasilache , Oleksandr Zinenko , Aart J. C. Bik , Mahesh Ravishankar , Thomas Raoux , Alexander Belyaev , Matthias Springer , Tobias Gysi , Diego Caballero , Stephan Herhut , Stella Laurenzo , and Albert Cohen . 2022. Composable and Modular Code Generation in MLIR: A Structured and Retargetable Approach to Tensor Compiler Construction. CoRR abs\/2202.03293 ( 2022 ). arxiv:2202.03293 https:\/\/arxiv.org\/abs\/2202.03293 Nicolas Vasilache, Oleksandr Zinenko, Aart J. C. Bik, Mahesh Ravishankar, Thomas Raoux, Alexander Belyaev, Matthias Springer, Tobias Gysi, Diego Caballero, Stephan Herhut, Stella Laurenzo, and Albert Cohen. 2022. Composable and Modular Code Generation in MLIR: A Structured and Retargetable Approach to Tensor Compiler Construction. CoRR abs\/2202.03293 (2022). arxiv:2202.03293 https:\/\/arxiv.org\/abs\/2202.03293"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/CGO51591.2021.9370330"},{"key":"e_1_3_2_1_30_1","volume-title":"Proceedings of Machine Learning and Systems 2022","author":"Xie Ningning","year":"2022","unstructured":"Ningning Xie , Tamara Norman , Dominik Grewe , and Dimitrios Vytiniotis . 2022 . Synthesizing Optimal Parallelism Placement and Reduction Strategies on Hierarchical Systems for Deep Learning . In Proceedings of Machine Learning and Systems 2022 , MLSys 2022, Santa Clara, CA, USA, August 29 - September 1, 2022, Diana Marculescu, Yuejie Chi, and Carole-Jean Wu (Eds.). mlsys.org. https:\/\/proceedings.mlsys.org\/paper\/2022\/hash\/b73ce398c39f506af761d2277d853a92-Abstract.html Ningning Xie, Tamara Norman, Dominik Grewe, and Dimitrios Vytiniotis. 2022. Synthesizing Optimal Parallelism Placement and Reduction Strategies on Hierarchical Systems for Deep Learning. In Proceedings of Machine Learning and Systems 2022, MLSys 2022, Santa Clara, CA, USA, August 29 - September 1, 2022, Diana Marculescu, Yuejie Chi, and Carole-Jean Wu (Eds.). mlsys.org. https:\/\/proceedings.mlsys.org\/paper\/2022\/hash\/b73ce398c39f506af761d2277d853a92-Abstract.html"},{"key":"e_1_3_2_1_31_1","volume-title":"GSPMD: General and Scalable Parallelization for ML Computation Graphs. CoRR abs\/2105.04663","author":"Xu Yuanzhong","year":"2021","unstructured":"Yuanzhong Xu , HyoukJoong Lee , Dehao Chen , Blake A. Hechtman , Yanping Huang , Rahul Joshi , Maxim Krikun , Dmitry Lepikhin , Andy Ly , Marcello Maggioni , Ruoming Pang , Noam Shazeer , Shibo Wang , Tao Wang , Yonghui Wu , and Zhifeng Chen . 2021 . GSPMD: General and Scalable Parallelization for ML Computation Graphs. CoRR abs\/2105.04663 (2021). arxiv:2105.04663 https:\/\/arxiv.org\/abs\/2105.04663 Yuanzhong Xu, HyoukJoong Lee, Dehao Chen, Blake A. Hechtman, Yanping Huang, Rahul Joshi, Maxim Krikun, Dmitry Lepikhin, Andy Ly, Marcello Maggioni, Ruoming Pang, Noam Shazeer, Shibo Wang, Tao Wang, Yonghui Wu, and Zhifeng Chen. 2021. GSPMD: General and Scalable Parallelization for ML Computation Graphs. CoRR abs\/2105.04663 (2021). arxiv:2105.04663 https:\/\/arxiv.org\/abs\/2105.04663"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3470496.3527440"}],"event":{"name":"ASPLOS '23: 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 3","location":"Vancouver BC Canada","acronym":"ASPLOS '23","sponsor":["SIGARCH ACM Special Interest Group on Computer Architecture","SIGOPS ACM Special Interest Group on Operating Systems","SIGPLAN ACM Special Interest Group on Programming Languages","SIGBED ACM Special Interest Group on Embedded Systems"]},"container-title":["Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 3"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3582016.3582018","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:46:44Z","timestamp":1750178804000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3582016.3582018"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,25]]},"references-count":32,"alternative-id":["10.1145\/3582016.3582018","10.1145\/3582016"],"URL":"https:\/\/doi.org\/10.1145\/3582016.3582018","relation":{},"subject":[],"published":{"date-parts":[[2023,3,25]]},"assertion":[{"value":"2023-03-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}