{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T23:22:22Z","timestamp":1776468142501,"version":"3.51.2"},"publisher-location":"New York, NY, USA","reference-count":35,"publisher":"ACM","license":[{"start":{"date-parts":[[2018,6,18]],"date-time":"2018-06-18T00:00:00Z","timestamp":1529280000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2018,6,18]]},"DOI":"10.1145\/3211346.3211348","type":"proceedings-article","created":{"date-parts":[[2018,6,7]],"date-time":"2018-06-07T19:49:37Z","timestamp":1528400977000},"page":"58-68","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":81,"title":["Relay: a new IR for machine learning frameworks"],"prefix":"10.1145","author":[{"given":"Jared","family":"Roesch","sequence":"first","affiliation":[{"name":"University of Washington, USA"}]},{"given":"Steven","family":"Lyubomirsky","sequence":"additional","affiliation":[{"name":"University of Washington, USA"}]},{"given":"Logan","family":"Weber","sequence":"additional","affiliation":[{"name":"University of Washington, USA"}]},{"given":"Josh","family":"Pollock","sequence":"additional","affiliation":[{"name":"University of Washington, USA"}]},{"given":"Marisa","family":"Kirisame","sequence":"additional","affiliation":[{"name":"University of Washington, USA"}]},{"given":"Tianqi","family":"Chen","sequence":"additional","affiliation":[{"name":"University of Washington, USA"}]},{"given":"Zachary","family":"Tatlock","sequence":"additional","affiliation":[{"name":"University of Washington, USA"}]}],"member":"320","published-online":{"date-parts":[[2018,6,18]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16)","author":"Abadi Martin","year":"2016","unstructured":"Martin Abadi , Paul Barham , Jianmin Chen , Zhifeng Chen , Andy Davis , Jeffrey Dean , Matthieu Devin , Sanjay Ghemawat , Geoffrey Irving , Michael Isard , Manjunath Kudlur , Josh Levenberg , Rajat Monga , Sherry Moore , Derek G. Murray , Benoit Steiner , Paul Tucker , Vijay Vasudevan , Pete Warden , Martin Wicke , Yuan Yu , and Xiaoqiang Zheng . 2016 . TensorFlow: A system for large-scale machine learning . In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16) . 265\u2013283. https:\/\/www.usenix.org\/system\/files\/conference\/osdi16\/ osdi16-abadi.pdf Martin Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, Manjunath Kudlur, Josh Levenberg, Rajat Monga, Sherry Moore, Derek G. Murray, Benoit Steiner, Paul Tucker, Vijay Vasudevan, Pete Warden, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng. 2016. TensorFlow: A system for large-scale machine learning. In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16). 265\u2013283. https:\/\/www.usenix.org\/system\/files\/conference\/osdi16\/ osdi16-abadi.pdf"},{"key":"e_1_3_2_1_2_1","volume-title":"Murray","author":"Abadi Martin","year":"2017","unstructured":"Martin Abadi , Michael Isard , and Derek G . Murray . 2017 . A Computational Model for TensorFlow (An Introduction) . Martin Abadi, Michael Isard, and Derek G. Murray. 2017. A Computational Model for TensorFlow (An Introduction)."},{"key":"e_1_3_2_1_3_1","volume-title":"DeepCoder: Learning to Write Programs. CoRR abs\/1611.01989","author":"Balog Matej","year":"2016","unstructured":"Matej Balog , Alexander L. Gaunt , Marc Brockschmidt , Sebastian Nowozin , and Daniel Tarlow . 2016. DeepCoder: Learning to Write Programs. CoRR abs\/1611.01989 ( 2016 ). arXiv: 1611.01989 http:\/\/arxiv. org\/abs\/1611.01989 Matej Balog, Alexander L. Gaunt, Marc Brockschmidt, Sebastian Nowozin, and Daniel Tarlow. 2016. DeepCoder: Learning to Write Programs. CoRR abs\/1611.01989 (2016). arXiv: 1611.01989 http:\/\/arxiv. org\/abs\/1611.01989"},{"key":"e_1_3_2_1_4_1","volume-title":"Alexey Andreyevich Radul, and Jeffrey Mark Siskind","author":"Baydin Atilim Gunes","year":"2015","unstructured":"Atilim Gunes Baydin , Barak A. Pearlmutter , Alexey Andreyevich Radul, and Jeffrey Mark Siskind . 2015 . Automatic differentiation in machine learning: a survey. CoRR abs\/1502.05767 (2015). arXiv: 1502.05767 http:\/\/arxiv.org\/abs\/1502.05767 Atilim Gunes Baydin, Barak A. Pearlmutter, Alexey Andreyevich Radul, and Jeffrey Mark Siskind. 2015. Automatic differentiation in machine learning: a survey. CoRR abs\/1502.05767 (2015). arXiv: 1502.05767 http:\/\/arxiv.org\/abs\/1502.05767"},{"key":"e_1_3_2_1_5_1","unstructured":"Oliver Breuleux and Bart van Merri\u00c3\u0144nboer. 2017. Automatic differentiation in Myia. (2017). https:\/\/openreview.net\/pdf?id=S1hcluzAb  Oliver Breuleux and Bart van Merri\u00c3\u0144nboer. 2017. Automatic differentiation in Myia. (2017). https:\/\/openreview.net\/pdf?id=S1hcluzAb"},{"key":"e_1_3_2_1_6_1","volume-title":"TVM: End-to-End Compilation Stack for Deep Learning. In SysML","author":"Chen Tianqi","year":"2018","unstructured":"Tianqi Chen , Thierry Moreau , Ziheng Jiang , Haichen Shen , Eddie Yan , Leyuan Wang , Yuwei Hu , Luis Ceze , Carlos Guestrin , and Arvind Krishnamurthy . 2018 . TVM: End-to-End Compilation Stack for Deep Learning. In SysML 2018. https:\/\/arxiv.org\/abs\/1802.04799 Tianqi Chen, Thierry Moreau, Ziheng Jiang, Haichen Shen, Eddie Yan, Leyuan Wang, Yuwei Hu, Luis Ceze, Carlos Guestrin, and Arvind Krishnamurthy. 2018. TVM: End-to-End Compilation Stack for Deep Learning. In SysML 2018. https:\/\/arxiv.org\/abs\/1802.04799"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/351240.351266"},{"key":"e_1_3_2_1_8_1","volume-title":"Ng","author":"Dean Jeffrey","year":"2012","unstructured":"Jeffrey Dean , Greg S. Corrado , Rajat Monga , Kai Chen , Matthieu Devin , Quoc V. Le , Mark Z. Mao , Marc\u00e2\u0102\u0179Aurelio Ranzato , Andrew Senior , Paul Tucker , Ke Yang , and Andrew Y . Ng . 2012 . Large Scale Distributed Deep Networks. In NIPS. https:\/\/research.google.com\/archive\/large_ deep_networks_nips2012.html Jeffrey Dean, Greg S. Corrado, Rajat Monga, Kai Chen, Matthieu Devin, Quoc V. Le, Mark Z. Mao, Marc\u00e2\u0102\u0179Aurelio Ranzato, Andrew Senior, Paul Tucker, Ke Yang, and Andrew Y. Ng. 2012. Large Scale Distributed Deep Networks. In NIPS. https:\/\/research.google.com\/archive\/large_ deep_networks_nips2012.html"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3110278"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1596550.1596579"},{"key":"e_1_3_2_1_11_1","volume-title":"Deep Reinforcement Learning for Robotic Manipulation. CoRR abs\/1610.00633","author":"Gu Shixiang","year":"2016","unstructured":"Shixiang Gu , Ethan Holly , Timothy P. Lillicrap , and Sergey Levine . 2016. Deep Reinforcement Learning for Robotic Manipulation. CoRR abs\/1610.00633 ( 2016 ). arXiv: 1610.00633 http:\/\/arxiv.org\/abs\/1610. 00633 Shixiang Gu, Ethan Holly, Timothy P. Lillicrap, and Sergey Levine. 2016. Deep Reinforcement Learning for Robotic Manipulation. CoRR abs\/1610.00633 (2016). arXiv: 1610.00633 http:\/\/arxiv.org\/abs\/1610. 00633"},{"key":"e_1_3_2_1_12_1","volume-title":"Deep Learning with Limited Numerical Precision. CoRR abs\/1502.02551","author":"Gupta Suyog","year":"2015","unstructured":"Suyog Gupta , Ankur Agrawal , Kailash Gopalakrishnan , and Pritish Narayanan . 2015. Deep Learning with Limited Numerical Precision. CoRR abs\/1502.02551 ( 2015 ). arXiv: 1502.02551 http:\/\/arxiv.org\/abs\/ 1502.02551 Suyog Gupta, Ankur Agrawal, Kailash Gopalakrishnan, and Pritish Narayanan. 2015. Deep Learning with Limited Numerical Precision. CoRR abs\/1502.02551 (2015). arXiv: 1502.02551 http:\/\/arxiv.org\/abs\/ 1502.02551"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.14529\/jsfi170206"},{"key":"e_1_3_2_1_14_1","volume-title":"Deep Residual Learning for Image Recognition. CoRR abs\/1512.03385","author":"He Kaiming","year":"2015","unstructured":"Kaiming He , Xiangyu Zhang , Shaoqing Ren , and Jian Sun . 2015. Deep Residual Learning for Image Recognition. CoRR abs\/1512.03385 ( 2015 ). arXiv: 1512.03385 http:\/\/arxiv.org\/abs\/1512.03385 Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2015. Deep Residual Learning for Image Recognition. CoRR abs\/1512.03385 (2015). arXiv: 1512.03385 http:\/\/arxiv.org\/abs\/1512.03385"},{"key":"e_1_3_2_1_15_1","unstructured":"Simon Peyton Jones. {n. d.}. Into the Core - Squeezing Haskell into Nine Constructors. ({n. d.}). https:\/\/www.youtube.com\/watch?v=uR_ VzYxvbxg  Simon Peyton Jones. {n. d.}. Into the Core - Squeezing Haskell into Nine Constructors. ({n. d.}). https:\/\/www.youtube.com\/watch?v=uR_ VzYxvbxg"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3079856.3080246"},{"key":"e_1_3_2_1_17_1","unstructured":"Edward Kmett Barak Pearlmutter and Jeffrey Mark Siskind. 2008. ad: Automatic Differentiation. (2008). https:\/\/github.com\/ekmett\/ad  Edward Kmett Barak Pearlmutter and Jeffrey Mark Siskind. 2008. ad: Automatic Differentiation. (2008). https:\/\/github.com\/ekmett\/ad"},{"key":"e_1_3_2_1_18_1","volume-title":"Proceedings of the 25th International Conference on Neural Information Processing Systems -","volume":"1","author":"Krizhevsky Alex","unstructured":"Alex Krizhevsky , Ilya Sutskever , and Geoffrey E. Hinton . 2012. ImageNet Classification with Deep Convolutional Neural Networks . In Proceedings of the 25th International Conference on Neural Information Processing Systems - Volume 1 (NIPS\u201912). Curran Associates Inc., USA, 1097\u20131105. http:\/\/dl.acm.org\/citation.cfm?id=2999134.2999257 Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. ImageNet Classification with Deep Convolutional Neural Networks. In Proceedings of the 25th International Conference on Neural Information Processing Systems - Volume 1 (NIPS\u201912). Curran Associates Inc., USA, 1097\u20131105. http:\/\/dl.acm.org\/citation.cfm?id=2999134.2999257"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/178243.178246"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"e_1_3_2_1_21_1","volume-title":"Announcing TensorFlow Fold: Deep Learning With Dynamic Computation Graphs. https:\/\/research.googleblog.com\/2017\/02\/ announcing-tensorflow-fold-deep.html . (7","author":"Looks Moshe","year":"2017","unstructured":"Moshe Looks , Marcello Herreshoff , and DeLesley Hutchins . 2017. Announcing TensorFlow Fold: Deep Learning With Dynamic Computation Graphs. https:\/\/research.googleblog.com\/2017\/02\/ announcing-tensorflow-fold-deep.html . (7 February 2017 ). Moshe Looks, Marcello Herreshoff, and DeLesley Hutchins. 2017. Announcing TensorFlow Fold: Deep Learning With Dynamic Computation Graphs. https:\/\/research.googleblog.com\/2017\/02\/ announcing-tensorflow-fold-deep.html . (7 February 2017)."},{"key":"e_1_3_2_1_22_1","unstructured":"Graham Neubig Chris Dyer Yoav Goldberg Austin Matthews Waleed Ammar Antonios Anastasopoulos Miguel Ballesteros David Chiang Daniel Clothiaux Trevor Cohn Kevin Duh Manaal Faruqui Cynthia Gan Dan Garrette Yangfeng Ji Lingpeng Kong Adhiguna Kuncoro Gaurav Kumar Chaitanya Malaviya Paul Michel Yusuke Oda Matthew Richardson Naomi Saphra Swabha Swayamdipta and Pengcheng Yin. {n. d.}. DyNet: The Dynamic Neural Network Toolkit. ({n. d.}). https:\/\/arxiv.org\/abs\/1701.03980  Graham Neubig Chris Dyer Yoav Goldberg Austin Matthews Waleed Ammar Antonios Anastasopoulos Miguel Ballesteros David Chiang Daniel Clothiaux Trevor Cohn Kevin Duh Manaal Faruqui Cynthia Gan Dan Garrette Yangfeng Ji Lingpeng Kong Adhiguna Kuncoro Gaurav Kumar Chaitanya Malaviya Paul Michel Yusuke Oda Matthew Richardson Naomi Saphra Swabha Swayamdipta and Pengcheng Yin. {n. d.}. DyNet: The Dynamic Neural Network Toolkit. ({n. d.}). https:\/\/arxiv.org\/abs\/1701.03980"},{"key":"e_1_3_2_1_23_1","unstructured":"Christopher Olah. 2015. Calculus on Computational Graphs: Backpropagation. (2015). http:\/\/colah.github.io\/posts\/2015-08-Backprop\/  Christopher Olah. 2015. Calculus on Computational Graphs: Backpropagation. (2015). http:\/\/colah.github.io\/posts\/2015-08-Backprop\/"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2737924.2737959"},{"key":"e_1_3_2_1_25_1","unstructured":"Adam Paszke Sam Gross Soumith Chintala Gregory Chanan Edward Yang Zachary DeVito Zeming Lin Alban Desmaison Luca Antiga and Adam Lerer. 2017. Automatic differentiation in PyTorch. (2017). https:\/\/openreview.net\/pdf?id=BJJsrmfCZ  Adam Paszke Sam Gross Soumith Chintala Gregory Chanan Edward Yang Zachary DeVito Zeming Lin Alban Desmaison Luca Antiga and Adam Lerer. 2017. Automatic differentiation in PyTorch. (2017). https:\/\/openreview.net\/pdf?id=BJJsrmfCZ"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1330017.1330018"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2491956.2462176"},{"key":"e_1_3_2_1_28_1","volume-title":"Glow: Graph Lowering Compiler Techniques for Neural Networks. CoRR abs\/1805.00907","author":"Rotem Nadav","year":"2018","unstructured":"Nadav Rotem , Jordan Fix , Saleem Abdulrasool , Summer Deng , Roman Dzhabarov , James Hegeman , Roman Levenstein , Bert Maher , Satish Nadathur , Jakob Olesen , Jongsoo Park , Artem Rakhov , and Misha Smelyanskiy . 2018 . Glow: Graph Lowering Compiler Techniques for Neural Networks. CoRR abs\/1805.00907 (2018). arXiv: 1805.00907 https:\/\/arxiv.org\/abs\/1805.00907 Nadav Rotem, Jordan Fix, Saleem Abdulrasool, Summer Deng, Roman Dzhabarov, James Hegeman, Roman Levenstein, Bert Maher, Satish Nadathur, Jakob Olesen, Jongsoo Park, Artem Rakhov, and Misha Smelyanskiy. 2018. Glow: Graph Lowering Compiler Techniques for Neural Networks. CoRR abs\/1805.00907 (2018). arXiv: 1805.00907 https:\/\/arxiv.org\/abs\/1805.00907"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2594291.2594302"},{"key":"e_1_3_2_1_30_1","volume-title":"Eager Execution: An imperative, define-by-run interface to TensorFlow.","author":"Shankar Asim","year":"2017","unstructured":"Asim Shankar and Wolff Dobson . 2017 . Eager Execution: An imperative, define-by-run interface to TensorFlow. (2017). https: \/\/ai.googleblog.com\/2017\/10\/eager-execution-imperative-define-by. html Asim Shankar and Wolff Dobson. 2017. Eager Execution: An imperative, define-by-run interface to TensorFlow. (2017). https: \/\/ai.googleblog.com\/2017\/10\/eager-execution-imperative-define-by. html"},{"key":"e_1_3_2_1_31_1","unstructured":"Seiya Tokui Kenta Oono Shohei Hido and Justin Clayton. 2015. Chainer: a Next-Generation Open Source Framework for Deep Learning. In Proceedings of Workshop on Machine Learning Systems (LearningSys) in The Twenty-ninth Annual Conference on Neural Information Processing Systems (NIPS). http:\/\/learningsys.org\/papers\/LearningSys_ 2015_paper_33.pdf  Seiya Tokui Kenta Oono Shohei Hido and Justin Clayton. 2015. Chainer: a Next-Generation Open Source Framework for Deep Learning. In Proceedings of Workshop on Machine Learning Systems (LearningSys) in The Twenty-ninth Annual Conference on Neural Information Processing Systems (NIPS). http:\/\/learningsys.org\/papers\/LearningSys_ 2015_paper_33.pdf"},{"key":"e_1_3_2_1_32_1","volume-title":"Tensor Comprehensions: FrameworkAgnostic High-Performance Machine Learning Abstractions.","author":"Vasilache Nicolas","year":"2018","unstructured":"Nicolas Vasilache , Oleksandr Zinenko , Theodoros Theodoridis , Priya Goyal , Zachary DeVito , William S. Moses , Sven Verdoolaege , Andrew Adams , and Albert Cohen . 2018 . Tensor Comprehensions: FrameworkAgnostic High-Performance Machine Learning Abstractions. (2018). arXiv: 1802.04730 https:\/\/arxiv.org\/abs\/1802.04730 Nicolas Vasilache, Oleksandr Zinenko, Theodoros Theodoridis, Priya Goyal, Zachary DeVito, William S. Moses, Sven Verdoolaege, Andrew Adams, and Albert Cohen. 2018. Tensor Comprehensions: FrameworkAgnostic High-Performance Machine Learning Abstractions. (2018). arXiv: 1802.04730 https:\/\/arxiv.org\/abs\/1802.04730"},{"key":"e_1_3_2_1_33_1","unstructured":"Mu Wang and Alex Pothen. 2017. An Overview of High Order Reverse Mode. (2017). https:\/\/openreview.net\/pdf?id=Hkmj6tzRZ  Mu Wang and Alex Pothen. 2017. An Overview of High Order Reverse Mode. (2017). https:\/\/openreview.net\/pdf?id=Hkmj6tzRZ"},{"key":"e_1_3_2_1_34_1","volume-title":"DLVM: A modern compiler infrastructure for deep learning systems. CoRR abs\/1711.03016","author":"Wei Richard","year":"2017","unstructured":"Richard Wei , Vikram S. Adve , and Lane Schwartz . 2017 . DLVM: A modern compiler infrastructure for deep learning systems. CoRR abs\/1711.03016 (2017). arXiv: 1711.03016 http:\/\/arxiv.org\/abs\/1711. 03016 Richard Wei, Vikram S. Adve, and Lane Schwartz. 2017. DLVM: A modern compiler infrastructure for deep learning systems. CoRR abs\/1711.03016 (2017). arXiv: 1711.03016 http:\/\/arxiv.org\/abs\/1711. 03016"},{"key":"e_1_3_2_1_35_1","volume-title":"Tangent: Source-to-Source Debuggable Derivatives.","author":"Wiltschko Alex","year":"2017","unstructured":"Alex Wiltschko . 2017 . Tangent: Source-to-Source Debuggable Derivatives. (2017). https:\/\/ai.googleblog.com\/2017\/11\/ tangent-source-to-source-debuggable.html Alex Wiltschko. 2017. Tangent: Source-to-Source Debuggable Derivatives. (2017). https:\/\/ai.googleblog.com\/2017\/11\/ tangent-source-to-source-debuggable.html"}],"event":{"name":"PLDI '18: ACM SIGPLAN Conference on Programming Language Design and Implementation","location":"Philadelphia PA USA","acronym":"PLDI '18","sponsor":["SIGPLAN ACM Special Interest Group on Programming Languages"]},"container-title":["Proceedings of the 2nd ACM SIGPLAN International Workshop on Machine Learning and Programming Languages"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3211346.3211348","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3211346.3211348","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:08:14Z","timestamp":1750208894000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3211346.3211348"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,6,18]]},"references-count":35,"alternative-id":["10.1145\/3211346.3211348","10.1145\/3211346"],"URL":"https:\/\/doi.org\/10.1145\/3211346.3211348","relation":{},"subject":[],"published":{"date-parts":[[2018,6,18]]},"assertion":[{"value":"2018-06-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}