{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,14]],"date-time":"2026-01-14T18:34:38Z","timestamp":1768415678493,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":17,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,6,23]],"date-time":"2019-06-23T00:00:00Z","timestamp":1561248000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,6,23]]},"DOI":"10.1145\/3315573.3329984","type":"proceedings-article","created":{"date-parts":[[2019,6,7]],"date-time":"2019-06-07T21:02:18Z","timestamp":1559941338000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Automatic GPU memory management for large neural models in TensorFlow"],"prefix":"10.1145","author":[{"given":"Tung D.","family":"Le","sequence":"first","affiliation":[{"name":"IBM Research, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haruki","family":"Imai","sequence":"additional","affiliation":[{"name":"IBM Research, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yasushi","family":"Negishi","sequence":"additional","affiliation":[{"name":"IBM Research, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kiyokuni","family":"Kawachiya","sequence":"additional","affiliation":[{"name":"IBM Research, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,6,23]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"the 1st ACM SIGPLAN International Workshop on Machine Learning and Programming Languages (MAPL) . 1\u20137.","author":"Abadi Mart\u00edn","unstructured":"Mart\u00edn Abadi , Michael Isard , and Derek G. Murray . 2017. A Computational Model for TensorFlow: An Introduction . In the 1st ACM SIGPLAN International Workshop on Machine Learning and Programming Languages (MAPL) . 1\u20137. Mart\u00edn Abadi, Michael Isard, and Derek G. Murray. 2017. A Computational Model for TensorFlow: An Introduction. In the 1st ACM SIGPLAN International Workshop on Machine Learning and Programming Languages (MAPL) . 1\u20137."},{"key":"e_1_3_2_1_2_1","volume-title":"Segmentation Labels and Radiomic Features for the Pre-operative Scans of the TCGA-GBM collection. The Cancer Imaging Archive","author":"Bakas Spyridon","year":"2017","unstructured":"Spyridon Bakas , Hamed Akbari , Aristeidis Sotiras , Michel Bilello , Martin Rozycki , Justin Kirby , John Freymann , Keyvan Farahani , and Christos Davatzikos . 2017. Segmentation Labels and Radiomic Features for the Pre-operative Scans of the TCGA-GBM collection. The Cancer Imaging Archive ( 2017 ). Spyridon Bakas, Hamed Akbari, Aristeidis Sotiras, Michel Bilello, Martin Rozycki, Justin Kirby, John Freymann, Keyvan Farahani, and Christos Davatzikos. 2017. Segmentation Labels and Radiomic Features for the Pre-operative Scans of the TCGA-GBM collection. The Cancer Imaging Archive (2017)."},{"key":"e_1_3_2_1_3_1","volume-title":"Segmentation Labels and Radiomic Features for the Pre-operative Scans of the TCGA-LGG collection. The Cancer Imaging Archive","author":"Bakas Spyridon","year":"2017","unstructured":"Spyridon Bakas , Hamed Akbari , Aristeidis Sotiras , Michel Bilello , Martin Rozycki , Justin Kirby , John Freymann , Keyvan Farahani , and Christos Davatzikos . 2017. Segmentation Labels and Radiomic Features for the Pre-operative Scans of the TCGA-LGG collection. The Cancer Imaging Archive ( 2017 ). Spyridon Bakas, Hamed Akbari, Aristeidis Sotiras, Michel Bilello, Martin Rozycki, Justin Kirby, John Freymann, Keyvan Farahani, and Christos Davatzikos. 2017. Segmentation Labels and Radiomic Features for the Pre-operative Scans of the TCGA-LGG collection. The Cancer Imaging Archive (2017)."},{"key":"e_1_3_2_1_4_1","volume-title":"MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems. CoRR abs\/1512.01274","author":"Chen Tianqi","year":"2015","unstructured":"Tianqi Chen , Mu Li , Yutian Li , Min Lin , Naiyan Wang , Minjie Wang , Tianjun Xiao , Bing Xu , Chiyuan Zhang , and Zheng Zhang . 2015. MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems. CoRR abs\/1512.01274 ( 2015 ). http: \/\/arxiv.org\/abs\/1512.01274 Tianqi Chen, Mu Li, Yutian Li, Min Lin, Naiyan Wang, Minjie Wang, Tianjun Xiao, Bing Xu, Chiyuan Zhang, and Zheng Zhang. 2015. MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems. CoRR abs\/1512.01274 (2015). http: \/\/arxiv.org\/abs\/1512.01274"},{"key":"e_1_3_2_1_5_1","volume-title":"Universal Deep Neural Network Compression. CoRR abs\/1802.02271","author":"Choi Yoojin","year":"2018","unstructured":"Yoojin Choi , Mostafa El-Khamy , and Jungwon Lee . 2018. Universal Deep Neural Network Compression. CoRR abs\/1802.02271 ( 2018 ). http:\/\/arxiv.org\/abs\/1802.02271 Yoojin Choi, Mostafa El-Khamy, and Jungwon Lee. 2018. Universal Deep Neural Network Compression. CoRR abs\/1802.02271 (2018). http:\/\/arxiv.org\/abs\/1802.02271"},{"key":"e_1_3_2_1_6_1","volume-title":"Compressing Low Precision Deep Neural Networks Using Sparsity-Induced Regularization in Ternary Networks. CoRR abs\/1709.06262","author":"Faraone Julian","year":"2017","unstructured":"Julian Faraone , Nicholas J. Fraser , Giulio Gamberdella , Michaela Blott , and Philip Heng Wai Leong . 2017. Compressing Low Precision Deep Neural Networks Using Sparsity-Induced Regularization in Ternary Networks. CoRR abs\/1709.06262 ( 2017 ). http:\/\/arxiv.org\/abs\/1709. 06262 Julian Faraone, Nicholas J. Fraser, Giulio Gamberdella, Michaela Blott, and Philip Heng Wai Leong. 2017. Compressing Low Precision Deep Neural Networks Using Sparsity-Induced Regularization in Ternary Networks. CoRR abs\/1709.06262 (2017). http:\/\/arxiv.org\/abs\/1709. 06262"},{"key":"e_1_3_2_1_7_1","volume-title":"Deep Residual Learning for Image Recognition. CoRR abs\/1512.03385","author":"He Kaiming","year":"2015","unstructured":"Kaiming He , Xiangyu Zhang , Shaoqing Ren , and Jian Sun . 2015. Deep Residual Learning for Image Recognition. CoRR abs\/1512.03385 ( 2015 ). http:\/\/arxiv.org\/abs\/1512.03385 Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2015. Deep Residual Learning for Image Recognition. CoRR abs\/1512.03385 (2015). http:\/\/arxiv.org\/abs\/1512.03385"},{"key":"e_1_3_2_1_8_1","volume-title":"Identity Mappings in Deep Residual Networks. In European Conference on Computer Vision (ECCV) . 630\u2013645","author":"He Kaiming","year":"2016","unstructured":"Kaiming He , Xiangyu Zhang , Shaoqing Ren , and Jian Sun . 2016 . Identity Mappings in Deep Residual Networks. In European Conference on Computer Vision (ECCV) . 630\u2013645 . Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Identity Mappings in Deep Residual Networks. In European Conference on Computer Vision (ECCV) . 630\u2013645."},{"key":"e_1_3_2_1_9_1","unstructured":"IBM. 2016. IBM Power System S822LC for High Performance Computing. http:\/\/www-03.ibm.com\/systems\/power\/hardware\/s822lc-hpc\/ .  IBM. 2016. IBM Power System S822LC for High Performance Computing. http:\/\/www-03.ibm.com\/systems\/power\/hardware\/s822lc-hpc\/ ."},{"key":"e_1_3_2_1_10_1","volume-title":"Maier-Hein","author":"Isensee Fabian","year":"2018","unstructured":"Fabian Isensee , Philipp Kickingereder , Wolfgang Wick , Martin Bendszus , and Klaus H . Maier-Hein . 2018 . Brain Tumor Segmentation and Radiomics Survival Prediction: Contribution to the BRATS 2017 Challenge. CoRR abs\/1802.10508 (2018). http:\/\/arxiv.org\/abs\/1802.10508 Fabian Isensee, Philipp Kickingereder, Wolfgang Wick, Martin Bendszus, and Klaus H. Maier-Hein. 2018. Brain Tumor Segmentation and Radiomics Survival Prediction: Contribution to the BRATS 2017 Challenge. CoRR abs\/1802.10508 (2018). http:\/\/arxiv.org\/abs\/1802.10508"},{"key":"e_1_3_2_1_11_1","volume-title":"ImageNet Classification with Deep Convolutional Neural Networks. In International Conference on Neural Information Processing Systems (NIPS) . 1097\u20131105","author":"Krizhevsky Alex","unstructured":"Alex Krizhevsky , Ilya Sutskever , and Geoffrey E. Hinton . 2012 . ImageNet Classification with Deep Convolutional Neural Networks. In International Conference on Neural Information Processing Systems (NIPS) . 1097\u20131105 . Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. ImageNet Classification with Deep Convolutional Neural Networks. In International Conference on Neural Information Processing Systems (NIPS) . 1097\u20131105."},{"key":"e_1_3_2_1_12_1","volume-title":"ML Systems Workshop in NIPS.","author":"Meng Chen","year":"2017","unstructured":"Chen Meng , Minmin Sun , Jun Yang , Minghui Qiu , and Yang Gu . 2017 . Training Deeper Models by GPU Memory Optimization on TensorFlow . In ML Systems Workshop in NIPS. Chen Meng, Minmin Sun, Jun Yang, Minghui Qiu, and Yang Gu. 2017. Training Deeper Models by GPU Memory Optimization on TensorFlow. In ML Systems Workshop in NIPS."},{"key":"e_1_3_2_1_13_1","volume-title":"Keckler","author":"Rhu Minsoo","year":"2016","unstructured":"Minsoo Rhu , Natalia Gimelshein , Jason Clemons , Arslan Zulfiqar , and Stephen W . Keckler . 2016 . vDNN: Virtualized Deep Neural Networks for Scalable, Memory- Efficient Neural Network Design. CoRR abs\/1602.08124 (2016). http:\/\/arxiv.org\/abs\/1602.08124 Minsoo Rhu, Natalia Gimelshein, Jason Clemons, Arslan Zulfiqar, and Stephen W. Keckler. 2016. vDNN: Virtualized Deep Neural Networks for Scalable, Memory-Efficient Neural Network Design. CoRR abs\/1602.08124 (2016). http:\/\/arxiv.org\/abs\/1602.08124"},{"key":"e_1_3_2_1_14_1","unstructured":"Nikolay Sakharnykh. 2017. Unified Memory on Pascal and Volta. (2017). GTC.  Nikolay Sakharnykh. 2017. Unified Memory on Pascal and Volta. (2017). GTC."},{"key":"e_1_3_2_1_15_1","volume-title":"Memory Reduction Method for Deep Neural Network Training. In the 26th International Workshop on Machine Learning for Signal Processing (MLSP) . 1\u20136.","author":"Shirahata Koichi","year":"2016","unstructured":"Koichi Shirahata , Yasumoto Tomita , and Atsushi Ike . 2016 . Memory Reduction Method for Deep Neural Network Training. In the 26th International Workshop on Machine Learning for Signal Processing (MLSP) . 1\u20136. Koichi Shirahata, Yasumoto Tomita, and Atsushi Ike. 2016. Memory Reduction Method for Deep Neural Network Training. In the 26th International Workshop on Machine Learning for Signal Processing (MLSP) . 1\u20136."},{"key":"e_1_3_2_1_16_1","volume-title":"Training Deep Nets with Sublinear Memory Cost. ArXiv e-prints (April","author":"Carlos Guestrin Tianqi Chen Chiyuan Zhang","year":"2016","unstructured":"Chiyuan Zhang Carlos Guestrin Tianqi Chen , Bing Xu. 2016. Training Deep Nets with Sublinear Memory Cost. ArXiv e-prints (April 2016 ). arXiv: 1604.06174 Chiyuan Zhang Carlos Guestrin Tianqi Chen, Bing Xu. 2016. Training Deep Nets with Sublinear Memory Cost. ArXiv e-prints (April 2016). arXiv: 1604.06174"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3178487.3178491"}],"event":{"name":"ISMM '19: 2019 ACM SIGPLAN International Symposium on Memory Management","location":"Phoenix AZ USA","acronym":"ISMM '19","sponsor":["SIGPLAN ACM Special Interest Group on Programming Languages"]},"container-title":["Proceedings of the 2019 ACM SIGPLAN International Symposium on Memory Management"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3315573.3329984","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3315573.3329984","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:53:34Z","timestamp":1750204414000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3315573.3329984"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,6,23]]},"references-count":17,"alternative-id":["10.1145\/3315573.3329984","10.1145\/3315573"],"URL":"https:\/\/doi.org\/10.1145\/3315573.3329984","relation":{},"subject":[],"published":{"date-parts":[[2019,6,23]]},"assertion":[{"value":"2019-06-23","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}