{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:23:45Z","timestamp":1750220625520,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":18,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,12,2]],"date-time":"2019-12-02T00:00:00Z","timestamp":1575244800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Fujitsu Laboratories"},{"name":"JSPS KAKENHI","award":["17H01748"],"award-info":[{"award-number":["17H01748"]}]},{"name":"New Energy and Industrial Technology Development Organization (NEDO)"},{"name":"JST CREST","award":["JPMJCR1414"],"award-info":[{"award-number":["JPMJCR1414"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,12,2]]},"DOI":"10.1145\/3365109.3368768","type":"proceedings-article","created":{"date-parts":[[2019,11,27]],"date-time":"2019-11-27T13:23:09Z","timestamp":1574860989000},"page":"31-34","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Accelerating Machine Learning I\/O by Overlapping Data Staging and Mini-batch Generations"],"prefix":"10.1145","author":[{"given":"Kazuhiro","family":"Serizawa","sequence":"first","affiliation":[{"name":"University of Tsukuba, Ibaraki, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Osamu","family":"Tatebe","sequence":"additional","affiliation":[{"name":"University of Tsukuba, Ibaraki, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,12,2]]},"reference":[{"volume-title":"International Journal of Computer Vision (IJCV)","author":"Russakovsky Olga","key":"e_1_3_2_1_1_1","unstructured":"Olga Russakovsky , Jia Deng , Hao Su , Jonathan Krause , Sanjeev Satheesh , Sean Ma , Zhiheng Huang , Andrej Karpathy , Aditya Khosla , Michael Bernstein , Alexander C. Berg , and Li Fei-Fei . ImageNet Large Scale Visual Recognition Challenge . International Journal of Computer Vision (IJCV) , Vol. 115 , No. 3, pp. 211--252, 2015. Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, Alexander C. Berg, and Li Fei-Fei. ImageNet Large Scale Visual Recognition Challenge. International Journal of Computer Vision (IJCV), Vol. 115, No. 3, pp. 211--252, 2015."},{"key":"e_1_3_2_1_2_1","first-page":"1","volume-title":"Youtube-8m: A Large-Scale Video Classification Benchmark. arXiv preprint arXiv:1609.08675","author":"Abu-El-Haija Sami","year":"2016","unstructured":"Sami Abu-El-Haija , Nisarg Kothari , Joonseok Lee , Paul Natsev , George Toderici , Balakrishnan Varadarajan , and Sudheendra Vijayanarasimhan . Youtube-8m: A Large-Scale Video Classification Benchmark. arXiv preprint arXiv:1609.08675 , pp. 1 -- 10 , 2016 . Sami Abu-El-Haija, Nisarg Kothari, Joonseok Lee, Paul Natsev, George Toderici, Balakrishnan Varadarajan, and Sudheendra Vijayanarasimhan. Youtube-8m: A Large-Scale Video Classification Benchmark. arXiv preprint arXiv:1609.08675, pp. 1--10, 2016."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364913491297"},{"key":"e_1_3_2_1_4_1","first-page":"1","volume-title":"Michael Houston. Exascale Deep Learning for Climate Analytics. In Proceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis, SC '18","author":"Kurth Thorsten","year":"2018","unstructured":"Thorsten Kurth , Sean Treichler , Joshua Romero , Mayur Mudigonda , Nathan Luehr , Everett Phillips , Ankur Mahesh , Michael Matheson , Jack Deslippe , Massimiliano Fatica , Prabhat, and Michael Houston. Exascale Deep Learning for Climate Analytics. In Proceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis, SC '18 , pp. 51: 1 -- 51 :12. IEEE Press , 2018 . Thorsten Kurth, Sean Treichler, Joshua Romero, Mayur Mudigonda, Nathan Luehr, Everett Phillips, Ankur Mahesh, Michael Matheson, Jack Deslippe, Massimiliano Fatica, Prabhat, and Michael Houston. Exascale Deep Learning for Climate Analytics. In Proceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis, SC '18, pp. 51:1--51:12. IEEE Press, 2018."},{"key":"e_1_3_2_1_5_1","first-page":"1","volume-title":"Proceedings of Workshop on Machine Learning Systems (LearningSys) in The Twenty-ninth Annual Conference on Neural Information Processing Systems (NIPS)","author":"Tokui Seiya","year":"2015","unstructured":"Seiya Tokui , Kenta Oono , Shohei Hido , and Justin Clayton . Chainer : a Next-Generation Open Source Framework for Deep Learning . In Proceedings of Workshop on Machine Learning Systems (LearningSys) in The Twenty-ninth Annual Conference on Neural Information Processing Systems (NIPS) , pp. 1 -- 6 , 2015 . Seiya Tokui, Kenta Oono, Shohei Hido, and Justin Clayton. Chainer: a Next-Generation Open Source Framework for Deep Learning. In Proceedings of Workshop on Machine Learning Systems (LearningSys) in The Twenty-ninth Annual Conference on Neural Information Processing Systems (NIPS), pp. 1--6, 2015."},{"key":"e_1_3_2_1_6_1","unstructured":"Center for Computational Sciences University of Tsukuba. https:\/\/www.ccs.tsukuba.ac.jp\/.  Center for Computational Sciences University of Tsukuba. https:\/\/www.ccs.tsukuba.ac.jp\/."},{"key":"e_1_3_2_1_7_1","first-page":"1","volume-title":"Yet Another Accelerated SGD: ResNet-50 Training on ImageNet in 74.7 seconds. arXiv preprint arXiv:1903.12650","author":"Yamazaki Masafumi","year":"2019","unstructured":"Masafumi Yamazaki , Akihiko Kasagi , Akihiro Tabuchi , Takumi Honda , Masahiro Miwa , Naoto Fukumoto , Tsuguchika Tabaru , Atsushi Ike , and Kohta Nakashima . Yet Another Accelerated SGD: ResNet-50 Training on ImageNet in 74.7 seconds. arXiv preprint arXiv:1903.12650 , pp. 1 -- 5 , 2019 . Masafumi Yamazaki, Akihiko Kasagi, Akihiro Tabuchi, Takumi Honda, Masahiro Miwa, Naoto Fukumoto, Tsuguchika Tabaru, Atsushi Ike, and Kohta Nakashima. Yet Another Accelerated SGD: ResNet-50 Training on ImageNet in 74.7 seconds. arXiv preprint arXiv:1903.12650, pp. 1--5, 2019."},{"key":"e_1_3_2_1_8_1","first-page":"1","volume-title":"ImageNet\/Resnet-50 training in 224 Seconds. arXiv preprint arXiv:1811.05233","author":"Mikami Hiroaki","year":"2018","unstructured":"Hiroaki Mikami , Hisahiro Suganuma , Yoshiki Tanaka , Yuichi Kageyama , ImageNet\/Resnet-50 training in 224 Seconds. arXiv preprint arXiv:1811.05233 , pp. 1 -- 8 , 2018 . Hiroaki Mikami, Hisahiro Suganuma, Yoshiki Tanaka, Yuichi Kageyama, et al. ImageNet\/Resnet-50 training in 224 Seconds. arXiv preprint arXiv:1811.05233, pp. 1--8, 2018."},{"key":"e_1_3_2_1_9_1","first-page":"1","volume-title":"Image Classification at Supercomputer Scale. arXiv preprint arXiv:1811.06992","author":"Ying Chris","year":"2018","unstructured":"Chris Ying , Sameer Kumar , Dehao Chen , Tao Wang , and Youlong Cheng . Image Classification at Supercomputer Scale. arXiv preprint arXiv:1811.06992 , pp. 1 -- 8 , 2018 . Chris Ying, Sameer Kumar, Dehao Chen, Tao Wang, and Youlong Cheng. Image Classification at Supercomputer Scale. arXiv preprint arXiv:1811.06992, pp. 1--8, 2018."},{"key":"e_1_3_2_1_10_1","first-page":"1","volume-title":"Highly Scalable Deep Learning Training System with Mixed-Precision: Training ImageNet in Four Minutes. arXiv preprint arXiv:1807.11205","author":"Jia Xianyan","year":"2018","unstructured":"Xianyan Jia , Shutao Song , Wei He , Yangzihao Wang , Haidong Rong , Feihu Zhou , Liqiang Xie , Zhenyu Guo , Yuanzhou Yang , Liwei Yu , Highly Scalable Deep Learning Training System with Mixed-Precision: Training ImageNet in Four Minutes. arXiv preprint arXiv:1807.11205 , pp. 1 -- 9 , 2018 . Xianyan Jia, Shutao Song, Wei He, Yangzihao Wang, Haidong Rong, Feihu Zhou, Liqiang Xie, Zhenyu Guo, Yuanzhou Yang, Liwei Yu, et al. Highly Scalable Deep Learning Training System with Mixed-Precision: Training ImageNet in Four Minutes. arXiv preprint arXiv:1807.11205, pp. 1--9, 2018."},{"key":"e_1_3_2_1_11_1","first-page":"770","volume-title":"Jian Sun. Deep Residual Learning for Image Recognition. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","author":"He Kaiming","year":"2016","unstructured":"Kaiming He , Xiangyu Zhang , Shaoqing Ren , and Jian Sun. Deep Residual Learning for Image Recognition. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , pp. 770 -- 778 , 2016 . Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep Residual Learning for Image Recognition. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770--778, 2016."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/MASCOTS.2018.00023"},{"key":"e_1_3_2_1_13_1","first-page":"1","volume-title":"et al. Tensorflow: Large-Scale Machine Learning on Heterogeneous Distributed Systems. arXiv preprint arXiv:1603.04467","author":"Abadi Mart'in","year":"2016","unstructured":"Mart'in Abadi , Ashish Agarwal , Paul Barham , Eugene Brevdo , Zhifeng Chen , Craig Citro , Greg S Corrado , Andy Davis , Jeffrey Dean , Matthieu Devin , et al. Tensorflow: Large-Scale Machine Learning on Heterogeneous Distributed Systems. arXiv preprint arXiv:1603.04467 , pp. 1 -- 19 , 2016 . Mart'in Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, et al. Tensorflow: Large-Scale Machine Learning on Heterogeneous Distributed Systems. arXiv preprint arXiv:1603.04467, pp. 1--19, 2016."},{"key":"e_1_3_2_1_14_1","unstructured":"BeeGFS . https:\/\/www.beegfs.io\/content\/.  BeeGFS . https:\/\/www.beegfs.io\/content\/."},{"key":"e_1_3_2_1_15_1","first-page":"773","volume-title":"2017 USENIX Annual Technical Conference (USENIX ATC 17)","author":"Lu Youyou","year":"2017","unstructured":"Youyou Lu , Jiwu Shu , Youmin Chen , and Tao Li. Octopus : an RDMA-enabled Distributed Persistent Memory File System . In 2017 USENIX Annual Technical Conference (USENIX ATC 17) , pp. 773 -- 785 . USENIX Association , 2017 . Youyou Lu, Jiwu Shu, Youmin Chen, and Tao Li. Octopus: an RDMA-enabled Distributed Persistent Memory File System. In 2017 USENIX Annual Technical Conference (USENIX ATC 17), pp. 773--785. USENIX Association, 2017."},{"key":"e_1_3_2_1_16_1","first-page":"54","volume-title":"Workloads in TensorFlow. In 2018 IEEE\/ACM 3rd International Workshop on Parallel Data Storage & Data Intensive Scalable Computing Systems (PDSW-DISCS)","author":"Chien Steven WD","year":"2018","unstructured":"Steven WD Chien , Stefano Markidis , Chaitanya Prasad Sishtla , Luis Santos , Pawel Herman , Sai Narasimhamurthy , and Erwin Laure . Characterizing Deep-Learning I\/O Workloads in TensorFlow. In 2018 IEEE\/ACM 3rd International Workshop on Parallel Data Storage & Data Intensive Scalable Computing Systems (PDSW-DISCS) , pp. 54 -- 63 . IEEE, 2018 . Steven WD Chien, Stefano Markidis, Chaitanya Prasad Sishtla, Luis Santos, Pawel Herman, Sai Narasimhamurthy, and Erwin Laure. Characterizing Deep-Learning I\/O Workloads in TensorFlow. In 2018 IEEE\/ACM 3rd International Workshop on Parallel Data Storage & Data Intensive Scalable Computing Systems (PDSW-DISCS), pp. 54--63. IEEE, 2018."},{"key":"e_1_3_2_1_17_1","first-page":"1","volume-title":"Characterization and Performance Evaluation of BeeGFS for Deep Learning. In Proceedings of the 48th International Conference on Parallel Processing, ICPP 2019","author":"Chowdhury Fahim","year":"2019","unstructured":"Fahim Chowdhury , Yue Zhu , Todd Heer , Saul Paredes , Adam Moody , Robin Goldstone , Kathryn Mohror , and Weikuan Yu. I\/O Characterization and Performance Evaluation of BeeGFS for Deep Learning. In Proceedings of the 48th International Conference on Parallel Processing, ICPP 2019 , pp. 80: 1 -- 80 :10. ACM, 2019 . Fahim Chowdhury, Yue Zhu, Todd Heer, Saul Paredes, Adam Moody, Robin Goldstone, Kathryn Mohror, and Weikuan Yu. I\/O Characterization and Performance Evaluation of BeeGFS for Deep Learning. In Proceedings of the 48th International Conference on Parallel Processing, ICPP 2019, pp. 80:1--80:10. ACM, 2019."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2834892.2834897"}],"event":{"name":"UCC '19: IEEE\/ACM 12th International Conference on Utility and Cloud Computing","sponsor":["SIGARCH ACM Special Interest Group on Computer Architecture","IEEE TCSC IEEE Technical Committee on Scalable Computing"],"location":"Auckland New Zealand","acronym":"UCC '19"},"container-title":["Proceedings of the 6th IEEE\/ACM International Conference on Big Data Computing, Applications and Technologies"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3365109.3368768","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3365109.3368768","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:01:29Z","timestamp":1750197689000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3365109.3368768"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,2]]},"references-count":18,"alternative-id":["10.1145\/3365109.3368768","10.1145\/3365109"],"URL":"https:\/\/doi.org\/10.1145\/3365109.3368768","relation":{},"subject":[],"published":{"date-parts":[[2019,12,2]]},"assertion":[{"value":"2019-12-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}