{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,1,24]],"date-time":"2024-01-24T01:58:01Z","timestamp":1706061481499},"reference-count":9,"publisher":"Institute of Electronics, Information and Communications Engineers (IEICE)","issue":"6","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IEICE Trans. Electron."],"published-print":{"date-parts":[[2021,6,1]]},"DOI":"10.1587\/transele.2020lhs0001","type":"journal-article","created":{"date-parts":[[2020,11,30]],"date-time":"2020-11-30T22:10:36Z","timestamp":1606774236000},"page":"257-260","source":"Crossref","is-referenced-by-count":1,"title":["Preliminary Performance Analysis of Distributed DNN Training with Relaxed Synchronization"],"prefix":"10.1587","volume":"E104.C","author":[{"given":"Koichi","family":"SHIRAHATA","sequence":"first","affiliation":[{"name":"FUJITSU LABORATORIES Ltd."}]},{"given":"Amir","family":"HADERBACHE","sequence":"additional","affiliation":[{"name":"FUJITSU LABORATORIES Ltd."}]},{"given":"Naoto","family":"FUKUMOTO","sequence":"additional","affiliation":[{"name":"FUJITSU LABORATORIES Ltd."}]},{"given":"Kohta","family":"NAKASHIMA","sequence":"additional","affiliation":[{"name":"FUJITSU LABORATORIES Ltd."}]}],"member":"532","reference":[{"key":"1","unstructured":"[1] J. Chen, X. Pan, R. Monga, S. Bengio, and R. Jozefowicz, \u201cRevisiting distributed synchronous SGD,\u201d arXiv preprint, April 2016."},{"key":"2","unstructured":"[2] X. Lian, W. Zhang, C. Zhang, and J. Liu, \u201cAsynchronous decentralized parallel stochastic gradient descent,\u201d Proc. the 35th Int. Conf. Machine Learning, pp.3043-3052, July 2018."},{"key":"3","doi-asserted-by":"crossref","unstructured":"[3] S. Gupta, W. Zhang, and F. Wang, \u201cModel accuracy and runtime tradeoff in distributed deep learning: a systematic study,\u201d Proc. IEEE 16th Int. Conf. Data Mining (ICDM), pp.171-180, Dec. 2016. 10.1109\/ICDM.2016.0028","DOI":"10.1109\/ICDM.2016.0028"},{"key":"4","doi-asserted-by":"crossref","unstructured":"[4] J. Jiang, B. Cui, C. Zhang, and L. Yu, \u201cHeterogeneity-aware distributed parameter servers,\u201d Proc. the 2017 ACM Int. Conf. Management of Data, pp.463-478, May 2017. 10.1145\/3035918.3035933","DOI":"10.1145\/3035918.3035933"},{"key":"5","doi-asserted-by":"crossref","unstructured":"[5] Y. Zhu, F. Chowdhury, H. Fu, A. Moody, K. Mohror, K. Sato, and W. Yu, \u201cEntropy-aware I\/O pipelining for large-scale deep learning on HPC systems,\u201d Proc. 2018 IEEE 26th Int. Symp. Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS), pp.145-156, Sept. 2018. 10.1109\/MASCOTS.2018.00023","DOI":"10.1109\/MASCOTS.2018.00023"},{"key":"6","unstructured":"[6] D. Choi, A. Passos, C.J. Shallue, and G.E. Dah, \u201cFaster neural network training with data echoing,\u201d Computing Research Repository (CoRR) in arXiv, July 2019."},{"key":"7","doi-asserted-by":"publisher","unstructured":"[7] L. Wang, Y. Yang, M. Renqiang Min, and S.T. Chakradhar, \u201cAccelerating deep neural network training with inconsistent stochastic gradient descent,\u201d Computing Research Repository (CoRR) in arXiv, March 2016. 10.1016\/j.neunet.2017.06.003","DOI":"10.1016\/j.neunet.2017.06.003"},{"key":"8","doi-asserted-by":"crossref","unstructured":"[8] A. Azizimazreah, Y. Gu, X. Gu, and L. Chen, \u201cTolerating soft errors in deep learning accelerators with reliable on-chip memory designs,\u201d Proc. 2018 IEEE Int. Conf. Networking, Architecture and Storage (NAS), pp.1-10, Oct. 2018. 10.1109\/NAS.2018.8515692","DOI":"10.1109\/NAS.2018.8515692"},{"key":"9","doi-asserted-by":"crossref","unstructured":"[9] L.H. Hoang, M.A. Hanif, and M. Shafique, \u201cFt-clipact: resilience analysis of deep neural networks and improving their fault tolerance using clipped activation,\u201d Proc. 2020 Design, Automation and Test in Europe Conference and Exhibition (DATE), pp.1241-1246, March 2020. 10.23919\/DATE48585.2020.9116571","DOI":"10.23919\/DATE48585.2020.9116571"}],"container-title":["IEICE Transactions on Electronics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transele\/E104.C\/6\/E104.C_2020LHS0001\/_pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,6,5]],"date-time":"2021-06-05T05:50:14Z","timestamp":1622872214000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transele\/E104.C\/6\/E104.C_2020LHS0001\/_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,1]]},"references-count":9,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2021]]}},"URL":"https:\/\/doi.org\/10.1587\/transele.2020lhs0001","relation":{},"ISSN":["0916-8524","1745-1353"],"issn-type":[{"value":"0916-8524","type":"print"},{"value":"1745-1353","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,1]]}}}