{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,22]],"date-time":"2026-01-22T09:57:47Z","timestamp":1769075867853,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":26,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,9,11]],"date-time":"2019-09-11T00:00:00Z","timestamp":1568160000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Ministerio de Ciencia e Innovaci\u00f3n","award":["TIN2017-82972-R and RTI2018-098156-B-C51"],"award-info":[{"award-number":["TIN2017-82972-R and RTI2018-098156-B-C51"]}]},{"name":"Conselleria d'Educaci\u00f3, Investigaci\u00f3, Cultura i Esport","award":["CDEIGENT\/2018\/014"],"award-info":[{"award-number":["CDEIGENT\/2018\/014"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,9,11]]},"DOI":"10.1145\/3343211.3343218","type":"proceedings-article","created":{"date-parts":[[2019,8,23]],"date-time":"2019-08-23T12:03:10Z","timestamp":1566561790000},"page":"1-10","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Analysis of model parallelism for distributed neural networks"],"prefix":"10.1145","author":[{"given":"Adri\u00e1n","family":"Castell\u00f3","sequence":"first","affiliation":[{"name":"Universitat Polit\u00e8cnica de Val\u00e8ncia, Valencia, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Manuel F.","family":"Dolz","sequence":"additional","affiliation":[{"name":"Universitat Jaume I, Castell\u00f3n, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Enrique S.","family":"Quintana-Ort\u00ed","sequence":"additional","affiliation":[{"name":"Universitat Polit\u00e8cnica de Val\u00e8ncia, Valencia, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jos\u00e9","family":"Duato","sequence":"additional","affiliation":[{"name":"Universitat Polit\u00e8cnica de Val\u00e8ncia, Valencia, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,9,11]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Low-memory GEMM-based convolution algorithms for deep neural networks. CoRR, abs\/1709.03395","author":"Andrew Anderson","year":"2017","unstructured":"Andrew Anderson et al. Low-memory GEMM-based convolution algorithms for deep neural networks. CoRR, abs\/1709.03395 , 2017 . Andrew Anderson et al. Low-memory GEMM-based convolution algorithms for deep neural networks. CoRR, abs\/1709.03395, 2017."},{"key":"e_1_3_2_1_2_1","volume-title":"Demystifying parallel and distributed deep learning: An in-depth concurrency analysis. CoRR, abs\/1802.09941","author":"Ben-Nun Tal","year":"2018","unstructured":"Tal Ben-Nun and Torsten Hoefler . Demystifying parallel and distributed deep learning: An in-depth concurrency analysis. CoRR, abs\/1802.09941 , 2018 . Tal Ben-Nun and Torsten Hoefler. Demystifying parallel and distributed deep learning: An in-depth concurrency analysis. CoRR, abs\/1802.09941, 2018."},{"key":"e_1_3_2_1_3_1","volume-title":"2nd High Performance Machine Learning Workshop -HPML'2019","author":"Adri\u00e1n","year":"2019","unstructured":"Adri\u00e1n Castell\u00f3 et al. Theoretical scalability analysis of distributed deep convolutional neural networks . In 2nd High Performance Machine Learning Workshop -HPML'2019 , 2019 . To appear. Adri\u00e1n Castell\u00f3 et al. Theoretical scalability analysis of distributed deep convolutional neural networks. In 2nd High Performance Machine Learning Workshop -HPML'2019, 2019. To appear."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.5555\/1285358.1285359"},{"key":"e_1_3_2_1_5_1","volume-title":"International Workshop on Frontiers in Handwriting Recognition","author":"Chellapilla Kumar","year":"2006","unstructured":"Kumar Chellapilla , Sidd Puri , and Patrice Simard . High performance convolutional neural networks for document processing . In International Workshop on Frontiers in Handwriting Recognition , 2006 . Kumar Chellapilla, Sidd Puri, and Patrice Simard. High performance convolutional neural networks for document processing. In International Workshop on Frontiers in Handwriting Recognition, 2006."},{"key":"e_1_3_2_1_6_1","first-page":"8604","volume-title":"2013 IEEE International Conference on Acoustics, Speech and Signal Processing","author":"Li","year":"2013","unstructured":"Li Deng et al. Recent advances in deep learning for speech research at Microsoft . In 2013 IEEE International Conference on Acoustics, Speech and Signal Processing , pages 8604 -- 8608 , May 2013 . Li Deng et al. Recent advances in deep learning for speech research at Microsoft. In 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, pages 8604--8608, May 2013."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/11587514_18"},{"key":"e_1_3_2_1_8_1","volume-title":"Integrated model, batch, and domain parallelism in training neural networks. CoRR, abs\/1712.04432v4","author":"Amir Gholami","year":"2018","unstructured":"Amir Gholami et al. Integrated model, batch, and domain parallelism in training neural networks. CoRR, abs\/1712.04432v4 , 2018 . Amir Gholami et al. Integrated model, batch, and domain parallelism in training neural networks. CoRR, abs\/1712.04432v4, 2018."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_2_1_10_1","volume-title":"Deep learning: An introduction for applied mathematicians","author":"Higham Catherine F.","year":"2018","unstructured":"Catherine F. Higham and Desmond J. Higham . Deep learning: An introduction for applied mathematicians , 2018 . arXiv:1801.05894. Catherine F. Higham and Desmond J. Higham. Deep learning: An introduction for applied mathematicians, 2018. arXiv:1801.05894."},{"key":"e_1_3_2_1_11_1","unstructured":"Google Inc. Tensorflow benchmarks.  Google Inc. Tensorflow benchmarks."},{"key":"e_1_3_2_1_12_1","volume-title":"Beyond data and model parallelism for deep neural networks. CoRR, abs\/1807.05358","author":"Jia Zhihao","year":"2018","unstructured":"Zhihao Jia , Matei Zaharia , and Alex Aiken . Beyond data and model parallelism for deep neural networks. CoRR, abs\/1807.05358 , 2018 . Zhihao Jia, Matei Zaharia, and Alex Aiken. Beyond data and model parallelism for deep neural networks. CoRR, abs\/1807.05358, 2018."},{"key":"e_1_3_2_1_13_1","first-page":"1097","volume-title":"Proceedings of the 25th International Conference on Neural Information Processing Systems -","volume":"1","author":"Krizhevsky Alex","year":"2012","unstructured":"Alex Krizhevsky , Ilya Sutskever , and Geoffrey E. Hinton . Imagenet classification with deep convolutional neural networks . In Proceedings of the 25th International Conference on Neural Information Processing Systems - Volume 1 , NIPS'12, pages 1097 -- 1105 , USA, 2012 . Curran Associates Inc. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. Imagenet classification with deep convolutional neural networks. In Proceedings of the 25th International Conference on Neural Information Processing Systems - Volume 1, NIPS'12, pages 1097--1105, USA, 2012. Curran Associates Inc."},{"key":"e_1_3_2_1_14_1","first-page":"583","volume-title":"Proceedings of the 11th USENIX Conference on Operating Systems Design and Implementation, OSDI'14","author":"Mu","year":"2014","unstructured":"Mu Li et al. Scaling distributed machine learning with the parameter server . In Proceedings of the 11th USENIX Conference on Operating Systems Design and Implementation, OSDI'14 , pages 583 -- 598 , 2014 . Mu Li et al. Scaling distributed machine learning with the parameter server. In Proceedings of the 11th USENIX Conference on Operating Systems Design and Implementation, OSDI'14, pages 583--598, 2014."},{"key":"e_1_3_2_1_15_1","volume-title":"https:\/\/www.mpi-forum.org\/. Last access","author":"The MPI","year":"2019","unstructured":"The MPI forum. https:\/\/www.mpi-forum.org\/. Last access : April 2019 . The MPI forum. https:\/\/www.mpi-forum.org\/. Last access: April 2019."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1186\/s40537-014-0007-7"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3234150"},{"key":"e_1_3_2_1_18_1","volume-title":"Mesh-TensorFlow: Deep learning for supercomputers. CoRR, abs\/1811.02084v1","author":"Noam Shazeer","year":"2018","unstructured":"Noam Shazeer et al. Mesh-TensorFlow: Deep learning for supercomputers. CoRR, abs\/1811.02084v1 , 2018 . Noam Shazeer et al. Mesh-TensorFlow: Deep learning for supercomputers. CoRR, abs\/1811.02084v1, 2018."},{"key":"e_1_3_2_1_19_1","volume-title":"Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556","author":"Simonyan Karen","year":"2014","unstructured":"Karen Simonyan and Andrew Zisserman . Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 , 2014 . Karen Simonyan and Andrew Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2017.2761740"},{"key":"e_1_3_2_1_21_1","first-page":"2818","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"Christian","year":"2016","unstructured":"Christian Szegedy et al. Rethinking the inception architecture for computer vision . In Proceedings of the IEEE conference on computer vision and pattern recognition , pages 2818 -- 2826 , 2016 . Christian Szegedy et al. Rethinking the inception architecture for computer vision. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 2818--2826, 2016."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1177\/1094342005051521"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/79173.79181"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASAP.2017.7995254"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1498765.1498785"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2015.69"}],"event":{"name":"EuroMPI 2019: 26th European MPI Users' Group Meeting","location":"Z\u00fcrich Switzerland","acronym":"EuroMPI 2019"},"container-title":["Proceedings of the 26th European MPI Users' Group Meeting"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3343211.3343218","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3343211.3343218","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:13:06Z","timestamp":1750201986000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3343211.3343218"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,9,11]]},"references-count":26,"alternative-id":["10.1145\/3343211.3343218","10.1145\/3343211"],"URL":"https:\/\/doi.org\/10.1145\/3343211.3343218","relation":{},"subject":[],"published":{"date-parts":[[2019,9,11]]},"assertion":[{"value":"2019-09-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}