{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T22:44:55Z","timestamp":1777675495894,"version":"3.51.4"},"reference-count":37,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2018,4,9]],"date-time":"2018-04-09T00:00:00Z","timestamp":1523232000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/501100002809","name":"Spanish Ministry of Science and Innovation","doi-asserted-by":"publisher","award":["TIN2015-65316"],"award-info":[{"award-number":["TIN2015-65316"]}],"id":[{"id":"10.13039\/501100002809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of High Performance Computing Applications"],"published-print":{"date-parts":[[2019,3]]},"abstract":"<jats:p>We investigate the usefulness of gossip-based reduction algorithms in a high-performance computing (HPC) context. We compare them to state-of-the-art deterministic parallel reduction algorithms in terms of fault tolerance and resilience against silent data corruption (SDC) as well as in terms of performance and scalability. New gossip-based reduction algorithms are proposed, which significantly improve the state-of-the-art in terms of resilience against SDC. Moreover, a new gossip-inspired reduction algorithm is proposed, which promises a much more competitive runtime performance in an HPC context than classical gossip-based algorithms, in particular for low accuracy requirements.<\/jats:p>","DOI":"10.1177\/1094342018762531","type":"journal-article","created":{"date-parts":[[2018,4,9]],"date-time":"2018-04-09T22:43:25Z","timestamp":1523313805000},"page":"366-383","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":4,"title":["Resilient gossip-inspired all-reduce algorithms for high-performance computing: Potential, limitations, and open questions"],"prefix":"10.1177","volume":"33","author":[{"given":"Marc","family":"Casas","sequence":"first","affiliation":[{"name":"Barcelona Supercomputing Center, Barcelona, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wilfried N","family":"Gansterer","sequence":"additional","affiliation":[{"name":"University of Vienna, Faculty of Computer Science, Research Group Theory and Applications of Algorithms, Vienna, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Elias","family":"Wimmer","sequence":"additional","affiliation":[{"name":"University of Vienna, Faculty of Computer Science, Research Group Theory and Applications of Algorithms, Vienna, Austria"},{"name":"Research Group Parallel Computing, Faculty of Informatics, TU Wien, Vienna, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2018,4,9]]},"reference":[{"key":"bibr1-1094342018762531","unstructured":"Ashby S, Beckman P, Chen J, (2010) The opportunities and challenges of exascale computing. Available at: https:\/\/science.energy.gov\/\u223c\/MEDIA\/ASCR\/ASCAC\/PDF\/REPORTS\/EXASCALE_SUBCOMMITTEE_REPORT.PDF (accessed 2 March 2018)."},{"key":"bibr2-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1177\/1094342013488238"},{"key":"bibr3-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-7908-2604-3_16"},{"key":"bibr4-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2006.874516"},{"issue":"1","key":"bibr5-1094342018762531","first-page":"5","volume":"1","author":"Cappello F","year":"2014","journal-title":"Supercomputing Frontiers and Innovations"},{"key":"bibr6-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.1206"},{"key":"bibr7-1094342018762531","unstructured":"Commonwealth Scientific and Industrial Research Organization (CSIRO) (2014) Scientific computing user manual. Available at: https:\/\/wiki.csiro.au\/display\/ASC\/User+Manual (accessed 2 March 2018)."},{"key":"bibr8-1094342018762531","first-page":"1223","volume-title":"Proceedings of the 25th international conference on neural information processing systems, NIPS\u201912","author":"Dean J","year":"2012"},{"key":"bibr9-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1109\/JSSC.1974.1050511"},{"key":"bibr10-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2007.908946"},{"key":"bibr11-1094342018762531","first-page":"72","volume-title":"Proceedings of the 7th international symposium on algorithms for sensor systems, wireless ad hoc networks and autonomous mobile entities ALGOSENSORS","author":"Eyal I","year":"2011"},{"key":"bibr12-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1007\/s00446-014-0213-8"},{"key":"bibr13-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2008.5219920"},{"key":"bibr14-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1016\/j.jocs.2013.01.006"},{"key":"bibr15-1094342018762531","unstructured":"Gupta S, Agrawal A, Gopalakrishnan K, (2015) Deep learning with limited numerical precision. In: Proceedings of the 32nd international conference on machine learning, ICML\u201915 (eds Bach F, Blei D), Lille, France, 6\u201311 July 2015, Vol. 37, pp. 1737\u20131746. http:\/\/JMLR.org."},{"key":"bibr16-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1109\/CDC.2012.6426666"},{"key":"bibr17-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1145\/2807591.2807665"},{"key":"bibr18-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1016\/j.parco.2007.06.006"},{"key":"bibr19-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1145\/2908812.2908832"},{"key":"bibr20-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-02164-0_6"},{"key":"bibr21-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1109\/SRDS.2010.13"},{"key":"bibr22-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpdc.2015.02.003"},{"key":"bibr23-1094342018762531","unstructured":"Jin PH, Yuan Q, Iandola FN, (2016) How to scale distributed deep learning? CoRR abs\/1611.04581. Available at: http:\/\/arxiv.org\/abs\/1611.04581 (accessed 11 March 2018)."},{"key":"bibr24-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1145\/2802658.2802660"},{"key":"bibr25-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1109\/SFCS.2003.1238221"},{"key":"bibr26-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2011.04.053"},{"key":"bibr27-1094342018762531","unstructured":"MPI Forum (2012) MPI: a message-passing interface standard version 3.0. Available at: http:\/\/mpi-forum.org\/docs\/ (accessed 11 March 2018)."},{"key":"bibr28-1094342018762531","volume-title":"Pthreads Programming","author":"Nichols B","year":"1996"},{"key":"bibr29-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611972931.12"},{"key":"bibr30-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1109\/SC.Companion.2012.89"},{"key":"bibr31-1094342018762531","unstructured":"OpenMP Architecture Review Board (2013) OpenMP application program interface version 4.5. Available at: http:\/\/www.openmp.org\/wp-content\/uploads\/openmp-4.5.pdf (accessed 11 March 2018)."},{"key":"bibr32-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1109\/TNS.2012.2218128"},{"key":"bibr33-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1145\/2025113.2025133"},{"key":"bibr34-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-39924-7_38"},{"key":"bibr35-1094342018762531","unstructured":"Top500 List (2018) TOP500 Supercomputers. Available at: http:\/\/www.top500.org (accessed 11 March 2018)."},{"key":"bibr36-1094342018762531","doi-asserted-by":"publisher","DOI":"10.1175\/MWR-D-16-0228.1"},{"key":"bibr37-1094342018762531","unstructured":"Vulcan Supercomputer (2015) Livermore computing. Available at: http:\/\/computation.llnl.gov\/computers\/vulcan (accessed 11 March 2018)."}],"container-title":["The International Journal of High Performance Computing Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1094342018762531","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/1094342018762531","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1094342018762531","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T08:15:40Z","timestamp":1777450540000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1094342018762531"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,4,9]]},"references-count":37,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2019,3]]}},"alternative-id":["10.1177\/1094342018762531"],"URL":"https:\/\/doi.org\/10.1177\/1094342018762531","relation":{},"ISSN":["1094-3420","1741-2846"],"issn-type":[{"value":"1094-3420","type":"print"},{"value":"1741-2846","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,4,9]]}}}