{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T02:08:47Z","timestamp":1784081327440,"version":"3.55.0"},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2016,9,16]],"date-time":"2016-09-16T00:00:00Z","timestamp":1473984000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100004329","name":"Slovenian Research Agency","doi-asserted-by":"crossref","award":["P2-0095"],"award-info":[{"award-number":["P2-0095"]}],"id":[{"id":"10.13039\/501100004329","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2017,9,30]]},"abstract":"<jats:p>This article provides background information about interconnection networks, an analysis of previous developments, and an overview of the state of the art. The main contribution of this article is to highlight the importance of the interpolation and extrapolation of technological changes and physical constraints in order to predict the optimum future interconnection network. The technological changes are related to three of the most important attributes of interconnection networks: topology, routing, and flow-control algorithms. On the other hand, the physical constraints, that is, port counts, number of communication nodes, and communication speed, determine the realistic properties of the network. We present the state-of-the-art technology for the most commonly used interconnection networks and some background related to often-used network topologies. The interconnection networks of the best-performing petascale parallel computers from past and present Top500 lists are analyzed. The lessons learned from this analysis indicate that computer networks need better performance in future exascale computers. Such an approach leads to the conclusion that a high-radix topology with optical connections for longer links is set to become the optimum interconnect for a number of relevant application domains.<\/jats:p>","DOI":"10.1145\/2983387","type":"journal-article","created":{"date-parts":[[2016,9,19]],"date-time":"2016-09-19T20:11:45Z","timestamp":1474315905000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":28,"title":["Interconnection Networks in Petascale Computer Systems"],"prefix":"10.1145","volume":"49","author":[{"given":"Roman","family":"Trobec","sequence":"first","affiliation":[{"name":"Jo\u017eef Stefan Institute, Ljubljana, Slovenia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Radivoje","family":"Vasiljevi\u0107","sequence":"additional","affiliation":[{"name":"University of Belgrade, Serbia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Milo","family":"Toma\u0161evi\u0107","sequence":"additional","affiliation":[{"name":"University of Belgrade, Serbia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Veljko","family":"Milutinovi\u0107","sequence":"additional","affiliation":[{"name":"Maxeler Technologies and MISANU Belgrade, Serbia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ramon","family":"Beivide","sequence":"additional","affiliation":[{"name":"University of Cantabria, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mateo","family":"Valero","sequence":"additional","affiliation":[{"name":"Barcelona Supercomputing Center, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2016,9,16]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1362622.1362646"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2009.370"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1362622.1362675"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/HOTI.2010.23"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TC.1982.1675886"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/HOTI.2010.16"},{"key":"e_1_2_1_7_1","volume-title":"International Conference for High Performance Computing, Networking, Storage and Analysis, 1--11","author":"Barker K. J.","unstructured":"K. J. Barker , K. Davis , A. Hoisie , D. J. Kerbyson , M. Lang , S. Pakin , and J. C. Sancho . 2008. Entering the petaflop era: The architecture and performance of roadrunner . International Conference for High Performance Computing, Networking, Storage and Analysis, 1--11 . K. J. Barker, K. Davis, A. Hoisie, D. J. Kerbyson, M. Lang, S. Pakin, and J. C. Sancho. 2008. Entering the petaflop era: The architecture and performance of roadrunner. International Conference for High Performance Computing, Networking, Storage and Analysis, 1--11."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/1148882.1148902"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.v17:10"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CONECT.2005.24"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.comnet.2014.04.015"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2010.30"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1103845.1094852"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1002\/j.1538-7305.1953.tb01433.x"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2011.2163967"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TC.1987.1676939"},{"key":"e_1_2_1_17_1","unstructured":"W. J. Dally and B. Towles. 2004. Principles And Practices of Interconnection Networks. Morgan Kaufmann.   W. J. Dally and B. Towles. 2004. Principles And Practices of Interconnection Networks. Morgan Kaufmann."},{"key":"e_1_2_1_18_1","unstructured":"J. J. Dongarra and M. A. Heroux. 2013. Toward a New Metric for Ranking High Performance Computing Systems. Sandia National Laboratories.  J. J. Dongarra and M. A. Heroux. 2013. Toward a New Metric for Ranking High Performance Computing Systems. Sandia National Laboratories."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.728"},{"key":"e_1_2_1_20_1","unstructured":"J. Duato S. Yalamanchili and L. Ni. 2002. Interconnection Networks. Morgan Kaufmann.   J. Duato S. Yalamanchili and L. Ni. 2002. Interconnection Networks. Morgan Kaufmann."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2447976.2447989"},{"key":"e_1_2_1_22_1","first-page":"5","article-title":"New views of the structure of the universe","volume":"4","author":"Friedman J.","year":"2008","unstructured":"J. Friedman . 2008 . New views of the structure of the universe . The IPSI BgD Transactions Advanced Research , 4 , 5 -- 6 . J. Friedman. 2008. New views of the structure of the universe. The IPSI BgD Transactions Advanced Research, 4, 5--6.","journal-title":"The IPSI BgD Transactions Advanced Research"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/CLUSTER.2015.136"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPP.2012.46"},{"key":"e_1_2_1_25_1","unstructured":"A. Grama A. Gupta V. Karypis and V. Kumar. 2003. Introduction to Parallel Computing 2nd ed. Pearson Education Limited Essex England.  A. Grama A. Gupta V. Karypis and V. Kumar. 2003. Introduction to Parallel Computing 2nd ed. Pearson Education Limited Essex England."},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the IEEE International Conference on Cluster Computing, 116--125","author":"Hoefler T.","unstructured":"T. Hoefler , T. Schneider , and A. Lumsdaine . 2008. Multistage switches are not crossbars: Effects of static routing in high-performance networks . In Proceedings of the IEEE International Conference on Cluster Computing, 116--125 . T. Hoefler, T. Schneider, and A. Lumsdaine. 2008. Multistage switches are not crossbars: Effects of static routing in high-performance networks. In Proceedings of the IEEE International Conference on Cluster Computing, 116--125."},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the 20th IEEE International Parallel & Distributed Processing Symposium. 1--10","author":"Jeffrey S. V.","unstructured":"S. V. Jeffrey , R. A. Sadaf , H. D. Thomas , Jr., R. F. Mark , C. R. Philip , and H. W. Patrick . 2006. Early evaluation of the cray XT3 . In Proceedings of the 20th IEEE International Parallel & Distributed Processing Symposium. 1--10 . S. V. Jeffrey, R. A. Sadaf, H. D. Thomas, Jr., R. F. Mark, C. R. Philip, and H. W. Patrick. 2006. Early evaluation of the cray XT3. In Proceedings of the 20th IEEE International Parallel & Distributed Processing Symposium. 1--10."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1177\/1094342005056114"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TC.2005.86"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISCA.2008.19"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISCA.2005.35"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/2.612252"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/384286.264206"},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the IEEE International Conference on Cluster Computing (ICCC\u201902)","author":"Lawry W.","unstructured":"W. Lawry , C. Wilson , A. B. Maccabe , and R. Brightwell . 2002. COMB: A portable benchmark suite for assessing MPI overlap . In Proceedings of the IEEE International Conference on Cluster Computing (ICCC\u201902) .472--475. W. Lawry, C. Wilson, A. B. Maccabe, and R. Brightwell. 2002. COMB: A portable benchmark suite for assessing MPI overlap. In Proceedings of the IEEE International Conference on Cluster Computing (ICCC\u201902).472--475."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.5555\/4492.4495"},{"key":"e_1_2_1_36_1","doi-asserted-by":"crossref","unstructured":"P. Luszczek J. J. Dongarra D. Koester R. Rabenseifner B. Lucas J. Kepner J. McCalpin D. Bailey and D. Takahashi. 2005. Introduction to the HPC Challenge Benchmark Suite. Electronic Book.  P. Luszczek J. J. Dongarra D. Koester R. Rabenseifner B. Lucas J. Kepner J. McCalpin D. Bailey and D. Takahashi. 2005. Introduction to the HPC Challenge Benchmark Suite. Electronic Book.","DOI":"10.1145\/1188455.1188677"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1810085.1810091"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10766-006-0014-1"},{"key":"e_1_2_1_39_1","volume-title":"Mellanox company site","unstructured":"Mellanox. 2013. Mellanox company site . Sunnyvale, California . Retrieved from http:\/\/www.mellanox.com. Mellanox. 2013. Mellanox company site. Sunnyvale, California. Retrieved from http:\/\/www.mellanox.com."},{"key":"e_1_2_1_40_1","unstructured":"NNSA. 2013. Advanced Simulation & Computing. National Nuclear Security Administration USA. Retrieved from http:\/\/www.nnsa.energy.gov\/asc.  NNSA. 2013. Advanced Simulation & Computing. National Nuclear Security Administration USA. Retrieved from http:\/\/www.nnsa.energy.gov\/asc."},{"key":"e_1_2_1_41_1","doi-asserted-by":"crossref","unstructured":"M. N\u00fcssle H. Fr\u00f6ning S. Kapferer and U. Br\u00fcning. 2013. Accelerate communication not computation&excl; In High-Performance Computing Using FPGAs 507--542.  M. N\u00fcssle H. Fr\u00f6ning S. Kapferer and U. Br\u00fcning. 2013. Accelerate communication not computation&excl; In High-Performance Computing Using FPGAs 507--542.","DOI":"10.1007\/978-1-4614-1791-0_17"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11227-016-1640-z"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISCA.2006.40"},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the 7th European LS-DYNA Conference.","author":"Shainer G.","unstructured":"G. Shainer , T. Liu , J. Liberman , J. Layton , O. Celebioglu , S. A. Schultz , J. Mora , D. Cownie , and V. Holst . 2009. LS-DYNA productivity and power-aware simulations in cluster environments . In Proceedings of the 7th European LS-DYNA Conference. G. Shainer, T. Liu, J. Liberman, J. Layton, O. Celebioglu, S. A. Schultz, J. Mora, D. Cownie, and V. Holst. 2009. LS-DYNA productivity and power-aware simulations in cluster environments. In Proceedings of the 7th European LS-DYNA Conference."},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the 16th International Euro-Par Conference on Parallel Processing: Part II, 428--439","author":"Stafford E.","unstructured":"E. Stafford , J. L. Bosque , C. Martinez , F. Vallejo , R. Beivide , and C. Camarero . 2010. A first approach to king topologies for on-chip networks . In Proceedings of the 16th International Euro-Par Conference on Parallel Processing: Part II, 428--439 . E. Stafford, J. L. Bosque, C. Martinez, F. Vallejo, R. Beivide, and C. Camarero. 2010. A first approach to king topologies for on-chip networks. In Proceedings of the 16th International Euro-Par Conference on Parallel Processing: Part II, 428--439."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/CLUSTER.2010.33"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/JLT.2011.2172989"},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of the ACM\/IEEE 2002 Conference on Supercomputing. 1--22","year":"2002","unstructured":"TheBlueGene\/LTeam. 2002 . An overview of the bluegene\/l supercomputer . In Proceedings of the ACM\/IEEE 2002 Conference on Supercomputing. 1--22 . TheBlueGene\/LTeam. 2002. An overview of the bluegene\/l supercomputer. In Proceedings of the ACM\/IEEE 2002 Conference on Supercomputing. 1--22."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.5555\/1375990.1376008"},{"key":"e_1_2_1_50_1","unstructured":"Top500. 2015. Top500 supercomputers site. Retrieved from http:\/\/www.top500.org.  Top500. 2015. Top500 supercomputers site. Retrieved from http:\/\/www.top500.org."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8191(00)00063-6"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPPW.2009.74"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10910-008-9423-2"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2011.342"},{"key":"e_1_2_1_55_1","volume-title":"Cray User Group Conference","author":"Worley P. H.","unstructured":"P. H. Worley , R. F. Barrett , and J. A. Kuehn . 2009. Early evaluation of the cray XT5 . Cray User Group Conference . New York, NY. P. H. Worley, R. F. Barrett, and J. A. Kuehn. 2009. Early evaluation of the cray XT5. Cray User Group Conference. New York, NY."}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2983387","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2983387","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:39:50Z","timestamp":1750217990000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2983387"}},"subtitle":["A Survey"],"short-title":[],"issued":{"date-parts":[[2016,9,16]]},"references-count":55,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2017,9,30]]}},"alternative-id":["10.1145\/2983387"],"URL":"https:\/\/doi.org\/10.1145\/2983387","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,9,16]]},"assertion":[{"value":"2015-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-09-16","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}