{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T21:02:39Z","timestamp":1785358959356,"version":"3.55.0"},"reference-count":37,"publisher":"Association for Computing Machinery (ACM)","issue":"8","license":[{"start":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T00:00:00Z","timestamp":1785283200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/publication-rights-and-licensing-policy"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Commun. ACM"],"published-print":{"date-parts":[[2026,8,1]]},"abstract":"<jats:p>Government-funded academic research on parallel computing, stream processing, real-time shading languages, and programmable graphics processing units (GPUs) directly led to the development of GPU computing.<\/jats:p>","DOI":"10.1145\/3778248","type":"journal-article","created":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T15:55:51Z","timestamp":1776095751000},"page":"42-47","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["The Origins of GPU Computing"],"prefix":"10.1145","volume":"69","author":[{"given":"William J.","family":"Dally","sequence":"first","affiliation":[{"name":"Santa Clara, California, United States"},{"name":"Stanford University, Stanford, California, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pat","family":"Hanrahan","sequence":"additional","affiliation":[{"name":"Stanford University, Stanford, California, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,7,29]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"crossref","unstructured":"Batcher K. Design of a massively parallel processor. IEEE Transactions on Computers C-29 9 (1980) 836\u2013840.","DOI":"10.1109\/TC.1980.1675684"},{"key":"e_1_3_1_3_2","unstructured":"Buck I. Brook Spec v0. 2. Stanford University. (2003)"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015800"},{"key":"e_1_3_1_5_2","unstructured":"Buck I. From Brook to GPUs. In Proceedings of the GPU Technology Conf. (2009); https:\/\/www.nvidia.com\/content\/GTC\/documents\/1001_GTC09.pdf"},{"key":"e_1_3_1_6_2","article-title":"CuDNN: Efficient primitives for deep learning","author":"Chetlur S.","year":"2014","unstructured":"Chetlur, S. et al. CuDNN: Efficient primitives for deep learning. arXiv:1410.0759 (2014).","journal-title":"arXiv:1410.0759"},{"key":"e_1_3_1_7_2","unstructured":"Christon M. et al. ASCI Red\u2014Experiences and Lessons Learned with a Massively Parallel TeraFLOP Supercomputer. No. SAND-97-0463C; CONF-9706112-1. Sandia National Lab. (SNL-NM) (1997)."},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/965145.801272"},{"key":"e_1_3_1_9_2","unstructured":"Coates A. et al. Deep learning with COTS HPC systems. In Proceedings of the Intern. Conf. on Machine Learning. PMLR (2013)."},{"key":"e_1_3_1_10_2","volume-title":"Parallel Computer Architecture: A Hardware\/Software Approach","author":"Culler D.","year":"1999","unstructured":"Culler, D. et al. Parallel Computer Architecture: A Hardware\/Software Approach. Gulf Professional Publishing (1999)."},{"key":"e_1_3_1_11_2","first-page":"54","article-title":"The J-machine: A retrospective","volume":"25","author":"Dally W.","year":"1998","unstructured":"Dally, W. et al. The J-machine: A retrospective. Retrospective In 25 (1998), 54\u201358.","journal-title":"Retrospective In"},{"key":"e_1_3_1_12_2","doi-asserted-by":"crossref","unstructured":"Dally W. et al. Merrimac: Supercomputing with streams. In Proceedings of the 2003 ACM\/IEEE Conf. on Supercomputing (2003).","DOI":"10.1145\/1048935.1050187"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/984458.984486"},{"key":"e_1_3_1_14_2","doi-asserted-by":"crossref","unstructured":"Deng J. et al. Imagenet: A large-scale hierarchical image database. In Proceedings of the IEEE Conf. on Computer Vision and Pattern Recognition (2009).","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_3_1_15_2","unstructured":"Elsen E. et al. N-body simulations on GPUs. arXiv:0706.3060 (2007)."},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.1986.276612"},{"key":"e_1_3_1_17_2","unstructured":"Erez M. et al. Analysis and performance results of a molecular modeling application on Merrimac. In Proceedings of the 2004 ACM\/IEEE Conf. on Supercomputing."},{"key":"e_1_3_1_18_2","unstructured":"Erez M. et al. Fault tolerance techniques for the Merrimac streaming supercomputer. In Proceedings of the 2005 ACM\/IEEE Conf. on Supercomputing."},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-014-0733-5"},{"key":"e_1_3_1_20_2","doi-asserted-by":"crossref","unstructured":"Fatahalian K. Sugerman J. and Hanrahan P. Understanding the efficiency of GPU algorithms for matrix-matrix multiplication. In Proceedings of the ACM SIGGRAPH\/EUROGRAPHICS Conf. on Graphics Hardware (2004).","DOI":"10.1145\/1058129.1058148"},{"key":"e_1_3_1_21_2","doi-asserted-by":"crossref","unstructured":"Fatica M. Jameson A. and Alonso J. STREAMFLO: An Euler solver for streaming architectures. In Proceedings of the 42nd AIAA Aerospace Sciences Meeting and Exhibit (2004).","DOI":"10.2514\/6.2004-1090"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF02700035"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/74334.74341"},{"key":"e_1_3_1_24_2","unstructured":"Kapasi U. et al. The Imagine stream processor. In Proceedings of the IEEE Intern. Conf. on Computer Design: VLSI in Computers and Processors (2002)."},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/CMPCON.1993.289660"},{"key":"e_1_3_1_26_2","volume-title":"Programming Massively Parallel Processors: A Hands-On Approach","author":"Kirk D.","year":"2016","unstructured":"Kirk, D. and Hwu, W. Programming Massively Parallel Processors: A Hands-On Approach. Morgan Kaufmann (2016)."},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/40.918001"},{"key":"e_1_3_1_28_2","doi-asserted-by":"crossref","unstructured":"Levinthal A. et al. Parallel computers for graphics applications. In Proceedings of the 2nd Intern. Conf. on Architectural Support for Programming Languages and Operating Systems (1987) 193\u2013198.","DOI":"10.1145\/36206.36202"},{"key":"e_1_3_1_29_2","unstructured":"Luebke D. et al. GPGPU: General-purpose computation on graphics hardware. In Proceedings of the 2006 ACM\/IEEE Conf. on Supercomputing (2006) 206."},{"key":"e_1_3_1_30_2","first-page":"1994","volume-title":"Technical Report","unstructured":"MPI: A Message-Passing Interface Standard. Technical Report. University of Tennessee (1994)."},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/1365490.1365500"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/MM.2010.41"},{"key":"e_1_3_1_33_2","doi-asserted-by":"crossref","unstructured":"Owens J. et al. Polygon rendering on a stream architecture. In Proceedings of the ACM SIGGRAPH\/EUROGRAPHICS Workshop on Graphics Hardware (2000).","DOI":"10.1145\/346876.346883"},{"key":"e_1_3_1_34_2","unstructured":"Owens J. et al. Media processing applications on the Imagine stream processor. In Proceedings of the IEEE Intern. Conf. on Computer Design: VLSI in Computers and Processors (2002)."},{"key":"e_1_3_1_35_2","doi-asserted-by":"crossref","unstructured":"Scott S. Synchronization and communication in the T3E multiprocessor. In Proceedings of the 7th Intern. Conf. on Architectural Support for Programming Languages and Operating Systems (1996) 26\u201336.","DOI":"10.1145\/237090.237144"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/2465.2467"},{"key":"e_1_3_1_37_2","unstructured":"Thompson C. et al. Using modern graphics architectures for general-purpose computing: A framework and analysis. In Proceedings of ACM\/IEEE MICRO-35 (2002)."},{"key":"e_1_3_1_38_2","article-title":"Attention is all you need","volume":"30","author":"Vaswani A.","year":"2017","unstructured":"Vaswani, A. et al. Attention is all you need. Advances in Neural Information Processing Systems 30, (2017).","journal-title":"Advances in Neural Information Processing Systems"}],"container-title":["Communications of the ACM"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3778248","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T20:19:41Z","timestamp":1785356381000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3778248"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,29]]},"references-count":37,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2026,8,1]]}},"alternative-id":["10.1145\/3778248"],"URL":"https:\/\/doi.org\/10.1145\/3778248","relation":{},"ISSN":["0001-0782","1557-7317"],"issn-type":[{"value":"0001-0782","type":"print"},{"value":"1557-7317","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,29]]},"assertion":[{"value":"2025-09-26","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-07-29","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}