{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,6]],"date-time":"2026-04-06T10:29:12Z","timestamp":1775471352657,"version":"3.50.1"},"reference-count":53,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2018,4,30]],"date-time":"2018-04-30T00:00:00Z","timestamp":1525046400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"U.S. Department of Energy, Office of Science, Office of Advanced Scientific Computing Research, Robinson Pino, program manager","award":["DE-AC05-00OR22725"],"award-info":[{"award-number":["DE-AC05-00OR22725"]}]},{"name":"DOE Office of Science User Facility"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Emerg. Technol. Comput. Syst."],"published-print":{"date-parts":[[2018,4,30]]},"abstract":"<jats:p>Current deep learning approaches have been very successful using convolutional neural networks trained on large graphical-processing-unit-based computers. Three limitations of this approach are that (1) they are based on a simple layered network topology, i.e., highly connected layers, without intra-layer connections; (2) the networks are manually configured to achieve optimal results, and (3) the implementation of the network model is expensive in both cost and power. In this article, we evaluate deep learning models using three different computing architectures to address these problems: quantum computing to train complex topologies, high performance computing to automatically determine network topology, and neuromorphic computing for a low-power hardware implementation. We use the MNIST dataset for our experiment, due to input size limitations of current quantum computers. Our results show the feasibility of using the three architectures in tandem to address the above deep learning limitations. We show that a quantum computer can find high quality values of intra-layer connection weights in a tractable time as the complexity of the network increases, a high performance computer can find optimal layer-based topologies, and a neuromorphic computer can represent the complex topology and weights derived from the other architectures in low power memristive hardware.<\/jats:p>","DOI":"10.1145\/3178454","type":"journal-article","created":{"date-parts":[[2018,7,11]],"date-time":"2018-07-11T20:15:18Z","timestamp":1531340118000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":57,"title":["A Study of Complex Deep Learning Networks on High-Performance, Neuromorphic, and Quantum Computers"],"prefix":"10.1145","volume":"14","author":[{"given":"Thomas E.","family":"Potok","sequence":"first","affiliation":[{"name":"Oak Ridge National Laboratory, Oak Ridge, TN"}]},{"given":"Catherine","family":"Schuman","sequence":"additional","affiliation":[{"name":"Oak Ridge National Laboratory, Oak Ridge, TN"}]},{"given":"Steven","family":"Young","sequence":"additional","affiliation":[{"name":"Oak Ridge National Laboratory, Oak Ridge, TN"}]},{"given":"Robert","family":"Patton","sequence":"additional","affiliation":[{"name":"Oak Ridge National Laboratory, Oak Ridge, TN"}]},{"given":"Federico","family":"Spedalieri","sequence":"additional","affiliation":[{"name":"USC Information Sciences Institute, Marina del Rey, CA"}]},{"given":"Jeremy","family":"Liu","sequence":"additional","affiliation":[{"name":"USC Information Sciences Institute, Marina del Rey, CA"}]},{"given":"Ke-Thia","family":"Yao","sequence":"additional","affiliation":[{"name":"USC Information Sciences Institute, Marina del Rey, CA"}]},{"given":"Garrett","family":"Rose","sequence":"additional","affiliation":[{"name":"University of Tennessee, Knoxville, TN USA"}]},{"given":"Gangotree","family":"Chakma","sequence":"additional","affiliation":[{"name":"University of Tennessee, Knoxville, TN USA"}]}],"member":"320","published-online":{"date-parts":[[2018,7,11]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Mart\u00edn Abadi Ashish Agarwal Paul Barham Eugene Brevdo Zhifeng Chen Craig Citro Greg S. Corrado etal 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. White Paper. TensorFlow. Software available from http:\/\/tensorflow.org.  Mart\u00edn Abadi Ashish Agarwal Paul Barham Eugene Brevdo Zhifeng Chen Craig Citro Greg S. Corrado et al. 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. White Paper. TensorFlow. Software available from http:\/\/tensorflow.org."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog0901_7"},{"key":"e_1_2_1_3_1","volume-title":"Henderson","author":"Adachi Steve H.","year":"2015","unstructured":"Steve H. Adachi and Maxwell P . Henderson . 2015 . Application of quantum annealing to training of deep neural networks. arXiv:1510.06356v1. Steve H. Adachi and Maxwell P. Henderson. 2015. Application of quantum annealing to training of deep neural networks. arXiv:1510.06356v1."},{"key":"e_1_2_1_4_1","volume-title":"Theano: A Python framework for fast computation of mathematical expressions. arXiv:1605.02688","author":"Al-Rfou Rami","year":"2016","unstructured":"Rami Al-Rfou , Guillaume Alain , Amjad Almahairi , Christof Angermueller , Dzmitry Bahdanau , Nicolas Ballas , Fr\u00e9d\u00e9ric Bastien , 2016 . Theano: A Python framework for fast computation of mathematical expressions. arXiv:1605.02688 . http:\/\/arxiv.org\/abs\/1605.02688 Rami Al-Rfou, Guillaume Alain, Amjad Almahairi, Christof Angermueller, Dzmitry Bahdanau, Nicolas Ballas, Fr\u00e9d\u00e9ric Bastien, et al. 2016. Theano: A Python framework for fast computation of mathematical expressions. arXiv:1605.02688. http:\/\/arxiv.org\/abs\/1605.02688"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2012.6252637"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevA.94.022308"},{"key":"e_1_2_1_7_1","unstructured":"Marcello Benedetti John Realpe-G\u00f3mez Rupak Biswas and Alejandro Perdomo-Ortiz. 2016b. Quantum-assisted learning of graphical models with arbitrary pairwise connectivity. arXiv:1609.02542v2.  Marcello Benedetti John Realpe-G\u00f3mez Rupak Biswas and Alejandro Perdomo-Ortiz. 2016b. Quantum-assisted learning of graphical models with arbitrary pairwise connectivity. arXiv:1609.02542v2."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0925-2312(01)00658-0"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the Government Microcircuit Applications and Critical Technology Conference (GOMACTech\u201916)","author":"Cady N.","unstructured":"N. Cady , K. Beckmann , H. Manem , M. E. Dean , G. S. Rose , and J. Van Nostrand . 2016. Towards memristive Dynamic Adaptive Neural Network Arrays . In Proceedings of the Government Microcircuit Applications and Critical Technology Conference (GOMACTech\u201916) . N. Cady, K. Beckmann, H. Manem, M. E. Dean, G. S. Rose, and J. Van Nostrand. 2016. Towards memristive Dynamic Adaptive Neural Network Arrays. In Proceedings of the Government Microcircuit Applications and Critical Technology Conference (GOMACTech\u201916)."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2013.6707077"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the 30th International Conference on Machine Learning (ICML\u201913)","author":"Coates Adam","unstructured":"Adam Coates , Brody Huval , Tao Wang , David J. Wu , Bryan Catanzaro , and Andrew Y. Ng . 2013. Deep learning with COTS HPC systems . In Proceedings of the 30th International Conference on Machine Learning (ICML\u201913) . 1337--1345. http:\/\/jmlr.org\/proceedings\/papers\/v28\/coates13.html. Adam Coates, Brody Huval, Tao Wang, David J. Wu, Bryan Catanzaro, and Andrew Y. Ng. 2013. Deep learning with COTS HPC systems. In Proceedings of the 30th International Conference on Machine Learning (ICML\u201913). 1337--1345. http:\/\/jmlr.org\/proceedings\/papers\/v28\/coates13.html."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2015.7280696"},{"key":"e_1_2_1_13_1","volume-title":"Plank","author":"Disney Adam","year":"2016","unstructured":"Adam Disney , John Reynolds , Catherine D. Schuman , Aleksander Klibisz , Aaron Young , and James S . Plank . 2016 . DANNA : A neuromorphic software ecosystem. Biologically-Inspired Cognitive Architectures 2016. In Press . Adam Disney, John Reynolds, Catherine D. Schuman, Aleksander Klibisz, Aaron Young, and James S. Plank. 2016. DANNA: A neuromorphic software ecosystem. Biologically-Inspired Cognitive Architectures 2016. In Press."},{"key":"e_1_2_1_14_1","volume-title":"Modha","author":"Esser Steve K.","year":"2015","unstructured":"Steve K. Esser , Rathinakumar Appuswamy , Paul Merolla , John V. Arthur , and Dharmendra S . Modha . 2015 . Backpropagation for energy-efficient neuromorphic computing. In Advances in Neural Information Processing Systems . 1117--1125. Steve K. Esser, Rathinakumar Appuswamy, Paul Merolla, John V. Arthur, and Dharmendra S. Modha. 2015. Backpropagation for energy-efficient neuromorphic computing. In Advances in Neural Information Processing Systems. 1117--1125."},{"key":"e_1_2_1_15_1","doi-asserted-by":"crossref","unstructured":"Steven K. Esser Paul A. Merolla John V. Arthur Andrew S. Cassidy Rathinakumar Appuswamy Alexander Andreopoulos David J. Berg etal 2016. Convolutional networks for fast energy-efficient neuromorphic computing. arXiv:1603.08270.  Steven K. Esser Paul A. Merolla John V. Arthur Andrew S. Cassidy Rathinakumar Appuswamy Alexander Andreopoulos David J. Berg et al. 2016. Convolutional networks for fast energy-efficient neuromorphic computing. arXiv:1603.08270.","DOI":"10.1073\/pnas.1604850113"},{"key":"e_1_2_1_16_1","volume-title":"Report MIT-CTP-2936. MIT.","author":"Farhi E.","year":"2000","unstructured":"E. Farhi , J. Goldstone , S. Gutmann , and M. Sipser . 2000 . Quantum Computation by Adiabatic Evolution . Report MIT-CTP-2936. MIT. E. Farhi, J. Goldstone, S. Gutmann, and M. Sipser. 2000. Quantum Computation by Adiabatic Evolution. Report MIT-CTP-2936. MIT."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02650179"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.123"},{"key":"e_1_2_1_19_1","first-page":"926","article-title":"A practical guide to training restricted Boltzmann machines","volume":"9","author":"Hinton Geoffrey","year":"2010","unstructured":"Geoffrey Hinton . 2010 . A practical guide to training restricted Boltzmann machines . Momentum 9 , 1 (2010), 926 . Geoffrey Hinton. 2010. A practical guide to training restricted Boltzmann machines. Momentum 9, 1 (2010), 926.","journal-title":"Momentum"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2006.18.7.1527"},{"key":"e_1_2_1_21_1","doi-asserted-by":"crossref","unstructured":"G. E. Hinton and R. R. Salakhutdinov. 2006. Reducing the dimensionality of data with neural networks. Science 313 5786 (2006) 504--507.  G. E. Hinton and R. R. Salakhutdinov. 2006. Reducing the dimensionality of data with neural networks. Science 313 5786 (2006) 504--507.","DOI":"10.1126\/science.1127647"},{"key":"e_1_2_1_22_1","volume-title":"Salakhutdinov","author":"Hinton Geoffrey E.","year":"2012","unstructured":"Geoffrey E. Hinton , Nitish Srivastava , Alex Krizhevsky , Ilya Sutskever , and Ruslan R . Salakhutdinov . 2012 . Improving neural networks by preventing co-adaptation of feature detectors. arXiv:1207.0580. Geoffrey E. Hinton, Nitish Srivastava, Alex Krizhevsky, Ilya Sutskever, and Ruslan R. Salakhutdinov. 2012. Improving neural networks by preventing co-adaptation of feature detectors. arXiv:1207.0580."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_2_1_24_1","volume-title":"Proceedings of the Workshop on Faces in Real-Life Images: Detection, Alignment, and Recognition.","author":"Huang Gary B.","year":"2008","unstructured":"Gary B. Huang , Marwan Mattar , Tamara Berg , and Eric Learned-Miller . 2008 . Labeled Faces in the Wild: A database for studying face recognition in unconstrained environments . In Proceedings of the Workshop on Faces in Real-Life Images: Detection, Alignment, and Recognition. Gary B. Huang, Marwan Mattar, Tamara Berg, and Eric Learned-Miller. 2008. Labeled Faces in the Wild: A database for studying face recognition in unconstrained environments. In Proceedings of the Workshop on Faces in Real-Life Images: Detection, Alignment, and Recognition."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/IEDM.2015.7409623"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2009.5459469"},{"key":"e_1_2_1_27_1","volume-title":"Caffe: Convolutional architecture for fast feature embedding. arXiv:1408.5093.","author":"Jia Yangqing","year":"2014","unstructured":"Yangqing Jia , Evan Shelhamer , Jeff Donahue , Sergey Karayev , Jonathan Long , Ross Girshick , Sergio Guadarrama , and Trevor Darrell . 2014 . Caffe: Convolutional architecture for fast feature embedding. arXiv:1408.5093. Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick, Sergio Guadarrama, and Trevor Darrell. 2014. Caffe: Convolutional architecture for fast feature embedding. arXiv:1408.5093."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1021\/nl904092h"},{"key":"e_1_2_1_29_1","doi-asserted-by":"crossref","unstructured":"M. W. Johnson M. H. S. Amin S. Gildert T. Lanting F. Hamze N. Dickson R. Harris etal 2011. Quantum annealing with manufactured spins. Nature 473 7346 (2011) 194--198.  M. W. Johnson M. H. S. Amin S. Gildert T. Lanting F. Hamze N. Dickson R. Harris et al. 2011. Quantum annealing with manufactured spins. Nature 473 7346 (2011) 194--198.","DOI":"10.1038\/nature10012"},{"key":"e_1_2_1_30_1","unstructured":"Norm Jouppi. 2016. Google Supercharges Machine Learning Tasks with TPU Custom Chip. Retrieved from https:\/\/cloudplatform.googleblog.com\/2016\/05\/Google-supercharges-machine-learning-tasks-with-custom-chip.html.  Norm Jouppi. 2016. Google Supercharges Machine Learning Tasks with TPU Custom Chip. Retrieved from https:\/\/cloudplatform.googleblog.com\/2016\/05\/Google-supercharges-machine-learning-tasks-with-custom-chip.html."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1021\/nl203687n"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"e_1_2_1_33_1","volume-title":"Burges","author":"LeCun Yann","year":"1998","unstructured":"Yann LeCun , Corinna Cortes , and Christopher J. C . Burges . 1998 b. The MNIST Database of Handwritten Digits. Retrieved from http:\/\/yann.lecun.com\/exdb\/mnist\/. Yann LeCun, Corinna Cortes, and Christopher J. C. Burges. 1998b. The MNIST Database of Handwritten Digits. Retrieved from http:\/\/yann.lecun.com\/exdb\/mnist\/."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISVLSI.2016.46"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSI.2016.2529279"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1088\/0957-4484\/22\/9\/095702"},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the 27th International Conference on Machine Learning (ICML\u201910)","author":"Nair Vinod","unstructured":"Vinod Nair and Geoffrey E. Hinton . 2010. Rectified linear units improve restricted Boltzmann machines . In Proceedings of the 27th International Conference on Machine Learning (ICML\u201910) . 807--814. Vinod Nair and Geoffrey E. Hinton. 2010. Rectified linear units improve restricted Boltzmann machines. In Proceedings of the 27th International Conference on Machine Learning (ICML\u201910). 807--814."},{"key":"e_1_2_1_38_1","unstructured":"Nervana. 2016. Nervana Engine. Retrieved from https:\/\/www.nervanasys.com\/technology\/engine\/.  Nervana. 2016. Nervana Engine. Retrieved from https:\/\/www.nervanasys.com\/technology\/engine\/."},{"key":"e_1_2_1_39_1","doi-asserted-by":"crossref","unstructured":"M. Prezioso F. Merrikh-Bayat B. D. Hoskins G. C. Adam K. K. Likharev and D. B. Strukov. 2015. Training and operation of an integrated neuromorphic network based on metal-oxide memristors. Nature 521 7550 (2015) 61--64.  M. Prezioso F. Merrikh-Bayat B. D. Hoskins G. C. Adam K. K. Likharev and D. B. Strukov. 2015. Training and operation of an integrated neuromorphic network based on metal-oxide memristors. Nature 521 7550 (2015) 61--64.","DOI":"10.1038\/nature14441"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-015-0816-y"},{"key":"e_1_2_1_41_1","volume-title":"Proceedings of the 12th International Conference on Artificial Intelligence and Statistics. 448--455","author":"Salakhutdinov Ruslan","year":"2009","unstructured":"Ruslan Salakhutdinov and Geoffrey Hinton . 2009 . Deep Boltzmann machines . In Proceedings of the 12th International Conference on Artificial Intelligence and Statistics. 448--455 . Ruslan Salakhutdinov and Geoffrey Hinton. 2009. Deep Boltzmann machines. In Proceedings of the 12th International Conference on Artificial Intelligence and Statistics. 448--455."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3060403.3060418"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.5555\/1886436.1886447"},{"key":"e_1_2_1_44_1","volume-title":"Extending SpikeProp. In Proceedings of the 2004 IEEE International Joint Conference on Neural Networks.","volume":"1","author":"Schrauwen Benjamin","year":"2004","unstructured":"Benjamin Schrauwen and Jan Van Campenhout . 2004 . Extending SpikeProp. In Proceedings of the 2004 IEEE International Joint Conference on Neural Networks. Vol. 1 . IEEE, 471--475. Benjamin Schrauwen and Jan Van Campenhout. 2004. Extending SpikeProp. In Proceedings of the 2004 IEEE International Joint Conference on Neural Networks. Vol. 1. IEEE, 471--475."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298682"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2014.11.089"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11432-015-5511-7"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1137\/S0097539795293172"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1038\/78829"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.5555\/3179466.3179467"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSPEC.2008.4687366"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1063\/1.3524521"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2834892.2834896"}],"container-title":["ACM Journal on Emerging Technologies in Computing Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3178454","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3178454","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:39:07Z","timestamp":1750210747000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3178454"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,4,30]]},"references-count":53,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2018,4,30]]}},"alternative-id":["10.1145\/3178454"],"URL":"https:\/\/doi.org\/10.1145\/3178454","relation":{},"ISSN":["1550-4832","1550-4840"],"issn-type":[{"value":"1550-4832","type":"print"},{"value":"1550-4840","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,4,30]]},"assertion":[{"value":"2017-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-07-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}