{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,3]],"date-time":"2026-10-03T02:25:07Z","timestamp":1790994307433,"version":"4.1.0"},"reference-count":40,"publisher":"American Association for the Advancement of Science (AAAS)","content-domain":{"domain":["spj.science.org"],"crossmark-restriction":true},"short-container-title":["Intell Comput"],"published-print":{"date-parts":[[2023,1]]},"abstract":"<jats:p>Recent research has demonstrated that parametric quantum circuits (PQCs) are affected by gradients that progressively vanish to zero as a function of the number of qubits. We show that using a combination of gradient-free natural evolutionary strategy and gradient descent can mitigate the possibility of optimizing barren plateaus in the landscape. We implemented 2 specific methods: natural evolutionary strategy stochastic gradient descent (NESSGD) and natural evolutionary strategy adapting the step size according to belief in observed gradients (NESAdaBelief) to optimize PQC parameter values. They were compared with standard stochastic gradient descent, adaptive moment estimation, and a version of adaptive moment estimation adapting the step size according to belief in observed gradients in 5 classification tasks. NESSGD and NESAdaBelief demonstrated some superiority in 4 of the tasks. NESAdaBelief showed higher accuracy than AdaBelief in all 5 tasks. In addition, we investigated the applicability of NESSGD under the parameter shift rule and demonstrated that NESSGD can adapt to this rule, which means that our proposed method could also optimize the parameters of PQCs on quantum computers.<\/jats:p>","DOI":"10.34133\/icomputing.0042","type":"journal-article","created":{"date-parts":[[2023,8,24]],"date-time":"2023-08-24T18:38:06Z","timestamp":1692902286000},"update-policy":"https:\/\/doi.org\/10.34133\/aaas_crossmark_01","source":"Crossref","is-referenced-by-count":2,"title":["Natural Evolutionary Gradient Descent Strategy for Variational Quantum Algorithms"],"prefix":"10.34133","volume":"2","author":[{"given":"Jianshe","family":"Xie","sequence":"first","affiliation":[{"name":"Chongqing Normal University, Chongqing 401331, China."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chen","family":"Xu","sequence":"additional","affiliation":[{"name":"Chongqing Normal University, Chongqing 401331, China."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chenhao","family":"Yin","sequence":"additional","affiliation":[{"name":"Chongqing Normal University, Chongqing 401331, China."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yumin","family":"Dong","sequence":"additional","affiliation":[{"name":"Chongqing Normal University, Chongqing 401331, China."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhirong","family":"Zhang","sequence":"additional","affiliation":[{"name":"China Telecom Corporation Limited Chongqing Branch, Chongqing, China."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"221","published-online":{"date-parts":[[2023,9,8]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"crossref","unstructured":"Preskill J. Quantum computing in the NISQ era and beyond. arXiv. 2018. https:\/\/doi.org\/10.48550\/arXiv.1801.00862","DOI":"10.22331\/q-2018-08-06-79"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1038\/ncomms5213"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1088\/1367-2630\/18\/2\/023023"},{"key":"e_1_3_3_5_2","doi-asserted-by":"crossref","DOI":"10.1038\/srep03589","article-title":"From transistor to trapped-ion computers for quantum chemistry","volume":"4","author":"Yung MH","year":"2014","unstructured":"Yung MH, Casanova J, Mezzacapo A, McClean J, Lamata L, Aspuru-Guzik A, Solano E. From transistor to trapped-ion computers for quantum chemistry. Sci Rep. 2014;4:3589.","journal-title":"Sci Rep"},{"key":"e_1_3_3_6_2","unstructured":"Farhi E Goldstone J Gutmann S. A quantum approximate optimization algorithm. ArXiv. 2014. https:\/\/doi.org\/10.48550\/arXiv.1411.4028."},{"key":"e_1_3_3_7_2","unstructured":"Johnson PD Romero J Olson J Cao Y Aspuru-Guzik A. QVECTOR: an algorithm for device-tailored quantum error correction. ArXiv. 2017. https:\/\/doi.org\/10.48550\/arXiv.1711.02249."},{"key":"e_1_3_3_8_2","unstructured":"Cao Y Guerreschi GG and Aspuru-Guzik A. Quantum neuron: an elementary building block for machine learning on quantum computers. ArXiv. 2017. https:\/\/doi.org\/10.48550\/arXiv.1711.11240."},{"key":"e_1_3_3_9_2","article-title":"Quantum chemistry calculations on a trapped-ion quantum simulator","volume":"8","author":"Hempel C","year":"2018","unstructured":"Hempel C, Maier C, Romero J, McClean J, Monz T, Shen H, Jurcevic P, Lanyon BP, Love P, Babbush R, et al. Quantum chemistry calculations on a trapped-ion quantum simulator. Phys Rev X. 2018;8:031022.","journal-title":"Phys Rev X"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-019-0980-2"},{"key":"e_1_3_3_11_2","unstructured":"Farhi E and Neven H. Classification with quantum neural networks on near term processors. ArXiv. 2018. https:\/\/doi.org\/10.48550\/arXiv.1802.06002."},{"issue":"3","key":"e_1_3_3_12_2","doi-asserted-by":"crossref","DOI":"10.1103\/PhysRevA.101.032308","article-title":"Circuit-centric quantum classifiers","volume":"101","author":"Schuld M","year":"2020","unstructured":"Schuld M, Bocharov A, Svore KM, Wiebe N. Circuit-centric quantum classifiers. Phys Rev A. 2020;101(3):032308.","journal-title":"Phys Rev A"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1088\/2058-9565\/aa8072"},{"key":"e_1_3_3_14_2","doi-asserted-by":"crossref","DOI":"10.1103\/PhysRevA.98.012324","article-title":"Quantum generative adversarial networks","volume":"98","author":"Dallaire-Demers PL","year":"2018","unstructured":"Dallaire-Demers PL, Killoran N. Quantum generative adversarial networks. Phys Rev A. 2018;98:012324.","journal-title":"Phys Rev A"},{"issue":"4","key":"e_1_3_3_15_2","doi-asserted-by":"crossref","DOI":"10.1103\/PhysRevLett.121.040502","article-title":"Quantum generative adversarial learning","volume":"121","author":"Lloyd S","year":"2018","unstructured":"Lloyd S, Weedbrook C. Quantum generative adversarial learning. Phys Rev Lett. 2018;121(4):040502.","journal-title":"Phys Rev Lett"},{"issue":"5","key":"e_1_3_3_16_2","doi-asserted-by":"crossref","DOI":"10.1103\/PhysRevA.99.052306","article-title":"Learning and inference on generative adversarial quantum circuits","volume":"99","author":"Zeng J","year":"2019","unstructured":"Zeng J, Wu Y, Liu JG, Wang L, Hu J. Learning and inference on generative adversarial quantum circuits. Phys Rev A. 2019;99(5):052306.","journal-title":"Phys Rev A"},{"key":"e_1_3_3_17_2","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1016\/j.ins.2020.05.127","article-title":"Quantum generative adversarial network for generating discrete distribution","volume":"538","author":"Situ H","year":"2020","unstructured":"Situ H, He Z, Wang Y, Li L, Zheng S. Quantum generative adversarial network for generating discrete distribution. Inform Sci. 2020;538:193\u2013208.","journal-title":"Inform Sci"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1126\/sciadv.aaw9918"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1002\/qute.202000003"},{"key":"e_1_3_3_20_2","doi-asserted-by":"crossref","first-page":"4812","DOI":"10.1038\/s41467-018-07090-4","article-title":"Barren plateaus in quantum neural network training landscapes","volume":"9","author":"McClean J","year":"2018","unstructured":"McClean J, Boixo S, Smelyanskiy VN, Babbush R, Neven H. Barren plateaus in quantum neural network training landscapes. Nat Commun. 2018;9:4812.","journal-title":"Nat Commun"},{"key":"e_1_3_3_21_2","doi-asserted-by":"crossref","first-page":"269","DOI":"10.22331\/q-2020-05-25-269","article-title":"Quantum natural gradient","volume":"4","author":"Stokes J","year":"2020","unstructured":"Stokes J, Izaac J, Killoran N, Carleo G. Quantum natural gradient. Quantum. 2020;4:269.","journal-title":"Quantum"},{"key":"e_1_3_3_22_2","doi-asserted-by":"crossref","first-page":"214","DOI":"10.22331\/q-2019-12-09-214","article-title":"An initialization strategy for addressing barren plateaus in parametrized quantum circuits","volume":"3","author":"Grant E","year":"2019","unstructured":"Grant E, Wossnig L, Ostaszewski M, Benedetti M. An initialization strategy for addressing barren plateaus in parametrized quantum circuits. Quantum. 2019;3:214.","journal-title":"Quantum"},{"issue":"2","key":"e_1_3_3_23_2","doi-asserted-by":"crossref","DOI":"10.1103\/PRXQuantum.3.020365","article-title":"Avoiding barren plateaus using classical shadows","volume":"3","author":"Sack SH","year":"2022","unstructured":"Sack SH, Medina RA, Michailidis AA, Kueng R, Serbyn M. Avoiding barren plateaus using classical shadows. PRX Quantum. 2022;3(2):020365.","journal-title":"PRX Quantum"},{"key":"e_1_3_3_24_2","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1023\/A:1015059928466","article-title":"Evolution strategies\u2013a comprehensive introduction","volume":"1","author":"Beyer HG","year":"2002","unstructured":"Beyer HG, Schwefel HP. Evolution strategies\u2013a comprehensive introduction. Nat Comput. 2002;1:3\u201352.","journal-title":"Nat Comput"},{"key":"e_1_3_3_25_2","unstructured":"GoldbergD E. Genetic algorithm in search optimization and machine learning . Boston (MA):Addison-Wesley; 1989."},{"key":"e_1_3_3_26_2","unstructured":"Igel C. Neuroevolution for reinforcement learning using evolution strategies. Paper presented at: CEC\u201903. The 2003 Congress on Evolutionary Computation; 2003 December 8\u201312; Canberra ACT Australia."},{"key":"e_1_3_3_27_2","unstructured":"Hansen N. The CMA evolution strategy: A tutorial. ArXiv. 2016. https:\/\/doi.org\/10.48550\/arXiv.1604.00772."},{"issue":"1","key":"e_1_3_3_28_2","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1162\/EVCO_a_00168","article-title":"LM-CMA: An alternative to L-BFGS for large-scale black box optimization","volume":"25","author":"Loshchilov I","year":"2017","unstructured":"Loshchilov I. LM-CMA: An alternative to L-BFGS for large-scale black box optimization. Evolut Comput. 2017;25(1):143\u2013171.","journal-title":"Evolut Comput"},{"key":"e_1_3_3_29_2","doi-asserted-by":"crossref","DOI":"10.1088\/2632-2153\/ac4559","article-title":"Variational quantum reinforcement learning via evolutionary optimization","volume":"3","author":"Chen SYC","year":"2022","unstructured":"Chen SYC, Huang CM, Hsing CW, Goan HS, Kao YJ. Variational quantum reinforcement learning via evolutionary optimization. Mach Learn Sci Technol. 2022;3:015025.","journal-title":"Mach Learn Sci Technol"},{"issue":"4","key":"e_1_3_3_30_2","doi-asserted-by":"crossref","DOI":"10.1088\/2632-2153\/abf3ac","article-title":"Natural evolutionary strategies for variational quantum computation","volume":"2","author":"Anand A","year":"2021","unstructured":"Anand A, Degroote M, Aspuru-Guzik A. Natural evolutionary strategies for variational quantum computation. Mach Learn Sci Technol. 2021;2(4):045012.","journal-title":"Mach Learn Sci Technol"},{"key":"e_1_3_3_31_2","unstructured":"Cui X Zhang W Tuske Z Picheny M. Evolutionary stochastic gradient descent for optimization of deep neural networks. Paper presented at: Advances in Neural Information Processing Systems; 2018 December 8; Red Hook NY USA."},{"key":"e_1_3_3_32_2","unstructured":"Gower RM Loizou N Qian X Sailanbayev A Shulgin E Richtarik P. SGD: General analysis and improved rates. Paper presented at: PMLR 97. Proceedings of the 36th International Conference on Machine Learning; 10\u201315 June 2019; Long Beach (CA): International Conference on Machine Learning. 2019. p. 5200\u20135209."},{"key":"e_1_3_3_33_2","first-page":"18795","article-title":"Adabelief optimizer: Adapting stepsizes by the belief in observed gradients","volume":"33","author":"Zhuang J","year":"2020","unstructured":"Zhuang J, Tang T, Ding Y, Tatikonda SC, Dvornek N, Papademetris X, Duncan J. Adabelief optimizer: Adapting stepsizes by the belief in observed gradients. Adv Neur Inf Process Syst. 2020;33:18795\u201318806.","journal-title":"Adv Neur Inf Process Syst"},{"key":"e_1_3_3_34_2","doi-asserted-by":"crossref","unstructured":"Ambainis A Emerson J. Quantum t-designs: t-wise independence in the quantum world. Paper presented at: Twenty-Second Annual IEEE Conference on Computational Complexity (CCC\u201907). 2007 June 13\u201316; San Diego CA USA.","DOI":"10.1109\/CCC.2007.26"},{"issue":"1","key":"e_1_3_3_35_2","doi-asserted-by":"crossref","DOI":"10.1103\/PhysRevA.80.012304","article-title":"Exact and approximate unitary 2-designs and their application to fidelity estimation","volume":"80","author":"Dankert C","year":"2009","unstructured":"Dankert C, Cleve R, Emerson J, Livine E. Exact and approximate unitary 2-designs and their application to fidelity estimation. Phys Rev A. 2009;80(1):012304.","journal-title":"Phys Rev A"},{"key":"e_1_3_3_36_2","unstructured":"Wilson AC Roelofs R Stern M Srebro N Recht B. The marginal value of adaptive gradient methods in machine learning. Paper presented at: Advances in Neural Information Processing Systems; 2017 December 4; Red Hook NY United States."},{"key":"e_1_3_3_37_2","unstructured":"Lyu K and Li J. Gradient descent maximizes the margin of homogeneous neural networks. ArXiv 2019. arXiv preprint arXiv:1906.05890."},{"key":"e_1_3_3_38_2","unstructured":"Reddi SJ Kale S and Kumar S. On the convergence of adam and beyond. ArXiv. 2019. https:\/\/doi.org\/10.48550\/arXiv.1904.09237."},{"issue":"11","key":"e_1_3_3_39_2","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"LeCun Y","year":"1998","unstructured":"LeCun Y, Bottou L, Bengio Y, Haffner P. Gradient-based learning applied to document recognition. Proc IEEE. 1998;86(11):2278\u20132324.","journal-title":"Proc IEEE"},{"key":"e_1_3_3_40_2","unstructured":"Xiao H Rasul K and Vollgraf R. Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms. ArXiv. 2017. https:\/\/doi.org\/10.48550\/arXiv.1708.07747."},{"key":"e_1_3_3_41_2","unstructured":"Recht B Roelofs R Schmidt L and Shankar V. Do cifar-10 classifiers generalize to cifar-10? ArXiv. 2018. https:\/\/doi.org\/10.48550\/arXiv.1806.00451."}],"container-title":["Intelligent Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/spj.science.org\/doi\/pdf\/10.34133\/icomputing.0042","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,9]],"date-time":"2024-01-09T14:09:56Z","timestamp":1704809396000},"score":1,"resource":{"primary":{"URL":"https:\/\/spj.science.org\/doi\/10.34133\/icomputing.0042"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1]]},"references-count":40,"alternative-id":["10.34133\/icomputing.0042"],"URL":"https:\/\/doi.org\/10.34133\/icomputing.0042","relation":{},"ISSN":["2771-5892"],"issn-type":[{"value":"2771-5892","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1]]},"assertion":[{"value":"2023-05-05","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-07-30","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-09-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"0042"}}