{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,10]],"date-time":"2026-04-10T00:41:27Z","timestamp":1775781687648,"version":"3.50.1"},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2024,8,6]],"date-time":"2024-08-06T00:00:00Z","timestamp":1722902400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,8,6]],"date-time":"2024-08-06T00:00:00Z","timestamp":1722902400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100007797","name":"University of Helsinki","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100007797","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Quantum Mach. Intell."],"published-print":{"date-parts":[[2024,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In the field of quantum computing, variational quantum algorithms (VQAs) represent a pivotal category of quantum solutions across a broad spectrum of applications. These algorithms demonstrate significant potential for realising quantum computational advantage. A fundamental aspect of VQAs involves formulating expressive and efficient quantum circuits (namely ansatz), and automating the search of such ansatz is known as quantum architecture search (QAS). Recently reinforcement learning (RL) techniques is utilized to automate the search for ansatzes, know as RL-QAS. This study investigates RL-QAS for crafting ansatz tailored to the variational quantum state diagonalisation problem. Our investigation includes a comprehensive analysis of various dimensions, such as the entanglement thresholds of the resultant states, the impact of initial conditions on the performance of RL-agent, the phase transition behaviour of correlation in concurrence bounds, and the discrete contributions of qubits in deducing eigenvalues through conditional entropy metrics. We leverage these insights to devise an entanglement-guided admissible ansatz in QAS to diagonalise random quantum states using optimal resources. Furthermore, the methodologies presented herein offer a generalised framework for constructing reward functions within RL-QAS applicable to variational quantum algorithms.<\/jats:p>","DOI":"10.1007\/s42484-024-00181-0","type":"journal-article","created":{"date-parts":[[2024,8,6]],"date-time":"2024-08-06T10:02:43Z","timestamp":1722938563000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["A quantum information theoretic analysis of reinforcement learning-assisted quantum architecture search"],"prefix":"10.1007","volume":"6","author":[{"given":"Abhishek","family":"Sadhu","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aritra","family":"Sarkar","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Akash","family":"Kundu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,8,6]]},"reference":[{"key":"181_CR1","doi-asserted-by":"crossref","unstructured":"Harrow AW, Montanaro A (2017) Quantum computational supremacy. Nat 549:203\u2013209","DOI":"10.1038\/nature23458"},{"key":"181_CR2","doi-asserted-by":"crossref","unstructured":"Montanaro A (2016) \u201cQuantum algorithms: an overview\u201d. npj Quantum Inf 2:1\u20138","DOI":"10.1038\/npjqi.2015.23"},{"key":"181_CR3","unstructured":"Sadhu A, Somayajula MA, Horodecki K, Das S (2023) \u201cPractical limitations on robustness and scalability of quantum internet\u201d. arXiv preprint arXiv:2308.12739"},{"key":"181_CR4","doi-asserted-by":"publisher","DOI":"10.1088\/2058-9565\/ac87cd","volume":"7","author":"SX Zhang","year":"2022","unstructured":"Zhang SX, Hsieh CY, Zhang S, Yao H (2022) Differentiable quantum architecture search. Quantum Sci Technol 7:045023","journal-title":"Quantum Sci Technol"},{"key":"181_CR5","doi-asserted-by":"crossref","unstructured":"Du Y, Huang T, You S, Hsieh MH, Tao D (2022) \u201cQuantum circuit architecture search for variational quantum algorithms\u201d. npj Quantum Inf 8:62","DOI":"10.1038\/s41534-022-00570-y"},{"key":"181_CR6","unstructured":"Kuo EJ, Fang YLL, Chen SYC (2021) \u201cQuantum architecture search via deep reinforcement learning,\u201d arXiv preprint arXiv:2104.07715"},{"key":"181_CR7","doi-asserted-by":"crossref","unstructured":"Zhang SX, Hsieh CY, Zhang S, Yao H (2021) Neural predictor based quantum architecture search. Mach Learn: Sci Technol 2","DOI":"10.1088\/2632-2153\/ac28dd"},{"key":"181_CR8","doi-asserted-by":"publisher","DOI":"10.1088\/1367-2630\/18\/2\/023023","volume":"18","author":"JR McClean","year":"2016","unstructured":"McClean JR, Romero J, Babbush R, Aspuru-Guzik A (2016) The theory of variational hybrid quantum-classical algorithms. New J Phys 18:023023","journal-title":"New J Phys"},{"key":"181_CR9","doi-asserted-by":"publisher","first-page":"625","DOI":"10.1038\/s42254-021-00348-9","volume":"3","author":"M Cerezo","year":"2021","unstructured":"Cerezo M, Arrasmith A, Babbush R, Benjamin SC, Endo S, Fujii K, McClean JR, Mitarai K, Yuan X, Cincio L et al (2021) Variational quantum algorithms. Nat Rev Phys 3:625\u2013644","journal-title":"Nat Rev Phys"},{"key":"181_CR10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10515-024-00436-x","volume":"31","author":"A Sarkar","year":"2024","unstructured":"Sarkar A (2024) Automated quantum software engineering. Autom Softw Eng 31:1\u201317","journal-title":"Autom Softw Eng"},{"key":"181_CR11","first-page":"18182","volume":"34","author":"M Ostaszewski","year":"2021","unstructured":"Ostaszewski M, Trenkwalder LM, Masarczyk W, Scerri E, Dunjko V (2021) Reinforcement learning for optimization of variational quantum circuit architectures. Adv Neural Inf Process Syst 34:18182\u201318194","journal-title":"Adv Neural Inf Process Syst"},{"key":"181_CR12","doi-asserted-by":"publisher","DOI":"10.1088\/1367-2630\/ad1b7f","volume":"26","author":"A Kundu","year":"2024","unstructured":"Kundu A, Bedelek P, Ostaszewski M, Danaci O, Patel YJ, Dunjko V, Miszczak JA (2024) Enhancing variational quantum state diagonalization using reinforcement learning techniques. New J Phys 26:013034","journal-title":"New J Phys"},{"key":"181_CR13","unstructured":"Patel YJ, Kundu A, Ostaszewski M, Bonet-Monroig X, Dunjko V, Danaci O (2024) \u201cCurriculum reinforcement learning for quantum architecture search under hardware errors,\u201d arXiv preprint arXiv:2402.03500 (2024)"},{"key":"181_CR14","unstructured":"Sutton RS, Barto AG (2018) Reinforcement learning: an introduction (MIT press, 2018)"},{"key":"181_CR15","unstructured":"Wu W, Yan G, Lu X, Pan K, Yan J (2023) \u201cQuantumdarts: differentiable quantum architecture search for variational quantum algorithms\u201d. in International Conference on Machine Learning (PMLR, 2023). pp 37745\u201337764"},{"key":"181_CR16","unstructured":"Kundu A (2024) \u201cReinforcement learning-assisted quantum architecture search for variational quantum algorithms\u201d. arXiv preprint arXiv:2402.13754"},{"key":"181_CR17","doi-asserted-by":"crossref","unstructured":"LaRose R, Tikku A, O\u2019Neel-Judy E, Cincio L, Coles PJ (2019) \u201cVariational quantum state diagonalization\u201d. npj Quantum Inf 5:57","DOI":"10.1038\/s41534-019-0167-6"},{"key":"181_CR18","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevResearch.3.033251","volume":"3","author":"KC Tan","year":"2021","unstructured":"Tan KC, Volkoff T (2021) Variational quantum algorithms to estimate rank, quantum entropies, fidelity, and fisher information via purity minimization. Phys Rev Res 3:033251","journal-title":"Phys Rev Res"},{"key":"181_CR19","doi-asserted-by":"publisher","first-page":"248","DOI":"10.22331\/q-2020-03-26-248","volume":"4","author":"M Cerezo","year":"2020","unstructured":"Cerezo M, Poremba A, Cincio L, Coles PJ (2020) Variational quantum fidelity estimation. Quantum 4:248","journal-title":"Quantum"},{"key":"181_CR20","doi-asserted-by":"publisher","DOI":"10.1088\/2058-9565\/ac8572","volume":"7","author":"A Kundu","year":"2022","unstructured":"Kundu A, Miszczak JA (2022) Variational certification of quantum devices. Quantum Sci Technol 7:045017","journal-title":"Quantum Sci Technol"},{"key":"181_CR21","doi-asserted-by":"publisher","first-page":"242","DOI":"10.1038\/nature23879","volume":"549","author":"A Kandala","year":"2017","unstructured":"Kandala A, Mezzacapo A, Temme K, Takita M, Brink M, Chow JM, Gambetta JM (2017) Hardware-efficient variational quantum eigensolver for small molecules and quantum magnets. Nat 549:242\u2013246","journal-title":"Nat"},{"key":"181_CR22","doi-asserted-by":"crossref","unstructured":"Mustafa H, Morapakula SN, Jain P, Ganguly S (2022) \u201cVariational quantum algorithms for chemical simulation and drug discovery,\u201d in 2022 International Conference on Trends in Quantum Computing and Emerging Business Technologies (TQCEBT) (IEEE, 2022) pp 1\u20138","DOI":"10.1109\/TQCEBT54229.2022.10041453"},{"key":"181_CR23","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevA.104.052402","volume":"104","author":"A Delgado","year":"2021","unstructured":"Delgado A, Arrazola JM, Jahangiri S, Niu Z, Izaac J, Roberts C, Killoran N (2021) Variational quantum algorithm for molecular geometry optimization. Phys Rev A 104:052402","journal-title":"Phys Rev A"},{"key":"181_CR24","doi-asserted-by":"crossref","unstructured":"Khairy S, Shaydulin R, Cincio L, Alexeev Y, Balaprakash P \u201cLearning to optimize variational quantum circuits to solve combinatorial problems\u201d. in Proceedings of the AAAI conference on artificial intelligence, Vol. 34. pp 2367\u20132375","DOI":"10.1609\/aaai.v34i03.5616"},{"key":"181_CR25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TQE.2022.3223368","volume":"3","author":"X Liu","year":"2022","unstructured":"Liu X, Angone A, Shaydulin R, Safro I, Alexeev Y, Cincio L (2022) Layer VQE: a variational approach for combinatorial optimization on noisy quantum computers. IEEE Trans Quantum Eng 3:1\u201320","journal-title":"IEEE Trans Quantum Eng"},{"key":"181_CR26","doi-asserted-by":"crossref","unstructured":"Glos A, Krawiec A, Zimbor\u00b4as Z (2022) \u201cSpace-efficient binary optimization for variational quantum computing,\u201d npj Quantum Inf 8:39","DOI":"10.1038\/s41534-022-00546-y"},{"key":"181_CR27","doi-asserted-by":"crossref","unstructured":"Wilde MM (2013) Quantum information theory (Cambridge university press, 2013)","DOI":"10.1017\/CBO9781139525343"},{"key":"181_CR28","doi-asserted-by":"publisher","first-page":"631","DOI":"10.1038\/nphys3029","volume":"10","author":"S Lloyd","year":"2014","unstructured":"Lloyd S, Mohseni M, Rebentrost P (2014) Quantum principal component analysis. Nat Phys 10:631\u2013633","journal-title":"Nat Phys"},{"key":"181_CR29","doi-asserted-by":"crossref","unstructured":"Powell MJD (1994) \u201cA direct search optimization method that models the objective and constraint functions by linear interpolation\u201d. in Advances in Optimization and Numerical Analysis. Mathematics and Its Applications, Vol. 275, (ed) by Gomez S, Hennart JP. (Springer,1994)","DOI":"10.1007\/978-94-015-8330-5_4"},{"key":"181_CR30","doi-asserted-by":"crossref","unstructured":"Powell MJD (2006) \u201cA fast algorithm for nonlinearly constrained optimization calculations,\u201d in Numerical Analysis: Proceedings of the Biennial Conference Held at Dundee, June 28\u2013July 1, 1977 (Springer, 2006) pp 144\u2013157","DOI":"10.1007\/BFb0067703"},{"key":"181_CR31","doi-asserted-by":"crossref","unstructured":"Hasselt HV, Guez A, Silver D (2016) \u201cDeep reinforcement learning with double q-learning\u201d. in Proceedings of the AAAI conference on artificial intelligence, Vol. 30","DOI":"10.1609\/aaai.v30i1.10295"},{"key":"181_CR32","doi-asserted-by":"crossref","unstructured":"Alagic G, Majenz C, Russell A (2020) \u201cEfficient simulation of random states and random unitaries,\u201d in Advances in Cryptology\u2013EUROCRYPT 2020: 39th Annual International Conference on the Theory and Applications of Cryptographic Techniques, Zagreb, Croatia, May 10\u201314, 2020, Proceedings, Part III 39 (Springer, 2020) pp 759\u2013787","DOI":"10.1007\/978-3-030-45727-3_26"},{"key":"181_CR33","unstructured":"Chen B, Coladangelo A, Sattath O (2024) \u201cThe power of a single haar random state: constructing and separating quantum pseudorandomness,\u201d arXiv preprint arXiv:2404.03295"},{"key":"181_CR34","unstructured":"Kingma DP, Ba J (2014) \u201cAdam: a method for stochastic optimization,\u201d arXiv preprint arXiv:1412.6980"},{"key":"181_CR35","doi-asserted-by":"publisher","first-page":"5022","DOI":"10.1103\/PhysRevLett.78.5022","volume":"78","author":"SA Hill","year":"1997","unstructured":"Hill SA, Wootters WK (1997) Entanglement of a pair of quantum bits. Phys Rev Lett 78:5022\u20135025","journal-title":"Phys Rev Lett"},{"key":"181_CR36","doi-asserted-by":"crossref","unstructured":"Wootters WK (1998) Entanglement of formation of an arbitrary state of two qubits. Phys Rev Lett 80:2245\u20132248","DOI":"10.1103\/PhysRevLett.80.2245"},{"key":"181_CR37","doi-asserted-by":"publisher","first-page":"59","DOI":"10.2307\/2685263","volume":"42","author":"JL Rodgers","year":"1988","unstructured":"Rodgers JL, Nicewander WA (1988) Thirteen ways to look at the correlation coefficient. Am Stat 42:59\u201366","journal-title":"Am Stat"},{"key":"181_CR38","doi-asserted-by":"publisher","first-page":"5194","DOI":"10.1103\/PhysRevLett.79.5194","volume":"79","author":"NJ Cerf","year":"1997","unstructured":"Cerf NJ, Adami C (1997) Negative entropy and information in quantum mechanics. Phys Rev Lett 79:5194\u20135197","journal-title":"Phys Rev Lett"},{"key":"181_CR39","doi-asserted-by":"crossref","unstructured":"Cerf NJ, Adami C (1999) Quantum extension of conditional probability. Phys Rev A 60:893\u2013897","DOI":"10.1103\/PhysRevA.60.893"},{"key":"181_CR40","doi-asserted-by":"publisher","first-page":"865","DOI":"10.1103\/RevModPhys.81.865","volume":"81","author":"R Horodecki","year":"2009","unstructured":"Horodecki R, Horodecki P, Horodecki M, Horodecki K (2009) Quantum entanglement. Rev Mod Phys 81:865\u2013942","journal-title":"Rev Mod Phys"},{"key":"181_CR41","doi-asserted-by":"publisher","first-page":"419","DOI":"10.1103\/RevModPhys.86.419","volume":"86","author":"N Brunner","year":"2014","unstructured":"Brunner N, Cavalcanti D, Pironio S, Scarani V, Wehner S (2014) Bell nonlocality. Revi Mod Phys 86:419","journal-title":"Revi Mod Phys"},{"key":"181_CR42","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevA.107.012212","volume":"107","author":"A Sadhu","year":"2023","unstructured":"Sadhu A, Das S (2023) Testing of quantum nonlocal correlations under constrained free will and imperfect detectors. Phys Rev A 107:012212","journal-title":"Phys Rev A"},{"key":"181_CR43","doi-asserted-by":"publisher","DOI":"10.1103\/RevModPhys.92.015001","volume":"92","author":"R Uola","year":"2020","unstructured":"Uola R, Costa ACS, Nguyen HC, G\u00fchne O (2020) Quantum steering. Rev Mod Phys 92:015001","journal-title":"Rev Mod Phys"},{"key":"181_CR44","unstructured":"Sadhu A, Das S (2024) \u201cQuantum steering under constrained free-will\u201d. arXiv preprint arXiv:2406.13494"},{"key":"181_CR45","unstructured":"An ,Z Cao C, Xu CQ, Zhou DL (2021) \u201cLearning quantum phases via single-qubit disentanglement\u201d. arXiv preprint arXiv:2107.03542"}],"container-title":["Quantum Machine Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s42484-024-00181-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s42484-024-00181-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s42484-024-00181-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,23]],"date-time":"2024-12-23T16:07:05Z","timestamp":1734970025000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s42484-024-00181-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,6]]},"references-count":45,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,12]]}},"alternative-id":["181"],"URL":"https:\/\/doi.org\/10.1007\/s42484-024-00181-0","relation":{},"ISSN":["2524-4906","2524-4914"],"issn-type":[{"value":"2524-4906","type":"print"},{"value":"2524-4914","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,6]]},"assertion":[{"value":"7 May 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 July 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 August 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"49"}}