{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T02:24:03Z","timestamp":1783391043461,"version":"3.54.6"},"reference-count":59,"publisher":"IOP Publishing","issue":"1","license":[{"start":{"date-parts":[[2025,2,14]],"date-time":"2025-02-14T00:00:00Z","timestamp":1739491200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2025,2,14]],"date-time":"2025-02-14T00:00:00Z","timestamp":1739491200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"name":"Ministerium f\u00fcr Wirtschaft, Arbeit und Tourismus Baden-W\u00fcrttemberg","award":["WM3-4332-34\/77"],"award-info":[{"award-number":["WM3-4332-34\/77"]}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Mach. Learn.: Sci. Technol."],"published-print":{"date-parts":[[2025,3,31]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Quantum machine learning (QML) models use encoding circuits to map data into a quantum Hilbert space. While it is well known that the architecture of these circuits significantly influences core properties of the resulting model, they are often chosen heuristically. In this work, we present a approach using reinforcement learning techniques to generate problem-specific encoding circuits to improve the performance of QML models. By specifically using a model-based reinforcement learning algorithm, we reduce the number of necessary circuit evaluations during the search, providing a sample-efficient framework. In contrast to previous search algorithms, our method uses a layered circuit structure that significantly reduces the search space. Additionally, our approach can account for multiple objectives such as solution quality and circuit depth. We benchmark our tailored circuits against various reference models, including models with problem-agnostic circuits and classical models. Our results highlight the effectiveness of problem-specific encoding circuits in enhancing QML model performance.<\/jats:p>","DOI":"10.1088\/2632-2153\/adaf75","type":"journal-article","created":{"date-parts":[[2025,1,28]],"date-time":"2025-01-28T22:58:33Z","timestamp":1738105113000},"page":"015041","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Reinforcement learning-based architecture search for quantum machine learning"],"prefix":"10.1088","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-6240-8390","authenticated-orcid":true,"given":"Frederic","family":"Rapp","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8129-6864","authenticated-orcid":false,"given":"David A","family":"Kreplin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8250-2092","authenticated-orcid":false,"given":"Marco F","family":"Huber","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1276-5655","authenticated-orcid":true,"given":"Marco","family":"Roth","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"266","published-online":{"date-parts":[[2025,2,14]]},"reference":[{"key":"mlstadaf75bib1","doi-asserted-by":"publisher","first-page":"79","DOI":"10.22331\/q-2018-08-06-79","article-title":"Quantum computing in the NISQ era and beyond","volume":"2","author":"Preskill","year":"2018","journal-title":"Quantum"},{"key":"mlstadaf75bib2","doi-asserted-by":"publisher","first-page":"567","DOI":"10.1038\/s43588-022-00311-3","article-title":"Challenges and opportunities in quantum machine learning","volume":"2","author":"Cerezo","year":"2022","journal-title":"Nat. Comput. Sci."},{"key":"mlstadaf75bib3","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevA.98.032309","article-title":"Quantum circuit learning","volume":"98","author":"Mitarai","year":"2018","journal-title":"Phys. Rev. A"},{"key":"mlstadaf75bib4","doi-asserted-by":"publisher","DOI":"10.1088\/2058-9565\/ab4eb5","article-title":"Parameterized quantum circuits as machine learning models","volume":"4","author":"Benedetti","year":"2019","journal-title":"Quantum Sci. Technol."},{"key":"mlstadaf75bib5","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.122.040504","article-title":"Quantum machine learning in feature hilbert spaces","volume":"122","author":"Schuld","year":"2019","journal-title":"Phys. Rev. Lett."},{"key":"mlstadaf75bib6","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1038\/s41586-019-0980-2","article-title":"Supervised learning with quantum-enhanced feature spaces","volume":"567","author":"Havl\u00ed\u010dek","year":"2019","journal-title":"Nature"},{"key":"mlstadaf75bib7","doi-asserted-by":"publisher","first-page":"2631","DOI":"10.1038\/s41467-021-22539-9","article-title":"Power of data in quantum machine learning","volume":"12","author":"Huang","year":"2021","journal-title":"Nat. Commun."},{"key":"mlstadaf75bib8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.physrep.2022.08.003","article-title":"The variational quantum Eigensolver: a review of methods and best practices","volume":"986","author":"Tilly","year":"2022","journal-title":"Phys. Rep."},{"key":"mlstadaf75bib9","doi-asserted-by":"publisher","first-page":"4213","DOI":"10.1038\/ncomms5213","article-title":"A variational eigenvalue solver on a photonic quantum processor","volume":"5","author":"Peruzzo","year":"2014","journal-title":"Nat. Commun."},{"key":"mlstadaf75bib10","article-title":"A quantum approximate optimization algorithm","author":"Farhi","year":"2014"},{"key":"mlstadaf75bib11","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-024-49909-3","article-title":"A lie algebraic theory of Barren plateaus for deep parameterized quantum circuits","author":"Ragone","year":"2023"},{"key":"mlstadaf75bib12","article-title":"A review of barren plateaus in variational quantum computing","author":"Larocca","year":"2024"},{"key":"mlstadaf75bib13","first-page":"pp 12661","article-title":"The inductive bias of quantum kernels","volume":"vol 34","author":"K\u00fcbler","year":"2021"},{"key":"mlstadaf75bib14","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1109\/4235.585893","article-title":"No free lunch theorems for optimization","volume":"1","author":"Wolpert","year":"1997","journal-title":"IEEE Trans. Evol. Comput."},{"key":"mlstadaf75bib15","article-title":"Contextuality and inductive bias in quantum machine learning","author":"Bowles","year":"2023"},{"key":"mlstadaf75bib16","article-title":"Representation theory for geometric quantum machine learning","author":"Ragone","year":"2023"},{"key":"mlstadaf75bib17","doi-asserted-by":"publisher","DOI":"10.1103\/PRXQuantum.3.030341","article-title":"Group-invariant quantum machine learning","volume":"3","author":"Larocca","year":"2022","journal-title":"PRX Quantum"},{"key":"mlstadaf75bib18","doi-asserted-by":"publisher","DOI":"10.1103\/PRXQuantum.4.010328","article-title":"Exploiting symmetry in variational quantum machine learning","volume":"4","author":"Meyer","year":"2023","journal-title":"PRX Quantum"},{"key":"mlstadaf75bib19","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1038\/s41534-024-00804-1","article-title":"Theoretical guarantees for permutation-equivariant quantum neural networks","volume":"10","author":"Schatzki","year":"2024","journal-title":"npj Quantum Inf."},{"key":"mlstadaf75bib20","article-title":"An inductive bias from quantum mechanics: learning order effects with non-commuting measurements","author":"Gili","year":"2023"},{"key":"mlstadaf75bib21","doi-asserted-by":"publisher","first-page":"604","DOI":"10.1038\/s41586-020-03051-4","article-title":"Mastering atari, go, chess and shogi by planning with a learned model","volume":"588","author":"Schrittwieser","year":"2020","journal-title":"Nature"},{"key":"mlstadaf75bib22","doi-asserted-by":"publisher","first-page":"2497","DOI":"10.1007\/s10462-022-10228-y","article-title":"Monte carlo tree search: a review of recent modifications and applications","volume":"56","author":"\u015awiechowski","year":"2023","journal-title":"Artif. Intell. Rev."},{"key":"mlstadaf75bib23","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.113.130503","article-title":"Quantum support vector machine for big data classification","volume":"113","author":"Rebentrost","year":"2014","journal-title":"Phys. Rev. Lett."},{"key":"mlstadaf75bib24","doi-asserted-by":"publisher","DOI":"10.1088\/2058-9565\/ac1ab1","article-title":"Automatic design of quantum feature maps","volume":"6","author":"Altares-L\u00f3pez","year":"2021","journal-title":"Quantum Sci. Technol."},{"key":"mlstadaf75bib25","article-title":"Quantum circuit optimization with deep reinforcement learning","author":"F\u00f6sel","year":"2021"},{"key":"mlstadaf75bib26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3520434","article-title":"Using reinforcement learning to perform qubit routing in quantum compilers","volume":"3","author":"Pozzi","year":"2022","journal-title":"ACM Trans. Quantum Comput."},{"key":"mlstadaf75bib27","article-title":"Curriculum reinforcement learning for quantum architecture search under hardware errors","author":"Patel","year":"2024"},{"key":"mlstadaf75bib28","doi-asserted-by":"publisher","DOI":"10.1088\/2058-9565\/ac87cd","article-title":"Differentiable quantum architecture search","volume":"7","author":"Zhang","year":"2022","journal-title":"Quantum Sci. Technol."},{"key":"mlstadaf75bib29","doi-asserted-by":"publisher","DOI":"10.1088\/2632-2153\/ac28dd","article-title":"Neural predictor based quantum architecture search","volume":"2","author":"Zhang","year":"2021","journal-title":"Mach. Learn.: Sci. Technol."},{"key":"mlstadaf75bib30","article-title":"Quantum architecture search via deep reinforcement learning","author":"Kuo","year":"2021"},{"key":"mlstadaf75bib31","doi-asserted-by":"publisher","first-page":"5157","DOI":"10.1038\/s41598-023-32349-2","article-title":"Quantum architecture search via truly proximal policy optimization","volume":"13","author":"Zhu","year":"2023","journal-title":"Sci. Rep."},{"key":"mlstadaf75bib32","article-title":"Quantum circuit optimization with alphatensor","author":"Ruiz","year":"2024"},{"key":"mlstadaf75bib33","first-page":"pp 18182","article-title":"Reinforcement learning for optimization of variational quantum circuit architectures","volume":"vol 34","author":"Ostaszewski","year":"2021"},{"key":"mlstadaf75bib34","doi-asserted-by":"crossref","DOI":"10.1109\/QCE60285.2024.00187","article-title":"Challenges for reinforcement learning in quantum circuit design","author":"Altmann","year":"2024"},{"key":"mlstadaf75bib35","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1007\/s42484-024-00181-0","article-title":"A quantum information theoretic analysis of reinforcement learning-assisted quantum architecture search","volume":"6","author":"Sadhu","year":"2024","journal-title":"Quantum Mach. Intell."},{"key":"mlstadaf75bib36","doi-asserted-by":"publisher","DOI":"10.1109\/TETCI.2024.3499993","article-title":"Automatic and effective discovery of quantum kernels","author":"Incudini","year":"2023"},{"key":"mlstadaf75bib37","doi-asserted-by":"crossref","DOI":"10.1109\/QCE60285.2024.00179","article-title":"Quantum machine learning architecture search via deep reinforcement learning","author":"Dai","year":"2024"},{"key":"mlstadaf75bib38","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevA.103.032430","article-title":"Effect of data encoding on the expressive power of variational quantum-machine-learning models","volume":"103","author":"Schuld","year":"2021","journal-title":"Phys. Rev. A"},{"key":"mlstadaf75bib39","article-title":"Supervised quantum machine learning models are kernel methods","author":"Schuld","year":"2021"},{"key":"mlstadaf75bib40","doi-asserted-by":"publisher","DOI":"10.1103\/PRXQuantum.5.020328","article-title":"Theory for equivariant quantum neural networks","volume":"5","author":"Nguyen","year":"2024","journal-title":"PRX Quantum"},{"key":"mlstadaf75bib41","author":"Sutton","year":"2018"},{"key":"mlstadaf75bib42","article-title":"Proximal policy optimization algorithms","author":"Schulman","year":"2017"},{"key":"mlstadaf75bib43","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1016\/0005-1098(89)90002-2","article-title":"Model predictive control: Theory and practice-a survey","volume":"25","author":"Garc\u00eda","year":"1989","journal-title":"Automatica"},{"key":"mlstadaf75bib44","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1561\/2300000021","article-title":"A survey on policy search for robotics","volume":"2","author":"Deisenroth","year":"2013","journal-title":"Found. Trends Robot."},{"key":"mlstadaf75bib45","first-page":"pp 1889","article-title":"Trust region policy optimization","volume":"vol 37","author":"Schulman","year":"2015"},{"key":"mlstadaf75bib46","article-title":"squlearn \u2014 a python library for quantum machine learning","author":"Kreplin","year":"2023"},{"key":"mlstadaf75bib47","article-title":"Training quantum embedding kernels on near-term quantum computers","author":"Hubregtsen","year":"2021"},{"key":"mlstadaf75bib48","doi-asserted-by":"publisher","DOI":"10.1038\/s41534-021-00498-9","article-title":"Machine learning of high dimensional data on a noisy quantum processor","author":"Peters","year":"2021"},{"key":"mlstadaf75bib49","doi-asserted-by":"publisher","DOI":"10.1088\/2632-2153\/acb0b4","article-title":"Quantum machine learning of large datasets using randomized measurements","volume":"4","author":"Haug","year":"2023","journal-title":"Mach. Learn.: Sci. Technol."},{"key":"mlstadaf75bib50","doi-asserted-by":"crossref","DOI":"10.1145\/3292500.3330701","article-title":"Optuna: a next-generation hyperparameter optimization framework","author":"Akiba","year":"2019"},{"key":"mlstadaf75bib51","doi-asserted-by":"publisher","first-page":"1385","DOI":"10.22331\/q-2024-06-25-1385","article-title":"Reduction of finite sampling noise in quantum neural networks","volume":"8","author":"Kreplin","year":"2024","journal-title":"Quantum"},{"key":"mlstadaf75bib52","article-title":"Better than classical? the subtle art of benchmarking quantum machine learning models","author":"Bowles","year":"2024"},{"key":"mlstadaf75bib53","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41567-023-02340-9","article-title":"Covariant quantum kernels for data with group structure","volume":"20","author":"Glick","year":"2024","journal-title":"Nat. Phys."},{"key":"mlstadaf75bib54","doi-asserted-by":"crossref","DOI":"10.1145\/2939672.2939785","article-title":"Xgboost: a scalable tree boosting system","author":"Chen","year":"2016"},{"key":"mlstadaf75bib55","article-title":"TensorFlow: large-scale machine learning on heterogeneous systems","author":"Abadi","year":"2015"},{"key":"mlstadaf75bib56","first-page":"2825","article-title":"Scikit-learn: machine learning in python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"mlstadaf75bib57","article-title":"Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms","author":"Xiao","year":"2017"},{"key":"mlstadaf75bib58","doi-asserted-by":"publisher","first-page":"517","DOI":"10.1038\/s41467-023-36159-y","article-title":"Quantum machine learning beyond kernel methods","volume":"14","author":"Jerbi","year":"2023","journal-title":"Nat. Commun."},{"key":"mlstadaf75bib59","article-title":"Qiskit: an open-source framework for quantum computing","author":"Qiskit Community","year":"2017"}],"container-title":["Machine Learning: Science and Technology"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/adaf75","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/adaf75\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/adaf75","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/adaf75\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/adaf75\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/adaf75\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/adaf75\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/adaf75\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,14]],"date-time":"2025-02-14T07:37:24Z","timestamp":1739518644000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/adaf75"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,14]]},"references-count":59,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,2,14]]},"published-print":{"date-parts":[[2025,3,31]]}},"URL":"https:\/\/doi.org\/10.1088\/2632-2153\/adaf75","relation":{},"ISSN":["2632-2153"],"issn-type":[{"value":"2632-2153","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,14]]},"assertion":[{"value":"Reinforcement learning-based architecture search for quantum machine learning","name":"article_title","label":"Article Title"},{"value":"Machine Learning: Science and Technology","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2025 The Author(s). Published by IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2024-08-06","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2025-01-28","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2025-02-14","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}