{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T18:12:37Z","timestamp":1775067157324,"version":"3.50.1"},"reference-count":44,"publisher":"IOP Publishing","issue":"2","license":[{"start":{"date-parts":[[2023,5,5]],"date-time":"2023-05-05T00:00:00Z","timestamp":1683244800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,5,5]],"date-time":"2023-05-05T00:00:00Z","timestamp":1683244800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"DOI":"10.13039\/501100000780","name":"European Union","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Transformation and Resilience Plan","award":["501100011033"],"award-info":[{"award-number":["501100011033"]}]},{"name":"EU"},{"name":"EPIQUS","award":["899368"],"award-info":[{"award-number":["899368"]}]},{"DOI":"10.13039\/501100003399","name":"STCSM","doi-asserted-by":"crossref","award":["2019SHZDZX01-ZX04"],"award-info":[{"award-number":["2019SHZDZX01-ZX04"]}],"id":[{"id":"10.13039\/501100003399","id-type":"DOI","asserted-by":"crossref"}]},{"name":"QUANTEK","award":["KK-2021\/00070"],"award-info":[{"award-number":["KK-2021\/00070"]}]},{"name":"Valencian Government"},{"name":"Spanish Ministry of Economic A\ufb00airs"},{"DOI":"10.13039\/501100001809","name":"NSFC","doi-asserted-by":"crossref","award":["12075145"],"award-info":[{"award-number":["12075145"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100003086","name":"Basque Government","doi-asserted-by":"crossref","award":["IT1470-22"],"award-info":[{"award-number":["IT1470-22"]}],"id":[{"id":"10.13039\/501100003086","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Mach. Learn.: Sci. Technol."],"published-print":{"date-parts":[[2023,6,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>The exotic nature of quantum mechanics differentiates machine learning applications in the quantum realm from classical ones. Stream learning is a powerful approach that can be applied to extract knowledge continuously from quantum systems in a wide range of tasks. In this paper, we propose a deep reinforcement learning method that uses streaming data from a continuously measured qubit in the presence of detuning, dephasing, and relaxation. The model receives streaming quantum information for learning and decision-making, providing instant feedback on the quantum system. We also explore the agent\u2019s adaptability to other quantum noise patterns through transfer learning. Our protocol offers insights into closed-loop quantum control, potentially advancing the development of quantum technologies.<\/jats:p>","DOI":"10.1088\/2632-2153\/acd048","type":"journal-article","created":{"date-parts":[[2023,4,25]],"date-time":"2023-04-25T23:01:33Z","timestamp":1682463693000},"page":"025020","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Closed-loop control of a noisy qubit with reinforcement learning"],"prefix":"10.1088","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6008-0001","authenticated-orcid":true,"given":"Yongcheng","family":"Ding","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4221-4288","authenticated-orcid":true,"given":"Xi","family":"Chen","sequence":"additional","affiliation":[]},{"given":"Rafael","family":"Magdalena-Benedito","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9378-0285","authenticated-orcid":true,"given":"Jos\u00e9 D","family":"Mart\u00edn-Guerrero","sequence":"additional","affiliation":[]}],"member":"266","published-online":{"date-parts":[[2023,5,5]]},"reference":[{"key":"mlstacd048bib1","author":"Nielsen","year":"2010"},{"key":"mlstacd048bib2","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1007\/s10462-012-9330-6","volume":"42","author":"Manju","year":"2014","journal-title":"Artif. Intell. Rev."},{"key":"mlstacd048bib3","doi-asserted-by":"publisher","first-page":"2522","DOI":"10.1109\/TNNLS.2019.2933394","volume":"31","author":"Nguyen","year":"2020","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"mlstacd048bib4","first-page":"pp 56","author":"Shor","year":"1996"},{"key":"mlstacd048bib5","first-page":"pp 213","author":"Preskill","year":"1998"},{"key":"mlstacd048bib6","first-page":"pp 13","volume":"vol 68","author":"Gottesman","year":"2010"},{"key":"mlstacd048bib7","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1103\/RevModPhys.79.53","volume":"79","author":"Kr\u00e1l","year":"2007","journal-title":"Rev. Mod. Phys."},{"key":"mlstacd048bib8","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevA.70.052318","volume":"70","author":"Brown","year":"2004","journal-title":"Phys. Rev. A"},{"key":"mlstacd048bib9","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.106.233001","volume":"106","author":"Torosov","year":"2011","journal-title":"Phys. Rev. Lett."},{"key":"mlstacd048bib10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/ncomms9748","volume":"6","author":"Rong","year":"2015","journal-title":"Nat. Commun."},{"key":"mlstacd048bib11","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevA.75.062326","volume":"75","author":"Steffen","year":"2007","journal-title":"Phys. Rev. A"},{"key":"mlstacd048bib12","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.109.060401","volume":"109","author":"Barnes","year":"2012","journal-title":"Phys. Rev. Lett."},{"key":"mlstacd048bib13","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.111.050404","volume":"111","author":"Daems","year":"2013","journal-title":"Phys. Rev. Lett."},{"key":"mlstacd048bib14","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.125.250403","volume":"125","author":"Dridi","year":"2020","journal-title":"Phys. Rev. Lett."},{"key":"mlstacd048bib15","doi-asserted-by":"publisher","DOI":"10.1103\/RevModPhys.91.045001","volume":"91","author":"Gu\u00e9ry-Odelin","year":"2019","journal-title":"Rev. Mod. Phys."},{"key":"mlstacd048bib16","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1016\/B978-0-12-408090-4.00002-5","volume":"62","author":"Torrontegui","year":"2013","journal-title":"Adv. At. Mol. Opt."},{"key":"mlstacd048bib17","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.104.063002","volume":"104","author":"Chen","year":"2010","journal-title":"Phys. Rev. Lett."},{"key":"mlstacd048bib18","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevApplied.6.054005","volume":"6","author":"Zahedinejad","year":"2016","journal-title":"Phys. Rev. Appl."},{"key":"mlstacd048bib19","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.123.100501","volume":"123","author":"Liu","year":"2019","journal-title":"Phys. Rev. Lett."},{"key":"mlstacd048bib20","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevA.103.L040401","volume":"103","author":"Ding","year":"2021","journal-title":"Phys. Rev. A"},{"key":"mlstacd048bib21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11433-021-1841-2","volume":"65","author":"Ai","year":"2022","journal-title":"Sci. China: Phys. Mech. Astron."},{"key":"mlstacd048bib22","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevX.11.031070","volume":"11","author":"Yao","year":"2021","journal-title":"Phys. Rev. X"},{"key":"mlstacd048bib23","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevX.8.031086","volume":"8","author":"Bukov","year":"2018","journal-title":"Phys. Rev. X"},{"key":"mlstacd048bib24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s42005-019-0169-x","volume":"2","author":"Porotti","year":"2019","journal-title":"Commun. Phys."},{"key":"mlstacd048bib25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41534-019-0141-3","volume":"5","author":"Niu","year":"2019","journal-title":"npj Quantum Inf."},{"key":"mlstacd048bib26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41534-019-0241-0","volume":"6","author":"Dalgaard","year":"2020","journal-title":"npj Quantum Inf."},{"key":"mlstacd048bib27","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevA.97.052333","volume":"97","author":"Zhang","year":"2018","journal-title":"Phys. Rev. A"},{"key":"mlstacd048bib28","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevA.99.042327","volume":"99","author":"Wu","year":"2019","journal-title":"Phys. Rev. A"},{"key":"mlstacd048bib29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11128-019-2240-7","volume":"18","author":"Ostaszewski","year":"2019","journal-title":"Quantum Inf. Process."},{"key":"mlstacd048bib30","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.127.190403","volume":"127","author":"Borah","year":"2021","journal-title":"Phys. Rev. Lett."},{"key":"mlstacd048bib31","doi-asserted-by":"publisher","first-page":"920","DOI":"10.1109\/TNNLS.2013.2283574","volume":"25","author":"Chen","year":"2014","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"mlstacd048bib32","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1016\/j.neucom.2021.02.102","volume":"470","author":"Mart\u00edn-Guerrero","year":"2022","journal-title":"Neurocomputing"},{"key":"mlstacd048bib33","doi-asserted-by":"publisher","first-page":"8589","DOI":"10.3390\/app11188589","volume":"11","author":"Mart\u00edn-Guerrero","year":"2021","journal-title":"Appl. Sci."},{"key":"mlstacd048bib34","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1811501115","volume":"115","author":"Henson","year":"2018","journal-title":"Proc. Natl Acad. Sci."},{"key":"mlstacd048bib35","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41534-019-0201-8","volume":"5","author":"Zhang","year":"2019","journal-title":"npj Quantum Inf."},{"key":"mlstacd048bib36","doi-asserted-by":"publisher","first-page":"01LT02","DOI":"10.1088\/2632-2153\/abc81f","volume":"2","author":"Haug","year":"2020","journal-title":"Mach. Learn.: Sci. Technol."},{"key":"mlstacd048bib37","doi-asserted-by":"publisher","DOI":"10.1209\/0295-5075\/126\/60002","volume":"126","author":"An","year":"2019","journal-title":"Europhys. Lett."},{"key":"mlstacd048bib38","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevA.100.042314","volume":"100","author":"S\u00f8rdal","year":"2019","journal-title":"Phys. Rev. A"},{"key":"mlstacd048bib39","doi-asserted-by":"publisher","first-page":"1351","DOI":"10.1103\/PhysRevLett.60.1351","volume":"60","author":"Aharonov","year":"1998","journal-title":"Phys. Rev. Lett."},{"key":"mlstacd048bib40","doi-asserted-by":"publisher","DOI":"10.1088\/2058-9565\/aaa39f","volume":"3","author":"Gross","year":"2018","journal-title":"Quantum Sci. Technol."},{"key":"mlstacd048bib41","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1080\/00107510601101934","volume":"47","author":"Jacobs","year":"2006","journal-title":"Contemp. Phys."},{"key":"mlstacd048bib42","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.124.140504","volume":"124","author":"Ding","year":"2020","journal-title":"Phys. Rev. Lett."},{"key":"mlstacd048bib43","author":"Schulman","year":"2017"},{"key":"mlstacd048bib44","article-title":"Tensorforce: a tensorflow library for applied reinforcement learning","author":"Kuhnle","year":"2017"}],"container-title":["Machine Learning: Science and Technology"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/acd048","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/acd048\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/acd048","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/acd048\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/acd048\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/acd048\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/acd048\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/acd048\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,5]],"date-time":"2023-05-05T09:37:34Z","timestamp":1683279454000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/acd048"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,5]]},"references-count":44,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,5,5]]},"published-print":{"date-parts":[[2023,6,1]]}},"URL":"https:\/\/doi.org\/10.1088\/2632-2153\/acd048","relation":{},"ISSN":["2632-2153"],"issn-type":[{"value":"2632-2153","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,5]]},"assertion":[{"value":"Closed-loop control of a noisy qubit with reinforcement learning","name":"article_title","label":"Article Title"},{"value":"Machine Learning: Science and Technology","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2023 The Author(s). Published by IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2023-01-02","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2023-04-25","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2023-05-05","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}