{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T16:35:25Z","timestamp":1773246925082,"version":"3.50.1"},"reference-count":57,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,4,11]],"date-time":"2023-04-11T00:00:00Z","timestamp":1681171200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,4,11]],"date-time":"2023-04-11T00:00:00Z","timestamp":1681171200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Quantum Mach. Intell."],"published-print":{"date-parts":[[2023,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Variational quantum circuits are being used as versatile quantum machine learning models. Some empirical results exhibit an advantage in supervised and generative learning tasks. However, when applied to reinforcement learning, less is known. In this work, we considered a variational quantum circuit composed of a low-depth hardware-efficient ansatz as the parameterized policy of a reinforcement learning agent. We show that an <jats:italic>\ud835\udf16<\/jats:italic>-approximation of the policy gradient can be obtained using a logarithmic number of samples concerning the total number of parameters. We empirically verify that such quantum models behave similarly to typical classical neural networks used in standard benchmarking environments and quantum control, using only a fraction of the parameters. Moreover, we study the barren plateau phenomenon in quantum policy gradients using the Fisher information matrix spectrum.<\/jats:p>","DOI":"10.1007\/s42484-023-00101-8","type":"journal-article","created":{"date-parts":[[2023,4,11]],"date-time":"2023-04-11T19:02:21Z","timestamp":1681239741000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Policy gradients using variational quantum circuits"],"prefix":"10.1007","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6659-9277","authenticated-orcid":false,"given":"Andr\u00e9","family":"Sequeira","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4466-1129","authenticated-orcid":false,"given":"Luis Paulo","family":"Santos","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5037-2588","authenticated-orcid":false,"given":"Luis Soares","family":"Barbosa","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,4,11]]},"reference":[{"issue":"6","key":"101_CR1","doi-asserted-by":"publisher","first-page":"403","DOI":"10.1038\/s43588-021-00084-1","volume":"1","author":"A Abbas","year":"2021","unstructured":"Abbas A, Sutter D, Zoufal C, Lucchi A, Figalli A, Woerner S (2021) The power of quantum neural networks. Nat. Comput. Sci 1(6):403\u2013409. https:\/\/doi.org\/10.1038\/s43588-021-00084-1","journal-title":"Nat. Comput. Sci"},{"key":"101_CR2","doi-asserted-by":"crossref","unstructured":"Afsar MM, Crump T, Far B (2021) Reinforcement learning based recommender systems: a survey","DOI":"10.1145\/3543846"},{"key":"101_CR3","unstructured":"Agarwal A, Jiang N, Kakade S (2019) Reinforcement learning: theory and algorithms"},{"key":"101_CR4","doi-asserted-by":"crossref","unstructured":"A\u00efmeur E., Brassard G, Gambs S (2006) Machine learning in a quantum world. In: Lamontagne L, Marchand M (eds) Advances in artificial intelligence. Springer, Berlin, pp 431\u2013442","DOI":"10.1007\/11766247_37"},{"key":"101_CR5","unstructured":"Bergholm V, Izaac J, Schuld M, Gogolin C, Alam MS, Ahmed S, Arrazola JM, Blank C, Delgado A, Jahangiri S, McKiernan K, Meyer JJ, Niu Z, Sz\u00e1va A, Killoran N (2020) Pennylane: automatic differentiation of hybrid quantum-classical computations"},{"key":"101_CR6","doi-asserted-by":"crossref","unstructured":"Bharti K, Cervera-Lierta A, Kyaw TH, Haug T, Alperin-Lea S, Anand A, Degroote M, Heimonen H, Kottmann JS, Menke T, Mok W-K, Sim S, Kwek L-C (2021) Aspuru-guzik A.: noisy intermediate-scale quantum (NISQ) algorithms","DOI":"10.1103\/RevModPhys.94.015004"},{"key":"101_CR7","doi-asserted-by":"publisher","first-page":"015004","DOI":"10.1103\/RevModPhys.94.015004","volume":"94","author":"K Bharti","year":"2022","unstructured":"Bharti K, Cervera-Lierta A, Kyaw TH, Haug T, Alperin-Lea S, Anand A, Degroote M, Heimonen H, Kottmann JS, Menke T, Mok W-K, Sim S, Kwek L-C, Aspuru-Guzik A (2022) Noisy intermediate-scale quantum algorithms. Rev Mod Phys 94:015004. https:\/\/doi.org\/10.1103\/RevModPhys.94.015004","journal-title":"Rev Mod Phys"},{"key":"101_CR8","unstructured":"Brockman G, Cheung V, Pettersson L, Schneider J, Schulman J, Tang J, Zaremba W (2016) Open AI Gym"},{"issue":"9","key":"101_CR9","doi-asserted-by":"publisher","first-page":"625","DOI":"10.1038\/s42254-021-00348-9","volume":"3","author":"M Cerezo","year":"2021","unstructured":"Cerezo M, Arrasmith A, Babbush R, Benjamin SC, Endo S, Fujii K, McClean JR, Mitarai K, Yuan X, Cincio L, Coles PJ (2021) Variational quantum algorithms. Nature Reviews Physics 3(9):625\u2013644. https:\/\/doi.org\/10.1038\/s42254-021-00348-9","journal-title":"Nature Reviews Physics"},{"key":"101_CR10","doi-asserted-by":"publisher","unstructured":"Chen SYC, Yang CHH, Qi J, Chen PY, Ma X, Goan HS (2020) Variational quantum circuits for deep reinforcement learning. IEEE Access. https:\/\/doi.org\/10.1109\/ACCESS.2020.3010470. arXiv:1907,00397","DOI":"10.1109\/ACCESS.2020.3010470"},{"key":"101_CR11","doi-asserted-by":"publisher","unstructured":"Dalgaard M, Motzoi F, S\u00f8rensen JJ, Sherson J (2020) Global optimization of quantum dynamics with alphazero deep exploration npj. Quantum Information 6(1). https:\/\/doi.org\/10.1038\/s41534-019-0241-0https:\/\/doi.org\/10.1038\/s41534-019-0241-0","DOI":"10.1038\/s41534-019-0241-0 10.1038\/s41534-019-0241-0"},{"issue":"7","key":"101_CR12","doi-asserted-by":"publisher","first-page":"074001","DOI":"10.1088\/1361-6633\/aab406","volume":"81","author":"V Dunjko","year":"2018","unstructured":"Dunjko V, Briegel HJ (2018) Machine learning & artificial intelligence in the quantum domain: a review of recent progress. Rep Prog Phys 81(7):074001. https:\/\/doi.org\/10.1088\/1361-6633\/aab406","journal-title":"Rep Prog Phys"},{"key":"101_CR13","doi-asserted-by":"crossref","unstructured":"Dunjko V, Liu Y-K, Wu X, Taylor JM (2017) Exponential improvements for quantum-accessible reinforcement learning. arXiv:1710.11160","DOI":"10.1109\/SMC.2017.8122616"},{"issue":"13","key":"101_CR14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1103\/PhysRevLett.117.130501","volume":"117","author":"V Dunjko","year":"2016","unstructured":"Dunjko V, Taylor JM, Briegel HJ (2016) Quantum-enhanced machine learning. Phys Rev Lett 117(13):1\u201319. https:\/\/doi.org\/10.1103\/PhysRevLett.117.130501. arXiv:1610.08251","journal-title":"Phys Rev Lett"},{"key":"101_CR15","unstructured":"Farhi E, Neven H (2018) Classification with quantum neural networks on near term processors"},{"key":"101_CR16","unstructured":"Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks. In: AISTATS"},{"key":"101_CR17","volume-title":"Deep learning","author":"I Goodfellow","year":"2016","unstructured":"Goodfellow I, Bengio Y, Courville A (2016) Deep learning. MIT Press, Cambridge"},{"key":"101_CR18","first-page":"1471","volume":"5","author":"E Greensmith","year":"2004","unstructured":"Greensmith E, Bartlett PL, Baxter J (2004) Variance reduction techniques for gradient estimates in reinforcement learning. J Mach Learn Res 5:1471\u20131530","journal-title":"J Mach Learn Res"},{"issue":"301","key":"101_CR19","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1080\/01621459.1963.10500830","volume":"58","author":"W Hoeffding","year":"1963","unstructured":"Hoeffding W (1963) Probability inequalities for sums of bounded random variables. J Am Stat Assoc 58(301):13\u201330. https:\/\/doi.org\/10.1080\/01621459.1963.10500830","journal-title":"J Am Stat Assoc"},{"key":"101_CR20","doi-asserted-by":"publisher","unstructured":"Huang H-Y, Broughton M, Mohseni M, Babbush R, Boixo S, Neven H, Mcclean J (2021) Power of data in quantum machine learning. Nat Commun 12. https:\/\/doi.org\/10.1038\/s41467-021-22539-9","DOI":"10.1038\/s41467-021-22539-9"},{"issue":"1","key":"101_CR21","doi-asserted-by":"publisher","first-page":"343","DOI":"10.1146\/annurev-control-061520-010444","volume":"4","author":"MR James","year":"2021","unstructured":"James MR (2021) Optimal quantum control theory. Annu Rev Control Robot Auton Syst 4 (1):343\u2013367. https:\/\/doi.org\/10.1146\/annurev-control-061520-010444","journal-title":"Annu Rev Control Robot Auton Syst"},{"key":"101_CR22","unstructured":"Jerbi S, Gyurik C, Marshall S, Briegel HJ, Dunjko V (2021) Variational quantum policies for reinforcement learning"},{"key":"101_CR23","unstructured":"Kakade S (2001) A natural policy gradient. In: Proceedings of the 14th international conference on neural information processing systems: natural and synthetic. NIPS\u201901. MIT Press, pp 1531\u20131538"},{"key":"101_CR24","doi-asserted-by":"crossref","unstructured":"Karakida R, Akaho S, Amari S-I (2019) Universal statistics of fisher information in deep neural networks: mean field approach","DOI":"10.1088\/1742-5468\/abc62e"},{"key":"101_CR25","unstructured":"Kingma DP, Ba J. (2017) Adam: a method for stochastic optimization"},{"key":"101_CR26","doi-asserted-by":"crossref","unstructured":"Kiran BR, Sobh I, Talpaert V, Mannion P, Sallab AAA, Yogamani S, P\u00e9rez P (2021) Deep reinforcement learning for autonomous driving: A survey","DOI":"10.1109\/TITS.2021.3054625"},{"key":"101_CR27","doi-asserted-by":"crossref","unstructured":"LaRose R, Coyle B (2020) Robust data encodings for quantum classifiers. ArXiv: 2003.01695","DOI":"10.1103\/PhysRevA.102.032420"},{"key":"101_CR28","doi-asserted-by":"crossref","unstructured":"Liu X-Y, Yang H, Chen Q, Zhang R, Yang L, Xiao B, Wang CD (2020) FinRL: a deep reinforcement learning library for automated stock trading in quantitative finance","DOI":"10.2139\/ssrn.3737859"},{"key":"101_CR29","doi-asserted-by":"crossref","unstructured":"Lockwood O, Si M (2020) Reinforcement learning with quantum variational circuits. In: Proceedings of the 16th AAAI conference on artificial intelligence and interactive digital entertainment, AIIDE 2020","DOI":"10.1609\/aiide.v16i1.7437"},{"key":"101_CR30","unstructured":"Lockwood O, Si M (2021) Playing atari with hybrid quantum-classical reinforcement learning"},{"key":"101_CR31","doi-asserted-by":"crossref","unstructured":"Ly A, Marsman M, Verhagen J, Grasman R, Wagenmakers E-J (2017) A tutorial on fisher information","DOI":"10.1016\/j.jmp.2017.05.006"},{"key":"101_CR32","doi-asserted-by":"publisher","first-page":"8589","DOI":"10.3390\/app11188589","volume":"11","author":"J Mart\u00edn-Guerrero","year":"2021","unstructured":"Mart\u00edn-Guerrero J, Lamata L (2021) Reinforcement learning and physics. Appl Sci 11:8589. https:\/\/doi.org\/10.3390\/app11188589","journal-title":"Appl Sci"},{"key":"101_CR33","doi-asserted-by":"publisher","first-page":"539","DOI":"10.22331\/q-2021-09-09-539","volume":"5","author":"JJ Meyer","year":"2021","unstructured":"Meyer JJ (2021) Fisher information in noisy intermediate-scale quantum applications. Quantum 5:539. https:\/\/doi.org\/10.22331\/q-2021-09-09-539","journal-title":"Quantum"},{"key":"101_CR34","doi-asserted-by":"publisher","unstructured":"Mosavi A, Ghamisi P, Faghan Y, Duan P, Shamshirband S (2020) Comprehensive review of deep reinforcement learning methods and applications in economics. https:\/\/doi.org\/10.20944\/preprints202003.0309.v1","DOI":"10.20944\/preprints202003.0309.v1"},{"key":"101_CR35","volume-title":"Quantum computation and quantum information: 10th anniversary edition","author":"MA Nielsen","year":"2011","unstructured":"Nielsen MA, Chuang IL (2011) Quantum computation and quantum information: 10th anniversary edition, 10th edn. Cambridge University Press, Cambridge","edition":"10th edn."},{"issue":"3","key":"101_CR36","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1103\/PhysRevX.4.031002","volume":"4","author":"GD Paparo","year":"2014","unstructured":"Paparo GD, Dunjko V, Makmal A, Martin-Delgado MA, Briegel HJ (2014) Quantum speedup for active learning agents. Phys Rev X 4(3):1\u201314. https:\/\/doi.org\/10.1103\/PhysRevX.4.031002. ArXiv:2209.14910","journal-title":"Phys Rev X"},{"key":"101_CR37","unstructured":"Paszke A, Gross S, Chintala S, Chanan G, Yang E, DeVito Z, Lin Z, Desmaison A, Antiga L, Lerer A (2017) Automatic differentiation in pytorch"},{"key":"101_CR38","doi-asserted-by":"crossref","unstructured":"Preskill J (1997) Fault-tolerant quantum computation. arXiv: Quantum Physics","DOI":"10.1142\/9789812385253_0008"},{"key":"101_CR39","doi-asserted-by":"publisher","first-page":"79","DOI":"10.22331\/q-2018-08-06-79","volume":"2","author":"J Preskill","year":"2018","unstructured":"Preskill J (2018) Quantum computing in the nisq era and beyond. Quantum 2:79. https:\/\/doi.org\/10.22331\/q-2018-08-06-79","journal-title":"Quantum"},{"issue":"7849","key":"101_CR40","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1038\/s41586-021-03242-7","volume":"591","author":"V Saggio","year":"2021","unstructured":"Saggio V, Asenbeck BE, Hamann A, Str\u00f6mberg T, Schiansky P, Dunjko V, Friis N, Harris NC, Hochberg M, Englund D et al (2021) Experimental quantum speed-up in reinforcement learning agents. Nature 591(7849):229\u2013233. https:\/\/doi.org\/10.1038\/s41586-021-03242-7","journal-title":"Nature"},{"key":"101_CR41","doi-asserted-by":"crossref","unstructured":"Sanches F, Weinberg S, Ide T, Kamiya K (2021) Short quantum circuits in reinforcement learning policies for the vehicle routing problem","DOI":"10.1103\/PhysRevA.105.062403"},{"issue":"7839","key":"101_CR42","doi-asserted-by":"publisher","first-page":"604","DOI":"10.1038\/s41586-020-03051-4","volume":"588","author":"J Schrittwieser","year":"2020","unstructured":"Schrittwieser J, Antonoglou I, Hubert T, Simonyan K, Sifre L, Schmitt S, Guez A, Lockhart E, Hassabis D, Graepel T et al (2020) Mastering atari, go, chess and shogi by planning with a learned model. Nature 588(7839):604\u2013609. https:\/\/doi.org\/10.1038\/s41586-020-03051-4","journal-title":"Nature"},{"key":"101_CR43","doi-asserted-by":"crossref","unstructured":"Schuld M (2021) Quantum machine learning models are kernel methods","DOI":"10.1007\/978-3-030-83098-4_6"},{"key":"101_CR44","doi-asserted-by":"publisher","first-page":"032331","DOI":"10.1103\/PhysRevA.99.032331","volume":"99","author":"M Schuld","year":"2019","unstructured":"Schuld M, Bergholm V, Gogolin C, Izaac JA, Killoran N (2019) Evaluating analytic gradients on quantum hardware. Phys Rev A 99:032331","journal-title":"Phys Rev A"},{"key":"101_CR45","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-96424-9","volume-title":"Supervised learning with quantum computers","author":"M Schuld","year":"2018","unstructured":"Schuld M, Petruccione F (2018) Supervised learning with quantum computers, 1st edn. Springer, Berlin","edition":"1st edn."},{"key":"101_CR46","doi-asserted-by":"publisher","unstructured":"Schuld M, Sweke R, Meyer JJ (2021) Effect of data encoding on the expressive power of variational quantum-machine-learning models. Phys Rev A 103(3). https:\/\/doi.org\/10.1103\/physreva.103.032430","DOI":"10.1103\/physreva.103.032430"},{"key":"101_CR47","doi-asserted-by":"publisher","first-page":"125416","DOI":"10.1109\/ACCESS.2021.3110652","volume":"9","author":"A Sequeira","year":"2021","unstructured":"Sequeira A, Santos LP, Barbosa LS (2021) Quantum tree-based planning. IEEE Access 9:125416\u2013125427. https:\/\/doi.org\/10.1109\/ACCESS.2021.3110652","journal-title":"IEEE Access"},{"key":"101_CR48","doi-asserted-by":"publisher","first-page":"484","DOI":"10.1038\/nature16961","volume":"529","author":"D Silver","year":"2016","unstructured":"Silver D, Huang A, Maddison CJ, Guez A, Sifre L, van den Driessche G, Schrittwieser J, Antonoglou I, Panneershelvam V, Lanctot M, Dieleman S, Grewe D, Nham J, Kalchbrenner N, Sutskever I, Lillicrap TP, Leach M, Kavukcuoglu K, Graepel T, Hassabis D (2016) Mastering the game of go with deep neural networks and tree search. Nature 529:484\u2013489","journal-title":"Nature"},{"issue":"12","key":"101_CR49","doi-asserted-by":"publisher","first-page":"1900070","DOI":"10.1002\/qute.201900070","volume":"2","author":"S Sim","year":"2019","unstructured":"Sim S, Johnson PD, Aspuru-Guzik A (2019) Expressibility and entangling capability of parameterized quantum circuits for hybrid quantum-classical algorithms. Adv Quantum Technol 2(12):1900070. https:\/\/doi.org\/10.1002\/qute.201900070","journal-title":"Adv Quantum Technol"},{"key":"101_CR50","doi-asserted-by":"publisher","first-page":"269","DOI":"10.22331\/q-2020-05-25-269","volume":"4","author":"J Stokes","year":"2020","unstructured":"Stokes J, Izaac J, Killoran N, Carleo G (2020) Quantum natural gradient. Quantum 4:269. https:\/\/doi.org\/10.22331\/q-2020-05-25-269","journal-title":"Quantum"},{"key":"101_CR51","volume-title":"Reinforcement learning: an introduction","author":"RS Sutton","year":"2018","unstructured":"Sutton RS, Barto AG (2018) Reinforcement learning: an introduction. A bradford book, Cambridge"},{"key":"101_CR52","unstructured":"Sutton R, McAllester DA, Singh S, Mansour Y (1999) Policy gradient methods for reinforcement learning with function approximation. In: NIPS"},{"key":"101_CR53","doi-asserted-by":"publisher","first-page":"314","DOI":"10.22331\/q-2020-08-31-314","volume":"4","author":"R Sweke","year":"2020","unstructured":"Sweke R, Wilde F, Meyer J, Schuld M, Faehrmann PK, Meynard-Piganeau B, Eisert J (2020) Stochastic gradient descent for hybrid quantum-classical optimization. Quantum 4:314. https:\/\/doi.org\/10.22331\/q-2020-08-31-314","journal-title":"Quantum"},{"key":"101_CR54","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1007\/BF00992696","volume":"8","author":"RJ Williams","year":"2004","unstructured":"Williams RJ (2004) Simple statistical gradient-following algorithms for connectionist reinforcement learning. Mach Learn 8:229\u2013256","journal-title":"Mach Learn"},{"key":"101_CR55","unstructured":"Wu S, Jin S, Wen D, Wang X (2021) Quantum reinforcement learning in continuous action space"},{"key":"101_CR56","doi-asserted-by":"publisher","unstructured":"Zhang K, Hsieh M-H, Liu L, Tao D (2022) Gaussian initializations help deep variational quantum circuits escape from the barren plateau arXiv. https:\/\/doi.org\/10.48550\/ARXIV.2203.09376","DOI":"10.48550\/ARXIV.2203.09376"},{"key":"101_CR57","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41534-019-0201-8","volume":"5","author":"X-M Zhang","year":"2019","unstructured":"Zhang X-M, Wei Z, Asad R, Yang X-C, Wang X (2019) When does reinforcement learning stand out in quantum control? a comparative study on state preparation. npj Quantum Information 5:1\u20137. https:\/\/doi.org\/10.1038\/s41534-019-0201-8","journal-title":"npj Quantum Information"}],"container-title":["Quantum Machine Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s42484-023-00101-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s42484-023-00101-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s42484-023-00101-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,19]],"date-time":"2023-06-19T07:32:01Z","timestamp":1687159921000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s42484-023-00101-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,11]]},"references-count":57,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,6]]}},"alternative-id":["101"],"URL":"https:\/\/doi.org\/10.1007\/s42484-023-00101-8","relation":{},"ISSN":["2524-4906","2524-4914"],"issn-type":[{"value":"2524-4906","type":"print"},{"value":"2524-4914","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,11]]},"assertion":[{"value":"17 March 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 January 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 April 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"<!--Emphasis Type='Bold' removed-->Conflict of interest"}}],"article-number":"18"}}