{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T06:25:19Z","timestamp":1771482319688,"version":"3.50.1"},"reference-count":64,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2024,2,29]],"date-time":"2024-02-29T00:00:00Z","timestamp":1709164800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,2,29]],"date-time":"2024-02-29T00:00:00Z","timestamp":1709164800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Research Foundation for Advanced Talents of Henan University of Technology","award":["31401529"],"award-info":[{"award-number":["31401529"]}]},{"name":"Key Scientific Research Projects of Higher Education Institutions in Henan Province","award":["24A520014"],"award-info":[{"award-number":["24A520014"]}]},{"name":"Open Fund of Key Laboratory of Grain Information Processing and Control (Henan University of Technology), Ministry of Education","award":["KFJJ2023015"],"award-info":[{"award-number":["KFJJ2023015"]}]},{"name":"College Students\u2019 Innovative Entrepreneurial Training Plan Program","award":["PX-38233887"],"award-info":[{"award-number":["PX-38233887"]}]},{"name":"College Students\u2019 Innovative Entrepreneurial Training Plan Program","award":["PX-38233886"],"award-info":[{"award-number":["PX-38233886"]}]},{"name":"College Students\u2019 Innovative Entrepreneurial Training Plan Program","award":["PX-38233884"],"award-info":[{"award-number":["PX-38233884"]}]},{"DOI":"10.13039\/501100001809","name":"National Nature Science Foundation of China","doi-asserted-by":"crossref","award":["62006071"],"award-info":[{"award-number":["62006071"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Complex Intell. Syst."],"published-print":{"date-parts":[[2024,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Most existing relation extraction methods only determine the relation type after identifying all entities, thus not fully modeling the interaction between relation-type recognition and entity mention detection. This article introduces a novel paradigm for relation extraction by treating relevant entities as parameters of relations and harnessing the strong expressive capabilities and acceleration advantages of quantum computing to address the relation extraction task. In this article, we develop a quantum hierarchical reinforcement learning approach to enhance the interaction between relation-type recognition and entity mention detection. The entire relation extraction process is broken down into a hierarchical structure of two layers of quantum reinforcement learning strategies dedicated to relation detection and entity extraction, demonstrating greater feasibility and expressiveness, especially when dealing with superimposed relations. Our proposed method outperforms existing approaches through experimental evaluations on commonly used public datasets, mainly showcasing its significant advantages in extracting superimposed relationships.<\/jats:p>","DOI":"10.1007\/s40747-024-01381-8","type":"journal-article","created":{"date-parts":[[2024,2,29]],"date-time":"2024-02-29T10:02:33Z","timestamp":1709200953000},"page":"4009-4018","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Efficient relation extraction via quantum reinforcement learning"],"prefix":"10.1007","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7148-7923","authenticated-orcid":false,"given":"Xianchao","family":"Zhu","sequence":"first","affiliation":[]},{"given":"Yashuang","family":"Mu","sequence":"additional","affiliation":[]},{"given":"Xuetao","family":"Wang","sequence":"additional","affiliation":[]},{"given":"William","family":"Zhu","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,2,29]]},"reference":[{"key":"1381_CR1","doi-asserted-by":"crossref","unstructured":"Mintz M, Bills S, Snow R, Jurafsky D (2009) Distant supervision for relation extraction without labeled data. In: ACL 2009, Proceedings of the 47th Annual Meeting of the Association for Computational Linguistics and the 4th International Joint Conference on Natural Language Processing of the AFNLP, 2-7 August, Singapore, The Association for Computer Linguistics, pp. 1003\u20131011","DOI":"10.3115\/1690219.1690287"},{"key":"1381_CR2","doi-asserted-by":"crossref","unstructured":"Nadeau D, Sekine S (2007) A survey of named entity recognition and classification. Lingvisticae Investigationes 30(1):3\u201326","DOI":"10.1075\/li.30.1.03nad"},{"key":"1381_CR3","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1016\/j.neunet.2023.11.029","volume":"170","author":"J de Jes\u00fas Rubio","year":"2024","unstructured":"de Jes\u00fas Rubio J, Hernandez MA, Rosas FJ, Orozco E, Balcazar R, Pacheco J (2024) Genetic high-gain controller to improve the position perturbation attenuation and compact high-gain controller to improve the velocity perturbation attenuation in inverted pendulums. Neural Netw 170:32\u201345","journal-title":"Neural Netw"},{"key":"1381_CR4","doi-asserted-by":"publisher","first-page":"103255","DOI":"10.1109\/ACCESS.2019.2929266","volume":"7","author":"H-S Chiang","year":"2019","unstructured":"Chiang H-S, Chen M-Y, Huang Y-J (2019) Wavelet-based eeg processing for epilepsy detection using fuzzy entropy and associative petri net. IEEE Access 7:103255\u2013103262","journal-title":"IEEE Access"},{"key":"1381_CR5","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2019.105929","volume":"86","author":"A L\u00f3pez-Gonz\u00e1lez","year":"2020","unstructured":"L\u00f3pez-Gonz\u00e1lez A, Campa\u00f1a JM, Mart\u00ednez EH, Contro PP (2020) Multi robot distance based formation using parallel genetic algorithm. Appl Soft Comput 86:105929","journal-title":"Appl Soft Comput"},{"key":"1381_CR6","doi-asserted-by":"crossref","unstructured":"Fader A, Zettlemoyer L, Etzioni O (2014) Open question answering over curated and extracted knowledge bases. In: The 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD \u201914, New York, NY, USA - August 24 - 27, ACM, pp. 1156\u20131165","DOI":"10.1145\/2623330.2623677"},{"issue":"15","key":"1381_CR7","doi-asserted-by":"publisher","first-page":"6904","DOI":"10.1016\/j.eswa.2014.04.004","volume":"41","author":"G Glava\u0161","year":"2014","unstructured":"Glava\u0161 G, \u0160najder J (2014) Event graphs for information retrieval and multi-document summarization. Expert Syst Appl 41(15):6904\u20136916","journal-title":"Expert Syst Appl"},{"key":"1381_CR8","doi-asserted-by":"publisher","first-page":"437","DOI":"10.1016\/j.neunet.2023.02.010","volume":"161","author":"J de Jes\u00fas Rubio","year":"2023","unstructured":"de Jes\u00fas Rubio J (2023) Bat algorithm based control to decrease the control energy consumption and modified bat algorithm based control to increase the trajectory tracking accuracy in robots. Neural Netw 161:437\u2013448","journal-title":"Neural Netw"},{"key":"1381_CR9","doi-asserted-by":"publisher","DOI":"10.1016\/j.energy.2023.128470","volume":"284","author":"J de Jes\u00fas Rubio","year":"2023","unstructured":"de Jes\u00fas Rubio J, Garcia D, Sossa H, Garcia I, Zacarias A, Mujica-Vargas D (2023) Energy processes prediction by a convolutional radial basis function network. Energy 284:128470","journal-title":"Energy"},{"key":"1381_CR10","doi-asserted-by":"crossref","unstructured":"Luan Y, He L, Ostendorf M, Hajishirzi H (2018) Multi-task identification of entities, relations, and coreference for scientific knowledge graph construction. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31 - November 4, The Association for Computational Linguistics, pp. 3219\u20133232","DOI":"10.18653\/v1\/D18-1360"},{"issue":"2","key":"1381_CR11","doi-asserted-by":"publisher","first-page":"140","DOI":"10.22201\/icat.24486736e.2021.19.2.1581","volume":"19","author":"D M\u00fajica-Vargas","year":"2021","unstructured":"M\u00fajica-Vargas D (2021) Superpixels extraction by an intuitionistic fuzzy clustering algorithm. J Appl Res Technol 19(2):140\u2013152","journal-title":"J Appl Res Technol"},{"issue":"1","key":"1381_CR12","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1093\/bib\/bbv024","volume":"17","author":"C-C Huang","year":"2016","unstructured":"Huang C-C, Lu Z (2016) Community challenges in biomedical text mining over 10 years: success, failure and the future. Brief. Bioinformatics 17(1):132\u2013144","journal-title":"Brief. Bioinformatics"},{"key":"1381_CR13","doi-asserted-by":"crossref","unstructured":"Fei H, Ren Y, Zhang Y, Ji D, Liang X (2021) Enriching contextualized language model from knowledge graph for biomedical information extraction. Briefings in Bioinformatics 22(3)","DOI":"10.1093\/bib\/bbaa110"},{"issue":"13","key":"1381_CR14","doi-asserted-by":"publisher","first-page":"1891","DOI":"10.1093\/bioinformatics\/btab024","volume":"37","author":"W Zhao","year":"2021","unstructured":"Zhao W, Zhao Y, Jiang X, He T, Liu F, Li N (2021) Efficient multiple biomedical events extraction via reinforcement learning. Bioinformatics 37(13):1891\u20131899","journal-title":"Bioinformatics"},{"issue":"1","key":"1381_CR15","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1075\/li.30.1.03nad","volume":"30","author":"D Nadeau","year":"2007","unstructured":"Nadeau D, Sekine S (2007) A survey of named entity recognition and classification. Lingvisticae Investigationes 30(1):3\u201326","journal-title":"Lingvisticae Investigationes"},{"issue":"1","key":"1381_CR16","doi-asserted-by":"publisher","first-page":"198:1","DOI":"10.1186\/s12859-017-1609-9","volume":"18","author":"F Li","year":"2017","unstructured":"Li F, Zhang M, Fu G, Ji D (2017) A neural joint model for entity and relation extraction from biomedical text. BMC Bioinformatics 18(1):198:1-198:11","journal-title":"BMC Bioinformatics"},{"key":"1381_CR17","doi-asserted-by":"crossref","unstructured":"Wang S, Zhang Y, Che W, Liu T (2018) Joint extraction of entities and relations based on a novel graph scheme. In: Lang J (Ed.), Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, IJCAI 2018, July 13-19, Stockholm, Sweden, Morgan Kaufmann, pp. 4461\u20134467","DOI":"10.24963\/ijcai.2018\/620"},{"key":"1381_CR18","doi-asserted-by":"crossref","unstructured":"Miwa M, Sasaki Y (2014) Modeling joint entity and relation extraction with table representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014, October 25-29, Doha, Qatar, A meeting of SIGDAT, a Special Interest Group of the ACL, The Association for Computational Linguistics, pp. 1858\u20131869","DOI":"10.3115\/v1\/D14-1200"},{"key":"1381_CR19","doi-asserted-by":"crossref","unstructured":"Miwa M, Bansal M (2016) End-to-end relation extraction using lstms on sequences and tree structures. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016, August 7-12, Berlin, Germany, Volume 1: Long Papers, The Association for Computer Linguistics","DOI":"10.18653\/v1\/P16-1105"},{"key":"1381_CR20","doi-asserted-by":"crossref","unstructured":"Zheng S, Wang F, Bao H, Hao Y, Zhou P, Xu B (2017) Joint extraction of entities and relations based on a novel tagging scheme. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, ACL 2017, Vancouver, Canada, July 30 - August 4, Volume 1: Long Papers, The Association for Computational Linguistics, pp. 1227\u20131236","DOI":"10.18653\/v1\/P17-1113"},{"key":"1381_CR21","doi-asserted-by":"crossref","unstructured":"Katiyar A, Cardie C (2017) Going out on a limb: Joint extraction of entity mentions and relations without dependency trees. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, ACL 2017, Vancouver, Canada, July 30 - August 4, Volume 1: Long Papers, Association for Computational Linguistics, pp. 917\u2013928","DOI":"10.18653\/v1\/P17-1085"},{"key":"1381_CR22","doi-asserted-by":"crossref","unstructured":"Huang P, Zhao X, Takanobu R, Tan Z, Xiao W (2020) Joint event extraction with hierarchical policy network. In: Proceedings of the 28th international conference on computational linguistics, pp. 2653\u20132664","DOI":"10.18653\/v1\/2020.coling-main.239"},{"key":"1381_CR23","doi-asserted-by":"crossref","unstructured":"Takanobu R, Zhang T, Liu J, Huang M (2019) A hierarchical framework for relation extraction with reinforcement learning. In: The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI 2019, The Thirty-First Innovative Applications of Artificial Intelligence Conference, IAAI 2019, The Ninth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2019, Honolulu, Hawaii, USA, January 27 - February 1, AAAI Press, pp. 7072\u20137079","DOI":"10.1609\/aaai.v33i01.33017072"},{"key":"1381_CR24","doi-asserted-by":"crossref","unstructured":"Yang C-HH, Qi J, Chen SY-C, Chen P-Y, Siniscalchi SM, Ma X, Lee C-H (2021) Decentralizing feature extraction with quantum convolutional neural network for automatic speech recognition. In: ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), IEEE, pp. 6523\u20136527","DOI":"10.1109\/ICASSP39728.2021.9413453"},{"key":"1381_CR25","doi-asserted-by":"crossref","unstructured":"Di Sipio R, Huang J-H, Chen SY-C, Mangini S, Worring M (2022) The dawn of quantum natural language processing. In: ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), IEEE, pp. 8612\u20138616","DOI":"10.1109\/ICASSP43922.2022.9747675"},{"issue":"7","key":"1381_CR26","doi-asserted-by":"publisher","first-page":"780","DOI":"10.1038\/s42256-023-00687-5","volume":"5","author":"F Metz","year":"2023","unstructured":"Metz F, Bukov M (2023) Self-correcting quantum many-body control using reinforcement learning with tensor networks. Nat Mach Intell 5(7):780\u2013791","journal-title":"Nat Mach Intell"},{"key":"1381_CR27","doi-asserted-by":"crossref","unstructured":"Ma H, Dong D, Ding SX, Chen C (2022) Curriculum-based deep reinforcement learning for quantum control. IEEE Transactions on Neural Networks and Learning Systems","DOI":"10.1109\/TNNLS.2022.3153502"},{"key":"1381_CR28","doi-asserted-by":"crossref","unstructured":"Chen SY-C, Yoo S, Fang Y-LL (2022) Quantum long short-term memory. In: ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), IEEE, pp. 8622\u20138626","DOI":"10.1109\/ICASSP43922.2022.9747369"},{"key":"1381_CR29","doi-asserted-by":"crossref","unstructured":"Gormley MR, Yu M, Dredze M (2015) Improved relation extraction with feature-rich compositional embedding models. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, EMNLP 2015, Lisbon, Portugal, September 17-21, The Association for Computational Linguistics, pp. 1774\u20131784","DOI":"10.18653\/v1\/D15-1205"},{"key":"1381_CR30","doi-asserted-by":"crossref","unstructured":"Tang J, Qu M, Wang M, Zhang M, Yan J, Mei Q (2015) Line: Large-scale information network embedding. In: Proceedings of the 24th International Conference on World Wide Web, WWW 2015, Florence, Italy, May 18-22, ACM, pp. 1067\u20131077","DOI":"10.1145\/2736277.2741093"},{"key":"1381_CR31","doi-asserted-by":"crossref","unstructured":"Zhou P, Shi W, Tian J, Qi Z, Li B, Hao H, Xu B (2016) Attention-based bidirectional long short-term memory networks for relation classification. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016, August 7-12, Berlin, Germany, Volume 2: Short Papers, The Association for Computer Linguistics","DOI":"10.18653\/v1\/P16-2034"},{"key":"1381_CR32","doi-asserted-by":"crossref","unstructured":"Tuo M, Yang W (2023) Review of entity relation extraction. Journal of Intelligent & Fuzzy Systems\u00a0(Preprint) 1\u201315","DOI":"10.3233\/JIFS-223915"},{"key":"1381_CR33","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2022.110108","volume":"260","author":"Q Zhou","year":"2023","unstructured":"Zhou Q, Zhang Y, Ji D (2023) Distantly supervised relation extraction with kb-enhanced reconstructed latent iterative graph networks. Knowl Based Syst 260:110108","journal-title":"Knowl Based Syst"},{"key":"1381_CR34","volume":"11","author":"A Javeed","year":"2023","unstructured":"Javeed A (2023) A hybrid attention mechanism for multi-target entity relation extraction using graph neural networks. Mach Learn Appl 11:100444","journal-title":"Mach Learn Appl"},{"key":"1381_CR35","doi-asserted-by":"crossref","unstructured":"Li Q, Ji H (2014) Incremental joint extraction of entity mentions and relations. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, ACL 2014, June 22-27, Baltimore, MD, USA, Volume 1: Long Papers, The Association for Computer Linguistics, pp. 402\u2013412","DOI":"10.3115\/v1\/P14-1038"},{"issue":"4","key":"1381_CR36","doi-asserted-by":"publisher","first-page":"541","DOI":"10.1111\/j.1467-8640.2011.00399.x","volume":"27","author":"J Bj\u00f6rne","year":"2011","unstructured":"Bj\u00f6rne J, Heimonen J, Ginter F, Airola A, Pahikkala T, Salakoski T (2011) Extracting contextualized complex biological events with rich graph-based feature sets. Comput Intell 27(4):541\u2013557","journal-title":"Comput Intell"},{"key":"1381_CR37","doi-asserted-by":"crossref","unstructured":"Narasimhan K, Yala A, Barzilay R (2016) Improving information extraction by acquiring external evidence with reinforcement learning. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, EMNLP 2016, Austin, Texas, USA, November 1-4, The Association for Computational Linguistics, pp. 2355\u20132365","DOI":"10.18653\/v1\/D16-1261"},{"key":"1381_CR38","doi-asserted-by":"crossref","unstructured":"Katiyar A, Cardie C (2016) Investigating lstms for joint extraction of opinion entities and relations. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016, August 7-12, Berlin, Germany, Volume 1: Long Papers, The Association for Computational Linguistics, pp. 919\u2013929","DOI":"10.18653\/v1\/P16-1087"},{"key":"1381_CR39","doi-asserted-by":"crossref","unstructured":"Zhang M, Zhang Y, Fu G (2017)nd-to-end neural relation extraction with global optimization. In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, EMNLP 2017, Copenhagen, Denmark, September 9-11, The Association for Computational Linguistics, pp. 1730\u20131740","DOI":"10.18653\/v1\/D17-1182"},{"key":"1381_CR40","doi-asserted-by":"crossref","unstructured":"Qin P, Xu W, Wang WY (2018) Robust distant supervision relation extraction via deep reinforcement learning. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, ACL 2018, Melbourne, Australia, July 15-20, Volume 1: Long Papers, The Association for Computational Linguistics, pp. 2137\u20132147","DOI":"10.18653\/v1\/P18-1199"},{"issue":"1\u20137643065","key":"1381_CR41","first-page":"11","volume":"7643065","author":"Y Feng","year":"2017","unstructured":"Feng Y, Zhang H, Hao W, Chen G (2017) Joint extraction of entities and relations using reinforcement learning and deep learning. Comput Intell Neurosci 7643065(1\u20137643065):11","journal-title":"Comput Intell Neurosci"},{"key":"1381_CR42","doi-asserted-by":"crossref","unstructured":"Feng J, Huang M, Zhao L, Yang Y, Zhu X (2018) Reinforcement learning for relation classification from noisy data. In: Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2-7, Vol.\u00a032, AAAI Press","DOI":"10.1609\/aaai.v32i1.12063"},{"issue":"5","key":"1381_CR43","doi-asserted-by":"publisher","first-page":"1207","DOI":"10.1109\/TSMCB.2008.925743","volume":"38","author":"D Dong","year":"2008","unstructured":"Dong D, Chen C, Li H, Tarn T-J (2008) Quantum reinforcement learning. IEEE Trans Syst Man Cybern 38(5):1207\u20131220","journal-title":"IEEE Trans Syst Man Cybern"},{"key":"1381_CR44","doi-asserted-by":"publisher","first-page":"141007","DOI":"10.1109\/ACCESS.2020.3010470","volume":"8","author":"SY-C Chen","year":"2020","unstructured":"Chen SY-C, Yang C-HH, Qi J, Chen P-Y, Ma X, Goan H-S (2020) Variational quantum circuits for deep reinforcement learning. IEEE Access 8:141007\u2013141024","journal-title":"IEEE Access"},{"key":"1381_CR45","doi-asserted-by":"crossref","unstructured":"Lockwood O, Si M (2020) Reinforcement learning with quantum variational circuit. In: Proceedings of the AAAI conference on artificial intelligence and interactive digital entertainment, Vol.\u00a016, pp. 245\u2013251","DOI":"10.1609\/aiide.v16i1.7437"},{"key":"1381_CR46","doi-asserted-by":"publisher","first-page":"720","DOI":"10.22331\/q-2022-05-24-720","volume":"6","author":"A Skolik","year":"2022","unstructured":"Skolik A, Jerbi S, Dunjko V (2022) Quantum agents in the gym: a variational quantum algorithm for deep q-learning. Quantum 6:720","journal-title":"Quantum"},{"key":"1381_CR47","unstructured":"Schenk M, Combarro EF, Grossi M, Kain V, Li KSB, Popa M-M, Vallecorsa S (2022) Hybrid actor-critic algorithm for quantum reinforcement learning at cern beam lines, arXiv preprint arXiv:2209.11044"},{"key":"1381_CR48","unstructured":"Lan Q (2021) Variational quantum soft actor-critic, arXiv preprint arXiv:2112.11921"},{"key":"1381_CR49","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2023.122243","volume":"238","author":"Y Qiu","year":"2024","unstructured":"Qiu Y, Liu R, Lee RS (2024) The design and implementation of a deep reinforcement learning and quantum finance theory-inspired portfolio investment management system. Expert Syst Appl 238:122243","journal-title":"Expert Syst Appl"},{"key":"1381_CR50","unstructured":"Heimann D, Hohenfeld H, Wiebe F, Kirchner F (2022) Quantum deep reinforcement learning for robot navigation tasks, arXiv preprint arXiv:2202.12180"},{"key":"1381_CR51","first-page":"28362","volume":"34","author":"S Jerbi","year":"2021","unstructured":"Jerbi S, Gyurik C, Marshall S, Briegel H, Dunjko V (2021) Parametrized quantum policies for reinforcement learning. Adv Neural Inform Process Syst 34:28362\u201328375","journal-title":"Adv Neural Inform Process Syst"},{"key":"1381_CR52","unstructured":"Hsiao J-Y, Du Y, Chiang W-Y, Hsieh M-H, Goan H-S (2022) Unentangled quantum reinforcement learning agents in the openai gym, arXiv preprint arXiv:2203.14348"},{"key":"1381_CR53","unstructured":"Sutton RS, Barto AG (2018) Reinforcement learning: An introduction. MIT press"},{"key":"1381_CR54","unstructured":"Vezhnevets AS, Osindero S, Schaul T, Heess N, Jaderberg M, Silver D, Kavukcuoglu K (2017) Feudal networks for hierarchical reinforcement learning. In: Proceedings of the 34th International Conference on Machine Learning, ICML 2017, Sydney, NSW, Australia, 6-11 August, Vol.\u00a070, PMLR, pp. 3540\u20133549"},{"key":"1381_CR55","unstructured":"Mohri M, Rostamizadeh A, Talwalkar A (2018) Foundations of machine learning. MIT press"},{"issue":"1\u20132","key":"1381_CR56","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1016\/S0004-3702(99)00052-1","volume":"112","author":"RS Sutton","year":"1999","unstructured":"Sutton RS, Precup D, Singh S (1999) Between mdps and semi-mdps: A framework for temporal abstraction in reinforcement learning. Artif intell 112(1\u20132):181\u2013211","journal-title":"Artif intell"},{"key":"1381_CR57","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2021.107128","volume":"225","author":"R Li","year":"2021","unstructured":"Li R, Cai Z, Huang T, Zhu W (2021) Anchor: The achieved goal to replace the subgoal for hierarchical reinforcement learning. Knowl Based Syst 225:107128","journal-title":"Knowl Based Syst"},{"key":"1381_CR58","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2022.108151","volume":"241","author":"X Zhu","year":"2022","unstructured":"Zhu X, Zhang R, Zhu W (2022) Mdmd options discovery for accelerating exploration in sparse-reward domains. Knowl Based Syst 241:108151","journal-title":"Knowl Based Syst"},{"key":"1381_CR59","doi-asserted-by":"publisher","first-page":"474","DOI":"10.1016\/j.neunet.2023.12.032","volume":"171","author":"W Ou","year":"2024","unstructured":"Ou W, Luo B, Wang B, Zhao Y (2024) Modular hierarchical reinforcement learning for multi-destination navigation in hybrid crowds. Neural Netw 171:474\u2013484","journal-title":"Neural Netw"},{"key":"1381_CR60","doi-asserted-by":"crossref","unstructured":"Luo J, Xu C, Geng X, Feng G, Fang K, Tan L, Schaal S, Levine S (2024) Multi-stage cable routing through hierarchical imitation learning. IEEE Transactions on Robotics","DOI":"10.1109\/TRO.2024.3353075"},{"key":"1381_CR61","doi-asserted-by":"crossref","unstructured":"Riedel S, Yao L, McCallum A (2010) Modeling relations and their mentions without labeled text. In: Machine Learning and Knowledge Discovery in Databases, European Conference, ECML PKDD 2010, Barcelona, Spain, September 20-24, 2010, Proceedings, Part III, Vol. 6323, Springer, pp. 148\u2013163","DOI":"10.1007\/978-3-642-15939-8_10"},{"key":"1381_CR62","unstructured":"Hoffmann R, Zhang C, Ling X, Zettlemoyer LS, Weld DS (2011) Knowledge-based weak supervision for information extraction of overlapping relations. In: The 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference, 19-24 June, Portland, Oregon, USA, The Association for Computer Linguistics, pp. 541\u2013550"},{"key":"1381_CR63","doi-asserted-by":"crossref","unstructured":"Ren X, Wu Z, He W, Qu M, Voss CR, Ji H, Abdelzaher TF, Han J (2017) Cotype: Joint extraction of typed entities and relations with knowledge bases. In: Proceedings of the 26th International Conference on World Wide Web, WWW 2017, Perth, Australia, April 3-7, ACM, pp. 1015\u20131024","DOI":"10.1145\/3038912.3052708"},{"key":"1381_CR64","doi-asserted-by":"crossref","unstructured":"Zeng X, Zeng D, He S, Liu K, Zhao J (2018) Extracting relational facts by an end-to-end neural model with copy mechanism. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, ACL 2018, Melbourne, Australia, July 15-20, Volume 1: Long Papers, Association for Computational Linguistics, pp. 506\u2013514","DOI":"10.18653\/v1\/P18-1047"}],"container-title":["Complex &amp; Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-024-01381-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40747-024-01381-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-024-01381-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,16]],"date-time":"2024-05-16T18:22:25Z","timestamp":1715883745000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40747-024-01381-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,29]]},"references-count":64,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,6]]}},"alternative-id":["1381"],"URL":"https:\/\/doi.org\/10.1007\/s40747-024-01381-8","relation":{},"ISSN":["2199-4536","2198-6053"],"issn-type":[{"value":"2199-4536","type":"print"},{"value":"2198-6053","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,29]]},"assertion":[{"value":"28 December 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 February 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 February 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}