{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T11:33:58Z","timestamp":1780054438507,"version":"3.54.0"},"reference-count":126,"publisher":"SAGE Publications","issue":"5","license":[{"start":{"date-parts":[[2024,10,9]],"date-time":"2024-10-09T00:00:00Z","timestamp":1728432000000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SW"],"published-print":{"date-parts":[[2024,10,9]]},"abstract":"<jats:p>This paper presents a survey on multilingual Knowledge Graph Question Answering (mKGQA). We employ a systematic review methodology to collect and analyze the research results in the field of mKGQA by defining scientific literature sources, selecting relevant publications, extracting objective information (e.g., problem, approach, evaluation values, used metrics, etc.), thoroughly analyzing the information, searching for novel insights, and methodically organizing them. Our insights are derived from 46 publications: 26 papers specifically focused on mKGQA systems, 14 papers concerning benchmarks and datasets, and 7 systematic survey articles. Starting its search from 2011, this work presents a comprehensive overview of the research field, encompassing the most recent findings pertaining to mKGQA and Large Language Models. We categorize the acquired information into a well-defined taxonomy, which classifies the methods employed in the development of mKGQA systems. Moreover, we formally define three pivotal characteristics of these methods, namely resource efficiency, multilinguality, and portability. These formal definitions serve as crucial reference points for selecting an appropriate method for mKGQA in a given use case. Lastly, we delve into the challenges of mKGQA, offer a broad outlook on the investigated research field, and outline important directions for future research. Accompanying this paper, we provide all the collected data, scripts, and documentation in an online appendix.<\/jats:p>","DOI":"10.3233\/sw-243633","type":"journal-article","created":{"date-parts":[[2024,8,30]],"date-time":"2024-08-30T11:19:12Z","timestamp":1725016752000},"page":"2089-2124","source":"Crossref","is-referenced-by-count":6,"title":["Multilingual question answering systems for knowledge graphs\u00a0\u2013 a survey"],"prefix":"10.1177","volume":"15","author":[{"given":"Aleksandr","family":"Perevalov","sequence":"first","affiliation":[{"name":"Faculty of Computer Science and Media, Leipzig University of Applied Sciences, Germany"},{"name":"Department of Computer Science and Languages, Anhalt University of Applied Sciences, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andreas","family":"Both","sequence":"additional","affiliation":[{"name":"Faculty of Computer Science and Media, Leipzig University of Applied Sciences, Germany"},{"name":"Technology Innovation Unit, DATEV eG, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Axel-Cyrille","family":"Ngonga Ngomo","sequence":"additional","affiliation":[{"name":"Data Science Group (DICE), University of Paderborn, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","reference":[{"key":"10.3233\/SW-243633_ref1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-35173-0_26"},{"key":"10.3233\/SW-243633_ref2","doi-asserted-by":"publisher","first-page":"69788","DOI":"10.1109\/ACCESS.2022.3187178","article-title":"Question answering over knowledge graphs: A case study in tourism","volume":"10","author":"Aghaei","year":"2022","journal-title":"IEEE Access"},{"key":"10.3233\/SW-243633_ref3","doi-asserted-by":"crossref","unstructured":"K.\u00a0Al Sharou, Z.\u00a0Li and L.\u00a0Specia, Towards a better understanding of noise in natural language processing, in: Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2021), 2021, pp.\u00a053\u201362.","DOI":"10.26615\/978-954-452-072-4_007"},{"key":"10.3233\/SW-243633_ref4","doi-asserted-by":"publisher","DOI":"10.1017\/S0269888921000138"},{"key":"10.3233\/SW-243633_ref5","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-76298-0_52"},{"key":"10.3233\/SW-243633_ref6","unstructured":"D.M.\u00a0Axel-Cyrille, N.\u00a0Ngomo and L.\u00a0B\u00fchman, A holistic natural language generation framework for the Semantic Web, in: Proceedings of the International Conference Recent Advances in Natural Language Processing, ACL (Association for Computational Linguistics), 2019, pp.\u00a08."},{"key":"10.3233\/SW-243633_ref7","doi-asserted-by":"crossref","unstructured":"J.\u00a0Baek, A.F.\u00a0Aji and A.\u00a0Saffari, Knowledge-augmented language model prompting for zero-shot knowledge graph question answering, in: ACL 2023 Workshop on Matching Entities, 2023, https:\/\/www.amazon.science\/publications\/knowledge-augmented-language-model-prompting-for-zero-shot-knowledge-graph-question-answering.","DOI":"10.18653\/v1\/2023.matching-1.7"},{"issue":"1","key":"10.3233\/SW-243633_ref8","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1145\/2964797.2964806","article-title":"Report on the eighth workshop on Exploiting Semantic Annotations in Information Retrieval (ESAIR \u201915)","volume":"50","author":"Balog","year":"2016","journal-title":"SIGIR Forum"},{"issue":"6","key":"10.3233\/SW-243633_ref9","doi-asserted-by":"publisher","first-page":"1554","DOI":"10.1214\/aoms\/1177699147","article-title":"Statistical inference for probabilistic functions of finite state Markov chains","volume":"37","author":"Baum","year":"1966","journal-title":"The annals of mathematical statistics"},{"key":"10.3233\/SW-243633_ref10","unstructured":"J.\u00a0Berant, A.\u00a0Chou, R.\u00a0Frostig and P.\u00a0Liang, Semantic parsing on freebase from question-answer pairs, in: Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Seattle, Washington, USA, 2013, pp.\u00a01533\u20131544, https:\/\/aclanthology.org\/D13-1160."},{"issue":"5","key":"10.3233\/SW-243633_ref11","first-page":"34","volume":"284","author":"Berners-Lee","year":"2001","journal-title":"The Semantic Web, Scientific American"},{"key":"10.3233\/SW-243633_ref13","doi-asserted-by":"publisher","DOI":"10.1145\/1376616.1376746"},{"key":"10.3233\/SW-243633_ref15","doi-asserted-by":"crossref","unstructured":"A.\u00a0Both, D.\u00a0Diefenbach, K.\u00a0Singh, S.\u00a0Shekarpour, D.\u00a0Cherix and C.\u00a0Lange, Qanary\u2013a methodology for vocabulary-driven open question answering systems, in: European Semantic Web Conference, Springer, 2016, pp.\u00a0625\u2013641.","DOI":"10.1007\/978-3-319-34129-3_38"},{"key":"10.3233\/SW-243633_ref16","doi-asserted-by":"publisher","DOI":"10.1145\/3488560.3502196"},{"key":"10.3233\/SW-243633_ref17","unstructured":"T.\u00a0Brown, B.\u00a0Mann, N.\u00a0Ryder, M.\u00a0Subbiah, J.D.\u00a0Kaplan, P.\u00a0Dhariwal, A.\u00a0Neelakantan, P.\u00a0Shyam, G.\u00a0Sastry, A.\u00a0Askell, S.\u00a0Agarwal, A.\u00a0Herbert-Voss, G.\u00a0Krueger, T.\u00a0Henighan, R.\u00a0Child, A.\u00a0Ramesh, D.\u00a0Ziegler, J.\u00a0Wu, C.\u00a0Winter, C.\u00a0Hesse, M.\u00a0Chen, E.\u00a0Sigler, M.\u00a0Litwin, S.\u00a0Gray, B.\u00a0Chess, J.\u00a0Clark, C.\u00a0Berner, S.\u00a0McCandlish, A.\u00a0Radford, I.\u00a0Sutskever and D.\u00a0Amodei, Language models are few-shot learners, in: Advances in Neural Information Processing Systems, H.\u00a0Larochelle, M.\u00a0Ranzato, R.\u00a0Hadsell, M.F.\u00a0Balcan and H.\u00a0Lin, eds, Vol.\u00a033, Curran Associates, Inc., 2020, pp.\u00a01877\u20131901, https:\/\/proceedings.neurips.cc\/paper\/2020\/file\/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf."},{"key":"10.3233\/SW-243633_ref18","doi-asserted-by":"crossref","unstructured":"E.\u00a0Cabrio, P.\u00a0Cimiano, V.\u00a0Lopez, A.-C.N.\u00a0Ngomo, C.\u00a0Unger and S.\u00a0Walter, QALD-3: Multilingual question answering over linked data, in: CLEF (Working Notes), Vol.\u00a038, 2013.","DOI":"10.1007\/978-3-642-40802-1_30"},{"key":"10.3233\/SW-243633_ref19","unstructured":"E.\u00a0Cabrio, J.\u00a0Cojan, A.P.\u00a0Aprosio, B.\u00a0Magnini, A.\u00a0Lavelli and F.\u00a0Gandon, QAKiS: An open domain QA system based on relational patterns, in: International Semantic Web Conference, ISWC 2012, 2012."},{"key":"10.3233\/SW-243633_ref20","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-43585-4_9"},{"key":"10.3233\/SW-243633_ref21","doi-asserted-by":"crossref","unstructured":"E.\u00a0Cabrio, J.\u00a0Cojan, F.\u00a0Gandon and A.\u00a0Hallili, Querying multilingual DBpedia with QAKiS, in: The Semantic Web: ESWC 2013 Satellite Events, P.\u00a0Cimiano, M.\u00a0Fern\u00e1ndez, V.\u00a0Lopez, S.\u00a0Schlobach and J.\u00a0V\u00f6lker, eds, Springer Berlin Heidelberg, Berlin, Heidelberg, 2013, pp.\u00a0194\u2013198. ISBN 978-3-642-41242-4.","DOI":"10.1007\/978-3-642-41242-4_23"},{"key":"10.3233\/SW-243633_ref22","unstructured":"C.P.\u00a0Carrino, M.\u00a0Ruiz Costa-Juss\u00e0 and J.A.\u00a0Rodr\u00edguez Fonollosa, Automatic Spanish translation of SQuAD dataset for multi-lingual question answering, in: LREC 2020: 12th International Conference on Language Resources and Evaluation, Marse\u00edlle, France, May 13\u201315, 2020, Conference Proceedings, European Language Resources Association (ELRA), 2020, pp.\u00a05515\u20135523."},{"key":"10.3233\/SW-243633_ref23","doi-asserted-by":"publisher","DOI":"10.1002\/widm.1389"},{"key":"10.3233\/SW-243633_ref24","doi-asserted-by":"publisher","DOI":"10.3115\/1219840.1219862"},{"key":"10.3233\/SW-243633_ref25","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1082"},{"issue":"2","key":"10.3233\/SW-243633_ref28","doi-asserted-by":"publisher","first-page":"515","DOI":"10.1214\/21-BA1259","article-title":"MBART: Multidimensional monotone BART","volume":"17","author":"Chipman","year":"2022","journal-title":"Bayesian Analysis"},{"key":"10.3233\/SW-243633_ref30","doi-asserted-by":"publisher","DOI":"10.1145\/2464464.2464500"},{"key":"10.3233\/SW-243633_ref32","doi-asserted-by":"publisher","first-page":"937","DOI":"10.1162\/tacl_a_00499","article-title":"Compositional generalization in multilingual semantic parsing over Wikidata","volume":"10","author":"Cui","year":"2022","journal-title":"Transactions of the Association for Computational Linguistics"},{"issue":"7","key":"10.3233\/SW-243633_ref33","doi-asserted-by":"publisher","first-page":"5429","DOI":"10.1007\/s10462-020-09826-5","article-title":"A short survey on end-to-end simple question answering systems","volume":"53","author":"da\u00a0Silva","year":"2020","journal-title":"Artificial Intelligence Review"},{"key":"10.3233\/SW-243633_ref34","unstructured":"M.-C.\u00a0De Marneffe, B.\u00a0MacCartney, C.D.\u00a0Manning et al., Generating typed dependency parses from phrase structure parses, in: Lrec, Vol.\u00a06, 2006, pp.\u00a0449\u2013454."},{"key":"10.3233\/SW-243633_ref37","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1423"},{"issue":"3","key":"10.3233\/SW-243633_ref38","doi-asserted-by":"publisher","first-page":"421","DOI":"10.3233\/SW-190343","article-title":"Towards a question answering system over the Semantic Web","volume":"11","author":"Diefenbach","year":"2020","journal-title":"Semantic Web"},{"key":"10.3233\/SW-243633_ref39","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-49461-2_25"},{"key":"10.3233\/SW-243633_ref40","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1007\/s10115-017-1100-y","article-title":"Core techniques of question answering systems over knowledge bases: A survey","volume":"55","author":"Diefenbach","year":"2017","journal-title":"Knowledge and Information Systems"},{"key":"10.3233\/SW-243633_ref41","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3314124"},{"key":"10.3233\/SW-243633_ref42","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-60131-1_10"},{"key":"10.3233\/SW-243633_ref43","isbn-type":"print","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1007\/978-3-319-69146-6_8","volume-title":"WDAqua-Core0: A Question Answering Component for the Research Community","author":"Diefenbach","year":"2017","ISBN":"https:\/\/id.crossref.org\/isbn\/9783319691466"},{"key":"10.3233\/SW-243633_ref44","doi-asserted-by":"publisher","DOI":"10.1145\/3184558.3191541"},{"issue":"2","key":"10.3233\/SW-243633_ref45","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1007\/s10844-019-00584-7","article-title":"A survey on question answering systems over linked data and documents","volume":"55","author":"Dimitrakis","year":"2020","journal-title":"Journal of intelligent information systems"},{"key":"10.3233\/SW-243633_ref46","unstructured":"T.\u00a0Dozat and C.D.\u00a0Manning, Deep biaffine attention for neural dependency parsing, in: 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24\u201326, 2017, Conference Track Proceedings, OpenReview.net, 2017, https:\/\/openreview.net\/forum?id=Hk95PK9le."},{"key":"10.3233\/SW-243633_ref47","unstructured":"R.\u00a0Dutt, S.\u00a0Khosla, V.B.\u00a0Kumar and R.\u00a0Gangadharaiah, Designing harder benchmarks for evaluating zero-shot generalizability in question answering over knowledge bases, in: ACL 2023 Workshop on Natural Language Reasoning and Structured Explanations, 2023, https:\/\/www.amazon.science\/publications\/designing-harder-benchmarks-for-evaluating-zero-shot-generalizability-in-question-answering-over-knowledge-bases."},{"key":"10.3233\/SW-243633_ref48","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P15-1033"},{"key":"10.3233\/SW-243633_ref49","unstructured":"M.F.\u00a0Elahi, B.\u00a0Ell, G.\u00a0Nolano and P.\u00a0Cimiano, Multilingual question answering over linked data building on a model of the lexicon-ontology interface, Semantic Web Journal (2023), https:\/\/www.semantic-web-journal.net\/system\/files\/swj3619.pdf."},{"key":"10.3233\/SW-243633_ref50","doi-asserted-by":"publisher","DOI":"10.28995\/2075-7182-2020-19-270-282"},{"key":"10.3233\/SW-243633_ref51","unstructured":"B.\u00a0Faria, D.\u00a0Perdig\u00e3o and H.\u00a0Gon\u00e7alo Oliveira, Question answering over linked data with GPT-3, in: 12th Symposium on Languages, Applications and Technologies (SLATE 2023), Schloss Dagstuhl-Leibniz-Zentrum f\u00fcr Informatik, 2023."},{"issue":"2","key":"10.3233\/SW-243633_ref52","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1016\/j.websem.2011.01.002","article-title":"The QALL-ME framework: A specifiable-domain multilingual question answering architecture","volume":"9","author":"Ferr\u00e1ndez","year":"2011","journal-title":"Journal of Web Semantics"},{"issue":"6","key":"10.3233\/SW-243633_ref54","doi-asserted-by":"publisher","first-page":"1039","DOI":"10.3233\/SW-190355","article-title":"EventKG\u2013the hub of event knowledge on the web\u2013and biographical timeline generation","volume":"10","author":"Gottschalk","year":"2019","journal-title":"Semantic Web"},{"key":"10.3233\/SW-243633_ref55","unstructured":"D.\u00a0Grune and C.J.\u00a0Jacobs, Parsing Techniques (Monographs in Computer Science), Springer-Verlag, 2006."},{"issue":"9","key":"10.3233\/SW-243633_ref56","doi-asserted-by":"publisher","first-page":"3649","DOI":"10.1016\/j.eswa.2012.12.070","article-title":"SWSNL: Semantic Web search using natural language","volume":"40","author":"Habernal","year":"2013","journal-title":"Expert Systems with Applications"},{"key":"10.3233\/SW-243633_ref57","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-68288-4_20"},{"issue":"2","key":"10.3233\/SW-243633_ref58","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1145\/320251.320253","article-title":"Developing a natural language interface to complex data","volume":"3","author":"Hendrix","year":"1978","journal-title":"ACM Trans. Database Syst."},{"key":"10.3233\/SW-243633_ref59","doi-asserted-by":"publisher","DOI":"10.1002\/advs.201900808"},{"issue":"8","key":"10.3233\/SW-243633_ref60","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"10.3233\/SW-243633_ref62","doi-asserted-by":"publisher","DOI":"10.3233\/SW-160247"},{"issue":"6","key":"10.3233\/SW-243633_ref63","doi-asserted-by":"publisher","first-page":"895","DOI":"10.3233\/SW-160247","article-title":"Survey on challenges of question answering in the Semantic Web","volume":"8","author":"H\u00f6ffner","year":"2017","journal-title":"Semantic Web"},{"key":"10.3233\/SW-243633_ref64","doi-asserted-by":"publisher","DOI":"10.2200\/S01125ED1V01Y202109DSK022"},{"key":"10.3233\/SW-243633_ref65","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.1212303"},{"key":"10.3233\/SW-243633_ref66","unstructured":"A.S.\u00a0Hornby and A.P.\u00a0Cowie, Oxford Advanced Learner\u2019s Dictionary of Current English, 1977."},{"key":"10.3233\/SW-243633_ref67","doi-asserted-by":"crossref","unstructured":"E.\u00a0Hovy, M.\u00a0Marcus, M.\u00a0Palmer, L.\u00a0Ramshaw and R.\u00a0Weischedel, OntoNotes: The 90% solution, in: Proceedings of the Human Language Technology Conference of the NAACL, Companion Volume: Short Papers, 2006, pp.\u00a057\u201360.","DOI":"10.3115\/1614049.1614064"},{"key":"10.3233\/SW-243633_ref70","unstructured":"M.\u00a0Irmer, C.\u00a0Bobach, T.\u00a0B\u00f6hme, A.\u00a0P\u00fcschel and L.\u00a0Weber, Using a chemical ontology for detecting and classifying chemical terms mentioned in texts, in: Proceedings of Bio-Ontologies 2013, 2013."},{"issue":"2","key":"10.3233\/SW-243633_ref71","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1162\/COLI_a_00284","article-title":"A comprehensive analysis of bilingual lexicon induction","volume":"43","author":"Irvine","year":"2017","journal-title":"Computational Linguistics"},{"key":"10.3233\/SW-243633_ref74","unstructured":"D.\u00a0Jurafsky and J.H.\u00a0Martin, Chapter Question Answering and Information Retrieval, 3rd edn, Speech and Language Processing, Prentice-Hall, Inc., USA, 2020, https:\/\/web.stanford.edu\/~jurafsky\/slp3\/."},{"key":"10.3233\/SW-243633_ref76","doi-asserted-by":"crossref","unstructured":"M.\u00a0Keskenidou, A.\u00a0Kyridis, L.P.\u00a0Valsamidou and A.-H.\u00a0Soulani, The Internet as a source of information. The social role of blogs and their reliability, Observatorio (OBS\u2217) (2014).","DOI":"10.15847\/obsOBS812014688"},{"key":"10.3233\/SW-243633_ref77","unstructured":"D.\u00a0Keysers, N.\u00a0Sch\u00e4rli, N.\u00a0Scales, H.\u00a0Buisman, D.\u00a0Furrer, S.\u00a0Kashubin, N.\u00a0Momchev, D.\u00a0Sinopalnikov, L.\u00a0Stafiniak, T.\u00a0Tihon, D.\u00a0Tsarkov, X.\u00a0Wang, M.\u00a0van Zee and O.\u00a0Bousquet, Measuring compositional generalization: A comprehensive method on realistic data, in: International Conference on Learning Representations (ICLR), 2020, https:\/\/openreview.net\/pdf?id=SygcCnNKwr."},{"key":"10.3233\/SW-243633_ref78","first-page":"1","volume-title":"Procedures for Performing Systematic Reviews","author":"Kitchenham","year":"2004"},{"key":"10.3233\/SW-243633_ref79","unstructured":"G.G.\u00a0Klager and A.\u00a0Polleres, Is GPT fit for KGQA?\u2013preliminary results, in: Joint Proceedings of TEXT2KG 2023 and BiKE 2023, S.\u00a0Tiwari, N.\u00a0Mihindukulasooriya, F.\u00a0Osborne, D.\u00a0Kontokostas, J.\u00a0D\u2019Souza, M.\u00a0Kejriwal and E.\u00a0Marx, eds, 2023, pp.\u00a0171\u2013191, https:\/\/ceur-ws.org\/Vol-3447\/Text2KG_Paper_11.pdf."},{"key":"10.3233\/SW-243633_ref80","doi-asserted-by":"crossref","unstructured":"D.\u00a0Klein and C.D.\u00a0Manning, Accurate unlexicalized parsing, in: Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, 2003, pp.\u00a0423\u2013430.","DOI":"10.3115\/1075096.1075150"},{"key":"10.3233\/SW-243633_ref82","doi-asserted-by":"crossref","unstructured":"V.\u00a0Korablinov and P.\u00a0Braslavski, RuBQ: A Russian dataset for question answering over Wikidata, in: International Semantic Web Conference, Springer, 2020, pp.\u00a097\u2013110.","DOI":"10.1007\/978-3-030-62466-8_7"},{"key":"10.3233\/SW-243633_ref85","unstructured":"T.\u00a0Kwiatkowksi, L.\u00a0Zettlemoyer, S.\u00a0Goldwater and M.\u00a0Steedman, Inducing probabilistic CCG grammars from logical form with higher-order unification, in: Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, 2010, pp.\u00a01223\u20131233."},{"key":"10.3233\/SW-243633_ref86","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.733"},{"key":"10.3233\/SW-243633_ref87","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1040"},{"key":"10.3233\/SW-243633_ref88","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10796-020-09987-2","article-title":"Towards end-to-end multilingual question answering","volume":"22","author":"Loginova","year":"2020","journal-title":"Information Systems Frontiers (ISF)"},{"key":"10.3233\/SW-243633_ref90","doi-asserted-by":"crossref","unstructured":"N.\u00a0McKenna and P.\u00a0Sen, KGQA without retraining, in: ACL 2023 Workshop on SustaiNLP, 2023, https:\/\/www.amazon.science\/publications\/kgqa-without-retraining.","DOI":"10.18653\/v1\/2023.sustainlp-1.15"},{"key":"10.3233\/SW-243633_ref91","unstructured":"P.\u00a0Mian, T.\u00a0Conte, A.\u00a0Natali, J.\u00a0Biolchini and G.\u00a0Travassos, A systematic review process for software engineering, in: ESELAW\u201905: 2nd Experimental Software Engineering Latin, American Workshop, 2005."},{"key":"10.3233\/SW-243633_ref92","doi-asserted-by":"publisher","DOI":"10.1145\/2736277.2741284"},{"key":"10.3233\/SW-243633_ref93","doi-asserted-by":"publisher","DOI":"10.3389\/fphy.2018.00054"},{"key":"10.3233\/SW-243633_ref94","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1162\/tacl_a_00179","article-title":"Entity linking meets word sense disambiguation: A unified approach","volume":"2","author":"Moro","year":"2014","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"10.3233\/SW-243633_ref95","unstructured":"M.\u00a0Mountantonakis, M.\u00a0Bastakis, L.\u00a0Mertzanis and Y.\u00a0Tzitzikas, Tiresias: Bilingual question answering over DBpedia, in: Workshop at ISWC 2022 on Deep Learning for Knowledge Graphs, CEUR, 2022."},{"key":"10.3233\/SW-243633_ref97","unstructured":"A.\u00a0Neves, A.\u00a0Lamurias and F.\u00a0Couto, Biomedical question answering using extreme multi-label classification and ontologies in the multilingual panorama, in: Semantic Indexing and Information Retrieval for Health Held in Conjunction with the 42nd European Conference on Information Retrieval (SIIRH@ECIR), 2020."},{"key":"10.3233\/SW-243633_ref98","unstructured":"J.\u00a0Nivre, M.-C.\u00a0De Marneffe, F.\u00a0Ginter, Y.\u00a0Goldberg, J.\u00a0Hajic, C.D.\u00a0Manning, R.\u00a0McDonald, S.\u00a0Petrov, S.\u00a0Pyysalo, N.\u00a0Silveira et al., Universal dependencies v1: A multilingual treebank collection, in: Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC\u201916), 2016, pp.\u00a01659\u20131666."},{"key":"10.3233\/SW-243633_ref99","unstructured":"J.\u00a0Nivre, D.\u00a0Zeman, F.\u00a0Ginter and F.\u00a0Tyers, Universal dependencies, in: Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Tutorial Abstracts, Association for Computational Linguistics, Valencia, Spain, 2017, https:\/\/aclanthology.org\/E17-5001."},{"issue":"1","key":"10.3233\/SW-243633_ref100","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13643-021-01626-4","article-title":"The PRISMA 2020 statement: An updated guideline for reporting systematic reviews","volume":"10","author":"Page","year":"2021","journal-title":"Systematic reviews"},{"key":"10.3233\/SW-243633_ref101","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-98192-5_21"},{"key":"10.3233\/SW-243633_ref102","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2022.104272"},{"issue":"1","key":"10.3233\/SW-243633_ref103","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1049\/sfw2.12028","article-title":"Systematic review of question answering over knowledge bases","volume":"16","author":"Pereira","year":"2022","journal-title":"IET Software"},{"key":"10.3233\/SW-243633_ref104","unstructured":"A.\u00a0Perevalov and A.\u00a0Both, Augmentation-based answer type classification of the SMART dataset, in: SMART@ ISWC, 2020, pp.\u00a01\u20139."},{"key":"10.3233\/SW-243633_ref105","doi-asserted-by":"publisher","DOI":"10.1145\/3485447.3511940"},{"key":"10.3233\/SW-243633_ref106","doi-asserted-by":"publisher","DOI":"10.1109\/ICSC52841.2022.00045"},{"key":"10.3233\/SW-243633_ref107","unstructured":"A.\u00a0Perevalov, X.\u00a0Yan, L.\u00a0Kovriguina, L.\u00a0Jiang, A.\u00a0Both and R.\u00a0Usbeck, Knowledge graph question answering leaderboard: A community resource to prevent a replication crisis, in: Proceedings of the Language Resources and Evaluation Conference, European Language Resources Association, Marseille, France, 2022, pp.\u00a02998\u20133007, https:\/\/aclanthology.org\/2022.lrec-1.321."},{"key":"10.3233\/SW-243633_ref108","doi-asserted-by":"publisher","DOI":"10.1145\/3297280.3297508"},{"key":"10.3233\/SW-243633_ref109","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1493"},{"key":"10.3233\/SW-243633_ref110","doi-asserted-by":"crossref","unstructured":"M.\u00a0Potthast, M.\u00a0Hagen and B.\u00a0Stein, The dilemma of the direct answer, in: ACM SIGIR Forum, Vol.\u00a054, ACM, New York, NY, USA, 2021, pp.\u00a01\u201312.","DOI":"10.1145\/3451964.3451978"},{"key":"10.3233\/SW-243633_ref111","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-1403"},{"issue":"2","key":"10.3233\/SW-243633_ref113","doi-asserted-by":"publisher","first-page":"200","DOI":"10.1109\/TAI.2021.3068697","article-title":"A global\u2013local attentive relation detection model for knowledge-based question answering","volume":"2","author":"Qiu","year":"2021","journal-title":"IEEE Transactions on Artificial Intelligence"},{"key":"10.3233\/SW-243633_ref115","isbn-type":"print","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1007\/978-3-030-00072-1_9","volume-title":"A Language Adaptive Method for Question Answering on French and English","author":"Radoev","year":"2018","ISBN":"https:\/\/id.crossref.org\/isbn\/9783030000721"},{"issue":"2","key":"10.3233\/SW-243633_ref116","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1017\/S0956796803004738","article-title":"Grammatical framework","volume":"14","author":"Ranta","year":"2004","journal-title":"Journal of Functional Programming"},{"key":"10.3233\/SW-243633_ref117","doi-asserted-by":"crossref","unstructured":"A.\u00a0Ranta, The GF Resource Grammar Library, Linguistic Issues in Language Technology 2, 2009.","DOI":"10.33011\/lilt.v2i.1205"},{"key":"10.3233\/SW-243633_ref118","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1009"},{"key":"10.3233\/SW-243633_ref119","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-77385-4_32"},{"key":"10.3233\/SW-243633_ref120","unstructured":"M.\u00a0Sanguinetti, M.\u00a0Atzori, N.\u00a0Puddu et al., RewordQALD9: A bilingual benchmark with alternative rewordings of QALD questions, in: CEUR Workshop Proceedings, Vol.\u00a03235, CEUR-WS, 2022."},{"key":"10.3233\/SW-243633_ref121","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.412"},{"key":"10.3233\/SW-243633_ref123","unstructured":"P.\u00a0Sen, A.F.\u00a0Aji and A.\u00a0Saffari, Mintaka: A complex, natural, and multilingual dataset for end-to-end question answering, in: Proceedings of the 29th International Conference on Computational Linguistics, International Committee on Computational Linguistics, Gyeongju, Republic of Korea, 2022, pp.\u00a01604\u20131619. https:\/\/aclanthology.org\/2022.coling-1.138."},{"key":"10.3233\/SW-243633_ref124","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1016\/j.midw.2017.03.005","article-title":"The Internet as a source of information used by women after childbirth to meet their need for information: A web-based survey","volume":"48","author":"Slomian","year":"2017","journal-title":"Midwifery"},{"key":"10.3233\/SW-243633_ref126","doi-asserted-by":"crossref","unstructured":"J.\u00a0Soruco, D.\u00a0Collarana, A.\u00a0Both and R.\u00a0Usbeck, QALD-9-ES: A Spanish dataset for question answering systems, in: Knowledge Graphs: Semantics, Machine Learning, and Languages, IOS Press, 2023, pp.\u00a038\u201352.","DOI":"10.3233\/SSW230004"},{"key":"10.3233\/SW-243633_ref127","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3412760"},{"key":"10.3233\/SW-243633_ref128","doi-asserted-by":"publisher","DOI":"10.1145\/3587259.3627567"},{"key":"10.3233\/SW-243633_ref129","doi-asserted-by":"publisher","first-page":"103642","DOI":"10.1109\/ACCESS.2020.2999160","article-title":"Direct answers in Google search results","volume":"8","author":"Strzelecki","year":"2020","journal-title":"IEEE Access"},{"key":"10.3233\/SW-243633_ref130","doi-asserted-by":"publisher","DOI":"10.1016\/j.bdr.2023.100381"},{"key":"10.3233\/SW-243633_ref131","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2023.120721"},{"key":"10.3233\/SW-243633_ref132","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1007\/978-94-010-0201-1_1","article-title":"The penn treebank: An overview","author":"Taylor","year":"2003","journal-title":"Treebanks"},{"key":"10.3233\/SW-243633_ref133","unstructured":"J.\u00a0Tiedemann and S.\u00a0Thottingal, OPUS-MT\u00a0\u2013 building open translation services for the world, in: Proceedings of the 22nd Annual Conference of the European Association for Machine Translation (EAMT), Lisbon, Portugal, 2020."},{"key":"10.3233\/SW-243633_ref135","doi-asserted-by":"crossref","unstructured":"P.\u00a0Trivedi, G.\u00a0Maheshwari, M.\u00a0Dubey and J.\u00a0Lehmann, LC-QuAD: A corpus for complex question answering over knowledge graphs, in: International Semantic Web Conference, Springer, 2017, pp.\u00a0210\u2013218.","DOI":"10.1007\/978-3-319-68204-4_22"},{"key":"10.3233\/SW-243633_ref136","doi-asserted-by":"publisher","DOI":"10.28995\/2075-7182-2023-22-1112-1126"},{"key":"10.3233\/SW-243633_ref137","unstructured":"A.\u00a0Ugawa, A.\u00a0Tamura, T.\u00a0Ninomiya, H.\u00a0Takamura and M.\u00a0Okumura, Neural machine translation incorporating named entity, in: Proceedings of the 27th International Conference on Computational Linguistics, 2018, pp.\u00a03240\u20133250."},{"key":"10.3233\/SW-243633_ref138","doi-asserted-by":"crossref","unstructured":"C.\u00a0Unger, A.-C.N.\u00a0Ngomo and E.\u00a0Cabrio, 6th open challenge on question answering over linked data (qald-6), in: Semantic Web Challenges: Third SemWebEval Challenge at ESWC 2016, Heraklion, Crete, Greece, May 29\u2013June 2, 2016, Revised Selected Papers, Vol.\u00a03, Springer, 2016, pp.\u00a0171\u2013177.","DOI":"10.1007\/978-3-319-46565-4_13"},{"key":"10.3233\/SW-243633_ref139","unstructured":"R.\u00a0Usbeck, R.H.\u00a0Gusmita, A.N.\u00a0Ngomo and M.\u00a0Saleem, 9th challenge on Question Answering over Linked Data (QALD-9), in: Joint Proceedings of the 4th Workshop on Semantic Deep Learning (SemDeep-4) and NLIWoD4: Natural Language Interfaces for the Web of Data (NLIWOD-4) and 9th Question Answering over Linked Data Challenge (QALD-9) Co-Located with 17th International Semantic Web Conference (ISWC 2018), Monterey, California, United States of America, October 8th\u20139th, 2018, 2018, pp.\u00a058\u201364."},{"issue":"1","key":"10.3233\/SW-243633_ref140","first-page":"51","article-title":"8th challenge on question answering over linked data (QALD-8)","volume":"7","author":"Usbeck","year":"2018","journal-title":"language"},{"key":"10.3233\/SW-243633_ref141","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-69146-6_6"},{"key":"10.3233\/SW-243633_ref142","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3233\/SW-233471","article-title":"QALD-10\u00a0\u2013 The 10th challenge on question answering over linked data","author":"Usbeck","year":"2023","journal-title":"Semantic Web"},{"issue":"10","key":"10.3233\/SW-243633_ref143","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1145\/2629489","article-title":"Wikidata: A free collaborative knowledgebase","volume":"57","author":"Vrande\u010di\u0107","year":"2014","journal-title":"Commun. ACM"},{"issue":"7","key":"10.3233\/SW-243633_ref144","doi-asserted-by":"publisher","first-page":"526","DOI":"10.1145\/359545.359550","article-title":"An English language question answering system for a large relational database","volume":"21","author":"Waltz","year":"1978","journal-title":"Commun. ACM"},{"key":"10.3233\/SW-243633_ref145","doi-asserted-by":"publisher","DOI":"10.1109\/SANER48275.2020.9054857"},{"key":"10.3233\/SW-243633_ref148","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.emnlp-main.296"},{"key":"10.3233\/SW-243633_ref149","doi-asserted-by":"publisher","first-page":"510","DOI":"10.1016\/j.future.2020.12.013","article-title":"Neural machine translating from natural language to SPARQL","volume":"117","author":"Yin","year":"2021","journal-title":"Future Generation Computer Systems"},{"key":"10.3233\/SW-243633_ref152","doi-asserted-by":"crossref","unstructured":"C.\u00a0Zhang, Y.\u00a0Lai, Y.\u00a0Feng and D.\u00a0Zhao, A review of deep learning in question answering over knowledge bases, AI Open (2021).","DOI":"10.1016\/j.aiopen.2021.12.001"},{"key":"10.3233\/SW-243633_ref153","doi-asserted-by":"crossref","unstructured":"Y.\u00a0Zhang, J.\u00a0Wang, Z.\u00a0Wang and R.\u00a0Zhang, XSemPLR: Cross-lingual semantic parsing in multiple natural languages and meaning representations, in: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Association for Computational Linguistics, Toronto, Canada, 2023, pp.\u00a015918\u201315947, https:\/\/aclanthology.org\/2023.acl-long.887.","DOI":"10.18653\/v1\/2023.acl-long.887"},{"key":"10.3233\/SW-243633_ref154","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.naacl-main.465"},{"key":"10.3233\/SW-243633_ref155","doi-asserted-by":"publisher","DOI":"10.1109\/PIC.2018.8706310"}],"container-title":["Semantic Web"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/SW-243633","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T05:27:33Z","timestamp":1777613253000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/SW-243633"}},"subtitle":[],"editor":[{"given":"Philipp","family":"Cimiano","sequence":"additional","affiliation":[{"name":"Bielefeld University, Germany"}],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2024,10,9]]},"references-count":126,"journal-issue":{"issue":"5"},"URL":"https:\/\/doi.org\/10.3233\/sw-243633","relation":{},"ISSN":["2210-4968","1570-0844"],"issn-type":[{"value":"2210-4968","type":"electronic"},{"value":"1570-0844","type":"print"}],"subject":[],"published":{"date-parts":[[2024,10,9]]}}}