{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T10:19:39Z","timestamp":1777889979982,"version":"3.51.4"},"reference-count":25,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2022,2,3]],"date-time":"2022-02-03T00:00:00Z","timestamp":1643846400000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SW"],"published-print":{"date-parts":[[2022,2,3]]},"abstract":"<jats:p>Question Answering (QA) over Knowledge Graphs (KG) aims to develop a system that is capable of answering users\u2019 questions using the information coming from one or multiple Knowledge Graphs, like DBpedia, Wikidata, and so on. Question Answering systems need to translate the user\u2019s question, written using natural language, into a query formulated through a specific data query language that is compliant with the underlying KG. This translation process is already non-trivial when trying to answer simple questions that involve a single triple pattern. It becomes even more troublesome when trying to cope with questions that require modifiers in the final query, i.e., aggregate functions, query forms, and so on. The attention over this last aspect is growing but has never been thoroughly addressed by the existing literature. Starting from the latest advances in this field, we want to further step in this direction. This work aims to provide a publicly available dataset designed for evaluating the performance of a QA system in translating articulated questions into a specific data query language. This dataset has also been used to evaluate three QA systems available at the state of the art.<\/jats:p>","DOI":"10.3233\/sw-210440","type":"journal-article","created":{"date-parts":[[2021,9,17]],"date-time":"2021-09-17T13:00:39Z","timestamp":1631883639000},"page":"215-231","source":"Crossref","is-referenced-by-count":4,"title":["MQALD: Evaluating the impact of modifiers in question answering over knowledge graphs"],"prefix":"10.1177","volume":"13","author":[{"given":"Lucia","family":"Siciliani","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Bari Aldo Moro, Via E. Orabona 4, 70125, Bari, Italy. E-mails:\u00a0lucia.siciliani@uniba.it,\u00a0pierpaolo.basile@uniba.it,\u00a0pasquale.lops@uniba.it,\u00a0giovanni.semeraro@uniba.it"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pierpaolo","family":"Basile","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Bari Aldo Moro, Via E. Orabona 4, 70125, Bari, Italy. E-mails:\u00a0lucia.siciliani@uniba.it,\u00a0pierpaolo.basile@uniba.it,\u00a0pasquale.lops@uniba.it,\u00a0giovanni.semeraro@uniba.it"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pasquale","family":"Lops","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Bari Aldo Moro, Via E. Orabona 4, 70125, Bari, Italy. E-mails:\u00a0lucia.siciliani@uniba.it,\u00a0pierpaolo.basile@uniba.it,\u00a0pasquale.lops@uniba.it,\u00a0giovanni.semeraro@uniba.it"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Giovanni","family":"Semeraro","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Bari Aldo Moro, Via E. Orabona 4, 70125, Bari, Italy. E-mails:\u00a0lucia.siciliani@uniba.it,\u00a0pierpaolo.basile@uniba.it,\u00a0pasquale.lops@uniba.it,\u00a0giovanni.semeraro@uniba.it"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"issue":"1","key":"10.3233\/SW-210440_ref1","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1017\/S135132490000005X","article-title":"Natural language interfaces to databases \u2013 an introduction","volume":"1","author":"Androutsopoulos","year":"1995","journal-title":"Nat. Lang. Eng."},{"key":"10.3233\/SW-210440_ref2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-76298-0_52"},{"key":"10.3233\/SW-210440_ref3","unstructured":"J.\u00a0Berant, A.\u00a0Chou, R.\u00a0Frostig and P.\u00a0Liang, Semantic parsing on freebase from question-answer pairs, in: Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, EMNLP 2013, a Meeting of SIGDAT, a Special Interest Group of the ACL, Grand Hyatt Seattle, Seattle, Washington, USA, 18\u201321 October 2013, ACL, 2013, pp.\u00a01533\u20131544, https:\/\/www.aclweb.org\/anthology\/D13-1160\/."},{"key":"10.3233\/SW-210440_ref4","doi-asserted-by":"publisher","DOI":"10.1145\/1376616.1376746"},{"key":"10.3233\/SW-210440_ref7","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3412760"},{"issue":"3","key":"10.3233\/SW-210440_ref8","doi-asserted-by":"publisher","first-page":"421","DOI":"10.3233\/SW-190343","article-title":"Towards a question answering system over the semantic web","volume":"11","author":"Diefenbach","year":"2020","journal-title":"Semantic Web"},{"issue":"3","key":"10.3233\/SW-210440_ref9","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1007\/s10115-017-1100-y","article-title":"Core techniques of question answering systems over knowledge bases: A survey","volume":"55","author":"Diefenbach","year":"2018","journal-title":"Knowl. Inf. Syst."},{"key":"10.3233\/SW-210440_ref10","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-69146-6_8"},{"key":"10.3233\/SW-210440_ref11","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-30796-7_5"},{"key":"10.3233\/SW-210440_ref12","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-34129-3_19"},{"issue":"6","key":"10.3233\/SW-210440_ref13","doi-asserted-by":"publisher","first-page":"895","DOI":"10.3233\/SW-160247","article-title":"Survey on challenges of question answering in the semantic web","volume":"8","author":"H\u00f6ffner","year":"2017","journal-title":"Semantic Web"},{"key":"10.3233\/SW-210440_ref14","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1234"},{"key":"10.3233\/SW-210440_ref15","doi-asserted-by":"publisher","DOI":"10.1145\/3184558.3191536"},{"key":"10.3233\/SW-210440_ref16","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-76298-0_21"},{"issue":"3","key":"10.3233\/SW-210440_ref17","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1016\/j.jksuci.2014.10.007","article-title":"A survey on question answering systems with classification","volume":"28","author":"Mishra","year":"2016","journal-title":"J. King Saud Univ. Comput. Inf. Sci."},{"key":"10.3233\/SW-210440_ref18","doi-asserted-by":"publisher","DOI":"10.1145\/3318464.3383128"},{"key":"10.3233\/SW-210440_ref19","unstructured":"M.\u00a0Saleem, S.N.\u00a0Dastjerdi, R.\u00a0Usbeck and A.N.\u00a0Ngomo, Question answering over linked data: What is difficult to answer? What affects the F scores? in: Joint Proceedings of BLINK2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3: Natural Language Interfaces for the Web of Data Co-Located with 16th International Semantic Web Conference (ISWC 2017), Vienna, Austria, October 21st\u201322nd 2017, R.\u00a0Usbeck, A.N.\u00a0Ngomo, J.\u00a0Kim, K.\u00a0Choi, P.\u00a0Cimiano, I.\u00a0Fundulaki and A.\u00a0Krithara, eds, CEUR Workshop Proceedings, Vol.\u00a01932, CEUR-WS.org, 2017, http:\/\/ceur-ws.org\/Vol-1932\/paper-02.pdf."},{"key":"10.3233\/SW-210440_ref20","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-35166-3_15"},{"key":"10.3233\/SW-210440_ref21","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/n18-1059"},{"key":"10.3233\/SW-210440_ref22","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-68204-4_22"},{"key":"10.3233\/SW-210440_ref23","unstructured":"R.\u00a0Usbeck, R.H.\u00a0Gusmita, A.N.\u00a0Ngomo and M.\u00a0Saleem, 9th challenge on question answering over linked data (QALD-9) (invited paper), in: Joint Proceedings of the 4th Workshop on Semantic Deep Learning (SemDeep-4) and NLIWoD4: Natural Language Interfaces for the Web of Data (NLIWOD-4) and 9th Question Answering over Linked Data Challenge (QALD-9) Co-Located with 17th International Semantic Web Conference (ISWC 2018), Monterey, California, United States of America, October 8th\u20139th, 2018, K.\u00a0Choi, L.E.\u00a0Anke, T.\u00a0Declerck, D.\u00a0Gromann, J.\u00a0Kim, A.N.\u00a0Ngomo, M.\u00a0Saleem and R.\u00a0Usbeck, eds, CEUR Workshop Proceedings, Vol.\u00a02241, CEUR-WS.org, 2018, pp.\u00a058\u201364, http:\/\/ceur-ws.org\/Vol-2241\/paper-06.pdf."},{"key":"10.3233\/SW-210440_ref25","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-69146-6_6"},{"issue":"2","key":"10.3233\/SW-210440_ref26","doi-asserted-by":"publisher","first-page":"293","DOI":"10.3233\/SW-180312","article-title":"Benchmarking question answering systems","volume":"10","author":"Usbeck","year":"2019","journal-title":"Semantic Web"},{"key":"10.3233\/SW-210440_ref27","doi-asserted-by":"publisher","DOI":"10.1145\/2736277.2741626"},{"issue":"10","key":"10.3233\/SW-210440_ref29","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1145\/2629489","article-title":"Wikidata: A free collaborative knowledgebase","volume":"57","author":"Vrandecic","year":"2014","journal-title":"Commun. ACM"}],"container-title":["Semantic Web"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/SW-210440","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T05:26:08Z","timestamp":1777613168000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/SW-210440"}},"subtitle":[],"editor":[{"given":"Harald","family":"Sack","sequence":"additional","affiliation":[{"name":"FIZ Karlsruhe \u2013 Leibniz Institute for Information Infrastructure, Germany"}],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2022,2,3]]},"references-count":25,"journal-issue":{"issue":"2"},"URL":"https:\/\/doi.org\/10.3233\/sw-210440","relation":{},"ISSN":["2210-4968","1570-0844"],"issn-type":[{"value":"2210-4968","type":"electronic"},{"value":"1570-0844","type":"print"}],"subject":[],"published":{"date-parts":[[2022,2,3]]}}}