{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T21:27:11Z","timestamp":1790717231725,"version":"4.1.0"},"publisher-location":"Cham","reference-count":36,"publisher":"Springer International Publishing","isbn-type":[{"value":"9783030494605","type":"print"},{"value":"9783030494612","type":"electronic"}],"license":[{"start":{"date-parts":[[2020,1,1]],"date-time":"2020-01-01T00:00:00Z","timestamp":1577836800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2020,1,1]],"date-time":"2020-01-01T00:00:00Z","timestamp":1577836800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020]]},"DOI":"10.1007\/978-3-030-49461-2_31","type":"book-chapter","created":{"date-parts":[[2020,5,26]],"date-time":"2020-05-26T23:04:49Z","timestamp":1590534289000},"page":"531-547","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["VQuAnDa: Verbalization QUestion ANswering DAtaset"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5012-0420","authenticated-orcid":false,"given":"Endri","family":"Kacupaj","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0407-1944","authenticated-orcid":false,"given":"Hamid","family":"Zafar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9108-4278","authenticated-orcid":false,"given":"Jens","family":"Lehmann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3458-4748","authenticated-orcid":false,"given":"Maria","family":"Maleshkova","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,5,27]]},"reference":[{"key":"31_CR1","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"571","DOI":"10.1007\/978-3-030-33246-4_36","volume-title":"On the Move to Meaningful Internet Systems: OTM 2019 Conferences","author":"A Abdelkawi","year":"2019","unstructured":"Abdelkawi, A., Zafar, H., Maleshkova, M., Lehmann, J.: Complex query augmentation for question answering over knowledge graphs. In: Panetto, H., Debruyne, C., Hepp, M., Lewis, D., Ardagna, C.A., Meersman, R. (eds.) OTM 2019. LNCS, vol. 11877, pp. 571\u2013587. Springer, Cham (2019). https:\/\/doi.org\/10.1007\/978-3-030-33246-4_36"},{"key":"31_CR2","unstructured":"Abujabal, A., Roy, R.S., Yahya, M., Weikum, G.: ComQa: a community-sourced dataset for complex factoid question answering with paraphrase clusters. arXiv preprint arXiv:1809.09528 (2018)"},{"key":"31_CR3","unstructured":"Azmy, M., Shi, P., Lin, J., Ilyas, I.: Farewell freebase: migrating the simple questions dataset to DBpedia. In: Proceedings of the 27th International Conference on Computational Linguistics, pp. 2093\u20132103 (2018)"},{"key":"31_CR4","unstructured":"Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. arXiv e-prints arXiv:1409.0473, September 2014"},{"key":"31_CR5","unstructured":"Bao, J., Duan, N., Yan, Z., Zhou, M., Zhao, T.: Constraint-based question answering with knowledge graph. In: Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pp. 2503\u20132514 (2016)"},{"key":"31_CR6","doi-asserted-by":"crossref","unstructured":"Berant, J., Chou, A., Frostig, R., Liang, P.: Semantic parsing on freebase from question-answer pairs. In: Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pp. 1533\u20131544 (2013)","DOI":"10.18653\/v1\/D13-1160"},{"key":"31_CR7","doi-asserted-by":"crossref","unstructured":"Bollacker, K., Evans, C., Paritosh, P., Sturge, T., Taylor, J.: Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data (2008)","DOI":"10.1145\/1376616.1376746"},{"key":"31_CR8","unstructured":"Bordes, A., Usunier, N., Chopra, S., Weston, J.: Large-scale simple question answering with memory networks. arXiv preprint arXiv:1506.02075 (2015)"},{"key":"31_CR9","unstructured":"Cai, Q., Yates, A.: Large-scale semantic parsing via schema matching and Lexicon extension. In: Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (2013)"},{"key":"31_CR10","doi-asserted-by":"crossref","unstructured":"Cho, K., et al.: Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv e-prints arXiv:1406.1078, June 2014","DOI":"10.3115\/v1\/D14-1179"},{"key":"31_CR11","unstructured":"Diefenbach, D., Dridi, Y., Singh, K., Maret, P.: SPARQLtoUser: did the question answering system understand me? (2017)"},{"key":"31_CR12","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1007\/978-3-030-30796-7_5","volume-title":"The Semantic Web \u2013 ISWC 2019","author":"M Dubey","year":"2019","unstructured":"Dubey, M., Banerjee, D., Abdelkawi, A., Lehmann, J.: LC-QuAD 2.0: a large dataset for complex question answering over Wikidata and DBpedia. In: Ghidini, C., et al. (eds.) ISWC 2019. LNCS, vol. 11779, pp. 69\u201378. Springer, Cham (2019). https:\/\/doi.org\/10.1007\/978-3-030-30796-7_5"},{"key":"31_CR13","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1007\/978-3-030-00671-6_7","volume-title":"The Semantic Web \u2013 ISWC 2018","author":"M Dubey","year":"2018","unstructured":"Dubey, M., Banerjee, D., Chaudhuri, D., Lehmann, J.: EARL: joint entity and relation linking for question answering over knowledge graphs. In: Vrande\u010di\u0107, D., et al. (eds.) ISWC 2018. LNCS, vol. 11136, pp. 108\u2013126. Springer, Cham (2018). https:\/\/doi.org\/10.1007\/978-3-030-00671-6_7"},{"key":"31_CR14","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"300","DOI":"10.1007\/978-3-319-34129-3_19","volume-title":"The Semantic Web. Latest Advances and New Domains","author":"M Dubey","year":"2016","unstructured":"Dubey, M., Dasgupta, S., Sharma, A., H\u00f6ffner, K., Lehmann, J.: AskNow: a framework for natural language query formalization in SPARQL. In: Sack, H., Blomqvist, E., d\u2019Aquin, M., Ghidini, C., Ponzetto, S.P., Lange, C. (eds.) ESWC 2016. LNCS, vol. 9678, pp. 300\u2013316. Springer, Cham (2016). https:\/\/doi.org\/10.1007\/978-3-319-34129-3_19"},{"key":"31_CR15","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"426","DOI":"10.1007\/978-3-319-07443-6_29","volume-title":"The Semantic Web: Trends and Challenges","author":"B Ell","year":"2014","unstructured":"Ell, B., Harth, A., Simperl, E.: SPARQL query verbalization for explaining semantic search engine queries. In: Presutti, V., d\u2019Amato, C., Gandon, F., d\u2019Aquin, M., Staab, S., Tordai, A. (eds.) ESWC 2014. LNCS, vol. 8465, pp. 426\u2013441. Springer, Cham (2014). https:\/\/doi.org\/10.1007\/978-3-319-07443-6_29"},{"key":"31_CR16","doi-asserted-by":"crossref","unstructured":"Eric, M., Manning, C.D.: Key-value retrieval networks for task-oriented dialogue. arXiv preprint arXiv:1705.05414 (2017)","DOI":"10.18653\/v1\/W17-5506"},{"key":"31_CR17","doi-asserted-by":"crossref","unstructured":"Ernst, P., Meng, C., Siu, A., Weikum, G.: KnowLife: a knowledge graph for health and life sciences. In: 2014 IEEE 30th International Conference on Data Engineering (2014)","DOI":"10.1109\/ICDE.2014.6816754"},{"issue":"3","key":"31_CR18","doi-asserted-by":"publisher","first-page":"405","DOI":"10.3233\/SW-150208","volume":"8","author":"S Ferr\u00e9","year":"2017","unstructured":"Ferr\u00e9, S.: SPARKLIS: an expressive query builder for SPARQL endpoints with guidance in natural language. Semant. Web 8(3), 405\u2013418 (2017)","journal-title":"Semant. Web"},{"key":"31_CR19","unstructured":"Gehring, J., Auli, M., Grangier, D., Yarats, D., Dauphin, Y.N.: Convolutional sequence to sequence learning. arXiv e-prints arXiv:1705.03122, May 2017"},{"key":"31_CR20","unstructured":"Jiang, K., Wu, D., Jiang, H.: FreebaseQA: a new factoid QA data set matching Trivia-style question-answer pairs with freebase. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics (2019)"},{"key":"31_CR21","doi-asserted-by":"publisher","first-page":"167","DOI":"10.3233\/SW-140134","volume":"6","author":"J Lehmann","year":"2015","unstructured":"Lehmann, J., et al.: DBpedia - a large-scale, multilingual knowledge base extracted from Wikipedia. Semant. Web J. 6, 167\u2013195 (2015)","journal-title":"Semant. Web J."},{"key":"31_CR22","doi-asserted-by":"crossref","unstructured":"Luong, M.T., Pham, H., Manning, C.D.: Effective approaches to attention-based neural machine translation. arXiv e-prints arXiv:1508.04025, August 2015","DOI":"10.18653\/v1\/D15-1166"},{"key":"31_CR23","doi-asserted-by":"crossref","unstructured":"Luong, T., Kayser, M., Manning, C.D.: Deep neural language models for machine translation. In: Proceedings of the 19th Conference on Computational Natural Language Learning, Beijing, China. Association for Computational Linguistics (2015)","DOI":"10.18653\/v1\/K15-1031"},{"key":"31_CR24","doi-asserted-by":"crossref","unstructured":"Ngonga Ngomo, A.C., B\u00fchmann, L., Unger, C., Lehmann, J., Gerber, D.: SPARQL2NL: verbalizing SPARQL queries. In: Proceedings of the 22nd International Conference on World Wide Web, pp. 329\u2013332. ACM (2013)","DOI":"10.1145\/2487788.2487936"},{"key":"31_CR25","unstructured":"Chakraborty, N., Lukovnikov, D., Maheshwari, G., Trivedi, P., Lehmann, J., Fischer, A.: Introduction to neural network based approaches for question answering over knowledge graphs (2019)"},{"key":"31_CR26","doi-asserted-by":"crossref","unstructured":"Papineni, K., Roukos, S., Ward, T., Zhu, W.J.: BLEU: a method for automatic evaluation of machine translation. In: Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (2002)","DOI":"10.3115\/1073083.1073135"},{"key":"31_CR27","doi-asserted-by":"crossref","unstructured":"Saha, A., Pahuja, V., Khapra, M.M., Sankaranarayanan, K., Chandar, S.: Complex sequential question answering: towards learning to converse over linked question answer pairs with a knowledge graph. In: Thirty-Second AAAI Conference (2018)","DOI":"10.1609\/aaai.v32i1.11332"},{"key":"31_CR28","doi-asserted-by":"crossref","unstructured":"Serban, I.V., et al.: Generating factoid questions with recurrent neural networks: the 30m factoid question-answer corpus. arXiv preprint arXiv:1603.06807 (2016)","DOI":"10.18653\/v1\/P16-1056"},{"key":"31_CR29","doi-asserted-by":"crossref","unstructured":"Su, Y., et al.: On generating characteristic-rich question sets for QA evaluation. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing (2016)","DOI":"10.18653\/v1\/D16-1054"},{"key":"31_CR30","doi-asserted-by":"crossref","unstructured":"Talmor, A., Berant, J.: The web as a knowledge-base for answering complex questions. arXiv preprint arXiv:1803.06643 (2018)","DOI":"10.18653\/v1\/N18-1059"},{"key":"31_CR31","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"210","DOI":"10.1007\/978-3-319-68204-4_22","volume-title":"The Semantic Web \u2013 ISWC 2017","author":"P Trivedi","year":"2017","unstructured":"Trivedi, P., Maheshwari, G., Dubey, M., Lehmann, J.: LC-QuAD: a corpus for complex question answering over knowledge graphs. In: d\u2019Amato, C., et al. (eds.) ISWC 2017. LNCS, vol. 10588, pp. 210\u2013218. Springer, Cham (2017). https:\/\/doi.org\/10.1007\/978-3-319-68204-4_22"},{"key":"31_CR32","doi-asserted-by":"crossref","unstructured":"Unger, C., B\u00fchmann, L., Lehmann, J., Ngonga Ngomo, A.C., Gerber, D., Cimiano, P.: Template-based question answering over RDF data. In: Proceedings of the 21st International Conference on World Wide Web, pp. 639\u2013648. ACM (2012)","DOI":"10.1145\/2187836.2187923"},{"key":"31_CR33","unstructured":"Vaswani, A., et al.: Attention is all you need. arXiv e-prints arXiv:1706.03762"},{"issue":"10","key":"31_CR34","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1145\/2629489","volume":"57","author":"Denny Vrande\u010di\u0107","year":"2014","unstructured":"Vrande\u010di\u0107, D., Kr\u00f6tzsch, M.: Wikidata: a free collaborative knowledge base (2014)","journal-title":"Communications of the ACM"},{"key":"31_CR35","doi-asserted-by":"crossref","unstructured":"Yih, W.t., Richardson, M., Meek, C., Chang, M.W., Suh, J.: The value of semantic parse labeling for knowledge base question answering. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (2016)","DOI":"10.18653\/v1\/P16-2033"},{"key":"31_CR36","doi-asserted-by":"crossref","unstructured":"Zheng, W., Cheng, H., Zou, L., Yu, J.X., Zhao, K.: Natural language question\/answering: let users talk with the knowledge graph. In: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management (2017)","DOI":"10.1145\/3132847.3132977"}],"container-title":["Lecture Notes in Computer Science","The Semantic Web"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-030-49461-2_31","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,26]],"date-time":"2025-05-26T22:02:37Z","timestamp":1748296957000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-030-49461-2_31"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020]]},"ISBN":["9783030494605","9783030494612"],"references-count":36,"URL":"https:\/\/doi.org\/10.1007\/978-3-030-49461-2_31","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"value":"0302-9743","type":"print"},{"value":"1611-3349","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020]]},"assertion":[{"value":"27 May 2020","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"ESWC","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"European Semantic Web Conference","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Heraklion, Crete","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Greece","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2020","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"31 May 2020","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"4 June 2020","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"17","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"esws2020","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/2020.eswc-conferences.org\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Open","order":1,"name":"type","label":"Type","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"EasyChair","order":2,"name":"conference_management_system","label":"Conference Management System","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"166","order":3,"name":"number_of_submissions_sent_for_review","label":"Number of Submissions Sent for Review","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"39","order":4,"name":"number_of_full_papers_accepted","label":"Number of Full Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"0","order":5,"name":"number_of_short_papers_accepted","label":"Number of Short Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"23% - The value is computed by the equation \"Number of Full Papers Accepted \/ Number of Submissions Sent for Review * 100\" and then rounded to a whole number.","order":6,"name":"acceptance_rate_of_full_papers","label":"Acceptance Rate of Full Papers","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"3","order":7,"name":"average_number_of_reviews_per_paper","label":"Average Number of Reviews per Paper","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"2","order":8,"name":"average_number_of_papers_per_reviewer","label":"Average Number of Papers per Reviewer","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"Yes","order":9,"name":"external_reviewers_involved","label":"External Reviewers Involved","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"Authors could choose to opt in or opt out of being known by the reviewers (i.e., submissions could be anonymous) while reviewers could choose to opt in or opt out of being known by the authors (i.e., reviews could be anonymous). The conference was held virtually due to the COVID-19 pandemic.","order":10,"name":"additional_info_on_review_process","label":"Additional Info on Review Process","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"This content has been made available to all.","name":"free","label":"Free to read"}]}}