{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T18:30:53Z","timestamp":1769020253830,"version":"3.49.0"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2021,12,11]],"date-time":"2021-12-11T00:00:00Z","timestamp":1639180800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,12,11]],"date-time":"2021-12-11T00:00:00Z","timestamp":1639180800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Manipal Academy of Higher Education, Manipal"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Prog Artif Intell"],"published-print":{"date-parts":[[2022,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The idea of data to be semantically linked and the subsequent usage of this linked data with modern computer applications has been one of the most important aspects of Web 3.0. However, the actualization of this aspect has been challenging due to the difficulties associated with building knowledge bases and using formal languages to query them. In this regard, SPARQL, a recursive acronym for standard query language and protocol for Linked Open Data and Resource Description Framework databases, is a most popular formal querying language. Nonetheless, writing SPARQL queries is known to be difficult, even for experts. Natural language query formalization, which involves semantically parsing natural language queries to their formal language equivalents, has been an essential step in overcoming this steep learning curve. Recent work in the field has seen the usage of artificial intelligence (AI) techniques for language modelling with adequate accuracy. This paper discusses a design for creating a closed domain ontology, which is then used by an AI-powered chat-bot that incorporates natural language query formalization for querying linked data using Rasa for entity extraction after intent recognition. A precision\u2013recall analysis is performed using in-built Rasa tools in conjunction with our own testing parameters, and it is found that our system achieves a precision of 0.78, recall of 0.79 and F1-score of 0.79, which are better than the current state of the art.<\/jats:p>","DOI":"10.1007\/s13748-021-00271-1","type":"journal-article","created":{"date-parts":[[2021,12,11]],"date-time":"2021-12-11T10:02:33Z","timestamp":1639216953000},"page":"193-206","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Natural language query formalization to SPARQL for querying knowledge bases using Rasa"],"prefix":"10.1007","volume":"11","author":[{"given":"Divyansh Shankar","family":"Mishra","sequence":"first","affiliation":[]},{"given":"Abhinav","family":"Agarwal","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6708-6385","authenticated-orcid":false,"given":"B. P.","family":"Swathi","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7961-0252","authenticated-orcid":false,"given":"K C.","family":"Akshay","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,12,11]]},"reference":[{"key":"271_CR1","doi-asserted-by":"crossref","unstructured":"Bahmid, R., Zouaq, A.: Hybrid question answering using heuristic methods and linked data schema. In: 2018 IEEE\/WIC\/ACM International Conference on Web Intelligence (WI), pp. 446\u2013451. IEEE (2018)","DOI":"10.1109\/WI.2018.00-54"},{"key":"271_CR2","doi-asserted-by":"crossref","unstructured":"Baudi\u0161, P., \u0160ediv\u1ef3, J.: Modeling of the question answering task in the yodaqa system. In: International Conference of the Cross-Language Evaluation Forum for European Languages, pp. 222\u2013228. Springer (2015)","DOI":"10.1007\/978-3-319-24027-5_20"},{"key":"271_CR3","doi-asserted-by":"crossref","unstructured":"Bollacker, K., Evans, C., Paritosh, P., Sturge, T., Taylor, J.: Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, pp. 1247\u20131250 (2008)","DOI":"10.1145\/1376616.1376746"},{"key":"271_CR4","doi-asserted-by":"crossref","unstructured":"Boumechaal, H., Boufaida, Z.: Formalization of natural language queries. In: 2011 International Symposium on Innovations in Intelligent Systems and Applications, pp. 495\u2013499. IEEE (2011)","DOI":"10.1109\/INISTA.2011.5946148"},{"key":"271_CR5","doi-asserted-by":"crossref","unstructured":"Chen, D., Fisch, A., Weston, J., Bordes, A.: Reading wikipedia to answer open-domain questions. arXiv:1704.00051 (2017)","DOI":"10.18653\/v1\/P17-1171"},{"key":"271_CR6","doi-asserted-by":"crossref","unstructured":"Chen, Q., Zhu, X., Ling, Z., Wei, S., Jiang, H., Inkpen, D.: Enhanced lstm for natural language inference. arXiv:1609.06038 (2016)","DOI":"10.18653\/v1\/P17-1152"},{"key":"271_CR7","doi-asserted-by":"crossref","unstructured":"Demidova, E., Fankhauser, P., Zhou, X., Nejdl, W.: Divq: diversification for keyword search over structured databases. In: Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 331\u2013338 (2010)","DOI":"10.1145\/1835449.1835506"},{"key":"271_CR8","doi-asserted-by":"crossref","unstructured":"Dong, X., Gabrilovich, E., Heitz, G., Horn, W., Lao, N., Murphy, K., Strohmann, T., Sun, S., Zhang, W.: Knowledge vault: a web-scale approach to probabilistic knowledge fusion. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 601\u2013610 (2014)","DOI":"10.1145\/2623330.2623623"},{"key":"271_CR9","doi-asserted-by":"crossref","unstructured":"Dubey, M., Dasgupta, S., Sharma, A., H\u00f6ffner, K., Lehmann, J.: Asknow: A framework for natural language query formalization in sparql. In: European Semantic Web Conference, pp. 300\u2013316. Springer (2016)","DOI":"10.1007\/978-3-319-34129-3_19"},{"key":"271_CR10","doi-asserted-by":"crossref","unstructured":"Elbedweihy, K., Wrigley, S.N., Ciravegna, F.: Evaluating semantic search query approaches with expert and casual users. In: International Semantic Web Conference, pp. 274\u2013286. Springer (2012)","DOI":"10.1007\/978-3-642-35173-0_18"},{"key":"271_CR11","doi-asserted-by":"crossref","unstructured":"Elbedweihy, K., Wrigley, S.N., Ciravegna, F., Reinhard, D., Bernstein, A.: Evaluating semantic search systems to identify future directions of research. In: Extended Semantic Web Conference, pp. 148\u2013162. Springer (2012)","DOI":"10.1007\/978-3-662-46641-4_11"},{"key":"271_CR12","unstructured":"Fabian, M., Gjergji, K., Gerhard, W., et\u00a0al.: Yago: A core of semantic knowledge unifying wordnet and wikipedia. In: 16th International World Wide Web Conference, WWW, pp. 697\u2013706 (2007)"},{"issue":"3","key":"271_CR13","doi-asserted-by":"publisher","first-page":"405","DOI":"10.3233\/SW-150208","volume":"8","author":"S Ferr\u00e9","year":"2017","unstructured":"Ferr\u00e9, S.: Sparklis: an expressive query builder for sparql endpoints with guidance in natural language. Semantic Web 8(3), 405\u2013418 (2017)","journal-title":"Semantic Web"},{"issue":"9","key":"271_CR14","doi-asserted-by":"publisher","first-page":"3649","DOI":"10.1016\/j.eswa.2012.12.070","volume":"40","author":"I Habernal","year":"2013","unstructured":"Habernal, I., Konop\u00edK, M.: Swsnl: semantic web search using natural language. Expert Syst. Appl. 40(9), 3649\u20133664 (2013)","journal-title":"Expert Syst. Appl."},{"key":"271_CR15","doi-asserted-by":"crossref","unstructured":"Hao, Y., Zhang, Y., Liu, K., He, S., Liu, Z., Wu, H., Zhao, J.: An end-to-end model for question answering over knowledge base with cross-attention combining global knowledge. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 221\u2013231 (2017)","DOI":"10.18653\/v1\/P17-1021"},{"key":"271_CR16","unstructured":"He, H., Meng, W., Yu, C., Wu, Z.: Wise-integrator: a system for extracting and integrating complex web search interfaces of the deep web. In: Proceedings of the 31st International Conference on Very Large Data Bases, pp. 1314\u20131317 (2005)"},{"key":"271_CR17","doi-asserted-by":"publisher","first-page":"363","DOI":"10.1016\/j.ins.2018.04.042","volume":"454","author":"X Hu","year":"2018","unstructured":"Hu, X., Dang, D., Yao, Y., Ye, L.: Natural language aggregate query over rdf data. Inf. Sci. 454, 363\u2013381 (2018)","journal-title":"Inf. Sci."},{"key":"271_CR18","unstructured":"Indurthi, S.R., Raghu, D., Khapra, M.M., Joshi, S.: Generating natural language question-answer pairs from a knowledge graph using a rnn based question generation model. In: Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers, pp. 376\u2013385 (2017)"},{"key":"271_CR19","doi-asserted-by":"crossref","unstructured":"Iyer, S., Konstas, I., Cheung, A., Krishnamurthy, J., Zettlemoyer, L.: Learning a neural semantic parser from user feedback. arXiv:1704.08760 (2017)","DOI":"10.18653\/v1\/P17-1089"},{"key":"271_CR20","doi-asserted-by":"crossref","unstructured":"Jagannatha, A.N., Yu, H.: Structured prediction models for rnn based sequence labeling in clinical text. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing. Conference on Empirical Methods in Natural Language Processing, vol. 2016, p. 856. NIH Public Access (2016)","DOI":"10.18653\/v1\/D16-1082"},{"issue":"1","key":"271_CR21","first-page":"012014","volume":"1487","author":"A Jiao","year":"2020","unstructured":"Jiao, A.: An intelligent chatbot system based on entity extraction using rasa nlu and neural network. JPhCS 1487(1), 012014 (2020)","journal-title":"JPhCS"},{"key":"271_CR22","doi-asserted-by":"crossref","unstructured":"Karimi, E., Majidi, B., Manzuri, M.T.: Relevant question answering in community based networks using deep lstm neural networks. In: 2019 7th Iranian Joint Congress on Fuzzy and Intelligent Systems (CFIS), pp. 1\u20135. IEEE (2019)","DOI":"10.1109\/CFIS.2019.8692168"},{"key":"271_CR23","doi-asserted-by":"crossref","unstructured":"Kaufmann, E., Bernstein, A.: How useful are natural language interfaces to the semantic web for casual end-users? In: The Semantic Web, pp. 281\u2013294. Springer (2007)","DOI":"10.1007\/978-3-540-76298-0_21"},{"key":"271_CR24","unstructured":"Kim, J.D., Cohen, K.B.: Natural language query processing for sparql generation: a prototype system for snomed ct. In: Proceedings of biolink, vol.\u00a032, p.\u00a038 (2013)"},{"issue":"2","key":"271_CR25","doi-asserted-by":"publisher","first-page":"167","DOI":"10.3233\/SW-140134","volume":"6","author":"J Lehmann","year":"2015","unstructured":"Lehmann, J., Isele, R., Jakob, M., Jentzsch, A., Kontokostas, D., Mendes, P.N., Hellmann, S., Morsey, M., Van Kleef, P., Auer, S., et al.: Dbpedia-a large-scale, multilingual knowledge base extracted from wikipedia. Seman. web 6(2), 167\u2013195 (2015)","journal-title":"Seman. web"},{"key":"271_CR26","doi-asserted-by":"crossref","unstructured":"Li, F., Jagadish, H.V.: NaLIR: an interactive natural language interface for querying relational databases. In: Proceedings of the 2014 ACM SIGMOD International Conference on Management of data, pp. 709\u2013712 (2014)","DOI":"10.1145\/2588555.2594519"},{"key":"271_CR27","unstructured":"Murayama, Y., Kobayashi, I., Morita, T., Nakano, Y.I., Yamaguchi, T.: Development of an access method to menu ontology data through converting natural language into sparql queries. In: JIST (Workshops & Posters), pp. 13\u201320 (2018)"},{"key":"271_CR28","first-page":"10024","volume":"5","author":"P Ochieng","year":"2020","unstructured":"Ochieng, P.: Parot: Translating natural language to sparql. Expert Syst. Appl. X 5, 10024 (2020)","journal-title":"Expert Syst. Appl. X"},{"key":"271_CR29","doi-asserted-by":"publisher","first-page":"347","DOI":"10.14445\/22315381\/IJETT-V41P263","volume":"41","author":"S Shaik","year":"2016","unstructured":"Shaik, S., Kanakam, P., Hussain, S.M., Suryanarayana, D.: Transforming natural language query to sparql for semantic information retrieval. Int. J. Eng. Trends Technol. 41, 347\u2013350 (2016)","journal-title":"Int. J. Eng. Trends Technol."},{"key":"271_CR30","doi-asserted-by":"crossref","unstructured":"Sun, C., Qiu, X., Xu, Y., Huang, X.: How to fine-tune bert for text classification? (2019)","DOI":"10.1007\/978-3-030-32381-3_16"},{"key":"271_CR31","doi-asserted-by":"crossref","unstructured":"Tatu, M., Balakrishna, M., Werner, S., Erekhinskaya, T., Moldovan, D.: Automatic extraction of actionable knowledge. In: 2016 IEEE Tenth International Conference on Semantic Computing (ICSC), pp. 396\u2013399 (2016)","DOI":"10.1109\/ICSC.2016.29"},{"key":"271_CR32","doi-asserted-by":"publisher","DOI":"10.1561\/9781601983077","volume-title":"From Keyword Search to Exploration: Designing Future Search Interfaces for the Web","author":"ML Wilson","year":"2010","unstructured":"Wilson, M.L., Kules, B., Schraefel, M., Shneiderman, B.: From Keyword Search to Exploration: Designing Future Search Interfaces for the Web, vol. 1. Now Publishers Inc, New York (2010)"},{"key":"271_CR33","unstructured":"Xu, X., Liu, C., Song, D.: Sqlnet: Generating structured queries from natural language without reinforcement learning. arXiv:1711.04436 (2017)"},{"issue":"OOPSLA","key":"271_CR34","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3133887","volume":"1","author":"N Yaghmazadeh","year":"2017","unstructured":"Yaghmazadeh, N., Wang, Y., Dillig, I., Dillig, T.: Sqlizer: query synthesis from natural language. Proc. ACM Program. Lang. 1(OOPSLA), 1\u201326 (2017)","journal-title":"Proc. ACM Program. Lang."}],"container-title":["Progress in Artificial Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s13748-021-00271-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s13748-021-00271-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s13748-021-00271-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,14]],"date-time":"2024-09-14T07:24:39Z","timestamp":1726298679000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s13748-021-00271-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,11]]},"references-count":34,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,9]]}},"alternative-id":["271"],"URL":"https:\/\/doi.org\/10.1007\/s13748-021-00271-1","relation":{},"ISSN":["2192-6352","2192-6360"],"issn-type":[{"value":"2192-6352","type":"print"},{"value":"2192-6360","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,11]]},"assertion":[{"value":"16 April 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 November 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 December 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"The code used for the approach discussed in this study is available from the corresponding author on reasonable request","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Availability of code"}}]}}