{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T00:08:37Z","timestamp":1775088517068,"version":"3.50.1"},"reference-count":69,"publisher":"Cambridge University Press (CUP)","issue":"4","license":[{"start":{"date-parts":[[2021,6,17]],"date-time":"2021-06-17T00:00:00Z","timestamp":1623888000000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"content-domain":{"domain":["cambridge.org"],"crossmark-restriction":true},"short-container-title":["Nat. Lang. Eng."],"published-print":{"date-parts":[[2022,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Automatic question generation is one of the most challenging tasks of Natural Language Processing. It requires \u201cbidirectional\u201d language processing: first, the system has to understand the input text (Natural Language Understanding), and it then has to generate questions also in the form of text (Natural Language Generation). In this article, we introduce our framework for generating the factual questions from unstructured text in the English language. It uses a combination of traditional linguistic approaches based on sentence patterns with several machine learning methods. We first obtain lexical, syntactic and semantic information from an input text, and we then construct a hierarchical set of patterns for each sentence. The set of features is extracted from the patterns, and it is then used for automated learning of new transformation rules. Our learning process is totally data-driven because the transformation rules are obtained from a set of initial sentence\u2013question pairs. The advantages of this approach lie in a simple expansion of new transformation rules which allows us to generate various types of questions and also in the continuous improvement of the system by reinforcement learning. The framework also includes a question evaluation module which estimates the quality of generated questions. It serves as a filter for selecting the best questions and eliminating incorrect ones or duplicates. We have performed several experiments to evaluate the correctness of generated questions, and we have also compared our system with several state-of-the-art systems. Our results indicate that the quality of generated questions outperforms the state-of-the-art systems and our questions are also comparable to questions created by humans. We have also created and published an interface with all created data sets and evaluated questions, so it is possible to follow up on our work.<\/jats:p>","DOI":"10.1017\/s1351324921000139","type":"journal-article","created":{"date-parts":[[2021,6,17]],"date-time":"2021-06-17T12:57:05Z","timestamp":1623934625000},"page":"487-517","update-policy":"https:\/\/doi.org\/10.1017\/policypage","source":"Crossref","is-referenced-by-count":28,"title":["Automatic question generation based on sentence structure analysis using machine learning approach"],"prefix":"10.1017","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8437-8769","authenticated-orcid":false,"given":"Miroslav","family":"Bl\u0161t\u00e1k","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Viera","family":"Rozinajov\u00e1","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"56","published-online":{"date-parts":[[2021,6,17]]},"reference":[{"key":"S1351324921000139_ref52","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2020.113765"},{"key":"S1351324921000139_ref32","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1237"},{"key":"S1351324921000139_ref51","volume-title":"Teaching Reading Comprehension","author":"Pearson","year":"1978"},{"key":"S1351324921000139_ref22","first-page":"521","author":"d\u2019Aquin","year":"2011"},{"key":"S1351324921000139_ref25","first-page":"85","author":"Denkowski","year":"2011"},{"key":"S1351324921000139_ref24","first-page":"60","article-title":"Developing reading comprehension questions","volume":"17","author":"Day","year":"2005","journal-title":"Reading in a Foreign Language"},{"key":"S1351324921000139_ref36","first-page":"154","author":"Kumar","year":"2015"},{"key":"S1351324921000139_ref37","doi-asserted-by":"publisher","DOI":"10.29007\/lfrr"},{"key":"S1351324921000139_ref47","unstructured":"Mostow, J. and Jang, H. (2012). Generating diagnostic multiple choice comprehension cloze questions. In Proceedings of the Seventh Workshop on Building Educational Applications Using NLP, pp. 136\u2013146."},{"key":"S1351324921000139_ref55","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-6640"},{"key":"S1351324921000139_ref16","first-page":"475","volume-title":"International Conference on Computational Linguistics (COLING)","author":"Chali","year":"2012"},{"key":"S1351324921000139_ref64","unstructured":"Varga, A. and Ha, L.A. (2010). WLV: A question generation system for the QGSTEC 2010 task B. In Proceedings of QG2010: The Third Workshop on Question Generation, pp. 80\u201383."},{"key":"S1351324921000139_ref65","doi-asserted-by":"publisher","DOI":"10.1145\/3231644.3231654"},{"key":"S1351324921000139_ref57","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1056"},{"key":"S1351324921000139_ref14","doi-asserted-by":"publisher","DOI":"10.1177\/1745691610393980"},{"key":"S1351324921000139_ref33","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-6623"},{"key":"S1351324921000139_ref46","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324906004177"},{"key":"S1351324921000139_ref23","doi-asserted-by":"publisher","DOI":"10.1109\/ICACCI.2016.7732102"},{"key":"S1351324921000139_ref58","unstructured":"Skalban, Y. (2013). Automatic Generation of Factual Questions from Video Documentaries. PhD Thesis, University of Wolverhampton, UK."},{"key":"S1351324921000139_ref6","volume-title":"A Taxonomy for Learning, Teaching and Assessing: A Revision of Bloom\u2019s Taxonomy of Educational Outcomes: Complete Edition","author":"Anderson","year":"2001"},{"key":"S1351324921000139_ref21","doi-asserted-by":"publisher","DOI":"10.5087\/dad.2012.207"},{"key":"S1351324921000139_ref66","doi-asserted-by":"publisher","DOI":"10.5087\/dad.2012.202"},{"key":"S1351324921000139_ref5","unstructured":"Ali, H. , Chali, Y. and Hasan, S. (2010). Automation of question generation from sentences. In Proceedings of QG2010: The Third Workshop on Question Generation, pp. 58\u201367."},{"key":"S1351324921000139_ref54","first-page":"376","article-title":"Generating natural language question-answer pairs from a knowledge graph using a RNN based question generation model","volume":"1","author":"Reddy","year":"2017","journal-title":"Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics"},{"key":"S1351324921000139_ref35","first-page":"111","author":"Karamanis","year":"2006"},{"key":"S1351324921000139_ref60","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-2090"},{"key":"S1351324921000139_ref39","doi-asserted-by":"crossref","unstructured":"Lee, J. , Kim, G. , Yoo, J. , Jung, C. , Kim, M. and Yoon, S. (2016). Training IBM Watson using automatically generated question-answer pairs. arXiv preprint .","DOI":"10.24251\/HICSS.2017.203"},{"key":"S1351324921000139_ref2","unstructured":"Agarwal, M. and Mannem, P. (2011). Automatic gap-fill question generation from text books. In Proceedings of the 6th Workshop on Innovative Use of NLP for Building Educational Applications. Association for Computational Linguistics, pp. 56\u201364."},{"key":"S1351324921000139_ref68","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-2603"},{"key":"S1351324921000139_ref40","first-page":"74","volume-title":"Proceedings of the ACL 2004 Workshop on Text Summarization Branches Out","author":"Lin","year":"2004"},{"key":"S1351324921000139_ref9","unstructured":"Bloom, B.S. (1956). Taxonomy of Educational Objectives: The Classification of Educational Goals. Cognitive Domain."},{"key":"S1351324921000139_ref31","unstructured":"Heilman, M. and Smith, N.A. (2010). Extracting simplified statements for factual question generation. In Proceedings of Workshop on Question Generation."},{"key":"S1351324921000139_ref7","doi-asserted-by":"publisher","DOI":"10.24081\/nijesr.2016.1.0010"},{"key":"S1351324921000139_ref42","first-page":"5","volume-title":"Proceedings of the 17th International Conference on Computers in Education","author":"Lin","year":"2009"},{"key":"S1351324921000139_ref13","doi-asserted-by":"publisher","DOI":"10.3115\/1220575.1220678"},{"key":"S1351324921000139_ref19","first-page":"1","author":"Chen","year":"2006"},{"key":"S1351324921000139_ref15","doi-asserted-by":"publisher","DOI":"10.1515\/jaiscr-2017-0004"},{"key":"S1351324921000139_ref12","doi-asserted-by":"publisher","DOI":"10.1109\/DISA.2018.8490637"},{"key":"S1351324921000139_ref10","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-45510-5_26"},{"key":"S1351324921000139_ref28","doi-asserted-by":"publisher","DOI":"10.1613\/jair.5477"},{"key":"S1351324921000139_ref62","doi-asserted-by":"publisher","DOI":"10.5220\/0005437200770087"},{"key":"S1351324921000139_ref18","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-6518"},{"key":"S1351324921000139_ref63","unstructured":"Tang, D. , Duan, N. , Qin, T. , Zhao, Y. and Zhou, M. (2017). Question Answering and Question Generation as Dual Tasks. arXiv preprint ."},{"key":"S1351324921000139_ref53","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D16-1264"},{"key":"S1351324921000139_ref59","unstructured":"Song, L. and Zhao, L. (2016). Question Generation from a Knowledge Base with Web Exploration. arXiv preprint ."},{"key":"S1351324921000139_ref17","doi-asserted-by":"publisher","DOI":"10.1162\/COLI_a_00206"},{"key":"S1351324921000139_ref4","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-6537"},{"key":"S1351324921000139_ref44","unstructured":"Mannem, P. , Prasad, R. and Joshi, A. (2010). Question generation from paragraphs at UPenn: QGSTEC system description. In Proceedings of QG2010: The Third Workshop on Question Generation, pp. 84\u201391."},{"key":"S1351324921000139_ref34","unstructured":"Kalady, S. , Elikkottil, A. and Das, R. (2010). Natural language question generation using syntax and keywords. In Proceedings of QG2010: The Third Workshop on Question Generation, pp. 1\u201310."},{"key":"S1351324921000139_ref38","unstructured":"Kunichika, H. , Katayama, T. , Hirashima, T. and Takeuchi, A. (2011). Automated question generation methods for intelligent English learning systems and its evaluation. In Proceedings of the International Conference on Computers in Education, pp. 1117\u20131124."},{"key":"S1351324921000139_ref30","first-page":"167","volume-title":"Questions and Information Systems","author":"Graesser","year":"1992"},{"key":"S1351324921000139_ref27","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1123"},{"key":"S1351324921000139_ref11","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-64206-2_12"},{"key":"S1351324921000139_ref26","doi-asserted-by":"publisher","DOI":"10.18520\/cs\/v113\/i09\/1683-1691"},{"key":"S1351324921000139_ref43","unstructured":"Lindberg, D. , Popowich, F. , Nesbit, J. and Winne, P. (2013). Generating natural language questions to support learning on-line. In Proceedings of the 14th European Workshop on Natural Language Generation, pp. 105\u2013114."},{"key":"S1351324921000139_ref48","doi-asserted-by":"publisher","DOI":"10.5087\/dad.2012.204"},{"key":"S1351324921000139_ref3","unstructured":"Agarwal, M. , Shah, R. and Mannem, P. (2011). Automatic question generation using discourse cues. In Proceedings of the 6th Workshop on Innovative Use of NLP for Building Educational Applications. Association for Computational Linguistics, pp. 1\u20139."},{"key":"S1351324921000139_ref29","first-page":"188","author":"Gawriljuk","year":"2016"},{"key":"S1351324921000139_ref41","unstructured":"Lin, Y.C. , Sung, L.C. and Chen, M.C. (2007). An automatic multiple-choice question generation scheme for English adjective understanding. In Proceedings of the 15th International Conference on Computers in Education, pp. 137\u2013142."},{"key":"S1351324921000139_ref50","first-page":"311","author":"Papineni","year":"2002"},{"key":"S1351324921000139_ref8","first-page":"742","volume-title":"Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Becker","year":"2012"},{"key":"S1351324921000139_ref49","unstructured":"Pal, S. , Mondal, T. , Pakray, P. , Das, D. and Bandyopadhyay, S. 2010. QGSTEC system description: JUQGG: A rule based approach. In Proceedings of QG2010: The Third Workshop on Question Generation, pp. 76\u201379."},{"key":"S1351324921000139_ref67","unstructured":"Yao, X. and Zhang, Y. (2010). Question generation with minimal recursion semantics. In Proceedings of QG2010: The Third Workshop on Question Generation, pp. 68\u201375."},{"key":"S1351324921000139_ref56","doi-asserted-by":"publisher","DOI":"10.5087\/dad.2012.208"},{"key":"S1351324921000139_ref20","doi-asserted-by":"crossref","unstructured":"Chen, G. , Yang, J. , Hauff, C. and Houben, G.J. (2018). LearningQ: A large-scale dataset for educational question generation. In International AAAI Conference on Web and Social Media.","DOI":"10.1609\/icwsm.v12i1.14987"},{"key":"S1351324921000139_ref61","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1427"},{"key":"S1351324921000139_ref1","doi-asserted-by":"publisher","DOI":"10.1007\/s00500-013-1141-4"},{"key":"S1351324921000139_ref69","first-page":"662","volume-title":"National CCF Conference on Natural Language Processing and Chinese Computing","author":"Zhou","year":"2018"},{"key":"S1351324921000139_ref45","unstructured":"Mazidi, K. and Tarau, P. (2010). Infusing NLU into automatic question generation. In Proceedings of the 9th International Natural Language Generation Conference, pp. 51\u201360."}],"container-title":["Natural Language Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S1351324921000139","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,31]],"date-time":"2022-12-31T13:52:15Z","timestamp":1672494735000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S1351324921000139\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,17]]},"references-count":69,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,7]]}},"alternative-id":["S1351324921000139"],"URL":"https:\/\/doi.org\/10.1017\/s1351324921000139","relation":{},"ISSN":["1351-3249","1469-8110"],"issn-type":[{"value":"1351-3249","type":"print"},{"value":"1469-8110","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,17]]},"assertion":[{"value":"\u00a9 The Author(s), 2021. Published by Cambridge University Press","name":"copyright","label":"Copyright","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}}]}}