{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T22:28:30Z","timestamp":1777415310292,"version":"3.51.4"},"reference-count":30,"publisher":"Institute of Electronics, Information and Communications Engineers (IEICE)","issue":"7","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IEICE Trans. Inf. &amp; Syst."],"published-print":{"date-parts":[[2019,7,1]]},"DOI":"10.1587\/transinf.2018edp7199","type":"journal-article","created":{"date-parts":[[2019,6,30]],"date-time":"2019-06-30T22:11:04Z","timestamp":1561932664000},"page":"1362-1373","source":"Crossref","is-referenced-by-count":13,"title":["Rule-Based Automatic Question Generation Using Semantic Role Labeling"],"prefix":"10.1587","volume":"E102.D","author":[{"given":"Onur","family":"KEKLIK","sequence":"first","affiliation":[{"name":"Department of Computer Engineering, Izmir Institute of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tugkan","family":"TUGLULAR","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Izmir Institute of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Selma","family":"TEKIR","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Izmir Institute of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"532","reference":[{"key":"1","doi-asserted-by":"crossref","unstructured":"[1] D.J. Hacker, J. Dunlosky, and A.C. Graesser, \u201cMetacognition in educational theory and practice,\u201d Routledge, 1998. 10.4324\/9781410602350","DOI":"10.4324\/9781410602350"},{"key":"2","unstructured":"[2] IBM, IBM Watson Ecosystem-Getting Started Guide, 2014."},{"key":"3","unstructured":"[3] V. Rus and C.G. Arthur, The question generation shared task and evaluation challenge workshop report, The University of Memphis, National Science Foundation, Citeseer, 2009."},{"key":"4","doi-asserted-by":"crossref","unstructured":"[4] K. Mazidi and P. Tarau, \u201cInfusing nlu into automatic question generation,\u201d Proceedings of the 9th International Natural Language Generation conference, pp.51-60, 2016. 10.18653\/v1\/w16-6609","DOI":"10.18653\/v1\/W16-6609"},{"key":"5","unstructured":"[5] M. Lapata and C. Brew, \u201cUsing subcategorization to resolve verb class ambiguity,\u201d Proceedings of the Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora, 1999."},{"key":"6","doi-asserted-by":"crossref","unstructured":"[6] X. Du, J. Shao, and C. Cardie, \u201cLearning to ask: Neural question generation for reading comprehension,\u201d Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, pp.1342-1352, 2017. 10.18653\/v1\/p17-1123","DOI":"10.18653\/v1\/P17-1123"},{"key":"7","unstructured":"[7] M. Heilman and N.A. Smith, \u201cRating computer-generated questions with mechanical turk,\u201d Proceedings of the NAACL HLT 2010 workshop on creating speech and language data with Amazon&apos;s mechanical turk, pp.35-40, Association for Computational Linguistics, 2010."},{"key":"8","unstructured":"[8] M. Heilman, Automatic Factual Question Generation from Text, PhD Thesis, Carnegie Mellon University, 2011."},{"key":"9","doi-asserted-by":"crossref","unstructured":"[9] I. Labutov, S. Basu, and L. Vanderwende, \u201cDeep questions without deep understanding,\u201d Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), vol.1, pp.889-898, 2015. 10.3115\/v1\/p15-1086","DOI":"10.3115\/v1\/P15-1086"},{"key":"10","unstructured":"[10] V. Rus, B. Wyse, P. Piwek, M. Lintean, S. Stoyanchev, and C. Moldovan, \u201cThe first question generation shared task evaluation challenge,\u201d Proceedings of the 6th International Natural Language Generation Conference, pp.251-257, Association for Computational Linguistics, 2010."},{"key":"11","doi-asserted-by":"crossref","unstructured":"[11] V. Rus, B. Wyse, P. Piwek, M. Lintean, S. Stoyanchev, and C. Moldovan, \u201cA detailed account of the first question generation shared task evaluation challenge,\u201d Dialogue &amp; Discourse, vol.3, no.2, pp.177-204, 2012.","DOI":"10.5087\/dad.2012.208"},{"key":"12","doi-asserted-by":"crossref","unstructured":"[12] K. Papineni, S. Roukos, T. Ward, and W.-J. Zhu, \u201cBleu: a method for automatic evaluation of machine translation,\u201d Proceedings of the 40th annual meeting on association for computational linguistics, pp.311-318, Association for Computational Linguistics, 2002. 10.3115\/1073083.1073135","DOI":"10.3115\/1073083.1073135"},{"key":"13","doi-asserted-by":"crossref","unstructured":"[13] G. Doddington, \u201cAutomatic evaluation of machine translation quality using n-gram co-occurrence statistics,\u201d Proceedings of the second international conference on Human Language Technology Research, pp.138-145, Morgan Kaufmann Publishers Inc., 2002. 10.3115\/1289189.1289273","DOI":"10.3115\/1289189.1289273"},{"key":"14","doi-asserted-by":"publisher","unstructured":"[14] A. Lavie and M.J. Denkowski, \u201cThe meteor metric for automatic evaluation of machine translation,\u201d Machine translation, vol.23, no.2-3, pp.105-115, 2009. 10.1007\/s10590-009-9059-4","DOI":"10.1007\/s10590-009-9059-4"},{"key":"15","unstructured":"[15] C.-Y. Lin, Rouge: A package for automatic evaluation of summaries, Text Summarization Branches Out, 2004."},{"key":"16","unstructured":"[16] X. Chen, H. Fang, T.-Y. Lin, R. Vedantam, S. Gupta, P. Doll\u00e1r, and C.L. Zitnick, \u201cMicrosoft coco captions: Data collection and evaluation server,\u201d arXiv preprint arXiv:1504.00325, 2015."},{"key":"17","unstructured":"[17] M. Richardson, C.J.C. Burges, and E. Renshaw, \u201cMctest: A challenge dataset for the open-domain machine comprehension of text,\u201d Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pp.193-203, 2013."},{"key":"18","doi-asserted-by":"crossref","unstructured":"[18] A.M. Rush, S. Chopra, and J. Weston, \u201cA neural attention model for abstractive sentence summarization,\u201d Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pp.379-389, 2015. 10.18653\/v1\/d15-1044","DOI":"10.18653\/v1\/D15-1044"},{"key":"19","unstructured":"[19] K.M. Hermann, T. Kocisky, E. Grefenstette, L. Espeholt, W. Kay, M. Suleyman, and P. Blunsom, \u201cTeaching machines to read and comprehend,\u201d Advances in Neural Information Processing Systems, pp.1693-1701, 2015."},{"key":"20","doi-asserted-by":"crossref","unstructured":"[20] D. Chen, J. Bolton, and C.D. Manning, \u201cA thorough examination of the cnn\/daily mail reading comprehension task,\u201d Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, pp.2358-2367, 2016. 10.18653\/v1\/p16-1223","DOI":"10.18653\/v1\/P16-1223"},{"key":"21","doi-asserted-by":"crossref","unstructured":"[21] P. Rajpurkar, J. Zhang, K. Lopyrev, and P. Liang, \u201cSquad: 100,000+ questions for machine comprehension of text,\u201d Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp.2383-2392, 2016. 10.18653\/v1\/d16-1264","DOI":"10.18653\/v1\/D16-1264"},{"key":"22","unstructured":"[22] R. Collobert, J. Weston, L. Bottou, M. Karlen, K. Kavukcuoglu, and P. Kuksa, \u201cNatural language processing (almost) from scratch,\u201d Journal of Machine Learning Research, vol.12, pp.2493-2537, Aug. 2011."},{"key":"23","doi-asserted-by":"crossref","unstructured":"[23] M.P. Marcus, M.A. Marcinkiewicz, and B. Santorini, \u201cBuilding a large annotated corpus of english: The penn treebank,\u201d Computational linguistics, vol.19, no.2, pp.313-330, 1993. 10.21236\/ada273556","DOI":"10.21236\/ADA273556"},{"key":"24","doi-asserted-by":"publisher","unstructured":"[24] M. Palmer, D. Gildea, and P. Kingsbury, \u201cThe proposition bank: An annotated corpus of semantic roles,\u201d Computational linguistics, vol.31, no.1, pp.71-106, 2005. 10.1162\/0891201053630264","DOI":"10.1162\/0891201053630264"},{"key":"25","unstructured":"[25] O. Babko-Malaya, Propbank annotation guidelines, URL: http:\/\/verbs.colorado.edu, 2005."},{"key":"26","unstructured":"[26] M. Gardner, J. Grus, M. Neumann, O. Tafjord, P. Dasigi, N. Liu, M. Peters, M. Schmitz, and L. Zettlemoyer, Allennlp: A deep semantic natural language processing platform."},{"key":"27","unstructured":"[27] T.D. Smedt and W. Daelemans, \u201cPattern for python,\u201d Journal of Machine Learning Research, vol.13, pp.2063-2067, June 2012."},{"key":"28","unstructured":"[28] S. Banerjee and A. Lavie, \u201cMeteor: An automatic metric for MT evaluation with improved correlation with human judgments,\u201d Proceedings of the ACL workshop on intrinsic and extrinsic evaluation measures for machine translation and\/or summarization, pp.65-72, 2005."},{"key":"29","doi-asserted-by":"crossref","unstructured":"[29] A. Stent, M. Marge, and M. Singhai, \u201cEvaluating Evaluation Methods for Generation in the Presence of Variation,\u201d Proceedings of the 6th International Conference on Computational Linguistics and Intelligent Text Processing, vol.3406, pp.341-351, 2005. 10.1007\/978-3-540-30586-6_38","DOI":"10.1007\/978-3-540-30586-6_38"},{"key":"30","unstructured":"[30] P. Nema and M.M. Khapra, \u201cTowards a Better Metric for Evaluating Question Generation Systems,\u201d Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp.3950-3959, 2018."}],"container-title":["IEICE Transactions on Information and Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transinf\/E102.D\/7\/E102.D_2018EDP7199\/_pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,1,8]],"date-time":"2021-01-08T19:06:25Z","timestamp":1610132785000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transinf\/E102.D\/7\/E102.D_2018EDP7199\/_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,1]]},"references-count":30,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2019]]}},"URL":"https:\/\/doi.org\/10.1587\/transinf.2018edp7199","relation":{},"ISSN":["0916-8532","1745-1361"],"issn-type":[{"value":"0916-8532","type":"print"},{"value":"1745-1361","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,7,1]]}}}