{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T06:56:39Z","timestamp":1760597799636},"reference-count":76,"publisher":"Cambridge University Press (CUP)","issue":"5","license":[{"start":{"date-parts":[[2018,4,10]],"date-time":"2018-04-10T00:00:00Z","timestamp":1523318400000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Nat. Lang. Eng."],"published-print":{"date-parts":[[2018,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper describes a question answering framework that can answer student questions given in natural language. We suggest a methodology that makes use of reliable resources only, provides the answer in the form of a multi-document summary for both factoid and open-ended questions, and produces an answer also from foreign resources by translating into the native language. The resources are compiled using a question database in the selected domains based on reliability and coverage metrics. A question is parsed using a dependency parser, important parts are extracted by rule-based and statistical methods, the question is converted into a representation, and a query is built. Documents relevant to the query are retrieved from the set of resources. The documents are summarized and the answers to the question together with other relevant information about the topic of the question are shown to the user. A summary answer from the foreign resources is also built by the translation of the input question and the retrieved documents. The proposed approach was applied to the Turkish language and it was tested with several experiments and a pilot study. The experiments have shown that the summaries returned include the answer for about 50\u201360 percent of the questions. The data bank built for factoid and open-ended questions in the two domains covered is made publicly available.<\/jats:p>","DOI":"10.1017\/s1351324918000141","type":"journal-article","created":{"date-parts":[[2018,4,10]],"date-time":"2018-04-10T05:28:29Z","timestamp":1523338109000},"page":"725-762","source":"Crossref","is-referenced-by-count":7,"title":["A closed-domain question answering framework using reliable resources to assist students"],"prefix":"10.1017","volume":"24","author":[{"given":"CANER","family":"DER\u0130C\u0130","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Y\u0130\u011e\u0130T","family":"AYDIN","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"\u00c7\u0130\u011eDEM","family":"YEN\u0130ALACA","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"N\u0130HAL YA\u011eMUR","family":"AYDIN","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"G\u00dcN\u0130Z\u0130","family":"KARTAL","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"ARZUCAN","family":"\u00d6ZG\u00dcR","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"TUNGA","family":"G\u00dcNG\u00d6R","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"56","published-online":{"date-parts":[[2018,4,10]]},"reference":[{"key":"S1351324918000141_ref016","unstructured":"Derici C. , \u00c7elik K. , \u00d6zg\u00fcr A. , G\u00fcng\u00f6r T. , Kutbay E. , Ayd\u0131n Y. , and Kartal G. 2014. T\u00fcrk\u00e7e soru cevaplama sistemlerinde kural tabanl\u0131odak \u00e7\u0131kar\u0131m\u0131(Rule-based focus extraction in Turkish question answering systems). In Proceedings of Signal Processing and Communications Applications Conference (SIU), pp. 1604\u20137."},{"key":"S1351324918000141_ref009","doi-asserted-by":"crossref","unstructured":"Brill E. , Dumais S. , and Banko M. 2002. An analysis of the AskMSR Question-Answering system. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 257\u201364.","DOI":"10.3115\/1118693.1118726"},{"key":"S1351324918000141_ref075","doi-asserted-by":"crossref","unstructured":"Zheng Z. 2002. AnswerBus question answering system. In Proceedings of the International Conference on Human Language Technology Research (HLT, pp. 399\u2013404.","DOI":"10.3115\/1289189.1289238"},{"key":"S1351324918000141_ref018","doi-asserted-by":"crossref","unstructured":"Dong L. , Wei F. , Zhou M. , and Xu K. 2015. Question answering over Freebase with multi-column convolutional neural networks. In Proceedings of International Joint Conference on Natural Language Processing (IJNLP), pp. 260\u20139.","DOI":"10.3115\/v1\/P15-1026"},{"key":"S1351324918000141_ref073","doi-asserted-by":"crossref","unstructured":"Yih W-T. , He X. , and Meek C. 2014. Semantic parsing for single-relation question answering. In Proceedings of the Annual Meeting of ACL, pp. 643\u20138.","DOI":"10.3115\/v1\/P14-2105"},{"key":"S1351324918000141_ref072","doi-asserted-by":"crossref","unstructured":"Yang Y. , Yih W.-t. , and Meek C. 2015b. WIKIQA: A challenge dataset for open-domain question answering. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 2013\u201318.","DOI":"10.18653\/v1\/D15-1237"},{"key":"S1351324918000141_ref074","unstructured":"Yu L. , Hermann K.M. , Blunsom P. , and Pulman S. 2014. Deep learning for answer sentence selection, In Proceedings of NIPS Deep Learning Workshop."},{"key":"S1351324918000141_ref071","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2015.07.009"},{"key":"S1351324918000141_ref069","unstructured":"Xiong C. , Merity S. , and Socher R. 2016. Dynamic memory networks for visual and textual question answering. In Proceedings of the International Conference on Machine Learning, pp. 2397\u2013406."},{"key":"S1351324918000141_ref043","doi-asserted-by":"publisher","DOI":"10.1075\/nlp.3"},{"key":"S1351324918000141_ref065","doi-asserted-by":"crossref","unstructured":"Wang D. , and Nyberg E. 2015. A long short-term memory model for answer sentence selection in question answering. In Proceedings of ACL-IJCNLP, pp. 707\u201312.","DOI":"10.3115\/v1\/P15-2116"},{"key":"S1351324918000141_ref057","first-page":"353","volume-title":"New Contributions in Information Systems and Technologies - Advances in Intelligent Systems and Computing","author":"Olvera-Lobo","year":"2015"},{"key":"S1351324918000141_ref039","doi-asserted-by":"publisher","DOI":"10.2307\/2529310"},{"key":"S1351324918000141_ref064","doi-asserted-by":"crossref","unstructured":"Wan X. 2009. Topic analysis for topic-focused multi-document summarization. In Proceedings of the ACM Conference on Information and Knowledge Management (CIKM, pp. 1609\u201312.","DOI":"10.1145\/1645953.1646184"},{"key":"S1351324918000141_ref063","first-page":"3158","article-title":"Question answering system: a review on question analysis, document processing, and answer extraction techniques","volume":"95","author":"Utomo","year":"2017","journal-title":"Journal of Theoretical and Applied Information Technology"},{"key":"S1351324918000141_ref076","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2015.05.034"},{"key":"S1351324918000141_ref059","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2016.01.030"},{"key":"S1351324918000141_ref058","doi-asserted-by":"publisher","DOI":"10.1016\/j.inpa.2016.01.002"},{"key":"S1351324918000141_ref036","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2015.09.001"},{"key":"S1351324918000141_ref061","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2014.06.002"},{"key":"S1351324918000141_ref056","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2016.08.030"},{"key":"S1351324918000141_ref054","first-page":"91","article-title":"The Japanese government project for machine translation","volume":"11","author":"Nagao","year":"1988","journal-title":"Computational Linguistics"},{"key":"S1351324918000141_ref022","doi-asserted-by":"crossref","unstructured":"Feng M. , Xiang B. , Glass M.R. , Wang L. , and Zhou B. 2015. Applying deep learning to answer selection: a study and an open task. In Proceedings of Automatic Speech Recognition and Understanding (ASRU), pp. 813\u201320.","DOI":"10.1109\/ASRU.2015.7404872"},{"key":"S1351324918000141_ref053","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2012.2187036"},{"key":"S1351324918000141_ref020","doi-asserted-by":"publisher","DOI":"10.1162\/coli.2008.07-017-R1-06-83"},{"key":"S1351324918000141_ref051","unstructured":"Morita H. , Sakai T. , and Okumura M. 2011. Query snowball: a co-occurrence-based approach to multi-document summarization for question answering. In Proceedings of the Annual Meeting of the ACL, pp. 223\u20139."},{"key":"S1351324918000141_ref001","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2015.04.006"},{"key":"S1351324918000141_ref066","doi-asserted-by":"publisher","DOI":"10.1145\/2362383.2362386"},{"key":"S1351324918000141_ref049","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2015.02.003"},{"key":"S1351324918000141_ref047","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2004.05.001"},{"key":"S1351324918000141_ref015","doi-asserted-by":"crossref","unstructured":"Derici C. , \u00c7elik K. , Kutbay E. , Ayd\u0131n Y. , G\u00fcng\u00f6r T. , \u00d6zg\u00fcr A. , and Kartal G. 2015. Question analysis for a closed domain question answering system. In A. Gelbukh (ed.), Proceedings of Computational Linguistics and Intelligent Text Processing (CicLing), pp. 468\u201382. Springer, Cairo.","DOI":"10.1007\/978-3-319-18117-2_35"},{"key":"S1351324918000141_ref014","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2016.07.002"},{"key":"S1351324918000141_ref048","first-page":"345","article-title":"A survey on question answering systems with classification","volume":"28","author":"Mishra","year":"2016","journal-title":"Journal of King Saud University"},{"key":"S1351324918000141_ref013","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2012.2185901"},{"key":"S1351324918000141_ref035","unstructured":"Katz B. 1997. Annotating the world wide web using natural language. In Proceedings of the Conference on Computer Assisted Information Searching on the Internet (RIAO), pp. 136\u201355."},{"key":"S1351324918000141_ref004","doi-asserted-by":"crossref","unstructured":"Bernhard D. , and Gurevych I. 2009. Combining lexical semantic resources with question & answer archives for translation-based answer finding. In Proceedings of ACL-IJCNLP, pp. 728\u201336.","DOI":"10.3115\/1690219.1690248"},{"key":"S1351324918000141_ref010","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2015.01.002"},{"key":"S1351324918000141_ref037","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2011.07.047"},{"key":"S1351324918000141_ref011","doi-asserted-by":"crossref","unstructured":"Chen Y. , Zhou M. , and Wang S. 2006. Reranking answers for definitional QA using language modeling. In Proceedings of ACL\/COLING, pp. 1081\u20138.","DOI":"10.3115\/1220175.1220311"},{"key":"S1351324918000141_ref068","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2015.12.012"},{"key":"S1351324918000141_ref003","unstructured":"Barzilay R. , and Elhadad M. 1997. Using lexical chains for text summarization. In Proceedings of the ACL Workshop on Intelligent Scalable Text Summarization, pp. 10\u20137."},{"key":"S1351324918000141_ref060","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-010-9128-6"},{"key":"S1351324918000141_ref017","first-page":"1","volume-title":"Knowledge and Information Systems","author":"Diefenbach","year":"2017"},{"key":"S1351324918000141_ref006","doi-asserted-by":"crossref","unstructured":"Bordes A. , Chopra S. , and Weston J. 2014. Question answering with subgraph embeddings. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 615\u201320.","DOI":"10.3115\/v1\/D14-1067"},{"key":"S1351324918000141_ref007","doi-asserted-by":"crossref","unstructured":"Bordes A. , Weston J. , and Usunier N. 2014. Open question answering with weakly supervised embedding models. In Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases (ECML-PKDD), Springer-Verlag, pp. 165\u201380.","DOI":"10.1007\/978-3-662-44848-9_11"},{"key":"S1351324918000141_ref008","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2015.12.005"},{"key":"S1351324918000141_ref052","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2012.2187249"},{"key":"S1351324918000141_ref019","unstructured":"Er N.P. , and \u00c7i\u00e7ekli I. 2013. A factoid question answering system using answer pattern matching. In Proceedings of International Joint Conference on Natural Language Processing (IJNLP), pp. 854\u20138."},{"key":"S1351324918000141_ref021","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2012.2186519"},{"key":"S1351324918000141_ref044","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2015.11.005"},{"key":"S1351324918000141_ref024","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2013.04.023"},{"key":"S1351324918000141_ref027","unstructured":"Ganesan K. , Zhai C.X. , and Han J. 2010. Opinosis: a graph-based approach to abstractive summarization of highly redundant opinions. In Proceedings of International Conference on Computational Linguistics (COLING), pp. 340\u20138."},{"key":"S1351324918000141_ref067","doi-asserted-by":"publisher","DOI":"10.1016\/j.csl.2014.06.001"},{"key":"S1351324918000141_ref023","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2014.03.023"},{"key":"S1351324918000141_ref034","unstructured":"\u0130lhan S. , Duru N. , Karag\u00f6z \u015e. , and Sa\u011f\u0131r M. 2008. Metin madencili\u011fi ile soru cevaplama sistemi (A question answering system based on text mining). In Proceedings of Elektrik-Elektronik ve Biyomedikal M\u00fchendisli\u011fi Konferans\u0131(ELECO) (Conference on Electrical-Electronics and Biomedical Engineering), pp. 356\u20139."},{"key":"S1351324918000141_ref029","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2012.2188760"},{"key":"S1351324918000141_ref031","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2016.02.032"},{"key":"S1351324918000141_ref032","first-page":"1","article-title":"Survey on challenges of question answering in the semantic web","volume":"8","author":"H\u00f6ffner","year":"2016","journal-title":"Semantic Web"},{"key":"S1351324918000141_ref005","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2012.06.015"},{"key":"S1351324918000141_ref045","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2012.2185409"},{"key":"S1351324918000141_ref033","doi-asserted-by":"crossref","unstructured":"Iyyer M. , Boyd-Graber J. , Claudino L. , Socher R. , and Daume H. 2014. A neural network for factoid question answering over paragraphs. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 633\u201344.","DOI":"10.3115\/v1\/D14-1070"},{"key":"S1351324918000141_ref025","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2012.2184356"},{"key":"S1351324918000141_ref040","unstructured":"Li J. , Sun L. , Kit C. , and Webster J. 2007. A query-focused multi-document summarizer based on lexical chains. In Proceedings of the Document Understanding Conference (DUC)."},{"key":"S1351324918000141_ref026","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2016.01.008"},{"key":"S1351324918000141_ref038","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2012.2184637"},{"key":"S1351324918000141_ref012","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2012.2186682"},{"key":"S1351324918000141_ref042","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-011-9216-z"},{"key":"S1351324918000141_ref062","doi-asserted-by":"publisher","DOI":"10.1162\/089120102762671954"},{"key":"S1351324918000141_ref050","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2015.04.005"},{"key":"S1351324918000141_ref028","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2014.04.004"},{"key":"S1351324918000141_ref041","unstructured":"Lin C.-Y. 2004. ROUGE: a package for automatic evaluation of summaries. In Proceedings of Workshop on Text Summarization Branches Out (WAS), pp. 74\u201381."},{"key":"S1351324918000141_ref002","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2012.09.014"},{"key":"S1351324918000141_ref070","doi-asserted-by":"crossref","unstructured":"Yang L. , Ai Q. , Spina D. , Chen R-C. , Pang L. , Croft W.B. , Guo J. , and Scholer F. 2016. Beyond factoid QA: effective methods for non-factoid answer sentence retrieval. In Proceedings of the European Conference on Information Retrieval (ECIR, pp. 115\u201328.","DOI":"10.1007\/978-3-319-30671-1_9"},{"key":"S1351324918000141_ref055","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-3223-4_3"},{"key":"S1351324918000141_ref030","doi-asserted-by":"publisher","DOI":"10.1016\/j.datak.2016.06.003"},{"key":"S1351324918000141_ref046","doi-asserted-by":"crossref","unstructured":"Medelyan O. 2007. Computing lexical chains with graph clustering. In Proceedings of the Annual Meeting of the ACL: Student Research Workshop, pp. 85\u201390.","DOI":"10.3115\/1557835.1557854"}],"container-title":["Natural Language Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S1351324918000141","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,10,14]],"date-time":"2019-10-14T21:00:02Z","timestamp":1571086802000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S1351324918000141\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,4,10]]},"references-count":76,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2018,9]]}},"alternative-id":["S1351324918000141"],"URL":"https:\/\/doi.org\/10.1017\/s1351324918000141","relation":{},"ISSN":["1351-3249","1469-8110"],"issn-type":[{"value":"1351-3249","type":"print"},{"value":"1469-8110","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,4,10]]}}}