{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,6,29]],"date-time":"2024-06-29T05:54:37Z","timestamp":1719640477132},"reference-count":33,"publisher":"IGI Global","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2017,7]]},"abstract":"<jats:p>Automated evaluation systems for objective type tests already exist. However, it is challenging to make an automated evaluation system for subjective type tests. Therefore, focus of this paper is on evaluation of simple text based subjective answers using Natural Language Processing techniques. A student's answer is evaluated by comparing it with a model answer of the question. Model answers cannot exactly match with the students' answers due to variability in writing. Therefore, researchers create conceptual graphs for both student as well as model answer and compute similarity between these graphs using techniques of graph similarity measures. Based on the similarity, marks are assigned to an answer. Lastly, in this manuscript authors compare the results obtained by human graders and the proposed system using Pearson correlation coefficient. Also, comparison has been drawn between the results of proposed system with other existing evaluation systems. The experimental evaluation of the proposed system shows promising results.<\/jats:p>","DOI":"10.4018\/ijcssa.2017070101","type":"journal-article","created":{"date-parts":[[2017,9,13]],"date-time":"2017-09-13T01:09:23Z","timestamp":1505264963000},"page":"1-21","source":"Crossref","is-referenced-by-count":3,"title":["Conceptual Graphs Based Approach for Subjective Answers Evaluation"],"prefix":"10.4018","volume":"5","author":[{"given":"Goonjan","family":"Jain","sequence":"first","affiliation":[{"name":"Jawaharlal Nehru University, New Dehli, India"}]},{"given":"D.K.","family":"Lobiyal","sequence":"additional","affiliation":[{"name":"Jawaharlal Nehru University, New Dehli, India"}]}],"member":"2432","reference":[{"issue":"10","key":"IJCSSA.2017070101-0","article-title":"An expert system for automated essay scoring (aes) in computing using shallow nlp techniques for inferencing.","volume":"51","author":"A. O.Ade-Ibijola","year":"2012","journal-title":"International Journal of Computers and Applications"},{"key":"IJCSSA.2017070101-1","unstructured":"Chakraborty P. (2012). Developing an intelligent tutoring system for assessing students\u2019 cognition and evaluating descriptive type answers. International Journal of Modern Engineering Research, 2(3), 985-990."},{"key":"IJCSSA.2017070101-2","first-page":"224","article-title":"Deep Learning for Efficient Discriminative Parsing.","author":"R.Collobert","year":"2011).","journal-title":"Proceedings Of International Conference on Artificial Intelligence and Statistics (AISTATS)"},{"key":"IJCSSA.2017070101-3","unstructured":"Collobert R., Weston J., Bottou L., Karlen M., Kavukcuoglu K. and Kuksa P. Natural Language Processing (Almost) from Scratch. Journal of Machine Learning Research, 12(1), 2493-2537."},{"key":"IJCSSA.2017070101-4","doi-asserted-by":"publisher","DOI":"10.1109\/T4E.2011.21"},{"key":"IJCSSA.2017070101-5","first-page":"47","article-title":"Assessment of Answers: Online Subjective Examination.","author":"A.Dhokrat","year":"2012).","journal-title":"Proceeding Workshop on Question Answering for Complex Domains COLING 2012"},{"key":"IJCSSA.2017070101-6","doi-asserted-by":"publisher","DOI":"10.2307\/1932409"},{"key":"IJCSSA.2017070101-7","first-page":"13","article-title":"Beetle II: a system for tutoring and computational linguistics experimentation.","author":"M. O.Dzikovska","year":"2010","journal-title":"Proceedings of ACL 2010 System Demonstrations"},{"key":"IJCSSA.2017070101-8","unstructured":"Dzikovska, M. O., Nielsen, R. D., & Brew, C. (2012). Towards effective tutorial feedback for explanation questions: A dataset and baselines. In Proceedings of 2012 Conference of NAACL: Human Language Technologies (pp. 200\u2013210)."},{"key":"IJCSSA.2017070101-9","unstructured":"Dzikovska, M. O., Nielsen, R. D., Brew, C., Leacock, C., Giampiccolo, D., Bentivogli, L., . . . Dagan, I. (2013). SemEval-2013 Task7: The Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge. In Proceedings of the Second Joint Conference on Lexical and Computational Semantics (*SEM) (pp. 263\u2013274)."},{"key":"IJCSSA.2017070101-10","unstructured":"Foltz P. W., Laham D., Landauer T. K. (1999, April). The Intelligent Essay Assessor: Applications to Educational Technology. Interactive Multimedia Electronic Journal of Computer-Enhanced Learning."},{"key":"IJCSSA.2017070101-11","doi-asserted-by":"publisher","DOI":"10.3115\/1614038.1614047"},{"key":"IJCSSA.2017070101-12","first-page":"81","article-title":"Constructing Conceptual Graphs using Linguistic Resources.","author":"S.Hensman","year":"2004).","journal-title":"Proceedings 7th International Conference, TSD 2004"},{"key":"IJCSSA.2017070101-13","doi-asserted-by":"publisher","DOI":"10.1109\/DEXA.2004.1333440"},{"issue":"3","key":"IJCSSA.2017070101-14","first-page":"1","article-title":"Superlative model using word cloud for short answers evaluation in eLearning.","volume":"21","author":"S.Jayshankar","year":"2016","journal-title":"Education and Information Technologies"},{"key":"IJCSSA.2017070101-15","author":"F.John","year":"1999","journal-title":"Sowa, Knowledge Representation: Logical, Philosophical, and Computational Foundations"},{"key":"IJCSSA.2017070101-16","unstructured":"Kaiche, B., Kalan, S., More, S., & Shelukar, L. (2014). Online descriptive examination and assessment system. International Journal of Emerging Technology and Advanced Engineering, 4(3), 660-664."},{"key":"IJCSSA.2017070101-17","unstructured":"Kaur A., Sasikumar M., Nema S, Pawar S. (2013). Algorithm for Automatic evaluation of single sentence descriptive answer. International Journal of Inventive Engineering and Science, 1(9), 112-121."},{"key":"IJCSSA.2017070101-18","doi-asserted-by":"publisher","DOI":"10.1145\/290941.290965"},{"key":"IJCSSA.2017070101-19","doi-asserted-by":"crossref","unstructured":"Leacock C., Chodorow M. (2003). C-rater: automated scoring of short-answer questions. Computer and the Humanities, 37(4), 389-405.","DOI":"10.1023\/A:1025779619903"},{"key":"IJCSSA.2017070101-20","unstructured":"Mitchell, T., Russell, T., Broomhead, P., & Aldridge, N. Towards robust computerized marking of free text responses. In Proceedings of 6th computer Assisted Assessment Conference,2002."},{"key":"IJCSSA.2017070101-21","first-page":"102","article-title":"Flexible Comparison of Conceptual Graphs.","author":"M.Montes-y-G\u00f3mez","year":"2001","journal-title":"Proceedings of 12th International Conference, DEXA 2001"},{"key":"IJCSSA.2017070101-22","doi-asserted-by":"crossref","unstructured":"Montes-y-G\u00f3mez, M., L\u00f3pez-L\u00f3pez, A., & Gelbukh, A. (2000). Information Retrieval using Conceptual Graph Matching. In Proceedings of DEXA-2000,11th conference on Database and Expert Systems Applications, Greenwich, England (pp. 312-321).","DOI":"10.1007\/3-540-44469-6_29"},{"key":"IJCSSA.2017070101-23","unstructured":"Nielsen, R. D., Ward, W., Martin, J. H., & Palmer, M. (2008). Annotating students\u2019 understanding of science concepts. In Proceedings of the Sixth International Language Resources and Evaluation Conference, (LREC08)."},{"key":"IJCSSA.2017070101-24","doi-asserted-by":"crossref","unstructured":"Palmer, M., Gildea, D., & Kingsbury, P. (2005). The Proposition Bank: A Corpus Annotated with Semantic Roles. Computational Linguistics Journal, 31(1), 71-106.","DOI":"10.1162\/0891201053630264"},{"key":"IJCSSA.2017070101-25","unstructured":"Patil, S., & Patil S. (2014). Intelligent tutoring system for evaluating student performance in descriptive answers using natural language processing. International Journal of Science and Research, 3(9), 779-783."},{"key":"IJCSSA.2017070101-26","doi-asserted-by":"crossref","unstructured":"Rotella, F., Ferilli, S., & Leuzzi, F. (2013). An Approach to Automated Learning of Conceptual Graphs from Text. In Proceedings 26th Int. Conf. on IEA\/AIE 2013, Amsterdam, The Netherlands (pp. 341-350).","DOI":"10.1007\/978-3-642-38577-3_35"},{"key":"IJCSSA.2017070101-27","author":"J. F.Sowa","year":"1984","journal-title":"Conceptual Structures: Information Processing in Mind and Machine, The Systems Programming Series"},{"key":"IJCSSA.2017070101-28","doi-asserted-by":"crossref","unstructured":"Sowa J. F., Way E. C. (1986). Implementing a semantic interpreter using conceptual graphs. IBM Journal of Research and Development, 30(1), 57-69.","DOI":"10.1147\/rd.301.0057"},{"key":"IJCSSA.2017070101-29","article-title":"Auto marking: using computational linguistics to score short, free text responses.","author":"J. Z.Sukkarieh","year":"2003).","journal-title":"Proceedings 29th annual Conference of IAEA"},{"key":"IJCSSA.2017070101-30","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W15-0628"},{"key":"IJCSSA.2017070101-31","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2011.11.006"},{"key":"IJCSSA.2017070101-32","doi-asserted-by":"crossref","unstructured":"Zeng, H., Xiong, L., & Chen, J. (2014). The Chinese Conceptual Graph Matching Algorithm Based on Conceptual Sub-Graph Weight Self-adjustment. In Proceedings of the 9th International Conference on P2P, Parallel, Grid, Cloud and Internet Computing (pp. 197-200).","DOI":"10.1109\/3PGCIC.2014.59"}],"container-title":["International Journal of Conceptual Structures and Smart Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.igi-global.com\/viewtitle.aspx?TitleId=189218","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,5,6]],"date-time":"2022-05-06T08:47:38Z","timestamp":1651826858000},"score":1,"resource":{"primary":{"URL":"http:\/\/services.igi-global.com\/resolvedoi\/resolve.aspx?doi=10.4018\/IJCSSA.2017070101"}},"subtitle":[""],"short-title":[],"issued":{"date-parts":[[2017,7]]},"references-count":33,"journal-issue":{"issue":"2"},"URL":"https:\/\/doi.org\/10.4018\/ijcssa.2017070101","relation":{},"ISSN":["2166-7292","2166-7306"],"issn-type":[{"value":"2166-7292","type":"print"},{"value":"2166-7306","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,7]]}}}