{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T06:42:04Z","timestamp":1771483324794,"version":"3.50.1"},"reference-count":55,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2016,10,25]],"date-time":"2016-10-25T00:00:00Z","timestamp":1477353600000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Educ Inf Technol"],"published-print":{"date-parts":[[2017,9]]},"DOI":"10.1007\/s10639-016-9547-0","type":"journal-article","created":{"date-parts":[[2016,10,24]],"date-time":"2016-10-24T23:02:00Z","timestamp":1477350120000},"page":"2383-2402","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":34,"title":["Superlative model using word cloud for short answers evaluation in eLearning"],"prefix":"10.1007","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8002-4755","authenticated-orcid":false,"given":"Shailaja","family":"Jayashankar","sequence":"first","affiliation":[]},{"given":"R.","family":"Sridaran","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2016,10,25]]},"reference":[{"issue":"1","key":"9547_CR1","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1111\/amet.12001","volume":"40","author":"LM Ahearn","year":"2013","unstructured":"Ahearn, L. M. (2013). Commentary: keywords as a literacy practice in the history of anthropological theory. American Ethnologist, 40(1), 6\u201312.","journal-title":"American Ethnologist"},{"key":"9547_CR2","doi-asserted-by":"crossref","unstructured":"Bailey, S. & Meurers, D., (2008). Diagnosing meaning errors in short answers to reading comprehension questions. In Proceedings of the Third Workshop on Innovative Use of NLP for Building Educational Applications (pp. 107\u2013115). Association for Computational Linguistics.","DOI":"10.3115\/1631836.1631849"},{"issue":"2","key":"9547_CR3","first-page":"12","volume":"15","author":"M Baralt","year":"2011","unstructured":"Baralt, M., Pennestri, S., & Selvandin, M. (2011). Action research: using wordles to teach foreign language writing. Language Learning & Technology, 15(2), 12\u201322.","journal-title":"Language Learning & Technology"},{"issue":"2","key":"9547_CR4","first-page":"25","volume":"8","author":"LS Behar-Horenstein","year":"2011","unstructured":"Behar-Horenstein, L. S., & Niu, L. (2011). Teaching critical thinking skills in higher education: a review of the literature. Journal of College Teaching and Learning, 8(2), 25.","journal-title":"Journal of College Teaching and Learning"},{"key":"9547_CR5","unstructured":"Bielenberg, K., (2005). Groups in social software: Utilizing tagging to integrate individual contexts for social navigation (Doctoral dissertation, Universit\u00e4t Bremen)."},{"issue":"2","key":"9547_CR6","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1016\/j.compedu.2007.09.017","volume":"50","author":"F Blin","year":"2008","unstructured":"Blin, F., & Munro, M. (2008). Why hasn\u2019t technology disrupted academics\u2019 teaching practices? understanding resistance to change through the lens of activity theory. Computers & Education, 50(2), 475\u2013490.","journal-title":"Computers & Education"},{"key":"9547_CR7","unstructured":"Bloom, B.S. (1956). Taxonomy of educational objectives: The classification of educational goals: Cognitive Domain. Longman."},{"key":"9547_CR8","doi-asserted-by":"crossref","unstructured":"Brin, S., Motwani, R., Ullman, J.D. & Tsur, S., (1997). Dynamic itemset counting and implication rules for market basket data. In ACM SIGMOD Record (Vol. 26, No. 2, pp. 255\u2013264). ACM.","DOI":"10.1145\/253262.253325"},{"issue":"1","key":"9547_CR9","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1007\/s40593-014-0026-8","volume":"25","author":"S Burrows","year":"2015","unstructured":"Burrows, S., Gurevych, I., & Stein, B. (2015). The eras and trends of automatic short answer grading. International Journal of Artificial Intelligence in Education, 25(1), 60\u2013117.","journal-title":"International Journal of Artificial Intelligence in Education"},{"key":"9547_CR10","doi-asserted-by":"crossref","unstructured":"Burstein, J., Wolff, S. & Lu, C., (1999). Using lexical semantic techniques to classify free-responses. In Breadth and depth of semantic lexicons (pp. 227\u2013244). Springer Netherlands.","DOI":"10.1007\/978-94-017-0952-1_11"},{"issue":"2","key":"9547_CR11","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1016\/j.compedu.2010.02.012","volume":"55","author":"PG Butcher","year":"2010","unstructured":"Butcher, P. G., & Jordan, S. E. (2010). A comparison of human and computer marking of short free-text student responses. Computers & Education, 55(2), 489\u2013499.","journal-title":"Computers & Education"},{"issue":"Aug","key":"9547_CR12","first-page":"2493","volume":"12","author":"R Collobert","year":"2011","unstructured":"Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., & Kuksa, P. (2011). Natural language processing (almost) from scratch. Journal of Machine Learning Research, 12(Aug), 2493\u20132537.","journal-title":"Journal of Machine Learning Research"},{"key":"9547_CR13","unstructured":"Concetta, A. DePaolo, Wilkinson, K. (2014). get your head into the clouds: using word clouds for analyzing qualitative assessment data. TechTrends-May\/June 2014, Springer, Volume 58, Number 3."},{"key":"9547_CR14","unstructured":"Cook, K. A. & Thomas, J. J. (2005). Illuminating the path: The research and development agenda for visual analytics (No. PNNL-SA-45230). Pacific Northwest National Laboratory (PNNL), Richland, WA (US)."},{"issue":"5","key":"9547_CR15","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1109\/MCG.2007.126","volume":"27","author":"K Cook","year":"2007","unstructured":"Cook, K., Earnshaw, R., & Stasko, J. (2007). Guest editors\u2019 introduction: Discovering the unexpected. IEEE Computer Graphics and Applications, 27(5), 15\u201319.","journal-title":"IEEE Computer Graphics and Applications"},{"issue":"4","key":"9547_CR16","doi-asserted-by":"crossref","first-page":"n4","DOI":"10.24059\/olj.v19i4.528","volume":"19","author":"A deNoyelles","year":"2015","unstructured":"deNoyelles, A., & Reyes-Foster, B. (2015). Using word clouds in online discussions to support critical thinking and engagement. Online Learning, 19(4), n4.","journal-title":"Online Learning"},{"issue":"3","key":"9547_CR17","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1007\/s11528-014-0750-9","volume":"58","author":"CA DePaolo","year":"2014","unstructured":"DePaolo, C. A., & Wilkinson, K. (2014). Get your head into the clouds: using word clouds for analyzing qualitative assessment data. TechTrends, 58(3), 38\u201344.","journal-title":"TechTrends"},{"issue":"1","key":"9547_CR18","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1007\/s10579-015-9313-8","volume":"50","author":"MO Dzikovska","year":"2016","unstructured":"Dzikovska, M. O., Nielsen, R. D., & Leacock, C. (2016). The joint student response analysis and recognizing textual entailment challenge: making sense of student responses in educational applications. Language Resources and Evaluation, 50(1), 67\u201393.","journal-title":"Language Resources and Evaluation"},{"key":"9547_CR19","first-page":"37","volume-title":"Beautiful visualization","author":"J Feinberg","year":"2010","unstructured":"Feinberg, J. (2010). Wordle. In J. Steele & N. Iliinsky (Eds.), Beautiful visualization (pp. 37\u201358). Sebastopol: O\u2019Reilly."},{"key":"9547_CR20","unstructured":"Feinerer, I., Hornik, K., Wallace, M. & Hornik, M.K., (2016). Package \u2018wordnet\u2019. https:\/\/CRAN.R-project.org\/package=wordnet , Accessed 21 January 2016."},{"key":"9547_CR21","unstructured":"Fellows (2013). https:\/\/cran.r-project.org\/web\/packages\/wordcloud\/index.html , Accessed 22 January 2016."},{"key":"9547_CR22","unstructured":"G\u00fctl, C. (2007). e-Examiner: towards a fully-automatic knowledge assessment tool applicable in adaptive e-learning systems. In Proceedings of the 2nd international conference on interactive mobile and computer aided learning (pp. 1\u201310)."},{"key":"9547_CR23","unstructured":"Hahn, M. & Meurers, D. (2012). Evaluating the meaning of answers to reading comprehension questions a semantics-based approach. In Proceedings of the Seventh Workshop on Building Educational Applications Using NLP (pp. 326\u2013336). Association for Computational Linguistics."},{"key":"9547_CR24","doi-asserted-by":"crossref","unstructured":"Hahsler, M., Gr\u00fcn, B. & Hornik, K. (2005). A computational environment for mining association rules and frequent item sets.","DOI":"10.18637\/jss.v014.i15"},{"issue":"9","key":"9547_CR25","doi-asserted-by":"crossref","first-page":"522","DOI":"10.5860\/crln.72.9.8634","volume":"72","author":"R Huisman","year":"2011","unstructured":"Huisman, R., Miller, W., & Trinoskey, J. (2011). We\u2019ve Wordled, have you? digital images in the library classroom. College & Research Libraries News, 72(9), 522\u2013526.","journal-title":"College & Research Libraries News"},{"key":"9547_CR26","unstructured":"Ingo, F & Kurt, H. (2015). tm: Text Mining Package. R package version 0.6-2. http:\/\/CRAN.R-project.org\/package=tm, Accessed 21 January 2016."},{"issue":"2","key":"9547_CR27","first-page":"47","volume":"1","author":"S Ingoley","year":"2012","unstructured":"Ingoley, S., & Bakal, J. W. (2012). Use of fuzzy logic in evaluating students\u2019 learning achievement. International Journal on Advanced Computer Engineering and Communication Technology (IJACECT), 1(2), 47\u201354.","journal-title":"International Journal on Advanced Computer Engineering and Communication Technology (IJACECT)"},{"key":"9547_CR28","unstructured":"Jablon, J.R. & Wilkinson, M. (2006). Using engagement strategies to facilitate children\u2019s learning and success. YC Young Children 12-16."},{"issue":"2","key":"9547_CR29","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1080\/13664530701414779","volume":"11","author":"A Jimoyiannis","year":"2007","unstructured":"Jimoyiannis, A., & Komis, V. (2007). Examining teachers\u2019 beliefs about ICT in education: implications of a teacher preparation programme. Teacher Development, 11(2), 149\u2013173.","journal-title":"Teacher Development"},{"key":"9547_CR30","doi-asserted-by":"crossref","unstructured":"Kao, A. & Poteet, S.R. eds. (2007). Natural language processing and text mining. Springer Science & Business Media.","DOI":"10.1007\/978-1-84628-754-1"},{"key":"9547_CR31","doi-asserted-by":"crossref","unstructured":"Kaptein, R., Hiemstra, D. & Kamps, J., (2010). How different are language models andword clouds?. In European Conference on Information Retrieval (pp. 556\u2013568). Springer Berlin Heidelberg.","DOI":"10.1007\/978-3-642-12275-0_48"},{"key":"9547_CR32","unstructured":"Kolb, A, Y. (2005). The Kolb Learning Style Inventory\u2014Version 3.1 2005 Technical Specifications. Boston, MA: Hay Resource Direct, 200."},{"issue":"10","key":"9547_CR33","doi-asserted-by":"crossref","first-page":"2161","DOI":"10.1039\/an9941902161","volume":"119","author":"J Kragten","year":"1994","unstructured":"Kragten, J. (1994). Tutorial review. calculating standard deviations and confidence intervals with a universally applicable spreadsheet technique. Analyst, 119(10), 2161\u20132165.","journal-title":"Analyst"},{"issue":"4","key":"9547_CR34","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1023\/A:1025779619903","volume":"37","author":"C Leacock","year":"2003","unstructured":"Leacock, C., & Chodorow, M. (2003). C-rater: automated scoring of short-answer questions. Computers and the Humanities, 37(4), 389\u2013405.","journal-title":"Computers and the Humanities"},{"key":"9547_CR35","unstructured":"Leek, J, Peng, R. & Irizarry, R. (2013). Simply statistics\u201d, http:\/\/www.r-bloggers.com\/a-wordcloud-comparison-of-the-2011-and-2012-sotu\/ #, Accessed 21 January 2016."},{"key":"9547_CR36","unstructured":"Liu, V. & Curran, J. R. (2006). Web Text Corpus for Natural Language Processing. In EACL."},{"key":"9547_CR37","unstructured":"Maglogiannis, I. G. (2007). Emerging artificial intelligence applications in computer engineering: real word AI systems with applications in eHealth, HCI, information retrieval and pervasive technologies (Vol. 160). Ios Press."},{"issue":"3","key":"9547_CR38","first-page":"630","volume":"15","author":"C McNaught","year":"2010","unstructured":"McNaught, C., & Lam, P. (2010). Using Wordle as a supplementary research tool. The Qualitative Report, 15(3), 630.","journal-title":"The Qualitative Report"},{"key":"9547_CR39","unstructured":"Meyer, D., Hornik, K. & Feinerer, I. (2008). Text mining infrastructure in R. Journal of Statistical Software 25(5), pp.1-54. ISSN 1548\u20137660. URL http:\/\/www.jstatsoft.org\/v25\/i05 , Accessed 21 April 2016."},{"issue":"2","key":"9547_CR40","first-page":"91","volume":"11","author":"F Miley","year":"2012","unstructured":"Miley, F., & Read, A. (2012). Using word clouds to develop proactive learners. Journal of the Scholarship of Teaching and Learning, 11(2), 91\u2013110.","journal-title":"Journal of the Scholarship of Teaching and Learning"},{"issue":"11","key":"9547_CR41","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1145\/219717.219748","volume":"38","author":"GA Miller","year":"1995","unstructured":"Miller, G. A. (1995). WordNet: a lexical database for English. Communications of the ACM, 38(11), 39\u201341.","journal-title":"Communications of the ACM"},{"key":"9547_CR42","unstructured":"Mitchell, T., Russell, T., Broomhead, P. & Aldridge, N. (2002). Towards robust computerised marking of free-text responses."},{"key":"9547_CR43","doi-asserted-by":"crossref","unstructured":"Mohler, M. & Mihalcea, R. (2009). Text-to-text semantic similarity for automatic short answer grading. In Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics (pp. 567\u2013575). Association for Computational Linguistics.","DOI":"10.3115\/1609067.1609130"},{"issue":"9","key":"9547_CR44","doi-asserted-by":"crossref","first-page":"564","DOI":"10.5951\/mathteacmiddscho.17.9.0564","volume":"17","author":"J Nickell","year":"2012","unstructured":"Nickell, J. (2012). Word clouds in math classrooms. Mathematics Teaching in the Middle School, 17(9), 564\u2013566.","journal-title":"Mathematics Teaching in the Middle School"},{"key":"9547_CR45","unstructured":"P\u00e9rez, D., Gliozzo, A. M., Strapparava, C., Alfonseca, E., Rodr\u00edguez, P. & Magnini, B. (2005). Automatic assessment of students\u2019 free-text answers underpinned by the combination of a BLEU-inspired algorithm and latent semantic analysis. In FLAIRS conference (pp. 358\u2013363)."},{"issue":"4","key":"9547_CR46","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1080\/17404622.2012.702918","volume":"26","author":"L Perry","year":"2012","unstructured":"Perry, L. (2012). Using word clouds to teach about speaking style. Communication Teacher, 26(4), 220\u2013223.","journal-title":"Communication Teacher"},{"key":"9547_CR47","doi-asserted-by":"crossref","unstructured":"Pulman, S.G. & Sukkarieh, J. Z. (2005). Automatic short answer marking. In Proceedings of the second workshop on Building Educational Applications Using NLP (pp. 9\u201316). Association for Computational Linguistics.","DOI":"10.3115\/1609829.1609831"},{"key":"9547_CR48","unstructured":"Ramsden, A. & Bate, A. (2008). Using word clouds in teaching and learning."},{"key":"9547_CR49","doi-asserted-by":"crossref","unstructured":"Sag I. A., Baldwin, T., Bond, F., Copestake, A. & Flickinger, D. (2002). Multiword expressions: a pain in the neck for NLP. In International Conference on Intelligent Text Processing and Computational Linguistics (pp. 1\u201315). Springer Berlin Heidelberg.","DOI":"10.1007\/3-540-45715-1_1"},{"key":"9547_CR50","unstructured":"Siddiqi, R. (2010). Improving learning and teaching through automated short answer marking, complete thesis, https:\/\/www.escholar.manchester.ac.uk\/api\/datastream?publicationPid=uk-ac-manscw:90867&datastreamId=FULL-TEXT.PDF , Accessed 28 July 2016."},{"issue":"3","key":"9547_CR51","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1109\/TLT.2010.4","volume":"3","author":"R Siddiqi","year":"2010","unstructured":"Siddiqi, R., Harrison, C. J., & Siddiqi, R. (2010). Improving teaching and learning through automated short-answer marking. IEEE Transactions on Learning Technologies, 3(3), 237\u2013249.","journal-title":"IEEE Transactions on Learning Technologies"},{"key":"9547_CR52","unstructured":"Sukkarieh, J. Z., Pulman, S.G. & Raikes, N. (2003). Auto-marking: using computational linguistics to score short, free text responses. In the annual conference of the International Association for Educational Assessment (IAEA), Manchester, UK."},{"issue":"6","key":"9547_CR53","first-page":"740","volume":"73","author":"L Tsui","year":"2002","unstructured":"Tsui, L. (2002). Fostering critical thinking through effective pedagogy: evidence from four institutional case studies. The Journal of Higher Education, 73(6), 740\u2013763.","journal-title":"The Journal of Higher Education"},{"issue":"1","key":"9547_CR54","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1111\/j.1745-3992.2011.00223.x","volume":"31","author":"DM Williamson","year":"2012","unstructured":"Williamson, D. M., Xi, X., & Breyer, F. J. (2012). A framework for evaluation and use of automated scoring. Educational Measurement: Issues and Practice, 31(1), 2\u201313.","journal-title":"Educational Measurement: Issues and Practice"},{"issue":"1881","key":"9547_CR55","doi-asserted-by":"crossref","first-page":"3717","DOI":"10.1098\/rsta.2008.0118","volume":"366","author":"JM Wing","year":"2008","unstructured":"Wing, J. M. (2008). Computational thinking and thinking about computing. Philosophical Transactions of the Royal Society of London A: Mathematical, Physical and Engineering Sciences, 366(1881), 3717\u20133725.","journal-title":"Philosophical Transactions of the Royal Society of London A: Mathematical, Physical and Engineering Sciences"}],"container-title":["Education and Information Technologies"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10639-016-9547-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10639-016-9547-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10639-016-9547-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,9,14]],"date-time":"2019-09-14T20:20:34Z","timestamp":1568492434000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10639-016-9547-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,10,25]]},"references-count":55,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2017,9]]}},"alternative-id":["9547"],"URL":"https:\/\/doi.org\/10.1007\/s10639-016-9547-0","relation":{},"ISSN":["1360-2357","1573-7608"],"issn-type":[{"value":"1360-2357","type":"print"},{"value":"1573-7608","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,10,25]]}}}