{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,16]],"date-time":"2026-03-16T10:11:30Z","timestamp":1773655890659,"version":"3.50.1"},"reference-count":58,"publisher":"Cambridge University Press (CUP)","issue":"2","license":[{"start":{"date-parts":[[2014,10,30]],"date-time":"2014-10-30T00:00:00Z","timestamp":1414627200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Nat. Lang. Eng."],"published-print":{"date-parts":[[2016,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Writing in language tests is regarded as an important indicator for assessing language skills of test takers. As Chinese language tests become popular, scoring a large number of essays becomes a heavy and expensive task for the organizers of these tests. In the past several years, some efforts have been made to develop automated simplified Chinese essay scoring systems, reducing both costs and evaluation time. In this paper, we introduce a system called SCESS (automated Simplified Chinese Essay Scoring System) based on Weighted Finite State Automata (WFSA) and using Incremental Latent Semantic Analysis (ILSA) to deal with a large number of essays. First, SCESS uses an<jats:italic>n<\/jats:italic>-gram language model to construct a WFSA to perform text pre-processing. At this stage, the system integrates a Confusing-Character Table, a Part-Of-Speech Table, beam search and heuristic search to perform automated word segmentation and correction of essays. Experimental results show that this pre-processing procedure is effective, with a Recall Rate of 88.50%, a Detection Precision of 92.31% and a Correction Precision of 88.46%. After text pre-processing, SCESS uses ILSA to perform automated essay scoring. We have carried out experiments to compare the ILSA method with the traditional LSA method on the corpora of essays from the MHK test (the Chinese proficiency test for minorities). Experimental results indicate that ILSA has a significant advantage over LSA, in terms of both running time and memory usage. Furthermore, experimental results also show that SCESS is quite effective with a scoring performance of 89.50%.<\/jats:p>","DOI":"10.1017\/s1351324914000138","type":"journal-article","created":{"date-parts":[[2014,10,30]],"date-time":"2014-10-30T11:31:59Z","timestamp":1414668719000},"page":"291-319","source":"Crossref","is-referenced-by-count":9,"title":["SCESS: a WFSA-based automated simplified chinese essay scoring system with incremental latent semantic analysis"],"prefix":"10.1017","volume":"22","author":[{"given":"SHUDONG","family":"HAO","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"YANYAN","family":"XU","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"DENGFENG","family":"KE","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"KAILE","family":"SU","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"HENGLI","family":"PENG","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"56","published-online":{"date-parts":[[2014,10,30]]},"reference":[{"key":"S1351324914000138_ref041","first-page":"27","volume-title":"Proceedings of the 5th Conference on Computer and Information Science","author":"Sarwar","year":"2002"},{"key":"S1351324914000138_ref026","doi-asserted-by":"publisher","DOI":"10.1631\/jzus.2007.A0079"},{"key":"S1351324914000138_ref030","unstructured":"Mesaros A. , Heittola T. , and Klapuri A. 2011. Latent semantic analysis in sound event detection. In Proceedings of the 19th European Signal Processing Conference (EUSIPCO 2011), Barcelona, Spain, The European Association for Signal Processing, pp. 1307\u20131311."},{"key":"S1351324914000138_ref024","first-page":"120","article-title":"Research on assisted scoring system for Chinese proficiency test for minority.","volume":"25","author":"Li","year":"2011","journal-title":"Journal Chinese Information Processing"},{"key":"S1351324914000138_ref057","first-page":"627","volume-title":"Proceedings of Australian Conference on Artificial Intelligence","author":"Yue","year":"2006"},{"key":"S1351324914000138_ref022","doi-asserted-by":"publisher","DOI":"10.1080\/01638539809545028"},{"key":"S1351324914000138_ref023","doi-asserted-by":"crossref","DOI":"10.2200\/S00275ED1V01Y201006HLT009","volume-title":"Automated grammatical error detection for language learners","author":"Leacock","year":"2010"},{"key":"S1351324914000138_ref021","first-page":"57","volume-title":"Proceedings of National Conference on Man-Machine Speech Communication","author":"Ke","year":"2011"},{"key":"S1351324914000138_ref031","first-page":"187","volume-title":"Proceedings of EuroConference Recent Advances in NLP (RANLP 2001)","author":"Nakov","year":"2001"},{"key":"S1351324914000138_ref016","first-page":"97","volume-title":"Proceedings of the 11th Conference of the European Chapter of the Association for Computational Linguistics","author":"Gorrell","year":"2006"},{"key":"S1351324914000138_ref039","doi-asserted-by":"crossref","unstructured":"Rosenfeld R. 1994. Adaptive statistical language modeling a maximum entropy approach. PhD thesis, CMU-CS-94-138, Pittsburgh, PA: Carnegie Mellon Universiy.","DOI":"10.3115\/1075812.1075827"},{"key":"S1351324914000138_ref011","first-page":"193","volume-title":"Proceedings of International Conference on Asian Language Processing","author":"Chang","year":"2013"},{"key":"S1351324914000138_ref020","first-page":"385","volume-title":"Intelligent Data Engineering and Automated Learning","author":"Jin","year":"2011"},{"key":"S1351324914000138_ref014","first-page":"71","volume-title":"Automated Essay Scoring: A Cross-Disciplinary Perspective","author":"Elliot","year":"2003"},{"key":"S1351324914000138_ref008","unstructured":"Chang T. H. , Lee C. H. , and Tam H. P. 2007. On developing techniques for automated Chinese essay scoring: a case in ACES system. Paper presented at the Forum for Educational Evaluation in East Asia."},{"key":"S1351324914000138_ref007","doi-asserted-by":"publisher","DOI":"10.1145\/1961189.1961199"},{"key":"S1351324914000138_ref006","first-page":"63","volume-title":"Examinations Research","author":"Cao","year":"2007"},{"key":"S1351324914000138_ref004","first-page":"113","volume-title":"Automated Essay Scoring: A Cross-Disciplinary Perspective","author":"Burstein","year":"2003"},{"key":"S1351324914000138_ref035","doi-asserted-by":"publisher","DOI":"10.1007\/s10483-009-0110-6"},{"key":"S1351324914000138_ref002","doi-asserted-by":"crossref","first-page":"707","DOI":"10.1007\/3-540-47969-4_47","volume-title":"Proceedings of the 2002 European Conference on Computer Vision (ECCV 2002)","author":"Brand","year":"2002"},{"key":"S1351324914000138_ref055","first-page":"180","volume-title":"Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics","author":"Yannakoudakis","year":"2011"},{"key":"S1351324914000138_ref043","first-page":"901","volume-title":"Proceedings of the International Conference on Spoken Language Processing (INTERSPEECH 2002)","author":"Stolcke","year":"2002"},{"key":"S1351324914000138_ref003","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611972733.4"},{"key":"S1351324914000138_ref018","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2014.533"},{"key":"S1351324914000138_ref033","first-page":"18","article-title":"An algorithm of text automatic proofreading based on chinese word segmentation.","volume":"31","author":"Pan","year":"2009","journal-title":"Journal of Wuhan University of Technology"},{"key":"S1351324914000138_ref036","first-page":"3","article-title":"Research on controlling central rating in net-based scoring of subjective test items.","volume":"6","author":"Peng","year":"2013","journal-title":"China Examinations"},{"key":"S1351324914000138_ref053","first-page":"133","volume-title":"Proceedings of the 10th International Conference on Software Engineering, Artificial Intelligences, Networking and Parallel\/Distributed Computing","author":"Xu","year":"2009"},{"key":"S1351324914000138_ref042","doi-asserted-by":"crossref","DOI":"10.4324\/9781410606860","volume-title":"Automated esssay scoring: a cross-disciplinary perspective","author":"Shermis","year":"2003"},{"key":"S1351324914000138_ref005","first-page":"487","volume-title":"The Oxford Handbook of Applied Linguistics","author":"Burstein","year":"2010"},{"key":"S1351324914000138_ref012","first-page":"323","article-title":"Chinese spelling correction in search engines based on n-gram model.","volume":"4","author":"Chen","year":"2009","journal-title":"Journal of China Academy of Electronics and Information Technology"},{"key":"S1351324914000138_ref034","first-page":"57","article-title":"The minorities-oriented Chinese level test.","volume":"10","author":"Peng","year":"2005","journal-title":"China Examinations"},{"key":"S1351324914000138_ref054","first-page":"271","volume-title":"Proceedings of Frontiers in Algorithmics, Third International Workshop","author":"Xu","year":"2009"},{"key":"S1351324914000138_ref038","doi-asserted-by":"crossref","unstructured":"Ramineni C. , Trapani C. S. , Williamson D. M. , Davey T. , and Bridgeman B. 2012. Evaluation of the e-rater Scoring Engine for the TOEFL Independent and Integrated Prompts. Research Report ETS RR-12-06, http:\/\/www.ets.org\/Media\/Research\/pdf\/RR-12-06.pdf.","DOI":"10.1002\/j.2333-8504.2012.tb02288.x"},{"key":"S1351324914000138_ref009","first-page":"351","article-title":"Automated essay scoring using set of literary sememes.","volume":"12","author":"Chang","year":"2009","journal-title":"Information: An International Interdisciplinary Journal"},{"key":"S1351324914000138_ref017","doi-asserted-by":"publisher","DOI":"10.1109\/ICDAR.2013.156"},{"key":"S1351324914000138_ref001","article-title":"Automated essay scoring with e-rater v.2.0.","volume":"4","author":"Attali","year":"2006","journal-title":"Journal of Technology, Learning, and Assessment"},{"key":"S1351324914000138_ref019","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-20998-7_60"},{"key":"S1351324914000138_ref029","doi-asserted-by":"publisher","DOI":"10.1145\/2370216.2370420"},{"key":"S1351324914000138_ref025","unstructured":"Li Y. N. 2006. Automated essay scoring for testing Chinese as a second language. PhD thesis, Beijing: Beijing Language and Culture University."},{"key":"S1351324914000138_ref027","volume-title":"Eight hundred words in modern Chinese","author":"Lv","year":"1999"},{"key":"S1351324914000138_ref045","doi-asserted-by":"publisher","DOI":"10.1016\/j.joi.2009.11.003"},{"key":"S1351324914000138_ref046","volume-title":"Proceedings of the 3rd International Conference on Spoken Language Processing (ICSLP 1994)","author":"Steinbiss","year":"1994"},{"key":"S1351324914000138_ref047","doi-asserted-by":"publisher","DOI":"10.1109\/ICDAR.2011.189"},{"key":"S1351324914000138_ref048","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-21802-6_57"},{"key":"S1351324914000138_ref010","first-page":"97","volume-title":"Proceedings of the Seventh SIGHAN Workshop on Chinese Language Processing (ACL-SIGHAN 2013)","author":"Chang","year":"2013"},{"key":"S1351324914000138_ref050","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-008-0193-3"},{"key":"S1351324914000138_ref049","doi-asserted-by":"publisher","DOI":"10.1145\/2414782.2414787"},{"key":"S1351324914000138_ref051","first-page":"485","volume-title":"Proceedings of the 9th Computer Assisted Assessment Conference (CAA Conference 2005)","author":"Wild","year":"2005"},{"key":"S1351324914000138_ref056","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-36227-4_8"},{"key":"S1351324914000138_ref015","article-title":"The intelligent essay assessor: Applications to educational technology","volume":"1","author":"Foltz","year":"1999","journal-title":"Interactive Multimedia Electronic Journal of Computer Enhanced Learning"},{"key":"S1351324914000138_ref032","doi-asserted-by":"publisher","DOI":"10.1080\/00220973.1994.9943835"},{"key":"S1351324914000138_ref040","article-title":"Automated essay scoring using Bayes theorem","volume":"1","author":"Rudner","year":"2002","journal-title":"Journal of Technology, Learning, and Assessment"},{"key":"S1351324914000138_ref044","doi-asserted-by":"publisher","DOI":"10.1162\/089120100561746"},{"key":"S1351324914000138_ref058","first-page":"345","article-title":"Application of latent semantic analysis in auto-grading system.","volume":"37","author":"Zhao","year":"2011","journal-title":"Journal of Yanbian University (Natural Science)"},{"key":"S1351324914000138_ref052","article-title":"Research on and implementation of Chinese text proof-reading system.","volume":"33","author":"Wu","year":"2001","journal-title":"Journal of Harbin Institute of Technology"},{"key":"S1351324914000138_ref028","article-title":"Detecting Chinese text errors based on trigram and dependency parsing.","volume":"6","author":"Ma","year":"2004","journal-title":"Journal of The China Society For Scientific and Technical Information"},{"key":"S1351324914000138_ref013","first-page":"461","volume-title":"Proceeding of the 7th International Conference on Automatic Face and Gesture Recognition","author":"Chin","year":"2006"},{"key":"S1351324914000138_ref037","first-page":"50","volume-title":"Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics","author":"Peng","year":"2012"}],"container-title":["Natural Language Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S1351324914000138","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,4,20]],"date-time":"2022-04-20T22:48:55Z","timestamp":1650494935000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S1351324914000138\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,10,30]]},"references-count":58,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2016,3]]}},"alternative-id":["S1351324914000138"],"URL":"https:\/\/doi.org\/10.1017\/s1351324914000138","relation":{},"ISSN":["1351-3249","1469-8110"],"issn-type":[{"value":"1351-3249","type":"print"},{"value":"1469-8110","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,10,30]]}}}