{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T14:30:53Z","timestamp":1774881053478,"version":"3.50.1"},"reference-count":50,"publisher":"Emerald","issue":"1","license":[{"start":{"date-parts":[[2020,10,14]],"date-time":"2020-10-14T00:00:00Z","timestamp":1602633600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["LHT"],"published-print":{"date-parts":[[2022,2,14]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title><jats:p>The aim of this study is to explore students' expectations and perceived effectiveness of computer-assisted review tools, and the differences in reliability and validity between human evaluation and automatic evaluation, to find a way to improve students' English writing ability.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title><jats:p>Based on the expectancy disconfirmation theory (EDT) and Intelligent Computer-Assisted Language Learning (ICALL) theory, an experiment is conducted through the observation method, semistructured interview method and questionnaire survey method. In the experiment, respondents were asked to write and submit four essays on three online automated essay evaluation (AEE) systems in total, one essay every two weeks. Also, two teacher raters were invited to score the first and last papers of each student. The respondents' feedbacks were investigated to confirm the effectiveness of the AEE system; the evaluation results of the AEE systems and teachers were compared; descriptive statistics was used to analyze the experimental data.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Findings<\/jats:title><jats:p>The experiment revealed that the respondents held high expectations for the computer-assisted evaluation tools, and the effectiveness of computer scoring feedback on students was higher than that of teacher scoring feedback. Moreover, at the end of the writing project, the students' independent learning ability and English writing ability were significantly improved. Besides, there was a positive correlation between students' initial expectations of computer-assisted learning tools and the final evaluation of learning results.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title><jats:p>The innovation lies in the use of observation methods, questionnaire survey methods, data analysis, and other methods for the experiment, and the combination of deep learning theory, EDT and descriptive statistics, which has particular reference value for future works.<\/jats:p><\/jats:sec>","DOI":"10.1108\/lht-05-2020-0113","type":"journal-article","created":{"date-parts":[[2020,10,13]],"date-time":"2020-10-13T00:27:01Z","timestamp":1602548821000},"page":"80-97","source":"Crossref","is-referenced-by-count":92,"title":["Computer-assisted EFL writing and evaluations based on artificial intelligence: a case from a college reading and writing course"],"prefix":"10.1108","volume":"40","author":[{"given":"Zhijie","family":"Wang","sequence":"first","affiliation":[]}],"member":"140","published-online":{"date-parts":[[2020,10,14]]},"reference":[{"issue":"6","key":"key2022021611152570900_ref001","first-page":"54","article-title":"The effect of using automated essay evaluation on ESL undergraduate students' writing skill","volume":"6","year":"2016","journal-title":"International Journal of English Linguistics"},{"issue":"2011","key":"key2022021611152570900_ref002","first-page":"537","article-title":"Blogs in language learning: maximizing students' collaborative","volume":"18","year":"2011","journal-title":"Procedia Social and Behavioral Sciences"},{"key":"key2022021611152570900_ref003","volume-title":"Construct Validity of E-Rater in Scoring TOEFL Essays (Research Report No. RR\u201007\u201021)","year":"2007"},{"issue":"5","key":"key2022021611152570900_ref004","doi-asserted-by":"crossref","first-page":"1736","DOI":"10.1016\/j.ipm.2019.05.008","article-title":"AAEE\u2013automated evaluation of students' essays in Arabic language","volume":"56","year":"2019","journal-title":"Information Processing and Management"},{"issue":"1","key":"key2022021611152570900_ref005","first-page":"65","article-title":"An overview of automatic essay evaluation in the past two decades","year":"2019","journal-title":"Foreign Language Research"},{"issue":"2","key":"key2022021611152570900_ref006","first-page":"71","article-title":"Evaluation of computer based foreign language learning software by teachers and students","volume":"13","year":"2014","journal-title":"The Turkish Online Journal of Educational Technology"},{"key":"key2022021611152570900_ref007","doi-asserted-by":"publisher","article-title":"Deep learning in automated essay scoring","year":"2019","DOI":"10.1007\/978-3-319-91464-0_30"},{"issue":"3","key":"key2022021611152570900_ref008","doi-asserted-by":"crossref","first-page":"432","DOI":"10.1108\/JBIM-07-2016-0150","article-title":"Open innovation in supply networks: an expectation disconfirmation","volume":"32","year":"2017","journal-title":"Journal of Business and Industrial Marketing"},{"issue":"3","key":"key2022021611152570900_ref009","first-page":"27","article-title":"Automated essay evaluation: the criterion online writing service","volume":"25","year":"2004","journal-title":"AI Magazine"},{"issue":"2","key":"key2022021611152570900_ref010","first-page":"94","article-title":"Beyond the design of automated writing evaluation: pedagogical practices and perceived earning effectiveness in EFL writing classes","volume":"12","year":"2008","journal-title":"Language Learning and Technology"},{"issue":"2","key":"key2022021611152570900_ref011","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1080\/07908318.2015.1027216","article-title":"Impacts of the test of English listening comprehension on students' English learning expectations in taiwan","volume":"28","year":"2015","journal-title":"Language and Curriculum"},{"issue":"2017","key":"key2022021611152570900_ref012","first-page":"170","article-title":"Evaluating the use of a social media tool for collaborative group writing of secondary school students in Hong Kong","volume":"110","year":"2017","journal-title":"Computers and Education"},{"issue":"2016","key":"key2022021611152570900_ref013","first-page":"601","article-title":"L2 collaborative E-writing","volume":"228","year":"2016","journal-title":"Procedia-Social and Behavioral Sciences"},{"key":"key2022021611152570900_ref014","doi-asserted-by":"publisher","first-page":"601","DOI":"10.1177\/1362168820915337","article-title":"Instructor feedback on free writing and automated corrective feedback in drills: intensity and efficacy","year":"2020","journal-title":"Language Teaching Research"},{"issue":"8","key":"key2022021611152570900_ref015","first-page":"71","article-title":"The effect of automated writing evaluation feedback on students' vocabulary revision -taking Pigai.org for example","volume":"2","year":"2018","journal-title":"Modern Educational Technology"},{"issue":"4","key":"key2022021611152570900_ref016","doi-asserted-by":"crossref","first-page":"877","DOI":"10.1017\/S014271641900002X","article-title":"The development of vocabulary and morphological awareness: a longitudinal study with college EFL students","volume":"40","year":"2019","journal-title":"Applied Psycholinguistics"},{"issue":"335","key":"key2022021611152570900_ref017","first-page":"139","article-title":"An evidenced-based rearch on the role of web 2.0 in building up college students' collaborative learning capabilities","volume":"12","year":"2014","journal-title":"China Educational Technology"},{"key":"key2022021611152570900_ref018","doi-asserted-by":"crossref","unstructured":"Khadka, S. (2020), \u201cMeaning and teaching of writing in higher education in Nepal\u201d, in Bista, K., Sharma, S. and Raby, R.L. (Eds), Higher Education in Nepal: Policies and Perspectives, Routledge, Oxford, pp. 201-213.","DOI":"10.4324\/9781351139205-15"},{"issue":"1","key":"key2022021611152570900_ref019","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18627\/jslg.32.1.201605.1","article-title":"Korean EFL freshman students' English learning experiences in high school and in college","volume":"32","year":"2016","journal-title":"The Journal of Studies in Language"},{"issue":"2017","key":"key2022021611152570900_ref020","first-page":"48","article-title":"Science-writing in the blogosphere as a tool to promote autonomous motivation in education","volume":"35","year":"2017","journal-title":"The Internet and Higher Education"},{"issue":"5","key":"key2022021611152570900_ref021","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/5254.889104","article-title":"Beyond automated essay scoring, the debate on automated essay grading","volume":"15","year":"2000","journal-title":"IEEE Intelligent Systems"},{"issue":"4","key":"key2022021611152570900_ref022","first-page":"72","article-title":"The impact of the integrated feedback on students' writing revision based on the AWE","volume":"40","year":"2019","journal-title":"Foreign Language Education"},{"issue":"7","key":"key2022021611152570900_ref023","first-page":"67","article-title":"Study on the effect of web-based collaborative writing","volume":"219","year":"2011","journal-title":"Web-Assisted Education"},{"issue":"7","key":"key2022021611152570900_ref024","first-page":"91","article-title":"Freshmen's new words consciousness and its influence on language output competence measured on a corpus basis","volume":"2015","year":"2015","journal-title":"Higher Education Exploration"},{"issue":"2018","key":"key2022021611152570900_ref025","first-page":"1","article-title":"Group awareness increases student engagement in online collaborative writing","volume":"38","year":"2018","journal-title":"The Internet and Higher Education"},{"issue":"2","key":"key2022021611152570900_ref026","first-page":"88","article-title":"A study of the second writing process based on an automated essay evaluation tools","volume":"2016","year":"2016","journal-title":"Foreign Language World"},{"issue":"4","key":"key2022021611152570900_ref027","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1037\/0021-9010.62.4.480","article-title":"Effect of expectation and disconfirmation on postexposure product evaluations\u2013an alternative interpretation","volume":"62","year":"1977","journal-title":"Journal of Applied Psychology"},{"issue":"4","key":"key2022021611152570900_ref028","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1177\/002224378001700405","article-title":"A cognitive model of the antecedents and consequences of satisfaction decisions","volume":"17","year":"1980","journal-title":"Journal of Marketing Research"},{"issue":"5","key":"key2022021611152570900_ref029","first-page":"238","article-title":"The imminence of grading essays by computer","volume":"47","year":"1966","journal-title":"Phi Delta Kappan"},{"key":"key2022021611152570900_ref030","doi-asserted-by":"publisher","article-title":"Towards context-aware automated writing evaluation systems","year":"2019","DOI":"10.1145\/3340435.3342722"},{"issue":"1","key":"key2022021611152570900_ref031","first-page":"165","article-title":"The reliability and validity of automated tools for examining variation in syntactic complexity across genres","volume":"128","year":"2018","journal-title":"International Journal of Applied Linguistics"},{"key":"key2022021611152570900_ref032","volume-title":"Comparing the Validity of Automated and Human Scoring of Essays","year":"2000"},{"key":"key2022021611152570900_ref033","doi-asserted-by":"publisher","article-title":"Automated short essay scoring system using normalized simpson methods","year":"2017","DOI":"10.1063\/1.5028081"},{"key":"key2022021611152570900_ref034","volume-title":"Evaluating the Construct-Coverage of the E-Rater\u00ae Scoring Engine","year":"2009"},{"issue":"4","key":"key2022021611152570900_ref035","first-page":"1","article-title":"An evaluation of the IntelliMetricSM essay scoring system","volume":"4","year":"2006","journal-title":"The Journal of Technology, Learning, and Assessment"},{"issue":"1","key":"key2022021611152570900_ref036","doi-asserted-by":"crossref","first-page":"93","DOI":"10.30530\/JSL.2019.04.24.1.93","article-title":"Comparison of automatic and human evaluation of L2 texts in Czech","volume":"24","year":"2019","journal-title":"Issledovanija po slavjanskim jazykam"},{"key":"key2022021611152570900_ref037","doi-asserted-by":"publisher","article-title":"Automatic scoring method of English composition based on language depth perception","year":"2019","DOI":"10.1088\/1742-6596\/1486\/4\/042045"},{"issue":"2","key":"key2022021611152570900_ref038","first-page":"273","article-title":"Using automated writing evaluation in classroom assessment: a critical review","volume":"2011","year":"2011","journal-title":"Foreign Language Teaching and Research"},{"issue":"102247","key":"key2022021611152570900_ref039","doi-asserted-by":"publisher","DOI":"10.1016\/j.system.2020.102247","article-title":"Learner engagement with automated feedback, peer feedback and teacher feedback in an online EFL writing context","volume":"91","year":"2020","journal-title":"System"},{"issue":"3","key":"key2022021611152570900_ref040","doi-asserted-by":"crossref","first-page":"597","DOI":"10.1002\/pam.21702","article-title":"An experimental test of the expectancy-disconfirmation theory of citizen satisfaction","volume":"32","year":"2013","journal-title":"Journal of Policy Analysis and Management"},{"issue":"1","key":"key2022021611152570900_ref041","doi-asserted-by":"crossref","first-page":"6","DOI":"10.7575\/ijalel.v.2n.1p.6","article-title":"Can automated writing evaluation programs help students improve their English writing?","volume":"2","year":"2013","journal-title":"International Journal of Applied Linguistics and English Literature"},{"issue":"3","key":"key2022021611152570900_ref042","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1080\/09588221.2012.655300","article-title":"Exploring the impact of using automated writing evaluation in English as a foreign language university students' writing","volume":"26","year":"2013","journal-title":"Computer Assisted Language Learning"},{"issue":"1","key":"key2022021611152570900_ref043","first-page":"93","article-title":"Does automated feedback improve writing quality?","volume":"12","year":"2014","journal-title":"Learning Disabilities: A Contemporary Journal"},{"issue":"2016","key":"key2022021611152570900_ref044","first-page":"94","article-title":"Automated essay evaluation software in English language arts classrooms: effects on teacher feedback, student motivation, and writing quality","volume":"100","year":"2016","journal-title":"Computers and Education"},{"key":"key2022021611152570900_ref045","doi-asserted-by":"crossref","unstructured":"Winke, P.M. and Isbell, D.R. (2017), \u201cComputer-assisted language assessment\u201d, in Thorne, S. and May, S. (Eds), Language, Education and Technology. Encyclopedia of Language and Education, 3rd ed., Springer, Cham, pp. 1-13.","DOI":"10.1007\/978-3-319-02237-6_25"},{"issue":"2","key":"key2022021611152570900_ref046","first-page":"17","article-title":"An empirical study on college English autonomous writing teaching model based on www. pigai.Org","volume":"2015","year":"2015","journal-title":"Computer-assisted Foreign Language Education"},{"issue":"2013","key":"key2022021611152570900_ref047","first-page":"46","article-title":"Blog-assisted process writing for English majors and pedagogic implications","volume":"153","year":"2013","journal-title":"Computer-Assisted Foreign Language Education"},{"issue":"11","key":"key2022021611152570900_ref048","doi-asserted-by":"crossref","first-page":"808","DOI":"10.7763\/IJIET.2015.V5.616","article-title":"Incorporation of automated writing evaluation software in language education: a case of evening university","volume":"5","year":"2015","journal-title":"International Journal of Information and Education Technology"},{"issue":"12","key":"key2022021611152570900_ref049","first-page":"35","article-title":"A discussion on the connection of English teaching between high school and college","volume":"2014","year":"2014","journal-title":"Education exploration"},{"issue":"1","key":"key2022021611152570900_ref050","doi-asserted-by":"crossref","first-page":"189","DOI":"10.17507\/jltr.0601.23","article-title":"An empirical study of blog-assisted EFL process writing: evidence from Chinese non-English majors","volume":"6","year":"2015","journal-title":"Journal of Language Teaching and Research"}],"container-title":["Library Hi Tech"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/LHT-05-2020-0113\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/LHT-05-2020-0113\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T22:14:31Z","timestamp":1753395271000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/lht\/article\/40\/1\/80-97\/453947"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,14]]},"references-count":50,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,10,14]]},"published-print":{"date-parts":[[2022,2,14]]}},"alternative-id":["10.1108\/LHT-05-2020-0113"],"URL":"https:\/\/doi.org\/10.1108\/lht-05-2020-0113","relation":{},"ISSN":["0737-8831"],"issn-type":[{"value":"0737-8831","type":"print"}],"subject":[],"published":{"date-parts":[[2020,10,14]]}}}