{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T19:09:04Z","timestamp":1790104144626,"version":"4.0.1"},"reference-count":68,"publisher":"SAGE Publications","issue":"4","license":[{"start":{"date-parts":[[2022,11,17]],"date-time":"2022-11-17T00:00:00Z","timestamp":1668643200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/501100012456","name":"National Social Science Fund of China","doi-asserted-by":"publisher","award":["17BYY015"],"award-info":[{"award-number":["17BYY015"]}],"id":[{"id":"10.13039\/501100012456","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Educational Computing Research"],"published-print":{"date-parts":[[2023,7]]},"abstract":"<jats:p>Automated writing evaluation (AWE) has been frequently used to provide feedback on student writing. Many empirical studies have examined the effectiveness of AWE on writing quality, but the results were inconclusive. Thus, the magnitude of AWE\u2019s overall effect and factors influencing its effectiveness across studies remained unclear. This study re-examined the issue by meta-analyzing the results of 26 primary studies with a total of 2468 participants from 2010 to 2022. The results revealed that AWE had a large positive overall effect on writing quality (g = 0.861, p &lt; 0.001). Further moderator analyses indicated that AWE was more effective for post-secondary students than for secondary students and had more benefits for English as a Foreign Language (EFL) and English as a Second Language (ESL) learners than for Native English Speaker (NES) learners. When the genre of writing was considered, AWE showed a more significant impact on argumentative writing than on academic and mixed writing genres. However, intervention duration, feedback combination, and AWE platform did not moderate the effect of AWE on writing quality. The implications and recommendations for both research and practice are discussed in depth.<\/jats:p>","DOI":"10.1177\/07356331221127300","type":"journal-article","created":{"date-parts":[[2022,11,17]],"date-time":"2022-11-17T21:06:36Z","timestamp":1668719196000},"page":"875-900","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":102,"title":["The Effectiveness of Automated Writing Evaluation on Writing Quality: A Meta-Analysis"],"prefix":"10.1177","volume":"61","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4261-943X","authenticated-orcid":false,"given":"Na","family":"Zhai","sequence":"first","affiliation":[{"name":"School of Foreign Languages, Xi\u2019an Jiaotong University, Xi\u2019an, PR China"},{"name":"School of Translation Studies, Xi\u2019an Fanyi University, Xi\u2019an, PR China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaomei","family":"Ma","sequence":"additional","affiliation":[{"name":"School of Foreign Languages, Xi\u2019an Jiaotong University, Xi\u2019an, PR China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2022,11,17]]},"reference":[{"key":"bibr1-07356331221127300","volume-title":"EAP essentials: A teacher's guide to principles and practice","author":"Alexander O.","year":"2008"},{"issue":"1","key":"bibr2-07356331221127300","first-page":"107","volume":"24","author":"Bakla A.","year":"2020","journal-title":"Language Learning & Technology"},{"issue":"1","key":"bibr3-07356331221127300","first-page":"320","volume":"100","author":"Barkaoui K.","year":"2016","journal-title":"The Medico-legal Journal"},{"issue":"1","key":"bibr4-07356331221127300","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1515\/jccall-2021-2001","volume":"1","author":"Barrot J. S.","year":"2021","journal-title":"Computer Assisted Language Learning"},{"key":"bibr5-07356331221127300","volume-title":"Introduction to meta-analysis","author":"Borenstein M.","year":"2011"},{"key":"bibr6-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1145\/3459043.3459065"},{"key":"bibr7-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1016\/j.iheduc.2017.04.002"},{"key":"bibr8-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1177\/0735633119837765"},{"key":"bibr9-07356331221127300","doi-asserted-by":"publisher","DOI":"10.4324\/9780203771587"},{"key":"bibr10-07356331221127300","doi-asserted-by":"publisher","DOI":"10.17239\/jowr-2020.11.03.01"},{"key":"bibr11-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1017\/S2045796016000809"},{"key":"bibr12-07356331221127300","volume-title":"TOEFL 2000 writing framework","author":"Cumming A.","year":"2000"},{"key":"bibr13-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1016\/j.asw.2012.10.002"},{"key":"bibr14-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1016\/j.asw.2014.03.006"},{"key":"bibr15-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.315.7109.629"},{"key":"bibr16-07356331221127300","volume-title":"The study of second language acquisition","author":"Ellis R.","year":"2008","edition":"2"},{"key":"bibr17-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1080\/09588221.2022.2033787"},{"issue":"1","key":"bibr18-07356331221127300","first-page":"244","volume":"27","author":"Garz\u00f3n J.","year":"2019","journal-title":"European Respiratory Review: an Official Journal of the European Respiratory Society"},{"key":"bibr19-07356331221127300","doi-asserted-by":"publisher","DOI":"10.3102\/0034654317746927"},{"key":"bibr20-07356331221127300","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2021.752793"},{"key":"bibr21-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1111\/jcal.12587"},{"key":"bibr22-07356331221127300","doi-asserted-by":"publisher","DOI":"10.3102\/003465430298487"},{"issue":"2","key":"bibr23-07356331221127300","first-page":"107","volume":"6","author":"Hedges L. V.","year":"1981","journal-title":"(Journal of Environmental Sciences China)"},{"key":"bibr24-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1186\/s12909-018-1144-z"},{"key":"bibr25-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1111\/emip.12036"},{"key":"bibr26-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.327.7414.557"},{"key":"bibr27-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1093\/elt\/ccy044"},{"key":"bibr28-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1093\/applin\/amp048"},{"key":"bibr29-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1080\/02602938.2018.1545896"},{"key":"bibr30-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1016\/j.system.2020.102302"},{"key":"bibr31-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1111\/modl.12189"},{"key":"bibr32-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1177\/1362168818802469"},{"key":"bibr33-07356331221127300","doi-asserted-by":"publisher","DOI":"10.2190\/EC.42.2.c"},{"key":"bibr34-07356331221127300","doi-asserted-by":"publisher","DOI":"10.17239\/jowr-2020.12.01.06"},{"key":"bibr35-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1016\/j.jslw.2014.10.004"},{"issue":"1","key":"bibr36-07356331221127300","first-page":"1","volume":"1","author":"Link S.","year":"2020","journal-title":"Computer Assisted Language Learning"},{"key":"bibr37-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1016\/B978-012589042-7\/50015-3"},{"key":"bibr38-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1089\/big.2018.0151"},{"key":"bibr39-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1007\/s40299-021-00594-6"},{"key":"bibr40-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1177\/07356331211064066"},{"key":"bibr41-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1080\/10494820.2022.2096642"},{"key":"bibr42-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1111\/jcal.12635"},{"key":"bibr43-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijsu.2021.105906"},{"key":"bibr44-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1016\/j.cedpsych.2018.07.002"},{"key":"bibr45-07356331221127300","volume-title":"A framework for deliberate practice: Self-regulated strategy development and an automated writing evaluation program","author":"Palermo C. J","year":"2017"},{"key":"bibr46-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1007\/s40299-021-00597-3"},{"key":"bibr47-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1515\/cjal-2012-0006"},{"key":"bibr48-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2016.12.076"},{"key":"bibr49-07356331221127300","doi-asserted-by":"publisher","DOI":"10.4135\/9781412984997"},{"issue":"32","key":"bibr50-07356331221127300","first-page":"181","volume":"39","author":"Salavatizadeh M.","year":"2020","journal-title":"Teaching English As a Second Language"},{"issue":"1","key":"bibr51-07356331221127300","first-page":"1","volume":"9","author":"Schmidt R.","year":"1995","journal-title":"Attention and Awareness in Foreign Language Learning"},{"key":"bibr52-07356331221127300","volume-title":"A cognitive approach to language learning","author":"Skehan P.","year":"1998"},{"key":"bibr53-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1016\/j.asw.2013.11.007"},{"key":"bibr54-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1016\/j.stueduc.2021.101123"},{"key":"bibr55-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1080\/10494820.2022.2066137"},{"key":"bibr56-07356331221127300","doi-asserted-by":"publisher","DOI":"10.29140\/jaltcall.v13n2.215"},{"issue":"3","key":"bibr57-07356331221127300","first-page":"34","volume":"23","author":"Vygotsky L.","year":"1978","journal-title":"Readings on the Development of Children"},{"key":"bibr58-07356331221127300","doi-asserted-by":"publisher","DOI":"10.11648\/j.ijll.20190705.16"},{"key":"bibr59-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1080\/09588221.2012.655300"},{"key":"bibr60-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1108\/LHT-05-2020-0113"},{"key":"bibr61-07356331221127300","first-page":"58","volume-title":"Handbook of automated essay evaluation","author":"Weigle S. C.","year":"2013"},{"issue":"1","key":"bibr62-07356331221127300","first-page":"51","volume":"2","author":"White H. D.","year":"2009","journal-title":"The Handbook of Research Synthesis and Meta-Analysis"},{"key":"bibr63-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2016.05.004"},{"key":"bibr64-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1177\/0735633119830764"},{"issue":"1","key":"bibr65-07356331221127300","first-page":"1","volume":"1","author":"Xu J.","year":"2021","journal-title":"The Asia-Pacific Education Researcher"},{"key":"bibr66-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1080\/09588221.2018.1501069"},{"key":"bibr67-07356331221127300","doi-asserted-by":"crossref","unstructured":"Zhai N., Ma X. (2021). Automated writing evaluation (AWE) feedback: A systematic investigation of college students\u2019 acceptance (pp. 1\u201326). Computer Assisted Language Learning.","DOI":"10.1080\/09588221.2021.1897019"},{"key":"bibr68-07356331221127300","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2019.103668"}],"container-title":["Journal of Educational Computing Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/07356331221127300","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/07356331221127300","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/07356331221127300","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T21:11:35Z","timestamp":1777497095000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/07356331221127300"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,17]]},"references-count":68,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,7]]}},"alternative-id":["10.1177\/07356331221127300"],"URL":"https:\/\/doi.org\/10.1177\/07356331221127300","relation":{},"ISSN":["0735-6331","1541-4140"],"issn-type":[{"value":"0735-6331","type":"print"},{"value":"1541-4140","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,17]]}}}