{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,22]],"date-time":"2026-07-22T23:37:39Z","timestamp":1784763459001,"version":"3.55.0"},"reference-count":67,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2026,6,8]],"date-time":"2026-06-08T00:00:00Z","timestamp":1780876800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001839","name":"Research Grants Council of the Hong Kong Special Administrative Region, China","doi-asserted-by":"publisher","award":["PolyU 15603225"],"award-info":[{"award-number":["PolyU 15603225"]}],"id":[{"id":"10.13039\/501100001839","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JEMR"],"abstract":"<jats:p>Translation and post-editing both integrate reading into bilingual text production, yet it remains unclear which computational predictors from multilingual pre-trained models best account for translators\u2019 reading patterns across task types and translation directions. We recruited twenty-six Chinese L1 translators who completed en\u2192zh and zh\u2192en translation and post-editing tasks, yielding 104 eye-tracking sessions. Dependent measures were source reading time (TrtS), target reading time (TrtT), and target production duration (Dur). Predictors were derived from two model architectures, a decoder-only language model (LM) and an encoder\u2013decoder neural machine translation (NMT) model, and they included monolingual surprisal, translation surprisal with source context, and attention features computed from models\u2019 internal weights. Analyses showed that LM surprisal provided the strongest account of target reading, while source reading was most strongly predicted by encoder self-attention with LM surprisal, a robust secondary predictor, and target production duration drew on both LM and NMT translation surprisal. Direction effects were broader than task effects, especially on target measures. These findings suggest that although translation reading is bilingual in task structure, cumulative reading time is best explained by monolingual LM surprisal, whereas production duration additionally reflects NMT translation surprisal and revision behavior.<\/jats:p>","DOI":"10.3390\/jemr19030066","type":"journal-article","created":{"date-parts":[[2026,6,9]],"date-time":"2026-06-09T00:43:54Z","timestamp":1780965834000},"page":"66","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Reading to Translate or Translating to Read? Modeling Translators\u2019 Eye Movements with Multilingual Pre-Trained Models"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-0589-4459","authenticated-orcid":false,"given":"Yiyu","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Foreign Languages, China University of Geosciences (Wuhan), Wuhan 430074, China"},{"name":"Department of Language Science and Technology, The Hong Kong Polytechnic University, Hong Kong SAR, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-0299-1387","authenticated-orcid":false,"given":"Xiajing","family":"Yao","sequence":"additional","affiliation":[{"name":"School of Foreign Languages, China University of Geosciences (Wuhan), Wuhan 430074, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6312-6581","authenticated-orcid":false,"given":"Dechao","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Language Science and Technology, The Hong Kong Polytechnic University, Hong Kong SAR, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,6,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"372","DOI":"10.1037\/0033-2909.124.3.372","article-title":"Eye movements in reading and information processing: 20 years of research","volume":"124","author":"Rayner","year":"1998","journal-title":"Psychol. Bull."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1111\/lnc3.12144","article-title":"Computational models of reading: A primer","volume":"9","author":"Reichle","year":"2015","journal-title":"Lang. Linguist. Compass"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"van Gompel, R.P.G., Fischer, M.H., Murray, W.S., and Hill, R.L. (2007). Eye movements in reading words and sentences. Eye Movements: A Window on Mind and Brain, Elsevier.","DOI":"10.1016\/B978-008044980-7\/50003-3"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cognition.2004.09.012","article-title":"Reading for repetition and reading for translation: Do they involve the same processes?","volume":"99","author":"Macizo","year":"2006","journal-title":"Cognition"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"234","DOI":"10.7202\/1027474ar","article-title":"Evidence of parallel processing during translation","volume":"59","author":"Balling","year":"2014","journal-title":"Meta"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Carl, M., Bangalore, S., and Schaeffer, M. (2016). The CRITT translation process research database. New Directions in Empirical Translation Process Research, Springer.","DOI":"10.1007\/978-3-319-20358-4"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Schaeffer, M., and Carl, M. (2014, January 26). Measuring the cognitive effort of literal translation processes. Proceedings of the EACL 2014 Workshop on Humans and Computer-Assisted Translation, Gothenburg, Sweden.","DOI":"10.3115\/v1\/W14-0306"},{"key":"ref_8","first-page":"107","article-title":"Machine translation errors and the translation process: A study across different languages","volume":"31","author":"Carl","year":"2019","journal-title":"J. Spec. Transl."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Nitzke, J. (2019). Problem Solving Activities in Post-Editing and Translation from Scratch: A Multi-Method Study, Language Science Press.","DOI":"10.4324\/9780429030376-5"},{"key":"ref_10","first-page":"43","article-title":"Why translation is difficult: A corpus-based study of non-literality in post-editing and from-scratch translation","volume":"56","author":"Carl","year":"2017","journal-title":"Hermes"},{"key":"ref_11","unstructured":"Wei, Y. (2022, January 12\u201316). Entropy as a measurement of cognitive load in translation. Proceedings of the 15th Biennial Conference of the Association for Machine Translation in the Americas, Orlando, FL, USA. Workshop 1: Empirical Translation Process Research."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Lim, Z.W., Cohn, T., Kemp, C., and Vylomova, E. (2023). Predicting human translation difficulty using automatic word alignment. Findings of the Association for Computational Linguistics: ACL 2023, Association for Computational Linguistics.","DOI":"10.18653\/v1\/2023.findings-acl.736"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1479","DOI":"10.1162\/tacl_a_00714","article-title":"Predicting human translation difficulty with neural machine translation","volume":"12","author":"Lim","year":"2024","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Hale, J. (2001, January 2\u20137). A probabilistic Earley parser as a psycholinguistic model. Proceedings of the Second Meeting of the North American Chapter of the Association for Computational Linguistics on Language Technologies, Pittsburgh, PA, USA.","DOI":"10.3115\/1073336.1073357"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1126","DOI":"10.1016\/j.cognition.2007.05.006","article-title":"Expectation-based syntactic comprehension","volume":"106","author":"Levy","year":"2008","journal-title":"Cognition"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Reichle, E.D. (2021). Computational Models of Reading: A Handbook, Oxford University Press.","DOI":"10.1093\/oso\/9780195370669.001.0001"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1457","DOI":"10.1080\/17470210902816461","article-title":"Eye movements and attention in reading, scene perception, and visual search","volume":"62","author":"Rayner","year":"2009","journal-title":"Q. J. Exp. Psychol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1561","DOI":"10.1037\/a0020693","article-title":"Task effects on eye movements during reading","volume":"36","author":"Kaakinen","year":"2010","journal-title":"J. Exp. Psychol. Learn. Mem. Cogn."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.16910\/jemr.11.1.1","article-title":"One page of text: Eye movements during regular and thorough reading, skimming, and spell checking","volume":"11","author":"Strukelj","year":"2018","journal-title":"J. Eye Mov. Res."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Cop, U., Drieghe, D., and Duyck, W. (2015). Eye movement patterns in natural reading: A comparison of monolingual and bilingual reading of a novel. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0134008"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1037\/0278-7393.33.4.663","article-title":"Visual word recognition by bilinguals in a sentence context: Evidence for nonselective lexical access","volume":"33","author":"Duyck","year":"2007","journal-title":"J. Exp. Psychol. Learn. Mem. Cogn."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1466","DOI":"10.1037\/xhp0001161","article-title":"Parafoveal processing in bilingual readers: Semantic access within but not across languages","volume":"49","author":"Hoversten","year":"2023","journal-title":"J. Exp. Psychol. Hum. Percept. Perform."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"100156","DOI":"10.1016\/j.amper.2023.100156","article-title":"Cognitive aspects of compound translation: Insights into the relation between implicitation and cognitive effort from a translation process perspective","volume":"11","author":"Deilen","year":"2023","journal-title":"Ampersand"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wang, Y., Li, S., and Rasmussen, Y.Z. (2025). Translators\u2019 allocation of cognitive resources in two translation directions: A study using eye-tracking and keystroke logging. Appl. Sci., 15.","DOI":"10.20944\/preprints202501.0525.v1"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Chen, S., Feng, J., and Carl, M. (2025). Exploring preparatory reading in bidirectional sight and written translation through clustering analysis of eye-tracking data. PLoS ONE, 20.","DOI":"10.1371\/journal.pone.0329858"},{"key":"ref_26","unstructured":"Monsalve, I.F., Frank, S.L., and Vigliocco, G. (2012, January 23\u201327). Lexical surprisal as a general predictor of reading time. Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics, Avignon, France."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1016\/j.cognition.2013.02.013","article-title":"The effect of word predictability on reading time is logarithmic","volume":"128","author":"Smith","year":"2013","journal-title":"Cognition"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"e2307876121","DOI":"10.1073\/pnas.2307876121","article-title":"Large-scale evidence for logarithmic effects of word predictability on reading time","volume":"121","author":"Shain","year":"2024","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1451","DOI":"10.1162\/tacl_a_00612","article-title":"Testing the predictions of surprisal theory in 11 languages","volume":"11","author":"Wilcox","year":"2023","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"829","DOI":"10.1177\/0956797611409589","article-title":"Insensitivity of the human sentence-processing system to hierarchical structure","volume":"22","author":"Frank","year":"2011","journal-title":"Psychol. Sci."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Goodkind, A., and Bicknell, K. (2018, January 7). Predictive power of word surprisal for reading times is a linear function of language model quality. Proceedings of the 8th Workshop on Cognitive Modeling and Computational Linguistics (CMCL 2018), Salt Lake City, UT, USA.","DOI":"10.18653\/v1\/W18-0102"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Kuribayashi, T., Oseki, Y., Ito, T., Yoshida, R., Asahara, M., and Inui, K. (2021, January 1\u20136). Lower perplexity is not always human-like. Proceedings of the ACL-IJCNLP 2021 (Volume 1: Long Papers), Online.","DOI":"10.18653\/v1\/2021.acl-long.405"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Oh, B.-D., and Schuler, W. (2023, January 6\u201310). Transformer-based language model surprisal predicts human reading times best with about two billion training tokens. Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, Singapore.","DOI":"10.18653\/v1\/2023.findings-emnlp.128"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"104677","DOI":"10.1016\/j.jml.2025.104677","article-title":"Language models that match reader experience are better predictors of reading times","volume":"146","author":"Demberg","year":"2026","journal-title":"J. Mem. Lang."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Chen, L., Oralova, G., Fang, X., Clark, S., Teodorescu, D., Helfrich, M., Fyshe, A., Demmans Epp, C., and Perfetti, C. (2026). Text difficulty modulates the surprisal effect in self-paced reading. Read. Writ., advance online publication.","DOI":"10.1007\/s11145-026-10768-7"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1743","DOI":"10.1162\/TACL.a.58","article-title":"Large language models are human-like internally","volume":"13","author":"Kuribayashi","year":"2025","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_37","unstructured":"Kuribayashi, T., Warstadt, A., Oseki, Y., and Wilcox, E. (2026). Dual alignment between language model layers and human sentence processing. arXiv."},{"key":"ref_38","unstructured":"Wang, S.-F., Pr\u00e9vot, L., Chi, J.-A., Huang, R.-S., and Hsieh, S.-K. (2025). Spontaneous speech variables for evaluating LLMs cognitive plausibility. arXiv."},{"key":"ref_39","unstructured":"Clark, T.H., Arriaga, C., Conde, J., Mart\u00ednez, G., and Reviriego, P. (2026). To words and beyond: Probing large language models for sentence-level psycholinguistic norms of memorability and reading times. arXiv."},{"key":"ref_40","unstructured":"Costa-jussa, M.R., Cross, J., \u00c7elebi, O., Elbayad, M., Heafield, K., Heffernan, K., Kalbassi, E., Lam, J., Licht, D., and Maillard, J. (2022). No language left behind: Scaling human-centered machine translation. arXiv."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Oh, B.-D., and Schuler, W. (2022, January 7\u201311). Entropy-and distance-based predictors from GPT-2 attention patterns predict reading times over and above GPT-2 surprisal. Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, Abu Dhabi, United Arab Emirates.","DOI":"10.18653\/v1\/2022.emnlp-main.632"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Ryu, S.H., and Lewis, R.L. (2021, January 10). Accounting for agreement phenomena in sentence comprehension with transformer language models: Effects of similarity-based interference on surprisal and attention. Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics, Online.","DOI":"10.18653\/v1\/2021.cmcl-1.6"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Ferrando, J., and Costa-jussa, M.R. (2021, January 9). Attention weights in transformer NMT fail aligning words between sequences but largely explain model predictions. Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, Virtual.","DOI":"10.18653\/v1\/2021.findings-emnlp.39"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Opedal, A., Chodroff, E., Cotterell, R., and Wilcox, E.G. (2024). On the role of context in reading time prediction. arXiv.","DOI":"10.18653\/v1\/2024.emnlp-main.179"},{"key":"ref_45","unstructured":"Hurst, A., Lerer, A., Goucher, A., Perelman, A., Brundage, M., Epstein, A., and McGrew, B. (2024). GPT-4o system card. arXiv."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Carl, M. (2012, January 21\u201327). Translog-II: A program for recording user activity data for empirical reading and writing research. Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC\u201912), Istanbul, Turkey.","DOI":"10.63317\/4yt2527b3dza"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1177\/0265532216643630","article-title":"China Accreditation Test for Translators and Interpreters (CATTI): Test review based on the language pairing of English and Chinese","volume":"33","author":"Zhao","year":"2016","journal-title":"Lang. Test."},{"key":"ref_48","first-page":"120","article-title":"Investigating the content validity of practical translation test in CATTI Level II","volume":"2","author":"Xu","year":"2022","journal-title":"Transl. Res. Teach."},{"key":"ref_49","unstructured":"Tseng, A. (2025, December 01). mDeBERTa-V3-Base-Readability: A Fine-Tuned Multilingual DeBERTa Model for Cross-Lingual Readability Assessment; Hugging Face, 2024. Available online: https:\/\/huggingface.co\/agentlans\/mdeberta-v3-base-readability."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Carl, M. (2021). Translation norms, translation behavior, and continuous vector space models. Explorations in Empirical Translation Process Research, Springer.","DOI":"10.1007\/978-3-030-69777-8"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1162\/tacl_a_00633","article-title":"mGPT: Few-shot learners go multilingual","volume":"12","author":"Shliazhko","year":"2024","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_52","unstructured":"Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2019, January 2\u20137). BERT: Pre-training of deep bidirectional transformers for language understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, MN, USA. Volume 1 (Long and Short Papers)."},{"key":"ref_53","unstructured":"Wang, A., and Cho, K. (2019, January 2\u20137). BERT has a mouth, and it must speak: BERT as a Markov random field language model. Proceedings of the Workshop on Methods for Optimizing and Evaluating Neural Language Generation, Minneapolis, MN, USA."},{"key":"ref_54","first-page":"421","article-title":"Masked language model scoring","volume":"8","author":"Salazar","year":"2020","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1016\/j.jml.2012.11.001","article-title":"Random effects structure for confirmatory hypothesis testing: Keep it maximal","volume":"68","author":"Barr","year":"2013","journal-title":"J. Mem. Lang."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: A practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"J. R. Stat. Soc. Ser. B Methodol."},{"key":"ref_57","unstructured":"R Core Team (2026). R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing. Available online: https:\/\/www.r-project.org\/."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v067.i01","article-title":"Fitting linear mixed-effects models using lme4","volume":"67","author":"Bates","year":"2015","journal-title":"J. Stat. Softw."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"730","DOI":"10.1198\/016214501753168389","article-title":"A two-part random-effects model for semicontinuous longitudinal data","volume":"96","author":"Olsen","year":"2001","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1017\/S1366728902003012","article-title":"The architecture of the bilingual word recognition system: From identification to decision","volume":"5","author":"Dijkstra","year":"2002","journal-title":"Bilingualism"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"490","DOI":"10.1016\/j.actpsy.2007.08.004","article-title":"Activation of lexical and syntactic target language properties in translation","volume":"128","author":"Ruiz","year":"2008","journal-title":"Acta Psychol."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"1216","DOI":"10.3758\/s13423-015-0819-2","article-title":"Frequency effects in monolingual and bilingual natural reading","volume":"22","author":"Cop","year":"2015","journal-title":"Psychon. Bull. Rev."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1007\/s10590-016-9188-5","article-title":"How do measures of cognitive effort relate to each other? A multivariate analysis of post-editing process data","volume":"30","author":"Vieira","year":"2016","journal-title":"Mach. Transl."},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Daems, J., Vandepitte, S., Hartsuiker, R.J., and Macken, L. (2017). Identifying the machine translation error types with the greatest impact on post-editing effort. Front. Psychol., 8.","DOI":"10.3389\/fpsyg.2017.01282"},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1007\/s10590-019-09228-7","article-title":"A product and process analysis of post-editor corrections on neural, statistical and rule-based machine translation output","volume":"33","author":"Koponen","year":"2019","journal-title":"Mach. Transl."},{"key":"ref_66","unstructured":"Jain, S., and Wallace, B.C. (2019, January 2\u20137). Attention is not explanation. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, MN, USA. Volume 1 (Long and Short Papers)."},{"key":"ref_67","unstructured":"Serrano, S., and Smith, N.A. (August, January 28). Is attention interpretable?. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy."}],"container-title":["Journal of Eye Movement Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1995-8692\/19\/3\/66\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,9]],"date-time":"2026-06-09T01:21:49Z","timestamp":1780968109000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1995-8692\/19\/3\/66"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,8]]},"references-count":67,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2026,6]]}},"alternative-id":["jemr19030066"],"URL":"https:\/\/doi.org\/10.3390\/jemr19030066","relation":{},"ISSN":["1995-8692"],"issn-type":[{"value":"1995-8692","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,8]]}}}