{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,9]],"date-time":"2026-06-09T12:26:32Z","timestamp":1781007992976,"version":"3.54.1"},"reference-count":99,"publisher":"MIT Press","license":[{"start":{"date-parts":[[2024,11,21]],"date-time":"2024-11-21T00:00:00Z","timestamp":1732147200000},"content-version":"vor","delay-in-days":3,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,11,18]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Human translators linger on some words and phrases more than others, and predicting this variation is a step towards explaining the underlying cognitive processes. Using data from the CRITT Translation Process Research Database, we evaluate the extent to which surprisal and attentional features derived from a Neural Machine Translation (NMT) model account for reading and production times of human translators. We find that surprisal and attention are complementary predictors of translation difficulty, and that surprisal derived from a NMT model is the single most successful predictor of production duration. Our analyses draw on data from hundreds of translators operating across 13 language pairs, and represent the most comprehensive investigation of human translation difficulty to date.<\/jats:p>","DOI":"10.1162\/tacl_a_00714","type":"journal-article","created":{"date-parts":[[2024,11,21]],"date-time":"2024-11-21T19:15:53Z","timestamp":1732216553000},"page":"1479-1496","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":4,"title":["Predicting Human Translation Difficulty with Neural Machine Translation"],"prefix":"10.1162","volume":"12","author":[{"given":"Zheng Wei","family":"Lim","sequence":"first","affiliation":[{"name":"The University of Melbourne, Australia. z.lim4@student.unimelb.edu.au"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ekaterina","family":"Vylomova","sequence":"additional","affiliation":[{"name":"The University of Melbourne, Australia. vylomovae@unimelb.edu.au"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Charles","family":"Kemp","sequence":"additional","affiliation":[{"name":"The University of Melbourne, Australia. c.kemp@unimelb.edu.au"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Trevor","family":"Cohn","sequence":"additional","affiliation":[{"name":"The University of Melbourne, Australia. t.cohn@unimelb.edu.au"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","published-online":{"date-parts":[[2024,11,18]]},"reference":[{"key":"2024112119154819000_bib1","doi-asserted-by":"publisher","first-page":"3874","DOI":"10.18653\/v1\/N19-1388","article-title":"Massively multilingual neural machine translation","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)","author":"Aharoni","year":"2019"},{"key":"2024112119154819000_bib2","doi-asserted-by":"publisher","first-page":"177","DOI":"10.18653\/v1\/W18-6318","article-title":"On the alignment problem in multi-head attention-based neural machine translation","volume-title":"Proceedings of the Third Conference on Machine Translation: Research Papers","author":"Alkhouli","year":"2018"},{"issue":"1","key":"2024112119154819000_bib3","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1075\/target.25.1.09alv","article-title":"Investigating the conceptual-procedural distinction in the translation process: A relevance-theoretic analysis of micro and macro translation units","volume":"25","author":"Alves","year":"2013","journal-title":"Target. International Journal of Translation Studies"},{"issue":"2","key":"2024112119154819000_bib4","doi-asserted-by":"publisher","first-page":"234","DOI":"10.7202\/1027474ar","article-title":"Evidence of parallel processing during translation","volume":"59","author":"Balling","year":"2014","journal-title":"Meta"},{"key":"2024112119154819000_bib5","doi-asserted-by":"publisher","first-page":"4029","DOI":"10.18653\/v1\/2020.emnlp-main.330","article-title":"Surprisal predicts code-switching in Chinese-English bilingual text","volume-title":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Calvillo","year":"2020"},{"issue":"1","key":"2024112119154819000_bib6","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1075\/target.11.1.03cam","article-title":"A cognitive approach to source text difficulty in translation","volume":"11","author":"Campbell","year":"1999","journal-title":"Target. International Journal of Translation Studies"},{"key":"2024112119154819000_bib7","article-title":"The CRITT TPR-DB 1.0: A database for empirical human translation process research","volume-title":"Workshop on Post-Editing Technology and Practice","author":"Carl","year":"2012"},{"key":"2024112119154819000_bib8","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1007\/978-3-030-69777-8_5","article-title":"Information and entropy measures of rendered literal translation","author":"Carl","year":"2021","journal-title":"Explorations in Empirical Translation Process Research"},{"key":"2024112119154819000_bib9","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1007\/978-3-030-69777-8_14","article-title":"Translation norms, translation behavior, and continuous vector space models","volume-title":"Explorations in Empirical Translation Process Research","author":"Carl","year":"2021"},{"key":"2024112119154819000_bib10","first-page":"4024","article-title":"English-to-Japanese translation vs. dictation vs. post-editing: Comparing translation modes in a multilingual setting","volume-title":"Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC\u201916)","author":"Carl","year":"2016"},{"key":"2024112119154819000_bib11","first-page":"107","article-title":"Machine translation errors and the translation process: A study across different languages","volume":"31","author":"Carl","year":"2019","journal-title":"Journal of Specialised Translation"},{"key":"2024112119154819000_bib12","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1007\/978-3-319-20358-4_2","article-title":"The CRITT translation process research database","volume-title":"New Directions in Empirical Translation process research","author":"Carl","year":"2016"},{"key":"2024112119154819000_bib13","doi-asserted-by":"publisher","first-page":"43","DOI":"10.7146\/hjlcb.v0i56.97201","article-title":"Why translation is difficult: A corpus-based study of non-literality in post-editing and from-scratch translation","volume":"56","author":"Carl","year":"2017","journal-title":"HERMES-Journal of Language and Communication in Business"},{"key":"2024112119154819000_bib14","article-title":"On factors influencing typing time: Insights from a viral online typing game","volume-title":"Proceedings of the Annual Meeting of the Cognitive Science Society","author":"Chen","year":"2021"},{"key":"2024112119154819000_bib15","article-title":"Phone information content influences phone duration","volume-title":"Conference on Prosody and Language Processing","author":"Cohen-Priva","year":"2008"},{"key":"2024112119154819000_bib16","article-title":"No language left behind: Scaling human-centered machine translation","author":"Costa-juss\u00e0","year":"2022","journal-title":"arXiv preprint arXiv:2207.04672v3"},{"issue":"01","key":"2024112119154819000_bib17","doi-asserted-by":"publisher","first-page":"6292","DOI":"10.1609\/aaai.v33i01.33016292","article-title":"Recurrent stacking of layers for compact neural machine translation models","volume":"33","author":"Dabre","year":"2019","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"2024112119154819000_bib18","doi-asserted-by":"publisher","first-page":"103","DOI":"10.18653\/v1\/N19-3015","article-title":"Expectation and locality effects in the prediction of disfluent fillers and repairs in English speech","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Student Research Workshop","author":"Dammalapati","year":"2019"},{"key":"2024112119154819000_bib19","first-page":"91","article-title":"Effects of duration, locality, and surprisal in speech disfluency prediction in English spontaneous speech","volume-title":"Proceedings of the Society for Computation in Linguistics 2021","author":"Dammalapati","year":"2021"},{"key":"2024112119154819000_bib20","doi-asserted-by":"publisher","first-page":"3608","DOI":"10.18653\/v1\/2022.acl-long.252","article-title":"Can transformer be too compositional? Analysing idiom processing in neural machine translation","volume-title":"Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Dankers","year":"2022"},{"key":"2024112119154819000_bib21","doi-asserted-by":"publisher","first-page":"139","DOI":"10.18653\/v1\/2023.acl-short.14","article-title":"Scaling in cognitive modelling: A multilingual approach to human reading times","volume-title":"Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)","author":"De Varda","year":"2023"},{"key":"2024112119154819000_bib22","doi-asserted-by":"publisher","first-page":"100156","DOI":"10.1016\/j.amper.2023.100156","article-title":"Cognitive aspects of compound translation: Insights into the relation between implicitation and cognitive effort from a translation process perspective","volume":"11","author":"Deilen","year":"2023","journal-title":"Ampersand"},{"key":"2024112119154819000_bib23","first-page":"356","article-title":"Syntactic surprisal affects spoken word duration in conversational contexts","volume-title":"Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning","author":"Demberg","year":"2012"},{"key":"2024112119154819000_bib24","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1075\/ata.xv.04dra","article-title":"Coordination of reading and writing processes in translation: An eye on uncharted territory","volume-title":"Translation and Cognition","author":"Dragsted","year":"2010"},{"key":"2024112119154819000_bib25","doi-asserted-by":"publisher","first-page":"434","DOI":"10.18653\/v1\/2021.findings-emnlp.39","article-title":"Attention weights in transformer NMT fail aligning words between sequences but largely explain model predictions","volume-title":"Findings of the Association for Computational Linguistics: EMNLP 2021","author":"Ferrando","year":"2021"},{"key":"2024112119154819000_bib26","doi-asserted-by":"publisher","first-page":"657725","DOI":"10.3389\/fcomm.2022.657725","article-title":"Information theory as a bridge between language function and language form","volume":"7","author":"Futrell","year":"2022","journal-title":"Frontiers in Communication"},{"key":"2024112119154819000_bib27","doi-asserted-by":"publisher","first-page":"10","DOI":"10.18653\/v1\/W18-0102","article-title":"Predictive power of word surprisal for reading times is a linear function of language model quality","volume-title":"Proceedings of the 8th Workshop on Cognitive Modeling and Computational Linguistics (CMCL 2018)","author":"Goodkind","year":"2018"},{"key":"2024112119154819000_bib28","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1007\/978-3-662-43585-4_14","article-title":"A cross-lingual correcting and completive method for multilingual ontology labels","author":"Gromann","year":"2014","journal-title":"Towards the Multilingual Semantic Web: Principles, Methods and Applications"},{"key":"2024112119154819000_bib29","doi-asserted-by":"publisher","DOI":"10.3115\/1073336.1073357","article-title":"A probabilistic Earley parser as a psycholinguistic model","volume-title":"Second Meeting of the North American Chapter of the Association for Computational Linguistics on Language technologies 2001-NAACL\u201901","author":"Hale","year":"2001"},{"key":"2024112119154819000_bib30","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1023\/A:1022492123056","article-title":"The information conveyed by words in sentences","volume":"32","author":"Hale","year":"2003","journal-title":"Journal of Psycholinguistic Research"},{"key":"2024112119154819000_bib31","doi-asserted-by":"publisher","first-page":"953","DOI":"10.18653\/v1\/D19-1088","article-title":"Towards understanding neural machine translation with word importance","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"He","year":"2019"},{"key":"2024112119154819000_bib32","first-page":"319","article-title":"Effects of L1 syntax on L2 translation","volume":"38","author":"Jensen","year":"2009","journal-title":"Copenhagen Studies in Language"},{"key":"2024112119154819000_bib33","doi-asserted-by":"publisher","first-page":"1","DOI":"10.7551\/mitpress\/5582.003.0006","article-title":"Probabilistic modeling in psycholinguistics: Linguistic comprehension and production","volume":"21","author":"Jurafsky","year":"2003","journal-title":"Probabilistic Linguistics"},{"key":"2024112119154819000_bib34","doi-asserted-by":"publisher","first-page":"567","DOI":"10.18653\/v1\/2023.bea-1.48","article-title":"A dynamic model of lexical experience for tracking of oral reading fluency","volume-title":"Proceedings of the 18th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2023)","author":"Klebanov","year":"2023"},{"key":"2024112119154819000_bib35","doi-asserted-by":"publisher","first-page":"1565","DOI":"10.18653\/v1\/D19-1167","article-title":"Investigating multilingual NMT representations at scale","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Kudugunta","year":"2019"},{"issue":"10","key":"2024112119154819000_bib36","doi-asserted-by":"publisher","first-page":"e13343","DOI":"10.1111\/cogs.13343","article-title":"Bayesian surprise predicts human event segmentation in story listening","volume":"47","author":"Kumar","year":"2023","journal-title":"Cognitive Science"},{"key":"2024112119154819000_bib37","doi-asserted-by":"publisher","first-page":"5203","DOI":"10.18653\/v1\/2021.acl-long.405","article-title":"Lower perplexity is not always human-like","volume-title":"Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)","author":"Kuribayashi","year":"2021"},{"issue":"3","key":"2024112119154819000_bib38","doi-asserted-by":"publisher","first-page":"1126","DOI":"10.1016\/j.cognition.2007.05.006","article-title":"Expectation-based syntactic comprehension","volume":"106","author":"Levy","year":"2008","journal-title":"Cognition"},{"key":"2024112119154819000_bib39","first-page":"78","article-title":"Memory and surprisal in human sentence comprehension","volume-title":"Sentence Processing","author":"Levy","year":"2013"},{"key":"2024112119154819000_bib40","doi-asserted-by":"publisher","first-page":"849","DOI":"10.7551\/mitpress\/7503.003.0111","article-title":"Speakers optimize information density through syntactic reduction","volume-title":"Proceedings of the 19th International Conference on Neural Information Processing Systems","author":"Levy","year":"2006"},{"key":"2024112119154819000_bib41","first-page":"577","article-title":"Cross-lingual discourse relation analysis: A corpus study and a semi-supervised classification system","volume-title":"Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers","author":"Li","year":"2014"},{"key":"2024112119154819000_bib42","doi-asserted-by":"publisher","first-page":"1293","DOI":"10.18653\/v1\/P19-1124","article-title":"On the word alignment from neural machine translation","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"Li","year":"2019"},{"key":"2024112119154819000_bib43","first-page":"685","article-title":"Mechanics of next token prediction with self-attention","volume-title":"International Conference on Artificial Intelligence and Statistics","author":"Li","year":"2024"},{"key":"2024112119154819000_bib44","doi-asserted-by":"publisher","first-page":"11590","DOI":"10.18653\/v1\/2023.findings-acl.736","article-title":"Predicting human translation difficulty using automatic word alignment","volume-title":"Findings of the Association for Computational Linguistics: ACL 2023","author":"Lim","year":"2023"},{"key":"2024112119154819000_bib45","article-title":"Simpson\u2019s paradox and the accuracy-fluency tradeoff in translation","author":"Lim","year":"2024","journal-title":"arXiv preprint arXiv:2402.12690v2"},{"issue":"6","key":"2024112119154819000_bib46","doi-asserted-by":"publisher","first-page":"1382","DOI":"10.1111\/cogs.12274","article-title":"Uncertainty and expectation in sentence processing: Evidence from subcategorization distributions","volume":"40","author":"Linzen","year":"2016","journal-title":"Cognitive Science"},{"issue":"4","key":"2024112119154819000_bib47","doi-asserted-by":"publisher","first-page":"1166","DOI":"10.1111\/cogs.12597","article-title":"Lexical predictability during natural reading: Effects of surprisal and entropy reduction.","volume":"42","author":"Lowder","year":"2018","journal-title":"Cognitive Science"},{"key":"2024112119154819000_bib48","doi-asserted-by":"publisher","first-page":"1288","DOI":"10.18653\/v1\/2021.acl-long.103","article-title":"Attention calibration for transformer in neural machine translation","volume-title":"Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)","author":"Yu","year":"2021"},{"issue":"2","key":"2024112119154819000_bib49","first-page":"181","article-title":"When translation makes the difference: Sentence processing in reading and translation","volume":"25","author":"Macizo","year":"2004","journal-title":"Psicol\u00f3gica"},{"issue":"1","key":"2024112119154819000_bib50","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.cognition.2004.09.012","article-title":"Reading for repetition and reading for translation: Do they involve the same processes?","volume":"99","author":"Macizo","year":"2006","journal-title":"Cognition"},{"issue":"8","key":"2024112119154819000_bib51","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3546577","article-title":"Post-hoc interpretability for neural NLP: A survey","volume":"55","author":"Madsen","year":"2022","journal-title":"ACM Computing Surveys"},{"key":"2024112119154819000_bib52","doi-asserted-by":"publisher","first-page":"25","DOI":"10.3389\/fcomm.2018.00025","article-title":"Dimensions of segmental variability: Interaction of prosody and surprisal in six languages","volume":"3","author":"Malisz","year":"2018","journal-title":"Frontiers in Communication"},{"key":"2024112119154819000_bib53","article-title":"Nuremberg: The trial of six million words","author":"Matasov","year":"2017"},{"key":"2024112119154819000_bib54","doi-asserted-by":"publisher","first-page":"963","DOI":"10.18653\/v1\/2021.emnlp-main.74","article-title":"Revisiting the uniform information density hypothesis","volume-title":"Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing","author":"Meister","year":"2021"},{"key":"2024112119154819000_bib55","first-page":"219","article-title":"Gaze behaviour on source texts: An exploratory study comparing translation and post-editing","volume-title":"Post-editing of Machine Translation: Processes and Applications","author":"Mesa-Lao","year":"2014"},{"key":"2024112119154819000_bib56","doi-asserted-by":"publisher","first-page":"955","DOI":"10.18653\/v1\/D16-1096","article-title":"Coverage embedding models for neural machine translation","volume-title":"Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing","author":"Mi","year":"2016"},{"key":"2024112119154819000_bib57","first-page":"398","article-title":"Lexical surprisal as a general predictor of reading time","volume-title":"Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics","author":"Monsalve","year":"2012"},{"key":"2024112119154819000_bib58","doi-asserted-by":"publisher","first-page":"227","DOI":"10.18653\/v1\/2023.wmt-1.82","article-title":"Adaptive machine translation with large language models","volume-title":"Proceedings of the 24th Annual Conference of the European Association for Machine Translation","author":"Moslem","year":"2023"},{"key":"2024112119154819000_bib59","first-page":"151","article-title":"Domain robustness in neural machine translation","volume-title":"Proceedings of the 14th Conference of the Association for Machine Translation in the Americas (Volume 1: Research Track)","author":"M\u00fcller","year":"2020"},{"key":"2024112119154819000_bib60","doi-asserted-by":"publisher","DOI":"10.4324\/9780429030376-5","volume-title":"Problem Solving Activities in Post-editing and Translation from Scratch: A Multi-method Study","author":"Nitzke","year":"2019"},{"issue":"4","key":"2024112119154819000_bib61","doi-asserted-by":"publisher","first-page":"405","DOI":"10.1556\/2062.2022.00580","article-title":"Cross-lingual transfer of knowledge in distributional language models: Experiments in Hungarian","volume":"69","author":"Nov\u00e1k","year":"2022","journal-title":"Acta Linguistica Academica"},{"key":"2024112119154819000_bib62","doi-asserted-by":"publisher","first-page":"9324","DOI":"10.18653\/v1\/2022.emnlp-main.632","article-title":"Entropy-and distance-based predictors from GPT-2 attention patterns predict reading times over and above GPT-2 surprisal","volume-title":"Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing","author":"Byung-Doh","year":"2022"},{"key":"2024112119154819000_bib63","doi-asserted-by":"publisher","first-page":"949","DOI":"10.18653\/v1\/2021.emnlp-main.73","article-title":"A surprisal\u2013duration trade-off across and within the world\u2019s languages","volume-title":"Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing","author":"Pimentel","year":"2021"},{"key":"2024112119154819000_bib64","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1007\/978-3-319-20358-4_13","article-title":"Problems of literality in French-Polish translations of a newspaper article","author":"P\u0142o\u0144ska","year":"2016","journal-title":"New Directions in Empirical Translation Process Research: Exploring the CRITT TPR-DB"},{"key":"2024112119154819000_bib65","doi-asserted-by":"publisher","first-page":"464","DOI":"10.18653\/v1\/W19-5353","article-title":"Evaluating conjunction disambiguation on English-to-German and French-to-German WMT 2019 translation hypotheses","volume-title":"Proceedings of the Fourth Conference on Machine Translation (Volume 2: Shared Task Papers, Day 1)","author":"Popovi\u0107","year":"2019"},{"key":"2024112119154819000_bib66","doi-asserted-by":"publisher","first-page":"959","DOI":"10.26615\/978-954-452-056-4_111","article-title":"Are ambiguous conjunctions problematic for machine translation?","volume-title":"Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2019)","author":"Popovi\u0107","year":"2019"},{"issue":"6","key":"2024112119154819000_bib67","doi-asserted-by":"publisher","first-page":"721","DOI":"10.1515\/multi-2014-0066","article-title":"Translation meets cognitive science: The imprint of translation on cognitive processing","volume":"34","author":"Rojo","year":"2015","journal-title":"Multilingua"},{"key":"2024112119154819000_bib68","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1016\/j.cortex.2022.07.005","article-title":"Negative correlation between word-level surprisal and intersubject neural synchronization during narrative listening","volume":"155","author":"Russo","year":"2022","journal-title":"Cortex"},{"key":"2024112119154819000_bib69","doi-asserted-by":"publisher","first-page":"117281","DOI":"10.1016\/j.neuroimage.2020.117281","article-title":"Semantics-weighted lexical surprisal modeling of naturalistic functional MRI time-series during spoken narrative listening","volume":"222","author":"Russo","year":"2020","journal-title":"Neuroimage"},{"key":"2024112119154819000_bib70","doi-asserted-by":"publisher","first-page":"61","DOI":"10.18653\/v1\/2021.cmcl-1.6","article-title":"Accounting for agreement phenomena in sentence comprehension with transformer language models: Effects of similarity-based interference on surprisal and attention","volume-title":"Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics","author":"Ryu","year":"2021"},{"key":"2024112119154819000_bib71","doi-asserted-by":"publisher","first-page":"29","DOI":"10.3115\/v1\/W14-0306","article-title":"Measuring the cognitive effort of literal translation processes","volume-title":"Proceedings of the EACL 2014 Workshop on Humans and Computer-assisted Translation","author":"Schaeffer","year":"2014"},{"key":"2024112119154819000_bib72","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1007\/978-3-319-20358-4_11","article-title":"Cohesive relations in text comprehension and production: An exploratory study comparing translation and post-editing","author":"Schmaltz","year":"2016","journal-title":"New Directions in Empirical Translation Process Research: Exploring the CRITT TPR-DB"},{"key":"2024112119154819000_bib73","article-title":"SeamlessM4T: Massively multilingual & multimodal machine translation","author":"Communication","year":"2023","journal-title":"arXiv preprint arXiv:2308.11596v3"},{"issue":"10","key":"2024112119154819000_bib74","doi-asserted-by":"publisher","first-page":"e2307876121","DOI":"10.1073\/pnas.2307876121","article-title":"Large-scale evidence for logarithmic effects of word predictability on reading time","volume":"121","author":"Shain","year":"2024","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"2024112119154819000_bib75","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1162\/tacl_a_00633","article-title":"mGPT: Few-shot learners go multilingual","volume":"11","author":"Shliazhko","year":"2024","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"2024112119154819000_bib76","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1002\/9781119241485.ch7","article-title":"Aspects of a cognitive model of translation","author":"Shreve","year":"2017","journal-title":"The Handbook of Translation and Cognition"},{"issue":"1","key":"2024112119154819000_bib77","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1075\/target.5.1.03shr","article-title":"Is there a special kind of \u201creading\u201d for translation? An empirical investigation of reading in the translation process","volume":"5","author":"Shreve","year":"1993","journal-title":"Target"},{"key":"2024112119154819000_bib78","volume-title":"Cognitive effort in metaphor translation: An eye-tracking and key-logging study","author":"Sj\u00f8rup","year":"2013"},{"issue":"3","key":"2024112119154819000_bib79","doi-asserted-by":"publisher","first-page":"302","DOI":"10.1016\/j.cognition.2013.02.013","article-title":"The effect of word predictability on reading time is logarithmic","volume":"128","author":"Smith","year":"2013","journal-title":"Cognition"},{"issue":"1","key":"2024112119154819000_bib80","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1556\/084.2015.16.1.2","article-title":"Measuring translation difficulty: Theoretical and methodological considerations","volume":"16","author":"Sun","year":"2015","journal-title":"Across Languages and Cultures"},{"key":"2024112119154819000_bib81","doi-asserted-by":"publisher","DOI":"10.1515\/9783110197808","volume-title":"Morphosyntactic persistence in spoken English: A corpus study at the intersection of variationist sociolinguistics, psycholinguistics, and discourse analysis","author":"Szmrecsanyi","year":"2006"},{"key":"2024112119154819000_bib82","doi-asserted-by":"publisher","first-page":"1429","DOI":"10.18653\/v1\/D19-1149","article-title":"Encoders help you disambiguate word senses in neural machine translation","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Tang","year":"2019"},{"key":"2024112119154819000_bib83","doi-asserted-by":"publisher","first-page":"360","DOI":"10.4324\/9781315178127-24","article-title":"Translation, information theory and cognition","author":"Teich","year":"2020","journal-title":"The Routledge Handbook of Translation and Cognition"},{"key":"2024112119154819000_bib84","first-page":"76","article-title":"Modeling coverage for neural machine translation","volume-title":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Zhaopeng","year":"2016"},{"key":"2024112119154819000_bib85","unstructured":"Bram\n              Vanroy\n            \n          . 2021. Syntactic Difficulties in Translation. Ph.D. thesis, Ghent University."},{"issue":"6","key":"2024112119154819000_bib86","doi-asserted-by":"publisher","first-page":"924","DOI":"10.1080\/0907676X.2019.1594319","article-title":"Correlating process and product data to get an insight into translation difficulty","volume":"27","author":"Vanroy","year":"2019","journal-title":"Perspectives: Studies in Translation Theory and Practice"},{"key":"2024112119154819000_bib87","article-title":"Attention interpretability across NLP tasks","author":"Vashishth","year":"2019","journal-title":"arXiv preprint arXiv:1909.11218v1"},{"key":"2024112119154819000_bib88","article-title":"Attention is all you need","volume-title":"Advances in Neural Information Processing Systems","author":"Vaswani","year":"2017"},{"issue":"1","key":"2024112119154819000_bib89","doi-asserted-by":"publisher","first-page":"216","DOI":"10.12807\/ti.115201.2023.a11","article-title":"Translating science fiction in a CAT tool: Machine translation and segmentation settings","volume":"15","author":"Vieira","year":"2023","journal-title":"Translation & Interpreting"},{"key":"2024112119154819000_bib90","first-page":"75","article-title":"Entropy as a measurement of cognitive load in translation","volume-title":"Proceedings of the 15th biennial conference of the Association for Machine Translation in the Americas (Workshop 1: Empirical Translation Process Research)","author":"Wei","year":"2022"},{"key":"2024112119154819000_bib91","doi-asserted-by":"publisher","first-page":"939","DOI":"10.18653\/v1\/2021.acl-long.76","article-title":"A targeted assessment of incremental processing in neural language models and humans","volume-title":"Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)","author":"Wilcox","year":"2021"},{"key":"2024112119154819000_bib92","first-page":"1707","article-title":"On the predictive power of neural language models for human real-time comprehension behavior","volume-title":"Proceedings of the 42nd Annual Meeting of the Cognitive Science Society","author":"Wilcox","year":"2020"},{"key":"2024112119154819000_bib93","doi-asserted-by":"publisher","first-page":"1451","DOI":"10.1162\/tacl_a_00612","article-title":"Testing the predictions of surprisal theory in 11 languages","volume":"11","author":"Wilcox","year":"2023","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"2024112119154819000_bib94","doi-asserted-by":"publisher","first-page":"4799","DOI":"10.18653\/v1\/2020.findings-emnlp.432","article-title":"On the sub-layer functionalities of transformer decoder","volume-title":"Findings of the Association for Computational Linguistics: EMNLP 2020","author":"Yang","year":"2020"},{"key":"2024112119154819000_bib95","doi-asserted-by":"publisher","first-page":"788","DOI":"10.18653\/v1\/2021.acl-long.65","article-title":"Do context-aware translation models pay the right attention?","volume-title":"Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)","author":"Yin","year":"2021"},{"key":"2024112119154819000_bib96","article-title":"Neural processing of children\u2019s theory of mind in a naturalistic story-listening paradigm","author":"Chi-Lin","year":"2023","journal-title":"PsyArXiv"},{"key":"2024112119154819000_bib97","doi-asserted-by":"publisher","first-page":"1401","DOI":"10.18653\/v1\/2021.findings-emnlp.121","article-title":"Modeling concentrated cross-attention for neural machine translation with Gaussian mixture model","volume-title":"Findings of the Association for Computational Linguistics: EMNLP 2021","author":"Zhang","year":"2021"},{"issue":"5","key":"2024112119154819000_bib98","doi-asserted-by":"publisher","first-page":"726","DOI":"10.1109\/TETCI.2021.3100641","article-title":"A survey on neural network interpretability","volume":"5","author":"Zhang","year":"2021","journal-title":"IEEE Transactions on Emerging Topics in Computational Intelligence"},{"issue":"1","key":"2024112119154819000_bib99","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1111\/j.2041-210X.2009.00001.x","article-title":"A protocol for data exploration to avoid common statistical problems","volume":"1","author":"Zuur","year":"2010","journal-title":"Methods in Ecology and Evolution"}],"container-title":["Transactions of the Association for Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/tacl\/article-pdf\/doi\/10.1162\/tacl_a_00714\/2480383\/tacl_a_00714.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/tacl\/article-pdf\/doi\/10.1162\/tacl_a_00714\/2480383\/tacl_a_00714.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,21]],"date-time":"2024-11-21T19:16:03Z","timestamp":1732216563000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/tacl\/article\/doi\/10.1162\/tacl_a_00714\/125279\/Predicting-Human-Translation-Difficulty-with"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,18]]},"references-count":99,"URL":"https:\/\/doi.org\/10.1162\/tacl_a_00714","relation":{},"ISSN":["2307-387X"],"issn-type":[{"value":"2307-387X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,18]]}}}