{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,1]],"date-time":"2026-06-01T23:20:53Z","timestamp":1780356053842,"version":"3.54.1"},"reference-count":51,"publisher":"MIT Press - Journals","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Transactions of the Association for Computational Linguistics"],"published-print":{"date-parts":[[2019,11]]},"abstract":"<jats:p>We present a multiattentive recurrent neural network architecture for automatic multilingual readability assessment. This architecture considers raw words as its main input, but internally captures text structure and informs its word attention process using other syntax- and morphology-related datapoints, known to be of great importance to readability. This is achieved by a multiattentive strategy that allows the neural network to focus on specific parts of a text for predicting its reading level. We conducted an exhaustive evaluation using data sets targeting multiple languages and prediction task types, to compare the proposed model with traditional, state-of-the-art, and other neural network strategies.<\/jats:p>","DOI":"10.1162\/tacl_a_00278","type":"journal-article","created":{"date-parts":[[2019,7,26]],"date-time":"2019-07-26T19:55:46Z","timestamp":1564170946000},"page":"421-436","source":"Crossref","is-referenced-by-count":34,"title":["Multiattentive Recurrent Neural Network Architecture for Multilingual Readability Assessment"],"prefix":"10.1162","volume":"7","author":[{"given":"Ion Madrazo","family":"Azpiazu","sequence":"first","affiliation":[{"name":"Department of Computer Science, Boise State University."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maria Soledad","family":"Pera","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Boise State University."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","reference":[{"issue":"3","key":"bib1","first-page":"12","volume":"26","author":"Abbasi Ahmed","year":"2008","journal-title":"Association of Computer Machinery Transactions on Information Systems (TOIS)"},{"key":"bib2","first-page":"506","volume-title":"Proceedings of the International Conference on Digital Information Management","author":"Al-Ajlan Amani A","year":"2008"},{"key":"bib3","first-page":"1051","volume-title":"Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Ambati Bharat Ram","year":"2016"},{"key":"bib4","doi-asserted-by":"crossref","first-page":"2442","DOI":"10.18653\/v1\/P16-1231","volume-title":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","volume":"1","author":"Andor Daniel","year":"2016"},{"key":"bib5","doi-asserted-by":"crossref","first-page":"2191","DOI":"10.1007\/s11145-017-9785-6","volume":"31","author":"Arf\u00e9 Barbara","year":"2018","journal-title":"Reading and Writing"},{"key":"bib6","author":"Bahdanau Dzmitry","year":"2014","journal-title":"arXiv preprint arXiv:1409.0473"},{"issue":"3","key":"bib7","doi-asserted-by":"crossref","first-page":"397","DOI":"10.4321\/S1137-66272013000300005","volume":"36","author":"Ballesteros-Pe\u00f1a Sendoa","year":"2013","journal-title":"Anales del Sistema Sanitario de Navarra"},{"issue":"2","key":"bib8","doi-asserted-by":"crossref","first-page":"255","DOI":"10.4321\/S1137-66272015000200009","volume":"38","author":"Bea-Mu\u00f1oz Manuel","year":"2015","journal-title":"Anales del Sistema Sanitario de Navarra"},{"issue":"1","key":"bib9","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1007\/s10648-011-9181-8","volume":"24","author":"Benjamin Rebekah George","year":"2012","journal-title":"Educational Psychology Review"},{"issue":"1","key":"bib10","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.ijmedinf.2004.10.001","volume":"74","author":"Bernstam Elmer V.","year":"2005","journal-title":"International Journal Medical Information"},{"key":"bib11","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00051"},{"key":"bib12","first-page":"705","volume-title":"Proceedings of the International Conference on Machine Learning and Computing","volume":"2","author":"Chen Yaw-Huei","year":"2011"},{"key":"bib13","doi-asserted-by":"crossref","first-page":"187","DOI":"10.2307\/747483","volume":"17","author":"Davison Alice","year":"1982","journal-title":"Reading Research Quarterly"},{"issue":"3","key":"bib14","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1162\/COLI_a_00255","volume":"42","author":"Clercq Orph\u00e9e De","year":"2016","journal-title":"Computational Linguistics"},{"key":"bib15","first-page":"73","volume-title":"Workshop on Speech and Language Processing for Assistive Technologies","author":"Dell\u2019Orletta Felice","year":"2011"},{"issue":"3","key":"bib16","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1002\/asi.23417","volume":"67","author":"Denning Joel","year":"2016","journal-title":"Journal of the Association for Information Science and Technology"},{"key":"bib17","author":"Douma W.H.","year":"1960","journal-title":"afd. Sociologie en Sociographie van de Landbouwhogeschool te Wageningen"},{"issue":"5","key":"bib18","doi-asserted-by":"crossref","first-page":"246","DOI":"10.3102\/0013189X11414181","volume":"40","author":"Elfenbein Andrew","year":"2011","journal-title":"Educational Researcher"},{"key":"bib19","first-page":"276","volume-title":"Proceedings of the International Conference on Computational Linguistics: Posters","author":"Feng Lijun","year":"2010"},{"key":"bib20","first-page":"29","volume":"214","author":"Fern\u00e1ndez Huerta Jos\u00e9","year":"1959","journal-title":"Consigna"},{"issue":"4","key":"bib21","doi-asserted-by":"crossref","first-page":"292","DOI":"10.4997\/JRCPE.2010.401","volume":"40","author":"Fitzsimmons P. R.","year":"2010","journal-title":"The Journal of the Royal College of Physicians of Edinburgh"},{"issue":"3","key":"bib22","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1037\/h0057532","volume":"32","author":"Flesch Rudolph","year":"1948","journal-title":"Journal of Applied Psychology"},{"key":"bib23","first-page":"466","volume-title":"Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning","author":"Fran\u00e7ois Thomas","year":"2012"},{"key":"bib24","first-page":"63","volume-title":"Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers)","volume":"2","author":"Glava\u0161 Goran","year":"2015"},{"key":"bib25","first-page":"334","volume-title":"Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers","author":"Gonzalez-Dios Itziar","year":"2014"},{"issue":"5","key":"bib26","doi-asserted-by":"crossref","first-page":"223","DOI":"10.3102\/0013189X11413260","volume":"40","author":"Graesser Arthur C.","year":"2011","journal-title":"Educational Researcher"},{"issue":"1","key":"bib27","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/0893-6080(88)90021-4","volume":"1","author":"Grossberg Stephen","year":"1988","journal-title":"Neural Networks"},{"key":"bib28","first-page":"1693","volume-title":"Proceedings of Advances in Neural Information Processing Systems","author":"Hermann Karl Moritz","year":"2015"},{"key":"bib29","first-page":"1","volume":"91","author":"Hochreiter Sepp","year":"1991","journal-title":"Diploma, Technische Universit\u00e4t M\u00fcnchen"},{"key":"bib30","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"bib32","first-page":"253","volume":"19","author":"Kandel Lilian","year":"1958","journal-title":"Cahiers Etudes de Radio-T\u00e9l\u00e9vision"},{"key":"bib33","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1145\/1498759.1498827","volume-title":"Proceedings of the Second ACM International Conference on Web Search and Data Mining","author":"Kanungo Tapas","year":"2009"},{"key":"bib34","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1007\/978-3-319-12580-0_9","volume-title":"Proceedings of the International Conference on Analysis of Images, Social Networks and Texts","author":"Karpov Nikolay","year":"2014"},{"key":"bib35","author":"Kingma Diederik","year":"2014","journal-title":"arXiv preprint arXiv:1412.6980"},{"issue":"31","key":"bib37","first-page":"110","volume":"3","author":"Lucisano Pietro","year":"1988","journal-title":"Scuola e citt\u00e0"},{"key":"bib38","unstructured":"Ion Madrazo Azpiazu. 2017. Towards multilingual readability assessment. Master\u2019s thesis, Boise State University, Boise, Idaho."},{"key":"bib39","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1145\/3176349.3176379","volume-title":"Proceedings of the 2018 Conference on Human Information Interaction & Retrieval (ACM CHIIR)","author":"Madrazo Azpiazu Ion","year":"2018"},{"issue":"8","key":"bib40","first-page":"837","volume":"18","author":"Manjunath Bangalore S.","year":"1996","journal-title":"Institute of Electrical and Electronics Engineers Transactions on Pattern Analysis and machine Intelligence"},{"key":"bib41","unstructured":"Ion Madrazo. 2014. Testuen irakurgarritasuna neurtzeko sailkatzaile automatikoa [an automatic classifier of text legibility]. Master\u2019s thesis, University of the Basque Country (UPV\/EHU). Advisor: Montse Maritxalar Anglada."},{"key":"bib42","doi-asserted-by":"crossref","first-page":"309","DOI":"10.18653\/v1\/S15-1036","volume-title":"Proceedings of the Fourth Joint Conference on Lexical and Computational Semantics","author":"Mesgar Mohsen","year":"2015"},{"key":"bib43","first-page":"1414","volume-title":"Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Mesgar Mohsen","year":"2016"},{"key":"bib44","doi-asserted-by":"crossref","first-page":"4328","DOI":"10.18653\/v1\/D18-1464","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Mesgar Mohsen","year":"2018"},{"key":"bib45","first-page":"3761","volume-title":"Association for the Advancement of Artificial Intelligence","author":"Paetzold Gustavo H.","year":"2016"},{"key":"bib46","first-page":"9","volume-title":"Association of Computer Machinery Conference on Recommender Systems","author":"Pera Maria Soledad","year":"2014"},{"key":"bib47","first-page":"523","volume-title":"Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics","author":"Schwarm Sarah E.","year":"2005"},{"issue":"8","key":"bib48","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1111\/j.1540-4781.1956.tb02145.x","volume":"40","author":"Spaulding Seth","year":"1956","journal-title":"The Modern Language Journal"},{"key":"bib49","doi-asserted-by":"crossref","first-page":"1555","DOI":"10.3115\/v1\/P14-1146","volume-title":"Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","volume":"1","author":"Tang Duyu","year":"2014"},{"key":"bib50","doi-asserted-by":"crossref","first-page":"225","DOI":"10.18653\/v1\/P16-2037","volume-title":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)","volume":"2","author":"Wang Jin","year":"2016"},{"key":"bib53","author":"Bing Xu","year":"2015","journal-title":"arXiv preprint arXiv:1505.00853"},{"key":"bib54","first-page":"2048","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Kelvin Xu","year":"2015"},{"key":"bib55","first-page":"1480","volume-title":"Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Yang Zichao","year":"2016"}],"container-title":["Transactions of the Association for Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/tacl_a_00278","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:39:25Z","timestamp":1615585165000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/tacl\/article\/43526"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11]]},"references-count":51,"alternative-id":["10.1162\/tacl_a_00278"],"URL":"https:\/\/doi.org\/10.1162\/tacl_a_00278","relation":{},"ISSN":["2307-387X"],"issn-type":[{"value":"2307-387X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11]]}}}