{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T10:52:19Z","timestamp":1781693539326,"version":"3.54.5"},"reference-count":81,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2025,2,9]],"date-time":"2025-02-09T00:00:00Z","timestamp":1739059200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,2,9]],"date-time":"2025-02-09T00:00:00Z","timestamp":1739059200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Lang Resources &amp; Evaluation"],"published-print":{"date-parts":[[2025,9]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Automatic readability assessment (ARA) aims to determine the cognitive load of a reader to comprehend a given text. ARA research has been mostly conducted at the text level, with numerous studies showing strong performance of neural and hybrid models. ARA at the sentence level, however, has received less attention, even though many applications in natural language processing (NLP) require assessment of the difficulty of individual sentences. This article compares the performance of neural models, hybrid models and large language models (LLMs) for sentence-level ARA, making three main contributions. First, we construct the first Chinese sentence-level ARA datasets, with nearly 70K sentences, to facilitate evaluation on Chinese. Second, we present the first experimental results on applying LLMs to sentence-level ARA. Finally, while previous work focused mostly on English data, we show that hybrid models outperform traditional classifiers, neural models, and LLMs in both English and Chinese data. The best hybrid model obtained state-of-the-art results on the Wall Street Journal dataset, surpassing the previous best result by almost 15% absolute. It also achieved competitive results on the CEFR-SP dataset. In detailed analyses, we identify the linguistic features that most significantly contributed to the performance of the hybrid model. We show that 10 linguistic features are correlated to readability across all datasets, and models trained on this reduced feature set achieve performance that rivals the full set. These results not only yield new insights into hybrid models for sentence-level ARA, but also set new benchmarks for future research in both English and Chinese.<\/jats:p>","DOI":"10.1007\/s10579-024-09800-5","type":"journal-article","created":{"date-parts":[[2025,2,9]],"date-time":"2025-02-09T02:07:01Z","timestamp":1739066821000},"page":"2265-2296","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Automatic readability assessment for sentences: neural, hybrid and large language models"],"prefix":"10.1007","volume":"59","author":[{"given":"Fengkai","family":"Liu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tan","family":"Jin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John S. Y.","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,2,9]]},"reference":[{"key":"9800_CR1","doi-asserted-by":"crossref","unstructured":"Ambati, B.R., Reddy, S., & Steedman, M. (2016). Assessing relative sentence complexity using an incremental ccg parser. Proceedings of the 2016 conference of the North American chapter of the association for computational linguistics: Human language technologies (pp. 1051\u20131057).","DOI":"10.18653\/v1\/N16-1120"},{"key":"9800_CR2","doi-asserted-by":"crossref","unstructured":"Arase, Y., Uchida, S., & Kajiwara, T. (2022). CEFR-based sentence difficulty annotation and assessment. Proceedings of the 2022 conference on empirical methods in natural language processing (pp. 6206\u20136219). Abu Dhabi, United Arab Emirates: Association for Computational Linguistics. https:\/\/aclanthology.org\/2022.emnlp-main.416","DOI":"10.18653\/v1\/2022.emnlp-main.416"},{"key":"9800_CR3","doi-asserted-by":"publisher","first-page":"421","DOI":"10.1162\/tacl_a_00278","volume":"7","author":"IM Azpiazu","year":"2019","unstructured":"Azpiazu, I. M., & Pera, M. S. (2019). Multiattentive recurrent neural network architecture for multilingual readability assessment. Transactions of the Association for Computational Linguistics, 7, 421\u2013436.","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"9800_CR4","unstructured":"Bird, S., Klein, E., & Loper, E. (2009). Natural language processing with python: analyzing text with the natural language toolkit. \" O\u2019Reilly Media, Inc.\"."},{"key":"9800_CR5","doi-asserted-by":"crossref","unstructured":"Bo, W., Chen, J., Guo, K., & Jin, T. (2019). Data-driven adapting for fine-tuning chinese teaching materials: Using corpora as benchmarks. Computational and Corpus Approaches to Chinese Language Learning, 99\u2013118,","DOI":"10.1007\/978-981-13-3570-9_6"},{"key":"9800_CR6","doi-asserted-by":"publisher","first-page":"100097","DOI":"10.1016\/j.array.2021.100097","volume":"12","author":"GL Bosco","year":"2021","unstructured":"Bosco, G. L., Pilato, G., & Schicchi, D. (2021). Deepeva: A deep neural network architecture for assessing sentence complexity in italian and english languages. Array, 12, 100097.","journal-title":"Array"},{"key":"9800_CR7","doi-asserted-by":"crossref","unstructured":"Brunato, D., De\u00a0Mattei, L., Dell\u2019Orletta, F., Iavarone, B., & Venturi, G. (2018). Is this sentence difficult? do you agree? Proceedings of the 2018 conference on empirical methods in natural language processing (pp. 2690\u20132699).","DOI":"10.18653\/v1\/D18-1289"},{"issue":"7","key":"9800_CR8","first-page":"103","volume":"3","author":"Y Cheng","year":"2019","unstructured":"Cheng, Y., Xu, D., & Lv, X. (2019). Automatically grading text difficulty with multiple features. Data Analysis and Knowledge Discovery, 3(7), 103\u2013112.","journal-title":"Data Analysis and Knowledge Discovery"},{"key":"9800_CR9","doi-asserted-by":"crossref","unstructured":"Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014). Learning phrase representations using rnn encoder\u2013decoder for statistical machine translation. Proceedings of the 2014 conference on empirical methods in natural language processing (emnlp) (p.1724).","DOI":"10.3115\/v1\/D14-1179"},{"key":"9800_CR10","doi-asserted-by":"crossref","unstructured":"Chujo, K., Oghigian, K., & Akasegawa, S. (2015). A corpus and grammatical browsing system for remedial efl learners. Multiple affordances of language corpora for data-driven learning, 109\u2013128,","DOI":"10.1075\/scl.69.06chu"},{"key":"9800_CR11","unstructured":"Clark, K., Luong, M.-T., Le, Q.V., & Manning, C.D. (2020). Electra: Pre-training text encoders as discriminators rather than generators. arXiv preprint[SPACE]arXiv:2003.10555, ,"},{"issue":"2","key":"9800_CR12","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1075\/itl.165.2.01col","volume":"165","author":"K Collins-Thompson","year":"2008","unstructured":"Collins-Thompson, K. (2008). Computational assessment of text readability: A survey of current and future research. International Journal of Applied Linguistics, 165(2), 97\u2013135.","journal-title":"International Journal of Applied Linguistics"},{"key":"9800_CR13","doi-asserted-by":"crossref","unstructured":"Cui, Y., Che, W., Liu, T., Qin, B., Wang, S., & Hu, G. (2020). Revisiting pre-trained models for chinese natural language processing. arXiv preprint[SPACE]arXiv:2004.13922, ,","DOI":"10.18653\/v1\/2020.findings-emnlp.58"},{"key":"9800_CR14","unstructured":"Cui, Y., Che, W., Wang, S., & Liu, T. (2022). Lert: A linguistically-motivated pre-trained language model. arXiv preprint[SPACE]arXiv:2211.05344, ,"},{"key":"9800_CR15","doi-asserted-by":"crossref","unstructured":"Dell\u2019Orletta, F., Wieling, M., Venturi, G., Cimino, A., & Montemagni, S. (2014). Assessing the readability of sentences: which corpora and features? Proceedings of the ninth workshop on innovative use of nlp for building educational applications (pp. 163\u2013173).","DOI":"10.3115\/v1\/W14-1820"},{"key":"9800_CR16","doi-asserted-by":"publisher","first-page":"101182","DOI":"10.1016\/j.csl.2020.101182","volume":"68","author":"J Deng","year":"2021","unstructured":"Deng, J., Cheng, L., & Wang, Z. (2021). Attention-based bilstm fused cnn with gating mechanism model for Chinese long text classification. Computer Speech and Language, 68, 101182.","journal-title":"Computer Speech and Language"},{"key":"9800_CR17","doi-asserted-by":"crossref","unstructured":"Deutsch, T., Jasbi, M., & Shieber, S. (2020b). Linguistic Features for Readability Assessment. Proceedings of the fifteenth workshop on innovative use of nlp for building educational applications.","DOI":"10.18653\/v1\/2020.bea-1.1"},{"key":"9800_CR18","doi-asserted-by":"crossref","unstructured":"Deutsch, T., Jasbi, M., & Shieber, S.M. (2020a). Linguistic features for readability assessment. Proceedings of the fifteenth workshop on innovative use of nlp for building educational applications (pp. 1\u201317).","DOI":"10.18653\/v1\/2020.bea-1.1"},{"key":"9800_CR19","unstructured":"Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pretraining of Deep Bidirectional Transformers for Language Understanding. Proc. North American chapter of the association for computational linguistics - human language technologies (naacl-hlt)."},{"key":"9800_CR20","unstructured":"Feng, Y., Qiang, J., Li, Y., Yuan, Y., & Zhu, Y. (2023). Sentence simplification via large language models. arXiv preprint[SPACE]arXiv:2302.11957, ,"},{"key":"9800_CR21","doi-asserted-by":"crossref","unstructured":"Filighera, A., Steuer, T., & Rensing, C. (2019). Automatic text difficulty estimation using embeddings and neural networks. European conference on technology enhanced learning (p.335\u2013348). Springer.","DOI":"10.1007\/978-3-030-29736-7_25"},{"issue":"7","key":"9800_CR22","first-page":"513","volume":"11","author":"E Fry","year":"1968","unstructured":"Fry, E. (1968). A readability formula that saves time. Journal of Reading, 11(7), 513\u2013578.","journal-title":"Journal of Reading"},{"issue":"8","key":"9800_CR23","first-page":"594","volume":"33","author":"E Fry","year":"1990","unstructured":"Fry, E. (1990). A readability formula for short passages. Journal of Reading, 33(8), 594\u2013597.","journal-title":"Journal of Reading"},{"key":"9800_CR24","doi-asserted-by":"crossref","unstructured":"Garbacea, C., Guo, M., Carton, S., & Mei, Q. (2021). Explainable prediction of text complexity: The missing preliminaries for text simplification. Proceedings of the 59th annual meeting of the association for computational linguistics and the 11th international joint conference on natural language processing (volume 1: Long papers) (pp. 1086\u20131097).","DOI":"10.18653\/v1\/2021.acl-long.88"},{"key":"9800_CR25","doi-asserted-by":"publisher","first-page":"101056","DOI":"10.1016\/j.csl.2019.101056","volume":"62","author":"D Grie\u00dfhaber","year":"2020","unstructured":"Grie\u00dfhaber, D., Vu, N. T., & Maucher, J. (2020). Low-resource text classification using domain-adversarial learning. Computer Speech and Language, 62, 101056.","journal-title":"Computer Speech and Language"},{"key":"9800_CR26","unstructured":"Hanban\/Confucius Institute Headquarters. (2008). International curriculum for Chinese language education. Beijing: Foreign Languages Teaching and Research Press."},{"key":"9800_CR27","doi-asserted-by":"crossref","unstructured":"Howcroft, D.M., & Demberg, V. (2017). Psycholinguistic models of sentence processing improve sentence readability ranking. Proceedings of the 15th conference of the european chapter of the association for computational linguistics: Volume 1, long papers (pp. 958\u2013968).","DOI":"10.18653\/v1\/E17-1090"},{"key":"9800_CR28","doi-asserted-by":"crossref","unstructured":"Imperial, J.M. (2021). Bert embeddings for automatic readability assessment. Proceedings of the international conference on recent advances in natural language processing (ranlp 2021) (pp. 611\u2013618).","DOI":"10.26615\/978-954-452-072-4_069"},{"key":"9800_CR29","doi-asserted-by":"crossref","unstructured":"Jiang, C., Maddela, M., Lan, W., Zhong, Y., & Xu, W. (2020). Neural CRF model for sentence alignment in text simplification. Proceedings of the 58th annual meeting of the association for computational linguistics (pp. 7943\u20137960). Online: Association for Computational Linguistics. https:\/\/aclanthology.org\/2020.acl-main.709","DOI":"10.18653\/v1\/2020.acl-main.709"},{"key":"9800_CR30","unstructured":"Kilgarriff, A., Hus\u00e1k, M., McAdam, K., Rundell, M., & Rychl\u1ef3, P. (2008). Gdex: Automatically finding good dictionary examples in a corpus. Proceedings of the xiii euralex international congress (Vol.\u00a01, pp. 425\u2013432)."},{"key":"9800_CR31","unstructured":"Kincaid, P.J., Fishburne, R.P., Rogers, R.L., & Chissom, B.S. (1975). Derivation of new readability formulas for Navy enlisted personnel. Research branch report 8-75. Chief of Naval Technical Training: Naval Air Station Memphis."},{"key":"9800_CR32","unstructured":"Kingma, D.P., & Ba, J. (2015). Adam: A Method for Stochastic Optimization. Proc. 3rd international conference for learning representations. San Diego."},{"key":"9800_CR33","doi-asserted-by":"publisher","first-page":"159","DOI":"10.2307\/2529310","volume":"33","author":"JR Landis","year":"1977","unstructured":"Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159\u2013174.","journal-title":"Biometrics"},{"key":"9800_CR34","doi-asserted-by":"crossref","unstructured":"Lee, B.W., Jang, Y.S., & Lee, J.H.-J. (2021). Pushing on Text Readability Assessment: A Transformer Meets Handcrafted Linguistic Features. Proceedings of the 2021 conference on empirical methods in natural language processing.","DOI":"10.18653\/v1\/2021.emnlp-main.834"},{"key":"9800_CR35","doi-asserted-by":"crossref","unstructured":"Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., & Zettlemoyer, L. (2019). Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. arXiv preprint[SPACE]arXiv:1910.13461, ,","DOI":"10.18653\/v1\/2020.acl-main.703"},{"key":"9800_CR36","doi-asserted-by":"crossref","unstructured":"Liu, F., & Lee, J.S. (2023). Hybrid models for sentence readability assessment. Proceedings of the 18th workshop on innovative use of nlp for building educational applications (bea 2023) (pp. 448\u2013454).","DOI":"10.18653\/v1\/2023.bea-1.37"},{"key":"9800_CR37","doi-asserted-by":"crossref","unstructured":"Liu, X., You, X., Zhang, X., Wu, J., & Lv, P. (2020). Tensor graph convolutional networks for text classification. Proceedings of the aaai conference on artificial intelligence (Vol.\u00a034, pp. 8409\u20138416).","DOI":"10.1609\/aaai.v34i05.6359"},{"key":"9800_CR38","unstructured":"Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., ... & Stoyanov, V. (2019). Roberta: A robustly optimized bert pretraining approach. arXiv preprint[SPACE]arXiv:1907.11692, ,"},{"key":"9800_CR39","unstructured":"Logar, N., Gr\u010dar, M., Brakus, M., Erjavec, T., Holdt, \u0160.A., & Krek, S. (2020). Korpusi slovenskega jezika gigafida, kres, ccgigafida in cckres: gradnja, vsebina, uporaba. Znanstvena zalo\u017eba Filozofske fakultete."},{"key":"9800_CR40","doi-asserted-by":"crossref","unstructured":"Lu, D., Qiu, X., & Cai, Y. (2020a). Sentence-level readability assessment for l2 chinese learning. Chinese lexical semantics: 20th workshop, clsw 2019, Beijing, China, june 28\u201330, 2019, revised selected papers 20 (pp. 381\u2013392).","DOI":"10.1007\/978-3-030-38189-9_40"},{"key":"9800_CR41","first-page":"381","volume":"11831","author":"D Lu","year":"2020","unstructured":"Lu, D., Qiu, X., & Cai, Y. (2020). Sentence-level readability assessment for l2 Chinese learning. CLSW 2019. LNAI, 11831, 381\u2013392.","journal-title":"LNAI"},{"key":"9800_CR42","doi-asserted-by":"crossref","unstructured":"Mallinson, J., Sennrich, R., & Lapata, M. (2020). Zero-shot crosslingual sentence simplification. Proceedings of the 2020 conference on empirical methods in natural language processing (emnlp) (pp. 5109\u20135126).","DOI":"10.18653\/v1\/2020.emnlp-main.415"},{"issue":"1","key":"9800_CR43","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1162\/coli_a_00398","volume":"47","author":"M Martinc","year":"2021","unstructured":"Martinc, M., Pollak, S., & Marko, Robnik-\u0160ikonja. (2021). Supervised and unsupervised neural approaches to text readability. Computational Linguistics, 47(1), 141\u2013179.","journal-title":"Computational Linguistics"},{"key":"9800_CR44","doi-asserted-by":"crossref","unstructured":"Mertzen, D., Paape, D., Dillon, B., Engbert, R., Vasishth, S., Mertzen, D., ... & Vasishth, S. (2023). Syntactic and semantic interference in sentence comprehension: Support from english and German eye-tracking data. Glossa Psycholinguistics, 2(1), ,","DOI":"10.5070\/G60111266"},{"key":"9800_CR45","unstructured":"Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013). Efficient estimation of word representations in vector space. arXiv preprint[SPACE]arXiv:1301.3781, ,"},{"key":"9800_CR46","unstructured":"Mohammadi, H., & Khasteh, S.H. (2019). Text as environment: A deep reinforcement learning text readability assessment model. arXiv preprint[SPACE]arXiv:1912.05957, , ,"},{"key":"9800_CR47","doi-asserted-by":"crossref","unstructured":"Nadeem, F., & Ostendorf, M. (2018). Estimating linguistic complexity for science texts. Proceedings of the thirteenth workshop on innovative use of nlp for building educational applications (pp. 45\u201355).","DOI":"10.18653\/v1\/W18-0505"},{"issue":"4","key":"9800_CR48","doi-asserted-by":"publisher","first-page":"1004","DOI":"10.1111\/lang.12455","volume":"71","author":"S Nahatame","year":"2021","unstructured":"Nahatame, S. (2021). Text readability and processing effort in second language reading: A computational and eye-tracking investigation. Language Learning, 71(4), 1004\u20131043.","journal-title":"Language Learning"},{"key":"9800_CR49","unstructured":"Nivre, J., Hall, J., K\u00fcbler, S., McDonald, R., Nilsson, J., Riedel, S., & Yuret, D. (2007). The conll 2007 shared task on dependency parsing. Proceedings of the 2007 joint conference on empirical methods in natural language processing and computational natural language learning (emnlp-conll) (pp. 915\u2013932)."},{"key":"9800_CR50","unstructured":"OpenAI (2021). Chatgpt.[SPACE]https:\/\/openai.com\/."},{"key":"9800_CR51","unstructured":"Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., & Grisel, O. (2011). Scikit-learn: Machine learning in python. Journal of machine learning research, 12(Oct), 2825-2830,"},{"key":"9800_CR52","doi-asserted-by":"crossref","unstructured":"Pennington, J., Socher, R., & Manning, C.D. (2014). Glove: Global vectors for word representation. Proceedings of the 2014 conference on empirical methods in natural language processing (emnlp) (pp. 1532\u20131543).","DOI":"10.3115\/v1\/D14-1162"},{"issue":"1","key":"9800_CR53","first-page":"143","volume":"7","author":"I Pil\u00e1n","year":"2016","unstructured":"Pil\u00e1n, I., Vajjala, S., & Volodina, E. (2016). A readable read: Automatic assessment of language learning materials based on linguistic complexity. International Journal of Applied Linguistics, 7(1), 143\u2013159.","journal-title":"International Journal of Applied Linguistics"},{"key":"9800_CR54","doi-asserted-by":"crossref","unstructured":"Pil\u00e1n, I., Volodina, E., & Johansson, R. (2014). Rule-based and machine learning approaches for second language sentence-level readability. Proceedings of the ninth workshop on innovative use of nlp for building educational applications (pp. 174\u2013184).","DOI":"10.3115\/v1\/W14-1821"},{"key":"9800_CR55","doi-asserted-by":"crossref","unstructured":"Pil\u00e1n, I., Volodina, E., & Johansson, R. (2014). Rule-based and Machine Learning Approaches for Second Language Sentence-level Readability. Proc. 9th workshop on innovative use of nlp for building educational applications.","DOI":"10.3115\/v1\/W14-1821"},{"issue":"4","key":"9800_CR56","doi-asserted-by":"publisher","first-page":"3504","DOI":"10.3758\/s13428-023-02176-4","volume":"56","author":"Y Prystauka","year":"2024","unstructured":"Prystauka, Y., Altmann, G. T., & Rothman, J. (2024). Online eye tracking and real-time sentence processing: On opportunities and efficacy for capturing psycholinguistic effects of different magnitudes and diversity. Behavior Research Methods, 56(4), 3504\u20133522.","journal-title":"Behavior Research Methods"},{"key":"9800_CR57","doi-asserted-by":"crossref","unstructured":"Qiu, X., Chen, Y., Chen, H., Nie, J.-Y., Shen, Y., & Lu, D. (2021). Learning Syntactic Dense Embedding with Correlation Graph for Automatic Readability Assessment. Proc. 59th annual meeting of the association for computational linguistics (acl) (p.3013\u20133025).","DOI":"10.18653\/v1\/2021.acl-long.235"},{"key":"9800_CR58","doi-asserted-by":"crossref","unstructured":"Schicchi, D., Pilato, G., & Bosco, G.L. (2020). Deep neural attention-based model for the evaluation of italian sentences complexity. 2020 ieee 14th international conference on semantic computing (icsc) (pp. 253\u2013256).","DOI":"10.1109\/ICSC.2020.00053"},{"key":"9800_CR59","doi-asserted-by":"crossref","unstructured":"Schumacher, E., Eskenazi, M., Frishkoff, G., & Collins-Thompson, K. (2016). Predicting the relative difficulty of single sentences with and without surrounding context. Proceedings of the 2016 conference on empirical methods in natural language processing (pp. 1871\u20131881).","DOI":"10.18653\/v1\/D16-1192"},{"key":"9800_CR60","unstructured":"Segler, T.M. (2007). Investigating the selection of example sentences for unknown target words in icall reading texts for l2 German."},{"key":"9800_CR61","doi-asserted-by":"crossref","unstructured":"Shi, Y., Ma, H., Zhong, W., Mai, G., Li, X., Liu, T., & Huang, J. (2023). Chatgraph: Interpretable text classification by converting chatgpt knowledge to graphs. arXiv preprint[SPACE]arXiv:2305.03513, ,","DOI":"10.1109\/ICDMW60847.2023.00073"},{"issue":"1","key":"9800_CR62","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1080\/00031305.1988.10475530","volume":"42","author":"RE Shiffler","year":"1988","unstructured":"Shiffler, R. E. (1988). Maximum z scores and outliers. The American Statistician, 42(1), 79\u201380.","journal-title":"The American Statistician"},{"key":"9800_CR63","doi-asserted-by":"publisher","first-page":"107408","DOI":"10.1016\/j.knosys.2021.107408","volume":"230","author":"D Song","year":"2021","unstructured":"Song, D., Ma, S., Sun, Z., Yang, S., & Liao, L. (2021). Kvl-bert: Knowledge enhanced visual-and-linguistic bert for visual commonsense reasoning. Knowledge-Based Systems, 230, 107408.","journal-title":"Knowledge-Based Systems"},{"key":"9800_CR64","doi-asserted-by":"crossref","unstructured":"\u0160tajner, S., Ponzetto, S.P., & Stuckenschmidt, H. (2017). Automatic assessment of absolute sentence complexity. Proceedings of the 26th international joint conference on artificial intelligence, ijcai (Vol.\u00a017, pp. 4096\u20134102).","DOI":"10.24963\/ijcai.2017\/572"},{"key":"9800_CR65","doi-asserted-by":"crossref","unstructured":"Sun, X., Li, X., Li, J., Wu, F., Guo, S., Zhang, T., & Wang, G. (2023). Text classification via large language models. arXiv preprint[SPACE]arXiv:2305.08377, ,","DOI":"10.18653\/v1\/2023.findings-emnlp.603"},{"key":"9800_CR66","doi-asserted-by":"publisher","first-page":"340","DOI":"10.3758\/s13428-014-0459-x","volume":"47","author":"Y-T Sung","year":"2015","unstructured":"Sung, Y.-T., Chen, J.-L., Cha, J.-H., Tseng, H.-C., Chang, T.-H., & Chang, K.-E. (2015). Constructing and validating readability models: The method of integrating multilevel linguistic features with machine learning. Behavior Research Methods, 47, 340\u2013354.","journal-title":"Behavior Research Methods"},{"key":"9800_CR67","unstructured":"Todirascu, A., Fran\u00e7ois, T., Bernhard, D., Gala, N., & Ligozat, A.-L. (2016). Are cohesive features relevant for text readability evaluation? Proceedings of coling 2016, the 26th international conference on computational linguistics: Technical papers (pp. 987\u2013997)."},{"key":"9800_CR68","doi-asserted-by":"crossref","unstructured":"Vajjala, S., & Lu\u010di\u0107, I. (2018). Onestopenglish corpus: A new corpus for automatic readability assessment and text simplification. Proceedings of the thirteenth workshop on innovative use of nlp for building educational applications (pp. 297\u2013304).","DOI":"10.18653\/v1\/W18-0535"},{"key":"9800_CR81","unstructured":"Vajjala, S., & Meurers, D. (2012). On improving the accuracy of readability classification using insights from second language acquisition. Proceedings of the seventh workshop on building educational applications using NLP (pp. 163\u2013173)."},{"key":"9800_CR69","doi-asserted-by":"crossref","unstructured":"Vajjala, S., & Meurers, D. (2014). Assessing the relative reading level of sentence pairs for text simplification. Proceedings of the 14th conference of the european chapter of the association for computational linguistics (pp. 288\u2013297).","DOI":"10.3115\/v1\/E14-1031"},{"key":"9800_CR70","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N... & Polosukhin, I. (2017). Attention is all you need. Advances in neural information processing systems, 30, ,"},{"key":"9800_CR71","doi-asserted-by":"crossref","unstructured":"Volodina, E., Pil\u00e1n, I., Borin, L., & Tiedemann, T.L. (2014). A flexible language learning platform based on language resources and web services. Lrec (pp. 3973\u20133978).","DOI":"10.63317\/5povtp8o9z2t"},{"key":"9800_CR72","unstructured":"Wang, Z., Schaul, T., Hessel, M., Van\u00a0Hasselt, H., Lanctot, M., & De\u00a0Freitas, N. (2016). Dueling network architectures for deep reinforcement learning. Proceedings of the 33rd international conference on international conference on machine learning-volume 48 (pp. 1995\u20132003)."},{"key":"9800_CR73","doi-asserted-by":"crossref","unstructured":"Weiss, Z., & Meurers, D. (2022). Assessing sentence readability for german language learners with broad linguistic modeling or readability formulas: When do linguistic insights make a difference? Proceedings of the 17th workshop on innovative use of nlp for building educational applications (bea 2022) (pp. 141\u2013153).","DOI":"10.18653\/v1\/2022.bea-1.19"},{"key":"9800_CR74","unstructured":"Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., ... & Rush, A.M. (2019). Huggingface\u2019s transformers: State-of-the-art natural language processing. ArXiv:abs\/1910.03771"},{"key":"9800_CR75","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1162\/tacl_a_00139","volume":"3","author":"W Xu","year":"2015","unstructured":"Xu, W., Callison-Burch, C., & Napoles, C. (2015). Problems in current text simplification research: New data can help. Transactions of the Association for Computational Linguistics, 3, 283\u2013297.","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"9800_CR76","doi-asserted-by":"crossref","unstructured":"Yang, S., Sun, R., & Wan, X. (2023). A new dataset and empirical study for sentence simplification in chinese. Proceedings of the 61st annual meeting of the association for computational linguistics (volume 1: Long papers) (p.8306-8321).","DOI":"10.18653\/v1\/2023.acl-long.462"},{"key":"9800_CR77","unstructured":"Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R.R., & Le, Q.V. (2019). Xlnet: Generalized autoregressive pretraining for language understanding. Advances in neural information processing systems, 32, ,"},{"key":"9800_CR78","doi-asserted-by":"crossref","unstructured":"Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., & Hovy, E. (2016). Hierarchical attention networks for document classification. Proceedings of the 2016 conference of the north american chapter of the association for computational linguistics: human language technologies (pp. 1480\u20131489).","DOI":"10.18653\/v1\/N16-1174"},{"key":"9800_CR79","doi-asserted-by":"crossref","unstructured":"Yao, L., Mao, C., & Luo, Y. (2019). Graph convolutional networks for text classification. Proceedings of the aaai conference on artificial intelligence (Vol.\u00a033, pp. 7370\u20137377).","DOI":"10.1609\/aaai.v33i01.33017370"},{"key":"9800_CR80","doi-asserted-by":"crossref","unstructured":"Zeng, J., Xie, Y., Yu, X., Lee, J.S.Y., & Zhou, D.-X. (2022). Enhancing Automatic Readability Assessment with Pre-training and Soft Labels for Ordinal Regression. Findings of the association for computational linguistics: Emnlp 2022 (p.4586-4597).","DOI":"10.18653\/v1\/2022.findings-emnlp.334"}],"container-title":["Language Resources and Evaluation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10579-024-09800-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10579-024-09800-5","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10579-024-09800-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T10:00:30Z","timestamp":1781690430000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10579-024-09800-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,9]]},"references-count":81,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,9]]}},"alternative-id":["9800"],"URL":"https:\/\/doi.org\/10.1007\/s10579-024-09800-5","relation":{},"ISSN":["1574-020X","1574-0218"],"issn-type":[{"value":"1574-020X","type":"print"},{"value":"1574-0218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,9]]},"assertion":[{"value":"6 December 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 February 2025","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 January 2026","order":4,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Update","order":5,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"This article was originally published under the subscription model but it is now published under an Open Access license.","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"All authors declare that they have no conficts of interest to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}