{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:37:04Z","timestamp":1760146624705,"version":"build-2065373602"},"reference-count":98,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2024,11,20]],"date-time":"2024-11-20T00:00:00Z","timestamp":1732060800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"RESEARCH COUNCIL OF LITHUANIA (LMTLT)","award":["S-LIP-22-77"],"award-info":[{"award-number":["S-LIP-22-77"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Text simplification reduces the complexity of text while preserving essential information, thus making it more accessible to a broad range of readers, including individuals with cognitive disorders, non-native speakers, children, and the general public. In this paper, we present experiments on text simplification for the Lithuanian language, aiming to simplify administrative texts to a Plain Language level. We fine-tuned mT5 and mBART models for this task and evaluated the effectiveness of ChatGPT as well. We assessed simplification results via both quantitative metrics and qualitative evaluation. Our findings indicated that mBART performed the best as it achieved the best scores across all evaluation metrics. The qualitative analysis further supported these findings. ChatGPT experiments showed that it responded quite well to a short and simple prompt to simplify the given text; however, it ignored most of the rules given in a more elaborate prompt. Finally, our analysis revealed that BERTScore and ROUGE aligned moderately well with human evaluations, while BLEU and readability scores indicated lower or even negative correlations<\/jats:p>","DOI":"10.3390\/a17110533","type":"journal-article","created":{"date-parts":[[2024,11,20]],"date-time":"2024-11-20T09:14:38Z","timestamp":1732094078000},"page":"533","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Automatic Simplification of Lithuanian Administrative Texts"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9426-6165","authenticated-orcid":false,"given":"Justina","family":"Mandravickait\u0117","sequence":"first","affiliation":[{"name":"Faculty of Informatics, Vytautas Magnus University, 53361 Akademija, Kaunas District, Lithuania"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9352-9709","authenticated-orcid":false,"given":"Egl\u0117","family":"Rimkien\u0117","sequence":"additional","affiliation":[{"name":"Faculty of Informatics, Vytautas Magnus University, 53361 Akademija, Kaunas District, Lithuania"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-1673-9626","authenticated-orcid":false,"given":"Danguol\u0117 Kotryna","family":"Kapkan","sequence":"additional","affiliation":[{"name":"Faculty of Informatics, Vytautas Magnus University, 53361 Akademija, Kaunas District, Lithuania"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0641-2324","authenticated-orcid":false,"given":"Danguol\u0117","family":"Kalinauskait\u0117","sequence":"additional","affiliation":[{"name":"Faculty of Informatics, Vytautas Magnus University, 53361 Akademija, Kaunas District, Lithuania"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8509-420X","authenticated-orcid":false,"given":"Tomas","family":"Krilavi\u010dius","sequence":"additional","affiliation":[{"name":"Faculty of Informatics, Vytautas Magnus University, 53361 Akademija, Kaunas District, Lithuania"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,11,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"\u0160tajner, S. (2021, January 1\u20136). Automatic text simplification for social good: Progress and challenges. Proceedings of the Findings of the Association for Computational Linguistics: ACL\/IJCNLP 2021, Online Event.","DOI":"10.18653\/v1\/2021.findings-acl.233"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Fran\u00e7ois, T., M\u00fcller, A., Rolin, E., and Norr\u00e9, M. (2020, January 4\u20137). AMesure: A Web platform to assist the clear writing of administrative texts. Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing: System Demonstrations, Online Event.","DOI":"10.18653\/v1\/2020.aacl-demo.1"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Solan, L.M., and Tiersma, P.M. (2012). The Plain Language Movement. The Oxford Handbook of Language and Law, Oxford University Press.","DOI":"10.1093\/oxfordhb\/9780199572120.001.0001"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Maa\u00df, C. (2020). Easy Language\u2013Plain Language\u2013Easy Language Plus: Balancing Comprehensibility and Acceptability, Frank & Timme.","DOI":"10.26530\/20.500.12657\/42089"},{"key":"ref_5","unstructured":"Rennes, E., and J\u00f6nsson, A. (2015, January 11\u201313). A tool for automatic simplification of Swedish texts. Proceedings of the 20th Nordic Conference of Computational Linguistics, Link\u00f6ping University Electronic Press, Link\u00f6ping, Sweden."},{"key":"ref_6","unstructured":"Suter, J., Ebling, S., and Volk, M. (2016). Rule-based Automatic Text Simplification for German. Boch. Linguist. Arbeitsberichte, 279."},{"key":"ref_7","unstructured":"\u0160tajner, S., and Saggion, H. (2018, January 20\u201326). Data-driven text simplification. Proceedings of the 27th International Conference on Computational Linguistics: Tutorial Abstracts, Santa Fe, NM, USA."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Srikanth, N., and Li, J.J. (2020). Elaborative simplification: Content addition and explanation generation in text simplification. arXiv Prepr.","DOI":"10.18653\/v1\/2021.findings-acl.455"},{"key":"ref_9","first-page":"1","article-title":"Automated Text Simplification: A Survey","volume":"54","author":"Azmi","year":"2021","journal-title":"ACM Comput. Surv."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Swain, D., Tambe, M., Ballal, P., Dolase, V., Agrawal, K., and Rajmane, Y. (2019, January 12\u201313). Lexical text simplification using WordNet. Proceedings of the Advances in Computing and Data Sciences: Third International Conference, ICACDS 2019, Ghaziabad, India. Revised Selected Papers, Part II 3.","DOI":"10.1007\/978-981-13-9942-8_11"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"58755","DOI":"10.1109\/ACCESS.2021.3072697","article-title":"Lexical simplification system to improve web accessibility","volume":"9","author":"Alarcon","year":"2021","journal-title":"IEEE Access"},{"key":"ref_12","unstructured":"Qiang, J., Li, Y., Zhu, Y., Yuan, Y., and Wu, X. (2020). LSBert: A simple framework for lexical simplification. arXiv Prepr."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"53290","DOI":"10.1109\/ACCESS.2022.3174846","article-title":"Pattern-based syntactic simplification of compound and complex sentences","volume":"10","author":"Kumar","year":"2022","journal-title":"IEEE Access"},{"key":"ref_14","unstructured":"\u0160tajner, S., and Popovi\u0107, M. (2019, January 2\u20134). Automated text simplification as a preprocessing step for machine translation into an under-resourced language. Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2019), Varna, Bulgaria."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Vu, T., Hu, B., Munkhdalai, T., and Yu, H. (2018). Sentence simplification with memory-augmented neural networks. arXiv Prepr.","DOI":"10.18653\/v1\/N18-2013"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Agrawal, S., and Carpuat, M. (2019, January 3\u20137). Controlling Text Complexity in Neural Machine Translation. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.","DOI":"10.18653\/v1\/D19-1166"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Mallinson, J., Sennrich, R., and Lapata, M. (2020, January 16\u201320). Zero-shot crosslingual sentence simplification. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Online.","DOI":"10.18653\/v1\/2020.emnlp-main.415"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Sakakini, T., Lee, J.Y., Duri, A., Azevedo, R.F., Sadauskas, V., Gu, K., Bhat, S., Morrow, D., Graumlich, J., and Walayat, S. (2020, January 20). Context-aware automatic text simplification of health materials in low-resource domains. Proceedings of the 11th International Workshop on Health Text Mining and Information Analysis, Online Event.","DOI":"10.18653\/v1\/2020.louhi-1.13"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"de Lima, T.B., Nascimento, A.C., Valen\u00e7a, G., Miranda, P., Mello, R.F., and Si, T. (December, January 29). Portuguese neural text simplification using machine translation. Proceedings of the Intelligent Systems: 10th Brazilian Conference, BRACIS 2021, Virtual Event. Proceedings, Part II 10.","DOI":"10.1007\/978-3-030-91699-2_37"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Botarleanu, R.M., Dascalu, M., Crossley, S.A., and McNamara, D.S. (2020, January 6\u201310). Sequence-to-sequence models for automated text simplification. Proceedings of the Artificial Intelligence in Education: 21st International Conference, AIED 2020, Ifrane, Morocco. Proceedings, Part II 21.","DOI":"10.1007\/978-3-030-52240-7_6"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Maddela, M., Alva-Manchego, F., and Xu, W. (2020). Controllable text simplification with explicit paraphrasing. arXiv Prepr.","DOI":"10.18653\/v1\/2021.naacl-main.277"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Ul\u010dar, M., and Robnik-\u0160ikonja, M. (2023). Sequence-to-sequence pretraining for a less-resourced Slovenian language. Front. Artif. Intell., 6.","DOI":"10.3389\/frai.2023.932519"},{"key":"ref_23","unstructured":"Dmitrieva, A., and Tiedemann, J. (2024, January 21). Towards Automatic Finnish Text Simplification. Proceedings of the Workshop on DeTermIt! Evaluating Text Difficulty in a Multilingual Context@ LREC-COLING 2024, Torino, Italy."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhao, S., Meng, R., He, D., Andi, S., and Bambang, P. (2018). Integrating transformer and paraphrase rules for sentence simplification. arXiv Prepr.","DOI":"10.18653\/v1\/D18-1355"},{"key":"ref_25","unstructured":"Omelianchuk, K., Raheja, V., and Skurzhanskyi, O. (2021, January 20). Text Simplification by Tagging. Proceedings of the 16th Workshop on Innovative Use of NLP for Building Educational Applications, Online Event."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2817","DOI":"10.1007\/s00330-023-10213-1","article-title":"ChatGPT makes medicine easy to swallow: An exploratory case study on simplified radiology reports","volume":"34","author":"Jeblick","year":"2023","journal-title":"Eur. Radiol."},{"key":"ref_27","unstructured":"Rogers, A., Boyd-Graber, J., and Okazaki, N. (2023, January 9\u201314). Teaching the Pre-trained Model to Generate Simple Texts for Text Simplification. Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, Toronto, ON, Canada."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Huang, C.Y., Wei, J., and Huang, T.H. (2024). Generating Educational Materials with Different Levels of Readability using LLMs. arXiv Prepr.","DOI":"10.1145\/3690712.3690718"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Agrawal, S., and Carpuat, M. (2023, January 6\u201310). Controlling Pre-trained Language Models for Grade-Specific Text Simplification. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, Singapore.","DOI":"10.18653\/v1\/2023.emnlp-main.790"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Qiang, J., Li, Y., Zhu, Y., Yuan, Y., and Wu, X. (2020, January 7\u201312). Lexical simplification with pretrained encoders. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i05.6389"},{"key":"ref_31","first-page":"3479","article-title":"Text simplification using transformer and BERT","volume":"75","author":"Alissa","year":"2023","journal-title":"Comput. Mater. Contin."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Sheang, K.C., and Saggion, H. (2021, January 20\u201324). Controllable sentence simplification with a unified text-to-text transfer transformer. Proceedings of the 14th International Conference on Natural Language Generation (INLG), Aberdeen, UK.","DOI":"10.18653\/v1\/2021.inlg-1.38"},{"key":"ref_33","first-page":"31","article-title":"Controllable Sentence Simplification in Dutch","volume":"13","author":"Seidl","year":"2024","journal-title":"Comput. Linguist. Neth. J."},{"key":"ref_34","unstructured":"Monteiro, J., Aguiar, M., and Ara\u00fajo, S. (2022, January 5\u20138). Using a pre-trained SimpleT5 model for text simplification in a limited corpus. Proceedings of the Working Notes of CLEF 2022, Bologna, Italy."},{"key":"ref_35","unstructured":"Schlippe, T., and Eichinger, K. Multilingual Text Simplification and its Performance on Social Sciences Coursebooks. Proceedings of the International Conference on Artificial Intelligence in Education Technology."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Devaraj, A., Wallace, B.C., Marshall, I.J., and Li, J.J. (2021, January 6\u201311). Paragraph-level simplification of medical texts. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Online Event.","DOI":"10.18653\/v1\/2021.naacl-main.395"},{"key":"ref_37","unstructured":"V\u00e1squez-Rodr\u00edguez, L., Shardlow, M., Przyby\u0142a, P., and Ananiadou, S. (2023, January 7). Document-level Text Simplification with Coherence Evaluation. Proceedings of the Second Workshop on Text Simplification, Accessibility and Readability associated with RANLP-2023, Varna, Bulgaria."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Wen, Z., and Fang, Y. (2023, January 23\u201327). Augmenting low-resource text classification with graph-grounded pre-training and prompting. Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval, Taipei, Taiwan.","DOI":"10.1145\/3539618.3591641"},{"key":"ref_39","unstructured":"\u0160tajner, S., Saggio, H., Shardlow, M., and Alva-Manchego, F. (2023, January 7). Using ChatGPT as a CAT tool in Easy Language translation. Proceedings of the Second Workshop on Text Simplification, Accessibility and Readability associated with RANLP-2023, Varna, Bulgaria."},{"key":"ref_40","unstructured":"\u0160tajner, S., Saggio, H., Shardlow, M., and Alva-Manchego, F. (2023, January 7). Comparing Generic and Expert Models for Genre-Specific Text Simplification. Proceedings of the Second Workshop on Text Simplification, Accessibility and Readability, Varna, Bulgaria."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"573","DOI":"10.1007\/s11606-023-08469-w","article-title":"New frontiers in health literacy: Using ChatGPT to simplify health information for people in the community","volume":"39","author":"Ayre","year":"2024","journal-title":"J. Gen. Intern. Med."},{"key":"ref_42","first-page":"e55304","article-title":"Assessing the Utility of ChatGPT in Simplifying Text Complexity of Patient Educational Materials","volume":"16","author":"Sudharshan","year":"2024","journal-title":"Cureus"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Tariq, R., Malik, S., Roy, M., Islam, M.Z., Rasheed, U., Bian, J., Zheng, K., and Zhang, R. (2023, January 26\u201329). Assessing ChatGPT for Text Summarization, Simplification and Extraction Tasks. Proceedings of the 2023 IEEE 11th International Conference on Healthcare Informatics (ICHI), Houston, TX, USA.","DOI":"10.1109\/ICHI57859.2023.00136"},{"key":"ref_44","unstructured":"Guo, B., Zhang, X., Wang, Z., Jiang, M., Nie, J., Ding, Y., Yue, J., and Wu, Y. (2023). How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detection. arXiv."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Doshi, R., Amin, K.S., Khosla, P., Bajaj, S., Chheang, S., and Forman, H.P. (2023). Utilizing Large Language Models to Simplify Radiology Reports: A comparative analysis of ChatGPT-3.5, ChatGPT-4.0, Google Bard, and Microsoft Bing. medRxiv.","DOI":"10.1101\/2023.06.04.23290786"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Blinova, S., Zhou, X., Jaggi, M., Eickhoff, C., and Bahrainian, S.A. (2023, January 9\u201314). SIMSUM: Document-level Text Simplification via Simultaneous Summarization. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Toronto, ON, Canada.","DOI":"10.18653\/v1\/2023.acl-long.552"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Colas, A., Ma, H., He, X., Bai, Y., and Wang, D.Z. (2023, January 21\u201325). Can Knowledge Graphs Simplify Text?. Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, Birmingham, UK.","DOI":"10.1145\/3583780.3615514"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Raheja, V., Alikaniotis, D., Kulkarni, V., Alhafni, B., and Kumar, D. (2024, January 16\u201321). mEdIT: Multilingual Text Editing via Instruction Tuning. Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), Mexico City, Mexico.","DOI":"10.18653\/v1\/2024.naacl-long.56"},{"key":"ref_49","unstructured":"Saini, A., Chernodub, A., Raheja, V., and Kulkarni, V. (2024, January 25). Spivavtor: An Instruction Tuned Ukrainian Text Editing Model. Proceedings of the Third Ukrainian Natural Language Processing Workshop (UNLP)@ LREC-COLING 2024, Torino, Italy."},{"key":"ref_50","unstructured":"Tran, H., Yao, Z., Li, L., and Yu, H. (2024). ReadCtrl: Personalizing text generation with readability-controlled instruction learning. arXiv Prepr."},{"key":"ref_51","unstructured":"Basu, C., Vasu, R., Yasunaga, M., and Yang, Q. (2023, January 7\u201314). Med-EASi: Finely annotated dataset and models for controllable simplification of medical texts. Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence and Thirty-Fifth Conference on Innovative Applications of Artificial Intelligence and Thirteenth Symposium on Educational Advances in Artificial Intelligence, Cambridge, MA, USA. AAAI\u201923\/IAAI\u201923\/EAAI\u201923."},{"key":"ref_52","unstructured":"Kaur, P., Kashyap, G.S., Kumar, A., Nafis, M.T., Kumar, S., and Shokeen, V. (2024). From Text to Transformation: A Comprehensive Review of Large Language Models\u2019 Versatility. arXiv Prepr."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Sun, R., Yang, Z., and Wan, X. (2023, January 2\u20136). Exploiting Summarization Data to Help Text Simplification. Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, Dubrovnik, Croatia.","DOI":"10.18653\/v1\/2023.eacl-main.3"},{"key":"ref_54","unstructured":"Bouamor, H., Pino, J., and Bali, K. (2023, January 6\u201310). Multilingual Simplification of Medical Texts. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, Singapore."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Flores, L.J.Y., Huang, H., Shi, K., Chheang, S., and Cohan, A. (2023, January 6\u201310). Medical Text Simplification: Optimizing for Readability with Unlikelihood Training and Reranked Beam Search Decoding. Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, Singapore.","DOI":"10.18653\/v1\/2023.findings-emnlp.322"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Yamaguchi, D., Miyata, R., Shimada, S., and Sato, S. (2023, January 2\u20136). Gauging the gap between human and machine text simplification through analytical evaluation of simplification strategies and errors. Proceedings of the Findings of the Association for Computational Linguistics: EACL 2023, Dubrovnik, Croatia.","DOI":"10.18653\/v1\/2023.findings-eacl.27"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1080\/02564602.2022.2055670","article-title":"Studying the Effect of Syntactic Simplification on Text Summarization","volume":"40","author":"Chatterjee","year":"2022","journal-title":"IETE Tech. Rev."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Cripwell, L., Legrand, J., and Gardent, C. (2023, January 2\u20136). Document-Level Planning for Text Simplification. Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, Dubrovnik, Croatia.","DOI":"10.18653\/v1\/2023.eacl-main.70"},{"key":"ref_59","first-page":"634","article-title":"Impact of the Text Simplification on Understanding","volume":"294","author":"Ivchenko","year":"2022","journal-title":"Stud. Health Technol. Informatics"},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Wang, J. (2022). Research on Text Simplification Method Based on BERT. 2022 7th International Conference on Multimedia Communication Technologies (ICMCT), Xiamen, China, 7\u20139 July 2022, IEEE Computer Society.","DOI":"10.1109\/ICMCT57031.2022.00023"},{"key":"ref_61","unstructured":"Corti, L., and Yang, J. (2023). ARTIST: ARTificial Intelligence for Simplified Text. arXiv Prepr."},{"key":"ref_62","unstructured":"Scarton, C., Paetzold, G., and Specia, L. (2018, January 7\u201312). Simpa: A sentence-level simplification corpus for the public administration domain. Proceedings of the LREC 2018, Miyazaki, Japan."},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Schwarzer, M., Tanprasert, T., and Kauchak, D. (2021, January 11). Improving human text simplification with sentence fusion. Proceedings of the 15th Workshop on Graph-Based Methods for Natural Language Processing (TextGraphs-15), Mexico City, Mexico.","DOI":"10.18653\/v1\/2021.textgraphs-1.10"},{"key":"ref_64","first-page":"16","article-title":"Setting plain language standards","volume":"64","author":"Harris","year":"2010","journal-title":"Clarity J. Lansing"},{"key":"ref_65","first-page":"17","article-title":"International standard for clarity\u2014We bet this works for all languages","volume":"79","author":"Martinho","year":"2018","journal-title":"Clarity J."},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Brunato, D., Dell\u2019Orletta, F., Venturi, G., and Montemagni, S. (2015, January 5). Design and Annotation of the First Italian Corpus for Text Simplification. Proceedings of the 9th Linguistic Annotation Workshop, Denver, CO, USA.","DOI":"10.3115\/v1\/W15-1604"},{"key":"ref_67","unstructured":"D\u0119bowski, \u0141., Broda, B., Nito\u0144, B., and Charzy\u0144ska, E. (2015). Jasnopis\u2014A program to compute readability of texts in Polish based on psycholinguistic research. Natural Language Processing and Cognitive Science, Liberia Editrice Cafoscarina."},{"key":"ref_68","unstructured":"Utka, A. (2009). Da\u017eninis Ra\u0161ytin\u0117s Lietuvi\u0173 Kalbos \u017eOdynas, Vytautas Magnus University Press."},{"key":"ref_69","doi-asserted-by":"crossref","unstructured":"Kale, M., and Rastogi, A. (2020, January 15\u201318). Text-to-Text Pre-Training for Data-to-Text Tasks. Proceedings of the 13th International Conference on Natural Language Generation, Dublin, Ireland.","DOI":"10.18653\/v1\/2020.inlg-1.14"},{"key":"ref_70","doi-asserted-by":"crossref","unstructured":"Xue, L., Constant, N., Roberts, A., Kale, M., Al-Rfou, R., Siddhant, A., Barua, A., and Raffel, C. (2021, January 6\u201311). mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Online Event.","DOI":"10.18653\/v1\/2021.naacl-main.41"},{"key":"ref_71","doi-asserted-by":"crossref","unstructured":"Dodge, J., Sap, M., Marasovi\u0107, A., Agnew, W., Ilharco, G., Groeneveld, D., Mitchell, M., and Gardner, M. (2021). Documenting large webtext corpora: A case study on the colossal clean crawled corpus. arXiv Prepr.","DOI":"10.18653\/v1\/2021.emnlp-main.98"},{"key":"ref_72","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2023). Attention Is All You Need. arXiv."},{"key":"ref_73","doi-asserted-by":"crossref","unstructured":"Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., and Zettlemoyer, L. (2019). BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. arXiv.","DOI":"10.18653\/v1\/2020.acl-main.703"},{"key":"ref_74","unstructured":"Wenzek, G., Lachaux, M.A., Conneau, A., Chaudhary, V., Guzm\u00e1n, F., Joulin, A., and Grave, E. (2019). CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Data. arXiv."},{"key":"ref_75","doi-asserted-by":"crossref","unstructured":"Liu, Y., Gu, J., Goyal, N., Li, X., Edunov, S., Ghazvininejad, M., Lewis, M., and Zettlemoyer, L. (2020). Multilingual Denoising Pre-training for Neural Machine Translation. arXiv.","DOI":"10.1162\/tacl_a_00343"},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"54608","DOI":"10.1109\/ACCESS.2024.3389497","article-title":"GPT (Generative Pre-trained Transformer)\u2014A Comprehensive Review on Enabling Technologies, Potential Applications, Emerging Challenges, and Future Directions","volume":"12","author":"Yenduri","year":"2024","journal-title":"IEEE Access"},{"key":"ref_77","unstructured":"Rothman, D. (2022). Transformers for Natural Language Processing: Build, Train, and Fine-Tune Deep Neural Network Architectures for NLP with Python, Hugging Face, and OpenAI\u2019s GPT-3, ChatGPT, and GPT-4, Packt Publishing Ltd."},{"key":"ref_78","unstructured":"Papineni, K., Roukos, S., Ward, T., and Zhu, W.J. (2002, January 7\u201312). Bleu: A method for automatic evaluation of machine translation. Proceedings of the ACL 2002, Philadelphia, PA, USA."},{"key":"ref_79","unstructured":"Lin, C.Y. (2004, January 26\u201327). Rouge: A package for automatic evaluation of summaries. Proceedings of the Text Summarization Branches Out, Barcelona, Spain."},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1162\/tacl_a_00107","article-title":"Optimizing Statistical Machine Translation for Text Simplification","volume":"4","author":"Xu","year":"2016","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_81","doi-asserted-by":"crossref","unstructured":"Alva-Manchego, F., Martin, L., Scarton, C., and Specia, L. (2019, January 3\u20137). EASSE: Easier Automatic Sentence Simplification Evaluation. Proceedings of the EMNLP-IJCNLP 2019 (Demo Session), Hong Kong, China.","DOI":"10.18653\/v1\/D19-3009"},{"key":"ref_82","doi-asserted-by":"crossref","unstructured":"Ribeiro, V.H.A., Cavalin, P., and Morais, E. (2021, January 18\u201322). A Dynamic Multi-criteria Multi-engine Approach for Text Simplification. Proceedings of the 2021 International Joint Conference on Neural Networks (IJCNN), Online Event.","DOI":"10.1109\/IJCNN52387.2021.9533365"},{"key":"ref_83","unstructured":"Zhang, T., Kishore, V., Wu, F., Weinberger, K.Q., and Artzi, Y. (2019, January 6\u20139). BERTScore: Evaluating Text Generation with BERT. Proceedings of the International Conference on Learning Representations, New Orleans, LA, USA."},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"1976","DOI":"10.1093\/jamia\/ocac149","article-title":"A survey of automated methods for biomedical text simplification","volume":"29","author":"Ondov","year":"2022","journal-title":"J. Am. Med Inform. Assoc."},{"key":"ref_85","doi-asserted-by":"crossref","first-page":"53978","DOI":"10.1109\/ACCESS.2023.3279360","article-title":"Comprehensive readability assessment of scientific learning resources","volume":"11","author":"Arshad","year":"2023","journal-title":"IEEE Access"},{"key":"ref_86","unstructured":"Post, M. (November, January 31). A Call for Clarity in Reporting BLEU Scores. Proceedings of the Third Conference on Machine Translation: Research Papers, Brussels, Belgium."},{"key":"ref_87","unstructured":"Nisioi, S., \u0160tajner, S., Ponzetto, S.P., and Dinu, L.P. (August, January 30). Exploring neural text simplification models. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Vancouver, BC, Canada."},{"key":"ref_88","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1162\/coli_a_00370","article-title":"Data-driven sentence simplification: Survey and benchmark","volume":"46","author":"Scarton","year":"2020","journal-title":"Comput. Linguist."},{"key":"ref_89","unstructured":"Grabar, N., and Saggion, H. (July, January 27). Evaluation of Automatic Text Simplification: Where are we now, where should we go from here. Proceedings of the Traitement Automatique des Langues Naturelles. ATALA, Avignon, France."},{"key":"ref_90","doi-asserted-by":"crossref","first-page":"276","DOI":"10.11613\/BM.2012.031","article-title":"Interrater reliability: The kappa statistic","volume":"22","author":"McHugh","year":"2012","journal-title":"Biochem. Medica"},{"key":"ref_91","first-page":"55","article-title":"Lietuvi\u0173 bendrin\u0117s ir administracin\u0117s kalbos santykis","volume":"80","year":"2007","journal-title":"Bendrin\u0117 Kalba (Iki 2014 Met\u0173\u2013Kalbos Kult\u016bRa)"},{"key":"ref_92","doi-asserted-by":"crossref","first-page":"4","DOI":"10.15388\/Verb.42","article-title":"Prompting Metalinguistic Awareness in Large Language Models: ChatGPT and Bias Effects on the Grammar of Italian and Italian Varieties","volume":"14","author":"Massaro","year":"2023","journal-title":"Verbum"},{"key":"ref_93","first-page":"87","article-title":"Comparison of values of Pearson\u2019s and Spearman\u2019s correlation coefficients on the same sets of data","volume":"30","author":"Hauke","year":"2011","journal-title":"Quaest. Geogr."},{"key":"ref_94","doi-asserted-by":"crossref","unstructured":"Sai, A.B., Dixit, T., Sheth, D.Y., Mohan, S., and Khapra, M.M. (2021, January 7\u201311). Perturbation CheckLists for Evaluating NLG Evaluation Metrics. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Punta Cana, Dominican Republic.","DOI":"10.18653\/v1\/2021.emnlp-main.575"},{"key":"ref_95","doi-asserted-by":"crossref","unstructured":"Zhang, S., and Bansal, M. (2021, January 7\u201311). Finding a Balanced Degree of Automation for Summary Evaluation. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Punta Cana, Dominican Republic.","DOI":"10.18653\/v1\/2021.emnlp-main.531"},{"key":"ref_96","doi-asserted-by":"crossref","unstructured":"Liu, Y., Iter, D., Xu, Y., Wang, S., Xu, R., and Zhu, C. (2023, January 6\u201310). G-Eval: NLG Evaluation using Gpt-4 with Better Human Alignment. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, Singapore.","DOI":"10.18653\/v1\/2023.emnlp-main.153"},{"key":"ref_97","doi-asserted-by":"crossref","unstructured":"Lamprinidis, S. (2023, January 25\u201326). LLM cognitive judgements differ from human. Proceedings of the International Conference on Frontiers of Artificial Intelligence, Ethics, and Multidisciplinary Applications, Athens, Greece.","DOI":"10.1007\/978-981-99-9836-4_2"},{"key":"ref_98","unstructured":"Leivada, E., Dentella, V., and Murphy, E. (2023). The Quo Vadis of the Relationship between Language and Large Language Models. arXiv e-prints."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/17\/11\/533\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:36:05Z","timestamp":1760114165000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/17\/11\/533"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,20]]},"references-count":98,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2024,11]]}},"alternative-id":["a17110533"],"URL":"https:\/\/doi.org\/10.3390\/a17110533","relation":{},"ISSN":["1999-4893"],"issn-type":[{"type":"electronic","value":"1999-4893"}],"subject":[],"published":{"date-parts":[[2024,11,20]]}}}