{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T10:40:50Z","timestamp":1776336050880,"version":"3.51.2"},"reference-count":56,"publisher":"Springer Science and Business Media LLC","issue":"18","license":[{"start":{"date-parts":[[2025,4,24]],"date-time":"2025-04-24T00:00:00Z","timestamp":1745452800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,4,24]],"date-time":"2025-04-24T00:00:00Z","timestamp":1745452800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100012997","name":"Arab Academy for Science, Technology & Maritime Transport","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100012997","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Neural Comput &amp; Applic"],"published-print":{"date-parts":[[2025,6]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Grammatical error correction (GEC) in Arabic presents unique challenges arising from complex morphology and contextual intricacies. Current methodologies predominantly rely on neural machine translation (NMT) models, hindered by adequately annotated training data scarcity. This research introduces a novel approach utilizing pre-trained transformers, specifically sequence-to-sequence (seq2seq) models, such as AraT5 and AraBART, alongside their multilingual variants (mT5 and mBART), to address Arabic GEC. These transformers, initially designed for diverse natural language processing tasks, demonstrate promising results in GEC, particularly when parallel data are limited. Employing tokenization and preprocessing techniques on publicly accessible GEC datasets, we train the transformers using a supervised approach. The experimental results showcase superior performance, surpassing previous models with an F1 score of 92.1% on the QALB 2014 dataset, 89.4% on the QALB 2015 native test data, and 83.6% on non-native data. This highlights the effectiveness of the proposed methodology in rectifying various grammatical errors in Arabic text. In conclusion, this study contributes to advancing the field of Arabic GEC by leveraging transfer learning with pre-trained transformers. The findings underscore the potential of this approach to overcome challenges posed by limited data availability, with AraBART emerging as a practical choice. This research opens avenues for further exploration in low-resource languages. It suggests potential applications in high-resource languages, encouraging future comparative studies.<\/jats:p>","DOI":"10.1007\/s00521-025-11145-1","type":"journal-article","created":{"date-parts":[[2025,4,24]],"date-time":"2025-04-24T10:26:49Z","timestamp":1745490409000},"page":"13011-13038","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Transformers to the rescue: alleviating data scarcity in arabic grammatical error correction with pre-trained models"],"prefix":"10.1007","volume":"37","author":[{"given":"Karim","family":"Ismail","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sherif","family":"Abdou","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mohamed","family":"Farouk","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0456-2276","authenticated-orcid":false,"given":"Ahmed","family":"Salem","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,4,24]]},"reference":[{"issue":"5","key":"11145_CR1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3234150","volume":"51","author":"S Pouyanfar","year":"2018","unstructured":"Pouyanfar S, Sadiq S, Yan Y, Tian H, Tao Y, Reyes MP, Shyu M-L, Chen S-C, Iyengar SS (2018) A survey on deep learning: algorithms, techniques, and applications. ACM Comput Surv 51(5):1\u201336. https:\/\/doi.org\/10.1145\/3234150","journal-title":"ACM Comput Surv"},{"key":"11145_CR2","doi-asserted-by":"publisher","first-page":"1071","DOI":"10.1007\/s11831-019-09344-w","volume":"27","author":"S Dargan","year":"2020","unstructured":"Dargan S, Kumar M, Ayyagari MR, Kumar G (2020) A survey of deep learning and its applications: a new paradigm to machine learning. Arch Comput Methods Eng 27:1071\u20131092. https:\/\/doi.org\/10.1007\/s11831-019-09344-w","journal-title":"Arch Comput Methods Eng"},{"key":"11145_CR3","doi-asserted-by":"publisher","DOI":"10.1016\/j.cosrev.2021.100379","volume":"40","author":"S Dong","year":"2021","unstructured":"Dong S, Wang P, Abbas K (2021) A survey on deep learning and its applications. Comput Sci Rev 40:100379. https:\/\/doi.org\/10.1016\/j.cosrev.2021.100379","journal-title":"Comput Sci Rev"},{"key":"11145_CR4","doi-asserted-by":"publisher","unstructured":"Li Y, Yang T (2018) Word embedding for understanding natural language: a survey. In: Guide to big data applications, pp 83\u2013104, https:\/\/doi.org\/10.1007\/978-3-319-53817-4_4","DOI":"10.1007\/978-3-319-53817-4_4"},{"key":"11145_CR5","doi-asserted-by":"publisher","unstructured":"Yang H, Luo L, Chueng LP, Ling D, Chin F (2019) Deep learning and its applications to natural language processing. In: Deep learning: fundamentals, theory and applications, pp 89\u2013109, https:\/\/doi.org\/10.1007\/978-3-030-06073-2_4","DOI":"10.1007\/978-3-030-06073-2_4"},{"key":"11145_CR6","doi-asserted-by":"publisher","unstructured":"Wang Y, Wang Y, Liu J, Liu Z (2005) A comprehensive survey of grammar error correction. arxiv 2020, arXiv preprint arXiv:2005.06600, https:\/\/doi.org\/10.48550\/arXiv.2005.06600","DOI":"10.48550\/arXiv.2005.06600"},{"issue":"1","key":"11145_CR7","doi-asserted-by":"publisher","first-page":"260","DOI":"10.1515\/jisys-2022-0013","volume":"31","author":"Yanghui Zhong and Xiaorui Yue","year":"2022","unstructured":"Yanghui Zhong and Xiaorui Yue (2022) On the correction of errors in english grammar by deep learning. J Intell Syst 31(1):260\u2013270. https:\/\/doi.org\/10.1515\/jisys-2022-0013","journal-title":"J Intell Syst"},{"key":"11145_CR8","doi-asserted-by":"publisher","unstructured":"Katsumata S, Komachi M (2020) Stronger baselines for grammatical error correction using pretrained encoder-decoder model arXiv preprint arXiv:2005.11849, https:\/\/doi.org\/10.48550\/arXiv.2005.11849","DOI":"10.48550\/arXiv.2005.11849"},{"key":"11145_CR9","first-page":"1","volume":"5","author":"H Liang","year":"2022","unstructured":"Liang H, Tang Y, Xinli W, Zeng J (2022) Considering optimization of english grammar error correction based on neural network. Neural Comput Appl 5:1\u201313","journal-title":"Neural Comput Appl"},{"key":"11145_CR10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2021\/4213791","volume":"2021","author":"J Zhu","year":"2021","unstructured":"Zhu J, Shi X, Zhang S (2021) Machine learning-based grammar error detection method in english composition. Sci Program 2021:1\u201310. https:\/\/doi.org\/10.1155\/2021\/4213791","journal-title":"Sci Program"},{"key":"11145_CR11","doi-asserted-by":"publisher","unstructured":"Solyman A, Wang Z, Tao Q (2019) Proposed model for arabic grammar error correction based on convolutional neural network. In: 2019 International Conference on Computer, Control, Electrical, and Electronics Engineering (ICCCEEE), pp 1\u20136, IEEE, https:\/\/doi.org\/10.1109\/ICCCEEE46830.2019.9071310","DOI":"10.1109\/ICCCEEE46830.2019.9071310"},{"issue":"15","key":"11145_CR12","doi-asserted-by":"publisher","first-page":"5279","DOI":"10.3390\/app10155279","volume":"10","author":"Nora Madi and Hend Al-Khalifa","year":"2020","unstructured":"Nora Madi and Hend Al-Khalifa (2020) Error detection for arabic text using neural sequence labeling. Appl Sci 10(15):5279. https:\/\/doi.org\/10.3390\/app10155279","journal-title":"Appl Sci"},{"issue":"4","key":"11145_CR13","doi-asserted-by":"publisher","first-page":"476","DOI":"10.1016\/j.jksuci.2019.02.005","volume":"33","author":"C Moukrim","year":"2021","unstructured":"Moukrim C, Abderrahim T, Tarik A et al (2021) An innovative approach to autocorrecting grammatical errors in Arabic texts. J King Saud Univ-Comput Inf Sci 33(4):476\u2013488. https:\/\/doi.org\/10.1016\/j.jksuci.2019.02.005","journal-title":"J King Saud Univ-Comput Inf Sci"},{"issue":"5","key":"11145_CR14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3373266","volume":"19","author":"M Alkhatib","year":"2020","unstructured":"Alkhatib M, Monem AA, Shaalan K (2020) Deep learning for Arabic error detection and correction. ACM Trans Asian Low-Resource Lang Inf Process 19(5):1\u201313. https:\/\/doi.org\/10.1145\/3373266","journal-title":"ACM Trans Asian Low-Resource Lang Inf Process"},{"key":"11145_CR15","first-page":"963","volume":"5","author":"OI Vinyals","year":"2014","unstructured":"Vinyals OI, Le Sutskever QV (2014) Sequence to sequence learning with neural networks. Adv Neural Inf Process Syst 5:963","journal-title":"Adv Neural Inf Process Syst"},{"key":"11145_CR16","first-page":"1877","volume":"33","author":"T Brown","year":"2020","unstructured":"Brown T, Mann B, Ryder N, Subbiah M, Kaplan JD, Dhariwal P, Neelakantan A, Shyam P, Sastry G, Askell A et al (2020) Language models are few-shot learners. Adv Neural Inf Process Syst 33:1877\u20131901","journal-title":"Adv Neural Inf Process Syst"},{"issue":"3","key":"11145_CR17","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1016\/j.eng.2019.12.014","volume":"6","author":"M Zhou","year":"2020","unstructured":"Zhou M, Duan N, Liu S, Shum H-Y (2020) Progress in neural nlp: modeling, learning, and reasoning. Engineering 6(3):275\u2013290. https:\/\/doi.org\/10.1016\/j.eng.2019.12.014","journal-title":"Engineering"},{"key":"11145_CR18","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s00521-021-05960-5","volume":"7","author":"A Mohamed","year":"2021","unstructured":"Mohamed A, Elaziz DA, Abualigah L, Yu L, Alshinwan M, Khasawneh AM, Lu S (2021) Advanced metaheuristic optimization techniques in applications of deep neural networks: a review. Neural Comput Appl 7:1\u201321. https:\/\/doi.org\/10.1007\/s00521-021-05960-5","journal-title":"Neural Comput Appl"},{"key":"11145_CR19","first-page":"632","volume":"27","author":"I Sutskever","year":"2014","unstructured":"Sutskever I, Vinyals O, Le QV (2014) Sequence to sequence learning with neural networks. Adv Neural Inf Process Syst 27:632","journal-title":"Adv Neural Inf Process Syst"},{"key":"11145_CR20","doi-asserted-by":"publisher","unstructured":"Bahdanau D, Cho K, Bengio Y (2014) Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473, https:\/\/doi.org\/10.48550\/arXiv.1409.0473","DOI":"10.48550\/arXiv.1409.0473"},{"key":"11145_CR21","first-page":"432","volume":"8","author":"D Hu","year":"2019","unstructured":"Hu D (2019) An introductory survey on attention mechanisms in NLP problems. Adv Intell Syst Comput 8:432\u2013448","journal-title":"Adv Intell Syst Comput"},{"issue":"10","key":"11145_CR22","doi-asserted-by":"publisher","first-page":"4291","DOI":"10.1109\/TNNLS.2020.3019893","volume":"32","author":"A Galassi","year":"2020","unstructured":"Galassi A, Lippi M, Torroni P (2020) Attention in natural language processing. IEEE Trans Neural Netw Learn Syst 32(10):4291\u20134308. https:\/\/doi.org\/10.1109\/TNNLS.2020.3019893","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"issue":"11","key":"11145_CR23","doi-asserted-by":"publisher","first-page":"8423","DOI":"10.1007\/s00521-022-08115-2","volume":"35","author":"P Kenneweg","year":"2023","unstructured":"Kenneweg P, Stallmann D, Hammer B (2023) Novel transfer learning schemes based on siamese networks and synthetic data. Neural Comput Appl 35(11):8423\u20138436. https:\/\/doi.org\/10.1007\/s00521-022-08115-2","journal-title":"Neural Comput Appl"},{"key":"11145_CR24","first-page":"1","volume":"7","author":"A Francisca","year":"2021","unstructured":"Francisca A, Acheampong HN-M, Chen W (2021) Transformer models for text-based emotion detection: a review of bert-based approaches. Artifi Intell Rev 7:1\u201341","journal-title":"Artifi Intell Rev"},{"key":"11145_CR25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s00521-023-08687-7","volume":"8","author":"S Kumar","year":"2023","unstructured":"Kumar S, Solanki A (2023) An abstractive text summarization technique using transformer model with self-attention mechanism. Neural Comput Appl 8:1\u201320. https:\/\/doi.org\/10.1007\/s00521-023-08687-7","journal-title":"Neural Comput Appl"},{"key":"11145_CR26","doi-asserted-by":"publisher","unstructured":"Asa CS, Li X, Ghazvininejad M (2020) Recipes for adapting pre-trained monolingual and multilingual models to machine translation. arXiv preprint arXiv:2004.14911, https:\/\/doi.org\/10.48550\/arXiv.2004.14911","DOI":"10.48550\/arXiv.2004.14911"},{"key":"11145_CR27","doi-asserted-by":"publisher","first-page":"21709","DOI":"10.1007\/s00521-023-08858-6","volume":"35","author":"DT Mosa","year":"2023","unstructured":"Mosa DT, Nasef NA, Lotfy MA et al (2023) A real-time Arabic avatar for deaf\u2013mute community using attention mechanism. Neural Comput Applic 35:21709\u201321723. https:\/\/doi.org\/10.1007\/s00521-023-08858-6","journal-title":"Neural Comput Applic"},{"key":"11145_CR28","doi-asserted-by":"publisher","unstructured":"Eddine MK, Tomeh N, Habash N, Roux J\u00a0Le, Vazirgiannis M (2022) Arabart: a pretrained arabic sequence-to-sequence model for abstractive summarization. arXiv preprint arXiv:2203.10945, https:\/\/doi.org\/10.48550\/arXiv.2203.10945","DOI":"10.48550\/arXiv.2203.10945"},{"key":"11145_CR29","doi-asserted-by":"publisher","unstructured":"Xue L, Constant N, Roberts A, Kale M, Al-Rfou R, Siddhant A, Barua A, Raffel C (2020) mt5: a massively multilingual pre-trained text-to-text transformer. arXiv preprint arXiv:2010.11934, https:\/\/doi.org\/10.48550\/arXiv.2010.11934","DOI":"10.48550\/arXiv.2010.11934"},{"key":"11145_CR30","doi-asserted-by":"publisher","first-page":"726","DOI":"10.1162\/tacl_a_00343","volume":"8","author":"Y Liu","year":"2020","unstructured":"Liu Y, Jiatao G, Goyal N, Li X, Edunov S, Ghazvininejad M, Lewis M, Zettlemoyer L (2020) Multilingual denoising pre-training for neural machine translation. Trans Assoc Comput Ling 8:726\u2013742. https:\/\/doi.org\/10.1162\/tacl_a_00343","journal-title":"Trans Assoc Comput Ling"},{"key":"11145_CR31","doi-asserted-by":"publisher","unstructured":"Alhafni B, Inoue G, Khairallah C, Habash N (2023) Advancements in arabic grammatical error detection and correction: an empirical investigation arXiv preprint arXiv:2305.14734, https:\/\/doi.org\/10.48550\/arXiv.2305.14734","DOI":"10.48550\/arXiv.2305.14734"},{"issue":"6","key":"11145_CR32","doi-asserted-by":"publisher","DOI":"10.1016\/j.jksuci.2023.101572","volume":"35","author":"A Solyman","year":"2023","unstructured":"Solyman A, Zappatore M, Zhenyu W, Mahmoud Z, Alfatemi A, Ibrahim AO, Gabralla LA (2023) Optimizing the impact of data augmentation for low-resource grammatical error correction. J King Saud Univ-Comput Inf Sci 35(6):101572. https:\/\/doi.org\/10.1016\/j.jksuci.2023.101572","journal-title":"J King Saud Univ-Comput Inf Sci"},{"issue":"3","key":"11145_CR33","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1016\/j.eij.2020.12.001","volume":"22","author":"A Solyman","year":"2021","unstructured":"Solyman A, Zhenyu W, Qian T, Elhag A, Toseef M, Aleibeid Z (2021) Synthetic data with neural machine translation for automatic correction in Arabic grammar. Egy Inf J 22(3):303\u2013315. https:\/\/doi.org\/10.1016\/j.eij.2020.12.001","journal-title":"Egy Inf J"},{"key":"11145_CR34","doi-asserted-by":"publisher","unstructured":"Abandah GA, Suyyagh A, Khedher MZ (2021) Correcting arabic soft spelling mistakes using bilstm-based machine learning. arXiv preprint arXiv:2108.01141, https:\/\/doi.org\/10.48550\/arXiv.2108.01141","DOI":"10.48550\/arXiv.2108.01141"},{"key":"11145_CR35","doi-asserted-by":"publisher","unstructured":"Alayba AM, Palade V, England M, Iqbal R (2018) A combined cnn and lstm model for arabic sentiment analysis. In: Machine Learning and Knowledge Extraction: Second IFIP TC 5, TC 8\/WG 8.4, 8.9, TC 12\/WG 12.9 International Cross-Domain Conference, CD-MAKE 2018, Hamburg, Germany, August 27\u201330, 2018, Proceedings 2, pp 179\u2013191, Springer, https:\/\/doi.org\/10.1007\/978-3-319-99740-7_12","DOI":"10.1007\/978-3-319-99740-7_12"},{"key":"11145_CR36","first-page":"963","volume":"30","author":"A Vaswani","year":"2017","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser \u0141, Polosukhin I (2017) Attention is all you need. Adv Neural Inf Process Syst 30:963","journal-title":"Adv Neural Inf Process Syst"},{"key":"11145_CR37","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.aiopen.2022.01.001","volume":"3","author":"R Ludan","year":"2022","unstructured":"Ludan R, Qin J (2022) Survey: transformer based video-language pre-training. AI Open 3:1\u201313. https:\/\/doi.org\/10.1016\/j.aiopen.2022.01.001","journal-title":"AI Open"},{"issue":"8","key":"11145_CR38","doi-asserted-by":"publisher","first-page":"6115","DOI":"10.1007\/s00521-022-07944-5","volume":"35","author":"MA Humayun","year":"2023","unstructured":"Humayun MA, Yassin H, Shuja J, Alourani A, Abas PE (2023) A transformer fine-tuning strategy for text dialect identification. Neural Comput Appl 35(8):6115\u20136124. https:\/\/doi.org\/10.1007\/s00521-022-07944-5","journal-title":"Neural Comput Appl"},{"issue":"19","key":"11145_CR39","doi-asserted-by":"publisher","first-page":"16945","DOI":"10.1007\/s00521-022-07346-7","volume":"34","author":"R Dharaniya","year":"2022","unstructured":"Dharaniya R, Indumathi J, Uma GV (2022) Automatic scene generation using sentiment analysis and bidirectional recurrent neural network with multi-head attention. Neural Comput Appl 34(19):16945\u201316958. https:\/\/doi.org\/10.1007\/s00521-022-07346-7","journal-title":"Neural Comput Appl"},{"key":"11145_CR40","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s40537-021-00492-0","volume":"8","author":"C Shorten","year":"2021","unstructured":"Shorten C, Khoshgoftaar TM, Furht B (2021) Text data augmentation for deep learning. J Big Data 8:1\u201334. https:\/\/doi.org\/10.1186\/s40537-021-00492-0","journal-title":"J Big Data"},{"key":"11145_CR41","doi-asserted-by":"crossref","unstructured":"Pennington J, Socher R, Manning CD (2014) Glove: global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp 1532\u20131543","DOI":"10.3115\/v1\/D14-1162"},{"key":"11145_CR42","doi-asserted-by":"publisher","DOI":"10.1016\/j.mlwa.2022.100334","volume":"9","author":"S Casola","year":"2022","unstructured":"Casola S, Lauriola I, Lavelli A (2022) Pre-trained transformers: an empirical comparison. Mach Learn Appl 9:100334. https:\/\/doi.org\/10.1016\/j.mlwa.2022.100334","journal-title":"Mach Learn Appl"},{"key":"11145_CR43","doi-asserted-by":"publisher","unstructured":"Devlin J, Chang M-W, Lee K, Toutanova K (2018) Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805, https:\/\/doi.org\/10.48550\/arXiv.1810.04805","DOI":"10.48550\/arXiv.1810.04805"},{"key":"11145_CR44","doi-asserted-by":"publisher","unstructured":"Lewis M, Liu Y, Goyal N, Ghazvininejad M, Mohamed A, Levy O, Stoyanov V, Zettlemoyer L (2019) Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. arXiv preprint arXiv:1910.13461, https:\/\/doi.org\/10.48550\/arXiv.1910.13461","DOI":"10.48550\/arXiv.1910.13461"},{"key":"11145_CR45","doi-asserted-by":"publisher","first-page":"681","DOI":"10.1007\/s11023-020-09548-1","volume":"30","author":"Luciano Floridi and Massimo Chiriatti","year":"2020","unstructured":"Luciano Floridi and Massimo Chiriatti (2020) Gpt-3: Its nature, scope, limits, and consequences. Mind Mach 30:681\u2013694. https:\/\/doi.org\/10.1007\/s11023-020-09548-1","journal-title":"Mind Mach"},{"key":"11145_CR46","doi-asserted-by":"publisher","unstructured":"Ni J, \u00c1brego GH, Constant N, Ma J, Hall KB, Cer D, Yang Y (2021) Sentence-t5: scalable sentence encoders from pre-trained text-to-text models. arXiv preprint arXiv:2108.08877, https:\/\/doi.org\/10.48550\/arXiv.2108.08877","DOI":"10.48550\/arXiv.2108.08877"},{"key":"11145_CR47","doi-asserted-by":"publisher","unstructured":"Sabharwal N, Agrawal A, Sabharwal N, Agrawal A (2021) Future of bert models. In: Hands-on question answering systems with BERT: applications in neural networks and natural language processing, pp 173\u2013178, https:\/\/doi.org\/10.1007\/978-1-4842-6664-9_7","DOI":"10.1007\/978-1-4842-6664-9_7"},{"key":"11145_CR48","doi-asserted-by":"publisher","unstructured":"Grover K, Kaur K, Tiwari K, Rupali, Kumar P (2021) Deep learning based question generation using t5 transformer. In: Advanced Computing: 10th International Conference, IACC 2020, Panaji, Goa, India, December 5\u20136, 2020, Revised Selected Papers, Part I 10, pp 243\u2013255, Springer, https:\/\/doi.org\/10.1007\/978-981-16-0401-0_18","DOI":"10.1007\/978-981-16-0401-0_18"},{"issue":"4","key":"11145_CR49","doi-asserted-by":"publisher","first-page":"3129","DOI":"10.1007\/s12652-021-03439-8","volume":"14","author":"JJ Bird","year":"2023","unstructured":"Bird JJ, Ek\u00e1rt A, Faria DR (2023) Chatbot interaction with artificial intelligence: human data augmentation with t5 and language transformer ensemble for text classification. J Ambient Intell Humaniz Comput 14(4):3129\u20133144. https:\/\/doi.org\/10.1007\/s12652-021-03439-8","journal-title":"J Ambient Intell Humaniz Comput"},{"key":"11145_CR50","doi-asserted-by":"publisher","unstructured":"Antoun W, Baly F, Hajj H (2020), Arabert: transformer-based model for arabic language understanding. arXiv preprint arXiv:2003.00104, https:\/\/doi.org\/10.48550\/arXiv.2003.00104","DOI":"10.48550\/arXiv.2003.00104"},{"key":"11145_CR51","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2022.108180","volume":"241","author":"A Solyman","year":"2022","unstructured":"Solyman A, Wang Z, Tao Q, Elhag A, Zhang R, Mahmoud Z (2022) Automatic arabic grammatical error correction based on expectation-maximization routing and target-bidirectional agreement. Knowl-Based Syst 241:108180. https:\/\/doi.org\/10.1016\/j.knosys.2022.108180","journal-title":"Knowl-Based Syst"},{"key":"11145_CR52","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2022.116948","volume":"200","author":"Krzysztof Paj\u0105k and Dominik Paj\u0105k","year":"2022","unstructured":"Krzysztof Paj\u0105k and Dominik Paj\u0105k (2022) Multilingual fine-tuning for grammatical error correction. Expert Syst Appl 200:116948. https:\/\/doi.org\/10.1016\/j.eswa.2022.116948","journal-title":"Expert Syst Appl"},{"key":"11145_CR53","doi-asserted-by":"publisher","unstructured":"Sang YK, Bhatia G, Nagoudi El MB, Abdul-Mageed M (2023) Beyond english: evaluating llms for arabic grammatical error correction. arXiv preprint arXiv:2312.08400, https:\/\/doi.org\/10.48550\/arXiv.2312.08400","DOI":"10.48550\/arXiv.2312.08400"},{"key":"11145_CR54","doi-asserted-by":"publisher","unstructured":"Holtzman A, Buys J, Li D, Forbes M, Choi Y (2019) The curious case of neural text degeneration. arXiv preprint arXiv:1904.09751, https:\/\/doi.org\/10.48550\/arXiv.1904.09751","DOI":"10.48550\/arXiv.1904.09751"},{"key":"11145_CR55","doi-asserted-by":"publisher","unstructured":"Welleck S, Kulikov I, Roller S, Dinan E, Cho K, Weston J (2019) Neural text generation with unlikelihood training arXiv preprint arXiv:1908.04319, https:\/\/doi.org\/10.48550\/arXiv.1908.04319","DOI":"10.48550\/arXiv.1908.04319"},{"issue":"11s","key":"11145_CR56","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3512467","volume":"54","author":"Yu Wenhao","year":"2022","unstructured":"Wenhao Yu, Zhu C, Li Z, Zhiting H, Wang Q, Ji H, Jiang M (2022) A survey of knowledge-enhanced text generation. ACM Comput Surv 54(11s):1\u201338. https:\/\/doi.org\/10.1145\/3512467","journal-title":"ACM Comput Surv"}],"container-title":["Neural Computing and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-025-11145-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00521-025-11145-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-025-11145-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T14:55:16Z","timestamp":1750172116000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00521-025-11145-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,24]]},"references-count":56,"journal-issue":{"issue":"18","published-print":{"date-parts":[[2025,6]]}},"alternative-id":["11145"],"URL":"https:\/\/doi.org\/10.1007\/s00521-025-11145-1","relation":{},"ISSN":["0941-0643","1433-3058"],"issn-type":[{"value":"0941-0643","type":"print"},{"value":"1433-3058","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4,24]]},"assertion":[{"value":"13 March 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 February 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 April 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors disclose no conflict of interest relevant to the content of this article. Furthermore, the authors do not have any relevant financial or non-financial interests to state.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}