{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T17:14:24Z","timestamp":1778692464982,"version":"3.51.4"},"reference-count":11,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,5,9]],"date-time":"2026-05-09T00:00:00Z","timestamp":1778284800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,5,9]],"date-time":"2026-05-09T00:00:00Z","timestamp":1778284800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>In the rapidly evolving landscape of Natural Language Processing (NLP), transfer learning has emerged as a game-changing methodology, fundamentally altering how machine learning models are trained and deployed. The study at hand dives deep into the intricacies of transfer learning techniques, specifically focusing on their application in complex deep learning architectures within the NLP domain. By exploring a variety of architectural designs, fine-tuning methodologies, and alternative training paradigms, we aim to demystify the optimal strategies for harnessing the power of pre-trained models. To quantify the effectiveness of these approaches, we conducted a comprehensive series of experiments targeting key NLP tasks, such as text classification and language generation. Transfer learning significantly accelerated training and improved model accuracy, highlighting its practical advantages in NLP tasks. This dual benefit underscores the immense potential of advanced transfer learning techniques, making them an indispensable tool for future NLP applications. By implementing state-of-the-art transfer learning methodologies, companies can offer faster and more accurate NLP solutions, aligning perfectly with the ethos of \u201cBusiness Digitalized\u201d and catering to a broad spectrum of client needs in the market.<\/jats:p>","DOI":"10.1038\/s41598-026-39819-3","type":"journal-article","created":{"date-parts":[[2026,5,9]],"date-time":"2026-05-09T15:35:31Z","timestamp":1778340931000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Uncovering advanced transfer learning strategies for deep neural networks in natural language processing"],"prefix":"10.1038","volume":"16","author":[{"given":"Mohamed M.","family":"Abbassy","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Waleed M.","family":"Ead","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Amr I. A.","family":"El-Shora","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ayman M.","family":"Aboalndr","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2026,5,9]]},"reference":[{"key":"39819_CR1","doi-asserted-by":"crossref","unstructured":"Devlin, J., Chang, M. W., Lee, K., Toutanova, K. & BERT Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Vol.1, pp. 4171\u20134186 (2019).","DOI":"10.18653\/v1\/N19-1423"},{"key":"39819_CR2","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","volume":"115","author":"O Russakovsky","year":"2015","unstructured":"Russakovsky, O. et al. Imagenet large scale visual recognition challenge. Int. J. Comput. Vis. 115, 211\u2013252 (2015).","journal-title":"Int. J. Comput. Vis."},{"issue":"11","key":"39819_CR3","doi-asserted-by":"publisher","first-page":"4232","DOI":"10.1007\/s10489-018-1212-4","volume":"48","author":"D Xue","year":"2018","unstructured":"Xue, D. et al. Deep learning-based personality recognition from text posts of online social networks. Appl. Intell. 48 (11), 4232\u20134246 (2018).","journal-title":"Appl. Intell."},{"key":"39819_CR4","doi-asserted-by":"crossref","unstructured":"Popescu, A. M., Etzioni, O. & Kautz, H. Towards a theory of natural language interfaces to databases. In Proceedings of the 8th international conference on Intelligent user interfaces, pp.149\u2013157 (2003).","DOI":"10.1145\/604045.604070"},{"issue":"1","key":"39819_CR5","first-page":"1","volume":"11","author":"C Zuo","year":"2022","unstructured":"Zuo, C. et al. Deep learning in optical metrology: a review. Light Sci. Appl. 11 (1), 1\u201354 (2022).","journal-title":"Light Sci. Appl."},{"issue":"2","key":"39819_CR6","doi-asserted-by":"publisher","first-page":"604","DOI":"10.1109\/TNNLS.2020.2979670","volume":"32","author":"DW Otter","year":"2020","unstructured":"Otter, D. W., Medina, J. R. & Kalita, J. K. A survey of the usages of deep learning for natural Language processing. IEEE Trans. Neural Netw. Learn. Syst. 32 (2), 604\u2013624 (2020).","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"issue":"8","key":"39819_CR7","doi-asserted-by":"publisher","first-page":"4781","DOI":"10.3390\/app13084781","volume":"13","author":"M Guven","year":"2023","unstructured":"Guven, M. & Uysal, F. Time series forecasting performance of the novel deep learning algorithms on stack overflow website data. Appl. Sci. 13 (8), 4781 (2023).","journal-title":"Appl. Sci."},{"issue":"105","key":"39819_CR8","first-page":"1","volume":"24","author":"MR Smith","year":"2024","unstructured":"Smith, M. R., Kumar, A. & Gao, L. Recent developments in transfer learning for NLP: techniques and applications. J. Mach. Learn. Res. 24 (105), 1\u201332 (2024).","journal-title":"J. Mach. Learn. Res."},{"key":"39819_CR9","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/s11227-023-05567-8","volume":"80","author":"I Biri","year":"2024","unstructured":"Biri, I. et al. Forecasting the future popularity of the anti-vax narrative on Twitter with machine learning. J. Supercomputing. 80, 3 (2024).","journal-title":"J. Supercomputing"},{"key":"39819_CR10","unstructured":"Nguyen, T., Brown, J. & Lee, S. Advancements in Transfer Learning for NLP Tasks: A Review, Applied Sciences, vol. 13, no. 7, pp. 2345\u20132361, (2023)."},{"issue":"1","key":"39819_CR11","doi-asserted-by":"publisher","first-page":"749","DOI":"10.1007\/s10462-022-10183-8","volume":"56","author":"JYL Chan","year":"2023","unstructured":"Chan, J. Y. L. et al. State of the art: a review of sentiment analysis based on sequential transfer learning. Artif. Intell. Rev. 56 (1), 749\u2013780 (2023).","journal-title":"Artif. Intell. Rev."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-39819-3","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-39819-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-39819-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T16:34:43Z","timestamp":1778690083000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-39819-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,9]]},"references-count":11,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["39819"],"URL":"https:\/\/doi.org\/10.1038\/s41598-026-39819-3","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,9]]},"assertion":[{"value":"3 October 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 February 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 May 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"14698"}}