{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,12]],"date-time":"2026-06-12T00:07:54Z","timestamp":1781222874609,"version":"3.54.1"},"reference-count":87,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,4,20]],"date-time":"2026-04-20T00:00:00Z","timestamp":1776643200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,6,12]],"date-time":"2026-06-12T00:00:00Z","timestamp":1781222400000},"content-version":"vor","delay-in-days":53,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>The metaverse refers to a digital environment that enables real-time user interaction through immersive technologies. Recent advancements in deep learning have particularly strengthened the capabilities of Natural Language Processing (NLP) and Large Language Models (LLMs). These developments have made human\u2013computer interactions in the metaverse more natural and responsive, especially those involving users and non-Player Characters (NPCs). Many virtual platforms use LLMs-powered Application Programming Interfaces (APIs) to facilitate these interactions, but these often produce long, semantically irrelevant responses that weaken the user\u2019s immersive experience. This study addresses this limitation by designing NLP systems capable of generating concise, context-aware, and task-oriented outputs for AI-powered NPCs. Unlike open-domain conversational agents, dialogue systems for metaverse-based NPCs operate under strict real-time and contextual constraints. NPC interactions require concise, task-oriented, and context-aware responses, as overly long or semantically irrelevant outputs can disrupt immersion and degrade user experience. Although recent advances in LLMs have improved dialogue generation, most existing studies focus on open-ended conversations or general-purpose question answering. This study addresses this gap by systematically investigating fine-tuning and Retrieval-Augmented Generation (RAG) strategies within a metaverse-focused dialogue domain. We propose a comparative evaluation of systems developed using fine-tuning and RAG techniques between decoder-only models (GPT-2, LLaMA, Qwen) and encoder-decoder models (mBART, mT5). The models trained on the dataset were evaluated using a combination of standard evaluation metrics and semantic-based criteria. All evaluation scores were normalized using the Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) method to ensure objective comparability between models. The findings indicate that RAG provides a more balanced performance, particularly when applied to encoder-decoder models such as mBART (~\u20090.652) and mT5 (~\u20090.555), even when trained on relatively small datasets. Additionally, this paper presents a speech-based interaction framework designed to enable personalized and real-time communication in metaverse environments. The proposed framework is structured as Speech-to-Text (STT)\u2009\u2192\u2009LLMs\u2009\u2192\u2009Text-to-Speech (TTS). This architecture improves interaction quality by enabling coherent and realistic speech-based communication.<\/jats:p>","DOI":"10.1038\/s41598-026-35392-x","type":"journal-article","created":{"date-parts":[[2026,4,20]],"date-time":"2026-04-20T09:07:00Z","timestamp":1776676020000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Designing metaverse interaction systems for the Turkish language enhanced by fine-tuning and retrieval-augmented generation (RAG)"],"prefix":"10.1038","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9022-458X","authenticated-orcid":false,"given":"\u0130brahim","family":"\u00d6ZKAL","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1679-7416","authenticated-orcid":false,"given":"Fatih","family":"BA\u015e\u00c7\u0130FT\u00c7\u0130","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,4,20]]},"reference":[{"key":"35392_CR1","doi-asserted-by":"publisher","unstructured":"Abbate, S., Centobelli, P., Cerchione, R., Oropallo, E., & Riccio, E. A first bibliometric literature review on metaverse. 2022 IEEE Technology and Engineering Management Conference, Izmir, Turkey, https:\/\/doi.org\/10.1109\/TEMSCONEUROPE54743.2022.9802015 (2022)","DOI":"10.1109\/TEMSCONEUROPE54743.2022.9802015"},{"key":"35392_CR2","doi-asserted-by":"publisher","first-page":"100875","DOI":"10.1016\/j.entcom.2024.100875","volume":"52","author":"H Armanto","year":"2024","unstructured":"Armanto, H. & Rosyid, H. A. Improved non-player character (NPC) behavior using evolutionary algorithm\u2014a systematic review. Entertain. Comput. 52, 100875. https:\/\/doi.org\/10.1016\/j.entcom.2024.100875 (2024).","journal-title":"Entertain. Comput."},{"key":"35392_CR3","doi-asserted-by":"publisher","unstructured":"Bag, S., Rahman, M. S., Srivastava, G., & Shrivastav, S. K. Unveiling metaverse potential in supply chain management and overcoming implementation challenges: an empirical study. Benchmarking An International Journal, 1\u201330. https:\/\/doi.org\/10.1108\/BIJ-05-2023-0314 (2023)","DOI":"10.1108\/BIJ-05-2023-0314"},{"key":"35392_CR4","doi-asserted-by":"publisher","unstructured":"Bowen, J. P., & Giannini, T. Digital experience in art and identity: The metaverse calls. EVA 2022 Florence, Florence, Italy, https:\/\/doi.org\/10.31235\/osf.io\/6y4vd (2022)","DOI":"10.31235\/osf.io\/6y4vd"},{"key":"35392_CR5","doi-asserted-by":"publisher","unstructured":"Brown, B. R. Human\u2013machine teaming using large language models. In Interdependent Human-Machine Teams (pp. 41\u201366). Academic Press. https:\/\/doi.org\/10.1016\/B978-0-443-29246-0.00014-6 (2025).","DOI":"10.1016\/B978-0-443-29246-0.00014-6"},{"issue":"4","key":"35392_CR6","doi-asserted-by":"publisher","first-page":"126","DOI":"10.1109\/IOTM.001.2300174","volume":"7","author":"V Chamola","year":"2024","unstructured":"Chamola, V. et al. Beyond reality: The pivotal role of generative ai in the metaverse. IEEE Internet of Things Magazine 7(4), 126\u2013135. https:\/\/doi.org\/10.1109\/IOTM.001.2300174 (2024).","journal-title":"IEEE Internet of Things Magazine"},{"key":"35392_CR7","doi-asserted-by":"publisher","unstructured":"Chaubey, H. K., Tripathi, G., & Ranjan, R. Comparative analysis of RAG, fine-tuning, and prompt engineering in chatbot development. 2024 International Conference on Future Technologies for Smart Society (ICFTSS), Kuala Lumpur, Malaysia, https:\/\/doi.org\/10.1109\/ICFTSS61109.2024.10691338 (2024)","DOI":"10.1109\/ICFTSS61109.2024.10691338"},{"key":"35392_CR8","doi-asserted-by":"publisher","first-page":"102571","DOI":"10.1016\/j.jocs.2025.102571","volume":"87","author":"AA Citarella","year":"2025","unstructured":"Citarella, A. A. et al. Assessing the effectiveness of ROUGE as unbiased metric in Extractive vs. Abstractive summarization techniques. J. Comput. Sci. 87, 102571. https:\/\/doi.org\/10.1016\/j.jocs.2025.102571 (2025).","journal-title":"J. Comput. Sci."},{"key":"35392_CR9","unstructured":"Colbert, J. ColBERT. Retrieved 22.05.2025 from https:\/\/jina.ai\/news\/jina-colbert-v2-multilingual-late-interaction-retriever-for-embedding-and-reranking\/ (2025)"},{"key":"35392_CR10","unstructured":"Cooper, S. B., & Van Leeuwen, J. Alan Turing: His work and impact. Elsevier Science (2013)"},{"key":"35392_CR11","doi-asserted-by":"publisher","unstructured":"Deng, J., Zhang, Z., Cheng, J.-K., & Ma, J. Enhancing large language models on domain-specific tasks: A novel training strategy via domain adaptation and preference alignment. ICASSP 2025\u20132025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), https:\/\/doi.org\/10.1109\/ICASSP49660.2025.10890050 (2025)","DOI":"10.1109\/ICASSP49660.2025.10890050"},{"issue":"5","key":"35392_CR12","doi-asserted-by":"publisher","first-page":"1521","DOI":"10.1007\/s12065-022-00769-0","volume":"16","author":"Y Deng","year":"2023","unstructured":"Deng, Y., Weng, Z. & Zhang, T. Metaverse-driven remote management solution for scene-based energy storage power stations. Evol. Intel. 16(5), 1521\u20131532. https:\/\/doi.org\/10.1007\/s12065-022-00769-0 (2023).","journal-title":"Evol. Intel."},{"key":"35392_CR13","doi-asserted-by":"publisher","unstructured":"Elhagry, A., & Saddik, A. E. Text-to-metaverse: Towards a digital twin-enabled multimodal conditional generative metaverse. IEEE International Conference on Metaverse Computing, Networking and Applications, Kyoto, Japan, 2023, https:\/\/doi.org\/10.1109\/MetaCom57706.2023.00118 (2023)","DOI":"10.1109\/MetaCom57706.2023.00118"},{"issue":"2","key":"35392_CR14","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1016\/0364-0213(90)90002-E","volume":"14","author":"JL Elman","year":"1990","unstructured":"Elman, J. L. Finding structure in time. Cogn. Sci. 14(2), 179\u2013211. https:\/\/doi.org\/10.1016\/0364-0213(90)90002-E (1990).","journal-title":"Cogn. Sci."},{"issue":"10","key":"35392_CR15","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1109\/MC.2022.3192702","volume":"55","author":"P Faraboschi","year":"2022","unstructured":"Faraboschi, P., Frachtenberg, E., Laplante, P., Milojicic, D. & Saracco, R. Virtual worlds (Metaverse): From skepticism, to fear, to immersive opportunities. Computer 55(10), 100\u2013106. https:\/\/doi.org\/10.1109\/MC.2022.3192702 (2022).","journal-title":"Computer"},{"key":"35392_CR16","unstructured":"Figueroa, R. Evaluating adaptive layer freezing through hyperparameter optimization for enhanced fine-tuning performance of language models Massachusetts Institute of Technology]. Massachusetts Institute of Technology. https:\/\/hdl.handle.net\/1721.1\/157169 (2023)"},{"key":"35392_CR17","doi-asserted-by":"publisher","unstructured":"Gao, X., Zhang, Y., Galley, M., Brockett, C., & Dolan, B. Dialogue response ranking training with large-scale human feedback data. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, https:\/\/doi.org\/10.18653\/v1\/2020.emnlp-main.28 (2020)","DOI":"10.18653\/v1\/2020.emnlp-main.28"},{"key":"35392_CR18","first-page":"50","volume":"14","author":"D Gugin","year":"2023","unstructured":"Gugin, D. Artificial intelligence & generative AI for beginners. Pac. Asia Inq. 14, 50 (2023).","journal-title":"Pac. Asia Inq."},{"key":"35392_CR19","doi-asserted-by":"publisher","unstructured":"Halim, N. A. A., Azlan, M. H., Ismail, A. W., Fazli, F. E., Ahmad, M. A., & Aladin, M. Y. F. Edu-Metaverse Classroom with AI-Driven Virtual Avatar Assistant. 2024 5th International Conference on Smart Electronics and Communication, Trichy, India, 2024, https:\/\/doi.org\/10.1109\/ICOSEC61587.2024.10722453 (2024)","DOI":"10.1109\/ICOSEC61587.2024.10722453"},{"key":"35392_CR20","unstructured":"Hamill, D. (2012). An introduction to NLP: Exploring what works. eBookIt."},{"key":"35392_CR21","doi-asserted-by":"publisher","first-page":"1111","DOI":"10.1016\/j.procs.2024.10.340","volume":"245","author":"JPW Hardiman","year":"2024","unstructured":"Hardiman, J. P. W., Thio, D. C. & Zakiyyah, A. Y. AI-powered dialogues and quests generation in role-playing games using Google\u2019s Gemini and Sentence BERT framework. Procedia Comput. Sci. 245, 1111\u20131119. https:\/\/doi.org\/10.1016\/j.procs.2024.10.340 (2024).","journal-title":"Procedia Comput. Sci."},{"issue":"4","key":"35392_CR22","doi-asserted-by":"publisher","first-page":"104150","DOI":"10.1016\/j.ipm.2025.104235","volume":"62","author":"L He","year":"2025","unstructured":"He, L., Tang, P., Zhang, Y., Zhou, P. & Su, S. Mitigating privacy risks in retrieval-augmented generation via locally private entity perturbation. Inf. Process. Manage. 62(4), 104150. https:\/\/doi.org\/10.1016\/j.ipm.2025.104235 (2025).","journal-title":"Inf. Process. Manage."},{"key":"35392_CR23","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2025.3550145","author":"M Hindi","year":"2025","unstructured":"Hindi, M., Mohammed, L., Maaz, O. & Alwarafy, A. Enhancing the precision and interpretability of retrieval-augmented generation (rag) in legal technology: A survey. IEEE Access https:\/\/doi.org\/10.1109\/ACCESS.2025.3550145 (2025).","journal-title":"IEEE Access"},{"issue":"8","key":"35392_CR24","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter, S. & Schmidhuber, J. Long short-term memory. Neural Comput. 9(8), 1735\u20131780. https:\/\/doi.org\/10.1162\/neco.1997.9.8.1735 (1997).","journal-title":"Neural Comput."},{"key":"35392_CR25","doi-asserted-by":"crossref","unstructured":"Huang, J., Ma, H., Zhang, T., Lin, F., Ma, S., Wang, X., & Wang, F.-Y. DriveRP: RAG and Prompt Engineering Embodied Parallel Driving in Cyber-Physical-Social Spaces. 2024 IEEE 4th International Conference on Digital Twins and Parallel Intelligence (DTPI) (2024a)","DOI":"10.1109\/DTPI61353.2024.10778684"},{"key":"35392_CR26","doi-asserted-by":"publisher","unstructured":"Huang, J., Ma, H., Zhang, T., Lin, F., Ma, S., Wang, X., & Wang, F.-Y. DriveRP: RAG and Prompt Engineering Embodied Parallel Driving in Cyber-Physical-Social Spaces. 2024 IEEE 4th International Conference on Digital Twins and Parallel Intelligence, Wuhan, China, https:\/\/doi.org\/10.1109\/DTPI61353.2024.10778684 (2024b)","DOI":"10.1109\/DTPI61353.2024.10778684"},{"key":"35392_CR27","doi-asserted-by":"publisher","unstructured":"Huang, X., Lin, Z., Sun, F., Zhang, W., Tong, K., & Liu, Y. Enhancing document-level question answering via multi-hop retrieval-augmented generation with LLaMA 3. arXiv preprint  arXiv:2506.16037. https:\/\/doi.org\/10.1109\/ISCTIS65944.2025.11065712 (2025)","DOI":"10.1109\/ISCTIS65944.2025.11065712"},{"key":"35392_CR28","unstructured":"Huggingface. Huggingface. Huggingface. Retrieved 22.05.2025 from https:\/\/huggingface.co\/, https:\/\/huggingface.co\/terms-of-service (2025)"},{"key":"35392_CR29","doi-asserted-by":"publisher","DOI":"10.1016\/j.heliyon.2024.e34964","author":"N-T Huyen","year":"2024","unstructured":"Huyen, N.-T. Fostering design thinking mindset for university students with NPCs in the metaverse. Heliyon https:\/\/doi.org\/10.1016\/j.heliyon.2024.e34964 (2024).","journal-title":"Heliyon"},{"key":"35392_CR30","doi-asserted-by":"publisher","unstructured":"Hwang, C.-L., Yoon, K., Hwang, C.-L., & Yoon, K. Methods for multiple attribute decision making.Heidelberg, BerlinSpringer Berlin. https:\/\/doi.org\/10.1007\/978-3-642-48318-9 (1981)","DOI":"10.1007\/978-3-642-48318-9"},{"issue":"6","key":"35392_CR31","doi-asserted-by":"publisher","first-page":"104239","DOI":"10.1016\/j.ipm.2025.104239","volume":"62","author":"MS Jabbar","year":"2025","unstructured":"Jabbar, M. S., Al-Azani, S., Alotaibi, A. & Ahmed, M. Red teaming large language models: A comprehensive review and critical analysis. Inf. Process. Manage. 62(6), 104239. https:\/\/doi.org\/10.1016\/j.ipm.2025.104239 (2025).","journal-title":"Inf. Process. Manage."},{"key":"35392_CR32","unstructured":"Jairath, A. Empathetic Dialogues (Facebook AI). https:\/\/parl.ai\/ (2021)"},{"issue":"S1","key":"35392_CR33","doi-asserted-by":"publisher","first-page":"S63","DOI":"10.1121\/1.2016299","volume":"62","author":"F Jelinek","year":"1977","unstructured":"Jelinek, F., Mercer, R. L., Bahl, L. R. & Baker, J. K. Perplexity\u2014a measure of the difficulty of speech recognition tasks. J. Acoust. Soc.Am. 62(S1), S63\u2013S63. https:\/\/doi.org\/10.1121\/1.2016299 (1977).","journal-title":"J. Acoust. Soc.Am."},{"issue":"6","key":"35392_CR34","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11063-024-11710-0","volume":"56","author":"K Jin","year":"2024","unstructured":"Jin, K., Xiong, Y., Lou, S. & Yu, Z. MAFD: Multiple adversarial features detector for enhanced detection of text based adversarial examples. Neural Process. Lett. 56(6), 1\u201324. https:\/\/doi.org\/10.1007\/s11063-024-11710-0 (2024).","journal-title":"Neural Process. Lett."},{"key":"35392_CR35","unstructured":"Johnsen, M. Large language models (LLMs) Maria Johnsen (2024)"},{"issue":"1","key":"35392_CR36","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1108\/josm-12-2021-0481","volume":"34","author":"RV Kozinets","year":"2022","unstructured":"Kozinets, R. V. Immersive netnography: A novel method for service experience research in virtual reality, augmented reality and metaverse contexts. J. Serv. Manag. 34(1), 100\u2013125. https:\/\/doi.org\/10.1108\/josm-12-2021-0481 (2022).","journal-title":"J. Serv. Manag."},{"key":"35392_CR37","doi-asserted-by":"publisher","unstructured":"Krauss, C., Bassbouss, L., Upravitelev, M., An, T.-S., Altun, D., Reray, L., Balitzki, E., El Tamimi, T., & Karag\u00fclle, M. Opportunities and challenges in developing educational ai-assistants for the metaverse (R. A. Sottilare & J. Schwarz, Eds. Vol. 14727). Springer, Cham. https:\/\/doi.org\/10.1007\/978-3-031-60609-0_16 (2024)","DOI":"10.1007\/978-3-031-60609-0_16"},{"key":"35392_CR38","first-page":"9459","volume":"33","author":"P Lewis","year":"2020","unstructured":"Lewis, P. et al. Retrieval augmented generation for knowledge intensive nlp tasks. Adv. Neural Inform. Process. Syst. 33, 9459\u20139474 (2020).","journal-title":"Adv. Neural Inform. Process. Syst."},{"issue":"22","key":"35392_CR39","doi-asserted-by":"publisher","first-page":"12137","DOI":"10.1007\/s00500-022-07462-5","volume":"26","author":"H Li","year":"2022","unstructured":"Li, H., Yazdi, M., Huang, C.-G. & Peng, W. A reliable probabilistic risk-based decision-making method: Bayesian technique for order of preference by similarity to ideal solution. Soft. Comput. 26(22), 12137\u201312153. https:\/\/doi.org\/10.1007\/s00500-022-07462-5 (2022).","journal-title":"Soft. Comput."},{"issue":"1","key":"35392_CR40","doi-asserted-by":"publisher","first-page":"103581","DOI":"10.1016\/j.ipm.2023.103581","volume":"61","author":"L Li","year":"2024","unstructured":"Li, L., Zhang, D., Zhu, S., Li, S. & Zhou, G. Response generation in multi-modal dialogues with split pre-generation and cross-modal contrasting. Inf. Process. Manage. 61(1), 103581. https:\/\/doi.org\/10.1016\/j.ipm.2023.103581 (2024).","journal-title":"Inf. Process. Manage."},{"key":"35392_CR41","doi-asserted-by":"publisher","unstructured":"Li, Z., Wang, Z., Wang, W., Hung, K., Xie, H., & Wang, F. L. Retrieval-augmented generation for educational application: A systematic survey. Computers and Education: Artificial Intelligence, 100417. https:\/\/doi.org\/10.1016\/j.caeai.2025.100417 (2025)","DOI":"10.1016\/j.caeai.2025.100417"},{"issue":"6","key":"35392_CR42","doi-asserted-by":"publisher","first-page":"104235","DOI":"10.1016\/j.ipm.2025.104235","volume":"62","author":"Z Lin","year":"2025","unstructured":"Lin, Z., Zhang, X., Zhao, K., Lu, X. & Zhang, Y. STrajRAG: Supervised trajectory retrieval augmented generation for next POI recommendation with travel semantics. Inf. Process. Manage. 62(6), 104235. https:\/\/doi.org\/10.1016\/j.ipm.2025.104235 (2025).","journal-title":"Inf. Process. Manage."},{"key":"35392_CR43","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2025.108420","author":"C Liu","year":"2025","unstructured":"Liu, C., Bai, X., Li, Y., Tan, J. & Chu, J. Granger-TSllm: Granger causality enhanced LLMs with residual-quantized tokenizer for multivariate time series forecasting. Neural Netw. https:\/\/doi.org\/10.1016\/j.neunet.2025.108420 (2025).","journal-title":"Neural Netw."},{"key":"35392_CR44","unstructured":"LLaMA, R. BM25. Llama. Retrieved 22.05.2025 from https:\/\/docs.llamaindex.ai\/en\/stable\/examples\/retrievers\/bm25_retriever\/ (2025)"},{"key":"35392_CR45","doi-asserted-by":"publisher","unstructured":"Mahmoud, I. M., Li, L., Wloka, D., & Ali, M. Z. Believable NPCs in serious games: HTN planning approach based on visual perception. 2014 IEEE Conference on Computational Intelligence and Games, Dortmund, Germany https:\/\/doi.org\/10.1109\/CIG.2014.6932891 (2014)","DOI":"10.1109\/CIG.2014.6932891"},{"issue":"17","key":"35392_CR46","doi-asserted-by":"publisher","first-page":"8805","DOI":"10.3390\/app12178805","volume":"12","author":"M Mars","year":"2022","unstructured":"Mars, M. From word embeddings to pre-trained language models: A state-of-the-art walkthrough. Appl. Sci. 12(17), 8805. https:\/\/doi.org\/10.3390\/app12178805 (2022).","journal-title":"Appl. Sci."},{"key":"35392_CR47","unstructured":"Meta. FAISS Retriever. https:\/\/faiss.ai\/index.html (2025)"},{"key":"35392_CR48","doi-asserted-by":"publisher","unstructured":"Meyer, S., Singh, S., Tam, B., Ton, C., & Ren, A. A Comparison of LLM Finetuning Methods & Evaluation Metrics with Travel Chatbot Use Case. ArXiv Preprint. https:\/\/doi.org\/10.48550\/arXiv.2408.03562 (2024)","DOI":"10.48550\/arXiv.2408.03562"},{"issue":"2","key":"35392_CR49","doi-asserted-by":"publisher","first-page":"524","DOI":"10.3390\/app15020524","volume":"15","author":"EV Ndimbo","year":"2025","unstructured":"Ndimbo, E. V., Luo, Q., Fernando, G. C., Yang, X. & Wang, B. Leveraging retrieval augmented generation for Swahili language conversation systems. Appl. Sci. 15(2), 524. https:\/\/doi.org\/10.3390\/app15020524 (2025).","journal-title":"Appl. Sci."},{"key":"35392_CR50","doi-asserted-by":"publisher","first-page":"100347","DOI":"10.1016\/j.caeai.2024.100347","volume":"8","author":"AB Nofal","year":"2025","unstructured":"Nofal, A. B. et al. AI-enhanced interview simulation in the metaverse: Transforming professional skills training through VR and generative conversational AI. Comput. Educ. Artif. Intell. 8, 100347. https:\/\/doi.org\/10.1016\/j.caeai.2024.100347 (2025).","journal-title":"Comput. Educ. Artif. Intell."},{"key":"35392_CR51","unstructured":"\u00d6zkal, \u0130., & Basciftci, F. Deep learning in the metaverse: A systematic literature review and future perspectives [Unpublished manuscript], 1\u201342. 26.03.2025 Accessed, from https:\/\/ssrn.com\/abstract=5022041 (2024)"},{"key":"35392_CR52","doi-asserted-by":"publisher","first-page":"4209","DOI":"10.1109\/ACCESS.2021.3140175","volume":"10","author":"S-M Park","year":"2022","unstructured":"Park, S.-M. & Kim, Y.-G. A metaverse: Taxonomy, components, applications, and open challenges. IEEE Access 10, 4209\u20134251. https:\/\/doi.org\/10.1109\/ACCESS.2021.3140175 (2022).","journal-title":"IEEE Access"},{"issue":"4","key":"35392_CR53","doi-asserted-by":"publisher","first-page":"242","DOI":"10.3390\/info14040242","volume":"14","author":"N Patwardhan","year":"2023","unstructured":"Patwardhan, N., Marrone, S. & Sansone, C. Transformers in the real world: A survey on nlp applications. Information 14(4), 242. https:\/\/doi.org\/10.3390\/info14040242 (2023).","journal-title":"Information"},{"key":"35392_CR54","doi-asserted-by":"publisher","unstructured":"Plupattanakit, K., Suntichaikul, P., Taveekitworachai, P., Thawonmas, R., White, J., Sookhanaphibarn, K., & Choensawat, W. LLMs in Eduverse: LLM-integrated English educational game in metaverse. 2024 IEEE 13th Global Conference on Consumer Electronics, Kitakyushu, Japan, https:\/\/doi.org\/10.1109\/GCCE62371.2024.10760474 (2024a)","DOI":"10.1109\/GCCE62371.2024.10760474"},{"key":"35392_CR55","doi-asserted-by":"crossref","unstructured":"Plupattanakit, K., Suntichaikul, P., Taveekitworachai, P., Thawonmas, R., White, J., Sookhanaphibarn, K., & Choensawat, W. LLMs in Eduverse: LLM-Integrated English Educational Game in Metaverse. 2024 IEEE 13th Global Conference on Consumer Electronics (GCCE) (2024b)","DOI":"10.1109\/GCCE62371.2024.10760474"},{"key":"35392_CR56","doi-asserted-by":"publisher","unstructured":"Provakar, M. M. Evaluating the text summarization efficiency of large language models. 2nd International Conference on Information and Communication Technology, https:\/\/doi.org\/10.48550\/arXiv.2405.04053 (2024)","DOI":"10.48550\/arXiv.2405.04053"},{"key":"35392_CR57","doi-asserted-by":"publisher","unstructured":"Qin, H. X., & Hui, P. Empowering the metaverse with generative AI: Survey and future directions. IEEE 43rd international conference on distributed computing systems workshops, Hong Kong, https:\/\/doi.org\/10.1109\/ICDCSW60045.2023.00022 (2023)","DOI":"10.1109\/ICDCSW60045.2023.00022"},{"key":"35392_CR58","unstructured":"Raaijmakers, S. Deep learning for natural language processing.KoreSimon and Schuster (2022)"},{"key":"35392_CR59","doi-asserted-by":"publisher","first-page":"26839","DOI":"10.1109\/ACCESS.2024.3365742","volume":"12","author":"MAK Raiaan","year":"2024","unstructured":"Raiaan, M. A. K. et al. A review on large language models: Architectures, applications, taxonomies, open issues and challenges. IEEE Access 12, 26839\u201326874. https:\/\/doi.org\/10.1109\/ACCESS.2024.3365742 (2024).","journal-title":"IEEE Access"},{"key":"35392_CR60","doi-asserted-by":"publisher","unstructured":"Ramalingam, M., Yenduri, G., Baza, M., Srivastava, G., & Gadekallu, T. R. GPT for the metaverse in smart cities. 26th International Symposium on Wireless Personal Multimedia Communications, Tampa, FL, USA, https:\/\/doi.org\/10.1109\/WPMC59531.2023.10338966 (2023)","DOI":"10.1109\/WPMC59531.2023.10338966"},{"issue":"1","key":"35392_CR61","doi-asserted-by":"publisher","first-page":"103892","DOI":"10.1016\/j.ipm.2024.103892","volume":"62","author":"N Ramrakhiyani","year":"2025","unstructured":"Ramrakhiyani, N., Varma, V., Palshikar, G. K. & Pawar, S. Gauging, enriching and applying geography knowledge in Pre-trained Language Models. Inf. Process. Manage. 62(1), 103892. https:\/\/doi.org\/10.1016\/j.ipm.2024.103892 (2025).","journal-title":"Inf. Process. Manage."},{"key":"35392_CR62","doi-asserted-by":"publisher","unstructured":"Ruoyan, Z., Zhongxiang, Z., & Wankang, B. Practical secure inference algorithm for fine-tuned large language model based on fully homomorphic encryption. arXiv preprint  arXiv:2501.01672. https:\/\/doi.org\/10.1109\/TIFS.2025.3639994 (2025).","DOI":"10.1109\/TIFS.2025.3639994"},{"key":"35392_CR63","doi-asserted-by":"publisher","first-page":"100783","DOI":"10.1016\/j.simpa.2025.100783","volume":"26","author":"H Ruparel","year":"2025","unstructured":"Ruparel, H. & Patel, T. RAGCacheSim: A discrete-event simulator for evaluating caching strategies in Retrieval-Augmented Generation systems. Software Impacts 26, 100783. https:\/\/doi.org\/10.1016\/j.simpa.2025.100783 (2025).","journal-title":"Software Impacts"},{"key":"35392_CR64","doi-asserted-by":"publisher","unstructured":"Saha, A., Ma, K., Amarnath, C., & Chatterjee, A. Efficient optimized testing of resistive RAM based convolutional neural networks. 2024 IEEE 30th International Symposium on On-Line Testing and Robust System Design (IOLTS), https:\/\/doi.org\/10.1109\/IOLTS60994.2024.10616092 (2024)","DOI":"10.1109\/IOLTS60994.2024.10616092"},{"key":"35392_CR65","doi-asserted-by":"publisher","DOI":"10.32604\/cmc.2025.063721","author":"U Sirisha","year":"2025","unstructured":"Sirisha, U., Kumar, C. K., Durgam, R., Eswaraiah, P. & Nagamani, G. An analytical review of large language models leveraging KDGI fine-tuning, quantum embedding\u2019s, and multimodal architectures. Comput. Mater. Continu. https:\/\/doi.org\/10.32604\/cmc.2025.063721 (2025).","journal-title":"Comput. Mater. Continu."},{"key":"35392_CR66","doi-asserted-by":"publisher","first-page":"100069","DOI":"10.1016\/j.cexr.2024.100069","volume":"4","author":"Y Song","year":"2024","unstructured":"Song, Y., Wu, K. & Ding, J. Developing an immersive game-based learning platform with generative artificial intelligence and virtual reality technologies\u2013\u201cLearningverseVR\u201d. Comput. Educ X Real. 4, 100069. https:\/\/doi.org\/10.1016\/j.cexr.2024.100069 (2024).","journal-title":"Comput. Educ X Real."},{"key":"35392_CR67","doi-asserted-by":"publisher","first-page":"100948","DOI":"10.1016\/j.entcom.2025.100948","volume":"54","author":"Y Sun","year":"2025","unstructured":"Sun, Y. et al. Bring game characters to the social space: Developing storytelling community AI agents driven by LLMs. Entertainm. Comput. 54, 100948. https:\/\/doi.org\/10.1016\/j.entcom.2025.100948 (2025).","journal-title":"Entertainm. Comput."},{"key":"35392_CR68","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2025.104259","author":"YL Tingyu Xia","year":"2025","unstructured":"Tingyu Xia, Y. L., Yuan, Wu. & Chang, Yi. Selective fine-tuning for large language models via matrix nuclear norm. Inform. Process. Manag. https:\/\/doi.org\/10.1016\/j.ipm.2025.104259 (2025).","journal-title":"Inform. Process. Manag."},{"key":"35392_CR69","doi-asserted-by":"publisher","first-page":"118775","DOI":"10.1016\/j.eswa.2022.118775","volume":"213","author":"A Tiwari","year":"2023","unstructured":"Tiwari, A. et al. Towards personalized persuasive dialogue generation for adversarial task oriented dialogue setting. Expert Syst. Appl. 213, 118775. https:\/\/doi.org\/10.1016\/j.eswa.2022.118775 (2023).","journal-title":"Expert Syst. Appl."},{"issue":"3","key":"35392_CR70","doi-asserted-by":"publisher","first-page":"204","DOI":"10.28978\/nesciences.833188","volume":"5","author":"K Tohma","year":"2020","unstructured":"Tohma, K. & Kutlu, Y. Challenges encountered in turkish natural language processing studies. Natural Eng. Sci. 5(3), 204\u2013211 (2020).","journal-title":"Natural Eng. Sci."},{"key":"35392_CR71","unstructured":"Unity. Unity XR Interaction Toolkit. Unity. Retrieved 22.05.2025 from https:\/\/unity.com\/, https:\/\/docs.unity3d.com\/Packages\/com.unity.xr.interaction.toolkit@3.1\/manual\/index.html (2025)"},{"key":"35392_CR72","unstructured":"Unreal. Unreal Engine. Unreal Engine. Retrieved 22.05.2025 from https:\/\/www.unrealengine.com\/en-US\/xr (2025)"},{"key":"35392_CR73","doi-asserted-by":"publisher","unstructured":"Vashishth, T. K., Sharma, V., Sharma, K. K., Chaudhary, S., Kumar, B., & Kumar, P. Graphs, language models, and NLP: The future of search engines. In P. K. D. Pethuru Raj, Peter Han Joo Chong, Houbing Herbert Song, Dmitry A. Zaitsev (Ed.), Applied Graph Data Science (pp. 91\u2013104). Elsevier. https:\/\/doi.org\/10.1016\/B978-0-443-29654-3.00011-9 (2025)","DOI":"10.1016\/B978-0-443-29654-3.00011-9"},{"key":"35392_CR74","doi-asserted-by":"publisher","unstructured":"Vaswani, A. a. S., Noam and Parmar, Niki and Uszkoreit, Jakob and Jones, Llion and Gomez, Aidan N. and Kaiser. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 6000\u20136010. https:\/\/doi.org\/10.5555\/3295222.3295349","DOI":"10.5555\/3295222.3295349"},{"key":"35392_CR75","doi-asserted-by":"publisher","first-page":"103212","DOI":"10.1016\/j.aei.2025.103212","volume":"65","author":"Y Wan","year":"2025","unstructured":"Wan, Y., Chen, Z., Liu, Y., Chen, C. & Packianather, M. Empowering LLMs by hybrid retrieval-augmented generation for domain-centric Q&A in smart manufacturing. Adv. Eng. Inform. 65, 103212. https:\/\/doi.org\/10.1016\/j.aei.2025.103212 (2025).","journal-title":"Adv. Eng. Inform."},{"key":"35392_CR76","doi-asserted-by":"publisher","unstructured":"Wang, C., Li, H., Song, W., & Lin, Y. Retrieval-augmented generation: A survey of security challenges and countermeasures. 2025 11th IEEE International Conference on Privacy Computing and Data Security (PCDS), https:\/\/doi.org\/10.1109\/PCDS65695.2025.00037 (2025)","DOI":"10.1109\/PCDS65695.2025.00037"},{"key":"35392_CR77","doi-asserted-by":"publisher","unstructured":"Wang, J. Y., Sukiennik, N., Li, T., Su, W., Hao, Q., Xu, J., Huang, Z., Xu, F., & Li, Y. A survey on human-centric llms. arXiv preprint  arXiv:2411.14491. https:\/\/doi.org\/10.48550\/arXiv.2411.14491 (2024)","DOI":"10.48550\/arXiv.2411.14491"},{"issue":"2","key":"35392_CR78","doi-asserted-by":"publisher","first-page":"659","DOI":"10.1007\/s10796-022-10244-x","volume":"25","author":"N Xi","year":"2023","unstructured":"Xi, N., Chen, J., Gama, F., Riar, M. & Hamari, J. The challenges of entering the metaverse: An experiment on the effect of extended reality on workload. Inf. Syst. Front. 25(2), 659\u2013680. https:\/\/doi.org\/10.1007\/s10796-022-10244-x (2023).","journal-title":"Inf. Syst. Front."},{"key":"35392_CR79","doi-asserted-by":"publisher","DOI":"10.1016\/j.iot.2023.100884","author":"I Yaqoob","year":"2023","unstructured":"Yaqoob, I., Salah, K., Jayaraman, R. & Omar, M. Metaverse applications in smart cities: Enabling technologies, opportunities, challenges, and future directions. Internet of Things https:\/\/doi.org\/10.1016\/j.iot.2023.100884 (2023).","journal-title":"Internet of Things"},{"issue":"3","key":"35392_CR80","doi-asserted-by":"publisher","first-page":"104015","DOI":"10.1016\/j.ipm.2024.104015","volume":"62","author":"A Yusufu","year":"2025","unstructured":"Yusufu, A. et al. Analysis of user experience in low-resource languages: A case study of the Uzbek language Google Play reviews. Inf. Process. Manage. 62(3), 104015. https:\/\/doi.org\/10.1016\/j.ipm.2024.104015 (2025).","journal-title":"Inf. Process. Manage."},{"issue":"6","key":"35392_CR81","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1109\/MITP.2022.3203820","volume":"24","author":"HE Zainab","year":"2022","unstructured":"Zainab, H. E., Bawany, N. Z., Imran, J. & Rehman, W. Virtual dimension\u2014a primer to metaverse. IT Professional 24(6), 27\u201333. https:\/\/doi.org\/10.1109\/MITP.2022.3203820 (2022).","journal-title":"IT Professional"},{"key":"35392_CR82","doi-asserted-by":"publisher","DOI":"10.1016\/j.acags.2025.100311","author":"J Zhang","year":"2025","unstructured":"Zhang, J. et al. Fine-tuning small and open LLMs to automate geoscience data analysis workflows: A scalable approach. Appl. Comput. Geosci. https:\/\/doi.org\/10.1016\/j.acags.2025.100311 (2025).","journal-title":"Appl. Comput. Geosci."},{"key":"35392_CR83","doi-asserted-by":"publisher","unstructured":"Zhou, H., Liu, F., Gu, B., Zou, X., Huang, J., Wu, J., Li, Y., Chen, S. S., Zhou, P., & Liu, J. A survey of large language models in medicine: Progress, application, and challenge. ArXiv Preprint. https:\/\/doi.org\/10.48550\/arXiv.2311.05112 (2023)","DOI":"10.48550\/arXiv.2311.05112"},{"issue":"3","key":"35392_CR84","doi-asserted-by":"publisher","first-page":"104534","DOI":"10.1016\/j.ipm.2025.104534","volume":"63","author":"M Zhou","year":"2026","unstructured":"Zhou, M., Tang, J., Zeng, W. & Zhao, X. INKER: Adaptive dynamic retrieval augmented generation with internal-external knowledge integration. Inf. Process. Manag. 63(3), 104534. https:\/\/doi.org\/10.1016\/j.ipm.2025.104534 (2026).","journal-title":"Inf. Process. Manag."},{"issue":"4","key":"35392_CR85","doi-asserted-by":"publisher","first-page":"103740","DOI":"10.1016\/j.ipm.2024.103740","volume":"61","author":"X Zhou","year":"2024","unstructured":"Zhou, X., Huang, H., Chi, Z., Ren, M. & Gao, Y. RS-BERT: Pre-training radical enhanced sense embedding for Chinese word sense disambiguation. Inf. Process. Manage. 61(4), 103740. https:\/\/doi.org\/10.1016\/j.ipm.2024.103740 (2024).","journal-title":"Inf. Process. Manage."},{"key":"35392_CR86","doi-asserted-by":"publisher","unstructured":"Zhu, C. (2021). Chapter 2\u2014The basics of natural language processing.China Machine Press. Elsevier Inc. . https:\/\/doi.org\/10.1016\/C2020-0-03297-4","DOI":"10.1016\/C2020-0-03297-4"},{"issue":"6","key":"35392_CR87","doi-asserted-by":"publisher","first-page":"104219","DOI":"10.1016\/j.ipm.2025.104219","volume":"62","author":"G Zou","year":"2025","unstructured":"Zou, G. et al. LLM-enhanced service Semantic Representation and Category co-occurrence feature Augmentation for Web API recommendation. Inf. Process. Manage. 62(6), 104219. https:\/\/doi.org\/10.1016\/j.ipm.2025.104219 (2025).","journal-title":"Inf. Process. Manage."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-35392-x","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-35392-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-35392-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,11]],"date-time":"2026-06-11T23:50:57Z","timestamp":1781221857000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-35392-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,20]]},"references-count":87,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["35392"],"URL":"https:\/\/doi.org\/10.1038\/s41598-026-35392-x","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,20]]},"assertion":[{"value":"3 November 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 January 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 April 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Human or animal rights"}},{"value":"Not applicable.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"During the preparation of this work the author(s) used ChatGPT, Deply in order to improve the readability and language of the manuscript. After using this tool\/service, the author(s) reviewed and edited the content as needed and take(s) full responsibility for the content of the published article.","order":6,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declaration of generative AI and AI-assisted technologies in the writing process"}}],"article-number":"18294"}}