{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,28]],"date-time":"2026-07-28T11:14:36Z","timestamp":1785237276555,"version":"3.55.0"},"reference-count":95,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2023,5,26]],"date-time":"2023-05-26T00:00:00Z","timestamp":1685059200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>According to numerous reports, ChatGPT represents a significant breakthrough in the field of artificial intelligence. ChatGPT is a pre-trained AI model designed to engage in natural language conversations, utilizing sophisticated techniques from Natural Language Processing (NLP), Supervised Learning, and Reinforcement Learning to comprehend and generate text comparable to human-generated text. This article provides an overview of the training process and fundamental functionality of ChatGPT, accompanied by a preliminary review of the relevant literature. Notably, this article presents the first comprehensive literature review of this technology at the time of publication, aiming to aggregate all the available pertinent articles to facilitate further developments in the field. Ultimately, the authors aim to offer an appraisal of the technology\u2019s potential implications on existing knowledge and technology, along with potential challenges that must be addressed.<\/jats:p>","DOI":"10.3390\/fi15060192","type":"journal-article","created":{"date-parts":[[2023,5,27]],"date-time":"2023-05-27T16:16:04Z","timestamp":1685204164000},"page":"192","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":642,"title":["ChatGPT and Open-AI Models: A Preliminary Review"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8098-1616","authenticated-orcid":false,"given":"Konstantinos I.","family":"Roumeliotis","sequence":"first","affiliation":[{"name":"Department of Informatics and Telecommunications, University of Peloponnese, 221 00 Tripoli, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5799-3558","authenticated-orcid":false,"given":"Nikolaos D.","family":"Tselikas","sequence":"additional","affiliation":[{"name":"Department of Informatics and Telecommunications, University of Peloponnese, 221 00 Tripoli, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,5,26]]},"reference":[{"key":"ref_1","unstructured":"Brown, T.B., Mann, B., and Ryder, N. (2020). Language Models are Few-Shot Learners. arXiv."},{"key":"ref_2","unstructured":"Chen, M., Tworek, J., Jun, H., Yuan, Q., de Oliveira Pinto, H.P., Kaplan, J., Edwards, H., Burda, Y., Joseph, N., and Brockman, G. (2021). Evaluating large language models trained on code. arXiv."},{"key":"ref_3","unstructured":"Wahde, M., and Virgolin, M. (2022). Conversational agents: Theory and applications. arXiv."},{"key":"ref_4","unstructured":"Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., and Sutskever, I. (2023, April 26). Language Models Are Unsupervised Multitask Learners. OpenAI Blog. Available online: https:\/\/life-extension.github.io\/2020\/05\/27\/GPT%E6%8A%80%E6%9C%AF%E5%88%9D%E6%8E%A2\/language-models.pdf."},{"key":"ref_5","unstructured":"Wei, J., Bosma, M., Zhao, V.Y., Guu, K., Yu, A.W., Lester, B., Du, N., Dai, A.M., and Le, Q.V. (2022). Finetuned language models are zero-shot learners. arXiv."},{"key":"ref_6","unstructured":"Zhang, Y., Sun, S., Galley, M., Chen, Y.-C., Brockett, C., Gao, X., Gao, J., Liu, J., and Dolan, B. (2022). Dialogpt: Large-scale generative pre-training for conversational response generation. arXiv."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zhang, S., Dinan, E., Urbanek, J., Szlam, A., Kiela, D., and Weston, J. (2018). Personalizing dialogue agents: I have a dog, do you have pets too?. arXiv.","DOI":"10.18653\/v1\/P18-1205"},{"key":"ref_8","unstructured":"Wang, X., Pham, H., Arthur, P., and Neubig, G. (2019). Multilingual neural machine translation with soft decoupled encoding. arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Bowman, S.R., Vilnis, L., Vinyals, O., Dai, A.M., Jozefowicz, R., and Bengio, S. (2016). Generating sentences from a continuous. arXiv.","DOI":"10.18653\/v1\/K16-1002"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1162\/coli_r_00470","article-title":"Conversational AI: Dialogue systems, conversational agents, and Chatbots by Michael McTear","volume":"49","author":"Seminck","year":"2023","journal-title":"Comput. Linguist."},{"key":"ref_11","unstructured":"Brownlee, J. (2023, April 26). How to Develop a GPT-2 Text Generator in Python. Machine Learning Mastery. Available online: https:\/\/machinelearningmastery.com\/how-to-develop-a-generative-model-for-text-generation-in-python\/."},{"key":"ref_12","unstructured":"OpenAI (2023, April 26). OpenAI Blog. Available online: https:\/\/openai.com\/blog\/."},{"key":"ref_13","first-page":"166","article-title":"Interaction of proctoring and student major on online test performance","volume":"19","author":"Alessio","year":"2018","journal-title":"Int. Rev. Res. Open Distrib. Learn."},{"key":"ref_14","first-page":"10749","article-title":"Galaxy: A generative pre-trained model for task-oriented dialog with semi-supervised learning and explicit policy injection","volume":"36","author":"He","year":"2022","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"ref_15","unstructured":"Susnjak, T. (2022). CHATGPT: The end of online exam integrity?. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"103662","DOI":"10.1016\/j.frl.2023.103662","article-title":"Chatgpt for (Finance) Research: The Bananarama conjecture","volume":"53","author":"Dowling","year":"2023","journal-title":"Financ. Res. Lett."},{"key":"ref_17","unstructured":"Grant, N., and Metz, C. (2023, April 26). A New Chat Bot Is a \u2018Code Red\u2019 for Google\u2019s Search Business. Available online: https:\/\/www.nytimes.com\/2022\/12\/21\/technology\/ai-chatgpt-google-search.html."},{"key":"ref_18","unstructured":"Gozalo-Brizuela, R., and Garrido-Merchan, E.C. (2023). CHATGPT is not all you need. A state of the art review of large generative AI models. arXiv."},{"key":"ref_19","unstructured":"OpenAI (2023, April 26). Introducing Whisper. Available online: https:\/\/openai.com\/research\/whisper."},{"key":"ref_20","unstructured":"OpenAI (2023, April 26). Embeddings. Available online: https:\/\/platform.openai.com\/docs\/guides\/embeddings."},{"key":"ref_21","unstructured":"Brennan, R.W., and Lesage, J. (2023). Service Oriented, Holonic and Multi-Agent Manufacturing Systems for Industry of the Future, Springer International Publishing."},{"key":"ref_22","unstructured":"OpenAI (2023, April 26). Moderation Model. Available online: https:\/\/platform.openai.com\/docs\/guides\/moderation\/overview."},{"key":"ref_23","unstructured":"(2023, April 26). OpenAI Models. Available online: https:\/\/platform.openai.com\/docs\/models\/overview."},{"key":"ref_24","unstructured":"(2023, April 26). OpenAI API: Model Index for Researchers. Available online: https:\/\/platform.openai.com\/docs\/model-index-for-researchers."},{"key":"ref_25","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017, January 4\u20139). Attention is All You Need. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_26","unstructured":"Dai, Z., Yang, Z., Yang, Y., Carbonell, J.G., Le, Q.V., and Salakhutdinov, R. (August, January 28). Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy."},{"key":"ref_27","unstructured":"Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2019). Bert: Pre-training of deep bidirectional Transformers for language understanding. arXiv."},{"key":"ref_28","unstructured":"Wu, Y., Schuster, M., Chen, Z., Le, Q.V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., and Macherey, K. (2016). Google\u2019s Neural Machine Translation System: Bridging the Gap between Human and Machine Translation. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Manning, C.D., Surdeanu, M., Bauer, J., Finkel, J., Bethard, S.J., and McClosky, D. (2014, January 23\u201324). The Stanford CoreNLP natural language processing toolkit. Proceedings of the Association for Computational Linguistics (ACL) System Demonstrations, Baltimore, MD, USA.","DOI":"10.3115\/v1\/P14-5010"},{"key":"ref_30","unstructured":"Kingma, D.P., and Ba, J. (2015, January 7\u20139). Adam: A Method for Stochastic Optimization. Proceedings of the 3rd International Conference on Learning Representations (ICLR), San Diego, CA, USA."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Howard, J., and Ruder, S. (2018). Universal language model fine-tuning for text classification. arXiv.","DOI":"10.18653\/v1\/P18-1031"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Kung, T.H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepa\u00f1o, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., and Maningo, J. (2023). Performance of chatgpt on USMLE: Potential for AI-assisted medical education using large language models. PLOS Digit. Health, 2.","DOI":"10.1371\/journal.pdig.0000198"},{"key":"ref_33","first-page":"22","article-title":"OpenAI ChatGPT Generated Literature Review: Digital Twin in Healthcare","volume":"2","author":"Karaarslan","year":"2022","journal-title":"Emerg. Comput. Technol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"01003","DOI":"10.7189\/jogh.13.01003","article-title":"Can ChatGPT draft a research article? An example of population-level vaccine effectiveness analysis","volume":"13","author":"Macdonald","year":"2023","journal-title":"J. Glob. Health"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Sallam, M. (2023). ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare, 11.","DOI":"10.3390\/healthcare11060887"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1187","DOI":"10.1007\/s00167-023-07355-6","article-title":"Artificial Intelligence Bot CHATGPT in medical research: The potential game changer as a double-edged sword","volume":"31","author":"Dahmen","year":"2023","journal-title":"Knee Surg. Sport. Traumatol. Arthrosc."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Shahriar, S., and Hayawi, K. (2023). Let\u2019s have a chat! A conversation with chatgpt: Technology, applications, and limitations. arXiv.","DOI":"10.47852\/bonviewAIA3202939"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"24","DOI":"10.5530\/bems.9.1.5","article-title":"Analysis of CHATGPT tool to assess the potential of its utility for academic writing in biomedical domain","volume":"9","year":"2023","journal-title":"Biol. Eng. Med. Sci. Rep."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Thurzo, A., Strunga, M., Urban, R., Surovkov\u00e1, J., and Afrashtehfar, K.I. (2023). Impact of Artificial Intelligence on Dental Education: A Review and Guide for Curriculum Update. Educ. Sci., 13.","DOI":"10.3390\/educsci13020150"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Hirosawa, T., Harada, Y., Yokose, M., Sakamoto, T., Kawamura, R., and Shimizu, T. (2023). Diagnostic Accuracy of Differential-Diagnosis Lists Generated by Generative Pretrained Transformer 3 Chatbot for Clinical Vignettes with Common Chief Complaints: A Pilot Study. Int. J. Environ. Res. Public Health, 20.","DOI":"10.3390\/ijerph20043378"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Strunga, M., Urban, R., Surovkov\u00e1, J., and Thurzo, A. (2023). Artificial Intelligence Systems Assisting in the Assessment of the Course and Retention of Orthodontic Treatment. Healthcare, 11.","DOI":"10.3390\/healthcare11050683"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Zhu, Y., Han, D., Chen, S., Zeng, F., and Wang, C. (2023). How can chatgpt benefit pharmacy: A case report on review writing. Preprints, 2023020324.","DOI":"10.20944\/preprints202302.0324.v1"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Nastasi, A.J., Courtright, K.R., Halpern, S.D., and Weissman, G.E. (2023). Does Chatgpt Provide Appropriate and Equitable Medical Advice? A Vignette-Based, Clinical Evaluation Across Care Contexts. medRxiv.","DOI":"10.1101\/2023.02.25.23286451"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Sharma, G., and Thakur, A. (2023). Chatgpt in Drug Discovery, Cambridge Open Engage. ChemRxiv.","DOI":"10.26434\/chemrxiv-2023-qgs3k"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Surovkov\u00e1, J., Haluzov\u00e1, S., Strunga, M., Urban, R., Lifkov\u00e1, M., and Thurzo, A. (2023). The New Role of the Dental Assistant and Nurse in the Age of Advanced Artificial Intelligence in Telehealth Orthodontic Care with Dental Monitoring: Preliminary Report. Appl. Sci., 13.","DOI":"10.3390\/app13085212"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Corsello, A., and Santangelo, A. (2023). May Artificial Intelligence Influence Future Pediatric Research?\u2014The Case of ChatGPT. Children, 10.","DOI":"10.3390\/children10040757"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Rudolph, J., and Tan, S. (2023). Chatgpt: Bullshit spewer or the end of traditional assessments in higher education?. J. Appl. Learn. Teach., 6.","DOI":"10.37074\/jalt.2023.6.1.9"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1186\/s40561-023-00237-x","article-title":"What if the devil is my guardian angel: Chatgpt as a case study of using Chatbots in education","volume":"10","author":"Tlili","year":"2023","journal-title":"Smart Learn. Environ."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Kova\u010devi\u0107, D. (2023, January 15\u201317). Use of chatgpt in ESP teaching process. Proceedings of the 2023 22nd International Symposium INFOTEH-JAHORINA (INFOTEH), East Sarajevo, Bosnia and Herzegovina.","DOI":"10.1109\/INFOTEH57020.2023.10094133"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Shoufan, A. (2023). Exploring Students\u2019 Perceptions of CHATGPT: Thematic Analysis and Follow-Up Survey, IEEE Access.","DOI":"10.1109\/ACCESS.2023.3268224"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"135","DOI":"10.3390\/nanomanufacturing3020009","article-title":"Good Practices for Scientific Article Writing with ChatGPT and Other Artificial Intelligence Language Models","volume":"3","year":"2023","journal-title":"Nanomanufacturing"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Bang, Y., Cahyawijaya, S., Lee, N., Dai, W., Su, D., Wilie, B., Lovenia, H., Ji, Z., Yu, T., and Chung, W. (2023). A multitask, multilingual, multimodal evaluation of Chatgpt on reasoning, hallucination, and Interactivity. arXiv.","DOI":"10.18653\/v1\/2023.ijcnlp-main.45"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Sobania, D., Briesch, M., Hanna, C., and Petke, J. (2023). An analysis of the automatic bug fixing performance of chatgpt. arXiv.","DOI":"10.1109\/APR59189.2023.00012"},{"key":"ref_54","unstructured":"Zhuo, T.Y., Huang, Y., Chen, C., and Xing, Z. (2023). Exploring ai ethics of CHATGPT: A diagnostic analysis. arXiv."},{"key":"ref_55","unstructured":"Zhong, Q., Ding, L., Liu, J., Du, B., and Tao, D. (2023). Can CHATGPT understand too? A comparative study on CHATGPT and fine-tuned Bert. arXiv."},{"key":"ref_56","unstructured":"Geerling, W., Mateer, G.D., Wooten, J., and Damodaran, N. (2023). Is CHATGPT smarter than a student in principles of economics?. SSRN Electron. J."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Qin, C., Zhang, A., Zhang, Z., Chen, J., Yasunaga, M., and Yang, D. (2023). Is chatgpt a general-purpose natural language processing task solver?. arXiv.","DOI":"10.18653\/v1\/2023.emnlp-main.85"},{"key":"ref_58","unstructured":"Mitrovi\u0107, S., Andreoletti, D., and Ayoub, O. (2023). Chatgpt or human? detect and explain. explaining decisions of machine learning model for detecting short chatgpt-generated text. arXiv."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Hassani, H., and Silva, E.S. (2023). The Role of ChatGPT in Data Science: How AI-Assisted Conversational Interfaces Are Revolutionizing the Field. Big Data Cogn. Comput., 7.","DOI":"10.3390\/bdcc7020062"},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Lin, C.-C., Huang, A.Y.Q., and Yang, S.J.H. (2023). A Review of AI-Driven Conversational Chatbots Implementation Methodologies and Challenges (1999\u20132022). Sustainability, 15.","DOI":"10.3390\/su15054012"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"877","DOI":"10.1109\/JAS.2023.123561","article-title":"Dao to Hanoi via DeSci: Ai paradigm shifts from AlphaGo to chatgpt","volume":"10","author":"Miao","year":"2023","journal-title":"IEEE\/CAA J. Autom. Sin."},{"key":"ref_62","unstructured":"Jiao, W., Wang, W., Huang, J.T., Wang, X., and Tu, Z. (2023). Is chatgpt a good translator? A preliminary study. arXiv."},{"key":"ref_63","unstructured":"Frieder, S., Pinchetti, L., Griffiths, R.-R., Salvatori, T., Lukasiewicz, T., Petersen, P.C., Chevalier, A., and Berner, J. (2023). Mathematical capabilities of chatgpt. arXiv."},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Taecharungroj, V. (2023). \u201cWhat Can ChatGPT Do\u201d? Analyzing Early Reactions to the Innovative AI Chatbot on Twitter. Big Data Cogn. Comput., 7.","DOI":"10.3390\/bdcc7010035"},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Haluza, D., and Jungwirth, D. (2023). Artificial Intelligence and Ten Societal Megatrends: An Exploratory Study Using GPT-3. Systems, 11.","DOI":"10.20944\/preprints202301.0474.v1"},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Rozado, D. (2023). The political biases of chatgpt. Soc. Sci., 12.","DOI":"10.3390\/socsci12030148"},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"Abdullah, M., Madain, A., and Jararweh, Y. (December, January 29). Chatgpt: Fundamentals, applications and social impacts. Proceedings of the 2022 Ninth International Conference on Social Networks Analysis, Management and Security (SNAMS), Milan, Italy.","DOI":"10.1109\/SNAMS58071.2022.10062688"},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Grbic, D.V., and Dujlovic, I. (2023, January 15\u201317). Social Engineering with chatgpt. Proceedings of the 2023 22nd International Symposium INFOTEH-JAHORINA (INFOTEH), East Sarajevo, Bosnia and Herzegovina.","DOI":"10.1109\/INFOTEH57020.2023.10094141"},{"key":"ref_69","unstructured":"Vemprala, S., Bonatti, R., Bucker, A., and Kapoor, A. (2023, April 26). ChatGPT for Robotics: Design Principles and Model Abilities. Microsoft Autonomous Systems and Robotics Research. Available online: https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2023\/02\/ChatGPT___Robotics.pdf."},{"key":"ref_70","doi-asserted-by":"crossref","unstructured":"Du, H., Teng, S., Chen, H., Ma, J., Wang, X., Gou, C., Li, B., Ma, S., Miao, Q., and Na, X. (2023). Chat with CHATGPT on Intelligent Vehicles: An IEEE Tiv Perspective, IEEE Transactions on Intelligent Vehicles.","DOI":"10.1109\/TIV.2023.3253281"},{"key":"ref_71","doi-asserted-by":"crossref","unstructured":"Gao, Y., Tong, W., Wu, E.Q., Chen, W., Zhu, G.Y., and Wang, F.-Y. (2023). Chat with CHATGPT on Interactive Engines for Intelligent Driving, IEEE Transactions on Intelligent Vehicles.","DOI":"10.1109\/TIV.2023.3252571"},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Prieto, S.A., Mengiste, E.T., and Garc\u00eda de Soto, B. (2023). Investigating the Use of ChatGPT for the Scheduling of Construction Projects. Buildings, 13.","DOI":"10.3390\/buildings13040857"},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"831","DOI":"10.1109\/JAS.2023.123552","article-title":"Chat with CHATGPT on industry 5.0: Learning and decision-making for Intelligent Industries","volume":"10","author":"Wang","year":"2023","journal-title":"IEEE\/CAA J. Autom. Sin."},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Frederico, G.F. (2023). ChatGPT in Supply Chains: Initial Evidence of Applications and Potential Research Agenda. Logistics, 7.","DOI":"10.3390\/logistics7020026"},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"835","DOI":"10.1109\/JAS.2023.123555","article-title":"Can chatgpt boost artistic creation: The need of Imaginative Intelligence for parallel art","volume":"10","author":"Guo","year":"2023","journal-title":"IEEE\/CAA J. Autom. Sin."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"375","DOI":"10.3390\/ai4020019","article-title":"Marketing with ChatGPT: Navigating the Ethical Terrain of GPT-Based Chatbot Technology","volume":"4","author":"Rivas","year":"2023","journal-title":"AI"},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"105117","DOI":"10.1016\/j.cmpb.2019.105117","article-title":"Deep contextualized embeddings for quantifying the informative content in biomedical text summarization","volume":"184","author":"Moradi","year":"2020","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_78","unstructured":"(2023, April 26). OpenAI Usage Policies. Available online: https:\/\/platform.openai.com\/docs\/data-usage-policies."},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1162\/tacl_a_00041","article-title":"Data Statements for Natural Language Processing: Toward Mitigating System Bias and Enabling Better Science","volume":"6","author":"Bender","year":"2018","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_80","unstructured":"Lample, G., and Conneau, A. (2019). Cross-lingual Language Model Pretraining. arXiv."},{"key":"ref_81","doi-asserted-by":"crossref","unstructured":"Klein, A., Ranzato, M., Collobert, R., and Karaayvaz, T. (2017). OpenNMT: Open-Source Toolkit for Neural Machine Translation. arXiv.","DOI":"10.18653\/v1\/P17-4012"},{"key":"ref_82","doi-asserted-by":"crossref","unstructured":"Zhao, X., Wang, L., and Dang, J. (2022, January 23\u201327). Improving dialogue generation via proactively querying grounded knowledge. Proceedings of the ICASSP 2022\u20132022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Singapore.","DOI":"10.1109\/ICASSP43922.2022.9746877"},{"key":"ref_83","doi-asserted-by":"crossref","unstructured":"Tufail, S., Riggs, H., Tariq, M., and Sarwat, A.I. (2023). Advancements and Challenges in Machine Learning: A Comprehensive Review of Models, Libraries, Applications, and Algorithms. Electronics, 12.","DOI":"10.3390\/electronics12081789"},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1111\/cgf.12919","article-title":"Contovi: Multi-party conversation exploration using topic-space views","volume":"35","author":"Gold","year":"2016","journal-title":"Comput. Graph. Forum"},{"key":"ref_85","first-page":"31","article-title":"Total-text: Toward orientation robustness in scene text detection","volume":"23","author":"Chan","year":"2019","journal-title":"Int. J. Doc. Anal. Recognit. (IJDAR)"},{"key":"ref_86","doi-asserted-by":"crossref","unstructured":"Bender, E.M., and Koller, A. (2020, January 5\u201310). Climbing towards NLU: On meaning, form, and understanding in the age of data. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.","DOI":"10.18653\/v1\/2020.acl-main.463"},{"key":"ref_87","doi-asserted-by":"crossref","unstructured":"Neeraja, J., Gupta, V., and Srikumar, V. (2021). Incorporating external knowledge to enhance tabular reasoning. arXiv.","DOI":"10.18653\/v1\/2021.naacl-main.224"},{"key":"ref_88","doi-asserted-by":"crossref","first-page":"1198","DOI":"10.1109\/TASLP.2020.2983593","article-title":"Out-of-domain detection for natural language understanding in Dialog Systems","volume":"28","author":"Zheng","year":"2020","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process."},{"key":"ref_89","unstructured":"Guan, J., Yang, Z., Zhang, R., Hu, Z., and Huang, M. (2022). Generating coherent narratives by learning dynamic and discrete entity states with a contrastive framework. arXiv."},{"key":"ref_90","unstructured":"Doshi-Velez, F., and Kim, B. (2017). Towards a rigorous science of interpretable machine learning. arXiv."},{"key":"ref_91","first-page":"8018","article-title":"Is Bert really robust? A strong baseline for natural language attack on text classification and entailment","volume":"34","author":"Jin","year":"2020","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"ref_92","doi-asserted-by":"crossref","unstructured":"Yuan, L., Chen, Y., Wang, T., Yu, W., Shi, Y., Jiang, Z., Tay, F.E.H., Feng, J., and Yan, S. (2021). Tokens-to-token VIT: Training vision transformers from scratch on ImageNet. arXiv.","DOI":"10.1109\/ICCV48922.2021.00060"},{"key":"ref_93","doi-asserted-by":"crossref","unstructured":"Hendrycks, D., Zhao, B., Basart, S., and Steinhardt, J. (2020). Natural Adversarial Examples. arXiv.","DOI":"10.1109\/CVPR46437.2021.01501"},{"key":"ref_94","doi-asserted-by":"crossref","unstructured":"Wallace, E., Feng, S., Kandpal, N., and Gardner, M. (2019, January 3\u20137). Universal Adversarial Triggers for Attacking and Analyzing NLP. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, Hong Kong, China.","DOI":"10.18653\/v1\/D19-1221"},{"key":"ref_95","doi-asserted-by":"crossref","unstructured":"Strubell, E., Ganesh, A., and McCallum, A. (2019). Energy and Policy Considerations for Deep Learning in NLP. arXiv.","DOI":"10.18653\/v1\/P19-1355"}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/15\/6\/192\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:42:35Z","timestamp":1760125355000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/15\/6\/192"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,26]]},"references-count":95,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["fi15060192"],"URL":"https:\/\/doi.org\/10.3390\/fi15060192","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,26]]}}}