{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T16:15:56Z","timestamp":1782317756388,"version":"3.54.5"},"reference-count":33,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2023,9,2]],"date-time":"2023-09-02T00:00:00Z","timestamp":1693612800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Natural Science Foundation of Gansu Province 2022: Research on Animation Technology Innovation Based on Meta-Universe Platform","award":["22JR5RA357"],"award-info":[{"award-number":["22JR5RA357"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Traditional 3D animation creation involves a process of motion acquisition, dubbing, and mouth movement data binding for each character. To streamline animation creation, we propose combining artificial intelligence (AI) with a motion capture system. This integration aims to reduce the time, workload, and cost associated with animation creation. By utilizing AI and natural language processing, the characters can engage in independent learning, generating their own responses and interactions, thus moving away from the traditional method of creating digital characters with pre-defined behaviors. In this paper, we present an approach that employs a digital person\u2019s animation environment. We utilized Unity plug-ins to drive the character\u2019s mouth Blendshape, synchronize the character\u2019s voice and mouth movements in Unity, and connect the digital person to an AI system. This integration enables AI-driven language interactions within animation production. Through experimentation, we evaluated the correctness of the natural language interaction of the digital human in the animated scene, the real-time synchronization of mouth movements, the potential for singularity in guiding users during digital human animation creation, and its ability to guide user interactions through its own thought process.<\/jats:p>","DOI":"10.3390\/fi15090300","type":"journal-article","created":{"date-parts":[[2023,9,4]],"date-time":"2023-09-04T02:26:12Z","timestamp":1693794372000},"page":"300","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["Application of ChatGPT-Based Digital Human in Animation Creation"],"prefix":"10.3390","volume":"15","author":[{"given":"Chong","family":"Lan","sequence":"first","affiliation":[{"name":"School of Art and Design, Lanzhou Jiaotong University, Lanzhou 730070, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yongsheng","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Art and Design, Lanzhou Jiaotong University, Lanzhou 730070, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chengze","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Art and Design, Lanzhou Jiaotong University, Lanzhou 730070, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shirong","family":"Song","sequence":"additional","affiliation":[{"name":"School of Art and Design, Lanzhou Jiaotong University, Lanzhou 730070, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zheng","family":"Gong","sequence":"additional","affiliation":[{"name":"School of Art and Design, Lanzhou Jiaotong University, Lanzhou 730070, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,9,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"877","DOI":"10.1109\/JAS.2023.123561","article-title":"DAO to HANOI via DeSci:AI Paradigm Shifts from AlphaGo to ChatGPT","volume":"10","author":"Miao","year":"2023","journal-title":"IEEE\/CAA J. Autom. Sin."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1038\/d41586-023-00340-6","article-title":"What ChatGPT and generative AI mean for science","volume":"614","year":"2023","journal-title":"Nature"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"131858","DOI":"10.1109\/ACCESS.2021.3112535","article-title":"Automatic Speech Recognition: Systematic Literature Review","volume":"9","author":"Alharbi","year":"2021","journal-title":"IEEE Access"},{"key":"ref_4","unstructured":"Cai, S., and Yang, L. (2023). Study on the Risk and Collaborative Governance of ChatGPT Intelligent Robot Application. Intell. Theory Pract., 1\u201311. Available online: http:\/\/kns.cnki.net\/kcms\/detail\/11.1762.G3.20230406.1618.008.html."},{"key":"ref_5","unstructured":"OpenAI (2023, April 03). No Date Provided. Introducing ChatGPT. Available online: https:\/\/openai.com\/blog\/chatgpt."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Kwon, H., Kwon, Y., and Han, J. (2022, January 19\u201322). Backward Graph Construction and Lowering in DL Compiler for Model Training on AI Accelerators. Proceedings of the 2022 19th International SoC Design Conference (ISOCC), Gangneung-si, Republic of Korea.","DOI":"10.1109\/ISOCC56007.2022.10031488"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Temsah, M.-H., Aljamaan, F., Malki, K.H., Alhasan, K., Altamimi, I., Aljarbou, R., Bazuhair, F., Alsubaihin, A., Abdulmajeed, N., and Alshahrani, F.S. (2023). ChatGPT and the Future of Digital Health: A Study on Healthcare Workers\u2019 Perceptions and Expectations. Healthcare, 11.","DOI":"10.3390\/healthcare11131812"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Gebrael, G., Sahu, K.K., Chigarira, B., Tripathi, N., Mathew Thomas, V., Sayegh, N., Maughan, B.L., Agarwal, N., Swami, U., and Li, H. (2023). Enhancing Triage Efficiency and Accuracy in Emergency Rooms for Patients with Metastatic Prostate Cancer: A Retrospective Analysis of Artificial Intelligence-Assisted Triage Using ChatGPT 4.0. Cancers, 15.","DOI":"10.3390\/cancers15143717"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Lee, M. (2023). A Mathematical Investigation of Hallucination and Creativity in GPT Models. Mathematics, 11.","DOI":"10.3390\/math11102320"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Luo, Z., Yan, S., and Luo, S. (2023). Multitask Fine Tuning on Pretrained Language Model for Retrieval-Based Question Answering in Automotive Domain. Mathematics, 11.","DOI":"10.3390\/math11122733"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"S\u00e1nchez-Ruiz, L.M., Moll-L\u00f3pez, S., Nu\u00f1ez-P\u00e9rez, A., Mora\u00f1o-Fern\u00e1ndez, J.A., and Vega-Fleitas, E. (2023). ChatGPT Challenges Blended Learning Methodologies in Engineering Education: A Case Study in Mathematics. Appl. Sci., 13.","DOI":"10.3390\/app13106039"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Rahman, M.M., and Watanobe, Y. (2023). ChatGPT for Education and Research: Opportunities, Threats, and Strategies. Appl. Sci., 13.","DOI":"10.20944\/preprints202303.0473.v1"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Birenbaum, M. (2023). The Chatbots\u2019 Challenge to Education: Disruption or Destruction?. Educ. Sci., 13.","DOI":"10.3390\/educsci13070711"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Meng, F., and Hyung, C.J. (2022, January 24\u201326). Research on Multi-NPC Marine Game AI System based on Q-learning Algorithm. Proceedings of the 2022 IEEE International Conference on Artificial Intelligence and Computer Applications (ICAICA), Dalian, China.","DOI":"10.1109\/ICAICA54878.2022.9844648"},{"key":"ref_15","unstructured":"Yannakakis, G.N., and Togelius, J. IEEE Transactions on Computational Intelligence and AI in Games, IEEE."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1016\/j.procs.2019.08.222","article-title":"Applying Behavior characteristics to decision-making process to create believable game AI","volume":"156","author":"Simonov","year":"2019","journal-title":"Procedia Comput. Sci."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Dare, D.E. (2018, January 19). AI\/VR: Situated Animation in the Library of Babel. Proceedings of the 2018 IEEE 1st Workshop on Animation in Virtual and Augmented Environments (ANIVAE), Reutlingen, Germany.","DOI":"10.1109\/ANIVAE.2018.8587271"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"102626","DOI":"10.1016\/j.jksus.2023.102626","article-title":"Research on innovation and application of 5G using artificial intelligence-based image and speech recognition technologies","volume":"35","author":"Fan","year":"2023","journal-title":"J. King Saud Univ. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"102092","DOI":"10.1016\/j.rcim.2020.102092","article-title":"Digital twins for collaborative robots: A case study in human-robot interaction","volume":"68","author":"Malik","year":"2021","journal-title":"Robot. Comput.-Integr. Manuf."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"170274","DOI":"10.1016\/j.ijleo.2022.170274","article-title":"Research on the application of virtual reality technology in 3D animation creation","volume":"272","author":"Hu","year":"2023","journal-title":"Optik"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"107246","DOI":"10.1016\/j.chb.2022.107246","article-title":"What drives technology-enhanced storytelling immersion?","volume":"132","author":"Sung","year":"2022","journal-title":"Role Digit. Hum. Comput. Hum. Behav."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"502","DOI":"10.1016\/j.procs.2019.11.158","article-title":"English Education Game using Non-Player Character Based on Natural Language Processing","volume":"161","author":"Yunanto","year":"2019","journal-title":"Procedia Comput. Sci."},{"key":"ref_23","unstructured":"(2022, August 11). Mora App. Available online: https:\/\/ui.nubia.cn\/app\/detail\/100."},{"key":"ref_24","unstructured":"Li, J., Deng, L., Haeb-Umbach, R., and Gong, Y. (2016). A Bridge to Practical Applications, Academic Press. Robust Automatic Speech Recognition."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zen, H., and Senior, A. (2013, January 26\u201331). Schuster, Statistical parametric speech synthesis using deep neural networks. Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, Vancouver, BC, Canada.","DOI":"10.1109\/ICASSP.2013.6639215"},{"key":"ref_26","unstructured":"Kim, J., Kong, J., and Son, J. (2021). Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech. arXiv."},{"key":"ref_27","unstructured":"(2023, June 13). What Is AICG and What Areas of Content AICG Can Do. Available online: https:\/\/baijiahao.baidu.com\/s?id=1768567295399756174&wfr=spider&for=pc."},{"key":"ref_28","unstructured":"(2023, July 05). AICG Overview Understand the Basic Concepts and Definitions of AICG and Understand the Application of AICG Technology in Film, Television and Animation. Available online: https:\/\/zhuanlan.zhihu.com\/p\/632434790."},{"key":"ref_29","unstructured":"(2022, April 05). SALSA with RandomEyes (Speech Generation Mouth Shape\/Character Speaking) Use. Available online: https:\/\/blog.csdn.net\/yigiwoliao\/article\/details\/122389453."},{"key":"ref_30","unstructured":"(2023, July 02). Voice Technology. Available online: https:\/\/ai.baidu.com\/ai-doc\/SPEECH\/qlcirqhz0."},{"key":"ref_31","unstructured":"(2023, May 30). Text-to-Speech Documents. Available online: https:\/\/learn.microsoft.com\/zh-cn\/azure\/cognitive-services\/speech-service\/index-text-to-speech."},{"key":"ref_32","unstructured":"(2023, June 25). The OpenAI API Uses Documentation. Available online: https:\/\/platform.openai.com\/docs\/introduction."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"107669","DOI":"10.1016\/j.chb.2023.107669","article-title":"The dark side of AI identity: Investigating when and why AI identity entitles unethical behavior","volume":"143","author":"Cao","year":"2023","journal-title":"Comput. Hum. Behav."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/15\/9\/300\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:45:25Z","timestamp":1760129125000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/15\/9\/300"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,2]]},"references-count":33,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["fi15090300"],"URL":"https:\/\/doi.org\/10.3390\/fi15090300","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,2]]}}}