{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,6]],"date-time":"2026-07-06T18:15:52Z","timestamp":1783361752164,"version":"3.54.6"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,3,4]],"date-time":"2022-03-04T00:00:00Z","timestamp":1646352000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,3,4]],"date-time":"2022-03-04T00:00:00Z","timestamp":1646352000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Modernizing medical education by using artificial intelligence and other new technologies to improve the clinical thinking ability of medical students is an important research topic in recent years. Prominent medical universities are actively conducting research and exploration in this area. In particular, given the shortage of human resources, the need to maintain social distancing to prevent the spread of the epidemics, and the increase in the cost of medical education, it is critical to harness online learning to promote medical education. A virtual case learning system that uses natural language processing technology to process and present a hospital\u2019s real medical records and evaluate student responses can effectively improve medical students\u2019 clinical thinking abilities.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Objective<\/jats:title>\n                <jats:p>The purpose of this study is to develop a virtual case system, AIteach, based on actual complete hospital medical records and natural language processing technology, and achieve clinical thinking ability improvement through a contactless, self-service, trial-and-error system application.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>Case extraction is performed on a hospital\u2019s case data center and the best-matching cases are produced through natural language processing, word segmentation, synonym conversion, and sorting. A standard clinical questioning data module, virtual case data module, and student learning difficulty module are established to achieve simulation. Students can view the objective examination and inspection data of actual cases, including details of the consultation and physical examination, and automatically provide their learning response via a multi-dimensional evaluation system. In order to assess the changes in students\u2019 clinical thinking after using AIteach, 15 medical graduate students were subjected to two simulation tests before and after learning through the virtual case system. The tests, which included the full-process case examination of cases having the same difficulty level, examined core clinical thinking test points such as consultation, physical examination, and disposal, and generated multi-dimensional evaluation indicators (rigor, logic, system, agility, and knowledge expansion). Thus, a complete and credible evaluation system is developed.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>The AIteach system used an internal and external double-cycle learning model. Students collect case information through online inquiries, physical examinations, and other means, analyze the information for feedback verification, and generate their detailed multi-dimensional clinical thinking after learning. The feedback report can be evaluated and its knowledge gaps analyzed. Such learning based on real cases is in line with traditional methods of disease diagnosis and treatment, and addresses the practical difficulties in reflecting actual disease progression while keeping pace with recent research. Test results regarding short-term learning showed that the average score (<jats:italic>P<\/jats:italic>\u2009&lt;\u20090.01) increased from 69.87 to 85.6, the five indicators of clinical thinking evaluation improved, and there was obvious logical improvement, reaching 47%.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>By combining real cases and natural language processing technology, AIteach can provide medical students (including undergraduates and postgraduates) with an online learning tool for clinical thinking training. Virtual case learning helps students to cultivate clinical thinking abilities even in the absence of clinical tutor, such as during pandemics or natural disasters.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12911-022-01797-7","type":"journal-article","created":{"date-parts":[[2022,3,4]],"date-time":"2022-03-04T14:03:41Z","timestamp":1646402621000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":43,"title":["Intelligent virtual case learning system based on real medical records and natural language processing"],"prefix":"10.1186","volume":"22","author":[{"given":"Mengying","family":"Wang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhen","family":"Sun","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mo","family":"Jia","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yan","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Heng","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xingxing","family":"Zhu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lianzhong","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hong","family":"Ji","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,3,4]]},"reference":[{"key":"1797_CR1","doi-asserted-by":"publisher","first-page":"414","DOI":"10.1046\/j.1365-2648.1998.00499.x","volume":"27","author":"KR Shin","year":"1998","unstructured":"Shin KR. Critical thinking ability and clinical decision-making skills among senior nursing students in associate and baccalaureate programmes in Korea. J Adv Nurs. 1998;27:414\u20138. https:\/\/doi.org\/10.1046\/j.1365-2648.1998.00499.x.","journal-title":"J Adv Nurs"},{"key":"1797_CR2","doi-asserted-by":"publisher","DOI":"10.1002\/9780470750568","author":"C Del Mar","year":"2007","unstructured":"Del Mar C, Doust J, Glasziou P. Clinical thinking: evidence, communication and decision-making. Health Sci Med Pap. 2007. https:\/\/doi.org\/10.1002\/9780470750568.","journal-title":"Health Sci Med Pap"},{"key":"1797_CR3","doi-asserted-by":"publisher","first-page":"1033","DOI":"10.1001\/jama.2020.14136","volume":"324","author":"CR Lucey","year":"2020","unstructured":"Lucey CR, Johnston SC. The transformational effects of COVID-19 on medical education. Jama-J Am Med Assoc. 2020;324:1033\u20134. https:\/\/doi.org\/10.1001\/jama.2020.14136.","journal-title":"Jama-J Am Med Assoc"},{"key":"1797_CR4","doi-asserted-by":"publisher","first-page":"2131","DOI":"10.1001\/jama.2020.5227","volume":"323","author":"S Rose","year":"2020","unstructured":"Rose S. Medical student education in the time of COVID-19. Jama-J Am Med Assoc. 2020;323:2131\u20132. https:\/\/doi.org\/10.1001\/jama.2020.5227.","journal-title":"Jama-J Am Med Assoc"},{"key":"1797_CR5","doi-asserted-by":"publisher","unstructured":"Al-Balas, M.; Al-Balas, H.I.; Jaber, H.M.; Obeidat, K.; Al-Balas, H.; Aborajooh, E.A.; Al-Taher, R.; Al-Balas, B. Distance learning in clinical medical education amid COVID-19 pandemic in Jordan: current situation, challenges, and perspectives (vol 20, 341, 2020). BMC Med Educ. 2020;20. doi:https:\/\/doi.org\/10.1186\/s12909-020-02428-3.","DOI":"10.1186\/s12909-020-02428-3"},{"key":"1797_CR6","unstructured":"Cunningham J, Hellmich C, Docherty SM, Lyall H, Collins A. Virtual morphology meetings - moving haematology online and across the County (Medical Education in the time of COVID-19 Virtual Conference) 2020. Virtual Morphology Meetings 2020."},{"key":"1797_CR7","unstructured":"Deladisma AM, Johnsen K, Raij A, Rossen B, Kotranza A, Kalapurakal M, Szlam S, Bittner JG, Swinson D, Lok B, et al. Medical student satisfaction using a virtual patient system to learn history-taking and communication skills. Medicine Meets Virtual Reality 16: Parallel, Combinatorial, Convergent: Nextmed by Design 2008;132, 101."},{"key":"1797_CR8","unstructured":"Forslund DW, Phillips RL, Kilman DG, Cook JL. Experiences with a distributed virtual patient record system. Proc: Conf Am Med Inform Assoc. AMIA Fall Symposium 1996, 483\u2013487."},{"key":"1797_CR9","doi-asserted-by":"publisher","unstructured":"Okuda Y, Bryson EO, DeMaria S Jr, Jacobson L Quinones J, Shen B, Levine AI. The utility of simulation in medical education: what is the evidence? Mount Sinai J Med. 2009;76:330\u201343, doi:https:\/\/doi.org\/10.1002\/msj.20127.","DOI":"10.1002\/msj.20127"},{"key":"1797_CR10","doi-asserted-by":"publisher","unstructured":"Larsen CR, Soerensen JL, Grantcharov TP, Dalsgaard T, Schouenborg L, Ottosen C, Schroeder TV, Ottesen BS. Effect of virtual reality training on laparoscopic surgery: randomised controlled trial. BMJ-Br Med J 2009; 338. doi:https:\/\/doi.org\/10.1136\/bmj.b1802.","DOI":"10.1136\/bmj.b1802"},{"key":"1797_CR11","doi-asserted-by":"publisher","first-page":"792","DOI":"10.1007\/s00330-004-2353-x","volume":"15","author":"M Rieger","year":"2005","unstructured":"Rieger M, Gabl M, Gruber H, Jaschke WR, Mallouhi A. CT virtual reality in the preoperative workup of malunited distal radius fractures: preliminary results. Eur Radiol. 2005;15:792\u20137. https:\/\/doi.org\/10.1007\/s00330-004-2353-x.","journal-title":"Eur Radiol"},{"key":"1797_CR12","unstructured":"Mastmeyer A, Wilms M, Fortmeier D, Schroeder J, Handels H. Real-time ultrasound simulation for training of US-guided needle insertion in breathing virtual patients. In Medicine meets virtual reality 22, Westwood, J.D., Westwood, S.W., FellanderTsai, L., Fidopiastis, C.M., Liu, A., Senger, S., Vosburgh, K.G., Eds.; Studies in health technology and informatics; 2016; vol. 220, pp. 219\u2013226."},{"key":"1797_CR13","doi-asserted-by":"crossref","unstructured":"Dafli EL, Bamidis PD, Pappas C, Dombros N. Design and development of a pilot on line electronic OSCE station for use in medical education; Design and development of a pilot on line electronic OSCE station for use in medical education; 2010.","DOI":"10.1007\/978-3-642-13039-7_247"},{"key":"1797_CR14","doi-asserted-by":"crossref","unstructured":"Furlan R, Gatti M, Men\u00e8 R, Shiffer D, Dipaola FJJMI. An NLP-based virtual patient simulator and intelligent tutoring system for the clinical diagnostic process: a case study. (Preprint). JMIR Med Inform 2020; 9.","DOI":"10.2196\/preprints.24073"},{"key":"1797_CR15","doi-asserted-by":"crossref","unstructured":"Douglass MA, Casale JP, Skirvin JA, DiVall MV. A virtual patient software program to improve pharmacy student learning in a comprehensive disease management course. Am J Pharmac Educ. 2013; 77.","DOI":"10.5688\/ajpe778172"},{"key":"1797_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3904\/kjim.2018.381","volume":"34","author":"C Yoon","year":"2019","unstructured":"Yoon C, Nam KC, Lee YK, Kang YJ, Jung CS, Shin HM, Jang H, Kim J, Sun KB, Ishikawa H, et al. Differences in perspectives of medical device adverse events: observational results in training program using virtual cases. J Korean Med Sci. 2019;34:1\u201311.","journal-title":"J Korean Med Sci"},{"key":"1797_CR17","doi-asserted-by":"publisher","first-page":"56","DOI":"10.2196\/16912","volume":"8","author":"L Tao","year":"2020","unstructured":"Tao L, Zhang C, Zeng L, Zhu S, Li N, Li W, Zhang H, Zhao Y, Zhan S, Ji H. Accuracy and effects of clinical decision support systems integrated with BMJ best practice-aided diagnosis: interrupted time series study. JMIR Med Inform. 2020;8:56\u201370. https:\/\/doi.org\/10.2196\/16912.","journal-title":"JMIR Med Inform"},{"key":"1797_CR18","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1111\/j.1365-2923.2008.03286.x","volume":"43","author":"DA Cook","year":"2009","unstructured":"Cook DA, Triola MM. Virtual patients: a critical literature review and proposed next steps. Med Educ. 2009;43:303\u201311. https:\/\/doi.org\/10.1111\/j.1365-2923.2008.03286.x.","journal-title":"Med Educ"},{"key":"1797_CR19","doi-asserted-by":"crossref","unstructured":"Posel N, Mcgee JB, Fleiszer DMJMT. Twelve tips to support the development of clinical reasoning skills using virtual patient cases. 2015; 37:813\u201318.","DOI":"10.3109\/0142159X.2014.993951"},{"key":"1797_CR20","unstructured":"Peng H, Chen L, Tan TH, Nie YS, Diagnostics LOJMI. Application of teacher standardized patient combined with CBL in diagnostic experiment teaching. Med Inf. 2019."},{"key":"1797_CR21","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1016\/j.jsurg.2011.10.008","volume":"69","author":"PJ Schenarts","year":"2012","unstructured":"Schenarts PJ, Schenarts KD. Educational impact of the electronic medical record. J Surg Educ. 2012;69:105\u201312. https:\/\/doi.org\/10.1016\/j.jsurg.2011.10.008.","journal-title":"J Surg Educ"},{"key":"1797_CR22","first-page":"127","volume":"35","author":"W Yang","year":"2013","unstructured":"Yang W, Liu J, Yu M. Research of an improved algorithm for Chinese word segmentation dictionary based on double-array Trie-tree. Comput Eng Sci. 2013;35:127\u201331.","journal-title":"Comput Eng Sci"},{"key":"1797_CR23","doi-asserted-by":"publisher","unstructured":"Shrier I, Platt RW. Reducing bias through directed acyclic graphs. Bmc Med Res Methodol. 2008; 8. doi:https:\/\/doi.org\/10.1186\/1471-2288-8-70.","DOI":"10.1186\/1471-2288-8-70"},{"key":"1797_CR24","first-page":"567","volume":"39","author":"W Bellin","year":"1987","unstructured":"Bellin W. Introduction to natural-language processing - Harris, MD. Q J Exp Psychol Sect Hum Exp Psychol. 1987;39:567\u20139.","journal-title":"Q J Exp Psychol Sect Hum Exp Psychol"},{"key":"1797_CR25","doi-asserted-by":"crossref","unstructured":"Essa; Environments, A.J.S.L. A possible future for next generation adaptive learning systems. 2016;3, 16.","DOI":"10.1186\/s40561-016-0038-y"},{"key":"1797_CR26","doi-asserted-by":"crossref","unstructured":"Unal DS, Arrington CM, Solovey E, Walker E. Using thinkalouds to understand rule learning and cognitive control mechanisms within an intelligent tutoring system. Artif Intell Educ. 2020.","DOI":"10.1007\/978-3-030-52237-7_40"},{"key":"1797_CR27","unstructured":"Jing LI, Fan X, Zhang HJJONS. Correlation between the critical thinking ability and clinical competency in seniors of nurse students. J Nurs Sci; 2006."},{"key":"1797_CR28","unstructured":"Zheng YY, Qing YU, Jiang Y, Xiang Y, Chen C, Miao XU, Zhang K, Zhou R, Cai D, Education DOJCJOCM. Survey of the evaluation of clinical thinking training and assessment system by residents standardized training in Shanghai. Chin J Clin Med; 2018."},{"key":"1797_CR29","unstructured":"Xiao-Chen DU, Bai ZJ, Ying LI, Hua J, Huang J, Huang L, Ding XJETF. Exploration of SOAP teaching method in standardized training practice of residents in department of pediatric intensive care medicine. Educ Teach Forum 2020."},{"key":"1797_CR30","doi-asserted-by":"publisher","DOI":"10.1007\/s40841-021-00197-1","author":"A Tsai","year":"2021","unstructured":"Tsai A, Burrell MH, Sturm S, Garbett D. Rethinking the carrot and the stick: a case study of non-grade-bearing learning activities to enhance students\u2019 engagement and achievement. N Z J Educ Stud. 2021. https:\/\/doi.org\/10.1007\/s40841-021-00197-1.","journal-title":"N Z J Educ Stud"},{"key":"1797_CR31","doi-asserted-by":"publisher","first-page":"959","DOI":"10.1007\/s10459-019-09917-1","volume":"24","author":"D Stentoft","year":"2019","unstructured":"Stentoft D. Problem-based projects in medical education: extending PBL practices and broadening learning perspectives. Adv Health Sci Educ. 2019;24:959\u201369. https:\/\/doi.org\/10.1007\/s10459-019-09917-1.","journal-title":"Adv Health Sci Educ"},{"key":"1797_CR32","doi-asserted-by":"crossref","unstructured":"Granek L, Shapira MS, Roth J, Constantini SJJOSE. Can good intraoperative judgement be taught?: Pediatric neurosurgeons' pedagogical approaches to training residents on intraoperative decision-making. J Surg Educ. 2021.","DOI":"10.1016\/j.jsurg.2021.03.006"},{"key":"1797_CR33","doi-asserted-by":"publisher","unstructured":"Wei C-J, Lu T-H, Chien S-C, Huang W-T, Liu Y-P, Chan C-Y, Chiu C-H. The development and use of a pharmacist-specific Mini-CEX for postgraduate year trainees in Taiwan. BMC Med Educ. 2019, 19, doi:https:\/\/doi.org\/10.1186\/s12909-019-1602-2.","DOI":"10.1186\/s12909-019-1602-2"},{"key":"1797_CR34","doi-asserted-by":"publisher","unstructured":"Suhoyo Y, Schonrock-Adema J, Emilia O, Kuks JBM, Cohen-Schotanus J. How students and specialists appreciate the mini-clinical evaluation exercise (mini-CEX) in Indonesian clerkships. Bmc Med Educ. 2020; 20, doi:https:\/\/doi.org\/10.1186\/s12909-020-02062-z.","DOI":"10.1186\/s12909-020-02062-z"},{"key":"1797_CR35","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1016\/j.pec.2020.06.026","volume":"104","author":"A Lorwald","year":"2021","unstructured":"Lorwald A, Lahner F-M, Stricker D, Huwendiek S. Completing the picture on student performances in OSCEs: a mixed-methods study on integration of a standardized patient rating. Patient Educ Couns. 2021;104:85\u201391. https:\/\/doi.org\/10.1016\/j.pec.2020.06.026.","journal-title":"Patient Educ Couns"},{"key":"1797_CR36","doi-asserted-by":"crossref","unstructured":"Omar H, Archer L, Schroeder K, Robinson BJJODE. Web\u2010based standardized patient encounters for preclinical dental students during COIVD pandemic. J Dent Educ; 2020.","DOI":"10.1002\/jdd.12401"},{"key":"1797_CR37","doi-asserted-by":"publisher","first-page":"1282","DOI":"10.1016\/j.compedu.2011.12.021","volume":"58","author":"F Aparicio","year":"2012","unstructured":"Aparicio F, De Buenaga M, Rubio M, Hernando A. An intelligent information access system assisting a case based learning methodology evaluated in higher education with medical students. Comput Educ. 2012;58:1282\u201395. https:\/\/doi.org\/10.1016\/j.compedu.2011.12.021.","journal-title":"Comput Educ"},{"key":"1797_CR38","doi-asserted-by":"publisher","unstructured":"Barteit S, Guzek D, Jahn A, Baernighausen T, Jorge MM, Neuhann F. Evaluation of e-learning for medical education in low- and middle-income countries: a systematic review. Comput Educ. 2020; 145. doi:https:\/\/doi.org\/10.1016\/j.compedu.2019.103726.","DOI":"10.1016\/j.compedu.2019.103726"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-022-01797-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-022-01797-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-022-01797-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,3,4]],"date-time":"2022-03-04T14:03:50Z","timestamp":1646402630000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-022-01797-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,4]]},"references-count":38,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["1797"],"URL":"https:\/\/doi.org\/10.1186\/s12911-022-01797-7","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,4]]},"assertion":[{"value":"29 August 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 February 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 March 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Full name of the ethics committee: Peking University Third Hospital Medical Science Research Ethics Committee. According to management of the Medical Science Research Ethics Committee of Peking University Third Hospital, this study does not involve human and animal research, there is no need for formal ethics approval. Informed consent from the patients was exempt due to the retrospective nature of the study. We confirm all the experiment protocol for involving humans was in accordance to guidelines of national\/international\/institutional or Declaration of Helsinki in the manuscript.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"60"}}