{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,6]],"date-time":"2026-11-06T15:36:26Z","timestamp":1793979386874,"version":"4.8.0"},"reference-count":56,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Med Internet Res"],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>ChatGPT is a natural language processing model developed by OpenAI, which can be iteratively updated and optimized to accommodate the changing and complex requirements of human verbal communication.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>The study aimed to evaluate ChatGPT\u2019s accuracy in answering orthopedics-related multiple-choice questions (MCQs) and assess its short-term effects as a learning aid through a randomized controlled trial. In addition, long-term effects on student performance in other subjects were measured using final examination results.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We first evaluated ChatGPT\u2019s accuracy in answering MCQs pertaining to orthopedics across various question formats. Then, 129 undergraduate medical students participated in a randomized controlled study in which the ChatGPT group used ChatGPT as a learning tool, while the control group was prohibited from using artificial intelligence software to support learning. Following a 2-week intervention, the 2 groups\u2019 understanding of orthopedics was assessed by an orthopedics test, and variations in the 2 groups\u2019 performance in other disciplines were noted through a follow-up at the end of the semester.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>ChatGPT-4.0 answered 1051 orthopedics-related MCQs with a 70.60% (742\/1051) accuracy rate, including 71.8% (237\/330) accuracy for A1 MCQs, 73.7% (330\/448) accuracy for A2 MCQs, 70.2% (92\/131) accuracy for A3\/4 MCQs, and 58.5% (83\/142) accuracy for case analysis MCQs. As of April 7, 2023, a total of 129 individuals participated in the experiment. However, 19 individuals withdrew from the experiment at various phases; thus, as of July 1, 2023, a total of 110 individuals accomplished the trial and completed all follow-up work. After we intervened in the learning style of the students in the short term, the ChatGPT group answered more questions correctly than the control group (ChatGPT group: mean 141.20, SD 26.68; control group: mean 130.80, SD 25.56; P=.04) in the orthopedics test, particularly on A1 (ChatGPT group: mean 46.57, SD 8.52; control group: mean 42.18, SD 9.43; P=.01), A2 (ChatGPT group: mean 60.59, SD 10.58; control group: mean 56.66, SD 9.91; P=.047), and A3\/4 MCQs (ChatGPT group: mean 19.57, SD 5.48; control group: mean 16.46, SD 4.58; P=.002). At the end of the semester, we found that the ChatGPT group performed better on final examinations in surgery (ChatGPT group: mean 76.54, SD 9.79; control group: mean 72.54, SD 8.11; P=.02) and obstetrics and gynecology (ChatGPT group: mean 75.98, SD 8.94; control group: mean 72.54, SD 8.66; P=.04) than the control group.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>ChatGPT answers orthopedics-related MCQs accurately, and students using it excel in both short-term and long-term assessments. Our findings strongly support ChatGPT\u2019s integration into medical education, enhancing contemporary instructional methods.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Trial Registration<\/jats:title>\n                    <jats:p>Chinese Clinical Trial Registry Chictr2300071774; https:\/\/www.chictr.org.cn\/hvshowproject.html ?id=225740&amp;v=1.0<\/jats:p>\n                  <\/jats:sec>","DOI":"10.2196\/57037","type":"journal-article","created":{"date-parts":[[2024,8,20]],"date-time":"2024-08-20T13:00:31Z","timestamp":1724158831000},"page":"e57037","source":"Crossref","is-referenced-by-count":77,"title":["Integrating ChatGPT in Orthopedic Education for Medical Undergraduates: Randomized Controlled Trial"],"prefix":"10.2196","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1886-8062","authenticated-orcid":false,"given":"Wenyi","family":"Gan","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2708-8500","authenticated-orcid":false,"given":"Jianfeng","family":"Ouyang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8481-0235","authenticated-orcid":false,"given":"Hua","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-5807-9810","authenticated-orcid":false,"given":"Zhaowen","family":"Xue","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3366-9790","authenticated-orcid":false,"given":"Yiming","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8904-627X","authenticated-orcid":false,"given":"Qiu","family":"Dong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-9914-9667","authenticated-orcid":false,"given":"Jiadong","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7502-6131","authenticated-orcid":false,"given":"Xiaofei","family":"Zheng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-8507-5794","authenticated-orcid":false,"given":"Yiyi","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2024,8,20]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","DOI":"10.1007\/s11999-009-0781-2"},{"key":"ref2","doi-asserted-by":"publisher","DOI":"10.1016\/j.scitotenv.2023.164154"},{"key":"ref3","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-023-00340-6"},{"key":"ref4","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.37023"},{"key":"ref5","doi-asserted-by":"publisher","DOI":"10.1016\/j.resuscitation.2023.109729"},{"key":"ref6","doi-asserted-by":"publisher","DOI":"10.1016\/j.stemcr.2022.12.009"},{"key":"ref7","doi-asserted-by":"publisher","DOI":"10.1093\/asj\/sjad128"},{"key":"ref8","doi-asserted-by":"publisher","DOI":"10.1001\/jamainternmed.2023.1838"},{"key":"ref9","doi-asserted-by":"publisher","DOI":"10.1007\/s10439-023-03338-3"},{"key":"ref10","doi-asserted-by":"publisher","DOI":"10.2196\/48978"},{"key":"ref11","doi-asserted-by":"publisher","DOI":"10.1186\/1472-6920-13-139"},{"key":"ref12","doi-asserted-by":"publisher","DOI":"10.1227\/neu.0000000000002000"},{"key":"ref13","doi-asserted-by":"publisher","DOI":"10.1007\/s11920-018-0878-y"},{"key":"ref14","doi-asserted-by":"publisher","DOI":"10.1097\/00001888-200410001-00022"},{"key":"ref15","doi-asserted-by":"publisher","DOI":"10.1097\/00007632-200204010-00019"},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.2196\/51346"},{"key":"ref17","doi-asserted-by":"publisher","DOI":"10.2196\/16504"},{"key":"ref18","doi-asserted-by":"publisher","DOI":"10.2196\/15118"},{"key":"ref19","doi-asserted-by":"publisher","DOI":"10.2196\/50882"},{"key":"ref20","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.230163"},{"key":"ref21","doi-asserted-by":"publisher","DOI":"10.1007\/s11019-023-10136-0"},{"key":"ref22","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-023-00191-1"},{"key":"ref23","doi-asserted-by":"publisher","DOI":"10.1002\/ase.2270"},{"key":"ref24","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-023-01957-w"},{"key":"ref25","doi-asserted-by":"publisher","DOI":"10.1016\/S2589-7500(23)00023-7"},{"key":"ref26","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-023-31341-0"},{"key":"ref27","doi-asserted-by":"publisher","DOI":"10.1080\/10872981.2023.2181052"},{"key":"ref28","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0000000000005242"},{"key":"ref29","doi-asserted-by":"publisher","DOI":"10.2196\/48163"},{"key":"ref30","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijsu.2011.10.001"},{"key":"ref31","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.1923"},{"key":"ref32","doi-asserted-by":"publisher","DOI":"10.1152\/advan.00016.2001"},{"key":"ref33","doi-asserted-by":"publisher","DOI":"10.1016\/j.psc.2021.03.008"},{"key":"ref34","doi-asserted-by":"publisher","DOI":"10.2519\/jospt.2018.7850"},{"key":"ref35","doi-asserted-by":"publisher","DOI":"10.7326\/0003-4819-147-7-200710020-00006"},{"key":"ref36","doi-asserted-by":"publisher","DOI":"10.5858\/arpa.2018-0467-RA"},{"key":"ref37","doi-asserted-by":"publisher","DOI":"10.1016\/j.suc.2021.05.015"},{"key":"ref38","doi-asserted-by":"publisher","DOI":"10.1007\/s10459-007-9090-2"},{"key":"ref39","doi-asserted-by":"publisher","DOI":"10.1097\/00001888-199910000-00014"},{"key":"ref40","doi-asserted-by":"publisher","DOI":"10.1186\/1472-6920-10-12"},{"key":"ref41","doi-asserted-by":"publisher","DOI":"10.1016\/j.xcrm.2021.100348"},{"key":"ref42","doi-asserted-by":"publisher","DOI":"10.12669\/pjms.35.3.44"},{"key":"ref43","doi-asserted-by":"publisher","DOI":"10.1016\/j.cct.2021.106645"},{"issue":"2","key":"ref44","first-page":"157","volume":"60","author":"Al-Azri, H","year":"2014","journal-title":"Can Fam Physician"},{"key":"ref45","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.3240"},{"key":"ref46","doi-asserted-by":"publisher","DOI":"10.1186\/s12909-022-03992-6"},{"key":"ref47","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-024-02072-0"},{"key":"ref48","doi-asserted-by":"publisher","DOI":"10.1080\/0142159X.2024.2308779"},{"key":"ref49","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.51961"},{"key":"ref50","doi-asserted-by":"publisher","DOI":"10.1016\/j.isci.2024.109713"},{"key":"ref51","doi-asserted-by":"publisher","DOI":"10.2196\/50945"},{"key":"ref52","doi-asserted-by":"publisher","DOI":"10.3390\/healthcare11060887"},{"key":"ref53","doi-asserted-by":"publisher","DOI":"10.5114\/biolsport.2023.125623"},{"key":"ref54","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-022-04437-2"},{"key":"ref55","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-022-04397-7"},{"key":"ref56","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2021.06.070"}],"container-title":["Journal of Medical Internet Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jmir.org\/2024\/1\/e57037","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T17:46:53Z","timestamp":1782841613000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jmir.org\/2024\/1\/e57037"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,20]]},"references-count":56,"URL":"https:\/\/doi.org\/10.2196\/57037","relation":{"has-preprint":[{"id-type":"doi","id":"10.2196\/preprints.57037","asserted-by":"object"}]},"ISSN":["1438-8871"],"issn-type":[{"value":"1438-8871","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,20]]}}}