{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,23]],"date-time":"2026-10-23T20:02:38Z","timestamp":1792785758686,"version":"4.5.0"},"reference-count":23,"publisher":"Oxford University Press (OUP)","issue":"10","license":[{"start":{"date-parts":[[2026,7,2]],"date-time":"2026-07-02T00:00:00Z","timestamp":1782950400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"name":"Internal University of Toronto funding","id":[{"id":"https:\/\/ror.org\/03dbr7087","id-type":"ROR","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,10,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Purpose<\/jats:title>\n                    <jats:p>Large language models (LLMs), such as OpenAI\u2019s ChatGPT, have demonstrated tutoring benefits in small-scale pilot studies within focused areas of medical education. This study evaluated the large-scale implementation of AI-teaching assistants (AI-TAs) within a compulsory medical school course.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Method<\/jats:title>\n                    <jats:p>A quasi-experimental observational study with mixed methods was conducted to assess the impact of AI-TAs in a compulsory first-year medical school course at the University of Toronto in 2024. The research team developed AI-TAs using OpenAI\u2019s ChatGPT-4o and introduced them as a supplementary resource at the course\u2019s midpoint. They analyzed exam performance among the students who used AI-TAs (n\u2009=\u200987) and students who did not (n\u2009=\u2009206). Additionally, surveys (n\u2009=\u200918) and interviews (n\u2009=\u200910) explored student perceptions of AI-TAs\u2019 effectiveness, usability, and impact on learning.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Students who would later adopt AI-TAs had significantly lower pre-intervention exam scores than their peers [83.8% vs 88.1%; t(118.8) = \u22123.82, P &amp;lt; .001]. They also more often failed to meet the course\u2019s assessment standard pre-intervention (24.1% vs 6.4%). After AI-TA adoption, performance converged for both early users [86.1% vs 86.5%; t(95.63) = \u22120.35, P = .72] and late adopters [85.6% vs 86.5%; t(26.08) = \u22120.52, P = .61], with similar proportions falling below the course\u2019s standard (4.4%\u20136.4%). Thematic analysis and surveys identified 3 key advantages of AI-TAs: (1) reliable and accurate educational support, (2) efficient application across learning activities, and (3) improved psychological safety, promoting engagement in active learning.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>AI-TAs correlated with improved exam performance, fewer students in academic difficulty, and enhanced student engagement through a psychologically safe learning environment. These findings suggest that AI-TAs can serve as a scalable, cost-effective tool to support struggling students, while complementing traditional instruction.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/acamed\/wvag208","type":"journal-article","created":{"date-parts":[[2026,7,2]],"date-time":"2026-07-02T16:49:02Z","timestamp":1783010942000},"page":"1265-1273","source":"Crossref","is-referenced-by-count":2,"title":["Artificial intelligence teaching assistants: a scalable solution for supporting struggling medical students"],"prefix":"10.1093","volume":"101","author":[{"given":"Alina","family":"Sami","sequence":"first","affiliation":[{"name":"MD Program, Temerty Faculty of Medicine, University of Toronto , Toronto, Ontario,","place":["Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mark","family":"Adkins","sequence":"additional","affiliation":[{"name":"MD Program, Temerty Faculty of Medicine, University of Toronto , Toronto, Ontario,","place":["Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anne","family":"McLeod","sequence":"additional","affiliation":[{"name":"MD Program, Temerty Faculty of Medicine, University of Toronto , Toronto, Ontario,","place":["Canada"]},{"name":"Department of Medicine, Temerty Faculty of Medicine, University of Toronto , Toronto, Ontario,","place":["Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fok-Han","family":"Leung","sequence":"additional","affiliation":[{"name":"MD Program, Temerty Faculty of Medicine, University of Toronto , Toronto, Ontario,","place":["Canada"]},{"name":"Department of Family and Community Medicine, Temerty Faculty of Medicine, University of Toronto , Toronto, Ontario,","place":["Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-8234-5783","authenticated-orcid":false,"given":"Chris","family":"Gilchrist","sequence":"additional","affiliation":[{"name":"MD Program, Temerty Faculty of Medicine, University of Toronto , Toronto, Ontario,","place":["Canada"]},{"name":"Department of Family and Community Medicine, Temerty Faculty of Medicine, University of Toronto , Toronto, Ontario,","place":["Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2026,7,2]]},"reference":[{"key":"2026092503521027200_wvag208-B1","first-page":"260","article-title":"Using technology to meet the challenges of medical education","volume":"126","author":"Guze","year":"2015","journal-title":"Trans Am Clin Climatol Assoc"},{"key":"2026092503521027200_wvag208-B2","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1007\/s10459-009-9162-6","article-title":"Factors affecting feeling-of-knowing in a medical intelligent tutoring system: the role of immediate feedback as a metacognitive scaffold","volume":"15","author":"El Saadawi","year":"2010","journal-title":"Adv Health Sci Educ Theory Pract"},{"key":"2026092503521027200_wvag208-B3","doi-asserted-by":"publisher","first-page":"75264","DOI":"10.1109\/ACCESS.2020.2988510","article-title":"Artificial intelligence in education: a review","volume":"8","author":"Chen","year":"2020","journal-title":"IEEE Access"},{"key":"2026092503521027200_wvag208-B4","doi-asserted-by":"publisher","first-page":"2382120519840332","DOI":"10.1177\/2382120519840332","article-title":"Adult learning theories in context: a quick guide for healthcare professional educators","volume":"6","author":"Mukhalalati","year":"2019","journal-title":"J Med Educ Curric Dev"},{"key":"2026092503521027200_wvag208-B5","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1186\/s41239-019-0171-0","article-title":"Systematic review of research on artificial intelligence applications in higher education\u2014where are the educators?","volume":"16","author":"Zawacki-Richter","year":"2019","journal-title":"Int J Educ Technol High Educ"},{"key":"2026092503521027200_wvag208-B6","doi-asserted-by":"publisher","first-page":"644","DOI":"10.3233\/SHTI230580","article-title":"The pros and cons of using ChatGPT in medical education: a scoping review","volume":"305","author":"Mohammad","year":"2023","journal-title":"Stud Health Technol Inform"},{"key":"2026092503521027200_wvag208-B7","doi-asserted-by":"publisher","first-page":"39","DOI":"10.36834\/cmej.79759","article-title":"Artificial intelligence can \u00adtransform formative assessment in medical education","volume":"16","author":"Feldman","year":"2025","journal-title":"Can Med Educ J"},{"key":"2026092503521027200_wvag208-B8","doi-asserted-by":"publisher","first-page":"6","DOI":"10.3352\/jeehp.2024.21.6","article-title":"Opportunities, challenges, and future directions of large language models, including ChatGPT in medical education: a systematic scoping review","volume":"21","author":"Xu","year":"2024","journal-title":"J Educ Eval Health Prof"},{"key":"2026092503521027200_wvag208-B9","doi-asserted-by":"publisher","first-page":"e52483","DOI":"10.2196\/52483","article-title":"Embracing ChatGPT for medical education: exploring its impact on doctors and medical students","volume":"10","author":"Wu","year":"2024","journal-title":"JMIR Med Educ"},{"key":"2026092503521027200_wvag208-B10","doi-asserted-by":"publisher","first-page":"480","DOI":"10.1017\/S0022215123001354","article-title":"The role of ChatGPT in enhancing ENT surgical training: a trainees\u2019 perspective","volume":"138","author":"Brennan","year":"2024","journal-title":"J Laryngol Otol"},{"key":"2026092503521027200_wvag208-B11","doi-asserted-by":"publisher","first-page":"e50545","DOI":"10.2196\/50545","article-title":"Integration of ChatGPT into a course for medical students: explorative study on teaching scenarios, students\u2019 perception, and applications","volume":"10","author":"Thomae","year":"2024","journal-title":"JMIR Med Educ"},{"key":"2026092503521027200_wvag208-B12","doi-asserted-by":"publisher","first-page":"661","DOI":"10.1002\/ca.24178","article-title":"Introducing AnatomyGPT: a customized artificial intelligence application for anatomical sciences education","volume":"37","author":"Collins","year":"2024","journal-title":"Clin Anat"},{"key":"2026092503521027200_wvag208-B13","doi-asserted-by":"publisher","first-page":"753","DOI":"10.1016\/J.JSURG.2024.01.014","article-title":"Evaluating the role of ChatGPT as a study aid in medical education in surgery","volume":"81","author":"Araji","year":"2024","journal-title":"J Surg Educ"},{"key":"2026092503521027200_wvag208-B14"},{"key":"2026092503521027200_wvag208-B15","doi-asserted-by":"publisher","first-page":"157","DOI":"10.2307\/41410412","article-title":"Consumer acceptance and use of information technology: extending the unified theory of acceptance and use of technology","volume":"36","author":"Venkatesh","year":"2012","journal-title":"MIS Q"},{"key":"2026092503521027200_wvag208-B16","doi-asserted-by":"publisher","first-page":"5142","DOI":"10.1080\/10494820.2023.2209881","article-title":"To use or not to use ChatGPT in higher education? A study of students\u2019 acceptance and use of technology","volume":"32","author":"Strzelecki","year":"2024","journal-title":"Interact Learn Environ"},{"key":"2026092503521027200_wvag208-B17","volume-title":"Research Design: Qualitative, Quantitative, and Mixed Methods Approaches","author":"Creswell","year":"2018","edition":"5th ed"},{"key":"2026092503521027200_wvag208-B18","doi-asserted-by":"publisher","first-page":"349","DOI":"10.1093\/intqhc\/mzm042","article-title":"Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups","volume":"19","author":"Tong","year":"2007","journal-title":"Int J Qual Health Care"},{"key":"2026092503521027200_wvag208-B19","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1191\/1478088706qp063oa","article-title":"Using thematic analysis in psychology","volume":"3","author":"Braun","year":"2006","journal-title":"Qual Res Psychol"},{"key":"2026092503521027200_wvag208-B20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1177\/1609406917733847","article-title":"Thematic analysis: striving to meet the trustworthiness criteria","volume":"16","author":"Nowell","year":"2017","journal-title":"Int J Qual Methods"},{"key":"2026092503521027200_wvag208-B21","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1177\/1948550617697177","article-title":"Equivalence tests: a practical primer for t tests, correlations, and meta-analyses","volume":"8","author":"Lakens","year":"2017","journal-title":"Soc Psychol Personal Sci"},{"key":"2026092503521027200_wvag208-B22","doi-asserted-by":"publisher","first-page":"200","DOI":"10.5116\/ijme.5763.de11","article-title":"Constructivism: reflections on twenty five years teaching the constructivist approach in medical education","volume":"7","author":"Dennick","year":"2016","journal-title":"Int J Med Educ"},{"key":"2026092503521027200_wvag208-B23","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1007\/s40037-012-0012-5","article-title":"Academic self-efficacy: from educational theory to instructional practice","volume":"1","author":"Artino","year":"2012","journal-title":"Perspect Med Educ"}],"container-title":["Academic Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/academicmedicine\/advance-article-pdf\/doi\/10.1093\/acamed\/wvag208\/68683627\/wvag208.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/academicmedicine\/article-pdf\/101\/10\/1265\/68683627\/wvag208.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/academicmedicine\/article-pdf\/101\/10\/1265\/68683627\/wvag208.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,25]],"date-time":"2026-09-25T07:52:18Z","timestamp":1790322738000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/academicmedicine\/article\/101\/10\/1265\/8723692"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,2]]},"references-count":23,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2026,7,2]]},"published-print":{"date-parts":[[2026,10,1]]}},"URL":"https:\/\/doi.org\/10.1093\/acamed\/wvag208","relation":{},"ISSN":["1938-808X"],"issn-type":[{"value":"1938-808X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,10]]},"published":{"date-parts":[[2026,7,2]]}}}