{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,15]],"date-time":"2026-10-15T16:06:07Z","timestamp":1792080367458,"version":"4.4.0"},"reference-count":43,"publisher":"Wiley","issue":"11","license":[{"start":{"date-parts":[[2025,6,7]],"date-time":"2025-06-07T00:00:00Z","timestamp":1749254400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"},{"start":{"date-parts":[[2025,6,7]],"date-time":"2025-06-07T00:00:00Z","timestamp":1749254400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["The Laryngoscope"],"published-print":{"date-parts":[[2025,11]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objectives<\/jats:title>\n                    <jats:p>Residency programs face a large number of applications with limited time to review them. Artificial intelligence (AI) tools could potentially streamline this process. This scoping review examines how AI has been applied in the resident selection process, the impacts described, and the limitations identified.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Data Sources<\/jats:title>\n                    <jats:p>PubMed, OVID, Cochrane, EMBASE, Google Scholar, and Web of Science.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Review Methods<\/jats:title>\n                    <jats:p>A comprehensive search strategy was developed using keywords related to artificial intelligence, natural language processing, machine learning, medical residency, and personnel selection. Studies were included if they were published in English in the last 10\u2009years, involved real or simulated medical or surgical residency applicants or applications, and used AI in any part of the selection process. Articles were identified and screened independently by two reviewers, with conflicts resolved by consensus.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Of 115 identified articles, 11 met inclusion criteria. Applications of AI fell into three thematic areas: assessing bias (\n                      <jats:italic>n<\/jats:italic>\n                      \u2009=\u20094), predicting selection outcomes (\n                      <jats:italic>n<\/jats:italic>\n                      \u2009=\u20095), and comparing AI to human reviewers (\n                      <jats:italic>n<\/jats:italic>\n                      \u2009=\u20092). AI models included natural language processing, machine learning, and large language models. While several studies demonstrated AI's potential to detect bias, improve reviewer consistency, and identify overlooked applicants, concerns remain about bias replication, limited generalizability, and the interpretability of AI\u2010driven decisions.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Artificial intelligence holds promise for a more efficient and equitable resident selection process. Further investigation is needed to guide responsible development, validation, and oversight of these tools.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1002\/lary.32308","type":"journal-article","created":{"date-parts":[[2025,6,7]],"date-time":"2025-06-07T08:38:43Z","timestamp":1749285523000},"page":"4053-4063","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Preparing for\n                    <scp>AI<\/scp>\n                    in Resident Selection: A Scoping Review of Current Applications and Limitations"],"prefix":"10.1002","volume":"135","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1499-7721","authenticated-orcid":false,"given":"Gillian","family":"Michaelson","sequence":"first","affiliation":[{"name":"Case Western Reserve University School of Medicine  Cleveland Ohio USA"},{"name":"Department of Otolaryngology\u2014Head and Neck Surgery University Hospitals Cleveland Medical Center  Cleveland Ohio USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Karasik","sequence":"additional","affiliation":[{"name":"Department of Otolaryngology\u2014Head and Neck Surgery University Hospitals Cleveland Medical Center  Cleveland Ohio USA"},{"name":"Technion\u2014Israel Institute of Technology, Ruth and Bruce Rappaport Faculty of Medicine  Haifa Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eleanor","family":"Polen","sequence":"additional","affiliation":[{"name":"Core Library University Hospitals Cleveland Medical Center  Cleveland Ohio USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sanjeet V.","family":"Rangarajan","sequence":"additional","affiliation":[{"name":"Case Western Reserve University School of Medicine  Cleveland Ohio USA"},{"name":"Department of Otolaryngology\u2014Head and Neck Surgery University Hospitals Cleveland Medical Center  Cleveland Ohio USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9847-505X","authenticated-orcid":false,"given":"Nina W.","family":"Zhao","sequence":"additional","affiliation":[{"name":"Case Western Reserve University School of Medicine  Cleveland Ohio USA"},{"name":"Department of Otolaryngology\u2014Head and Neck Surgery University Hospitals Cleveland Medical Center  Cleveland Ohio USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2025,6,7]]},"reference":[{"key":"e_1_2_7_2_1","unstructured":"AAMC ERAS 2024 Cycle Applicant and Application Data."},{"issue":"11","key":"e_1_2_7_3_1","article-title":"Implications of a High\u2010Signal Approach in the Otolaryngology Residency Application Process","volume":"42","author":"Nadeem W.","year":"2023","journal-title":"Bulletin"},{"key":"e_1_2_7_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsurg.2021.02.003"},{"key":"e_1_2_7_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2018.07.057"},{"key":"e_1_2_7_6_1","doi-asserted-by":"publisher","DOI":"10.1002\/lary.30668"},{"key":"e_1_2_7_7_1","doi-asserted-by":"publisher","DOI":"10.9734\/ajarr\/2024\/v18i1596"},{"key":"e_1_2_7_8_1","unstructured":"Sonix \u201cAI vs. Machine Learning vs. Deep Learning: What's the Difference? \u201daccessed March 30 2024 https:\/\/sonix.ai\/articles\/difference\u2010between\u2010artificial\u2010intelligence\u2010machine\u2010learning\u2010and\u2010natural\u2010language\u2010processing."},{"key":"e_1_2_7_9_1","unstructured":"OpenAI \u201cIntroducing ChatGPT \u201daccessed July 28 2024 https:\/\/openai.com\/index\/chatgpt\/."},{"key":"e_1_2_7_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinane.2023.111185"},{"key":"e_1_2_7_11_1","doi-asserted-by":"publisher","DOI":"10.3389\/frai.2023.1169595"},{"key":"e_1_2_7_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-19-2984-7_14"},{"key":"e_1_2_7_13_1","doi-asserted-by":"publisher","DOI":"10.3390\/admsci14070157"},{"key":"e_1_2_7_14_1","unstructured":"AAMC and Thalamus Expand Strategic Collaboration to offer Technology\u2010Assisted Holistic Application Review Platform \u201cThe Association of American Medial Colleges (AAMC) \u201daccessed November 7 2024 https:\/\/www.aamc.org\/news\/press\u2010releases\/aamc\u2010and\u2010thalamus\u2010expand\u2010strategic\u2010collaboration\u2010offer\u2010technology\u2010assisted\u2010holistic\u2010application."},{"key":"e_1_2_7_15_1","unstructured":"Thalamus \u201cRevolutionize You Application Review With Thalamus Cortex \u201daccessed March 24 2025 https:\/\/www.thalamusgme.com\/add\u2010ons\/cortex\u2010application\u2010screening."},{"key":"e_1_2_7_16_1","unstructured":"L.Weidinger J.Mellor M.Rauh et\u00a0al. \u201cEthical and Social Risks of Harm From Language Models \u201d2021Preprint 211204359."},{"key":"e_1_2_7_17_1","article-title":"Amazon Scraps Secret AI Recruiting Engine That Showed Biases Against Women","volume":"11","author":"Iriondo R.","year":"2018","journal-title":"Machine Learning"},{"key":"e_1_2_7_18_1","doi-asserted-by":"publisher","DOI":"10.1097\/XEB.0000000000000050"},{"key":"e_1_2_7_19_1","doi-asserted-by":"publisher","DOI":"10.11124\/JBIES-20-00167"},{"key":"e_1_2_7_20_1","doi-asserted-by":"publisher","DOI":"10.7326\/M18-0850"},{"key":"e_1_2_7_21_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13643-016-0384-4"},{"key":"e_1_2_7_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.acap.2023.02.012"},{"key":"e_1_2_7_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjsurg.2021.09.034"},{"key":"e_1_2_7_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2024.12.017"},{"key":"e_1_2_7_25_1","doi-asserted-by":"publisher","DOI":"10.1002\/lary.31705"},{"key":"e_1_2_7_26_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0000000000004317"},{"key":"e_1_2_7_27_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0000000000005352"},{"key":"e_1_2_7_28_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0000000000005210"},{"key":"e_1_2_7_29_1","doi-asserted-by":"publisher","DOI":"10.3171\/2022.5.JNS22558"},{"key":"e_1_2_7_30_1","doi-asserted-by":"publisher","DOI":"10.1080\/10401334.2022.2059664"},{"key":"e_1_2_7_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsurg.2024.103308"},{"key":"e_1_2_7_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjsurg.2024.115816"},{"key":"e_1_2_7_33_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0000000000005439"},{"key":"e_1_2_7_34_1","doi-asserted-by":"publisher","DOI":"10.1053\/j.jvca.2024.05.003"},{"key":"e_1_2_7_35_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-023-31341-0"},{"key":"e_1_2_7_36_1","doi-asserted-by":"publisher","DOI":"10.1287\/msom.2023.0279"},{"issue":"2","key":"e_1_2_7_37_1","article-title":"What Goes in, Must Come out: Generative Artificial Intelligence Does Not Present Algorithmic Bias Across Race and Gender in Medical Residency Specialties","volume":"16","author":"Lin S.","year":"2024","journal-title":"Cureus"},{"key":"e_1_2_7_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13042-022-01647-y"},{"key":"e_1_2_7_39_1","doi-asserted-by":"publisher","DOI":"10.1111\/medu.12678"},{"key":"e_1_2_7_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsurg.2024.04.006"},{"key":"e_1_2_7_41_1","unstructured":"OpenAI \u201cHow Your Data is Used to Improve Model Performance \u201daccessed Jan 8 2025 https:\/\/help.openai.com\/en\/articles\/5722486\u2010how\u2010your\u2010data\u2010is\u2010used\u2010to\u2010improve\u2010model\u2010performance."},{"key":"e_1_2_7_42_1","unstructured":"OpenAI \u201cPrivacy Policy \u201daccessed Jan 8 2025 https:\/\/openai.com\/policies\/privacy\u2010policy\/."},{"key":"e_1_2_7_43_1","unstructured":"OpenAI \u201cTerms of Use.\u201d accessed Jan 8 2025 https:\/\/openai.com\/policies\/row\u2010terms\u2010of\u2010use\/."},{"key":"e_1_2_7_44_1","unstructured":"AAMC \u201cERAS Policies \u201daccessed Jan 8 2025 https:\/\/www.aamc.org\/services\/eras\u2010for\u2010institutions\/medical\u2010schools\/policies."}],"container-title":["The Laryngoscope"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/lary.32308","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/lary.32308","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/lary.32308","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,14]],"date-time":"2026-02-14T15:01:57Z","timestamp":1771081317000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/lary.32308"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,7]]},"references-count":43,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2025,11]]}},"alternative-id":["10.1002\/lary.32308"],"URL":"https:\/\/doi.org\/10.1002\/lary.32308","archive":["Portico"],"relation":{},"ISSN":["0023-852X","1531-4995"],"issn-type":[{"value":"0023-852X","type":"print"},{"value":"1531-4995","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,7]]},"assertion":[{"value":"2024-10-20","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-05-15","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-06-07","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}