{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,23]],"date-time":"2025-10-23T01:38:25Z","timestamp":1761183505130,"version":"build-2065373602"},"reference-count":16,"publisher":"Journal of Graduate Medical Education","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,4,1]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Prior to the COVID-19 pandemic, accreditation site visit interviews occurred in-person. In response to the pandemic, the Accreditation Council for Graduate Medical Education (ACGME) developed a remote site visit protocol.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To perform an early assessment of the remote accreditation site visits for programs applying for initial ACGME accreditation.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>A cohort of residency and fellowship programs that had remote site visits was evaluated from June to August 2020. Surveys were sent to program personnel, ACGME accreditation field representatives, and executive directors following the site visits. Comparison of accreditation decisions (Initial Accreditation or Accreditation Withheld) was completed for matched residency or fellowship programs having in-person site visits in 2019.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Surveys were sent to all program personnel from the 58 residency and fellowship programs that had remote site visits for new program applications, as well as the accreditation field representatives who performed the remote visits. The survey response rate was 58% (352 of 607). Ninety-one percent of all respondents were extremely or very confident that remote site visits provided a thorough assessment of proposed residency or fellowship programs. Fifty-four programs having remote site visits were matched by specialty to programs having had in-person program application site visits in 2019. Forty-six programs that had remote site visits received Initial Accreditation, and 52 programs that had in-person site visits in 2019 received Initial Accreditation (P=.093, 95% CI 0.91-22.38).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Most program personnel and accreditation field representatives were confident that remote site visits conducted for program applications provided fair and thorough assessments of the program.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.4300\/jgme-d-22-00419.1","type":"journal-article","created":{"date-parts":[[2023,4,17]],"date-time":"2023-04-17T16:48:38Z","timestamp":1681750118000},"page":"244-247","source":"Crossref","is-referenced-by-count":0,"title":["An Early Evaluation of Remote Site Visits for ACGME Program Applications"],"prefix":"10.4300","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2660-8191","authenticated-orcid":true,"given":"Lee S.","family":"Segal","sequence":"first","affiliation":[{"name":"Lee S. Segal, MD, is an Accreditation Field Representative, Accreditation Council for Graduate Medical Education (ACGME)"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrea","family":"Chow","sequence":"additional","affiliation":[{"name":"Andrea Chow, MA, is Associate Director, Department of Accreditation, Recognition, and Field Activities, ACGME"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"William W.","family":"Robertson","sequence":"additional","affiliation":[{"name":"William W. Robertson, MD, MBA, is an Accreditation Field Representative, ACGME"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David M.","family":"Drvaric","sequence":"additional","affiliation":[{"name":"David M. Drvaric, MD, is an Accreditation Field Representative, ACGME"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Margaret H.","family":"Mulligan","sequence":"additional","affiliation":[{"name":"Margaret H. Mulligan, PhD, is an Accreditation Field Representative, ACGME"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Serge","family":"Martinez","sequence":"additional","affiliation":[{"name":"Serge Martinez, MD, JD, is an Accreditation Field Representative, ACGME"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"2856","published-online":{"date-parts":[[2023,4,17]]},"reference":[{"doi-asserted-by":"crossref","unstructured":"Sohrabi\n              C,\n            \n            \n              Alsafi\n              Z,\n            \n            \n              O'Neill\n              N,\n            \n            et al.\n          \n          World Health Organization declares global emergency: a review of the 2019 novel coronavirus (COVID-19).\n\t\t\t\t\tInt J Surg.\n\t\t\t\t\t2020;\n\t\t\t\t\t76:\n\t\t\t\t\t71-\n\t\t\t\t\t76.\n\t\t\t\t\tdoi:https:\/\/doi.org\/10.1016\/j.ijsu.2020.02.034","key":"2023081614145404100_i1949-8357-15-2-244-b01","DOI":"10.1016\/j.ijsu.2020.02.034"},{"doi-asserted-by":"crossref","unstructured":"Nasca\n              TJ.\n            \n          \n          ACGME's early adaptation to the COVID-19 pandemic: principles and lessons learned.\n\t\t\t\t\tJ Grad Med Educ.\n\t\t\t\t\t2020;\n\t\t\t\t\t12(3):\n\t\t\t\t\t375-\n\t\t\t\t\t378.\n\t\t\t\t\tdoi:https:\/\/doi.org\/10.4300\/JGME-D-20-00302.1","key":"2023081614145404100_i1949-8357-15-2-244-b02","DOI":"10.4300\/JGME-D-20-00302.1"},{"doi-asserted-by":"crossref","unstructured":"Deakin\n              H,\n            \n            \n              Wakefield\n              K.\n            \n          \n          Skype interviewing: reflections of two PhD researchers.\n\t\t\t\t\tQual Res.\n\t\t\t\t\t2014;\n\t\t\t\t\t14(5):\n\t\t\t\t\t603-\n\t\t\t\t\t616.\n\t\t\t\t\tdoi:https:\/\/doi.org\/10.1177\/1468794113488126","key":"2023081614145404100_i1949-8357-15-2-244-b03","DOI":"10.1177\/1468794113488126"},{"doi-asserted-by":"crossref","unstructured":"Irani\n              E.\n            \n          \n          The use of videoconferencing for qualitative interviewing: opportunities, challenges, and considerations.\n\t\t\t\t\tClin Nurs Res.\n\t\t\t\t\t2019;\n\t\t\t\t\t28(1):\n\t\t\t\t\t3-\n\t\t\t\t\t8.\n\t\t\t\t\tdoi:https:\/\/doi.org\/10.1177\/1054773818803170","key":"2023081614145404100_i1949-8357-15-2-244-b04","DOI":"10.1177\/1054773818803170"},{"doi-asserted-by":"crossref","unstructured":"Jenner\n              BM,\n            \n            \n              Myers\n              KC.\n            \n          \n          Intimacy, rapport, and exceptional disclosure: a comparison of in-person and mediated interview contexts.\n\t\t\t\t\tInt J Soc Res Methodol.\n\t\t\t\t\t2019;\n\t\t\t\t\t22(2):\n\t\t\t\t\t165-\n\t\t\t\t\t177.\n\t\t\t\t\tdoi:https:\/\/doi.org\/10.1080\/13645579.2018.1512694","key":"2023081614145404100_i1949-8357-15-2-244-b05","DOI":"10.1080\/13645579.2018.1512694"},{"doi-asserted-by":"crossref","unstructured":"Krouwel\n              M,\n            \n            \n              Jolly\n              K,\n            \n            \n              Greenfield\n              S.\n            \n          \n          Comparing Skype (video calling) and in-person qualitative interview modes in a study of people with irritable bowel syndrome\u2014an exploratory comparative analysis.\n\t\t\t\t\tBMC Med Res Methodol.\n\t\t\t\t\t2019;\n\t\t\t\t\t19(1):\n\t\t\t\t\t219.\n\t\t\t\t\tdoi:https:\/\/doi.org\/10.1186\/s12874-019-0867-9","key":"2023081614145404100_i1949-8357-15-2-244-b06","DOI":"10.1186\/s12874-019-0867-9"},{"doi-asserted-by":"crossref","unstructured":"Sedgwick\n              M,\n            \n            \n              Spiers\n              J.\n            \n          \n          The use of videoconferencing as a medium for the qualitative interview.\n\t\t\t\t\tInt J Qual Method.\n\t\t\t\t\t2009;\n\t\t\t\t\t8(1):\n\t\t\t\t\t1-\n\t\t\t\t\t11.\n\t\t\t\t\tdoi:https:\/\/doi.org\/10.1177\/160940690900800101","key":"2023081614145404100_i1949-8357-15-2-244-b07","DOI":"10.1177\/160940690900800101"},{"doi-asserted-by":"crossref","unstructured":"Daram\n              SR,\n            \n            \n              Wu\n              R,\n            \n            \n              Tang\n              SJ.\n            \n          \n          Interview from anywhere: feasibility and utility of web-based videoconference interviews in the gastroenterology fellowship selection process.\n\t\t\t\t\tAm J Gastroenterol.\n\t\t\t\t\t2014;\n\t\t\t\t\t109(2):\n\t\t\t\t\t155-\n\t\t\t\t\t159.\n\t\t\t\t\tdoi:https:\/\/doi.org\/10.1038\/ajg.2013.278","key":"2023081614145404100_i1949-8357-15-2-244-b08","DOI":"10.1038\/ajg.2013.278"},{"doi-asserted-by":"crossref","unstructured":"Edje\n              L,\n            \n            \n              Miller\n              C,\n            \n            \n              Kiefer\n              J,\n            \n            \n              Oram\n              D.\n            \n          \n          Using Skype as an alternative for residency selection interviews.\n\t\t\t\t\tJ Grad Med Educ.\n\t\t\t\t\t2013;\n\t\t\t\t\t5(3):\n\t\t\t\t\t503-\n\t\t\t\t\t505.\n\t\t\t\t\tdoi:https:\/\/doi.org\/10.4300\/JGME-D-12-00152.1","key":"2023081614145404100_i1949-8357-15-2-244-b09","DOI":"10.4300\/JGME-D-12-00152.1"},{"doi-asserted-by":"crossref","unstructured":"Hariton\n              E,\n            \n            \n              Bortoletto\n              P,\n            \n            \n              Ayogu\n              N.\n            \n          \n          Using video-conference interviews in the residency application process.\n\t\t\t\t\tAcad Med.\n\t\t\t\t\t2017;\n\t\t\t\t\t92(6):\n\t\t\t\t\t728-\n\t\t\t\t\t729.\n\t\t\t\t\tdoi:https:\/\/doi.org\/10.1097\/ACM.0000000000001695","key":"2023081614145404100_i1949-8357-15-2-244-b10","DOI":"10.1097\/ACM.0000000000001695"},{"doi-asserted-by":"crossref","unstructured":"Healy\n              WL,\n            \n            \n              Bedair\n              H.\n            \n          \n          Videoconference interviews for an adult reconstruction fellowship: lessons learned.\n\t\t\t\t\tJ Bone Joint Surg Am.\n\t\t\t\t\t2017;\n\t\t\t\t\t99(21):\n\t\t\t\t\te114.\n\t\t\t\t\tdoi:https:\/\/doi.org\/10.2106\/JBJS.17.00322","key":"2023081614145404100_i1949-8357-15-2-244-b11","DOI":"10.2106\/JBJS.17.00322"},{"doi-asserted-by":"crossref","unstructured":"Melendez\n              MM,\n            \n            \n              Dobryansky\n              M,\n            \n            \n              Alizadeh\n              K.\n            \n          \n          Live online video interviews dramatically improve the plastic surgery residency application process.\n\t\t\t\t\tPlast Reconstr Surg.\n\t\t\t\t\t2012;\n\t\t\t\t\t130(1):\n\t\t\t\t\te240-\n\t\t\t\t\te241.\n\t\t\t\t\tdoi:https:\/\/doi.org\/10.1097\/PRS.0b013e3182550411","key":"2023081614145404100_i1949-8357-15-2-244-b12","DOI":"10.1097\/PRS.0b013e3182550411"},{"doi-asserted-by":"crossref","unstructured":"Pourmand\n              A,\n            \n            \n              Lee\n              H,\n            \n            \n              Fair\n              M,\n            \n            \n              Maloney\n              K,\n            \n            \n              Caggiula,\n              A.\n            \n          \n          Feasibility and usability of tele-interview for medical residency interview.\n\t\t\t\t\tWest J Emerg Med.\n\t\t\t\t\t2018;\n\t\t\t\t\t19(1):\n\t\t\t\t\t80-\n\t\t\t\t\t86.\n\t\t\t\t\tdoi:https:\/\/doi.org\/10.5811\/westjem.2017.11.35167","key":"2023081614145404100_i1949-8357-15-2-244-b13","DOI":"10.5811\/westjem.2017.11.35167"},{"doi-asserted-by":"crossref","unstructured":"Vadi\n              MG,\n            \n            \n              Malkin\n              MR,\n            \n            \n              Lenart\n              J,\n            \n            \n              Stier\n              GR,\n            \n            \n              Gatling\n              JW,\n            \n            \n              Applegate\n              RL\n              2nd.\n            \n          \n          Comparison of web-based and face-to-face interviews for application to an anesthesiology training program: a pilot study.\n\t\t\t\t\tInt J Med Educ.\n\t\t\t\t\t2016;\n\t\t\t\t\t7:\n\t\t\t\t\t102-\n\t\t\t\t\t108.\n\t\t\t\t\tdoi:10.5116\/ijme.56e5.491a","key":"2023081614145404100_i1949-8357-15-2-244-b14","DOI":"10.5116\/ijme.56e5.491a"},{"doi-asserted-by":"crossref","unstructured":"Williams\n              K,\n            \n            \n              Kling\n              JM,\n            \n            \n              Labonte\n              HR,\n            \n            \n              Blair\n              JE.\n            \n          \n          Videoconference interviewing: tips for success.\n\t\t\t\t\tJ Grad Med Educ.\n\t\t\t\t\t2015;\n\t\t\t\t\t7(3):\n\t\t\t\t\t331-\n\t\t\t\t\t333.\n\t\t\t\t\tdoi:https:\/\/doi.org\/10.4300\/JGME-D-14-00507.1","key":"2023081614145404100_i1949-8357-15-2-244-b15","DOI":"10.4300\/JGME-D-14-00507.1"},{"doi-asserted-by":"crossref","unstructured":"Bennett\n              AA,\n            \n            \n              Campion\n              ED,\n            \n            \n              Keeler\n              KR,\n            \n            \n              Keener\n              SK.\n            \n          \n          Videoconference fatigue? Exploring changes in fatigue after videoconference meetings during COVID-19.\n\t\t\t\t\tJ App Psychol.\n\t\t\t\t\t2021;\n\t\t\t\t\t106(3):\n\t\t\t\t\t330-\n\t\t\t\t\t344.\n\t\t\t\t\tdoi:https:\/\/doi.org\/10.1037\/apl0000906","key":"2023081614145404100_i1949-8357-15-2-244-b16","DOI":"10.1037\/apl0000906"}],"container-title":["Journal of Graduate Medical Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/meridian.allenpress.com\/jgme\/article-pdf\/15\/2\/244\/3249306\/i1949-8357-15-2-244.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/meridian.allenpress.com\/jgme\/article-pdf\/15\/2\/244\/3249306\/i1949-8357-15-2-244.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,22]],"date-time":"2025-10-22T19:57:38Z","timestamp":1761163058000},"score":1,"resource":{"primary":{"URL":"https:\/\/jgme.kglmeridian.com\/view\/journals\/jgme\/15\/2\/article-p244.xml"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,1]]},"references-count":16,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,4,17]]},"published-print":{"date-parts":[[2023,4,1]]}},"URL":"https:\/\/doi.org\/10.4300\/jgme-d-22-00419.1","relation":{},"ISSN":["1949-8357","1949-8349"],"issn-type":[{"type":"electronic","value":"1949-8357"},{"type":"print","value":"1949-8349"}],"subject":[],"published":{"date-parts":[[2023,4,1]]}}}