{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T18:41:45Z","timestamp":1791916905838,"version":"4.3.4"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,12,1]],"date-time":"2021-12-01T00:00:00Z","timestamp":1638316800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,12,20]],"date-time":"2021-12-20T00:00:00Z","timestamp":1639958400000},"content-version":"vor","delay-in-days":19,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Educ"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>The COVID-19 pandemic has profoundly affected assessment practices in medical education necessitating distancing from the traditional classroom. However, safeguarding academic integrity is of particular importance for high-stakes medical exams. We utilised remote proctoring to administer safely and reliably a proficiency-test for admission to the Advanced Master of General Practice (AMGP). We compared exam results of the remote proctored exam group to those of the on-site proctored exam group.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>A cross-sectional design was adopted with candidates applying for admission to the AMGP. We developed and applied a proctoring software operating on three levels to register suspicious events: recording actions, analysing behaviour, and live supervision. We performed a Mann-Whitney U test to compare exam results from the remote proctored to the on-site proctored group. To get more insight into candidates\u2019 perceptions about proctoring, a post-test questionnaire was administered. An exploratory factor analysis was performed to explore quantitative data, while qualitative data were thematically analysed.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>In total, 472 (79%) candidates took the proficiency-test using the proctoring software, while 121 (20%) were on-site with live supervision. The results indicated that the proctoring type does not influence exam results. Out of 472 candidates, 304 filled in the post-test questionnaire. Two factors were extracted from the analysis and identified as candidates\u2019 appreciation of proctoring and as emotional distress because of proctoring. Four themes were identified in the thematic analysis providing more insight on candidates\u2019 emotional well-being.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>A comparison of exam results revealed that remote proctoring could be a viable solution for administering high-stakes medical exams. With regards to candidates\u2019 educational experience, remote proctoring was met with mixed feelings. Potential privacy issues and increased test anxiety should be taken into consideration when choosing a proctoring protocol. Future research should explore generalizability of these results utilising other proctoring systems\u00a0in medical education and in other educational settings.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12909-021-03068-x","type":"journal-article","created":{"date-parts":[[2021,12,20]],"date-time":"2021-12-20T15:02:52Z","timestamp":1640012572000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":37,"title":["Remote versus on-site proctored exam: comparing student results in a cross-sectional study"],"prefix":"10.1186","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6679-0514","authenticated-orcid":false,"given":"Vasiliki","family":"Andreou","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6235-1752","authenticated-orcid":false,"given":"Sanne","family":"Peters","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8497-1159","authenticated-orcid":false,"given":"Jan","family":"Eggermont","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Johan","family":"Wens","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1909-9613","authenticated-orcid":false,"given":"Birgitte","family":"Schoenmakers","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,12,20]]},"reference":[{"key":"3068_CR1","doi-asserted-by":"crossref","unstructured":"Simpson E, Yu K. Closer to the truth: electronic records of academic dishonesty in an actual classroom setting. Ethics & Behavior - ETHICS BEHAV. 2012;22.","DOI":"10.1080\/10508422.2012.702514"},{"key":"3068_CR2","doi-asserted-by":"crossref","unstructured":"Hamamoto Filho PT, Bicudo AM, Cecilio-Fernandes D. Preserving Cornerstones of Student's Assessment in Medical Education During COVID-19. Front Psychol. 2021;12:591152-.","DOI":"10.3389\/fpsyg.2021.591152"},{"key":"3068_CR3","unstructured":"(NCCA) NCfCA. Report on the NCCA Assessment of Live Remote Proctoring. Washington, DC 20006: Institute for Credentialing Exellence; 2021."},{"key":"3068_CR4","unstructured":"Berkey D, Halfond J. Cheating, student authentication and proctoring in online programs. 2015, Jul 20 [Available from: https:\/\/nebhe.org\/journal\/cheating-student-authentication-and-proctoring-in-online-programs\/."},{"key":"3068_CR5","doi-asserted-by":"crossref","unstructured":"Dunn T.P. MMFMJ. The remote proctor: An innovatie technological solution for online course integrity. The International Journal of Technology, Knowledge, and Society. 2010;1:1\u20137.","DOI":"10.18848\/1832-3669\/CGP\/v06i01\/56033"},{"issue":"3","key":"3068_CR6","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1111\/emip.12359","volume":"39","author":"T Langenfeld","year":"2020","unstructured":"Langenfeld T. Internet-based proctored assessment: security and fairness issues. Educ Meas Issues Pract. 2020;39(3):24\u20137.","journal-title":"Educ Meas Issues Pract"},{"key":"3068_CR7","doi-asserted-by":"crossref","unstructured":"Gudi\u00f1o Paredes S, Jasso Pe\u00f1a FdJ, de La Fuente Alcazar JM. Remote proctored exams: integrity assurance in online education? Distance Education 2021;42(2):200\u2013218.","DOI":"10.1080\/01587919.2021.1910495"},{"issue":"8","key":"3068_CR8","doi-asserted-by":"publisher","DOI":"10.2196\/23834","volume":"5","author":"B Schoenmakers","year":"2021","unstructured":"Schoenmakers B, Wens J. Efficiency, usability, and outcomes of proctored next-level exams for proficiency testing in primary care education: observational study. JMIR Form Res. 2021;5(8):e23834.","journal-title":"JMIR Form Res"},{"key":"3068_CR9","doi-asserted-by":"crossref","unstructured":"Lilley M, Meere J, Barker T. Remote live invigilation: a pilot study. J Interact Media Educ. 2016;2016.","DOI":"10.5334\/jime.408"},{"key":"3068_CR10","doi-asserted-by":"crossref","unstructured":"Casta\u00f1o M, Noeller C, Sharma R. Implementing remotely proctored testing in nursing education. Teach Learn Nurs. 2020.","DOI":"10.1016\/j.teln.2020.10.008"},{"issue":"1","key":"3068_CR11","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1111\/j.1540-4609.2008.00220.x","volume":"7","author":"KK Hollister","year":"2009","unstructured":"Hollister KK, Berenson ML. Proctored versus unproctored online exams: studying the impact of exam environment on student performance. Decis Sci J Innov Educ. 2009;7(1):271\u201394.","journal-title":"Decis Sci J Innov Educ"},{"key":"3068_CR12","first-page":"131","volume":"22","author":"LWJ Daffin","year":"2018","unstructured":"Daffin LWJ, Jones AA. Comparing student performance on proctored and non-proctored exams in online psychology courses. Online Learning Journal. 2018;22:131\u201345.","journal-title":"Online Learning Journal"},{"issue":"1","key":"3068_CR13","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1111\/ijsa.12053","volume":"22","author":"NA Wright","year":"2014","unstructured":"Wright NA, Meade AW, Gutierrez SL. Using invariance to examine cheating in unproctored ability tests. Int J Sel Assess. 2014;22(1):12\u201322.","journal-title":"Int J Sel Assess"},{"key":"3068_CR14","doi-asserted-by":"publisher","first-page":"100033","DOI":"10.1016\/j.chbr.2020.100033","volume":"2","author":"S Dendir","year":"2020","unstructured":"Dendir S, Maxwell RS. Cheating in online courses: evidence from online proctoring. Computers in Human Behavior Reports. 2020;2:100033.","journal-title":"Computers in Human Behavior Reports"},{"key":"3068_CR15","unstructured":"Weiner JA, Hurtz G, editors. A Comparative Study of Online Remote Proctored Versus Onsite Proctored High-stakes Exams2017."},{"issue":"8","key":"3068_CR16","doi-asserted-by":"publisher","first-page":"767","DOI":"10.1111\/medu.14247","volume":"54","author":"AH Sam","year":"2020","unstructured":"Sam AH, Reid MD, Amin A. High-stakes, remote-access, open-book examinations. Med Educ. 2020;54(8):767\u20138.","journal-title":"Med Educ"},{"issue":"11","key":"3068_CR17","doi-asserted-by":"publisher","first-page":"828","DOI":"10.1046\/j.1365-2923.1999.00517.x","volume":"33","author":"RW Ogilvie","year":"1999","unstructured":"Ogilvie RW, Trusk TC, Blue AV. Students' attitudes towards computer testing in a basic science course. Med Educ. 1999;33(11):828\u201331.","journal-title":"Med Educ"},{"issue":"1","key":"3068_CR18","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1186\/s12909-020-02184-4","volume":"20","author":"V Andreou","year":"2020","unstructured":"Andreou V, Eggermont J, Gielis G, et al. Proficiency testing for identifying underperforming students before postgraduate education: a longitudinal study. BMC Med Educ. 2020;20(1):261.","journal-title":"BMC Med Educ"},{"issue":"1","key":"3068_CR19","doi-asserted-by":"publisher","first-page":"58","DOI":"10.4103\/jfmpc.jfmpc_163_17","volume":"7","author":"B Schoenmakers","year":"2018","unstructured":"Schoenmakers B, Wens J. Proficiency testing for admission to the postgraduate family medicine education. J Family Med Prim Care. 2018;7(1):58\u201363.","journal-title":"J Family Med Prim Care"},{"key":"3068_CR20","doi-asserted-by":"crossref","unstructured":"Munshi F, Alsughayyer A, Alhaidar S, et al. An online clinical exam for fellowship certification during COVID-19 pandemic. Med Educ. 2020.","DOI":"10.1111\/medu.14267"},{"key":"3068_CR21","doi-asserted-by":"crossref","unstructured":"Rosenthal R. Meta-analytic procedures for social research. Thousand Oaks, California1991. Available from: https:\/\/methods.sagepub.com\/book\/meta-analytic-procedures-for-social-research.","DOI":"10.4135\/9781412984997"},{"key":"3068_CR22","volume-title":"Discovering statistics using SPSS: SAGE publications","author":"A Field","year":"2009","unstructured":"Field A. Discovering statistics using SPSS: SAGE publications; 2009."},{"key":"3068_CR23","first-page":"1","volume":"10","author":"AB Costello","year":"2005","unstructured":"Costello AB, Osborne J. Best practices in exploratory factor analysis: four recommendations for getting the Most from your analysis. Pract Assess Res Eval. 2005;10:1\u20139.","journal-title":"Pract Assess Res Eval"},{"key":"3068_CR24","doi-asserted-by":"publisher","first-page":"53","DOI":"10.5116\/ijme.4dfb.8dfd","volume":"2","author":"M Tavakol","year":"2011","unstructured":"Tavakol M, Dennick R. Making sense of Cronbach's alpha. Int J Med Educ. 2011;2:53\u20135.","journal-title":"Int J Med Educ"},{"key":"3068_CR25","first-page":"1","volume":"12","author":"V Clarke","year":"2016","unstructured":"Clarke V, Braun V. Thematic analysis. J Posit Psychol. 2016;12:1\u20132.","journal-title":"J Posit Psychol"},{"issue":"1","key":"3068_CR26","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1016\/j.cptl.2016.08.037","volume":"9","author":"AS Milone","year":"2017","unstructured":"Milone AS, Cortese AM, Balestrieri RL, et al. The impact of proctored online exams on the educational experience. Curr Pharmy Teach Learn. 2017;9(1):108\u201314.","journal-title":"Curr Pharmy Teach Learn"},{"issue":"4","key":"3068_CR27","doi-asserted-by":"publisher","first-page":"555","DOI":"10.1007\/s10869-014-9343-z","volume":"29","author":"MN Karim","year":"2014","unstructured":"Karim MN, Kaminsky SE, Behrend TS. Cheating, reactions, and performance in remotely proctored testing: an exploratory experimental study. J Bus Psychol. 2014;29(4):555\u201372.","journal-title":"J Bus Psychol"},{"key":"3068_CR28","doi-asserted-by":"crossref","unstructured":"Kharbat FF, Abu Daabes AS. E-proctored exams during the COVID-19 pandemic: a close understanding. Educ Inf Technol. 2021.","DOI":"10.1007\/s10639-021-10458-7"},{"key":"3068_CR29","doi-asserted-by":"crossref","unstructured":"Hochlehnert A, Brass K, Moeltner A, et al. Does medical students' preference of test format (computer-based vs. paper-based) have an influence on performance? BMC Med Educ. 2011;11:89.","DOI":"10.1186\/1472-6920-11-89"}],"container-title":["BMC Medical Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12909-021-03068-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12909-021-03068-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12909-021-03068-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,12,20]],"date-time":"2021-12-20T15:06:52Z","timestamp":1640012812000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmededuc.biomedcentral.com\/articles\/10.1186\/s12909-021-03068-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12]]},"references-count":29,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["3068"],"URL":"https:\/\/doi.org\/10.1186\/s12909-021-03068-x","relation":{},"ISSN":["1472-6920"],"issn-type":[{"value":"1472-6920","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12]]},"assertion":[{"value":"4 March 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 December 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 December 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"According to the ruling policy and regulations at the involved universities (KU Leuven, University of Ghent, University of Antwerp, VUB), no participants\u2019 informed consent was needed in order to report the outcome measures of the proctoring software, because we used anonymized secondary data. Nevertheless, participants (students) were asked to consent with the ongoing procedure of the exam and to contribute to the rollout of it by the Interuniversity Centre for GP Training that initially collected the data for evaluation purposes.For the post-test survey, ethical approval was granted by the Social and Societal Ethics Committee of the KU Leuven with the following approval number: <b><i>G-2020-2262-R2(MAR)<\/i><\/b>.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"All participants have been informed and given consent for publication.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"None.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"624"}}