{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,4,9]],"date-time":"2025-04-09T08:33:03Z","timestamp":1744187583583},"reference-count":21,"publisher":"Springer Science and Business Media LLC","issue":"8","license":[{"start":{"date-parts":[[2021,10,22]],"date-time":"2021-10-22T00:00:00Z","timestamp":1634860800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,10,22]],"date-time":"2021-10-22T00:00:00Z","timestamp":1634860800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Br Dent J"],"published-print":{"date-parts":[[2021,10,22]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p><jats:bold>Introduction<\/jats:bold>  The Royal College of Surgeons of England (RCSEng) and the Royal College of Physicians and Surgeons of Glasgow (RCPSG) offer the bi-collegiate Membership in Orthodontics (MOrth) examination, a summative assessment of specialist knowledge, skill and behaviour in orthodontics. The COVID-19 pandemic has had a profound global effect on almost every facet of normal life, including the conduct of face-to-face examinations. We highlight development, implementation and feedback for the bi-collegiate MOrth Part 2 examination delivered remotely to a cohort of candidates in September 2020 by RCSEng\/RCPSG.<\/jats:p><jats:p><jats:bold>Methods<\/jats:bold>  Two anonymised online surveys (Google Forms) were distributed via electronic mail following completion of the examination diet. Forty-two candidates were sent a survey covering four domains and comprising a total of 31 questions. The 20 examiners were sent a survey containing eight questions. In both surveys, free-text responses were also collected. A rating system was used to categorise responses. All survey responses were summarised in an online data collection sheet.<\/jats:p><jats:p><jats:bold>Results<\/jats:bold>  The response rate was 78.5% (33\/42) and 75% (15\/20) for candidates and examiners, respectively. Overall, favourable responses in relation to all sections of the assessment were elicited from candidates with the majority (mean 79.8%; 75.8-81.9%) reporting that the online examination format worked well. Equally, favourable responses were reported by examiners. Notably, 80% of examiners felt that the online exam style did not affect the mark a candidate would receive, and 100% were confident that the marks the candidates received were a reflection of their ability and were not affected by the online delivery of the assessment.<\/jats:p><jats:p><jats:bold>Conclusions<\/jats:bold>  The feedback from both candidates and examiners relating to an online remote assessment of the bi-collegiate MOrth Part 2 was generally positive. Based on the survey responses, this format of a high-stakes examination was acceptable to all stakeholders, and demonstrated a high level of perceived validity and reliability in terms of content.<\/jats:p>","DOI":"10.1038\/s41415-021-3535-5","type":"journal-article","created":{"date-parts":[[2021,10,22]],"date-time":"2021-10-22T10:09:32Z","timestamp":1634897372000},"page":"503-511","update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Development, implementation and feedback for an online speciality membership examination in orthodontics during the COVID-19 pandemic"],"prefix":"10.1038","volume":"231","author":[{"given":"Charlotte E.","family":"Eckhardt","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jadbinder","family":"Seehra","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stephen M.","family":"Chadwick","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kim","family":"Voerman","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alex","family":"Landau","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fiona S.","family":"Ryan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Padhraig S.","family":"Fleming","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matthew","family":"Garrett","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martyn T.","family":"Cobourne","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,10,22]]},"reference":[{"key":"3535_CR7230","unstructured":"General Dental Council. Curriculum and specialist training programme in orthodontics. 2010. Available at https:\/\/www.gdc-uk.org\/docs\/default-source\/specialist-lists\/orthodonticcurriculum.pdf?sfvrsn=76eecfed_2 (accessed October 2020)."},{"key":"3535_CR7232","unstructured":"COPDEND. A Reference Guide for Postgraduate Dental Specialty Training in the UK. 2018. Available at www.copdend.org\/wp-content\/uploads\/2018\/08\/Dental-Gold-Guide-June-2018.pdf (accessed October 2020)."},{"key":"3535_CR7234","unstructured":"Royal College of Surgeons of England. Faculty of Dental Surgery (FDS). Available at https:\/\/www.rcseng.ac.uk\/dental-faculties\/fds\/ (accessed October 2020)."},{"key":"3535_CR7236","unstructured":"Royal College of Surgeons of England. Membership in Orthodontics (MOrth). Available at https:\/\/www.rcseng.ac.uk\/education-and-exams\/exams\/search\/membership-in-orthodontics\/ (accessed October 2020)."},{"key":"3535_CR7239","doi-asserted-by":"crossref","unstructured":"Kealey A, Alam F, McCreath G et al. Real-world impact of COVID-19 pandemic on the assessment of anaesthesiology residents. Br J Anaesth 2020; DOI: 10.1016\/j.bja.2020.08.016.","DOI":"10.1016\/j.bja.2020.08.016"},{"key":"3535_CR7241","doi-asserted-by":"crossref","unstructured":"Phillips G, Jones M, Dagg K. Restarting training and examinations in the era of COVID-19: a perspective from the Federation of Royal Colleges of Physicians UK. Clin Med (Lond) 2020; DOI: 10.7861\/clinmed.2020-0481.","DOI":"10.7861\/clinmed.2020-0481"},{"key":"3535_CR7243","unstructured":"COPDEND. Welcome to COPDEND. Available at https:\/\/www.copdend.org\/ (accessed October 2020)."},{"key":"3535_CR7245","unstructured":"Health Education England. Homepage. Available at www.hee.nhs.uk\/health-education-england (accessed October 2020)."},{"key":"3535_CR7247","doi-asserted-by":"crossref","unstructured":"Ashokka B, Ong S Y, Tay K H, Loh N H W, Gee C F, Samarasekera D D. Coordinated responses of academic medical centres to pandemics: Sustaining medical education during COVID-19. Med Teach 2020; 42: 762-771.","DOI":"10.1080\/0142159X.2020.1757634"},{"key":"3535_CR7250","doi-asserted-by":"crossref","unstructured":"Persky A M, Fuller K A, Jarstfer M, Rao K, Rodgers J E, Smith M. Maintaining Core Values in Postgraduate Programs During the COVID-19 Pandemic. Am J Pharm Educ 2020; DOI: 10.5688\/ajpe8158.","DOI":"10.5688\/ajpe8158"},{"key":"3535_CR7253","doi-asserted-by":"crossref","unstructured":"Walsh K. Point of view: Online assessment in medical education - current trends and future directions. Malawi Med J 2015; 27: 71-72.","DOI":"10.4314\/mmj.v27i2.8"},{"key":"3535_CR7255","doi-asserted-by":"crossref","unstructured":"Memon M A, Joughin G R, Memon B. Oral assessment and postgraduate medical examinations: establishing conditions for validity, reliability and fairness. Adv Health Sci Educ Theory Pract 2010; 15: 277-289.","DOI":"10.1007\/s10459-008-9111-9"},{"key":"3535_CR7257","doi-asserted-by":"crossref","unstructured":"Hulsbosch A M, Nugter M A, Tamis P, Kroon H. Videoconferencing in a mental health service in The Netherlands: A randomized controlled trial on patient satisfaction and clinical outcomes for outpatients with severe mental illness. J Telemed Telecare 2017; 23: 513-520.","DOI":"10.1177\/1357633X16650096"},{"key":"3535_CR7260","doi-asserted-by":"crossref","unstructured":"Donaghy E, Atherton H, Hammersley V et al. Acceptability, benefits, and challenges of video consulting: a qualitative study in primary care. Br J Gen Pract 2019; DOI: 10.3399\/bjgp19X704141.","DOI":"10.3399\/bjgp19X704141"},{"key":"3535_CR7263","doi-asserted-by":"crossref","unstructured":"Parker K, Chia M. Remote working in dentistry in a time of crisis - tools and their uses. Dent Update 2020; 47: 515-526.","DOI":"10.12968\/denu.2020.47.6.515"},{"key":"3535_CR7265","unstructured":"Martin L, Tapp D. Teaching with Teams: An introduction to teaching an undergraduate law module using Microsoft Teams. Innov Pract Higher Educ 2019; 3: 58-66."},{"key":"3535_CR7267","unstructured":"Surpass Powering Assessment. Technology & Test Development Services. Available online at https:\/\/surpass.com\/ (accessed October 2020)."},{"key":"3535_CR7270","doi-asserted-by":"crossref","unstructured":"Khalaf K, El-Kishawi M, Moufti M A, Al Kawas S. Introducing a comprehensive high-stake online exam to final-year dental students during the COVID-19 pandemic and evaluation of its effectiveness. Med Educ Online 2020; 25: 1826861.","DOI":"10.1080\/10872981.2020.1826861"},{"key":"3535_CR7273","unstructured":"Casbarro J. Reducing anxiety in the era of high-stakes testing. Principals 2004; 83: 36-38."},{"key":"3535_CR7275","doi-asserted-by":"crossref","unstructured":"Colbert-Getz J M, Fleishman C, Jung J, Shilkofski N. How do gender and anxiety affect students' self-assessment and actual performance on a high-stakes clinical skills examination? Acad Med 2013; 88: 44-48.","DOI":"10.1097\/ACM.0b013e318276bcc4"},{"key":"3535_CR7278","doi-asserted-by":"crossref","unstructured":"Van Der Vleuten C P. The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ Theory Pract 1996;  1: 41-67.","DOI":"10.1007\/BF00596229"}],"container-title":["British Dental Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41415-021-3535-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41415-021-3535-5","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41415-021-3535-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,2,22]],"date-time":"2022-02-22T20:35:36Z","timestamp":1645562136000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41415-021-3535-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,22]]},"references-count":21,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2021,10,22]]}},"alternative-id":["3535"],"URL":"https:\/\/doi.org\/10.1038\/s41415-021-3535-5","relation":{},"ISSN":["0007-0610","1476-5373"],"issn-type":[{"value":"0007-0610","type":"print"},{"value":"1476-5373","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,22]]},"assertion":[{"value":"12 November 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 March 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 October 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no conflicts of interest.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics declarations"}}]}}