{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,15]],"date-time":"2026-10-15T23:54:12Z","timestamp":1792108452322,"version":"4.4.0"},"reference-count":35,"publisher":"BMJ","issue":"11","license":[{"start":{"date-parts":[[2023,11,8]],"date-time":"2023-11-08T00:00:00Z","timestamp":1699401600000},"content-version":"unspecified","delay-in-days":7,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Applied Research Collaboration Oxford and Thames Valley"},{"DOI":"10.13039\/501100000780","name":"European Union","doi-asserted-by":"crossref","award":["23\/06\/2022"],"award-info":[{"award-number":["23\/06\/2022"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100000780","name":"European Union","doi-asserted-by":"crossref","award":["ECS_00000043"],"award-info":[{"award-number":["ECS_00000043"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100023234","name":"Oxford Health NHS Foundation Trust","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100023234","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000272","name":"National Institute for Health Research","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100000272","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100000269","name":"Economic and Social Research Council","doi-asserted-by":"publisher","award":["ES\/T008415\/1"],"award-info":[{"award-number":["ES\/T008415\/1"]}],"id":[{"id":"10.13039\/501100000269","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010269","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["207522"],"award-info":[{"award-number":["207522"]}],"id":[{"id":"10.13039\/100010269","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Keble Association"},{"DOI":"10.13039\/501100000769","name":"University of Oxford","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000769","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["BMJ Glob Health"],"accepted":{"date-parts":[[2023,10,1]]},"published-print":{"date-parts":[[2023,11]]},"abstract":"<jats:p>Routine surveys are used to understand the training quality and experiences of junior doctors but there are lack of tools designed to evaluate the training experiences of interns in low-income and middle-income countries (LMICs) where working conditions and resource constraints are challenging. We describe our process developing and validating a \u2018medical internship experience scale\u2019 to address this gap, work involving nine LMICs that varied in geographical locations, income-level and internship training models. We used a scoping review of existing tools, content validity discussions with target populations and an expert panel, back-and-forth translations into four language versions and cognitive interviews to develop and test the tool. Using data collected from 1646 interns and junior medical doctors, we assessed factor structure and assessed its reliability and validity. Fifty items about experiences of medical internship were retained from an initial pool of 102 items. These 50 items represent 6 major factors (constructs): (1) clinical learning and supervision, (2) patient safety, (3) job satisfaction, (4) stress and burnout, (5) mental well-being, and (6) fairness and discrimination. We reflect on the process of multicountry scale development and highlight some considerations for others who may use our scale, using preliminary analyses of the 1646 responses to illustrate that the tool may produce useful data to identify priorities for action. We suggest this tool could enable LMICs to assess key metrics regarding intern straining and initial work experiences and possibly allow comparison across countries and over time, to inform better internship planning and management.<\/jats:p>","DOI":"10.1136\/bmjgh-2023-013399","type":"journal-article","created":{"date-parts":[[2023,11,8]],"date-time":"2023-11-08T11:50:22Z","timestamp":1699444222000},"page":"e013399","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":4,"title":["Development and validation of a new measurement instrument to assess internship experience of medical doctors in low-income and middle-income countries"],"prefix":"10.1136","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4937-4703","authenticated-orcid":false,"given":"Yingxi","family":"Zhao","sequence":"first","affiliation":[{"name":"NDM Centre for Global Health Research, Nuffield Department of Medicine, University of Oxford, Oxford, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sulaiman","family":"Jalloh","sequence":"additional","affiliation":[{"name":"Ola During Children's Hospital, Freetown, Sierra Leone"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Phung Khanh","family":"Lam","sequence":"additional","affiliation":[{"name":"Oxford University Clinical Research Unit, Ho Chi Minh City, Viet Nam"},{"name":"University of Medicine and Pharmacy at Ho Chi Minh City, Ho Chi Minh City, Vietnam"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0555-9220","authenticated-orcid":false,"given":"Yakubu Kevin","family":"Kwarshak","sequence":"additional","affiliation":[{"name":"Department of Surgery, Division of Urology, Jos University Teaching Hospital, Jos, Plateau State, Nigeria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Mbuthia","sequence":"additional","affiliation":[{"name":"KEMRI-Wellcome Trust Research Programme, Nairobi, Kenya"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nadine","family":"Misago","sequence":"additional","affiliation":[{"name":"Interdisciplinary Research Group in Public Health \/ Doctoral School, University of Burundi, Bujumbura, Burundi"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mesulame","family":"Namedre","sequence":"additional","affiliation":[{"name":"Independent Researcher, Suva, Fiji"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nguy\u1ec5n Th\u1ecb B\u00e9","family":"Ph\u01b0\u01a1ng","sequence":"additional","affiliation":[{"name":"University of Medicine and Pharmacy at Ho Chi Minh City, Ho Chi Minh City, Vietnam"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sefanaia","family":"Qaloewa","sequence":"additional","affiliation":[{"name":"College of Medicine, Nursing and Health Sciences, Fiji National University, Suva, Fiji"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richard","family":"Summers","sequence":"additional","affiliation":[{"name":"School of Social Policy, University of Birmingham, Birmingham, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5444-186X","authenticated-orcid":false,"given":"Kun","family":"Tang","sequence":"additional","affiliation":[{"name":"Vanke School of Public Health, Tsinghua University, Beijing, People's Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Raymond","family":"Tweheyo","sequence":"additional","affiliation":[{"name":"Department of Health Policy Planning and Management, Makerere University School of Public Health, Kampala, Uganda"},{"name":"Centre for Health Systems Research and Development (CHSRD), The University of Free State, Bloemfontein, South Africa"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bridget","family":"Wills","sequence":"additional","affiliation":[{"name":"NDM Centre for Global Health Research, Nuffield Department of Medicine, University of Oxford, Oxford, UK"},{"name":"Oxford University Clinical Research Unit, Ho Chi Minh City, Viet Nam"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fang","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Endocrinology and Metabolism, Peking University People\u2019s Hospital, Beijing, People's Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Catia","family":"Nicodemo","sequence":"additional","affiliation":[{"name":"Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK"},{"name":"Department of Economics, Verona University, Verona, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Gathara","sequence":"additional","affiliation":[{"name":"KEMRI-Wellcome Trust Research Programme, Nairobi, Kenya"},{"name":"MARCH Centre, London School of Hygiene and Tropical Medicine, London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7427-0826","authenticated-orcid":false,"given":"Mike","family":"English","sequence":"additional","affiliation":[{"name":"NDM Centre for Global Health Research, Nuffield Department of Medicine, University of Oxford, Oxford, UK"},{"name":"KEMRI-Wellcome Trust Research Programme, Nairobi, Kenya"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[2023,11,8]]},"reference":[{"key":"2025073014353470000_8.11.e013399.1","doi-asserted-by":"crossref","DOI":"10.1136\/bmj.g2865","article-title":"\u201cModernising medical careers\u201d to \u201cshape of training\u201d\u2014How soon we forget","volume":"348","author":"Fuller","year":"2014","journal-title":"BMJ"},{"key":"2025073014353470000_8.11.e013399.2","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1186\/s12909-015-0463-6","article-title":"Perceptions of the preparedness of medical graduates for Internship responsibilities in district hospitals in Kenya: a qualitative study","volume":"15","author":"Muthaura","year":"2015","journal-title":"BMC Med Educ"},{"key":"2025073014353470000_8.11.e013399.3","doi-asserted-by":"publisher","DOI":"10.1001\/jama.279.15.1194"},{"key":"2025073014353470000_8.11.e013399.4","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0b013e31821d6ae2"},{"key":"2025073014353470000_8.11.e013399.5","doi-asserted-by":"publisher","DOI":"10.1186\/s12909-017-0931-2"},{"key":"2025073014353470000_8.11.e013399.6","doi-asserted-by":"publisher","DOI":"10.1186\/1472-6920-14-1"},{"key":"2025073014353470000_8.11.e013399.7","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2923.2009.03604.x"},{"key":"2025073014353470000_8.11.e013399.8","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0206840","article-title":"Burnout syndrome among medical residents: a systematic review and meta-analysis","volume":"13","author":"Rodrigues","year":"2018","journal-title":"PLoS One"},{"key":"2025073014353470000_8.11.e013399.9","doi-asserted-by":"crossref","first-page":"995","DOI":"10.1111\/imj.12785","article-title":"Understanding and reducing work-related psychological distress in interns: a systematic review","volume":"45","author":"Facey","year":"2015","journal-title":"Intern Med J"},{"key":"2025073014353470000_8.11.e013399.10","doi-asserted-by":"crossref","first-page":"535","DOI":"10.7196\/SAMJnew.7923","article-title":"The state of South African Internships: a national survey against HPCSA guidelines","volume":"105","author":"Bola","year":"2015","journal-title":"S Afr Med J"},{"key":"2025073014353470000_8.11.e013399.11","doi-asserted-by":"crossref","first-page":"2005458","DOI":"10.1080\/10872981.2021.2005458","article-title":"Transitional challenges faced by medical intern doctors (IDS) in Vanuatu: a qualitative study","volume":"27","author":"Sitobata","year":"2022","journal-title":"Med Educ Online"},{"key":"2025073014353470000_8.11.e013399.12","doi-asserted-by":"crossref","first-page":"655","DOI":"10.7196\/SAMJ.5987","article-title":"Slaves of the state-medical Internship and community service in South Africa","volume":"102","author":"Erasmus","year":"2012","journal-title":"S Afr Med J"},{"key":"2025073014353470000_8.11.e013399.13","unstructured":"GMC . UK general medical council national training surveys [Internet]. Available: https:\/\/www.gmc-uk.org\/education\/how-we-quality-assure\/national-training-surveys [Accessed 14 Sep 2020]."},{"key":"2025073014353470000_8.11.e013399.14","unstructured":"ACGME . Accreditation Council for graduate medical education resident\/fellow and faculty surveys [Internet]. Available: https:\/\/www.acgme.org\/Data-Collection-Systems\/Resident-Fellow-and-Faculty-Surveys [Accessed 14 Sep 2020]."},{"key":"2025073014353470000_8.11.e013399.15","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1186\/s12960-021-00554-7","article-title":"Tools for measuring medical Internship experience: a scoping review","volume":"19","author":"Zhao","year":"2021","journal-title":"Hum Resour Health"},{"key":"2025073014353470000_8.11.e013399.16","unstructured":"Ireland Medical Counci . Your Training Counts [Internet]. Available: https:\/\/www.medicalcouncil.ie\/news-and-publications\/reports\/your-training-counts-.html [Accessed 14 Sep 2020]."},{"key":"2025073014353470000_8.11.e013399.17","unstructured":"Essa ZI . Post-medical interns\u2019 reflections on medical Internships in South African state training hospitals [Internet] [Thesis]. Available: http:\/\/wiredspace.wits.ac.za\/handle\/10539\/9209 [Accessed 11 May 2021]."},{"key":"2025073014353470000_8.11.e013399.18","doi-asserted-by":"crossref","first-page":"149","DOI":"10.3389\/fpubh.2018.00149","article-title":"Best practices for developing and validating scales for health, social, and behavioral research: a primer","volume":"6","author":"Boateng","year":"2018","journal-title":"Front Public Health"},{"key":"2025073014353470000_8.11.e013399.19","unstructured":"World Health Organization . Translation and linguistic valuation protocol and supporting material [Internet]. n.d. Available: https:\/\/terrance.who.int\/mediacentre\/data\/WHODAS\/Guidelines\/WHODAS%202.0%20Translation%20guidelines.pdf"},{"key":"2025073014353470000_8.11.e013399.20","doi-asserted-by":"crossref","first-page":"982","DOI":"10.1093\/heapol\/czab048","article-title":"The devil is in the detail: reflections on the value and application of cognitive interviewing to strengthen quantitative surveys in global health","volume":"36","author":"Scott","year":"2021","journal-title":"Health Policy Plan"},{"key":"2025073014353470000_8.11.e013399.21","doi-asserted-by":"publisher","DOI":"10.4300\/JGME-D-13-00154.1"},{"key":"2025073014353470000_8.11.e013399.22","doi-asserted-by":"crossref","first-page":"221","DOI":"10.2307\/2987988","article-title":"The Guttman-Kaiser criterion as a predictor of the number of common factors","volume":"31","author":"Yeomans","year":"1982","journal-title":"The Statistician"},{"key":"2025073014353470000_8.11.e013399.23","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1007\/s10459-013-9458-4","article-title":"What counts as validity evidence? Examples and prevalence in a systematic review of simulation-based assessment","volume":"19","author":"Cook","year":"2014","journal-title":"Adv Health Sci Educ Theory Pract"},{"key":"2025073014353470000_8.11.e013399.24","doi-asserted-by":"publisher","DOI":"10.1080\/01421590500150874"},{"key":"2025073014353470000_8.11.e013399.25","doi-asserted-by":"crossref","DOI":"10.2307\/2136404","article-title":"A global measure of perceived stress","volume":"24","author":"Cohen","year":"1983","journal-title":"Journal of Health and Social Behavior"},{"key":"2025073014353470000_8.11.e013399.26","unstructured":"Center for Victims of Torture . Proqol measure. Available: https:\/\/www.proqol.org\/ProQol_Test.html [Accessed 21 Feb 2020]."},{"key":"2025073014353470000_8.11.e013399.27","doi-asserted-by":"crossref","unstructured":"Gerada C . How to improve Junior doctors\u2019 morale and wellbeing. BMJ 2016:352. doi:10.1136\/bmj.i1237 Available: https:\/\/www.jstor.org\/stable\/26941992","DOI":"10.1136\/bmj.i1237"},{"key":"2025073014353470000_8.11.e013399.28","doi-asserted-by":"crossref","first-page":"674","DOI":"10.4300\/JGME-D-15-00764.1","article-title":"Well-being in residency: a systematic review","volume":"8","author":"Raj","year":"2016","journal-title":"J Grad Med Educ"},{"key":"2025073014353470000_8.11.e013399.29","doi-asserted-by":"crossref","first-page":"203","DOI":"10.5267\/j.msl.2020.8.014","article-title":"Determinates of factors influencing job satisfaction and organizational loyalty","volume":"11","author":"Vuong","year":"2021","journal-title":"Manag Sci Lett"},{"key":"2025073014353470000_8.11.e013399.30","doi-asserted-by":"crossref","first-page":"946","DOI":"10.1016\/j.puhe.2012.12.017","article-title":"Improving job satisfaction of Chinese doctors: the positive effects of perceived organizational support and psychological capital","volume":"127","author":"Fu","year":"2013","journal-title":"Public Health"},{"key":"2025073014353470000_8.11.e013399.31","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2018-023823","article-title":"Cross-sectional survey on job satisfaction and its associated factors among doctors in tertiary public hospitals in Shanghai, China","volume":"9","author":"Liu","year":"2019","journal-title":"BMJ Open"},{"key":"2025073014353470000_8.11.e013399.32","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1186\/s12909-020-02339-3","article-title":"Doctors in Chinese public hospitals: demonstration of their professional identities","volume":"20","author":"Liang","year":"2020","journal-title":"BMC Med Educ"},{"key":"2025073014353470000_8.11.e013399.33","doi-asserted-by":"crossref","DOI":"10.1016\/S0140-6736(20)30003-9","article-title":"Protecting Chinese doctors","volume":"395","author":"Lancet","year":"2020","journal-title":"Lancet"},{"key":"2025073014353470000_8.11.e013399.34","doi-asserted-by":"publisher","DOI":"10.1186\/s12909-017-1115-9"},{"key":"2025073014353470000_8.11.e013399.35","doi-asserted-by":"publisher","DOI":"10.1177\/00131640121971518"}],"container-title":["BMJ Global Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/bmjgh-2023-013399","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T21:35:48Z","timestamp":1753911348000},"score":1,"resource":{"primary":{"URL":"https:\/\/gh.bmj.com\/lookup\/doi\/10.1136\/bmjgh-2023-013399"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11]]},"references-count":35,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2023,11,8]]},"published-print":{"date-parts":[[2023,11]]}},"alternative-id":["10.1136\/bmjgh-2023-013399"],"URL":"https:\/\/doi.org\/10.1136\/bmjgh-2023-013399","relation":{},"ISSN":["2059-7908"],"issn-type":[{"value":"2059-7908","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11]]}}}