{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T23:31:56Z","timestamp":1781652716000,"version":"3.54.5"},"reference-count":40,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2021,11,23]],"date-time":"2021-11-23T00:00:00Z","timestamp":1637625600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the General Directorate of Health of the Canton of Vaud","award":["Grant N\u00b0 8273\/3636000000-801"],"award-info":[{"award-number":["Grant N\u00b0 8273\/3636000000-801"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJERPH"],"abstract":"<jats:p>Background: We aimed to assess the validity (criterion and cross-cultural validity) and reliability of the first occupational burnout (OB) detection tool designed for healthcare professionals in Belgium in the context of Swiss medical practice. Methods: First, we assessed the sensitivity and specificity of the Tool. We developed this tool based on the consultation reports of 42 patients and compared its detection to the results of the Oldenburg Burnout Inventory (OLBI), filled-in by patients before a consultation. Second, we performed an inter-rater reliability (IRR) assessment on the OB symptoms and detection reached by the Tool between a psychiatrist, two psychologists, and an occupational physician. Results: The Tool correctly identified over 80% of patients with OB, regardless of the cutoff value used for OLBI scores, reflecting its high sensitivity. Conversely, its specificity strongly varied depending on the OLBI cutoff. There was a slight to fair overall agreement between the four raters on the detection of OB and the number of OB symptoms. Around 41% of symptoms showed a substantial to an almost perfect agreement, and 36% showed a slight to a moderate agreement. Conclusions: The Tool seems useful for identifying OB of moderate and strong severity in both the Belgian and Swiss contexts.<\/jats:p>","DOI":"10.3390\/ijerph182312300","type":"journal-article","created":{"date-parts":[[2021,11,24]],"date-time":"2021-11-24T02:46:08Z","timestamp":1637721968000},"page":"12300","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Diagnostic Performances of an Occupational Burnout Detection Method Designed for Healthcare Professionals"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9026-0011","authenticated-orcid":false,"given":"Agathe","family":"Nguyen Huynh","sequence":"first","affiliation":[{"name":"Center for Primary Care and Public Health (Unisant\u00e9), Department of Occupational and Environmental Health, University of Lausanne, 1066 Lausanne, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1183-8020","authenticated-orcid":false,"given":"Christine","family":"Besse","sequence":"additional","affiliation":[{"name":"Medical Direction of the Department of Psychiatry, CHUV, Les C\u00e8dres (Cery), 1008 Prilly, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zakia","family":"Mediouni","sequence":"additional","affiliation":[{"name":"Center for Primary Care and Public Health (Unisant\u00e9), Department of Occupational and Environmental Health, University of Lausanne, 1066 Lausanne, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emna","family":"El May","sequence":"additional","affiliation":[{"name":"Center for Primary Care and Public Health (Unisant\u00e9), Department of Occupational and Environmental Health, University of Lausanne, 1066 Lausanne, Switzerland"},{"name":"Faculty of Psychology and Educational Sciences, University of Geneva, 1205 Geneva, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5331-4535","authenticated-orcid":false,"given":"Yara","family":"Shoman","sequence":"additional","affiliation":[{"name":"Center for Primary Care and Public Health (Unisant\u00e9), Department of Occupational and Environmental Health, University of Lausanne, 1066 Lausanne, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Isabelle","family":"Hansez","sequence":"additional","affiliation":[{"name":"Unit of Promotion of Human Resources, Faculty of Psychology, Speech Therapy and Educational Sciences, University of Li\u00e8ge, 4000 Li\u00e8ge, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Irina","family":"Guseva Canu","sequence":"additional","affiliation":[{"name":"Center for Primary Care and Public Health (Unisant\u00e9), Department of Occupational and Environmental Health, University of Lausanne, 1066 Lausanne, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"95","DOI":"10.5271\/sjweh.3935","article-title":"Harmonized definition of occupational burnout: A systematic review, semantic analysis, and Delphi consensus in 29 countries","volume":"47","author":"Marca","year":"2021","journal-title":"Scand. J. Work. Environ. Health"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1131","DOI":"10.1001\/jama.2018.12777","article-title":"Prevalence of burnout among physicians: A systematic review","volume":"320","author":"Rotenstein","year":"2018","journal-title":"J. Am. Med. Assoc."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"624","DOI":"10.1037\/0735-7028.19.6.624","article-title":"Burnout among licensed psychologists","volume":"19","author":"Ackerley","year":"1988","journal-title":"Prof. Psychol. Res. Pract."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"499","DOI":"10.1037\/0021-9010.86.3.499","article-title":"The job demands-resources model of burnout","volume":"86","author":"Demerouti","year":"2001","journal-title":"J. Appl. Psychol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1080\/02678370500297720","article-title":"The Copenhagen burnout inventory: A new tool for the assessment of burnout","volume":"19","author":"Kristensen","year":"2005","journal-title":"Work Stress"},{"key":"ref_6","unstructured":"Maslach, C., Jackson, S.E., and Leiter, M.P. (1996). Maslach Burnout Inventory Manual, CPP, Inc. [3rd ed.]."},{"key":"ref_7","unstructured":"Pines, A., and Aronson, E. (1981). Burnout: From Tedium to Personal Growth, Freedom Press."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Marca, S.C., Paatz, P., Gy\u00f6rk\u00f6s, C., Cuneo, F., Bugge, M.D., Godderis, L., Bianchi, R., and Canu, I.G. (2020). Validation of questionnaires and rating scales used in medicine: Protocol for a systematic review of burnout self-reported measures. medRxiv.","DOI":"10.1101\/2020.06.24.20138115"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"737","DOI":"10.1016\/j.jclinepi.2010.02.006","article-title":"The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes","volume":"63","author":"Mokkink","year":"2010","journal-title":"J. Clin. Epidemiol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"E8","DOI":"10.1017\/S2045796020001134","article-title":"Psychometric properties of burnout measures: A systematic review","volume":"30","author":"Shoman","year":"2021","journal-title":"Epidemiol. Psychiatr. Sci."},{"key":"ref_11","unstructured":"Service Public F\u00e9d\u00e9ral (2020). D\u00e9tection Pr\u00e9coce du Burnout: Outil Pour le M\u00e9decin G\u00e9n\u00e9raliste Burnout (Early Detection of Burnout: BPSEWS Tool for the General Physician), Available online: https:\/\/www.souffrance-et-travail.com\/magazine\/burn-out\/outil-de-detection-precoce-du-burn-out\/."},{"key":"ref_12","unstructured":"Hansez, I., Mairiaux, P., Firket, P., and Braeckman, L. (2010). Recherche sur le Burnout au Sein de la Population Active Belge: Rapport Final (Research on Burnout in the Active Belgian Population: Final Report), Available online: https:\/\/orbi.uliege.be\/handle\/2268\/90274."},{"key":"ref_13","unstructured":"Hansez, I., Rusu, D., Firket, P., and Braeckman, L. (2019). Evolution 2010\u20132018 du Burnout en Belgique et Int\u00e9r\u00eat de L\u2019utilisation Conjointe de Deux Outils de Diagnostic (Evolution 2010\u20132018 of Burnout in Belgium and the Benefit of a Joined Usage of Two Diagnostic BPSEWS Tools), Available online: https:\/\/emploi.belgique.be\/sites\/default\/files\/content\/documents\/Bien-%C3%AAtre%20au%20travail\/Projets%20de%20recherche\/rapport_final_SPF_burnout.pdf."},{"key":"ref_14","unstructured":"Service Public F\u00e9d\u00e9ral (2020, February 10). Projets Pilote Pr\u00e9vention Int\u00e9gr\u00e9e Contre le Burnout (Pilot Projects for an Integrated Prevention of Burnout). Available online: https:\/\/socialsecurity.belgium.be\/fr\/elaboration-de-la-politique-sociale\/projets-pilote-prevention-integree-contre-le-burn-out."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1080\/02678370500385913","article-title":"The conceptualization and measurement of burnout: Common ground and worlds apart The views expressed in Work & Stress Commentaries are those of the author(s), and do not necessarily represent those of any other person or organization, or of the journal","volume":"19","author":"Schaufeli","year":"2005","journal-title":"Work Stress"},{"key":"ref_16","unstructured":"Hansez, I., Firket, P., and Leclercq, C. (2019, December 12). Stades du Burnout et le Type de Pr\u00e9vention Appropri\u00e9 Selon le Stade. \u201cBurnout: Les Clefs Pour Agir\u201d. Available online: https:\/\/www.health.belgium.be\/fr\/stades-du-burnout-et-le-type-de-prevention-approprie-selon-le-stade."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Leclercq, C., Braeckman, L., Firket, P., Babic, A., and Hansez, I. (2021). Interest of a joint use of two diagnostic tools of burnout: Comparison between the Oldenburg burnout inventory and the early detection tool of burnout completed by physicians. Int. J. Environ. Res. Public Health, 18.","DOI":"10.3390\/ijerph181910544"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"e15588","DOI":"10.2196\/15588","article-title":"Benefits and disadvantages of electronic patient-reported outcome measures: Systematic review","volume":"3","author":"Meirte","year":"2020","journal-title":"JMIR Perioper. Med."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Turner, G.M., Litchfield, I., Finnikin, S., Aiyegbusi, O.L., and Calvert, M. (2020). General practitioners\u2019 views on use of patient reported outcome measures in primary care: A cross-sectional survey and qualitative study. BMC Fam. Pract., 21.","DOI":"10.1186\/s12875-019-1077-6"},{"key":"ref_20","first-page":"221","article-title":"Detection and treatment of burnout by physicians of Unisant\u00e9","volume":"27","author":"Krief","year":"2021","journal-title":"Revue M\u00e9dicale Suisse"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"276","DOI":"10.53738\/REVMED.2016.12.504.0276","article-title":"Consultation pluridisciplinaire \u201csouffrance au travail\u201d: Une expr\u00e9rience romande (Multidisciplinary consultation \u201csuffering at work\u201d: An french-speaking Swiss experience)","volume":"12","author":"Besse","year":"2016","journal-title":"Revue M\u00e9dicale Suisse"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Bouter, L., Zielhuis, G., and Zeegers, M. (2017). Diagnostic and prognostic research. Textbook of Epidemiology, Vrije Universiteit Amsterdam.","DOI":"10.1007\/978-90-368-1741-7"},{"key":"ref_23","first-page":"1","article-title":"Calculating sensitivity, specificity and predictive values for medical diagnostic tests","volume":"5","author":"Nahavandi","year":"2018","journal-title":"Gene Cell Tissue"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1136\/eb-2012-100645","article-title":"Principles for high-quality, high-value testing","volume":"18","author":"Power","year":"2013","journal-title":"BMJ Evid. Based Med."},{"key":"ref_25","unstructured":"StataCorp (2019). Stata Statistical Software: Release 16, StataCorp LLC."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1177\/001316446002000104","article-title":"A coefficient of agreement for nominal scales","volume":"20","author":"Cohen","year":"1960","journal-title":"Educ. Psychol. Meas."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1037\/h0031643","article-title":"Measures of response agreement for qualitative data: Some generalizations and alternatives","volume":"76","author":"Light","year":"1971","journal-title":"Psychol. Bull."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"23","DOI":"10.20982\/tqmp.08.1.p023","article-title":"Computing inter-rater reliability for observational data: An overview and tutorial","volume":"8","author":"Hallgren","year":"2012","journal-title":"Tutor. Quant. Methods Psychol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1016\/0895-4356(93)90018-V","article-title":"Bias, prevalence and kappa","volume":"46","author":"Byrt","year":"1993","journal-title":"J. Clin. Epidemiol."},{"key":"ref_30","unstructured":"Siegel, S., and Castellan, N.J. (1988). Non Parametric Statistics for the Behavioral Sciences, McGraw-Hill Book Company."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data","volume":"33","author":"Landis","year":"1977","journal-title":"Biometrics"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1037\/1082-989X.1.1.30","article-title":"Forming inferences about some intraclass correlation coefficients","volume":"1","author":"McGraw","year":"1996","journal-title":"Psychol. Methods"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1037\/1040-3590.6.4.284","article-title":"Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology","volume":"6","author":"Cicchetti","year":"1994","journal-title":"Psychol. Assess."},{"key":"ref_34","unstructured":"Team, R.D.C. (2019). R: A Language Environment for Statistical Computing, R Foundation for Statistical Computing."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1002\/job.4030090402","article-title":"The impact of interpersonal environment on burnout and organizational commitment","volume":"9","author":"Leiter","year":"1988","journal-title":"J. Organ. Behav."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.burn.2015.12.002","article-title":"The person-oriented approach to burnout: A systematic review","volume":"3","author":"Kinnunen","year":"2016","journal-title":"Burn. Res."},{"key":"ref_37","unstructured":"World Health Organization (2010). International Classification of Diseases for Mortality and Morbidity Statistics the Tenth Revision, WHO."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Schaufeli, W.B., Desart, S., and De Witte, H. (2020). Burnout assessment tool (BAT)-development, validity, and reliability. Int. J. Environ. Res. Public Health, 17.","DOI":"10.3390\/ijerph17249495"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.cpr.2015.01.004","article-title":"Burnout\u2013depression overlap: A review","volume":"36","author":"Bianchi","year":"2015","journal-title":"Clin. Psychol. Rev."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"745","DOI":"10.2486\/indhealth.2018-0159","article-title":"Burnout syndrome in Europe: Towards a harmonized approach in occupational health practice and research","volume":"57","author":"Mesot","year":"2019","journal-title":"Ind. Health"}],"container-title":["International Journal of Environmental Research and Public Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1660-4601\/18\/23\/12300\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:34:41Z","timestamp":1760168081000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1660-4601\/18\/23\/12300"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,23]]},"references-count":40,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["ijerph182312300"],"URL":"https:\/\/doi.org\/10.3390\/ijerph182312300","relation":{},"ISSN":["1660-4601"],"issn-type":[{"value":"1660-4601","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,23]]}}}