{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T07:59:49Z","timestamp":1790668789972,"version":"4.1.0"},"reference-count":23,"publisher":"Wiley","license":[{"start":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T00:00:00Z","timestamp":1790640000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"},{"start":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T00:00:00Z","timestamp":1790640000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Eur J Dental Education"],"abstract":"<jats:title>ABSTRACT<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Aim<\/jats:title>\n                    <jats:p>To investigate the relationship between evaluator expertise and inter\u2010rater reliability during crown preparation assessment, as well as whether students' academic level affects performance outcomes.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>\n                      This research used a two\u2010phase design. Initially, it enrolled 92 third\u2010year and 90 fourth\u2010year students; after subjecting the cohorts to predetermined inclusion criteria, 85 students of each cohort were retained to be included in the study. In Phase 1, the third\u2010year students who prepared a metal ceramic crown on a typodont tooth were evaluated by two senior and two junior assessors using an analytic rubric that was validated on a 10\u2010point scale. In Phase 2, the fourth\u2010year students did the same task and it was only assessed by senior evaluators. The intraclass correlation coefficients (ICC) were used to analyse the inter\u2010rater reliability, and\n                      <jats:italic>t<\/jats:italic>\n                      \u2010tests were used to analyse differences in groups.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      In Phase 1 the reliability of all the evaluators was low (ICC\u2009=\u20090.035). Within this phase senior evaluators showed moderate reliability in the absence of formal calibration (average\u2010measure ICC\u2009=\u20090.634), and junior evaluators demonstrated systematic disagreement (ICC\u2009=\u2009\u22120.074). In Phase 2, senior evaluators demonstrated good\u2010to\u2010excellent agreement. Third\u2010 and fourth\u2010year performance did not differ significantly (mean difference\u2009=\u20090.28;\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.255;\n                      <jats:italic>d<\/jats:italic>\n                      \u2009=\u20090.18).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Within Phase 1, inter\u2010rater reliability differed descriptively between evaluator groups, with senior evaluators demonstrating more consistent scoring patterns than junior evaluators in the absence of formal calibration. There was no statistically significant difference observed in academic levels in this cohort.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1111\/eje.70317","type":"journal-article","created":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T07:53:33Z","timestamp":1790668413000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Influence of Evaluator Expertise on Inter\u2010Rater Reliability in Crown Preparation Assessment Without Formal Calibration"],"prefix":"10.1111","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7629-877X","authenticated-orcid":false,"given":"Eanas I.","family":"Jellil","sequence":"first","affiliation":[{"name":"Conservative Dentistry Department College of Dentistry, Mustansiriyah University  Baghdad Iraq"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5182-7417","authenticated-orcid":false,"given":"Mustafa N.","family":"Abdulghani","sequence":"additional","affiliation":[{"name":"Conservative Dentistry Department College of Dentistry, Mustansiriyah University  Baghdad Iraq"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7827-910X","authenticated-orcid":false,"given":"Sundus H.","family":"Naser","sequence":"additional","affiliation":[{"name":"Conservative Dentistry Department College of Dentistry, Mustansiriyah University  Baghdad Iraq"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4009-6732","authenticated-orcid":false,"given":"Amer A.","family":"Mohammed","sequence":"additional","affiliation":[{"name":"Conservative Dentistry Department College of Dentistry, Mustansiriyah University  Baghdad Iraq"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3464-8414","authenticated-orcid":false,"given":"Farah Nabeel","family":"AlKhayyat","sequence":"additional","affiliation":[{"name":"Prosthodontics Department College of Dentistry, Mustansiriyah University  Baghdad Iraq"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2026,9,29]]},"reference":[{"key":"e_1_2_9_2_1","doi-asserted-by":"crossref","first-page":"903","DOI":"10.2147\/AMEP.S522300","article-title":"The Technical Quality of Preclinical Tooth Preparation by Undergraduate Dental Students","volume":"16","author":"Almohefer S. A.","year":"2025","journal-title":"Advances in Medical Education and Practice"},{"issue":"9","key":"e_1_2_9_3_1","doi-asserted-by":"crossref","first-page":"1163","DOI":"10.1002\/j.0022-0337.2011.75.9.tb05160.x","article-title":"Rubrics 101: A Primer for Rubric Development in Dental Education","volume":"75","author":"O'Donnell J. A.","year":"2011","journal-title":"Journal of Dental Education"},{"issue":"4","key":"e_1_2_9_4_1","doi-asserted-by":"crossref","first-page":"438","DOI":"10.4103\/ijdr.ijdr_308_24","article-title":"Effectiveness of Using Analytical Grading Method for Crown Preparation Performed by Dental Students: An In\u00a0Vitro Study","volume":"35","author":"Abdulghani M. N.","year":"2024","journal-title":"Indian Journal of Dental Research"},{"issue":"1","key":"e_1_2_9_5_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/jedm.12000","article-title":"Validating the Interpretations and Uses of Test Scores","volume":"50","author":"Kane M. T.","year":"2013","journal-title":"Journal of Educational Measurement"},{"issue":"9","key":"e_1_2_9_6_1","doi-asserted-by":"crossref","first-page":"1006","DOI":"10.1111\/j.1365-2929.2004.01932.x","article-title":"Reliability: On the Reproducibility of Assessment Data","volume":"38","author":"Downing S. M.","year":"2004","journal-title":"Medical Education"},{"issue":"7","key":"e_1_2_9_7_1","doi-asserted-by":"crossref","first-page":"636","DOI":"10.1111\/jopr.12558","article-title":"Effects of Evaluator Fatigue and Level of Expertise on the Global and Analytical Evaluation of Preclinical Tooth Preparation","volume":"27","author":"Al Amri M. D.","year":"2018","journal-title":"Journal of Prosthodontics"},{"issue":"3","key":"e_1_2_9_8_1","doi-asserted-by":"crossref","first-page":"129","DOI":"10.4103\/ijabmr.ijabmr_382_23","article-title":"Validity and Reliability of Students' Assessment: Case for Recognition as a Unified Concept of Valid Reliability","volume":"13","author":"Gupta K.","year":"2023","journal-title":"International Journal of Applied & Basic Medical Research"},{"key":"e_1_2_9_9_1","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4757-3456-0","volume-title":"Generalizability Theory","author":"Brennan R. L.","year":"2001"},{"issue":"2","key":"e_1_2_9_10_1","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1007\/s10459-006-9043-1","article-title":"Broadening Perspectives on Clinical Performance Assessment: Rater Cognition","volume":"12","author":"Govaerts M. J.","year":"2007","journal-title":"Advances in Health Sciences Education: Theory and Practice"},{"issue":"1","key":"e_1_2_9_11_1","doi-asserted-by":"crossref","first-page":"1057","DOI":"10.1186\/s12909-025-07512-0","article-title":"A Comparative Study of Student Performance in All\u2010Ceramic Crown Preparation by Clinical\u2010Phase Students","volume":"25","author":"Alshehri A. H.","year":"2025","journal-title":"BMC Medical Education"},{"issue":"1","key":"e_1_2_9_12_1","doi-asserted-by":"crossref","first-page":"1174","DOI":"10.1186\/s12909-025-07732-4","article-title":"Inter\u2010Rater Reliability of Global and Analytic Assessment of Prosthodontic Procedures","volume":"25","author":"Baik K. M.","year":"2025","journal-title":"BMC Medical Education"},{"issue":"6","key":"e_1_2_9_13_1","doi-asserted-by":"crossref","first-page":"714","DOI":"10.1002\/jdd.12890","article-title":"Attitudes and Satisfaction of Dental Faculty Toward Calibration: A Cross\u2010Sectional Study","volume":"86","author":"Tabassum A.","year":"2022","journal-title":"Journal of Dental Education"},{"key":"e_1_2_9_14_1","first-page":"142","volume-title":"Fundamentals of Fixed Prosthodontics","author":"Shillingburg H. T.","year":"1997"},{"key":"e_1_2_9_15_1","first-page":"272","volume-title":"Contemporary Fixed Prosthodontics","author":"Rosenstiel S. F.","year":"2006"},{"issue":"3","key":"e_1_2_9_16_1","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1034\/j.1600-0579.6.s3.8.x","article-title":"Evolving Methods of Assessment","volume":"6","author":"Manogue M.","year":"2002","journal-title":"European Journal of Dental Education"},{"issue":"1","key":"e_1_2_9_17_1","first-page":"e12","article-title":"Rubric System for Evaluation of Crown Preparation Performed by Dental Students","volume":"22","author":"Habib S. R.","year":"2018","journal-title":"European Journal of Dental Education"},{"issue":"4","key":"e_1_2_9_18_1","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0318752","article-title":"Using an Analytic Rubric System for the Evaluation of Anterior Ceramic Crown Preparation Performed by Preclinical Dental Students","volume":"20","author":"Al Moaleem M. M.","year":"2025","journal-title":"PLoS One"},{"issue":"3","key":"e_1_2_9_19_1","doi-asserted-by":"crossref","first-page":"1406","DOI":"10.54361\/ajmas.258322","article-title":"Assessment of Agreement Among Evaluators in Scoring of Preclinical Full Metal Crown Preparation Using Global and Analytical Evaluation Methods","volume":"8","author":"Misurati N.","year":"2025","journal-title":"Alqalam Journal of Medical and Applied Sciences"},{"issue":"2","key":"e_1_2_9_20_1","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","article-title":"A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research","volume":"15","author":"Koo T. K.","year":"2016","journal-title":"Journal of Chiropractic Medicine"},{"key":"e_1_2_9_21_1","doi-asserted-by":"crossref","DOI":"10.1016\/j.nedt.2021.104885","article-title":"The Validity and Reliability of Clinical Judgement and Decision\u2010Making Skills Assessment in Nursing: A Systematic Literature Review","volume":"102","author":"Clemett V.","year":"2021","journal-title":"Nurse Education Today"},{"key":"e_1_2_9_22_1","doi-asserted-by":"crossref","first-page":"649","DOI":"10.2147\/AMEP.S460140","article-title":"The Effect of Student Experience and Tooth Location on Finish Line Width and Angle of Full Metal Crown Preparations in Preclinical Setting","volume":"15","author":"Munshi N.","year":"2024","journal-title":"Advances in Medical Education and Practice"},{"issue":"2","key":"e_1_2_9_23_1","doi-asserted-by":"crossref","first-page":"169","DOI":"10.69667\/amj.25218","article-title":"Learning Curve Analysis of Preclinical All\u2010Ceramic Crown Preparation Among Second\u2010Year Undergraduate Dental Students","volume":"2","author":"Mhanni A.","year":"2025","journal-title":"Attahadi Medical Journal"},{"issue":"11","key":"e_1_2_9_24_1","first-page":"ZC35","article-title":"An Evaluation on Full Coverage Crown Preparation: An Institutional Analysis","volume":"14","author":"Rashid N. R. B. M.","year":"2020","journal-title":"Journal of Clinical and Diagnostic Research"}],"container-title":["European Journal of Dental Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/eje.70317","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/eje.70317","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/eje.70317","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T07:53:36Z","timestamp":1790668416000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/eje.70317"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,29]]},"references-count":23,"alternative-id":["10.1111\/eje.70317"],"URL":"https:\/\/doi.org\/10.1111\/eje.70317","archive":["Portico"],"relation":{},"ISSN":["1396-5883","1600-0579"],"issn-type":[{"value":"1396-5883","type":"print"},{"value":"1600-0579","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,29]]},"assertion":[{"value":"2026-02-23","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-09-21","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-09-29","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"eje.70317"}}