{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,4]],"date-time":"2026-11-04T11:29:50Z","timestamp":1793791790675,"version":"4.6.1"},"reference-count":22,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,9,28]],"date-time":"2026-09-28T00:00:00Z","timestamp":1790553600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,9,28]],"date-time":"2026-09-28T00:00:00Z","timestamp":1790553600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BDJ Open"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>High-quality single-best-answer (SBA) questions require appropriate construction, alignment with intended learning outcomes, absence of technical item flaws and psychometric evaluation. Dentistry-specific evidence linking these constructional features to item performance remains limited. This study analysed Dental Materials responses from DentTest, an online undergraduate dentistry question bank, to identify item characteristics associated with higher discrimination.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>A retrospective learning-analytics item analysis was performed using first-attempt response data. At extraction, 134 users were eligible, of whom 76 provided research consent (56.7%). The dataset contained 44,964 user\u00d7item observations from 76 users across 1560 Dental Materials items. Primary analyses were restricted to 691 items with \u226530 unique first-attempt users. Analyses included item psychometric parameters (facility, discrimination index, number of functioning distractors and distractor entropy) and selected constructional features (option-length cueing, stem word count and negative-stem wording).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Discrimination index was inversely correlated with facility (\n                      <jats:italic>r<\/jats:italic>\n                      \u2009=\u2009\u22120.471; 95% CI \u20130.527 to \u20130.411). In the multivariable quadratic model, the estimated peak discrimination occurred at\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.578, consistent with an inverted-U relationship between facility and discrimination. Functioning distractors (\n                      <jats:italic>r<\/jats:italic>\n                      \u2009=\u20090.531; 95% CI 0.475\u20130.582) and distractor entropy (\n                      <jats:italic>r<\/jats:italic>\n                      \u2009=\u20090.471; 95% CI 0.411\u20130.527) were positively associated with discrimination index. However, split-half stability was low (\n                      <jats:italic>r<\/jats:italic>\n                      \u2009=\u20090.15), with 542\/691 items (78.4%) changing discrimination band at least once across repeated splits.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>In this formative dentistry question bank, Dental Materials SBAs with higher discrimination were associated with moderate facility, stronger distractor functioning and more informative distractor-choice patterns. Item analytics should be viewed as an early-warning system rather than a final judgement, guiding educators towards items that require revision.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1038\/s41405-026-00481-6","type":"journal-article","created":{"date-parts":[[2026,9,28]],"date-time":"2026-09-28T13:43:15Z","timestamp":1790602995000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Evaluating single-best-answer questions in dental materials education: a retrospective item analysis from an online undergraduate dentistry question bank"],"prefix":"10.1038","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-5787-6649","authenticated-orcid":false,"given":"Oliver","family":"Vij","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alannah","family":"Herbert","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joshua","family":"Penning-Lambert","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tyler","family":"Longbone","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sanjukta","family":"Deb","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,9,28]]},"reference":[{"key":"481_CR1","doi-asserted-by":"publisher","DOI":"10.1186\/s12909-024-05517-9","volume":"24","author":"J Fisher","year":"2024","unstructured":"Fisher J, Leahy D, Lim JJ, Astles E, Salvatore J, Thomson R. Question banks: credit? Or debit? A qualitative exploration of their use among medical students. BMC Med Educ. 2024;24:569. https:\/\/doi.org\/10.1186\/s12909-024-05517-9.","journal-title":"BMC Med Educ"},{"key":"481_CR2","doi-asserted-by":"publisher","DOI":"10.1186\/s12909-019-1462-9","volume":"19","author":"L Wynter","year":"2019","unstructured":"Wynter L, Burgess A, Kalman E, Heron JE, Bleasel J. Medical students: what educational resources are they using? BMC Med Educ. 2019;19:36. https:\/\/doi.org\/10.1186\/s12909-019-1462-9.","journal-title":"BMC Med Educ"},{"key":"481_CR3","unstructured":"Billings MS, DeRuchie K, Go S, Hussie K, Kulesher A, Merrell J, et al. Constructing Written Test Questions for the Health Sciences [Internet]. National Board of Medical Examiners (NBME). 2024. https:\/\/www.nbme.org\/sites\/default\/files\/2021-02\/NBME_Item%20Writing%20Guide_R_6.pdf"},{"key":"481_CR4","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1207\/S15324818AME1503_5","volume":"15","author":"T Haladyna","year":"2002","unstructured":"Haladyna T, Downing S, Rodriguez M. A review of multiple-choice item-writing guidelines for classroom assessment. Appl Meas Educ. 2002;15:309\u201333. https:\/\/doi.org\/10.1207\/S15324818AME1503_5.","journal-title":"Appl Meas Educ"},{"key":"481_CR5","doi-asserted-by":"publisher","unstructured":"Tarrant M, Ware J, Mohammed AM An assessment of functioning and non-functioning distractors in multiple-choice questions: a descriptive analysis. BMC Med Educ. 2009;9. https:\/\/doi.org\/10.1186\/1472-6920-9-40 .","DOI":"10.1186\/1472-6920-9-40"},{"key":"481_CR6","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1037\/h0057123","volume":"30","author":"TL Kelley","year":"1939","unstructured":"Kelley TL. The selection of upper and lower groups for the validation of test items. J Educ Psychol. 1939;30:17\u201324. https:\/\/doi.org\/10.1037\/h0057123.","journal-title":"J Educ Psychol"},{"key":"481_CR7","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1007\/s10459-018-9855-9","volume":"24","author":"M Raymond","year":"2019","unstructured":"Raymond M, Stevens C, Bucak S. The optimal number of options for multiple-choice questions on high-stakes tests: application of a revised index for detecting nonfunctional distractors. Adv Health Sci Educ Theory Pr. 2019;24:141\u201350. https:\/\/doi.org\/10.1007\/s10459-018-9855-9.","journal-title":"Adv Health Sci Educ Theory Pr"},{"key":"481_CR8","doi-asserted-by":"publisher","unstructured":"Mustafa S, Hamid OE Psychometric item\/question analysis of multiple-choice questions in fixed prosthodontics exam. BMC Med Educ. 2025 Dec;26. https:\/\/doi.org\/10.1186\/s12909-025-08429-4.","DOI":"10.1186\/s12909-025-08429-4"},{"key":"481_CR9","unstructured":"Shannon C, Weaver W The mathematical theory of communication, Univ. of Illinois. Urbana. 1949."},{"key":"481_CR10","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1007\/s40037-016-0322-0","volume":"6","author":"M Young","year":"2017","unstructured":"Young M, Cummings BA, St-Onge C. Ensuring the quality of multiple-choice exams administered to small cohorts: a cautionary tale. Perspect Med Educ. 2017;6:21\u20138. https:\/\/doi.org\/10.1007\/s40037-016-0322-0.","journal-title":"Perspect Med Educ"},{"key":"481_CR11","doi-asserted-by":"publisher","first-page":"67","DOI":"10.47102\/annals-acadmedsg.V35N2p67","volume":"35","author":"SM Sim","year":"2006","unstructured":"Sim SM, Rasiah RI. Relationship between item difficulty and discrimination indices in true\/false-type multiple choice questions of a para-clinical multidisciplinary paper. Ann Acad Med Singap. 2006;35:67\u201371. https:\/\/doi.org\/10.47102\/annals-acadmedsg.V35N2p67.","journal-title":"Ann Acad Med Singap"},{"key":"481_CR12","doi-asserted-by":"publisher","first-page":"e68","DOI":"10.18295\/squmj.2018.18.01.011","volume":"18","author":"D Kheyami","year":"2018","unstructured":"Kheyami D, Jaradat A, Al-Shibani T, Ali FA. Item Analysis of Multiple Choice Questions at the Department of Paediatrics, Arabian Gulf University, Manama, Bahrain. Sultan Qaboos Univ Med J. 2018;18:e68\u201374. https:\/\/doi.org\/10.18295\/squmj.2018.18.01.011.","journal-title":"Sultan Qaboos Univ Med J"},{"key":"481_CR13","first-page":"142","volume":"62","author":"MR Hingorjo","year":"2012","unstructured":"Hingorjo MR, Jaleel F. Analysis of one-best MCQs: the difficulty index, discrimination index and distractor efficiency. J Pak Med Assoc. 2012;62:142\u20137.","journal-title":"J Pak Med Assoc"},{"key":"481_CR14","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1111\/j.1745-3992.2005.00006.x","volume":"24","author":"M Rodriguez","year":"2005","unstructured":"Rodriguez M. Three options are optimal for multiple-choice items: a meta-analysis of 80 years of research. Educ Meas Issues Pr. 2005;24:3\u201313. https:\/\/doi.org\/10.1111\/j.1745-3992.2005.00006.x.","journal-title":"Educ Meas Issues Pr"},{"key":"481_CR15","doi-asserted-by":"publisher","first-page":"571","DOI":"10.1007\/s10459-015-9652-7","volume":"21","author":"JM Kilgour","year":"2016","unstructured":"Kilgour JM, Tayyaba S. An investigation into the optimal number of distractors in single-best answer exams. Adv Health Sci Educ. 2016;21:571\u201385. https:\/\/doi.org\/10.1007\/s10459-015-9652-7.","journal-title":"Adv Health Sci Educ"},{"key":"481_CR16","doi-asserted-by":"publisher","first-page":"825","DOI":"10.3389\/fpsyg.2019.00825","volume":"10","author":"J Shin","year":"2019","unstructured":"Shin J, Guo Q, Gierl MJ. Multiple-choice item distractor development using topic modeling approaches. Front Psychol. 2019;10:825. https:\/\/doi.org\/10.3389\/fpsyg.2019.00825.","journal-title":"Front Psychol"},{"key":"481_CR17","doi-asserted-by":"publisher","first-page":"1082","DOI":"10.3102\/0034654317726529","volume":"87","author":"MJ Gierl","year":"2017","unstructured":"Gierl MJ, Bulut O, Guo Q, Zhang X. Developing, analyzing, and using distractors for multiple-choice tests in education: a comprehensive review. Rev Educ Res. 2017;87:1082\u2013116. https:\/\/doi.org\/10.3102\/0034654317726529.","journal-title":"Rev Educ Res"},{"key":"481_CR18","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1007\/s10459-004-4019-5","volume":"10","author":"S Downing","year":"2005","unstructured":"Downing S. The effects of violating standard item writing principles on tests and students: the consequences of using flawed test items on achievement examinations in medical education. Adv Health Sci Educ Theory Pr. 2005;10:133\u201343. https:\/\/doi.org\/10.1007\/s10459-004-4019-5.","journal-title":"Adv Health Sci Educ Theory Pr"},{"key":"481_CR19","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1111\/j.1365-2923.2009.03425.x","volume":"44","author":"AF De Champlain","year":"2010","unstructured":"De Champlain AF. A primer on classical test theory and item response theory for assessments in medical education. Med Educ. 2010;44:109\u201317. https:\/\/doi.org\/10.1111\/j.1365-2923.2009.03425.x.","journal-title":"Med Educ"},{"key":"481_CR20","doi-asserted-by":"publisher","first-page":"739","DOI":"10.1046\/j.1365-2923.2003.01587.x","volume":"37","author":"S Downing","year":"2003","unstructured":"Downing S. Item response theory: applications of modern test theory in medical education. Med Educ. 2003;37:739\u201345. https:\/\/doi.org\/10.1046\/j.1365-2923.2003.01587.x.","journal-title":"Med Educ"},{"key":"481_CR21","doi-asserted-by":"publisher","first-page":"830","DOI":"10.1046\/j.1365-2923.2003.01594.x","volume":"37","author":"S Downing","year":"2003","unstructured":"Downing S. Validity: on the meaningful interpretation of assessment data. Med Educ. 2003;37:830\u20137. https:\/\/doi.org\/10.1046\/j.1365-2923.2003.01594.x.","journal-title":"Med Educ"},{"key":"481_CR22","doi-asserted-by":"publisher","first-page":"166.e7","DOI":"10.1016\/j.amjmed.2005.10.036","volume":"119","author":"DA Cook","year":"2006","unstructured":"Cook DA, Beckman TJ. Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med. 2006;119:166.e7\u2013166.e16. https:\/\/doi.org\/10.1016\/j.amjmed.2005.10.036.","journal-title":"Am J Med"}],"container-title":["BDJ Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41405-026-00481-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41405-026-00481-6","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41405-026-00481-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,11,4]],"date-time":"2026-11-04T11:06:41Z","timestamp":1793790401000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41405-026-00481-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,28]]},"references-count":22,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["481"],"URL":"https:\/\/doi.org\/10.1038\/s41405-026-00481-6","relation":{},"ISSN":["2056-807X"],"issn-type":[{"value":"2056-807X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,28]]},"assertion":[{"value":"12 July 2026","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 August 2026","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 August 2026","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 September 2026","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 November 2026","order":6,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Update","order":7,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"In this article the affiliation 'Lucy Cavendish College, University of Cambridge, Lady Margaret Road, Cambridge, CB3 0BU' for Oliver Vij was missing. The original article has been corrected.","order":8,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","label":"Competing interests","group":{"name":"EthicsHeading","label":"Ethics"}}],"article-number":"92"}}