{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,8,24]],"date-time":"2023-08-24T04:29:29Z","timestamp":1692851369820},"reference-count":24,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"3","license":[{"start":{"date-parts":[[2018,11,1]],"date-time":"2018-11-01T00:00:00Z","timestamp":1541030400000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2018,11]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:sec>\n            <jats:title>Introduction:<\/jats:title>\n            <jats:p>Reusing multiple-choice questions in different examinations may lead to item sharing between students. Our aim was to analyze and solve an item-sharing problem during assessment of medical students in pediatrics clerkship.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Methods:<\/jats:title>\n            <jats:p>This is a 3 years prospective analysis of 5th year medical students, submitted to an examination at the end of their Pediatrics\u2019 clerkship. In 2012, questions were reused across different clerkships. In 2013, no questions were reused in different clerkships. In 2014, no questions were reused and the review of the test was postponed to the end of the year, after all clerkships ended.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results:<\/jats:title>\n            <jats:p>In 2012, the mean score increased 1.36 points (in a scale of 0\u201320) per clerkship rotation, with the last clerkship having a difference of 9.5 points regarding the first one (<jats:italic toggle=\"yes\">P<\/jats:italic>\u200a&lt;\u200a.001). Fifty percent of this variation was due to the repetition of questions. In 2013, with a new question bank, the mean score increased 0.8 points per clerkship rotation, with a difference of 5.6 points between the last and the first rotations (<jats:italic toggle=\"yes\">P<\/jats:italic>\u200a&lt;\u200a.024). Finally, in 2014 there was no significant variation between clerkships.<\/jats:p>\n            <jats:p>Tests\u2019 scores had a significant moderate correlation with students\u2019 average course grade (<jats:italic toggle=\"yes\">r<\/jats:italic>\u200a=\u200a0.39, <jats:italic toggle=\"yes\">r<\/jats:italic>\u200a=\u200a0.30, <jats:italic toggle=\"yes\">r<\/jats:italic>\u200a=\u200a0.48, for 2012, 2013, and 2014, respectively). The students\u2019 average course grade, however, did not confound the increase in tests\u2019 scores across different clerkships.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusion:<\/jats:title>\n            <jats:p>The present work demonstrated an item-sharing problem among students during pediatric clerkships. An effective approach to correct this bias assessment was achieved by restricting the reuse of questions, by changing the time-point of test revision and by progressively adapting equating strategies.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1016\/j.pbj.0000000000000021","type":"journal-article","created":{"date-parts":[[2018,10,2]],"date-time":"2018-10-02T17:35:42Z","timestamp":1538501742000},"page":"e21","source":"Crossref","is-referenced-by-count":0,"title":["Assessment in pediatrics clerkships: impact of strategies to solve item-sharing problems"],"prefix":"10.1097","volume":"3","author":[{"given":"Gabriel","family":"Faria-Costa","sequence":"first","affiliation":[{"name":"Department of Surgery and Physiology"}]},{"given":"Milton","family":"Severo","sequence":"additional","affiliation":[{"name":"Department of Public Health and Forensic Sciences, and Medical Education"}]},{"given":"Maria Am\u00e9lia","family":"Ferreira","sequence":"additional","affiliation":[{"name":"Department of Public Health and Forensic Sciences, and Medical Education"}]},{"given":"Herc\u00edlia","family":"Guimar\u00e3es","sequence":"additional","affiliation":[{"name":"Department of Gynecology-Obstetrics and Pediatrics, University of Porto Medical School, Porto, Portugal."}]},{"given":"Tiago","family":"Henriques-Coelho","sequence":"additional","affiliation":[{"name":"Department of Surgery and Physiology"},{"name":"Department of Gynecology-Obstetrics and Pediatrics, University of Porto Medical School, Porto, Portugal."}]}],"member":"276","reference":[{"key":"R1-20230824","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1016\/j.jacr.2010.08.006","article-title":"Standardized tests: a review","volume":"8","author":"Dalal","year":"2011","journal-title":"J Am Coll Radiol."},{"key":"R2-20230824","first-page":"208","article-title":"Grading more accurately","volume":"7","author":"Rom","year":"2011","journal-title":"J Pol Sci Educ."},{"key":"R3-20230824","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1080\/01421590400013495","article-title":"Improving the fairness of multiple-choice questions: a literature review","volume":"26","author":"McCoubrie","year":"2004","journal-title":"Med Teach."},{"key":"R4-20230824","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1056\/NEJMra054784","article-title":"Assessment in medical education","volume":"356","author":"Epstein","year":"2007","journal-title":"N Engl J Med."},{"key":"R5-20230824","doi-asserted-by":"crossref","first-page":"1319","DOI":"10.1016\/j.acra.2013.04.009","article-title":"Inherent limitations of multiple-choice testing","volume":"20","author":"Gunderman","year":"2013","journal-title":"Acad Radiol."},{"key":"R6-20230824","doi-asserted-by":"crossref","first-page":"380","DOI":"10.1016\/j.jacr.2012.02.002","article-title":"The ABR \u201crecalls\u201d conundrum: an ethical quandary","volume":"9","author":"Berlin","year":"2012","journal-title":"J Am Coll Radiol."},{"key":"R7-20230824","doi-asserted-by":"crossref","first-page":"601","DOI":"10.1002\/j.0022-0337.2009.73.5.tb04735.x","article-title":"Effects of posting examinations and answer keys on students\u2019 study methods and test performance","volume":"73","author":"Lake","year":"2009","journal-title":"J Dent Educ."},{"key":"R8-20230824","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1080\/07294360.2012.687362","article-title":"Academic integrity and plagiarism: a review of the influences and risk situations for health students","volume":"32","author":"Jiang","year":"2013","journal-title":"Higher Educ Res Develop."},{"key":"R9-20230824","doi-asserted-by":"crossref","first-page":"373","DOI":"10.3102\/10769986025004373","article-title":"Detection of known items in adaptive testing with a statistical quality control method","volume":"25","author":"Veerkamp","year":"2000","journal-title":"J Educ Behav Stat."},{"issue":"(pt 2)","key":"R10-20230824","doi-asserted-by":"crossref","first-page":"493","DOI":"10.1348\/000711007X230937","article-title":"Incorporating randomness in the Fisher information for improving item-exposure control in CATs","volume":"61","author":"Barrada","year":"2008","journal-title":"Br J Math Stat Psychol."},{"key":"R11-20230824","first-page":"313","article-title":"Comparison of methods for controlling maximum exposure rates in computerized adaptive testing","volume":"21","author":"Barrada","year":"2009","journal-title":"Psicothema."},{"key":"R12-20230824","doi-asserted-by":"crossref","first-page":"618","DOI":"10.1017\/S1138741600004625","article-title":"Rotating item banks versus restriction of maximum exposure rates in computerized adaptive testing","volume":"11","author":"Barrada","year":"2008","journal-title":"Span J Psychol."},{"key":"R13-20230824","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1111\/j.1745-3984.2004.tb01170.x","article-title":"Constructing rotating item pools for constrained adaptive testing","volume":"41","author":"Ariel","year":"2004","journal-title":"J Educ Measure."},{"key":"R14-20230824","doi-asserted-by":"crossref","first-page":"742","DOI":"10.3758\/s13428-011-0178-5","article-title":"Comparing single-pool and multiple-pool designs regarding test security in computerized testing","volume":"44","author":"Zhang","year":"2012","journal-title":"Behav Res Methods."},{"key":"R15-20230824","doi-asserted-by":"crossref","first-page":"1443","DOI":"10.3758\/s13428-015-0659-z","article-title":"Item exposure control for multidimensional computer adaptive testing under maximum likelihood and expected a posteriori estimation","volume":"48","author":"Huebner","year":"2016","journal-title":"Behav Res Methods."},{"key":"R16-20230824","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1111\/j.1745-3984.2005.00018.x","article-title":"Accuracy of random groups equating with very small samples","volume":"42","author":"Skaggs","year":"2005","journal-title":"J Educ Measure."},{"key":"R17-20230824","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1111\/jedm.12062","article-title":"A general linear method for equating with small samples","volume":"52","author":"Albano","year":"2015","journal-title":"J Educ Measure."},{"key":"R19-20230824","first-page":"647","article-title":"Investigating test equating methods in small samples through various factors","volume":"16","author":"A\u015firet","year":"2016","journal-title":"Educ Sci."},{"key":"R20-20230824","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s10459-006-9020-8","article-title":"Item response theory test equating in health sciences education","volume":"13","author":"Guilera","year":"2008","journal-title":"Adv Health Sci Educ Theory Pract."},{"key":"R21-20230824","doi-asserted-by":"crossref","first-page":"1253","DOI":"10.1002\/j.0022-0337.2016.80.10.tb06209.x","article-title":"Evaluating the impact of releasing an item pool on a test's empirical characteristics","volume":"80","author":"Buckendahl","year":"2016","journal-title":"J Dent Educ."},{"key":"R22-20230824","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1155\/2013\/585420","article-title":"The effects of reusing written test items: a study using the Rasch model","volume":"2013","author":"Wagner-Menghin","year":"2013","journal-title":"ISRN Educ."},{"key":"R23-20230824","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1080\/10401334.2015.1077131","article-title":"The impact of repeated exposure to items","volume":"27","author":"O\u2019Neill","year":"2015","journal-title":"Teach Learn Med."},{"key":"R24-20230824","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1080\/01421599979428","article-title":"Reutilization of multiple-choice questions","volume":"21","author":"Herskovic","year":"1999","journal-title":"Med Teach."},{"key":"R25-20230824","doi-asserted-by":"crossref","first-page":"835","DOI":"10.1007\/s10459-012-9395-7","article-title":"The overall impact of testing on medical student learning: quantitative estimation of consequential validity","volume":"18","author":"Kreiter","year":"2013","journal-title":"Adv Health Sci Educ Theory Pract."}],"container-title":["Porto Biomedical Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.lww.com\/02054639-201812000-00004","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,24]],"date-time":"2023-08-24T01:44:36Z","timestamp":1692841476000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.lww.com\/02054639-201812000-00004"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,11]]},"references-count":24,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2018]]}},"URL":"https:\/\/doi.org\/10.1016\/j.pbj.0000000000000021","relation":{},"ISSN":["2444-8664"],"issn-type":[{"value":"2444-8664","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,11]]}}}