{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,23]],"date-time":"2026-08-23T15:10:59Z","timestamp":1787497859986,"version":"build-2736575974"},"reference-count":54,"publisher":"Cambridge University Press (CUP)","issue":"2","license":[{"start":{"date-parts":[[2025,1,1]],"date-time":"2025-01-01T00:00:00Z","timestamp":1735689600000},"content-version":"unspecified","delay-in-days":1310,"URL":"https:\/\/www.cambridge.org\/core\/terms"},{"start":{"date-parts":[[2021,6,1]],"date-time":"2021-06-01T00:00:00Z","timestamp":1622505600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springer.com\/tdm"},{"start":{"date-parts":[[2021,6,1]],"date-time":"2021-06-01T00:00:00Z","timestamp":1622505600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Psychometrika"],"published-print":{"date-parts":[[2021,6]]},"abstract":"<jats:p>When a response to a multiple-choice item consists of selecting a single-best answer, it is not possible for examiners to differentiate between a response that is a product of knowledge and one that is largely a product of uncertainty. Certainty-based marking (CBM) is one testing format that requires examinees to express their degree of certainty on the response option they have selected, leading to an item score that depends both on the correctness of an answer and the certainty expressed. The expected score is maximized if examinees truthfully report their level of certainty. However, prospect theory states that people do not always make rational choices of the optimal outcome due to varying risk attitudes. By integrating a psychometric model and a decision-making perspective, the present study looks into the response behaviors of 334 first-year students of physiotherapy on six multiple-choice examinations with CBM in a case study. We used item response theory to model the objective probability of students giving a correct response to an item, and cumulative prospect theory to estimate their risk attitudes when students choose to report their certainty. The results showed that with the given CBM scoring matrix, students\u2019 choices of a certainty level were affected by their risk attitudes. Students were generally risk averse and loss averse when they had a high success probability on an item, leading to an under-reporting of their certainty. Meanwhile, they were risk seeking in case of small success probabilities on the items, resulting in the over-reporting of certainty.<\/jats:p>","DOI":"10.1007\/s11336-021-09759-0","type":"journal-article","created":{"date-parts":[[2021,4,29]],"date-time":"2021-04-29T16:02:28Z","timestamp":1619712148000},"page":"518-543","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Certainty-Based Marking on Multiple-Choice Items: Psychometrics Meets Decision Theory"],"prefix":"10.1017","volume":"86","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5828-6468","authenticated-orcid":false,"given":"Qian","family":"Wu","sequence":"first","affiliation":[{"name":"KU Leuven"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Monique","family":"Vanerum","sequence":"additional","affiliation":[{"name":"University of Hasselt"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3859-6578","authenticated-orcid":false,"given":"Anouk","family":"Agten","sequence":"additional","affiliation":[{"name":"University of Hasselt"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2692-7843","authenticated-orcid":false,"given":"Andr\u00e9s","family":"Christiansen","sequence":"additional","affiliation":[{"name":"KU Leuven"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5556-8937","authenticated-orcid":false,"given":"Frank","family":"Vandenabeele","sequence":"additional","affiliation":[{"name":"University of Hasselt"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0031-526X","authenticated-orcid":false,"given":"Jean-Michel","family":"Rigo","sequence":"additional","affiliation":[{"name":"University of Hasselt"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5472-5494","authenticated-orcid":false,"given":"Rianne","family":"Janssen","sequence":"additional","affiliation":[{"name":"KU Leuven"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"56","published-online":{"date-parts":[[2025,1,1]]},"reference":[{"key":"S0033312300006359_CR38","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmp.2010.08.006"},{"key":"S0033312300006359_CR6","doi-asserted-by":"publisher","DOI":"10.1177\/0146621697211006"},{"key":"S0033312300006359_CR18","volume-title":"The theory and practice of item response theory","author":"De Ayala","year":"2009"},{"key":"S0033312300006359_CR14","doi-asserted-by":"publisher","DOI":"10.1007\/s11336-014-9425-x"},{"key":"S0033312300006359_CR40","doi-asserted-by":"publisher","DOI":"10.1016\/j.jebo.2014.08.007"},{"key":"S0033312300006359_CR5","doi-asserted-by":"publisher","DOI":"10.2307\/2118511"},{"key":"S0033312300006359_CR28","doi-asserted-by":"publisher","DOI":"10.2307\/1914185"},{"key":"S0033312300006359_CR52","first-page":"110","article-title":"Is there need for the 3PL model? Guess what?","volume":"7","author":"von Davier","year":"2009","journal-title":"Measurement: Interdisciplinary Research and Perspective"},{"key":"S0033312300006359_CR29","doi-asserted-by":"publisher","DOI":"10.1016\/j.jet.2004.03.009"},{"key":"S0033312300006359_CR3","doi-asserted-by":"publisher","DOI":"10.1007\/s11299-005-0001-z"},{"key":"S0033312300006359_CR42","volume-title":"R: A language and environment for statistical computing","year":"2019"},{"key":"S0033312300006359_CR39","doi-asserted-by":"publisher","DOI":"10.1177\/01466216000241003"},{"key":"S0033312300006359_CR25","unstructured":"Gilles, J.-L. (2002). Qualit\u00e9 spectrales des tests standardis\u00e9s universitaires\u2014Mise au point d\u2019indices \u00e9dum\u00e9triques d\u2019analyse de la qualit\u00e9 spectrale des \u00e9valuations des acquis des \u00e9tudiants universitaires et application aux \u00e9preuves MOHICAN check up \u201999 Spectral [Quality of University Standardized Tests\u2014Development of edumetrical indices for the analysis of the spectral quality of higher education standardized tests and application to the MOHICAN check up \u201999 tests] (Doctoral thesis, University of Li\u00e8ge, Belgium). Retrieved from http:\/\/hdl.handle.net\/2268\/2217"},{"key":"S0033312300006359_CR7","doi-asserted-by":"publisher","DOI":"10.1002\/bdm.417"},{"key":"S0033312300006359_CR43","doi-asserted-by":"publisher","DOI":"10.1007\/s11336-013-9396-3"},{"key":"S0033312300006359_CR15","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v048.i06"},{"key":"S0033312300006359_CR54","first-page":"183","volume-title":"Quantitative psychology. IMPS 2017. Springer proceedings in mathematics and statistics","author":"Wu","year":"2018"},{"key":"S0033312300006359_CR41","doi-asserted-by":"publisher","DOI":"10.2307\/2998573"},{"key":"S0033312300006359_CR45","volume-title":"Models of man: Social and rational- mathematical essays on rational human behavior in a social setting","author":"Simon","year":"1957"},{"key":"S0033312300006359_CR20","doi-asserted-by":"publisher","DOI":"10.1111\/j.2044-8317.1985.tb00817.x"},{"key":"S0033312300006359_CR44","doi-asserted-by":"publisher","DOI":"10.2147\/AMEP.S35972"},{"key":"S0033312300006359_CR46","doi-asserted-by":"publisher","DOI":"10.1007\/s11166-006-8289-6"},{"key":"S0033312300006359_CR34","doi-asserted-by":"publisher","DOI":"10.1037\/14396-000"},{"key":"S0033312300006359_CR53","first-page":"408","article-title":"3PL or Rasch?","volume":"9","author":"Wright","year":"1995","journal-title":"Rasch Measurement Transactions"},{"key":"S0033312300006359_CR27","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1994.tb00440.x"},{"key":"S0033312300006359_CR31","doi-asserted-by":"publisher","DOI":"10.1016\/j.stueduc.2013.07.001"},{"key":"S0033312300006359_CR13","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1993.tb00427.x"},{"key":"S0033312300006359_CR8","first-page":"374","volume-title":"Statistical theories of mental test scores","author":"Birnbaum","year":"1968"},{"key":"S0033312300006359_CR12","doi-asserted-by":"publisher","DOI":"10.1007\/s11336-014-9434-9"},{"key":"S0033312300006359_CR48","first-page":"177","article-title":"(Over)insuring modest risks","volume":"2","author":"Sydnor","year":"2010","journal-title":"American Economic Journal: Applied Economics"},{"key":"S0033312300006359_CR23","first-page":"141","volume-title":"Innovative assessment in higher education","author":"Gardner-Medwin","year":"2006"},{"key":"S0033312300006359_CR37","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2016.2591"},{"key":"S0033312300006359_CR4","doi-asserted-by":"publisher","DOI":"10.7899\/JCE-12-018"},{"key":"S0033312300006359_CR22","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3992.1988.tb00434.x"},{"key":"S0033312300006359_CR32","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511809477.023"},{"key":"S0033312300006359_CR10","doi-asserted-by":"publisher","DOI":"10.1007\/s11238-009-9144-4"},{"key":"S0033312300006359_CR11","doi-asserted-by":"publisher","DOI":"10.1080\/10618600.1998.10474787"},{"key":"S0033312300006359_CR17","doi-asserted-by":"publisher","DOI":"10.1007\/s11336-015-9484-7"},{"key":"S0033312300006359_CR51","doi-asserted-by":"publisher","DOI":"10.1007\/BF00122574"},{"key":"S0033312300006359_CR2","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2013.1776"},{"key":"S0033312300006359_CR35","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008929526011"},{"key":"S0033312300006359_CR21","doi-asserted-by":"publisher","DOI":"10.1177\/001316445301300404"},{"key":"S0033312300006359_CR49","doi-asserted-by":"publisher","DOI":"10.1016\/0167-2681(80)90051-7"},{"key":"S0033312300006359_CR33","doi-asserted-by":"publisher","DOI":"10.1111\/emip.12072"},{"key":"S0033312300006359_CR26","doi-asserted-by":"publisher","DOI":"10.1006\/cogp.1998.0710"},{"key":"S0033312300006359_CR24","doi-asserted-by":"publisher","DOI":"10.1214\/ss\/1177011136"},{"key":"S0033312300006359_CR30","doi-asserted-by":"publisher","DOI":"10.1016\/0191-765X(82)90011-8"},{"key":"S0033312300006359_CR50","volume-title":"Discrete choice methods with simulation","author":"Train","year":"2009"},{"key":"S0033312300006359_CR9","doi-asserted-by":"publisher","DOI":"10.1002\/j.2333-8504.1971.tb00615.x"},{"key":"S0033312300006359_CR47","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v012.i03"},{"key":"S0033312300006359_CR1","doi-asserted-by":"publisher","DOI":"10.1080\/15472450490523856"},{"key":"S0033312300006359_CR36","doi-asserted-by":"publisher","DOI":"10.1086\/296093"},{"key":"S0033312300006359_CR16","doi-asserted-by":"publisher","DOI":"10.1257\/jel.47.2.448"},{"key":"S0033312300006359_CR19","doi-asserted-by":"publisher","DOI":"10.1111\/j.1542-4774.2011.01015.x"}],"container-title":["Psychometrika"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11336-021-09759-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11336-021-09759-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11336-021-09759-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"},{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S0033312300006359","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T01:55:41Z","timestamp":1777946141000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S0033312300006359\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6]]},"references-count":54,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,6]]}},"alternative-id":["S0033312300006359"],"URL":"https:\/\/doi.org\/10.1007\/s11336-021-09759-0","relation":{},"ISSN":["0033-3123","1860-0980"],"issn-type":[{"value":"0033-3123","type":"print"},{"value":"1860-0980","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6]]},"assertion":[{"value":"21 August 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 January 2021","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 April 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}