{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T03:02:16Z","timestamp":1777431736607,"version":"3.51.4"},"reference-count":35,"publisher":"SAGE Publications","license":[{"start":{"date-parts":[[2025,2,20]],"date-time":"2025-02-20T00:00:00Z","timestamp":1740009600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Applied Psychological Measurement"],"abstract":"<jats:p>Item preknowledge refers to the case where examinees have advanced knowledge of test material prior to taking the examination. When examinees have item preknowledge, the scores that result from those item responses are not true reflections of the examinee\u2019s proficiency. Further, this contamination in the data also has an impact on the item parameter estimates and therefore has an impact on scores for all examinees, regardless of whether they had prior knowledge. To ensure the validity of test scores, it is essential to identify both issues: compromised items (CIs) and examinees with preknowledge (EWPs). In some cases, the CIs are known, and the task is reduced to determining the EWPs. However, due to the potential threat to validity, it is critical for high-stakes testing programs to have a process for routinely monitoring for evidence of EWPs, often when CIs are unknown. Further, even knowing that specific items may have been compromised does not guarantee that any examinees had prior access to those items, or that those examinees that did have prior access know how to effectively use the preknowledge. Therefore, this paper attempts to use response behavior to identify item preknowledge without knowledge of which items may or may not have been compromised. While most research in this area has relied on traditional psychometric models, we investigate the utility of an unsupervised machine learning algorithm, extended isolation forest (EIF), to detect EWPs. Similar to previous research, the response behavior being analyzed is response time (RT) and response accuracy (RA).<\/jats:p>","DOI":"10.1177\/01466216251320403","type":"journal-article","created":{"date-parts":[[2025,2,20]],"date-time":"2025-02-20T23:15:01Z","timestamp":1740093301000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":1,"title":["Few and Different: Detecting Examinees With Preknowledge Using Extended Isolation Forests"],"prefix":"10.1177","author":[{"given":"Nate R.","family":"Smith","sequence":"first","affiliation":[{"name":"University of Massachusetts Amherst, Amherst, MA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lisa A.","family":"Keller","sequence":"additional","affiliation":[{"name":"University of Massachusetts Amherst, Amherst, MA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1386-9867","authenticated-orcid":false,"given":"Richard A.","family":"Feinberg","sequence":"additional","affiliation":[{"name":"National Board of Medical Examiners, Philadelphia, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7863-8229","authenticated-orcid":false,"given":"Chunyan","family":"Liu","sequence":"additional","affiliation":[{"name":"National Board of Medical Examiners, Philadelphia, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2025,2,20]]},"reference":[{"key":"bibr1-01466216251320403","doi-asserted-by":"publisher","DOI":"10.1515\/9781400874668"},{"key":"bibr2-01466216251320403","doi-asserted-by":"publisher","DOI":"10.7333\/1410-0203037"},{"key":"bibr3-01466216251320403","doi-asserted-by":"publisher","DOI":"10.1177\/0146621615603327"},{"key":"bibr4-01466216251320403","doi-asserted-by":"publisher","DOI":"10.1214\/21-AOAS1564"},{"key":"bibr5-01466216251320403","doi-asserted-by":"publisher","DOI":"10.1145\/3338840.3355641"},{"key":"bibr6-01466216251320403","volume-title":"Handbook of detecting cheating on tests","author":"Cizek G. J.","year":"2017"},{"key":"bibr7-01466216251320403","volume-title":"Paper presented at the conference on test security, park city, UT","author":"Eckerly C.","year":"2018"},{"key":"bibr8-01466216251320403","author":"Fox J. P.","year":"2019","journal-title":"R package version 0.5.1"},{"key":"bibr9-01466216251320403","doi-asserted-by":"publisher","DOI":"10.1111\/jedm.12143"},{"issue":"4","key":"bibr10-01466216251320403","first-page":"359","volume":"64","author":"Gorgun G.","year":"2022","journal-title":"Psychological Test and Assessment Modeling"},{"key":"bibr11-01466216251320403","doi-asserted-by":"publisher","DOI":"10.1177\/01466216221108130"},{"key":"bibr12-01466216251320403","doi-asserted-by":"publisher","DOI":"10.1111\/jedm.12309"},{"key":"bibr13-01466216251320403","doi-asserted-by":"publisher","DOI":"10.3102\/10769986231159923"},{"key":"bibr14-01466216251320403","unstructured":"Hariri S., Kind M. C., Brunner R. J. (2018). Extended isolation forest. arXiv preprint arXiv:1811.02141."},{"issue":"1","key":"bibr15-01466216251320403","first-page":"179","volume":"65","author":"Jiao H.","year":"2023","journal-title":"Psychological Testing and Assessment Modeling"},{"key":"bibr16-01466216251320403","author":"Jiao H.","year":"2023","journal-title":"Large-Scale Assessment"},{"key":"bibr17-01466216251320403","doi-asserted-by":"publisher","DOI":"10.1007\/s11336-008-9075-y"},{"key":"bibr18-01466216251320403","doi-asserted-by":"publisher","DOI":"10.4324\/9781351064781-12"},{"key":"bibr19-01466216251320403","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2008.17"},{"key":"bibr20-01466216251320403","doi-asserted-by":"publisher","DOI":"10.1080\/15305058.2018.1429446"},{"issue":"4","key":"bibr21-01466216251320403","first-page":"385","volume":"64","author":"Pan Y.","year":"2022","journal-title":"Psychological Test and Assessment Modeling"},{"key":"bibr22-01466216251320403","doi-asserted-by":"publisher","DOI":"10.1111\/jedm.12299"},{"key":"bibr23-01466216251320403","doi-asserted-by":"publisher","DOI":"10.1111\/emip.12102"},{"key":"bibr24-01466216251320403","doi-asserted-by":"publisher","DOI":"10.1007\/s11336-012-9311-3"},{"key":"bibr25-01466216251320403","doi-asserted-by":"publisher","DOI":"10.3102\/1076998616673872"},{"key":"bibr26-01466216251320403","doi-asserted-by":"publisher","DOI":"10.1177\/0146621620909893"},{"key":"bibr27-01466216251320403","doi-asserted-by":"publisher","DOI":"10.1111\/bmsp.12187"},{"key":"bibr28-01466216251320403","doi-asserted-by":"publisher","DOI":"10.1109\/ASMC.2017.7969205"},{"key":"bibr29-01466216251320403","volume-title":"Presentation at the 2016 Maryland assessment research center conference","author":"Thomas S. L.","year":"2016"},{"key":"bibr30-01466216251320403","doi-asserted-by":"publisher","DOI":"10.3389\/feduc.2019.00049"},{"key":"bibr31-01466216251320403","doi-asserted-by":"publisher","DOI":"10.1007\/s11336-006-1478-z"},{"key":"bibr32-01466216251320403","doi-asserted-by":"publisher","DOI":"10.1007\/s11336-016-9525-x"},{"key":"bibr33-01466216251320403","doi-asserted-by":"publisher","DOI":"10.1177\/0146621616687285"},{"issue":"4","key":"bibr34-01466216251320403","first-page":"425","volume":"64","author":"Zhou T.","year":"2022","journal-title":"Psychological Test and Assessment Modeling"},{"key":"bibr35-01466216251320403","first-page":"25","volume-title":"Handbook of detecting cheating on tests","author":"Zopluoglu C.","year":"2017"}],"container-title":["Applied Psychological Measurement"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/01466216251320403","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/01466216251320403","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/01466216251320403","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T11:45:47Z","timestamp":1777376747000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/01466216251320403"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,20]]},"references-count":35,"alternative-id":["10.1177\/01466216251320403"],"URL":"https:\/\/doi.org\/10.1177\/01466216251320403","relation":{},"ISSN":["0146-6216","1552-3497"],"issn-type":[{"value":"0146-6216","type":"print"},{"value":"1552-3497","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,20]]},"article-number":"01466216251320403"}}