{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T02:31:14Z","timestamp":1778121074511,"version":"3.51.4"},"reference-count":31,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2007,3,2]],"date-time":"2007-03-02T00:00:00Z","timestamp":1172793600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Biometrics"],"published-print":{"date-parts":[[2007,6]]},"abstract":"<jats:p><jats:bold><jats:sc>Summary<\/jats:sc><\/jats:bold> Estimating diagnostic accuracy without a gold standard is an important problem in medical testing. Although there is a fairly large literature on this problem for the case of repeated binary tests, there is substantially less work for the case of ordinal tests. A noted exception is the work by <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"#b31\">Zhou, Castelluccio, and Zhou<\/jats:ext-link> (2005, <jats:italic>Biometrics<\/jats:italic><jats:bold>61,<\/jats:bold> 600\u2013609), which proposed a methodology for estimating receiver operating characteristic (ROC) curves without a gold standard from multiple ordinal tests. A key assumption in their work was that the test results are independent conditional on the true test result. I propose random effects modeling approaches that incorporate dependence between the ordinal tests, and I show through asymptotic results and simulations the importance of correctly accounting for the dependence between tests. These modeling approaches, along with the importance of accounting for the dependence between tests, are illustrated by analyzing the uterine cancer pathology data analyzed by <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"#b31\">Zhou et al. (2005)<\/jats:ext-link>.<\/jats:p>","DOI":"10.1111\/j.1541-0420.2006.00712.x","type":"journal-article","created":{"date-parts":[[2007,3,2]],"date-time":"2007-03-02T13:16:41Z","timestamp":1172841401000},"page":"593-602","source":"Crossref","is-referenced-by-count":20,"title":["Random Effects Modeling Approaches for Estimating ROC Curves from Repeated Ordinal Tests without a Gold Standard"],"prefix":"10.1093","volume":"63","author":[{"given":"Paul S.","family":"Albert","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2007,3,2]]},"reference":[{"key":"e_1_2_8_2_1","volume-title":"Handbook of Mathematical Functions","author":"Abramowitz M.","year":"1972"},{"key":"e_1_2_8_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.1974.1100705"},{"key":"e_1_2_8_4_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.0006-341X.2004.00187.x"},{"key":"e_1_2_8_5_1","unstructured":"Albert P. S.andDodd L. E.(2006).On estimating diagnostic accuracy from studies with multiple raters and partial gold standard evaluation. Biometric Research Branch\/NCI Technical Report 40. Available athttp:\/\/linus.nci.nih.gov\/~brb\/TechReport.htm)."},{"key":"e_1_2_8_6_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.0006-341X.2001.00610.x"},{"key":"e_1_2_8_7_1","volume-title":"Gauss Systems, Version 3.0","author":"Aptech Systems","year":"1992"},{"key":"e_1_2_8_8_1","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X9001000106"},{"key":"e_1_2_8_9_1","doi-asserted-by":"publisher","DOI":"10.2307\/2685441"},{"key":"e_1_2_8_10_1","doi-asserted-by":"publisher","DOI":"10.1198\/108571106X110883"},{"key":"e_1_2_8_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4899-4541-9"},{"key":"e_1_2_8_12_1","doi-asserted-by":"publisher","DOI":"10.2307\/2531499"},{"key":"e_1_2_8_13_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1992.10475229"},{"key":"e_1_2_8_14_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/61.2.215"},{"key":"e_1_2_8_15_1","doi-asserted-by":"publisher","DOI":"10.1002\/sim.762"},{"key":"e_1_2_8_16_1","doi-asserted-by":"publisher","DOI":"10.2307\/2531393"},{"key":"e_1_2_8_17_1","doi-asserted-by":"publisher","DOI":"10.2307\/2533433"},{"key":"e_1_2_8_18_1","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X9001000105"},{"key":"e_1_2_8_19_1","first-page":"334","article-title":"Variability in classification of carcinoma in situ of the uterine cervix","volume":"84","author":"Holmquist N. D.","year":"1967","journal-title":"Archives of Pathology"},{"key":"e_1_2_8_20_1","doi-asserted-by":"publisher","DOI":"10.2307\/3315912"},{"key":"e_1_2_8_21_1","doi-asserted-by":"publisher","DOI":"10.2307\/3315913"},{"key":"e_1_2_8_22_1","doi-asserted-by":"publisher","DOI":"10.1198\/106186005X63185"},{"key":"e_1_2_8_23_1","doi-asserted-by":"publisher","DOI":"10.2307\/2529786"},{"key":"e_1_2_8_24_1","doi-asserted-by":"publisher","DOI":"10.2307\/2283868"},{"key":"e_1_2_8_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4899-3242-6"},{"key":"e_1_2_8_26_1","doi-asserted-by":"publisher","DOI":"10.2307\/2531484"},{"key":"e_1_2_8_27_1","first-page":"658","article-title":"Reply to comment on: \u201cUsing a combination of reference tests to assess the accuracy of a diagnostic test\u201d (1999, 18, 2987\u20133003)","volume":"20","author":"Pepe M. S.","year":"2001","journal-title":"Statistics in Medicine"},{"key":"e_1_2_8_28_1","doi-asserted-by":"publisher","DOI":"10.1081\/BIP-120014415"},{"key":"e_1_2_8_29_1","doi-asserted-by":"publisher","DOI":"10.2307\/2533043"},{"key":"e_1_2_8_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/0167-9473(96)00004-7"},{"key":"e_1_2_8_31_1","doi-asserted-by":"publisher","DOI":"10.1177\/01466219922031400"},{"key":"e_1_2_8_32_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1541-0420.2005.00324.x"}],"container-title":["Biometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Fj.1541-0420.2006.00712.x","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/j.1541-0420.2006.00712.x","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,26]],"date-time":"2024-01-26T18:09:25Z","timestamp":1706292565000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/biometrics\/article\/63\/2\/593-602\/7325196"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2007,3,2]]},"references-count":31,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2007,6]]}},"alternative-id":["10.1111\/j.1541-0420.2006.00712.x"],"URL":"https:\/\/doi.org\/10.1111\/j.1541-0420.2006.00712.x","archive":["Portico"],"relation":{},"ISSN":["0006-341X","1541-0420"],"issn-type":[{"value":"0006-341X","type":"print"},{"value":"1541-0420","type":"electronic"}],"subject":[],"published":{"date-parts":[[2007,3,2]]}}}