{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T08:01:19Z","timestamp":1771488079041,"version":"3.50.1"},"reference-count":23,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2020,8,26]],"date-time":"2020-08-26T00:00:00Z","timestamp":1598400000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The predictive receiver operating characteristic (PROC) curve differs from the more well-known receiver operating characteristic (ROC) curve in that it provides a basis for the evaluation of binary diagnostic tests using metrics defined conditionally on the outcome of the test rather than metrics defined conditionally on the actual disease status. Application of PROC curve analysis may be hindered by the complex graphical patterns that are sometimes generated. Here we present an information theoretic analysis that allows concurrent evaluation of PROC curves and ROC curves together in a simple graphical format. The analysis is based on the observation that mutual information may be viewed both as a function of ROC curve summary statistics (sensitivity and specificity) and prevalence, and as a function of predictive values and prevalence. Mutual information calculated from a 2 \u00d7 2 prediction-realization table for a specified risk score threshold on an ROC curve is the same as the mutual information calculated at the same risk score threshold on a corresponding PROC curve. Thus, for a given value of prevalence, the risk score threshold that maximizes mutual information is the same on both the ROC curve and the corresponding PROC curve. Phytopathologists and clinicians who have previously relied solely on ROC curve summary statistics when formulating risk thresholds for application in practical agricultural or clinical decision-making contexts are thus presented with a methodology that brings predictive values within the scope of that formulation.<\/jats:p>","DOI":"10.3390\/e22090938","type":"journal-article","created":{"date-parts":[[2020,8,26]],"date-time":"2020-08-26T09:56:58Z","timestamp":1598435818000},"page":"938","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Mutual Information as a Performance Measure for Binary Predictors Characterized by Both ROC Curve and PROC Curve Analysis"],"prefix":"10.3390","volume":"22","author":[{"given":"Gareth","family":"Hughes","sequence":"first","affiliation":[{"name":"SRUC (Scotland\u2019s Rural College), The King\u2019s Buildings, Edinburgh EH9 3JG, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jennifer","family":"Kopetzky","sequence":"additional","affiliation":[{"name":"Department of Plant Pathology, University of California, Davis, CA 95616, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6346-9461","authenticated-orcid":false,"given":"Neil","family":"McRoberts","sequence":"additional","affiliation":[{"name":"Department of Plant Pathology, University of California, Davis, CA 95616, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,8,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1016\/0169-2607(91)90072-2","article-title":"Strategies for graphical threshold determination","volume":"35","author":"Vermont","year":"1991","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"23132333","DOI":"10.1098\/rsta.2008.0043","article-title":"The predictive receiver operating characteristic curve for the joint assessment of the positive and negative predictive values","volume":"366","author":"Shiu","year":"2008","journal-title":"Philos. Trans. R. Soc. A"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Reibnegger, G., and Schrabmair, W. (2014). Optimum binary cut-off threshold of a diagnostic test: Comparison of different methods using Monte Carlo technique. BMC Med. Inform. Decis. Mak., 14.","DOI":"10.1186\/s12911-014-0099-1"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Hughes, G. (2020). On the binormal predictive receiver operating characteristic curve for the joint assessment of positive and negative predictive values. Entropy, 22.","DOI":"10.3390\/e22060593"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1146\/annurev-phyto-080516-035342","article-title":"The evidential basis of decision making in plant disease management","volume":"55","author":"Hughes","year":"2017","journal-title":"Annu. Rev. Phytopathol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1007\/BF01877054","article-title":"Calibration and verification of risk algorithms using logistic regression","volume":"102","author":"Yuen","year":"1996","journal-title":"Eur. J. Plant Pathol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1016\/S0261-2194(98)00035-0","article-title":"Forecasting Sclerotinia stem rot in spring sown oilseed rape","volume":"17","author":"Sigvald","year":"1998","journal-title":"Crop Prot."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s10658-005-1229-5","article-title":"Botanical epidemiology: Some key advances and its continuing role in disease management","volume":"115","author":"Madden","year":"2006","journal-title":"Eur. J. Plant Pathol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2671","DOI":"10.1080\/02664763.2015.1046823","article-title":"Detecting diagnostic accuracy of two biomarkers through a bivariate log-normal ROC curve","volume":"12","author":"Pundir","year":"2015","journal-title":"J. Appl. Stat."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/j.acra.2010.09.002","article-title":"Using the mean-to-sigma ratio as a measure of the improperness of binormal ROC curves","volume":"18","author":"Hillis","year":"2011","journal-title":"Acad. Radiol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1016\/S1076-6332(97)80013-X","article-title":"Proper receiver operating characteristic analysis: The bigamma model","volume":"4","author":"Dorfman","year":"1997","journal-title":"Acad. Radiol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1002\/1097-0142(1950)3:1<32::AID-CNCR2820030106>3.0.CO;2-3","article-title":"Index for rating diagnostic tests","volume":"3","author":"Youden","year":"1950","journal-title":"Cancer"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1002\/(SICI)1097-0258(20000229)19:4<453::AID-SIM350>3.0.CO;2-5","article-title":"What do we mean by validating a prognostic model?","volume":"19","author":"Altman","year":"2000","journal-title":"Stat. Med."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1080\/10543406.2019.1632876","article-title":"A comprehensive and comparative review of optimal cut-points selection methods for diseases with multiple ordinal stages","volume":"30","author":"Hua","year":"2020","journal-title":"J. Biopharm. Stat."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1148\/109.2.297","article-title":"Evaluation of receiver operating characteristic curve data in terms of information theory, with applications in radiography","volume":"109","author":"Metz","year":"1973","journal-title":"Radiology"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1056\/NEJM197507312930501","article-title":"Primer on certain elements of medical decision making","volume":"293","author":"McNeil","year":"1975","journal-title":"N. Engl. J. Med."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1055\/s-0038-1634358","article-title":"Mutual information as an index of diagnostic test performance","volume":"42","author":"Benish","year":"2003","journal-title":"Methods Inf. Med."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Benish, W.A. (2020). A review of the application of information theory to clinical diagnostic testing. Entropy, 22.","DOI":"10.3390\/e22010097"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1177\/0272989X9201200303","article-title":"Comparing and optimizing diagnostic tests: An information-theoretical approach","volume":"12","author":"Somoza","year":"1992","journal-title":"Med. Decis. Mak."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1109\/TIT.1955.1055138","article-title":"On binary channels and their cascades","volume":"1","author":"Silverman","year":"1955","journal-title":"IRE Trans. Inf. Theory"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1044","DOI":"10.1177\/0962280212439742","article-title":"The channel capacity of a diagnostic test as a function of test sensitivity and test specificity","volume":"24","author":"Benish","year":"2015","journal-title":"Stat. Methods Med. Res."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Oehr, P., and Ecke, T. (2020). Establishment and characterization of an empirical biomarker SS\/PV-ROC plot using results of the UBC\u00ae Rapid Test in bladder cancer. Entropy, 22.","DOI":"10.3390\/e22070729"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1215","DOI":"10.1094\/PDIS-92-8-1215","article-title":"Adaptation of an apple sooty blotch and flyspeck warning system for the Upper Midwest United States","volume":"92","author":"Duttweiler","year":"2008","journal-title":"Plant Dis."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/9\/938\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:07:09Z","timestamp":1760177229000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/9\/938"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,26]]},"references-count":23,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["e22090938"],"URL":"https:\/\/doi.org\/10.3390\/e22090938","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8,26]]}}}