{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,16]],"date-time":"2026-10-16T22:04:58Z","timestamp":1792188298475,"version":"4.4.0"},"reference-count":41,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2020,1,14]],"date-time":"2020-01-14T00:00:00Z","timestamp":1578960000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The fundamental information theory functions of entropy, relative entropy, and mutual information are directly applicable to clinical diagnostic testing. This is a consequence of the fact that an individual\u2019s disease state and diagnostic test result are random variables. In this paper, we review the application of information theory to the quantification of diagnostic uncertainty, diagnostic information, and diagnostic test performance. An advantage of information theory functions over more established test performance measures is that they can be used when multiple disease states are under consideration as well as when the diagnostic test can yield multiple or continuous results. Since more than one diagnostic test is often required to help determine a patient\u2019s disease state, we also discuss the application of the theory to situations in which more than one diagnostic test is used. The total diagnostic information provided by two or more tests can be partitioned into meaningful components.<\/jats:p>","DOI":"10.3390\/e22010097","type":"journal-article","created":{"date-parts":[[2020,1,15]],"date-time":"2020-01-15T03:20:22Z","timestamp":1579058422000},"page":"97","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":25,"title":["A Review of the Application of Information Theory to Clinical Diagnostic Testing"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2049-5437","authenticated-orcid":false,"given":"William A.","family":"Benish","sequence":"first","affiliation":[{"name":"Department of Internal Medicine, Case Western Reserve University, Cleveland, OH 44106, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,1,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"535","DOI":"10.1002\/j.1538-7305.1928.tb01236.x","article-title":"Transmission of information","volume":"7","author":"Hartley","year":"1928","journal-title":"Bell Syst. Tech. J."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1055\/s-0038-1636670","article-title":"The diagnostic process with special reference to errors","volume":"10","author":"Good","year":"1971","journal-title":"Methods Inf. Med."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1148\/109.2.297","article-title":"Evaluation of receiver operating characteristic curve data in terms of information theory, with applications in radiography","volume":"109","author":"Metz","year":"1973","journal-title":"Radiology"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1056\/NEJM197507312930501","article-title":"Primer on certain elements of medical decision making","volume":"293","author":"McNeil","year":"1975","journal-title":"NEJM"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1161\/01.CIR.63.4.915","article-title":"Application of information theory to clinical diagnostic testing. The electrocardiographic stress test","volume":"63","author":"Diamond","year":"1981","journal-title":"Circulation"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1177\/0272989X9201200303","article-title":"Comparing and optimizing diagnostic tests: An information-theoretical approach","volume":"12","author":"Somoza","year":"1992","journal-title":"Med. Decis. Mak."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1177\/0272989X9901900211","article-title":"Relative entropy as a measure of diagnostic information","volume":"19","author":"Benish","year":"1999","journal-title":"Med. Decis. Mak."},{"key":"ref_9","unstructured":"Hughes, G. (2012). Applications of Information Theory to Epidemiology, APS Press."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1653","DOI":"10.1175\/1520-0493(2002)130<1653:EPFUIT>2.0.CO;2","article-title":"Evaluating probabilistic forecasts using information theory","volume":"130","author":"Roulston","year":"2002","journal-title":"Mon. Weather Rev."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1016\/0022-2836(86)90165-8","article-title":"Information content of binding sites on nucleotide sequences","volume":"188","author":"Schneider","year":"1986","journal-title":"J. Mol. Biol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2738","DOI":"10.1103\/PhysRevA.51.2738","article-title":"Quantum coding","volume":"51","author":"Schumacher","year":"1995","journal-title":"Phys. Rev. A"},{"key":"ref_13","unstructured":"Coombs, C.H., Dawes, R.M., and Tversky, A. (1970). Mathematical Psychology: An Elementary Introduction, Prentice-Hall."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1094\/PHYTO-02-14-0044-R","article-title":"Information graphs for binary predictors","volume":"105","author":"Hughes","year":"2015","journal-title":"Phytopathology"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1002\/bs.3830070202","article-title":"Information theory and music","volume":"7","author":"Cohen","year":"1962","journal-title":"Behav. Sci."},{"key":"ref_16","first-page":"178","article-title":"Energy and information","volume":"224","author":"Tribus","year":"1971","journal-title":"Sci. Am."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1055\/s-0038-1634358","article-title":"Mutual information as an index of diagnostic test performance","volume":"42","author":"Benish","year":"2003","journal-title":"Methods Inf. Med."},{"key":"ref_18","unstructured":"Shannon, C.E., and Weaver, W. (1963). The Mathematical Theory of Communication, University of Illinois Press."},{"key":"ref_19","unstructured":"Tribus, M. (1961). Thermostatics and Thermodynamics, D. van Nostrand."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"552","DOI":"10.3414\/ME0627","article-title":"Intuitive and axiomatic arguments for quantifying diagnostic test performance in units of information","volume":"48","author":"Benish","year":"2009","journal-title":"Methods Inf. Med."},{"key":"ref_21","unstructured":"Acz\u00e9l, J., and Dor\u00f3czy, Z. (1975). On Measures of Information and Their Characterizations, Academic Press."},{"key":"ref_22","first-page":"1","article-title":"Entropy-New Editor-in-Chief and Outlook","volume":"11","year":"2009","journal-title":"Entropy"},{"key":"ref_23","unstructured":"Cover, T.M., and Thomas, J.A. (1991). Elements of Information Theory, John Wiley and Sons."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1214\/aoms\/1177729694","article-title":"On information and sufficiency","volume":"22","author":"Kullback","year":"1951","journal-title":"Ann. Math. Stat."},{"key":"ref_25","first-page":"183","article-title":"What is the use of a distribution?","volume":"Volume 2","author":"Krishnaiah","year":"1969","journal-title":"Multivariate Analysis"},{"key":"ref_26","unstructured":"Kittel, C., and Kroemer, H. (1980). Thermal Physics, W.H. Freeman and Company. [2nd ed.]."},{"key":"ref_27","first-page":"60.1","article-title":"A logical analysis of medicine","volume":"Volume 3","author":"Passmore","year":"1974","journal-title":"A Companion to Medical Studies"},{"key":"ref_28","first-page":"1341","article-title":"The probability of induction","volume":"Volume 2","author":"Newman","year":"1956","journal-title":"The World of Mathematics"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1093\/biomet\/66.2.393","article-title":"Studies in the history of probability and statistics. XXXVII. A. M. Turing\u2019s statistical work in World War II","volume":"66","author":"Good","year":"1979","journal-title":"Biometrika"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1111\/j.1365-2753.2006.00710.x","article-title":"Bridging the gap between clinical practice and diagnostic clinical epidemiology: Pilot experiences with a didactic model based on a logarithmic scale","volume":"13","author":"Ende","year":"2007","journal-title":"J. Evaluation Clin. Pr."},{"key":"ref_31","unstructured":"Green, D.M., and Swets, J.A. (1966). Signal Detection Theory and Psychophysics, John Wiley and Sons Inc."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1148\/radiology.143.1.7063747","article-title":"The meaning and use of the area under a receiver operating characteristic (ROC) curve","volume":"143","author":"Hanley","year":"1982","journal-title":"Radiology"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/0020-7101(89)90029-9","article-title":"Evaluation and optimization of diagnostic tests using receiver operating characteristic analysis and information theory","volume":"24","author":"Somoza","year":"1989","journal-title":"Int. J. Biomed. Comput."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1056\/NEJM197709292971301","article-title":"Bayesian analysis of electrocardiographic exercise stress testing","volume":"297","author":"Rifkin","year":"1977","journal-title":"N. Engl. J. Med."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1177\/0272989X8500500207","article-title":"Maximum Shannon information content of diagnostic medical testing: Including application to multiple non-independent tests","volume":"5","author":"Rifkin","year":"1985","journal-title":"Med. Decis. Mak."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1093\/ije\/28.3.521","article-title":"Selecting diagnostic tests for ruling out or ruling in disease: The use of the Kullback-Leibler distance","volume":"28","author":"Lee","year":"1999","journal-title":"Int. J. Epidemiol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1044","DOI":"10.1177\/0962280212439742","article-title":"The channel capacity of a diagnostic test as a function of test sensitivity and test specificity","volume":"24","author":"Benish","year":"2015","journal-title":"Stat. Methods Med. Res."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1046\/j.1538-7836.2003.00131.x","article-title":"Combined use of clinical assessment and d-dimer to improve the management of patients presenting to the emergency department with suspected deep vein thrombosis (the EDITED Study)","volume":"1","author":"Anderson","year":"2003","journal-title":"J. Thromb. Haemost."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"2229","DOI":"10.1056\/NEJMsb1503104","article-title":"Precision medicine\u2014Personalized, problematic, and promising","volume":"372","author":"Jameson","year":"2015","journal-title":"NEJM"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"494","DOI":"10.1093\/bib\/bbv060","article-title":"Problems, challenges and promises: Perspectives on precision medicine","volume":"17","author":"Duffy","year":"2016","journal-title":"Brief Bioinform."},{"key":"ref_41","unstructured":"Munkres, J.R. (1975). Topology: A First Course, Prentice-Hall."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/1\/97\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T14:26:22Z","timestamp":1760365582000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/1\/97"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,14]]},"references-count":41,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,1]]}},"alternative-id":["e22010097"],"URL":"https:\/\/doi.org\/10.3390\/e22010097","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1,14]]}}}