{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T17:53:02Z","timestamp":1777917182284,"version":"3.51.4"},"reference-count":65,"publisher":"SAGE Publications","issue":"4","license":[{"start":{"date-parts":[[1988,12,1]],"date-time":"1988-12-01T00:00:00Z","timestamp":596937600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Med Decis Making"],"published-print":{"date-parts":[[1988,12]]},"abstract":"<jats:p>Physicians increasingly are challenged to make probabilistic judgments quantitatively. Their ability to make such judgments may be directly linked to the quality of care they provide. Many methods are available to evaluate these judgments. Graphic means of assessment include the calibration curve, covariance graph, and receiver operating characteristic (ROC) curve. Statistical tools can measure the significance of departures from ideal calibration, and measure the area under ROC curve. Modeling the calibration curve using linear or logistic regression provides another method to assess probabilistic judgments, although these may be limited by failure of the data to meet the model's assumptions. Scoring rules provide indices of overall judgmental performance, although their reliability is difficult to gauge for small sample sizes. Decompositions of scoring rules separate judgmental performance into functional components. The authors provide preliminary guidelines for choosing methods for specific research in this area. Key Words: medical judgments; probabilistic judgments; ROC curves; calibration; models. (Med Decis Making 8:233-240, 1988)<\/jats:p>","DOI":"10.1177\/0272989x8800800403","type":"journal-article","created":{"date-parts":[[2007,3,18]],"date-time":"2007-03-18T00:13:15Z","timestamp":1174176795000},"page":"233-240","source":"Crossref","is-referenced-by-count":47,"title":["Eualuating Physicians' Probabilistic Judgments"],"prefix":"10.1177","volume":"8","author":[{"given":"Roy M.","family":"Poses","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Randall D.","family":"Cebul","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Robert M.","family":"Centor","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[1988,12,1]]},"reference":[{"key":"atypb1","unstructured":"Afifi AA, Clark V (eds): Computer-Aided Multivariate Analysis. Belmont, CA, Lifetime Learning Publications, 1984, pp 287-308"},{"key":"atypb2","doi-asserted-by":"publisher","DOI":"10.1001\/jama.1985.03360020078028"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1097\/00005650-198309000-00004"},{"key":"atypb4","doi-asserted-by":"publisher","DOI":"10.1016\/0749-5978(85)90007-X"},{"key":"atypb5","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1177\/0272989X8500500215","volume":"5","author":"Centor RM","year":"1985","journal-title":"Med Decis Making"},{"key":"atypb6","doi-asserted-by":"publisher","DOI":"10.1037\/0096-1523.7.4.928"},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.2307\/2348040"},{"key":"atypb8","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X8600600406"},{"key":"atypb9","doi-asserted-by":"publisher","DOI":"10.1001\/archinte.1984.00350160063011"},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X8300300203"},{"key":"atypb11","doi-asserted-by":"publisher","DOI":"10.7326\/0003-4819-99-3-393"},{"key":"atypb12","unstructured":"Fletcher RH , Fletcher SW, Wagner EH: Clinical Epidemiology: the Essentials. Baltimore , Williams and Wilkins, 1982, pp 41-59"},{"key":"atypb13","doi-asserted-by":"publisher","DOI":"10.1016\/0169-2607(86)90090-8"},{"key":"atypb14","unstructured":"Galen RS, Gambino SR: Beyond Normality: The Predictive Value and Efficiency of Medical Diagnoses . New York, John Wiley & Sons , 1975, pp 88-97"},{"key":"atypb15","first-page":"1117","volume":"144","author":"Gelfand DW","year":"1985","journal-title":"Am J Radiol"},{"key":"atypb16","first-page":"453","author":"Griner PF","year":"1981","journal-title":"Ann Intern Med"},{"key":"atypb17","doi-asserted-by":"publisher","DOI":"10.1055\/s-0038-1635297"},{"key":"atypb18","doi-asserted-by":"publisher","DOI":"10.1148\/radiology.143.1.7063747"},{"key":"atypb19","doi-asserted-by":"publisher","DOI":"10.1148\/radiology.148.3.6878708"},{"key":"atypb20","first-page":"333","author":"Harrell FE","year":"1985","journal-title":"Biostatistics"},{"key":"atypb21","doi-asserted-by":"publisher","DOI":"10.1007\/BF02596298"},{"key":"atypb22","doi-asserted-by":"publisher","DOI":"10.1055\/s-0038-1636442"},{"key":"atypb23","doi-asserted-by":"publisher","DOI":"10.1016\/0002-9149(82)90211-9"},{"key":"atypb24","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1975.10479858"},{"key":"atypb25","unstructured":"Ingelfinger JA, Mosteller F, Thibodeau LA, et al (eds): Biostatistics in Clinical Medicine. New York, Macmillan, 1983, pp 160-176"},{"key":"atypb26","doi-asserted-by":"publisher","DOI":"10.1016\/0749-5978(87)90047-1"},{"key":"atypb27","doi-asserted-by":"publisher","DOI":"10.1056\/NEJM198609183151206"},{"key":"atypb28","doi-asserted-by":"publisher","DOI":"10.1016\/0002-9343(86)90807-7"},{"key":"atypb29","doi-asserted-by":"publisher","DOI":"10.1016\/0749-5978(85)90010-X"},{"key":"atypb30","doi-asserted-by":"crossref","unstructured":"Lichtenstein S., Fischoff B., Phillips LD: Calibration of probabilities: the state of the art in 1980. In: Kahneman D, Slovic P, Tversky A (eds): Judgement Under Uncertainty: Heuristics and Biases. Cambridge , Cambridge University Press, 1982 , pp 306-334","DOI":"10.1017\/CBO9780511809477.023"},{"key":"atypb31","doi-asserted-by":"publisher","DOI":"10.1126\/science.171.3977.1217"},{"key":"atypb32","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X8700700305"},{"key":"atypb33","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X8400400203"},{"key":"atypb34","doi-asserted-by":"publisher","DOI":"10.1056\/NEJM197507312930501"},{"key":"atypb35","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.1987.6499281"},{"key":"atypb36","doi-asserted-by":"publisher","DOI":"10.1016\/S0001-2998(78)80014-2"},{"key":"atypb37","doi-asserted-by":"publisher","DOI":"10.7326\/0003-4819-108-3-435"},{"key":"atypb38","unstructured":"Mosteller F. , Rourke Rek: Sturdy Statistics: Nonparametrics and Order Statistics. Reading, MA, Addison-Wesley , 1980 , pp 24-29"},{"key":"atypb39","doi-asserted-by":"publisher","DOI":"10.1175\/1520-0450(1973)012<0595:ANVPOT>2.0.CO;2"},{"key":"atypb40","first-page":"489","volume":"79","author":"Murphy AH","year":"1984","journal-title":"J Am Stat Assoc"},{"key":"atypb41","doi-asserted-by":"publisher","DOI":"10.1016\/0002-9343(83)90819-7"},{"key":"atypb42","doi-asserted-by":"publisher","DOI":"10.1056\/NEJM197507312930505"},{"key":"atypb43","doi-asserted-by":"publisher","DOI":"10.1056\/NEJM198701293160505"},{"key":"atypb44","doi-asserted-by":"publisher","DOI":"10.1001\/jama.1985.03360070063024"},{"key":"atypb45","doi-asserted-by":"publisher","DOI":"10.1016\/0749-5978(87)90012-4"},{"key":"atypb46","unstructured":"Sackett DL, Haynes RB, Tugwell P.: Clinical Epidemiology: A Basic Science for Clinical Medicine. Boston, Little, Brown, 1985, pp 108-126"},{"key":"atypb47","doi-asserted-by":"publisher","DOI":"10.1056\/NEJM197706302962607"},{"key":"atypb48","unstructured":"Siegel S.: Nonparametric Statistics for the Behavioral Sciences. New York, McGraw-Hill, 1956, pp 36-42"},{"key":"atypb49","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(85)91093-1"},{"key":"atypb50","volume-title":"Common Diagnostic Tests. Use and Interpretation","author":"Sox HC Jr","year":"1987"},{"key":"atypb51","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1016\/S0300-5089(21)00720-3","volume":"14","author":"Spiegelhalter DJ","year":"1985","journal-title":"Clin Gastroenterol"},{"key":"atypb52","doi-asserted-by":"publisher","DOI":"10.1126\/science.462188"},{"key":"atypb53","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X8600600103"},{"key":"atypb54","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.29.2.151"},{"key":"atypb55","volume-title":"Proceedings of the Ninth Conference of Probability and Statistics in Atmosphere Sciences","author":"Winkler RL"},{"key":"atypb56","unstructured":"Winkler RL: On \"good probability appraisers.\" In: Goel P, Zellner A (eds): Bayesian Inference and Decision Techniques. New York, Elsevier Science Publishers, 1986, pp 265-278"},{"key":"atypb57","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1967.10500920"},{"key":"atypb58","doi-asserted-by":"crossref","first-page":"1073","DOI":"10.2307\/2283697","volume":"62","author":"Winkler RL","year":"1967","journal-title":"J Am Stat Assoc"},{"key":"atypb59","doi-asserted-by":"publisher","DOI":"10.1175\/1520-0450(1968)007<0751:PA>2.0.CO;2"},{"key":"atypb60","doi-asserted-by":"publisher","DOI":"10.1016\/0749-5978(88)90031-3"},{"key":"atypb61","doi-asserted-by":"publisher","DOI":"10.1016\/0030-5073(82)90237-9"},{"key":"atypb62","doi-asserted-by":"publisher","DOI":"10.1002\/for.3980040110"},{"key":"atypb63","author":"Yates JF","journal-title":"Org Behav Human Decis Proc"},{"key":"atypb64","first-page":"763","volume":"20","author":"Young MJ","year":"1986","journal-title":"Health Serv Res"},{"key":"atypb65","doi-asserted-by":"publisher","DOI":"10.1016\/S0272-2712(18)30940-5"}],"container-title":["Medical Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0272989X8800800403","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0272989X8800800403","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T18:06:51Z","timestamp":1777658811000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0272989X8800800403"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[1988,12]]},"references-count":65,"journal-issue":{"issue":"4","published-print":{"date-parts":[[1988,12]]}},"alternative-id":["10.1177\/0272989X8800800403"],"URL":"https:\/\/doi.org\/10.1177\/0272989x8800800403","relation":{},"ISSN":["0272-989X","1552-681X"],"issn-type":[{"value":"0272-989X","type":"print"},{"value":"1552-681X","type":"electronic"}],"subject":[],"published":{"date-parts":[[1988,12]]}}}