{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T12:54:47Z","timestamp":1791464087021,"version":"4.3.4"},"reference-count":153,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2016,5,10]],"date-time":"2016-05-10T00:00:00Z","timestamp":1462838400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2016,6,1]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>In the practice of point prediction, it is desirable that forecasters receive a directive in the form of a statistical functional. For example, forecasters might be asked to report the mean or a quantile of their predictive distributions. When evaluating and comparing competing forecasts, it is then critical that the scoring function used for these purposes be consistent for the functional at hand, in the sense that the expected score is minimized when following the directive. We show that any scoring function that is consistent for a quantile or an expectile functional can be represented as a mixture of elementary or extremal scoring functions that form a linearly parameterized family. Scoring functions for the mean value and probability forecasts of binary events constitute important examples. The extremal scoring functions admit appealing economic interpretations of quantiles and expectiles in the context of betting and investment problems. The Choquet-type mixture representations give rise to simple checks of whether a forecast dominates another in the sense that it is preferable under any consistent scoring function. In empirical settings it suffices to compare the average scores for only a finite number of extremal elements. Plots of the average scores with respect to the extremal scoring functions, which we call Murphy diagrams, permit detailed comparisons of the relative merits of competing forecasts.<\/jats:p>","DOI":"10.1111\/rssb.12154","type":"journal-article","created":{"date-parts":[[2016,5,11]],"date-time":"2016-05-11T04:38:04Z","timestamp":1462941484000},"page":"505-562","source":"Crossref","is-referenced-by-count":156,"title":["Of Quantiles and Expectiles: Consistent Scoring Functions, Choquet Representations and Forecast Rankings"],"prefix":"10.1093","volume":"78","author":[{"given":"Werner","family":"Ehm","sequence":"first","affiliation":[{"name":"Heidelberger Institut f\u00fcr Theoretische Studien , Heidelberg , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tilmann","family":"Gneiting","sequence":"additional","affiliation":[{"name":"Heidelberger Institut f\u00fcr Theoretische Studien , Heidelberg"},{"name":"Karlsruher Institut f \u00a8 ur Technologie , Karlsruhe , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Jordan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fabian","family":"Kr\u00fcger","sequence":"additional","affiliation":[{"name":"Heidelberger Institut f\u00fcr Theoretische Studien , Heidelberg , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2016,5,10]]},"reference":[{"key":"2023021711190282000_rssb12154-cit-0001","doi-asserted-by":"crossref","first-page":"725","DOI":"10.1080\/14697688.2014.946955","article-title":"On elicitable risk measures","volume":"15","author":"Bellini","year":"2015","journal-title":"Quant. Finan."},{"key":"2023021711190282000_rssb12154-cit-0002","article-title":"Risk management with expectiles","author":"Bellini","year":"2015","journal-title":"Eur. J. Finan."},{"key":"2023021711190282000_rssb12154-cit-0003","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.insmatheco.2013.10.015","article-title":"Generalized quantiles as risk measures","volume":"54","author":"Bellini","year":"2014","journal-title":"Insur. Math. Econ."},{"key":"2023021711190282000_rssb12154-cit-0004","doi-asserted-by":"crossref","first-page":"1924","DOI":"10.1002\/qj.2284","article-title":"Decomposition and graphical portrayal of the quantile score","volume":"140","author":"Bentzien","year":"2014","journal-title":"Q. J. R. Meteorol. Soc."},{"key":"2023021711190282000_rssb12154-cit-0005","doi-asserted-by":"crossref","first-page":"522","DOI":"10.1198\/jasa.2009.ap07184","article-title":"Probabilistic weather forecasting for winter road maintenance","volume":"105","author":"Berrocal","year":"2010","journal-title":"J. Am. Statist. Ass."},{"key":"2023021711190282000_rssb12154-cit-0006","doi-asserted-by":"crossref","first-page":"3075","DOI":"10.1175\/2010MWR3305.1","article-title":"Summary Verification measures and their interpretation for ensemble forecasts","volume":"139","author":"Bradley","year":"2011","journal-title":"Mnthly Weath. Rev."},{"key":"2023021711190282000_rssb12154-cit-0007","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1093\/biomet\/75.4.761","article-title":"M-quantiles","volume":"75","author":"Breckling","year":"1988","journal-title":"Biometrika"},{"key":"2023021711190282000_rssb12154-cit-0008","doi-asserted-by":"crossref","first-page":"1512","DOI":"10.1002\/qj.456","article-title":"Reliability, sufficiency, and the decomposition of proper scores","volume":"135","author":"Br\u00f6cker","year":"2009","journal-title":"Q. J. R. Meteorol. Soc."},{"key":"2023021711190282000_rssb12154-cit-0009","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1007\/BF00967357","article-title":"Extremal convex functions","volume":"19","author":"Bronshtein","year":"1978","journal-title":"Sib. J. Math."},{"key":"2023021711190282000_rssb12154-cit-0010","volume-title":"Loss functions for binary class probability estimation and classification: structure and applications","author":"Buja","year":"2005"},{"key":"2023021711190282000_rssb12154-cit-0011","doi-asserted-by":"crossref","first-page":"621","DOI":"10.1093\/biomet\/asn021","article-title":"Pointwise testing with functional data using the Westfall-Young randomization method","volume":"95","author":"Cox","year":"2008","journal-title":"Biometrika"},{"key":"2023021711190282000_rssb12154-cit-0012","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1007\/s10463-006-0099-8","article-title":"The geometry of proper scoring rules","volume":"59","author":"Dawid","year":"2007","journal-title":"Ann. Inst. Statist. Math."},{"key":"2023021711190282000_rssb12154-cit-0013","doi-asserted-by":"crossref","first-page":"12","DOI":"10.2307\/2987588","article-title":"The comparison and evaluation of forecasters","volume":"32","author":"DeGroot","year":"1983","journal-title":"Statistician"},{"key":"2023021711190282000_rssb12154-cit-0014","article-title":"Risk measures with the CxLS property","author":"Delbaen","year":"2015","journal-title":"Finan. Stochast."},{"key":"2023021711190282000_rssb12154-cit-0015","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1080\/07350015.1995.10524599","article-title":"Comparing predictive accuracy","volume":"13","author":"Diebold","year":"1995","journal-title":"J. Bus. Econ. Statist."},{"key":"2023021711190282000_rssb12154-cit-0016","first-page":"93","article-title":"Regression percentiles using asymmetric squared error loss","volume":"1","author":"Efron","year":"1991","journal-title":"Statist. Sin."},{"key":"2023021711190282000_rssb12154-cit-0017","article-title":"Forecasting conditional probabilities of binary outcomes under misspecification","author":"Elliott","year":"2015","journal-title":"Rev. Econ. Statist."},{"key":"2023021711190282000_rssb12154-cit-0018","doi-asserted-by":"crossref","first-page":"25","DOI":"10.3390\/risks2010025","article-title":"An academic response to Basel 3.5","volume":"2","author":"Embrechts","year":"2014","journal-title":"Risks"},{"key":"2023021711190282000_rssb12154-cit-0019","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1198\/jbes.2009.0003","article-title":"Comparing the point predictions and subjective probability distributions of professional forecasters","volume":"27","author":"Engelberg","year":"2009","journal-title":"J. Bus. Econ. Statist."},{"key":"2023021711190282000_rssb12154-cit-0020","first-page":"2","volume-title":"Handbook of Economic Forecasting","author":"Faust","year":"2013"},{"key":"2023021711190282000_rssb12154-cit-0021","doi-asserted-by":"crossref","first-page":"1615","DOI":"10.1080\/03610929208830868","article-title":"Some aspects of probability forecasting","volume":"21","author":"Feuerverger","year":"1992","journal-title":"Communs Statist. Theor. Meth."},{"key":"2023021711190282000_rssb12154-cit-0022","volume-title":"Higher order elicitability and Osband's principle","author":"Fissler","year":"2015"},{"key":"2023021711190282000_rssb12154-cit-0023","first-page":"58","volume-title":"Expected shortfall is jointly elicitable with value at risk\u2014implications for backtesting","author":"Fissler","year":"2016"},{"key":"2023021711190282000_rssb12154-cit-0024","doi-asserted-by":"crossref","first-page":"746","DOI":"10.1198\/jasa.2011.r10138","article-title":"Making and evaluating point forecasts","volume":"106","author":"Gneiting","year":"2011","journal-title":"J. Am. Statist. Ass."},{"key":"2023021711190282000_rssb12154-cit-0025","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1111\/j.1467-9868.2007.00587.x","article-title":"Probabilistic forecasts, calibration and sharpness","volume":"69","author":"Gneiting","year":"2007","journal-title":"J. R. Statist. Soc."},{"key":"2023021711190282000_rssb12154-cit-0026","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1146\/annurev-statistics-062713-085831","article-title":"Probabilistic forecasting","volume":"1","author":"Gneiting","year":"2014","journal-title":"A. Rev. Statist. Appl."},{"key":"2023021711190282000_rssb12154-cit-0027","doi-asserted-by":"crossref","first-page":"968","DOI":"10.1198\/016214506000000456","article-title":"Calibrated probabilistic forecasting at the Stateline wind energy center: the regime-switching space-time method","volume":"101","author":"Gneiting","year":"2006","journal-title":"J. Am. Statist. Ass."},{"key":"2023021711190282000_rssb12154-cit-0028","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1198\/016214506000001437","article-title":"Strictly proper scoring rules, prediction, and estimation","volume":"102","author":"Gneiting","year":"2007","journal-title":"J. Am. Statist. Ass."},{"key":"2023021711190282000_rssb12154-cit-0029","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1198\/jbes.2010.08110","article-title":"Comparing density forecasts using threshold and quantile weighted proper scoring rules","volume":"29","author":"Gneiting","year":"2011","journal-title":"J. Bus. Econ. Statist."},{"key":"2023021711190282000_rssb12154-cit-0030","doi-asserted-by":"crossref","first-page":"1747","DOI":"10.1214\/13-EJS823","article-title":"Combining predictive distributions","volume":"7","author":"Gneiting","year":"2013","journal-title":"Electron. J. Statist."},{"key":"2023021711190282000_rssb12154-cit-0031","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1198\/0003130031423","article-title":"Local versus global models for classification problems: fitting models where it matters","volume":"57","author":"Hand","year":"2003","journal-title":"Am. Statistn"},{"key":"2023021711190282000_rssb12154-cit-0032","doi-asserted-by":"crossref","first-page":"595","DOI":"10.1214\/13-AOAS709","article-title":"The role of the information set for forecasting\u2014with applications to risk management","volume":"8","author":"Holzmann","year":"2014","journal-title":"Ann. Appl. Statist."},{"key":"2023021711190282000_rssb12154-cit-0033","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1016\/j.ijforecast.2013.07.001","article-title":"Global Energy Forecasting Competition 2012","volume":"30","author":"Hong","year":"2014","journal-title":"Int. J. Forecast."},{"key":"2023021711190282000_rssb12154-cit-0034","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1214\/aoms\/1177703732","article-title":"Robust estimation of a location parameter","volume":"35","author":"Huber","year":"1964","journal-title":"Ann. Math. Statist."},{"key":"2023021711190282000_rssb12154-cit-0035","doi-asserted-by":"crossref","first-page":"61","DOI":"10.7146\/math.scand.a-11506","article-title":"The extremal convex functions","volume":"34","author":"Johansen","year":"1974","journal-title":"Math. Scand."},{"key":"2023021711190282000_rssb12154-cit-0036","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511754098","volume-title":"Quantile Regression","author":"Koenker","year":"2005"},{"key":"2023021711190282000_rssb12154-cit-0037","doi-asserted-by":"crossref","first-page":"33","DOI":"10.2307\/1913643","article-title":"Regression quantiles","volume":"46","author":"Koenker","year":"1978","journal-title":"Econometrica"},{"key":"2023021711190282000_rssb12154-cit-0038","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1214\/aos\/1031833659","article-title":"M-estimation, convexity and quantiles","volume":"25","author":"Koltchinskii","year":"1997","journal-title":"Ann. Statist."},{"key":"2023021711190282000_rssb12154-cit-0039","first-page":"662","article-title":"On the ordering of probability forecasts","volume":"67","author":"Kr\u00e4mer","year":"2005","journal-title":"Sankhya A"},{"key":"2023021711190282000_rssb12154-cit-0040","doi-asserted-by":"crossref","first-page":"1267","DOI":"10.5194\/hess-11-1267-2007","article-title":"Verification tools for probabilistic forecasts of continuous hydrological variables","volume":"11","author":"Laio","year":"2007","journal-title":"Hydrol. Earth Syst. Sci."},{"key":"2023021711190282000_rssb12154-cit-0041","volume-title":"Elicitation and evaluation of statistical forecasts","author":"Lambert","year":"2013"},{"key":"2023021711190282000_rssb12154-cit-0042","doi-asserted-by":"crossref","first-page":"632","DOI":"10.1162\/REST_a_00270","article-title":"Closing the gap between risk estimation and decision making: efficient management of trade-related invasive species risk","volume":"95","author":"Lieli","year":"2013","journal-title":"Rev. Econ. Statist."},{"key":"2023021711190282000_rssb12154-cit-0043","doi-asserted-by":"crossref","first-page":"1087","DOI":"10.1287\/mnsc.22.10.1087","article-title":"Scoring rules for continuous probability distributions","volume":"22","author":"Matheson","year":"1976","journal-title":"Mangmnt Sci."},{"key":"2023021711190282000_rssb12154-cit-0044","volume-title":"Quantitative Risk Management","author":"McNeil","year":"2015"},{"key":"2023021711190282000_rssb12154-cit-0045","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1287\/deca.2013.0280","article-title":"Choosing a strictly proper scoring rule","volume":"10","author":"Merkle","year":"2013","journal-title":"Decisn Anal."},{"key":"2023021711190282000_rssb12154-cit-0046","doi-asserted-by":"crossref","first-page":"803","DOI":"10.1175\/1520-0493(1977)105<0803:TVOCCA>2.0.CO;2","article-title":"The value of climatological, categorical and probabilistic forecasts in the cost-loss ratio situation","volume":"105","author":"Murphy","year":"1977","journal-title":"Mnthly Weath. Rev."},{"key":"2023021711190282000_rssb12154-cit-0047","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1175\/1520-0493(1987)115<1330:AGFFFV>2.0.CO;2","article-title":"A general framework for forecast verification","volume":"115","author":"Murphy","year":"1987","journal-title":"Mnthly Weath. Rev."},{"key":"2023021711190282000_rssb12154-cit-0048","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1017\/S1350482702003043","article-title":"Decision making from probability forecasts based on forecast value","volume":"9","author":"Mylne","year":"2002","journal-title":"Meteorol. Appl."},{"key":"2023021711190282000_rssb12154-cit-0049","doi-asserted-by":"crossref","first-page":"527","DOI":"10.1287\/mnsc.31.5.527","article-title":"Should scoring rules be \u2018effective\u2019?","volume":"31","author":"Nau","year":"1985","journal-title":"Mangmnt Sci."},{"key":"2023021711190282000_rssb12154-cit-0050","doi-asserted-by":"crossref","first-page":"819","DOI":"10.2307\/1911031","article-title":"Asymmetric least squares estimation and testing","volume":"55","author":"Newey","year":"1987","journal-title":"Econometrica"},{"key":"2023021711190282000_rssb12154-cit-0051","doi-asserted-by":"crossref","first-page":"703","DOI":"10.2307\/1913610","article-title":"A simple, positive semi-definite, heteroskedasticity and autocorrelation consistent correlation matrix","volume":"55","author":"Newey","year":"1987","journal-title":"Econometrica"},{"key":"2023021711190282000_rssb12154-cit-0052","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1016\/j.jeconom.2010.03.034","article-title":"Volatility forecast comparison using imperfect volatility proxies","volume":"160","author":"Patton","year":"2011","journal-title":"J. Econmetr."},{"key":"2023021711190282000_rssb12154-cit-0053","volume-title":"Comparing possibly misspecified forecasts","author":"Patton","year":"2015"},{"key":"2023021711190282000_rssb12154-cit-0054","doi-asserted-by":"crossref","DOI":"10.1007\/b76887","volume-title":"Lectures on Choquet's Theorem","author":"Phelps","year":"2001"},{"key":"2023021711190282000_rssb12154-cit-0055","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1002\/qj.49712656313","article-title":"Skill and relative economic value of the ECMWF ensemble prediction system","volume":"126","author":"Richardson","year":"2000","journal-title":"Q. J. R. Meteorol. Soc."},{"key":"2023021711190282000_rssb12154-cit-0056","first-page":"167","volume-title":"Forecast Verification: a Practitioner's Guide in Atmospheric Science","author":"Richardson","year":"2012"},{"key":"2023021711190282000_rssb12154-cit-0057","doi-asserted-by":"crossref","first-page":"492","DOI":"10.1198\/jbes.2009.07213","article-title":"Forecasting recessions: the puzzle of the enduring power of the yield curve","volume":"27","author":"Rudebusch","year":"2009","journal-title":"J. Bus. Econ. Statist."},{"key":"2023021711190282000_rssb12154-cit-0058","doi-asserted-by":"crossref","first-page":"783","DOI":"10.1080\/01621459.1971.10482346","article-title":"Elicitation of personal probabilities and expectations","volume":"66","author":"Savage","year":"1971","journal-title":"J. Am. Statist. Ass."},{"key":"2023021711190282000_rssb12154-cit-0059","doi-asserted-by":"crossref","first-page":"1856","DOI":"10.1214\/aos\/1176347398","article-title":"A general method for comparing probability assessors","volume":"17","author":"Schervish","year":"1989","journal-title":"Ann. Statist."},{"key":"2023021711190282000_rssb12154-cit-0060","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1177\/1471082X14561155","article-title":"Expectile and quantile regression\u2014David and Goliath?","volume":"15","author":"Schulze Waltrup","year":"2015","journal-title":"Statist. Modllng"},{"key":"2023021711190282000_rssb12154-cit-0061","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1007\/BF02289503","article-title":"Admissible probability measurement procedures","volume":"31","author":"Shuford","year":"1966","journal-title":"Psychometrika"},{"key":"2023021711190282000_rssb12154-cit-0062","doi-asserted-by":"crossref","first-page":"18901","DOI":"10.3402\/tellusa.v64i0.18901","article-title":"Added economic value of limited-area multi-EPS weather forecasting applications","volume":"64","author":"Smet","year":"2012","journal-title":"Tellus"},{"key":"2023021711190282000_rssb12154-cit-0063","first-page":"1","article-title":"Elicitation and identification of properties","volume":"35","author":"Steinwart","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"2023021711190282000_rssb12154-cit-0064","volume-title":"Cross-calibration of probabilistic forecasts","author":"Str\u00e4hl","year":"2015"},{"key":"2023021711190282000_rssb12154-cit-0065","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1175\/1520-0493(1955)083<0249:TEUOWF>2.0.CO;2","article-title":"The economic utility of weather forecasts","volume":"83","author":"Thompson","year":"1955","journal-title":"Mnthly Weath. Rev."},{"key":"2023021711190282000_rssb12154-cit-0066","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1016\/0022-0531(79)90042-5","article-title":"Eliciting production possibilities from a well-informed manager","volume":"20","author":"Thomson","year":"1979","journal-title":"J. Econ. Theor."},{"key":"2023021711190282000_rssb12154-cit-0067","volume-title":"Theoretical guidelines for a partially informed forecast examiner","author":"Tsyplakov","year":"2014"},{"key":"2023021711190282000_rssb12154-cit-0068","doi-asserted-by":"crossref","first-page":"808","DOI":"10.1080\/01621459.1983.10477025","article-title":"Calibration, sufficiency, and domination considerations for Bayesian probability assessors","volume":"78","author":"Vardeman","year":"1983","journal-title":"J. Am. Statist. Ass."},{"key":"2023021711190282000_rssb12154-cit-0069","volume-title":"Resampling-based Multiple Testing","author":"Westfall","year":"1993"},{"key":"2023021711190282000_rssb12154-cit-0070","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1017\/S1350482701002092","article-title":"A skill score based on economic value for probability forecasts","volume":"8","author":"Wilks","year":"2001","journal-title":"Meteorol. Appl."},{"key":"2023021711190282000_rssb12154-cit-0071","volume-title":"The New Palgrave Dictionary of Economics","author":"Wolfers","year":"2008"},{"key":"2023021711190282000_rssb12154-cit-0072","article-title":"Coherence and elicitability","author":"Ziegel","year":"2014","journal-title":"Math. Finan."},{"key":"2023021711190282000_rssb12154-cit-1001","first-page":"1","volume-title":"Proc. 28th Conf. Learning Theory","author":"Agarwal","year":"2015"},{"key":"2023021711190282000_rssb12154-cit-1002","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1002\/env.1018","article-title":"Structural analysis of spatio-temporal threshold exceedances","volume":"21","author":"Angulo","year":"2010","journal-title":"Environmetrics"},{"key":"2023021711190282000_rssb12154-cit-1003","volume-title":"Information and Exponential Families in Statistical Theory","author":"Barndorff-Nielsen","year":"1978"},{"key":"2023021711190282000_rssb12154-cit-1004","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1198\/016214505000000907","article-title":"Convexity, classification, and risk bounds","volume":"101","author":"Bartlett","year":"2006","journal-title":"J. Am. Statist. Ass."},{"key":"2023021711190282000_rssb12154-cit-1005","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1007\/s10463-013-0412-2","article-title":"The harmonic moment tail index estimator: asymptotic distribution and robustness","volume":"66","author":"Beran","year":"2014","journal-title":"Ann. Inst. Statist. Math."},{"key":"2023021711190282000_rssb12154-cit-1006","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1016\/j.jeconom.2013.04.009","article-title":"Time-varying combinations of predictive densities using nonlinear filtering","volume":"177","author":"Billio","year":"2013","journal-title":"J. Econmetr."},{"key":"2023021711190282000_rssb12154-cit-1007","doi-asserted-by":"crossref","first-page":"200","DOI":"10.1016\/0041-5553(67)90040-7","article-title":"The relaxation method of finding a common point of convex sets and its application to the solution of problems in convex programming","volume":"7","author":"Bregman","year":"1967","journal-title":"Computnl Math. Math. Phys. USSR"},{"key":"2023021711190282000_rssb12154-cit-1008","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1175\/1520-0493(1950)078<0001:VOFEIT>2.0.CO;2","article-title":"Verification of forecasts expressed in terms of probability","volume":"78","author":"Brier","year":"1950","journal-title":"Mnthly Weath. Rev."},{"key":"2023021711190282000_rssb12154-cit-1009","first-page":"197","volume-title":"Advances in Neural Information Processing Systems","author":"Calauz\u00e8nes","year":"2012"},{"key":"2023021711190282000_rssb12154-cit-1010","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1007\/s10994-013-5382-3","article-title":"Calibration and regret bounds for order-preserving surrogate losses in learning to rank","volume":"93","author":"Calauz\u00e8nes","year":"2013","journal-title":"Mach. Learn."},{"key":"2023021711190282000_rssb12154-cit-1011","doi-asserted-by":"crossref","first-page":"841","DOI":"10.2307\/2527341","article-title":"Evaluating interval forecasts","volume":"39","author":"Christoffersen","year":"1998","journal-title":"Int. Econ. Rev."},{"key":"2023021711190282000_rssb12154-cit-1012","first-page":"121","volume-title":"Causality, Prediction, and Specification Analysis: Recent Advances and Future Directions, Essays in Honor of Halbert L. White, Jr","author":"Corradi","year":"2013"},{"key":"2023021711190282000_rssb12154-cit-1013","volume-title":"Computational Information Geometry for Image and Signal Processing","author":"Critchley","year":"2015"},{"key":"2023021711190282000_rssb12154-cit-1014","first-page":"210","volume-title":"Encyclopedia of Statistical Sciences","author":"Dawid","year":"1986"},{"key":"2023021711190282000_rssb12154-cit-1015","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1111\/sjos.12168","article-title":"Minimum scoring rule inference","volume":"43","author":"Dawid","year":"2016","journal-title":"Scand. J. Statist."},{"key":"2023021711190282000_rssb12154-cit-1016","volume-title":"Optimal Statistical Decisions","author":"DeGroot","year":"1970"},{"key":"2023021711190282000_rssb12154-cit-1017","doi-asserted-by":"crossref","first-page":"12","DOI":"10.2307\/2987588","article-title":"The comparison and evaluation of forecasters","volume":"32","author":"DeGroot","year":"1983","journal-title":"Statistician"},{"key":"2023021711190282000_rssb12154-cit-1018","volume-title":"Assessing point forecast accuracy by stochastic error distance","author":"Diebold","year":"2015"},{"key":"2023021711190282000_rssb12154-cit-1019","doi-asserted-by":"crossref","first-page":"2292","DOI":"10.1214\/13-AOS1142","article-title":"The asymptotics of ranking algorithms","volume":"41","author":"Duchi","year":"2013","journal-title":"Ann. Statist."},{"key":"2023021711190282000_rssb12154-cit-1020","doi-asserted-by":"crossref","first-page":"1107","DOI":"10.1111\/0034-6527.00363","article-title":"Estimation and testing of forecast rationality under flexible loss","volume":"72","author":"Elliott","year":"2005","journal-title":"Rev. Econ. Stud."},{"key":"2023021711190282000_rssb12154-cit-1021","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1016\/j.jeconom.2015.02.047","article-title":"Generalised density forecast combinations","volume":"188","author":"Fawcett","year":"2015","journal-title":"J. Econmetr."},{"key":"2023021711190282000_rssb12154-cit-1022","article-title":"Higher order elicitability and Osband's principle","author":"Fissler","year":"2015","journal-title":"Ann. Statist."},{"key":"2023021711190282000_rssb12154-cit-1023","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-13129-0_29","volume-title":"General truthfulness characterizations via convex analysis","author":"Frongillo","year":"2014"},{"key":"2023021711190282000_rssb12154-cit-1024","first-page":"3240","volume-title":"Advances in Neural Information Processing Systems","author":"Frongillo","year":"2015"},{"key":"2023021711190282000_rssb12154-cit-1025","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/j.ijforecast.2009.10.007","article-title":"Comparing and evaluating Bayesian predictive distributions of asset returns","volume":"26","author":"Geweke","year":"2010","journal-title":"Int. J. Forecast."},{"key":"2023021711190282000_rssb12154-cit-1026","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1016\/j.jeconom.2011.02.017","article-title":"Optimal prediction pools","volume":"164","author":"Geweke","year":"2011","journal-title":"J. Econmetr."},{"key":"2023021711190282000_rssb12154-cit-1027","doi-asserted-by":"crossref","first-page":"595","DOI":"10.1002\/jae.1177","article-title":"Forecast comparisons in unstable environments","volume":"25","author":"Giacomini","year":"2010","journal-title":"J. Appl. Econmetr."},{"key":"2023021711190282000_rssb12154-cit-1028","doi-asserted-by":"crossref","first-page":"746","DOI":"10.1198\/jasa.2011.r10138","article-title":"Making and evaluating point forecasts","volume":"106","author":"Gneiting","year":"2011","journal-title":"J. Am. Statist. Ass."},{"key":"2023021711190282000_rssb12154-cit-1029","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1198\/016214506000001437","article-title":"Strictly proper scoring rules, prediction, and estimation","volume":"102","author":"Gneiting","year":"2007","journal-title":"J. Am. Statist. Ass."},{"key":"2023021711190282000_rssb12154-cit-1030","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1198\/jbes.2010.08110","article-title":"Comparing density forecasts using threshold and quantile weighted proper scoring rules","volume":"29","author":"Gneiting","year":"2011","journal-title":"J. Bus. Econ. Statist."},{"key":"2023021711190282000_rssb12154-cit-1031","doi-asserted-by":"crossref","first-page":"1747","DOI":"10.1214\/13-EJS823","article-title":"Combining predictive distributions","volume":"7","author":"Gneiting","year":"2013","journal-title":"Electron. J. Statist."},{"key":"2023021711190282000_rssb12154-cit-1032","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.ijforecast.2006.08.001","article-title":"Combining density forecasts","volume":"23","author":"Hall","year":"2007","journal-title":"Int. J. Forecast."},{"key":"2023021711190282000_rssb12154-cit-1033","doi-asserted-by":"crossref","first-page":"1916","DOI":"10.1214\/aoms\/1177693057","article-title":"Proper scores for probability forecasters","volume":"42","author":"Hendrickson","year":"1971","journal-title":"Ann. Math. Statist."},{"key":"2023021711190282000_rssb12154-cit-1034","doi-asserted-by":"crossref","DOI":"10.2139\/ssrn.2605927","volume-title":"Robust forecast comparison","author":"Jin","year":"2015"},{"key":"2023021711190282000_rssb12154-cit-1035","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/0167-7152(94)90031-0","article-title":"Expectiles and M-quantiles are quantiles","volume":"20","author":"Jones","year":"1994","journal-title":"Statist. Probab. Lett."},{"key":"2023021711190282000_rssb12154-cit-1036","volume-title":"R Package \u2018murphydiagram\u2019, Version 0.11","author":"Jordan","year":"2016"},{"key":"2023021711190282000_rssb12154-cit-1037","doi-asserted-by":"crossref","first-page":"1287","DOI":"10.1287\/opre.1080.0665","article-title":"Evaluating quantile assessments","volume":"57","author":"Jose","year":"2009","journal-title":"Oper. Res."},{"key":"2023021711190282000_rssb12154-cit-1038","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1002\/for.1147","article-title":"Combining inflation density forecasts","volume":"29","author":"Kascha","year":"2010","journal-title":"J. Forecast."},{"key":"2023021711190282000_rssb12154-cit-1039","volume-title":"Geometrical Foundations of Asymptotic Inference","author":"Kass","year":"2011"},{"key":"2023021711190282000_rssb12154-cit-1040","volume-title":"Elicitation and evaluation of statistical forecasts","author":"Lambert","year":"2013"},{"key":"2023021711190282000_rssb12154-cit-1041","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1016\/j.jeconom.2014.04.018","article-title":"Nonparametric and semiparametric regressions subject to monotonicity constraints: estimation and forecasting","volume":"182","author":"Lee","year":"2014","journal-title":"J. Econmetr."},{"key":"2023021711190282000_rssb12154-cit-1042","volume-title":"Forecaster's dilemma: extreme events and forecast evaluation","author":"Lerch","year":"2015"},{"key":"2023021711190282000_rssb12154-cit-1043","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2307\/1402448","article-title":"Scoring rules and the inevitability of probability","volume":"50","author":"Lindley","year":"1982","journal-title":"Int. Statist. Rev."},{"key":"2023021711190282000_rssb12154-cit-1044","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1016\/j.jeconom.2009.08.002","article-title":"An improved bootstrap test of stochastic dominance","volume":"154","author":"Linton","year":"2010","journal-title":"J. Econmetr."},{"key":"2023021711190282000_rssb12154-cit-1045","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1002\/env.1141","article-title":"Spatial threshold exceedance analysis through marked point processes","volume":"23","author":"Madrid","year":"2012","journal-title":"Environmetrics"},{"key":"2023021711190282000_rssb12154-cit-1046","article-title":"Zero expectile processes and Bayesian spatial regression","author":"Majumdar","year":"2015","journal-title":"J. Computnl Graph. Statist."},{"key":"2023021711190282000_rssb12154-cit-1047","first-page":"68","volume-title":"Proc. 27th Conf. Learning Theory","author":"Menon","year":"2014"},{"key":"2023021711190282000_rssb12154-cit-1048","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1287\/deca.2013.0280","article-title":"Choosing a strictly proper scoring rule","volume":"10","author":"Merkle","year":"2013","journal-title":"Decisn Anal."},{"key":"2023021711190282000_rssb12154-cit-1049","doi-asserted-by":"crossref","first-page":"995","DOI":"10.1111\/j.1468-0084.2005.00149.x","article-title":"Evaluating, comparing and combining density forecasts using the KLIC with an application to the Bank of England and NIESER \u201cfan\u201d charts of inflation","volume":"67","author":"Mitchell","year":"2005","journal-title":"Oxf. Bull. Econ. Statist."},{"key":"2023021711190282000_rssb12154-cit-1050","doi-asserted-by":"crossref","first-page":"1437","DOI":"10.1162\/089976604323057452","article-title":"Information geometry of U-boost and Bregman divergence","volume":"16","author":"Murata","year":"2004","journal-title":"Neurl Computn"},{"key":"2023021711190282000_rssb12154-cit-1051","doi-asserted-by":"crossref","first-page":"595","DOI":"10.1175\/1520-0450(1973)012<0595:ANVPOT>2.0.CO;2","article-title":"A new vector partition of the probability score","volume":"12","author":"Murphy","year":"1973","journal-title":"J. Appl. Meteorol."},{"key":"2023021711190282000_rssb12154-cit-1052","doi-asserted-by":"crossref","first-page":"2417","DOI":"10.1175\/1520-0493(1988)116<2417:SSBOTM>2.0.CO;2","article-title":"Skill scores based on the mean square error and their relationships to the correlation coefficient","volume":"116","author":"Murphy","year":"1988","journal-title":"Mnthly Weath. Rev."},{"key":"2023021711190282000_rssb12154-cit-1053","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1175\/1520-0434(1993)008<0281:WIAGFA>2.0.CO;2","article-title":"What is a good forecast?: An essay on the nature of goodness in weather forecasting","volume":"8","author":"Murphy","year":"1993","journal-title":"Weath. Forecast."},{"key":"2023021711190282000_rssb12154-cit-1054","volume-title":"Providing incentives for better cost forecasting","author":"Osband","year":"1985"},{"key":"2023021711190282000_rssb12154-cit-1055","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1016\/0047-2727(85)90031-3","article-title":"Information-eliciting compensation schemes","volume":"27","author":"Osband","year":"1985","journal-title":"J. Publ. Econ."},{"key":"2023021711190282000_rssb12154-cit-1056","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1016\/j.jeconom.2010.03.034","article-title":"Volatility forecast comparison using imperfect volatility proxies","volume":"160","author":"Patton","year":"2011","journal-title":"J. Econmetr."},{"key":"2023021711190282000_rssb12154-cit-1057","volume-title":"Comparing possibly misspecified forecasts","author":"Patton","year":"2015"},{"key":"2023021711190282000_rssb12154-cit-1058","doi-asserted-by":"crossref","DOI":"10.1007\/978-94-017-2450-0","volume-title":"Nonlinear Statistical Models","author":"P\u00e1zman","year":"1993"},{"key":"2023021711190282000_rssb12154-cit-1059","doi-asserted-by":"crossref","DOI":"10.1007\/b76887","volume-title":"Lectures on Choquet's Theorem","author":"Phelps","year":"2001"},{"key":"2023021711190282000_rssb12154-cit-1060","article-title":"Convex calibration dimension for multiclass loss matrices","author":"Ramaswamy","year":"2016","journal-title":"J. Mach. Learn. Res."},{"key":"2023021711190282000_rssb12154-cit-1061","first-page":"731","article-title":"Information, divergence and risk for binary experiments","volume":"12","author":"Reid","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"2023021711190282000_rssb12154-cit-1062","volume-title":"Handbook of Economic Forecasting","author":"Rossi","year":"2013"},{"key":"2023021711190282000_rssb12154-cit-1063","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1016\/j.chemolab.2014.12.008","article-title":"Entropy based statistical inference for methane emissions released from wetland","volume":"141","author":"Sabolov\u00e1","year":"2015","journal-title":"Chemometr. Intell. Lab. Syst."},{"key":"2023021711190282000_rssb12154-cit-1064","doi-asserted-by":"crossref","first-page":"783","DOI":"10.1080\/01621459.1971.10482346","article-title":"Elicitation of personal probabilities and expectations","volume":"66","author":"Savage","year":"1971","journal-title":"J. Am. Statist. Ass."},{"key":"2023021711190282000_rssb12154-cit-1065","doi-asserted-by":"crossref","first-page":"1856","DOI":"10.1214\/aos\/1176347398","article-title":"A general method for comparing probability assessors","volume":"17","author":"Schervish","year":"1989","journal-title":"Ann. Statist."},{"key":"2023021711190282000_rssb12154-cit-1066","doi-asserted-by":"crossref","first-page":"958","DOI":"10.1214\/12-EJS699","article-title":"Calibrated asymmetric surrogate losses","volume":"6","author":"Scott","year":"2012","journal-title":"Electron. J. Statist."},{"key":"2023021711190282000_rssb12154-cit-1067","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-34675-5","volume-title":"Stochastic Orders","author":"Shaked","year":"2007"},{"key":"2023021711190282000_rssb12154-cit-1068","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1007\/BF02289503","article-title":"Admissible probability measurement procedures","volume":"31","author":"Shuford","year":"1966","journal-title":"Psychometrika"},{"key":"2023021711190282000_rssb12154-cit-1069","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4757-1862-1","volume-title":"Sequential Analysis","author":"Siegmund","year":"1985"},{"key":"2023021711190282000_rssb12154-cit-1070","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1007\/s001840200206","article-title":"Distributions of exact tests in the exponential family","volume":"57","author":"Stehl\u00edk","year":"2003","journal-title":"Metrika"},{"key":"2023021711190282000_rssb12154-cit-1071","doi-asserted-by":"crossref","first-page":"972","DOI":"10.1063\/1.4765604","article-title":"Decompositions of information divergences: recent development, open problems and applications","volume":"1493","author":"Stehl\u00edk","year":"2012","journal-title":"AIP Conf. Proc."},{"key":"2023021711190282000_rssb12154-cit-1072","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1007\/s00365-006-0662-3","article-title":"How to compare different loss functions","volume":"26","author":"Steinwart","year":"2007","journal-title":"Constr. Approx."},{"key":"2023021711190282000_rssb12154-cit-1073","first-page":"1","volume-title":"Proc. 27th Conf. Learning Theory","author":"Steinwart","year":"2014"},{"key":"2023021711190282000_rssb12154-cit-1074","volume-title":"Cross-calibration of probabilistic forecasts","author":"Str\u00e4hl","year":"2015"},{"key":"2023021711190282000_rssb12154-cit-1075","doi-asserted-by":"crossref","first-page":"1277","DOI":"10.1109\/TIT.2011.2178139","article-title":"On Bregman distances and divergences of probability measures","volume":"58","author":"Stummer","year":"2012","journal-title":"IEEE Trans. Inform. Theor."},{"key":"2023021711190282000_rssb12154-cit-1076","volume-title":"Superforecasting: the Art and Science of Prediction","author":"Tetlock","year":"2015"},{"key":"2023021711190282000_rssb12154-cit-1077","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1007\/11503415_10","volume-title":"Proc. 18th A. Conf. Learning Theory","author":"Tewari","year":"2005"},{"key":"2023021711190282000_rssb12154-cit-1078","volume-title":"Handbook of Economic Forecasting","author":"Timmermann","year":"2006"},{"key":"2023021711190282000_rssb12154-cit-1079","doi-asserted-by":"crossref","first-page":"3387","DOI":"10.1175\/2010MWR3229.1","article-title":"Kullback\u2013Leibler divergence as a forecast skill score with classic reliability\u2013resolution\u2013uncertainty decomposition","volume":"138","author":"Weijs","year":"2010","journal-title":"Mnthly Weath. Rev."},{"key":"2023021711190282000_rssb12154-cit-1080","volume-title":"Bayesian Forecasting and Dynamic Models","author":"West","year":"1999"},{"key":"2023021711190282000_rssb12154-cit-1081","first-page":"1225","article-title":"Statistical analysis of some multi-category large margin classification methods","volume":"5","author":"Zhang","year":"2004","journal-title":"J. Mach. Learn. Res."}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Frssb.12154","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/78\/3\/505\/49236469\/jrsssb_78_3_505.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/78\/3\/505\/49236469\/jrsssb_78_3_505.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,16]],"date-time":"2024-06-16T09:24:53Z","timestamp":1718529893000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/78\/3\/505\/7040984"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,5,10]]},"references-count":153,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2016,5,10]]},"published-print":{"date-parts":[[2016,6,1]]}},"URL":"https:\/\/doi.org\/10.1111\/rssb.12154","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2016,6]]},"published":{"date-parts":[[2016,5,10]]}}}