{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T21:01:19Z","timestamp":1778014879931,"version":"3.51.4"},"reference-count":74,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2013,10,12]],"date-time":"2013-10-12T00:00:00Z","timestamp":1381536000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Mach Learn"],"published-print":{"date-parts":[[2014,6]]},"DOI":"10.1007\/s10994-013-5401-4","type":"journal-article","created":{"date-parts":[[2013,10,13]],"date-time":"2013-10-13T23:27:08Z","timestamp":1381706828000},"page":"261-289","source":"Crossref","is-referenced-by-count":58,"title":["Forecast aggregation via recalibration"],"prefix":"10.1007","volume":"95","author":[{"given":"Brandon M.","family":"Turner","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mark","family":"Steyvers","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Edgar C.","family":"Merkle","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David V.","family":"Budescu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas S.","family":"Wallsten","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2013,10,12]]},"reference":[{"key":"5401_CR1","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1037\/1076-898X.6.2.130","volume":"6","author":"D. Ariely","year":"2000","unstructured":"Ariely, D., Au, W. T., Bender, R. H., Budescu, D. V., Dietz, C. B., Gu, H., Wallsten, T. S., & Zauberman, G. (2000). The effects of averaging subjective probability estimates between and within judges. Journal of Experimental Psychology. Applied, 6, 130\u2013147.","journal-title":"Journal of Experimental Psychology. Applied"},{"key":"5401_CR2","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1177\/0272989X9501500204","volume":"15","author":"H. R. Arkes","year":"1995","unstructured":"Arkes, H. R., Dawson, N. V., Speroff, T., Harrell, F. E. Jr., Alzola, C., Phillips, R., Desbiens, N., Oye, R. K., Knaus, W., & Connors, A. F. Jr. (1995). The covariance decomposition of the probability score and its use in evaluating prognostic estimates. Medical Decision Making, 15, 120\u2013131.","journal-title":"Medical Decision Making"},{"key":"5401_CR3","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-306-47630-3","volume-title":"Principles of forecasting","author":"J. S. Armstrong","year":"2001","unstructured":"Armstrong, J. S. (2001). Principles of forecasting. Norwell: Kluwer Academic."},{"key":"5401_CR4","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1006\/obhd.1996.0067","volume":"67","author":"M. H. Birnbaum","year":"1996","unstructured":"Birnbaum, M. H., & McIntosh, W. R. (1996). Violations of branch independence in choices between gambles. Organizational Behavior and Human Decision Processes, 67, 91\u2013110.","journal-title":"Organizational Behavior and Human Decision Processes"},{"key":"5401_CR5","first-page":"123","volume":"24","author":"L. Breiman","year":"1996","unstructured":"Breiman, L. (1996). Bagging predictors. Machine Learning, 24, 123\u2013140.","journal-title":"Machine Learning"},{"key":"5401_CR6","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1006\/obhd.1996.0021","volume":"65","author":"L. A. Brenner","year":"1996","unstructured":"Brenner, L. A., Koehler, D. J., Liberman, V., & Tversky, A. (1996). Overconfidence in probability and frequency judgments: a critical examination. Organizational Behavioral and Human Decision Processes, 65, 212\u2013219.","journal-title":"Organizational Behavioral and Human Decision Processes"},{"key":"5401_CR7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1175\/1520-0493(1950)078<0001:VOFEIT>2.0.CO;2","volume":"78","author":"G. W. Brier","year":"1950","unstructured":"Brier, G. W. (1950). Verification of forecasts expressed in terms of probability. Monthly Weather Review, 78, 1\u20133.","journal-title":"Monthly Weather Review"},{"key":"5401_CR8","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1017\/S1930297500004241","volume":"6","author":"S. B. Broomell","year":"2011","unstructured":"Broomell, S. B., Budescu, D. V., & Por, H. H. (2011). Pair-wise comparison of multiple models. Judgement and Decision Making, 6, 821\u2013831.","journal-title":"Judgement and Decision Making"},{"key":"5401_CR9","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.cogpsych.2008.09.002","volume":"58","author":"S. Brown","year":"2009","unstructured":"Brown, S., & Steyvers, M. (2009). Detecting and predicting changes. Cognitive Psychology, 58, 49\u201367.","journal-title":"Cognitive Psychology"},{"key":"5401_CR10","doi-asserted-by":"crossref","first-page":"857","DOI":"10.1017\/S1930297500004277","volume":"6","author":"D. V. Budescu","year":"2011","unstructured":"Budescu, D. V., & Johnson, T. R. (2011). A model-based approach for the analysis of the calibration of probability judgments. Judgment and Decision Making, 6, 857\u2013869.","journal-title":"Judgment and Decision Making"},{"key":"5401_CR11","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1613\/jair.62","volume":"2","author":"W. L. Buntine","year":"1994","unstructured":"Buntine, W. L. (1994). Operations for learning with graphical models. Journal of Artificial Intelligence Research, 2, 159\u2013225.","journal-title":"Journal of Artificial Intelligence Research"},{"key":"5401_CR12","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1007\/BF01065371","volume":"8","author":"C. F. Camerer","year":"1994","unstructured":"Camerer, C. F., & Ho, T. H. (1994). Violations of the betweenness axiom and nonlinearity in probability. Journal of Risk and Uncertainty, 8, 167\u2013196.","journal-title":"Journal of Risk and Uncertainty"},{"key":"5401_CR13","volume-title":"Bayesian ideas and data analysis: an introduction for scientists and statisticians","author":"R. Christensen","year":"2011","unstructured":"Christensen, R., Johnson, W., Branscum, A., & Hanson, T. E. (2011). Bayesian ideas and data analysis: an introduction for scientists and statisticians. Boca Raton: CRC Press."},{"key":"5401_CR14","doi-asserted-by":"crossref","first-page":"928","DOI":"10.1037\/0096-1523.7.4.928","volume":"7","author":"J. J. J. Christensen-Szalanski","year":"1981","unstructured":"Christensen-Szalanski, J. J. J., & Bushyhead, J. B. (1981). Physicians\u2019 use of probabilistic information in a real clinical setting. Journal of Experimental Psychology. Human Perception and Performance, 7, 928\u2013935.","journal-title":"Journal of Experimental Psychology. Human Perception and Performance"},{"key":"5401_CR15","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1287\/mnsc.32.3.312","volume":"32","author":"R. T. Clemen","year":"1986","unstructured":"Clemen, R. T. (1986). Calibration and the aggregation of probabilities. Management Science, 32, 312\u2013314.","journal-title":"Management Science"},{"key":"5401_CR16","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1016\/0169-2070(89)90012-5","volume":"5","author":"R. T. Clemen","year":"1989","unstructured":"Clemen, R. T. (1989). Combining forecasts: a review and annotated bibliography (with discussion). International Journal of Forecasting, 5, 559\u2013583.","journal-title":"International Journal of Forecasting"},{"key":"5401_CR17","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1080\/07350015.1986.10509492","volume":"4","author":"R. T. Clemen","year":"1986","unstructured":"Clemen, R. T., & Winkler, R. L. (1986). Combining economic forecasts. Journal of Business & Economic Statistics, 4, 39\u201346.","journal-title":"Journal of Business & Economic Statistics"},{"key":"5401_CR18","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780195064650.001.0001","volume-title":"Experts in uncertainty: opinion and subjective probability in science","author":"R. M. Cooke","year":"1991","unstructured":"Cooke, R. M. (1991). Experts in uncertainty: opinion and subjective probability in science. New York: Oxford University Press."},{"key":"5401_CR19","doi-asserted-by":"crossref","first-page":"519","DOI":"10.1037\/0033-295X.101.3.519","volume":"101","author":"I. Erev","year":"1994","unstructured":"Erev, I., Wallsten, T. S., & Budescu, D. V. (1994). Simultaneous over- and underconfidence: The role of error in judgment processes. Psychological Review, 101, 519\u2013527.","journal-title":"Psychological Review"},{"key":"5401_CR20","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/0030-5073(80)90045-8","volume":"26","author":"W. R. Ferrell","year":"1980","unstructured":"Ferrell, W. R., & McGoey, P. J. (1980). A model of calibration for subjective probabilities. Organizational Behavior and Human Decision Processes, 26, 32\u201353.","journal-title":"Organizational Behavior and Human Decision Processes"},{"key":"5401_CR21","first-page":"325","volume-title":"Machine learning: Proceedings of the thirteenth international conference","author":"Y. Freund","year":"1996","unstructured":"Freund, Y., & Schapire, R. E. (1996). Experiments with a new boosting algorithm. In Machine learning: Proceedings of the thirteenth international conference (pp. 325\u2013332). San Francisco: Morgan Kauffman."},{"key":"5401_CR22","volume-title":"Proceedings of the IEEE international conference on cybernetics and society","author":"D. G. Fryback","year":"1979","unstructured":"Fryback, D. G., & Erdman, H. (1979). Prospects for calibrating physicians\u2019 probabilistic judgments: design of a feedback system. In Proceedings of the IEEE international conference on cybernetics and society."},{"key":"5401_CR23","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1038\/075450a0","volume":"75","author":"F. Galton","year":"1907","unstructured":"Galton, F. (1907). Vox populi. Nature, 75, 450\u2013451.","journal-title":"Nature"},{"key":"5401_CR24","volume-title":"Bayesian data analysis","author":"A. Gelman","year":"2004","unstructured":"Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2004). Bayesian data analysis. New York: Chapman and Hall."},{"key":"5401_CR25","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1006\/cogp.1998.0710","volume":"38","author":"R. Gonzalez","year":"1999","unstructured":"Gonzalez, R., & Wu, G. (1999). On the shape of the probability weighting function. Cognitive Psychology, 38, 129\u2013166.","journal-title":"Cognitive Psychology"},{"key":"5401_CR26","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1016\/0010-0285(92)90013-R","volume":"24","author":"D. Griffin","year":"1992","unstructured":"Griffin, D., & Tversky, A. (1992). The weighing of evidence and the determinants of confidence. Cognitive Psychology, 24, 411\u2013435.","journal-title":"Cognitive Psychology"},{"key":"5401_CR27","volume-title":"Applied nonparametric regression","author":"W. H\u00e4rdle","year":"1992","unstructured":"H\u00e4rdle, W. (1992). Applied nonparametric regression. Cambridge: Cambridge University Press."},{"key":"5401_CR28","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-84858-7","volume-title":"The elements of statistical learning","author":"T. Hastie","year":"2009","unstructured":"Hastie, T., Tibshirani, R., & Friedman, J. (2009). The elements of statistical learning (2nd ed.). New York: Springer.","edition":"2"},{"key":"5401_CR29","volume-title":"Proceedings of the 32rd annual conference of the cognitive science society","author":"P. Hemmer","year":"2011","unstructured":"Hemmer, P., Steyvers, M., & Miller, B. J. (2011). The wisdom of crowds with informative priors. In Proceedings of the 32rd annual conference of the cognitive science society. Lawrence Erlbaum."},{"key":"5401_CR30","doi-asserted-by":"crossref","first-page":"597","DOI":"10.1287\/mnsc.1040.0205","volume":"50","author":"S. C. Hora","year":"2004","unstructured":"Hora, S. C. (2004). Probability judgments for continuous quantities: Linear combinations and calibration. Management Science, 50, 597\u2013604.","journal-title":"Management Science"},{"key":"5401_CR31","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1037\/a0025960","volume":"119","author":"Y. Jang","year":"2012","unstructured":"Jang, Y., Wallsten, T. S., & Huber, D. E. (2012). A stochastic detection and retrieval model for the study of metacognition. Psychological Review, 119, 186\u2013200.","journal-title":"Psychological Review"},{"key":"5401_CR32","doi-asserted-by":"crossref","first-page":"344","DOI":"10.1037\/0033-295X.104.2.344","volume":"104","author":"P. Juslin","year":"1997","unstructured":"Juslin, P., & Olsson, H. (1997). Thurstonian and Brunswikian origins of uncertainty in judgment: a sampling model of confidence in sensory discrimination. Psychological Review, 104, 344\u2013366.","journal-title":"Psychological Review"},{"key":"5401_CR33","doi-asserted-by":"crossref","first-page":"263","DOI":"10.2307\/1914185","volume":"47","author":"D. Kahneman","year":"1979","unstructured":"Kahneman, D., & Tversky, A. (1979). Prospect theory: An analysis of decision under risk. Econometrica, 47, 263\u2013291.","journal-title":"Econometrica"},{"key":"5401_CR34","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1016\/0030-5073(78)90039-9","volume":"21","author":"U. S. Karmarker","year":"1978","unstructured":"Karmarker, U. S. (1978). Subjectively weighted utility: a descriptive extension of the expected utility model. Organizational Behavior and Human Performance, 21, 61\u201372.","journal-title":"Organizational Behavior and Human Performance"},{"key":"5401_CR35","series-title":"Acta Psychologica","volume-title":"Calibration and Probability Judgments: Conceptual and Methodological Issues","author":"G. Keren","year":"1991","unstructured":"Keren, G. (1991). Calibration and Probability Judgments: Conceptual and Methodological Issues. Acta Psychologica."},{"key":"5401_CR36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3758\/PBR.15.1.1","volume":"15","author":"M. D. Lee","year":"2008","unstructured":"Lee, M. D. (2008). Three case studies in the Bayesian analysis of cognitive models. Psychonomic Bulletin & Review, 15, 1\u201315.","journal-title":"Psychonomic Bulletin & Review"},{"key":"5401_CR37","volume-title":"Proceedings of the 33rd annual conference of the cognitive science society","author":"M. D. Lee","year":"2011","unstructured":"Lee, M. D., Steyvers, M., de Young, M., & Miller, B. J. (2011). A model-based approach to measuring expertise in ranking tasks. In Proceedings of the 33rd annual conference of the cognitive science society. Cognitive Science Society."},{"key":"5401_CR38","unstructured":"Lee, M. D., & Wagenmakers, E.-J. (2012). A course in Bayesian graphical modeling for cognitive science. Available from http:\/\/www.ejwagenmakers.com\/BayesCourse\/BayesBookWeb.pdf ; last downloaded January 1, 2012."},{"key":"5401_CR39","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1017\/CBO9780511809477.023","volume-title":"Judgment under uncertainty: heuristics and biases","author":"S. Lichtenstein","year":"1982","unstructured":"Lichtenstein, S., Fischoff, B., & Phillips, L. D. (1982). Calibration of probabilities: the state of the art to 1980. In D. Kahneman, P. Slovic, & A. Tversky (Eds.), Judgment under uncertainty: heuristics and biases (pp. 306\u2013334). Cambridge: Cambridge University Press."},{"key":"5401_CR40","series-title":"Lecture notes in computer science","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1007\/978-3-642-12079-4_4","volume-title":"Social computing, behavioral modeling, and prediction (SBP) 2010","author":"E. C. Merkle","year":"2010","unstructured":"Merkle, E. C. (2010). Calibrating subjective probabilities using hierarchical Bayesian models. In S.-K. Chai, J. J. Salerno, & P. L. Mabry (Eds.), Lecture notes in computer science: Vol.\u00a06007. Social computing, behavioral modeling, and prediction (SBP) 2010 (pp. 13\u201322)."},{"key":"5401_CR41","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.jmp.2010.08.011","volume":"55","author":"E. C. Merkle","year":"2011","unstructured":"Merkle, E. C., Smithson, M., & Verkuilen, J. (2011). Hierarchical models of simple mechanisms underlying confidence in decision making. Journal of Mathematical Psychology, 55, 57\u201367.","journal-title":"Journal of Mathematical Psychology"},{"key":"5401_CR42","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1037\/0096-3445.135.3.391","volume":"135","author":"E. C. Merkle","year":"2006","unstructured":"Merkle, E. C., & Van Zandt, T. (2006). An application of the Poisson race model to confidence calibration. Journal of Experimental Psychology. General, 135, 391\u2013408.","journal-title":"Journal of Experimental Psychology. General"},{"key":"5401_CR43","volume-title":"Proceedings of the ninth international conference on cognitive modeling","author":"B. J. Miller","year":"2009","unstructured":"Miller, B. J., Hemmer, P., Steyvers, M., & Lee, M. D. (2009). The wisdom of crowds in ordering problems. In Proceedings of the ninth international conference on cognitive modeling, Manchester, UK."},{"key":"5401_CR44","doi-asserted-by":"crossref","first-page":"595","DOI":"10.1175\/1520-0450(1973)012<0595:ANVPOT>2.0.CO;2","volume":"12","author":"A. H. Murphy","year":"1973","unstructured":"Murphy, A. H. (1973). A new vector partition of the probability score. Journal of Applied Meteorology, 12, 595\u2013600.","journal-title":"Journal of Applied Meteorology"},{"key":"5401_CR45","doi-asserted-by":"crossref","first-page":"784","DOI":"10.1175\/1520-0493(1974)102<0784:CITFSE>2.0.CO;2","volume":"102","author":"A. H. Murphy","year":"1974","unstructured":"Murphy, A. H., & Winkler, R. L. (1974). Credible interval temperature forecasting: some experimental results. Monthly Weather Review, 102, 784\u2013794.","journal-title":"Monthly Weather Review"},{"key":"5401_CR46","first-page":"489","volume":"79","author":"A. H. Murphy","year":"1984","unstructured":"Murphy, A. H., & Winkler, R. L. (1984). Probability forecasting in meteorology. Journal of the American Statistical Association, 79, 489\u2013500.","journal-title":"Journal of the American Statistical Association"},{"key":"5401_CR47","doi-asserted-by":"crossref","DOI":"10.1002\/0470033312","volume-title":"Uncertain judgements: eliciting experts\u2019 probabilities","author":"A. O\u2019Hagan","year":"2006","unstructured":"O\u2019Hagan, A., Buck, C. E., Daneshkhah, A., Eiser, J. R., Garthwaite, P. H., Jenkinson, D. J., Oakley, J. E., & Rakow, T. (2006). Uncertain judgements: eliciting experts\u2019 probabilities. Hoboken: Wiley."},{"key":"5401_CR48","doi-asserted-by":"crossref","unstructured":"Page, L., & Clemen, R. T. (2012). Do prediction markets produce well calibrated probability forecasts? Manuscript in preparation.","DOI":"10.1111\/j.1468-0297.2012.02561.x"},{"key":"5401_CR49","doi-asserted-by":"crossref","first-page":"864","DOI":"10.1037\/a0019737","volume":"117","author":"T. J. Pleskac","year":"2010","unstructured":"Pleskac, T. J., & Busemeyer, J. R. (2010). Two-stage dynamic signal detection theory: a theory of choice, decision time, and confidence. Psychological Review, 117, 864\u2013901.","journal-title":"Psychological Review"},{"key":"5401_CR50","volume-title":"Proceedings of the 3rd international workshop on distributed statistical computing","author":"M. Plummer","year":"2003","unstructured":"Plummer, M. (2003). JAGS: a program for analysis of Bayesian graphical models using Gibbs sampling. In Proceedings of the 3rd international workshop on distributed statistical computing."},{"key":"5401_CR51","doi-asserted-by":"crossref","first-page":"1248","DOI":"10.1080\/03640210802414826","volume":"32","author":"R. M. Shiffrin","year":"2008","unstructured":"Shiffrin, R. M., Lee, M. D., Kim, W., & Wagenmakers, E.-J. (2008). A survey of model evaluation approaches with a tutorial on hierarchical Bayesian methods. Cognitive Science, 32, 1248\u20131284.","journal-title":"Cognitive Science"},{"key":"5401_CR52","doi-asserted-by":"crossref","first-page":"492","DOI":"10.3758\/PBR.17.4.492","volume":"17","author":"Y. Shlomi","year":"2010","unstructured":"Shlomi, Y., & Wallsten, T. S. (2010). Subjective recalibration of advisors\u2019 probability estimates. Psychonomic Bulletin & Review, 17, 492\u2013498.","journal-title":"Psychonomic Bulletin & Review"},{"key":"5401_CR53","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4899-3324-9","volume-title":"Density estimation for statistics and data analysis","author":"B. W. Silverman","year":"1986","unstructured":"Silverman, B. W. (1986). Density estimation for statistics and data analysis. London: Chapman & Hall."},{"key":"5401_CR54","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1006\/obhd.1996.0011","volume":"65","author":"J. B. Soll","year":"1996","unstructured":"Soll, J. B. (1996). Determinants of overconfidence and miscalibration: the roles of random error and ecological structure. Organizational Behavior and Human Decision Processes, 65, 117\u2013137.","journal-title":"Organizational Behavior and Human Decision Processes"},{"key":"5401_CR55","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1016\/0001-6918(70)90013-2","volume":"34","author":"C. A. S. Sta\u00ebl\u00a0von\u00a0Holstein","year":"1970","unstructured":"Sta\u00ebl\u00a0von\u00a0Holstein, C. A. S. (1970). Measurement of subjective probability. Acta Psychologica, 34, 146\u2013159.","journal-title":"Acta Psychologica"},{"key":"5401_CR56","first-page":"1785","volume-title":"Advances in neural information processing systems.","author":"M. Steyvers","year":"2009","unstructured":"Steyvers, M., Lee, M. D., & Miller, B. J. (2009). Wisdom of crowds in the recollection of order information. In Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I. Williams, & A. Culotta (Eds.), Advances in neural information processing systems. (Vol.\u00a022, pp. 1785\u20131793). New York: MIT Press."},{"key":"5401_CR57","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1006\/obhd.1996.0074","volume":"67","author":"L. Suantak","year":"1996","unstructured":"Suantak, L., Bolger, F., & Ferrell, W. R. (1996). The hard-easy effect in subjective probability calibration. Organizational Behavior and Human Decision Processes, 67, 201\u2013221.","journal-title":"Organizational Behavior and Human Decision Processes"},{"key":"5401_CR58","volume-title":"The wisdom of crowds","author":"J. Surowiecki","year":"2004","unstructured":"Surowiecki, J. (2004). The wisdom of crowds. New York: Random House."},{"key":"5401_CR59","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1037\/0033-295X.115.1.155","volume":"115","author":"R. P. Thomas","year":"2008","unstructured":"Thomas, R. P., Dougherty, M. R., Sprenger, A. M., & Harbison, J. I. (2008). Diagnostic hypothesis generation and human judgment. Psychological Review, 115, 155\u2013185.","journal-title":"Psychological Review"},{"key":"5401_CR60","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1037\/0033-295X.102.2.269","volume":"102","author":"A. Tversky","year":"1995","unstructured":"Tversky, A., & Fox, C. R. (1995). Weighing risk and uncertainty. Psychological Review, 102, 269\u2013283.","journal-title":"Psychological Review"},{"key":"5401_CR61","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1007\/BF00122574","volume":"5","author":"A. Tversky","year":"1992","unstructured":"Tversky, A., & Kahneman, D. (1992). Advances in prospect theory: cumulative representations of uncertainty. Journal of Risk and Uncertainty, 5, 297\u2013323.","journal-title":"Journal of Risk and Uncertainty"},{"key":"5401_CR62","doi-asserted-by":"crossref","first-page":"582","DOI":"10.1037\/0278-7393.26.3.582","volume":"26","author":"T. Zandt Van","year":"2000","unstructured":"Van Zandt, T. (2000). ROC curves and confidence judgments in recognition memory. Journal of Experimental Psychology. Learning, Memory, and Cognition, 26, 582\u2013600.","journal-title":"Journal of Experimental Psychology. Learning, Memory, and Cognition"},{"key":"5401_CR63","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1287\/mnsc.29.2.151","volume":"29","author":"T. S. Wallsten","year":"1983","unstructured":"Wallsten, T. S., & Budescu, D. V. (1983). Encoding subjective probabilities: a psychological and psychometric review. Management Science, 29, 151\u2013173.","journal-title":"Management Science"},{"key":"5401_CR64","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1002\/(SICI)1099-0771(199709)10:3<243::AID-BDM268>3.0.CO;2-M","volume":"10","author":"T. S. Wallsten","year":"1997","unstructured":"Wallsten, T. S., Budescu, D. V., & Erev, I. (1997). Evaluating and combining subjective probability estimates. Journal of Behavioral Decision Making, 10, 243\u2013268.","journal-title":"Journal of Behavioral Decision Making"},{"key":"5401_CR65","doi-asserted-by":"crossref","first-page":"490","DOI":"10.1037\/0033-295X.101.3.490","volume":"101","author":"T. S. Wallsten","year":"1994","unstructured":"Wallsten, T. S., & Gonz\u00e1lez-Vallejo, C. (1994). Statement verification: a stochastic model of judgment and response. Psychological Review, 101, 490\u2013504.","journal-title":"Psychological Review"},{"key":"5401_CR66","volume-title":"2012 AAAI symposium","author":"D. Warnaar","year":"2012","unstructured":"Warnaar, D., Merkle, E., Steyvers, S., Wallsten, T., Stone, E., Budescu, D., Yates, J., Sieck, W., Arkes, H., Argenta, C., Shin, Y., & Carter, J. (2012). The aggregative contingent estimation system: selecting, rewarding, and training experts in a wisdom of crowds approach to forecasting. In 2012 AAAI symposium. on Wisdom of the Crowd."},{"key":"5401_CR67","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1016\/0001-6918(82)90033-6","volume":"52","author":"G. Wright","year":"1982","unstructured":"Wright, G. (1982). Changes in the realism and distribution of probability assessments as a function of question type. Acta Psychologica, 52, 165\u2013174.","journal-title":"Acta Psychologica"},{"key":"5401_CR68","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1111\/j.1467-9450.1982.tb00435.x","volume":"23","author":"G. Wright","year":"1982","unstructured":"Wright, G., & Wisudha, A. (1982). Distribution of probability assessments for almanac and future event questions. Scandinavian Journal of Psychology, 23, 219\u2013224.","journal-title":"Scandinavian Journal of Psychology"},{"key":"5401_CR69","doi-asserted-by":"crossref","first-page":"1676","DOI":"10.1287\/mnsc.42.12.1676","volume":"42","author":"G. Wu","year":"1996","unstructured":"Wu, G., & Gonzalez, R. (1996). Curvature of the probability weight function. Management Science, 42, 1676\u20131690.","journal-title":"Management Science"},{"key":"5401_CR70","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1016\/0030-5073(82)90237-9","volume":"30","author":"J. F. Yates","year":"1982","unstructured":"Yates, J. F. (1982). External correspondence: decompositions of the mean probability score. Organizational Behavior and Human Performance, 30, 132\u2013156.","journal-title":"Organizational Behavior and Human Performance"},{"key":"5401_CR71","volume-title":"Judgment and decision making","author":"J. F. Yates","year":"1990","unstructured":"Yates, J. F. (1990). Judgment and decision making. Englewood Cliffs: Prentice Hall."},{"key":"5401_CR72","volume-title":"The wisdom of crowds in combinatorial problems","author":"S. K. M. Yi","year":"2011","unstructured":"Yi, S. K. M., Steyvers, M., & Lee, M. D. (2011). The wisdom of crowds in combinatorial problems. Cognitive Science."},{"key":"5401_CR73","volume-title":"Proceedings of the 32nd annual conference of the cognitive science society","author":"S. K. M. Yi","year":"2010","unstructured":"Yi, S. K. M., Steyvers, M., Lee, M. D., & Dry, M. (2010). Wisdom of crowds in minimum spanning tree problems. In Proceedings of the 32nd annual conference of the cognitive science society. Lawrence Erlbaum."},{"key":"5401_CR74","first-page":"1","volume":"6","author":"H. Zhang","year":"2011","unstructured":"Zhang, H., & Maloney, L. T. (2011). Ubiquitous log odds: a common representation of probability and frequency distortion in perception, action, and cognition. Frontiers in Neuroscience, 6, 1\u201314.","journal-title":"Frontiers in Neuroscience"}],"container-title":["Machine Learning"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-013-5401-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10994-013-5401-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-013-5401-4","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,18]],"date-time":"2024-05-18T17:20:44Z","timestamp":1716052844000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10994-013-5401-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,10,12]]},"references-count":74,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2014,6]]}},"alternative-id":["5401"],"URL":"https:\/\/doi.org\/10.1007\/s10994-013-5401-4","relation":{},"ISSN":["0885-6125","1573-0565"],"issn-type":[{"value":"0885-6125","type":"print"},{"value":"1573-0565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,10,12]]}}}