Two reasons to make aggregated probability forecasts more extreme

Decision Analysis

Volumn 11, Issue 2, 2014, Pages 133-145

  Baron, Jonathan ^a   Mellers, Barbara A ^a   Tetlock, Philip E ^a   Stone, Eric ^a   Ungar, Lyle H ^b  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

Aggregation; Confidence; Forecasting; Wisdom of crowds

Indexed keywords

EID: 84901658129     PISSN: 15458490     EISSN: 15458504     Source Type: Journal    
DOI: 10.1287/deca.2014.0293     Document Type: Article

References (16)

1. Ariely D, Wing-Tung A, Bender RH, Budescu DV, Dietz CB, Gu H, Wallsten TS, Zauberman G (2000) The effects of averaging subjective probability estimates between and within judges. J. Experiment. Psych.: Appl. 6(2):130-147.
2. Dřagulescu A, Yakovenko VM (2001) Evidence for the exponential distribution of income in the USA. Eur. Phys. J. B 299(1-2): 585-589.
3. Erev I, Wallsten TS, Budescu DV (1994) Simultaneous over- and underconfidence: The role of error in judgment processes. Psych. Rev. 101(3):519-527.
4. Fox CR, ÜlkÜmen G (2011) Distinguishing two dimensions of uncertainty. Brun W, Keren G, Kirkebo%oslash;en G, Montgomery H, eds. Perspectives on Thinking, Judging, and Decision Making A Tribute to Karl Halvor Teigen (Universitetsvorlaget, Oslo, Norway), 21-35
5. Hernández-Orallo J, Flach P, Ferri C (2012) A unified view of performance metrics: Translating threshold choice into expected classification loss. J. Machine Learn. Res. 13(October):2813-2869.
6. Johnstone DJ, Jose VRR, Winkler RL (2011) Tailored scoring rules for probabilities Decision Anal. 8(4):256-268
7. Juslin P, Winman A, Olsson H (2000) Naive empiricism and dogmatism in confidence research: A critical examination of the hardeasy effect. Psych. Rev. 107(2):384-396.
8. Karmarkar US (1978) Subjectively weighted utility: A descriptive extension of the expected utility model. Organ. Behav. Human Performance 21(1):61-72.
9. Mellers BA, Ungar L, Baron J, Ramos J, GÜray B, Fincher K, Scott S, et al. (2014) Psychological strategies for winning a geopolitical forecasting tournament. Psych. Sci. Forthcoming
10. Murphy AH (1966) A note on the utility of probabilistic predictions and the probability score in the cost-lost ratio decision situation. J. Appl. Meteorology 5(4):534-537.
11. Pauker SG, Kassirer JP (1980) The threshold approach to clinical decision making. New England J. Medicine 302(20):1109-1117.
12. Satopää VA, Baron J, Foster DP, Mellers BA, Tetlock PE, Ungar LH (2014) Combining multiple probability predictions using a simple logit model. Internat. J. Forecasting 30(2):344-356.
13. Shlomi Y, Wallsten TS (2010) Subjective recalibration of advisors probability estimates. Psych. Bull. Rev. 17(4):492-498.
14. Turner BM, Steyvers M, Merkle EC, Budescu DV, Wallsten TS (2013) Forecast aggregation via recalibration. Machine Learn., ePub ahead of print October, http//linkspringer.com/article/ 10.1007%2Fs10994-013-5401-4.
15. Wallsten TS, Diederich A (2001) Understanding pooled subjective probability estimates. Math. Soc. Sci. 41(1):1-18.
16. Yates JF (1990) Judgment and Decision Making (Prentice Hall, Englewood Cliffs, NJ).