Perspectives on Probability Judgment Calibration

Blackwell Handbook of Judgment and Decision Making

Volumn , Issue , 2008, Pages 177-199

  Griffin, Dale ^a   Brenner, Lyle ^b  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^b UNIVERSITY OF FLORIDA   (United States)

Author keywords

Calibration; Calibration research; Cultural differences; Environment; Probability

Indexed keywords

EID: 84889458757     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9780470752937.ch9     Document Type: Chapter

References (69)

1. Alicke, M. D. (1985) Global self-evaluation as determined by the desirability and controllability of trait adjectives, Journal of Personality & Social Psychology, 49, 1621-30.
2. Björkman, M. (1994) Internal cue theory: Calibration and resolution of confidence in general knowledge, Organizational Behavior & Human Decision Processes, 58, 386-405.
3. Brenner, L. (2000) Should observed overconfidence be dismissed as a statistical artifact? Critique of Erev, Wallsten, and Budescu (1994), Psychological Review, 107, 943-6.
4. Brenner, L. A. (2003) A random support model of the calibration of subjective probabilities, Organizational Behavior & Human Decision Processes, 90, 87-110.
5. Brenner, L. A., Koehler, D. J., Liberman, V., & Tversky, A. (1996) Overconfidence in probability and frequency judgments: A critical examination, Organizational Behavior & Human Decision Processes, 65, 212-19.
6. Brenner, L. A., Koehler, D. J., & Tversky, A. (1996) On the evaluation of one-sided evidence, Journal of Behavioral Decision Making, 9, 59-70.
7. Budescu, D. V., Erev, I., & Wallsten, T. S. (1997) On the importance of random error in the study of probability judgment. Part I: New theoretical developments, Journal of Behavioral Decision Making, 10, 157-71.
8. Budescu, D. V., Wallsten, T. S., & Au, W. T. (1997) On the importance of random error in the study of probability judgment: Part II. Applying the stochastic judgment model to detect systematic trends, Journal of Behavioral Decision Making, 10, 173-88.
9. Buehler, R., Griffin, D., & Ross, M. (1994) Exploring the "planning fallacy": Why people underestimate their task completion times, Journal of Personality & Social Psychology, 67, 366-81.
10. Buehler, R., Otsubo, Y., Lehman, D. R., Heine, S. J., & Griffin, D. (2003) Culture and Optimism: The Planning Fallacy in Japan and North America. Manuscript submitted for publication.
11. Cooper, A. C., Woo, C. Y., & Dunkelberg, W. (1988) Entrepreneurs' perceived chances for success, Journal of Business Venturing, 3, 97-108.
12. Erev, I., Wallsten, T. S., & Budescu, D. V. (1994) Simultaneous over-and underconfidence: The role of error in judgment processes, Psychological Review, 101, 519-27.
13. Ferrell, W. R. & McGoey, P. J. (1980) A model of calibration for subjective probabilities, Organizational Behavior & Human Decision Processes, 26, 32-53.
14. Fullerton, G. S. & Cattell, J. McK. (1892) On the perception of small differences: With special reference to the extent, force and time of movement, Publications of the University of Pennsylvania: Philosophical Series, no. 2.
15. Gigerenzer, G., Hoffrage, U., & Kleinbölting, H. (1991) Probabilistic mental models: A Brunswikian theory of confidence, Psychological Review, 98, 506-28.
16. Gilovich, T., Griffin, D. W., & Kahneman, D. (2002) Heuristics and Biases: The Psychology of Intuitive Judgment. New York: Cambridge University Press.
17. Gilovich, T., Kerr, M., & Medvec, V. H. (1993) Effect of temporal perspective on subjective confidence, Journal of Personality & Social Psychology, 64, 552-60.
18. Griffin, D. & Buehler, R. (1999) Frequency, probability, and prediction: Easy solutions to cognitive illusions? Cognitive Psychology, 38, 48-78.
19. Griffin, D. & Tversky, A. (1992) The weighing of evidence and the determinants of confidence, Cognitive Psychology, 24, 411-35.
20. Gu, H. & Wallsten, T. S. (2001) On setting response criteria for calibrated subjective probability estimates, Journal of Mathematical Psychology, 45, 551-63.
21. Hammond, K. (1998) Ecological Validity: Then and Now, online at: http://brunswik.org/notes/essay2.html.
22. Hammond, K. R. and Stewart, T. R. (eds.) (2001) The Essential Brunswik: Beginnings, Explications, Applications. New York: Oxford University Press.
23. Harvey, N. (1997) Confidence in judgment, Trends in Cognitive Sciences, 1, 78-82.
24. Hastorf, A. H. & Cantril, H. (1954) They saw a game; a case study, Journal of Abnormal & Social Psychology, 129-34.
25. Henmon, V. A. C. (1911) The relation of the time of a judgement to its accuracy, Psychological Review, 18, 186-201.
26. Hoch, S. J. (1985) Counterfactual reasoning and accuracy in predicting personal events, Journal of Experimental Psychology: Learning, Memory, & Cognition, 11, 719-31.
27. Hogarth, R. & Makridakis, S. (1981) Forecasting and planning: An evaluation, Management Science, 27, 115-38.
28. Juslin, P. & Olsson, H. (1997) Thurstonian and Brunswikian origins of uncertainty in judgment: A sampling model of confidence in sensory discrimination, Psychological Review, 104, 344-66.
29. Juslin, P., Wennerholm, P., & Olsson, H. (1999) Format dependence in subjective probability calibration, Journal of Experimental Psychology: Learning, Memory, & Cognition, 25, 1038-52.
30. Juslin, P., Winman, A., & Olsson, H. (2000) Naive empiricism and dogmatism in confidence research: A critical examination of the hard-easy effect, Psychological Review, 107, 384-96.
31. Kahneman, D. & Tversky, A. (1979) Intuitive prediction: Biases and corrective procedures, TIMS Studies in Management Science, 12, 313-27.
32. Kahneman, D., Slovic, P., & Tversky, A. (1982) Judgment Under Uncertainty: Heuristics and Biases. Cambridge: Cambridge University Press.
33. Keren, G. (1991) Calibration and probability judgments: Conceptual and methodological issues, Acta Psychologica, 77, 217-73.
34. Klayman, J., Soll, J. B., González-Vallejo, C., & Barlas, S. (1999) Overconfidence: It depends on how, what, and whom you ask, Organizational Behavior & Human Decision Processes, 79, 216-47.
35. Koehler, D. J., Brenner, L., & Griffin, D. (2002) The calibration of expert judgment: Heuristics and biases beyond the laboratory. In T. Gilovich, D. Griffin, & D. Kahneman (eds.), Heuristics and Biases: The Psychology of Intuitive Judgment (pp. 686-715). Cambridge: Cambridge University Press.
36. Koehler, D. J., Brenner, L. A., & Tversky, A. (1997) The enhancement effect in probability judgment, Journal of Behavioral Decision Making, 10, 293-313.
37. Koriat, A. & Levy-Sadot, R. (1999) Processes underlying metacognitive judgments: Informationbased and experience-based monitoring of one's own knowledge. In S. Chaiken and Y. Trope (eds.), Dual-Process Theories in Social Psychology. (pp. 483-502). New York, NY: Guilford.
38. Koriat, A., Lichtenstein, S., & Fischhoff, B. (1980) Reasons for confidence, Journal of Experimental Psychology: Human Learning & Memory, 6, 107-18.
39. Kruger, J. (1999) Lake Wobegon be gone! The "below-average effect" and the egocentric nature of comparative ability judgments, Journal of Personality & Social Psychology, 77, 221-32.
40. Langer, E. J. (1975) The illusion of control, Journal of Personality & Social Psychology, 32, 311-28.
41. Larwood, L. & Whittaker, W. (1977) Managerial myopia: Self-serving biases in organizational planning, Journal of Applied Psychology, 62, 194-8.
42. Liberman, N. & Trope, Y. (1998) The role of feasibility and desirability considerations in near and distant future decisions: A test of temporal construal theory, Journal of Personality & Social Psychology, 75, 5-18.
43. Liberman, V. & Tversky, A. (1993) On the evaluation of probability judgments: Calibration, resolution, and monotonicity, Psychological Bulletin, 114, 162-73.
44. Lichtenstein, S., Fischhoff, B., & Phillips, L. D. (1982) Calibration of probabilities: The state of the art to 1980. In D. Kahneman, P. Slovic, & A. Tversky (eds.), Judgment under Uncertainty: Heuristics and Biases (pp. 306-34). Cambridge: Cambridge University Press.
45. Lord, C. G., Lepper, M. R., & Preston, E. (1984) Considering the opposite: A corrective strategy for social judgment, Journal of Personality & Social Psychology, 47, 1231-43.
46. Lord, C. G., Ross, L., & Lepper, M. R. (1979) Biased assimilation and attitude polarization: The effects of prior theories on subsequently considered evidence, Journal of Personality & Social Psychology, 37, 2098-109.
47. Lusk, C. M., Stewart, T. R., Hammond, K. R. and Potts, R. J. (1990) Judgment and decision making in dynamic tasks: The case of forecasting the microburst, Weather and Forecasting, 5, 627-39.
48. May, R. S. (1986) Inferences, subjective probability and frequency of correct answers: A cognitive approach to the overconfidence phenomenon. In B. Brehmer, H. Jungermann, P. Lourens, and A. Sevoaan (eds.), New Directions in Research on Decision Making (pp. 175-89). Amsterdam: North Holland.
49. McKenzie, C. R. M. (1997) Underweighting alternatives and overconfidence, Organizational Behavior & Human Decision Processes, 71, 141-60.
50. Miller, D. T. & Ross, M. (1975) Self-serving biases in the attribution of causality: Fact or fiction? Psychological Bulletin, 82, 213-25.
51. Phillips, L. D. & Edwards, W. (1966) Conservatism in a simple probability inference task, Journal of Experimental Psychology, 346-54.
52. Pollack, I. & Decker, L. R. (1958) Confidence ratings, message reception, and the receiver operating characteristic, Journal of the Acoustical Society of America, 286-92.
53. Rosenthal, R. & Jacobson, L. (1966) Teachers' expectancies: Determinants of pupils' IQ gains, Psychological Reports, 115-18.
54. Rottenstreich, Y. & Tversky, A. (1997) Unpacking, repacking, and anchoring: Advances in support theory, Psychological Review, 104, 406-15.
55. Shepperd, J. A., Ouellette, J. A., & Fernandez, J. K. (1996) Abandoning unrealistic optimism: Performance estimates and the temporal proximity of self-relevant feedback, Journal of Personality & Social Psychology, 70, 844-55.
56. Smith, M. & Ferrell, W. R. (1983) The effect of base rate on calibration of subjective probability for true-false questions: Model and experiment. In P. Humphreys, O. Svenson, & A. Vari (eds.), Analyzing and Aiding Decisions. Amsterdam: North-Holland.
57. Snyder, M. & Swann, W. B. (1978) Behavioral confirmation in social interaction: From social perception to social reality, Journal of Experimental Social Psychology, 14, 148-62.
58. Soll, J. B. (1996) Determinants of overconfidence and miscalibration: The roles of random error and ecological structure, Organizational Behavior & Human Decision Processes, 65, 117-37.
59. Suantak, L., Bolger, F., & Ferrell, W. R. (1996) The hard-easy effect in subjective probability calibration, Organizational Behavior & Human Decision Processes, 67, 201-21.
60. Svenson, O. (1981) Are we all less risky and more skillful than our fellow drivers? Acta Psychologica, 47, 143-8.
61. Tversky, A. & Koehler, D. J. (1994) Support theory: A nonextensional representation of subjective probability, Psychological Review, 101, 547-67.
62. Wallsten, T. S. (1996) An analysis of judgment research analyses, Organizational Behavior & Human Decision Processes, 65, 220-26.
63. Wallsten, T. S. & Budescu, D. V. (1983) Encoding subjective probabilities: A psychological and psychometric review, Management Science, 29, 151-73.
64. Wallsten, T. S., Erev, I., & Budescu, D. V. (2000) The importance of theory: Response to Brenner (2000), Psychological Review, 107, 947-9.
65. Wallsten, T. S. & González-Vallejo, C. (1994) Statement verification: A stochastic model of judgment and response, Psychological Review, 101, 490-504.
66. Wason, P. C. (1968) Reasoning about a rule, Quarterly Journal of Experimental Psychology, 273-81.
67. Weinstein, N. D. (1980) Unrealistic optimism about future life events, Journal of Personality & Social Psychology, 39, 806-20.
68. Yates, J. F. (1990) Judgment and Decision Making. Englewood Cliffs, NJ: Prentice Hall.
69. Yates, J. F., Lee, J.-W., Sieck, W. R., Choi, I., & Price, P. C. (2002) Probability judgment across cultures. In T. Gilovich, D. Griffin, & D. Kahneman (eds.), Heuristics and Biases: The Psychology of Intuitive Judgment (pp. 271-91). Cambridge: Cambridge University Press.