Naive empiricism and dogmatism in confidence research: A critical examination of the hard-easy effect

Psychological Review

Volumn 107, Issue 2, 2000, Pages 384-396

  Juslin, Peter ^a,b   Winman, Anders ^a   Olsson, Henrik ^b  

^a UPPSALA UNIVERSITY   (Sweden)

^b UMEÅ UNIVERSITY   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; COGNITION; HUMAN; PSYCHOLOGICAL THEORY;

COGNITION; HUMANS; PSYCHOLOGICAL THEORY;

EID: 0034169210     PISSN: 0033295X     EISSN: None     Source Type: Journal    
DOI: 10.1037/0033-295X.107.2.384     Document Type: Article

References (85)

1. Allwood, C. M. (1994). Confidence in own and others' knowledge. Scandinavian Journal of Psychology, 35, 198-211.
2. Allwood, C. M., & Björhag, C.-G. (1990). Are two judges better than one?: On the realism of confidence judgements by pairs and individuals. In J.-P. Caverni, J.-M. Fabre, & M. Gonzalez (Eds.), Cognitive biases (pp. 443-463). Amsterdam: Elsevier Science.
3. Allwood, C. M., & Björhag, C.-G. (1991). Mood and realism of confidence judgements of one's own answers to general knowledge questions. Scandinavian Journal of Psychology, 32, 358-371.
4. Allwood, C. M., & Granhag, P. A. (1996a). Considering the knowledge you have: Effects on realism in confidence judgments. European Journal of Cognitive Psychology, 8, 235-256.
5. Allwood, C. M., & Granhag, P. A. (1996b). The effects of arguments on realism in confidence judgements. Acta Psychologica, 91, 99-119.
6. Allwood, C. M., & Granhag, P. A. (1996c). Realism of confidence as a function of working in dyads or alone. Organizational Behavior and Human Decision Processes, 66, 277-289.
7. Allwood, C. M., & Montgomery, H. (1987). Response selection strategies and realism of confidence judgments. Organizational Behavior and Human Decision Processes, 39, 365-383.
8. Ariely, D., Zauberman, G., & Wallsten, T. S. (1995, August). Statistical and psychological considerations in calibration research. Paper presented at the 15th Subjective Probability, Utility, and Decision Making Conference, Jerusalem, Israel.
9. Arkes, H. R., Christensen, C., Lai, C., & Blumer, C. (1987). Two methods of reducing overconfidence. Organizational Behavior and Human Decision Processes, 39, 133-144.
10. Ayton, P., & Wright, G. (1990). Uncertain memories: Evaluating the competence of probabilistic cognition. In J.-P. Caverni, J.-M. Fabre, & M. Gonzalez (Eds.), Cognitive biases (pp. 465-476). Amsterdam: Elsevier Science.
11. Baranski, J. V., & Petrusic, W. M. (1994). The calibration and resolution of confidence in perceptual judgments. Perception and Psychophysics, 55, 412-428.
12. Baranski, J. V., & Petrusic, W. M. (1995). On the calibration of knowledge and perception. Canadian Journal of Experimental Psychology, 49, 397-407.
13. Baranski, J. V., & Petrusic, W. M. (1997). Context, feedback, and the calibration and resolution of confidence in perceptual judgments. American Journal of Psychology, 110, 543-572.
14. Björkman, M. (1992). Knowledge, calibration, and resolution: A linear model. Organizational Behavior and Human Decision Processes, 51, 1-21.
15. Björkman, M. (1994). Internal cue theory: Calibration and resolution of confidence in general knowledge. Organizational Behavior and Human Decision Processes, 58, 386-405.
16. Brake, G. L., Doherty, M. E., & Kleiter, G. D. (1998). Overconfidence: Rethinking a fundamental bias in judgment yet again. Manuscript submitted for publication.
17. Brenner, L. A., Koehler, D. J., Liberman, V., & Tversky, A. (1996). Overconfidence in probability and frequency judgments: A critical examination. Organizational Behavior and Human Decision Processes, 65, 212-219.
18. Brunswik, E. (1956). Perception and representative design of psychological experiments. Berkeley: University of California Press.
19. Budescu, D. V., Wallsten, T. S., & Au, W. T. (1997). On the importance of random error in the study of probability judgment. Part II: Applying the stochastic judgment model to detect systematic trends. Journal of Behavioral Decision Making, 10, 172-188.
20. Dawes, R. M. (1980). Confidence in intellectual judgements vs. confidence in perceptual judgments. In E. D. Lanterman & H. Feger (Eds.), Similarity and choice: Papers in honour of Clyde Coombs (pp. 327-345). Bern, Switzerland: Huber.
21. Dawes, R. M., & Mulford, M. (1996). The false consensus effect and overconfidence: Flaws in judgment or flaws in how we study judgment? Organizational Behavior and Human Decision Processes, 65, 201-211.
22. Erev, I., Wallsten, T. S., & Budescu, D. V. (1994). Simultaneous over- and underconfidence: The role of error in judgment processes. Psychological Review, 101, 519-527.
23. Ferrell, W. R., & McGoey, P. J. (1980). A model of calibration for subjective probabilities. Organizational Behavior and Human Performance, 26, 32-53.
24. * Gigerenzer, G., Hoffrage, U., & Kleinbölting, H. (1991). Probabilistic mental models: A Brunswikian theory of confidence. Psychological Review, 98, 506-528.
25. * Granhag, P. A., Strömwall, L. A., & Allwood, C. M. (1998). Confidence judgment processes: Selective but possible to prime. Unpublished manuscript, Department of Psychology, Göteborg University, Göteborg, Sweden.
26. * Griffin, D., & Tversky, A. (1992). The weighing of evidence and the determinants of confidence. Cognitive Psychology, 24, 411-435.
27. Griffin, D. W., & Varey, C. A. (1996). Towards a consensus on overconfidence. Organizational Behavior and Human Decision Processes, 65, 227-231.
28. * Hoffrage, U. (1994). Zur angemessenheit subjektiver sicherhets-urteile: Eine exploration der theorie der probabilistischen mentalen modelle [On the realism of subjective confidence judgments: An exploration of the theory of probabilistic mental models]. Unpublished doctoral dissertation, Department of Psychology, University of Salzburg, Salzburg, Germany.
29. * Jansson, M. (1998). An empirical test of the PROBEX-model of subjective probability assessment. Unpublished undergraduate thesis, Department of Psychology, Uppsala University, Uppsala, Sweden.
30. Juslin, P. (1993a). An ecological model of realism of confidence in one's general knowledge (Acta Universitatis Upsaliensis: Studia Psychologica Upsaliensia, 14). Stockholm: Almqvist & Wiksell.
31. * Juslin, P. (1993b). An explanation of the "hard-easy effect" in studies of realism of confidence in one's general knowledge. European Journal of Cognitive Psychology, 5, 55-71.
32. * Juslin, P. (1994). The overconfidence phenomenon as a consequence of informal experimenter-guided selection of almanac items. Organizational Behavior and Human Decision Processes, 57, 226-246.
33. Juslin, P. (1995). Well calibrated confidence judgments for general knowledge items, inferential recognition decisions and social predictions. In J.-P. Caverni, M. Bar-Hillel, F. H. Barren, & H. Jungerman (Eds.), Contributions to decision making (Vol. 1, pp. 233-253). Amsterdam: Elsevier Science.
34. Juslin, P., & Olsson, H. (1997). Thurstonian and Brunswikian origins of uncertainty in judgment: A sampling model of confidence in sensory discrimination. Psychological Review, 104, 344-366.
35. * Juslin, P., Olsson, H., & Björkman, M. (1997). Brunswikian and Thurstonian origins of bias in probability assessment: On the interpretation of stochastic components of judgment. Journal of Behavioral Decision Making, 10, 189-209.
36. Juslin, P., Olsson, H., & Winman, A. (1998). The calibration issue: Theoretical comments on Suantak, Bolger, and Ferrell (1996). Organizational Behavior and Human Decision Processes, 73, 3-26.
37. * Juslin, P., Wennerholm, P., & Olsson, H. (1999). Format dependence in subjective probability calibration. Journal of Experimental Psychology: Learning, Memory, and Cognition, 25, 1038-1052.
38. * Juslin, P., Winman, A., & Persson, T. (1995). Can overconfidence be used as an indicator of reconstructive rather than retrieval processes? Cognition, 54, 99-130.
39. Kahneman, D., & Tversky, A. (1996). On the reality of cognitive illusions. Psychological Review, 103, 582-591.
40. * Keren, G. (1985). On the calibration of experts and lay people. Paper presented at the 10th Subjective Probability, Utility, and Decision Making Conference, Helsinki, Finland.
41. * Keren, G. (1988). On the ability of monitoring non-veridical perceptions and uncertain knowledge: Some calibration studies. Acta Psychologica, 67, 95-119.
42. Keren, G. (1991). Calibration and probability judgments: Conceptual and methodological issues. Acta Psychologica, 77, 217-273.
43. Keren, G. (1997). On the calibration of probability judgments: Some critical comments and alternative perspectives. Journal of Behavioral Decision Making, 10, 269-278.
44. * Klayman, J., Soll, J., Gonzalez-Vallejo, C., & Barlas, S. (1999). Overconfidence? It depends on how, what and whom you ask. Organizational Behavior and Human Decision Processes, 79, 216-247.
45. * Kleitman, S., & Stankov, L. (1996). Ecological and person-oriented aspects of metacognitive processes in test-taking. Unpublished manuscript, Department of Psychology, University of Sydney, Sydney, New South Wales, Australia.
46. * Koriat, A., Lichtenstein, S., & Fischhoff, B. (1980). Reasons for confidence. Journal of Experimental Psychology: Human Learning and Memory, 6, 107-118.
47. * Lichtenstein, S., & Fischhoff, B. (1977). Do those who know more also know more about how much they know? Organizational Behavior and Human Performance, 20, 159-183.
48. * Lichtenstein, S., & Fischhoff, B. (1980). Training for calibration. Organizational Behavior and Human Performance, 26, 149-171.
49. Lichtenstein, S., Fischhoff, B., & Phillips, L. D. (1982). Calibration of subjective probabilities: The state of the art up to 1980. In D. Kahneman, P. Slovic, & A. Tversky (Eds.), Judgment under uncertainty: Heuristics and biases (pp. 306-334). New York: Cambridge University Press.
50. * May, R. S. (1986). Overconfidence as a result of incomplete and wrong knowledge. In R. W. Scholz (Ed.), Current issues in West German decision research (pp. 13-30). Frankfurt, Germany: Lang.
51. McClelland, A. G. R., & Bolger, F. (1994). The calibration of subjective probabilities: Theories and models 1980-1993. In G. Wright & P. Ayton (Eds.), Subjective probability (pp. 453-482). Chichester, England: Wiley.
52. McKenzie, C. R. M. (1997). Underweighting alternatives and overconfidence. Organizational Behavior and Human Decision Processes, 71, 141-160.
53. Myers, D. G. (1997). Psychology (5th ed.). New York: Worth.
54. Pfeifer, P. E. (1994). Are we overconfident in the belief that probability forecasters are overconfident? Organizational Behavior and Human Decision Processes, 58, 203-213.
55. * Pliske, R. M., & Mutter, S. A. (1996). Age differences in the accuracy of confidence judgments. Experimental Aging Research, 22, 199-216.
56. Plous, S. (1993). The psychology of judgment and decision making. New York: McGraw-Hill.
57. * Price, P. C. (1998). Effects of relative-frequency elicitation question on likelihood judgment accuracy: The case of external correspondence. Organizational Behavior and Human Decision Processes, 76, 277-297.
58. * Ronis, D. L., & Yates, J. F. (1987). Components of probability judgment accuracy: Individual consistency and effects of subject matter and assessment method. Organizational Behavior and Human Decision Processes, 40, 193-218.
59. * Sniezek, J. A., & Buckley, T. (1995). Cueing and cognitive conflict in judge-advisor decision making. Organizational Behavior and Human Decision Processes, 62, 159-174.
60. * Sniezek, J. A., Paese, P. W., & Switzer, F. S. C. (1990). The effects of choosing on confidence in choice. Organizational Behavior and Human Decision Processes, 46, 264-282.
61. Soll, J. B. (1996). Determinants of overconfidence and miscalibration: The roles of random error and ecological structure. Organizational Behavior and Human Decision Processes, 65, 117-137.
62. Sternberg, R. J. (1996). Cognitive psychology. New York: Harcourt Brace.
63. * Suantak, L., Bolger, F., & Ferrell, W. R. (1996). The "hard-easy effect" in subjective probability calibration. Organizational Behavior and Human Decision Processes, 67, 201-221.
64. * Subbotin, V. (1994). Outcome feedback and confidence in general knowledge. Manuscript submitted for publication, Ben-Gurion University of the Negev, Beer-Sheva, Israel.
65. * Subbotin, V. (1996). Outcome feedback effects on under- and overconfident judgments (general knowledge tasks). Organizational Behavior and Human Decision Processes, 66, 268-276.
66. Svenson, O. (1981). Are we all less risky and more skillful than our fellow drivers? Acta Psychologica, 47, 143-148.
67. Taylor, S. E., & Brown, J. D. (1988). Illusion of well-being: A social psychological perspective on mental health. Psychological Bulletin, 103, 193-210.
68. * Trafimow, D., & Sniezek, J. A. (1994). Perceived expertise and its effect on confidence. Organizational Behavior and Human Decision Processes, 57, 290-302.
69. Tversky, A., & Kahneman, D. (1974, September). Judgment under uncertainty: Heuristics and biases. Science, 185, 1124-1131.
70. Wallsten, T. S., & Budescu, D. V. (1983). Encoding subjective probabilities: A psychological and psychometric review. Management Science, 29, 152-173.
71. Weinstein, N. D. (1980). Unrealistic optimism about future life events. Journal of Personality and Social Psychology, 39, 806-820.
72. * West, R. F., & Stanovich, K. E. (1997). The domain specificity and generality of overconfidence: Individual differences in performance estimation bias. Psychonomic Bulletin and Review, 4, 387-392.
73. * Winman, A. (1997a). The importance of item selection in "knew-it-all-along" studies of general knowledge. Scandinavian Journal of Psychology, 38, 63-72.
74. Winman, A. (1997b). Knowing if you would have known: A model of the hindsight bias (Comprehensive summaries of Uppsala dissertations from the faculty of social sciences, 69). Uppsala, Sweden: Acta Universitatis Upsaliensis.
75. * Winman, A., & Juslin, P. (1993). Calibration of sensory and cognitive judgments: Two different accounts. Scandinavian Journal of Psychology, 34, 135-148.
76. * Winman, A., & Juslin, P. (1994). [Effects of item selection strategies on over/underconfidence]. Unpublished raw data.
77. * Winman, A., Juslin, P., & Björkman, M. (1998). The confidence-hindsight mirror effect in judgment: An accuracy-assessment model for the knew-it-all-along phenomenon. Journal of Experimental Psychology: Learning, Memory, and Cognition, 24, 415-431.
78. * Wolfe, R. W., & Grosch, J. W. (1990). Personality correlates of confidence in one's decisions. Journal of Personality, 58, 515-534.
79. * Wright, G. (1982). Changes in the realism and distribution of probability assessments as a function of question type. Acta Psychologica, 52, 165-174.
80. * Wright, G., & Wishuda, A. (1982). Distribution of probability assessments for almanac and future event questions. Scandinavian Journal of Psychology, 23, 219-224.
81. Yates, J. F. (1990). Judgment and decision making. Englewood Cliffs, NJ: Prentice Hall.
82. Yates, J. F., Lee, J. W., & Bush, J. G. (1997). General knowledge overconfidence: Cross-national variations, response style, and "reality." Organizational Behavior and Human Decision Processes, 70, 87-94.
83. * Yates, J. F., Zhu, Y., Ronis, D. L., Wang, D.-F., Shinotsuka, H., & Toda, M. (1989). Probability judgment accuracy: China, Japan, and the United States. Organizational Behavior and Human Decision Processes, 43, 145-171.
84. * Zakay, D. (1992). The influence of computerized feedback on overconfidence in knowledge. Behaviour and Information Technology, 11, 329-333.
85. * Zakay, D., & Tuvia, R. (1998). Choice latency times as determinants of post-decisional confidence. Acta Psychologica, 98, 103-115.