Demonstrating and eliminating the aggregation effect in physical skill tasks

Journal of Behavioral Decision Making

Volumn 24, Issue 1, 2011, Pages 1-22

  Stone, Eric R ^a   Rittmayer, Ashley D ^a,b   Murray, Nicole T ^a   McNiel, J Murray ^a  

^a WAKE FOREST UNIVERSITY   (United States)

^b RICE UNIVERSITY   (United States)

Author keywords

Aggregation effect; Base rates; Confidence; Judgment; Skill

Indexed keywords

EID: 78650541123     PISSN: 08943257     EISSN: 10990771     Source Type: Journal    
DOI: 10.1002/bdm.675     Document Type: Article

References (49)

1. Allison, S. T., Messick, D. M., & Goethals, G. R. (1989). On being better but not smarter than others: The Muhammad Ali effect. Social Cognition, 7, 275-296.
2. Allwood, C. M., & Granhag, P. A. (1996). Considering the knowledge you have: Effects on realism in confidence judgments. European Journal of Cognitive Psychology, 8, 235-256.
3. Baranski, J. V., & Petrusic, W. M. (1995). On the calibration of knowledge and perception. Canadian Journal of Experimental Psychology, 49, 397-407.
4. Baranski, J. V., & Petrusic, W. M. (1999). Realism of confidence in sensory discrimination. Perception & Psychophysics, 61, 1369-1383.
5. Brenner, L. A., Koehler, D. J., Liberman, V., & Tversky, A. (1996). Overconfidence in probability and frequency judgments: A critical examination. Organizational Behavior and Human Decision Processes, 65, 212-219.
6. Cohen, J., Dearnaley, E. J., & Hansel, C. E. M. (1956). Risk and hazard: Influence of training on the performance of bus drivers. Operational Research Quarterly, 7, 67-82.
7. Cuite, C. L., Weinstein, N. D., Emmons, K., & Colditz, G. (2008). A test of numeric formats for communicating risk probabilities. Medical Decision Making, 28, 377-384.
8. Dunning, D., Griffin, D. W., Milojkovic, J. D., & Ross, L. (1990). The overconfidence effect in social prediction. Journal of Personality and Social Psychology, 58, 568-581.
9. Ferrell, W. R. (1994). Calibration of sensory and cognitive judgments: A single model for both. Scandinavian Journal of Psychology, 35, 297-314.
10. Ferrell, W. R., & McGoey, P. J. (1980). A model of calibration for subjective probabilities. Organizational Behavior and Human Performance, 26, 32-53.
11. Gigerenzer, G., & Hoffrage, U. (1999). Overcoming difficulties in Bayesian reasoning: A reply to Lewis and Keren (1999) and Mellers and McGraw (1999). Psychological Review, 106, 425-430.
12. Gigerenzer, G., Hoffrage, U., & Kleinbölting, H. (1991). Probabilistic mental models: A Brunswikian theory of confidence. Psychological Review, 98, 506-528.
13. Griffin, D., & Buehler, R. (1999). Frequency, probability, and prediction: Easy solutions to cognitive illusions? Cognitive Psychology, 38, 48-78.
14. Griffin, D., & Tversky, A. (1992). The weighing of evidence and the determinants of confidence. Cognitive Psychology, 24, 411-435.
15. Harvey, N. (1994). Relations between confidence and skilled performance. In G. Wright, & P. Ayton (Eds.), Subjective probability (pp. 321-352). Chichester, England: Wiley.
16. Hoch, S. J. (1985). Counterfactual reasoning and accuracy in predicting personal events. Journal of Experimental Psychology: Learning, Memory, and Cognition, 11, 719-731.
17. Hoffrage, U., Gigerenzer, G., Krauss, S., & Martignon, L. (2002). Representation facilitates reasoning: What natural frequencies are and what they are not. Cognition, 84, 343-352.
18. Juslin, P. (1994). The overconfidence phenomenon as a consequence of informal experimenter-guided selection of almanac items. Organizational Behavior and Human Decision Processes, 57, 226-246.
19. Juslin, P., & Winman, A. (1995). Reply to William R. Ferrell's paper Calibration of sensory and cognitive judgments: A single model for both. Scandinavian Journal of Psychology, 36, 153-163.
20. Juslin, P., Winman, A., & Olsson, H. (2003). Calibration, additivity, and source independence of probability judgments in general knowledge and sensory discrimination tasks. Organizational Behavior and Human Decision Processes, 92, 34-51.
21. Kahneman, D., & Lovallo, D. (1993). Timid choices and bold forecasts: A cognitive perspective on risk taking. Management Science, 39, 17-31.
22. Kahneman, D., & Tversky, A. (1973). On the psychology of prediction. Psychological Review, 80, 237-251.
23. Koehler, J. J. (1996). The base rate fallacy reconsidered: Descriptive, normative, and methodological challenges. Behavioral and Brain Sciences, 19, 1-53.
24. Koriat, A., Lichtenstein, S., & Fischhoff, B. (1980). Reasons for confidence. Journal of Experimental Psychology: Human Learning and Memory, 6, 107-118.
25. Kunda, Z. (1990). The case for motivated reasoning. Psychological Bulletin, 108, 480-498.
26. Lee, J.-W., Yates, J. F., Shinotsuka, H., Singh, R., Onglatco, M. L. U., Yen, N.-S., et al. (1995). Cross-national differences in overconfidence. Asian Journal of Psychology, 1, 63-69.
27. Lichtenstein, S., Fischhoff, B., & Phillips, L. D. (1982). Calibration of probabilities: The state of the art to (1980). In D. Kahneman, P. Slovic, & A. Tversky (Eds.), Judgment under uncertainty: Heuristics and biases (pp. 306-334). Cambridge: Cambridge University Press.
28. Mazzoni, G., & Nelson, T. O. (1995). Judgments of learning are affected by the kind of encoding in ways that cannot be attributed to the level of recall. Journal of Experimental Psychology: Learning, Memory, and Cognition, 21, 1263-1274.
29. McGraw, A. P., Mellers, B. A., & Ritov, I. (2004). The affective costs of overconfidence. Journal of Behavioral Decision Making, 17, 281-295.
30. Moore, D. A., & Healy, P. J. (2008). The trouble with overconfidence. Psychological Review, 115, 502-517.
31. Nisbett, R. E., & Borgida, E. (1975). Attribution and the psychology of prediction. Journal of Personality and Social Psychology, 32, 932-943.
32. Price, P. C. (1998). Effects of a relative-frequency elicitation question on likelihood judgment accuracy: The case of external correspondence. Organizational Behavior and Human Decision Processes, 76, 277-297.
33. Pulford, B. D., & Colman, A. M. (1996). Overconfidence, base rates and outcome positivity/negativity of predicted events. British Journal of Psychology, 87, 431-445.
34. Rakow, T., Harvey, N., & Finer, S. (2003). Improving calibration without training: The role of task information. Applied Cognitive Psychology, 17, 419-441.
35. Reeves, T., & Lockhart, R. S. (1993). Distributional versus singular approaches to probability and errors in probabilistic reasoning. Journal of Experimental Psychology: General, 122, 207-226.
36. Reyna, V. F., & Brainerd, C. J. (2008). Numeracy, ratio bias, and denominator neglect in judgments of risk and probability. Learning and Individual Differences, 18, 89-107.
37. Schneider, S. L. (1995). Item difficulty, discrimination, and the confidence-frequency effect in a categorical judgment task. Organizational Behavior and Human Decision Processes, 61, 148-167.
38. Sieck, W. R., Merkle, E. C., & Van Zandt, T. (2007). Option fixation: A cognitive contributor to overconfidence. Organizational Behavior and Human Decision Processes, 103, 68-83.
39. Sloman, S. A., Over, D., Slovak, L., & Stibel, J. M. (2003). Frequency illusions and other fallacies. Organizational Behavior and Human Decision Processes, 91, 296-309.
40. Sniezek, J. A., & Buckley, T. (1991). Confidence depends on the level of aggregation. Journal of Behavioral Decision Making, 4, 263-272.
41. Sniezek, J. A., Paese, P. W., & Switzer, F. S. (1990). The effect of choosing on confidence in choice. Organizational Behavior and Human Decision Processes, 46, 264-282.
42. Stone, E. R., Dodrill, C. L., & Johnson, N. (2001). Depressive cognition: A test of depressive realism versus negativity using general knowledge questions. The Journal of Psychology, 135, 583-602.
43. Svenson, O. (1981). Are we all less risky and more skillful than our fellow drivers? Acta Psychologica, 47, 143-148.
44. Treadwell, J. R., & Nelson, T. O. (1996). Availability of information and the aggregation of confidence in prior decisions. Organizational Behavior and Human Decision Processes, 68, 13-27.
45. Vallone, R. P., Griffin, D. W., Lin, S., & Ross, L. (1990). Overconfident prediction of future actions and outcomes by self and others. Journal of Personality and Social Psychology, 58, 582-592.
46. West, R. F., & Stanovich, K. E. (1997). The domain specificity and generality of overconfidence: Individual differences in performance estimation bias. Psychonomic Bulletin & Review, 4, 387-392.
47. Winman, A., & Juslin, P. (1993). Calibration of sensory and cognitive judgments: Two different accounts. Scandinavian Journal of Psychology, 34, 135-148.
48. Yates, J. F. (1982). External correspondence: Decompositions of the mean probability score. Organizational Behavior and Human Performance, 30, 132-156.
49. Yates, J. F., Lee, J.-W., & Shinotsuka, H. (1996). Beliefs about overconfidence, including its cross-national variation. Organizational Behavior and Human Decision Processes, 65, 138-147.