The Naïve Intuitive Statistician: A Naïve Sampling Model of Intuitive Confidence Intervals

Psychological Review

Volumn 114, Issue 3, 2007, Pages 678-703

  Juslin, Peter ^a   Winman, Anders ^a   Hansson, Patrik ^b  

^a UPPSALA UNIVERSITY   (Sweden)

^b UMEÅ UNIVERSITY   (Sweden)

Author keywords

calibration; confidence intervals; overconfidence; sampling model; subjective probability

Indexed keywords

ARTICLE; DECISION MAKING; EPIDEMIOLOGY; HUMAN; INTUITION; LEARNING; STATISTICAL MODEL;

HUMANS; INTUITION; JUDGMENT; MODELS, STATISTICAL; PROBABILITY LEARNING; SELECTION BIAS;

EID: 34548813857     PISSN: 0033295X     EISSN: None     Source Type: Journal    
DOI: 10.1037/0033-295X.114.3.678     Document Type: Article

References (86)

1. Ackerman P.L., Beier M.E., and Boyle M.O. Working memory and intelligence: The same or different constructs?. Psychological Bulletin 131 (2005) 30-60
2. Baddeley A. Recent developments in working memory. Current Opinion in Neurobiology 8 (1998) 234-238
3. Block R.A., and Harper D.R. Overconfidence in estimation: Testing the anchoring and adjustment hypothesis. Organizational Behavior and Human Decision Processes 49 (1991) 188-207
4. Broadbent D.E. The magic number seven after fifteen years. In: Kennedy A., and Wilkes A. (Eds). Studies in long term memory (1975), Wiley, London 3-18
5. Brunswik E. Representative design and probabilistic theory in a functional psychology. Psychological Review 62 (1955) 193-217
6. Chapman G.B., and Johnson E.J. Incorporating the irrelevant: Anchors in judgments of belief and value. In: Gilovich T., Griffin D.W., and Kahneman D. (Eds). Heuristics and biases: The psychology of intuitive judgment (2002), Cambridge University Press, Cambridge, England 120-138
7. Clemen R.T. Assessing 10-50-90s: A surprise. Decision Analysis Newsletterx 20 (2001, April) 2-15
8. Cowan N. The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Behavioral and Brain Sciences 24 (2001) 87-114 discussion 114-185
9. Denrell J. Why most people disapprove of me: Experience sampling in impression formation. Psychological Review 112 (2005) 951-978
10. Dougherty M.R. Integration of the ecological and error models of overconfidence using a multiple-trace memory model. Journal of Experimental Psychology: General 130 (2001) 579-599
11. Dougherty M.R., Gettys C.F., and Ogden E.E. MINERVA-DM: A memory process model for judgments of likelihood. Psychological Review 106 (1999) 180-209
12. Edwards W. Conservatism in human information processing. In: Kahneman D., Slovic P., and Tversky A. (Eds). Judgment under uncertainty: Heuristics and biases (1982), Cambridge University Press, Cambridge, England 359-369
13. Einhorn H.J., and Hogarth R.M. Confidence in judgment: Persistence of the illusion of validity. Psychological Review 85 (1978) 395-416
14. Elwin E., Juslin P., Olsson H., and Enkvist T. Constructivist coding: Learning from selective feedback. Psychological Science 18 (2007) 105-110
15. Erev I., Wallsten T.S., and Budescu D.V. Simultaneous over- and underconfidence: The role of random error in judgment processes. Psychological Review 101 (1994) 519-527
16. Estes W.K. The cognitive side of probability learning. Psychological Review 83 (1976) 37-64
17. Fiedler K. Beware of samples! A cognitive-ecological sampling approach to judgment biases. Psychological Review 107 (2000) 659-676
18. Fiedler K., and Juslin P. Information sampling and adaptive cognition (2006), Cambridge University Press, New York
19. Fiedler K., and Juslin P. Taking the interface between mind and environment seriously. In: Fiedler K., and Juslin P. (Eds). Information sampling and adaptive cognition (2006), Cambridge University Press, New York 3-32
20. Fischer I., and Budescu D.V. When do those who know more also know more about how much they know? The development of confidence and performance in categorical decision tasks. Organizational Behavior and Human Decision Processes 98 (2005) 39-53
21. Fischhoff B. Debiasing. In: Kahneman D., Slovic P., and Tversky A. (Eds). Judgment under uncertainty: Heuristics and biases (1982), Cambridge University Press, Cambridge, England 422-444
22. Gigerenzer G., Hoffrage U., and Kleinbölting H. Probabilistic mental models: A Brunswikian theory of confidence. Psychological Review 98 (1991) 506-528
23. Gigerenzer G., and Murray D.J. Cognition as intuitive statistics (1987), Erlbaum, Hillsdale, NJ
24. Gigerenzer G., Swijtink Z., Porter T., Daston L., Beatty J., and Kruger L. The empire of chance: How probability changed science and everyday life (1989), Cambridge University Press, Cambridge, England
25. Gilovich T., Griffin D.W., and Kahneman D. Heuristics and biases: The psychology of intuitive judgment (2002), Cambridge University Press, Cambridge, England
26. Goldstein D.G., and Gigerenzer G. Models of ecological rationality: The recognition heuristic. Psychological Review 109 (2002) 75-90
27. Grosskopf B., Erev I., and Yechiam E. Foregone with the wind (2001). http://www2.gsb.columbia.edu/faculty/ierev/foregone4.pdf Retrieved April 7, 2006, from http://www2.gsb.columbia.edu/faculty/ierev/foregone4.pdf
28. Hacking I. The emergence of probability: A philosophical study of early ideas about probability, induction and statistical inference (1975), Cambridge University Press, London
29. Hansson, P., Juslin, P., & Winman, A. (2006). The role of short-term memory and task experience for overconfidence in judgment under uncertainty. Manuscript submitted for publication, Umeå University, Umeå, Sweden.
30. Hasher L., and Zacks R.T. Automatic and effortful processes in memory. Journal of Experimental Psychology: General 108 (1979) 356-388
31. Hertwig R., Barron G., Weber E.U., and Erev I. Decisions from experience and the effect of rare events in risky choice. Psychological Science 15 (2004) 534-539
32. Hertwig R., Pachur T., and Kurzenhäuser S. Judgments of risk frequencies: Tests of possible cognitive mechanisms. Journal of Experimental Psychology: Learning, Memory, and Cognition 35 (2005) 621-642
33. Johnson-Laird P.N. Mental models: Towards a cognitive science of language, inference and consciousness (1983), Harvard University Press, Cambridge, MA
34. Juslin P. The overconfidence phenomenon as a consequence of informal experimenter-guided selection of almanac items. Organizational Behavior and Human Decision Processes 57 (1994) 226-246
35. Juslin P., Olsson H., and Bjorkman M. Brunswikian and Thurstonian origins of bias in probability assessment: On the interpretation of stochastic components of judgment. Journal of Behavioral Decision Making 10 (1997) 189-209
36. Juslin P., and Persson M. PROBabilities from EXemplars (PROBEX): A "lazy" algorithm for probabilistic inference from generic knowledge. Cognitive Science 26 (2002) 563-607
37. Juslin P., Wennerholm P., and Olsson H. Format dependence in subjective probability calibration. Journal of Experimental Psychology: Learning, Memory, and Cognition 28 (1999) 1038-1052
38. Juslin P., Winman A., and Olsson H. Naive empiricism and dogmatism in confidence research: A critical examination of the hard-easy effect. Psychological Review 107 (2000) 384-396
39. Juslin P., Winman A., and Olsson H. Calibration, additivity, and source independence of probability judgments in general knowledge and sensory discrimination tasks. Organizational Behavior and Human Decision Processes 92 (2003) 34-51
40. Just M.A., and Carpenter P.A. A capacity theory of comprehension: Individual differences in working memory. Psychological Review 99 (1992) 122-149
41. Kahneman D., and Frederick S. Representativeness revisited: Attribute substitution in intuitive judgment. In: Gilovich T., Griffin D.W., and Kahneman D. (Eds). Heuristics and biases: The psychology of intuitive judgment (2002), Cambridge University Press, Cambridge, England 49-81
42. Kahneman D., Slovic P., and Tversky A. Judgment under uncertainty: Heuristics and biases (1982), Cambridge University Press, Cambridge, England
43. Kahneman D., and Tversky A. Prospect theory: An analysis of decision under risk. Econometrica 47 (1979) 263-291
44. Kahneman D., and Tversky A. The simulation heuristic. In: Kahneman D., Slovic P., and Tversky A. (Eds). Judgment under uncertainty: Heuristics and biases (1982), Cambridge University Press, Cambridge, England 201-208
45. Kahneman D., and Tversky A. On the reality of cognitive illusions. Psychological Review 103 (1996) 582-591
46. Kane M.J., Hambrick D.Z., and Conway A.R. Working memory capacity and fluid intelligence are strongly related constructs: Comment on Ackerman, Beier, and Boyle (2005). Psychological Bulletin 131 (2005) 66-71
47. Kareev Y., Arnon S., and Horwitz-Zeliger R. On the misperception of variability. Journal of Experimental Psychology: General 131 (2002) 287-297
48. Keren G. Facing uncertainty in the game of bridge. Organizational Behavior and Human Decision Processes 39 (1987) 98-114
49. Keren G. Calibration and probability judgments: Conceptual and methodological issues. Acta Psychologica 77 (1991) 217-273
50. Klayman J., Soll J.B., Gonzalez-Vallejo C., and Barlas S. Overconfidence: It depends on how, what, and whom you ask. Organizational Behavior and Human Decision Processes 79 (1999) 216-247
51. Lichtenstein S., Fischhoff B., and Phillips L.D. Calibration of subjective probabilities: The state of the art up to 1980. In: Kahneman D., Slovic P., and Tversky A. (Eds). Judgment under uncertainty: Heuristics and biases (1982), Cambridge University Press, Cambridge, England 306-334
52. Lichtenstein S., Slovic P., Fischhoff B., Layman M., and Combs B. Judged frequency of lethal events. Journal of Experimental Psychology: Human Learning and Memory 4 (1978) 551-578
53. Macmillan N.A., and Creelman C.D. Detection theory: A user's guide (1991), Cambridge University Press, New York
54. Marr D. Vision: A computational investigation into the human representation and processing of visual information (1982), Freeman, San Francisco
55. Miller G.A. The magical number seven plus or minus two: Some limits on our capacity for processing information. Psychological Review 63 (1956) 81-97
56. Murphy A.H., and Brown B.G. A comparative evaluation of objective and subjective weather forecasts in the United States. In: Wright G. (Ed). Behavioral decision making (1985), Plenum Press, New York 329-359
57. Murphy A.H., and Winkler R.L. Reliability of subjective probability forecasts of precipitation and temperature. Applied Statistics 26 (1977) 41-47
58. Newell A., and Simon H. Human problem solving (1972), Prentice-Hall, Englewood Cliffs, NJ
59. Nilsson H., Olsson H., and Juslin P. The cognitive substrate of subjective probability. Journal of Experimental Psychology: Learning, Memory, and Cognition 31 (2005) 600-620
60. Nosofsky R.M., and Johansen M.K. Exemplar-based accounts of "multiple-system" phenomena in perceptual categorization. Psychonomic Bulletin & Review 7 (2000) 375-402
61. Peterson C.R., and Beach L.R. Man as an intuitive statistician. Psychological Bulletin 68 (1967) 29-46
62. Piaget J., and Inhelder B. The child's conception of space (1956), Routledge & Kegan Paul, London
63. Pitz G.F. Subjective probability distributions for imperfectly known quantities. In: Gregg L.W. (Ed). Knowledge and cognition (1974), Erlbaum, Potomac, MD 29-41
64. Poulsen O.M., Holst E., and Christensen J.M. Calculation and application of coverage intervals for biological reference values. Pure and Applied Chemistry 69 (1997) 1601-1611
65. Raven J.C. Advanced Progressive Matrices, Sets I and II (1965), Lewis, London
66. Russo J.E., and Schoemaker P.J. Managing overconfidence. Sloan Management Review 33 (1992) 7-17
67. Schwarz N., and Wänke M. Experiential and contextual heuristics in frequency judgment: Ease of recall and response scales. In: Sedlmeier P., and Betsch T. (Eds). Etc.: Frequency processing and cognition (2002), Oxford University Press, Oxford, England 89-108
68. Sedlmeier P., and Betsch T. Etc.: Frequency processing and cognition (2002), Oxford University Press, Oxford, England
69. Sieck W.R., and Yates J.F. Overconfidence effects in category learning: A comparison of connectionist and exemplar memory models. Journal of Experimental Psychology: Learning, Memory, and Cognition 27 (2001) 1003-1021
70. Slovic P., Griffin D.W., and Tversky A. Compatibility effects in judgment and choice. In: Gilovich T., Griffin D.W., and Kahneman D. (Eds). Heuristics and biases: The psychology of intuitive judgment (2002), Cambridge University Press, Cambridge, England 217-229
71. Soll J.B. Determinants of overconfidence and miscalibration: The roles of random error and ecological structure. Organizational Behavior and Human Decision Processes 65 (1996) 117-137
72. Soll J.B., and Klayman J. Overconfidence in interval estimates. Journal of Experimental Psychology: Learning, Memory, and Cognition 30 (2004) 299-314
73. Stewart N., Chater N., and Brown G.D.A. Decision by sampling. Cognitive Psychology 53 (2006) 1-26
74. Tomassini L.A., Solomon I., Romney M.B., and Krogstad J.L. Calibration of auditors' probabilistic judgments: Some empirical evidence. Organizational Behavior and Human Performance 30 (1982) 391-406
75. Tversky A., and Kahneman D. Belief in the law of small numbers. Psychological Bulletin 2 (1971) 105-110
76. Tversky A., and Kahneman D. Judgment under uncertainty: Heuristics and biases. Science 185 (1974, September 27) 1124-1131
77. Tversky A., and Kahneman D. Extensional versus intuitive reasoning: The conjunction fallacy in probability judgment. Psychological Review 90 (1983) 293-315
78. Tversky A., and Koehler D.J. Support theory: A nonextensional representation of subjective probability. Psychological Review 101 (1994) 547-567
79. Weber E.U., Shafir S., and Blaise A.-R. Predicting risk sensitivity in humans and lower animals: Risk as variance or coefficient of variation. Psychological Review 111 (2004) 430-445
80. Wechsler D. Wechsler Memory Scale-Revised (1987), Harcourt Assessment, San Antonio, TX
81. Winman A., Hansson P., and Juslin P. Subjective probability intervals: How to cure overconfidence by interval evaluation. Journal of Experimental Psychology: Learning, Memory, and Cognition 30 (2004) 1167-1175
82. Winman A., and Juslin P. Calibration of sensory and cognitive judgments: Two different accounts. Scandinavian Journal of Psychology 34 (1993) 135-148
83. Yaniv I., and Foster D.P. Graininess of judgment under uncertainty: An accuracy-informativeness trade-off. Journal of Experimental Psychology: General 124 (1995) 424-432
84. Yaniv I., and Foster D.P. Precision and accuracy of judgmental estimation. Journal of Behavioral Decision Making 10 (1997) 21-32
85. Yechiam E., and Busemeyer J.R. The effect of foregone payoffs on underweighting small probability events. Journal of Behavioral Decision Making 19 (2006) 1-16
86. Zacks R.T., and Hasher L. Frequency processing: A twenty-five year perspective. In: Sedlmeier P., and Betsch T. (Eds). Etc.: Frequency processing and cognition (2002), Oxford University Press, Oxford, England 21-36