Intuitive judgments of social statistics: How exhaustive does sampling need to be?

Journal of Experimental Social Psychology

Volumn 49, Issue 6, 2013, Pages 1059-1077

  Pachur, Thorsten ^a   Hertwig, Ralph ^a   Rieskamp, Jörg ^b  

^a MAX PLANCK INSTITUTE FOR HUMAN DEVELOPMENT   (Germany)

^b UNIVERSITY OF BASEL   (Switzerland)

Author keywords

Availability; Decision strategy; Frequency; Heuristics; Sampling

Indexed keywords

EID: 84882782102     PISSN: 00221031     EISSN: 10960465     Source Type: Journal    
DOI: 10.1016/j.jesp.2013.07.004     Document Type: Article

References (114)

1. Anderson J.R., Bothell D., Byrne M.D., Douglass S., Lebiere C., Qin Y. An integrated theory of the mind. Psychological Review 2004, 111:1036-1060.
2. Anderson J.R., Lebiere C. The atomic components of thought 1998, Erlbaum, Mahwah, NJ.
3. Anderson J.R., Milson R. Human memory: An adaptive perspective. Psychological Review 1989, 96:703-719.
4. Antunes J.L.F., Waldman E.A. Trends and spatial distribution of deaths of children aged 12-60months in São Paulo, Brazil, 1980-98. Bulletin of the World Health Organization 2002, 80:391-398.
5. Benjamin D.K., Dougan W.R. Individuals' estimates of the risks of death: Part I-A reassessment of the previous evidence. Journal of Risk and Uncertainty 1997, 15:115-133.
6. Benjamin D.K., Dougan W.R., Buschena D. Individuals' estimates of the risks of death: Part II-New evidence. Journal of Risk and Uncertainty 2001, 22:35-57.
7. Bond C.F., Brockett D.R. A social context personality index theory of memory for acquaintances. Journal of Personality and Social Psychology 1987, 52:1110-1121.
8. Boyce C.J., Brown G.D.A., Moore S.C. Money and happiness: Rank of income, not income, affects life satisfaction. Psychological Science 2010, 21:471-475.
9. Bröder A., Gaissmaier W. Sequential processing of cues in memory-based multi-attribute decisions. Psychonomic Bulletin and Review 2007, 14:895-900.
10. Bröder A., Schiffer S. "Take-the-best" versus simultaneous feature matching: Probabilistic inferences from memory and effects of representation format. Journal of Experimental Psychology. General 2003, 132:277-293.
11. Bröder A., Schiffer S. Stimulus format and working memory in fast and frugal strategy selection. Journal of Behavioral Decision Making 2006, 19:361-380.
12. Brunswik E. The conceptual framework of psychology. International encyclopaedia of unified science 1952, vol. I, no. 10. University of Chicago Press, Chicago, IL.
13. Brunswik E. Representative design and probabilistic theory in a functional psychology. Psychological Review 1955, 62:193-217.
14. Bundesamt für Statistik Todesursachenstatistik: Ursachen der Sterblichkeit 1999 und 2000 2004, Bundesamt für Statistik, Neuchâtel, Switzerland.
15. Burnham K.P., Anderson D.R. Model selection and inference: A practical information-theoretic approach 1998, Springer, New York, NY.
16. Chambers J.R. Explaining false uniqueness: Why we're both better and worse than others. Social and Personality Psychology Compass 2008, 2:1-17.
17. Clauset A., Shalizi C.R., Newman M.E.J. Power-law distributions in empirical data. SIAM Review 2009, 51:661-703.
18. Cohen J. A power primer. Psychological Bulletin 1992, 112:155-159.
19. Combs B., Slovic P. Causes of death: Biased newspaper coverage and biased judgments. Journalism Quarterly 1979, 56(837-843):849.
20. Dawes R.M. The robust beauty of improper linear models in decision making. American Psychologist 1979, 34:571-582.
21. De Schryver M., Vandist K., Rosseel Y. How many exemplars are used? Explorations with the Rex Leopold I model. Psychonomic Bulletin and Review 2009, 16:337-343.
22. Dhami M., Hertwig R., Hoffrage U. The role of representative design in an ecological approach to cognition. Psychological Bulletin 2004, 130:959-988.
23. Dieckmann A., Rieskamp J. The influence of information redundancy on probabilistic inferences. Memory and Cognition 2007, 35:1801-1813.
24. Dougherty M.R.P., Gettys C.F., Ogden E.E. MINERVA-DM: A memory processes model for judgments of likelihood. Psychological Review 1999, 106:180-209.
25. ECDC Rapid Risk Assessment Outbreak of Shiga toxin-producing E. coli (STEC) in Germany 2011, May 27, European Centre for Disease Prevention and Control, Stockholm.
26. Einhorn H.J. The use of nonlinear, noncompensatory models in decision making. Psychological Bulletin 1970, 73:221-230.
27. Information sampling and adaptive cognition 2005, Cambridge University Press, New York, NY. K. Fiedler, P. Juslin (Eds.).
28. Fiedler K., Kareev Y. Does decision quality (always) increase with the size of information samples? Some vicissitudes in applying the law of large numbers. Journal of Experimental Psychology: Learning, Memory, and Cognition 2006, 32:883-903.
29. Fischer P., Krueger J.I., Greitemeyer T., Vogrincic C., Kastenmüller A., Frey D., et al. The bystander-effect: A meta-analytic review on bystander intervention in dangerous and non-dangerous emergencies. Psychological Bulletin 2011, 137:517-537.
30. Fiske A.P. Social schemata for remembering people: Relationships and person attributes in free recall of acquaintances. Journal of Quantitative Anthropology 1995, 5:305-324.
31. Ford J.K., Schmitt N., Schechtman S.L., Hults B.H., Doherty M.L. Process tracing methods: Contributions, problems, and neglected research questions. Organizational Behavior and Decision Processes 1989, 43:75-117.
32. Fowler J., Settle J., Christakis N. Correlated genotypes in friendship networks. Proceedings of the National Academy of Sciences 2011, 108:1993-1997.
33. Gaissmaier W., Schooler L.J., Rieskamp J. Simple predictions fueled by capacity limitations: When are they successful?. Journal of Experimental Psychology: Learning, Memory, and Cognition 2006, 32:966-982.
34. Galesic M., Olsson H., Rieskamp J. Social sampling explains apparent biases in judgments of social environments. Psychological Science 2012, 23:1515-1523.
35. Geary D.C., Bjorklund D.F. Evolutionary developmental psychology. Child Development 2000, 71:57-65.
36. Gigerenzer G., Goldstein D.G. Reasoning the fast and frugal way: Models of bounded rationality. Psychological Review 1996, 103:650-669.
37. Heuristics: The foundations of adaptive behavior 2011, Oxford University Press, New York. G. Gigerenzer, R. Hertwig, T. Pachur (Eds.).
38. Gigerenzer G., Hoffrage U., Goldstein D.G. Fast and frugal heuristics are plausible models of cognition: Reply to Dougherty, Franco-Watkins, and Thomas. Psychological Review 2008, 115:230-239.
39. Gigerenzer G., Hoffrage U., Kleinbölting H. Probabilistic mental models: A Brunswikian theory of confidence. Psychological Review 1991, 98:506-528.
40. Gigerenzer G., Todd P.M., the ABC Research Group Simple heuristics that make us smart 1999, Oxford University Press, New York, NY.
41. Goldstein N.J., Cialdini R.B., Griskevicius A room with a viewpoint: Using social norms to motivate environmental conservation in hotels. Journal of Consumer Research 2008, 35:472-482.
42. Goldstein D.G., Gigerenzer G. Models of ecological rationality: The recognition heuristic. Psychological Review 2002, 109:75-90.
43. Gosling S.D., Ko S.J., Mannarelli T., Morris M.E. A room with a cue: Judgments of personality based on offices and bedrooms. Journal of Personality and Social Psychology 2002, 82:379-398.
44. Hamill R., Wilson T.D., Nisbett R.E. Insensitivity to sample bias: Generalizing from atypical cases. Journal of Personality and Social Psychology 1980, 39:578-589.
45. Hamilton W.D. The genetical evolution of social behaviour, I and II. Journal of Theoretical Biology 1964, 7:1-52.
46. Hammond K.R. Probabilistic functioning and the clinical method. Psychological Review 1955, 62:255-262.
47. Henrich N., Henrich J. Why humans cooperate: A cultural and evolutionary explanation 2007, Oxford University Press, New York, NY.
48. Hertwig R., Herzog S.M. Fast and frugal heuristics: Tools of social rationality. Social Cognition 2009, 27:661-698.
49. Hertwig R., Herzog S.M., Schooler L.J., Reimer T. Fluency heuristic: A model of how the mind exploits a by-product of information retrieval. Journal of Experimental Psychology: Learning, Memory, and Cognition 2008, 34:1191-1206.
50. Hertwig R., Hoffrage U., Martignon L. Quick estimation: Letting the environment do the work. Simple heuristics that make us smart 1999, 209-234. Oxford University Press, New York, NY. G. Gigerenzer, P.M. Todd, the ABC Research Group (Eds.).
51. Hertwig R., Hoffrage U., Sparr R. The QuickEst heuristic: How to benefit from an imbalanced world. Ecological rationality: Intelligence in the world 2013, Oxford University Press, Oxford, UK. P.M. Todd, G. Gigerenzer, the ABC Research Group (Eds.).
52. Hertwig R., Hoffrage U., the ABC Research Group Simple heuristics in a social world 2013, Oxford University Press, New York, NY.
53. Hertwig R., Pachur T., Kurzenhäuser S. Judgments of risk frequencies: Tests of possible cognitive mechanisms. Journal of Experimental Psychology: Learning, Memory, and Cognition 2005, 31:621-642.
54. Hertwig R., Pleskac T.J. The game of life: How small samples render choices simpler. The probabilistic mind: Prospects for rational models of cognition 2008, 209-235. Oxford University Press, Oxford, UK. N. Chater, M. Oaksford (Eds.).
55. Hertwig R., Pleskac T.J. How small samples amplify perceived differences in decisions from experience. Cognition 2010, 115:225-237.
56. Hilbig B.E., Erdfelder E., Pohl R.F. Fluent, fast, and frugal? A formal model evaluation of the interplay between memory, fluency, and comparative judgments. Journal of Experimental Psychology: Learning, Memory, and Cognition 2011, 37:827-839.
57. Hill R.A., Dunbar R.I.M. Social network size in humans. Human Nature 2003, 14:53-72.
58. Hills T.T., Pachur T. Dynamic search and working memory in social recall. Journal of Experimental Psychology: Learning, Memory, and Cognition 2012, 38:218-228.
59. Hills T.T., Todd P.M., Goldstone R.L. Search in external and internal spaces. Psychological Science 2008, 19:676-682.
60. Jeffreys H. Theory of probability 1961, Clarendon Press, Oxford, UK.
61. Juslin P., Fiedler K., Chater N. Less is more in contingency assessment. Or is it?. Information sampling and adaptive cognition 2006, Cambridge University Press, Cambridge, UK. K. Fiedler, P. Juslin (Eds.).
62. Juslin P., Olsson H. Capacity limitations and the detection of correlations: Comment on Kareev (2000). Psychological Review 2005, 112:256-267.
63. Juslin P., Persson M. PROBabilities from EXemplars (PROBEX): A "lazy" algorithm for probabilistic inference from generic knowledge. Cognitive Science 2002, 26:563-607.
64. Kahn R.L., Antonucci T.C. Convoys over the life course: Attachment, roles, and social support. Life Span Development and Behavior 1980, 3:253-286.
65. Kareev Y. Seven (indeed, plus or minus two) and the detection of correlations. Psychological Review 2000, 107:397-402.
66. Kareev Y. And yet the small-sample effect does hold: Reply to Juslin and Olsson (2005) and Anderson, Doherty, Berg, and Friedrich (2005). Psychological Review 2005, 112:280-285.
67. Katsikopoulos K., Pachur T., Machery E., Wallin A. From Meehl (1954) to fast and frugal heuristics (and back): New insights into how to bridge the clinical-actuarial divide. Theory and Psychology 2008, 18:443-464.
68. Katsikopoulos K.V., Schooler L.J., Hertwig R. The robust beauty of ordinary information. Psychological Review 2010, 117:1259-1266.
69. Khader P.H., Pachur T., Meier S., Bien S., Jost K., Rösler F. Memory-based decision making with heuristics involves increased activation of decision-relevant memory representations. Journal of Cognitive Neuroscience 2011, 23:3540-3554.
70. Krueger J.I., Clement R.W. The truly false consensus effect: An ineradicable and egocentric bias in social perception. Journal of Personality and Social Psychology 1994, 67:596-610.
71. Lichtenstein S., Slovic P., Fischhoff B., Layman M., Combs B. Judged frequency of lethal events. Journal of Experimental Psychology: Human Learning and Memory 1978, 4:551-578.
72. Marks G., Miller N. Ten years of research on the false-consensus effect: An empirical and theoretical review. Psychological Bulletin 1987, 102:72-90.
73. Martignon L., Hoffrage U. Fast, frugal and fit: Simple heuristics for paired comparison. Theory and Decision 2002, 52:29-71.
74. McPherson M., Smith-Lovin L., Cook J. Birds of a feather: Homophily in social networks. Annual Review of Sociology 2001, 27:415-444.
75. Milardo R.M. Comparative methods for delineating social networks. Journal of Social and Personal Relationships 1992, 9:447-461.
76. Moreno J.L. Organization of the social atom. Sociometric Review 1936, 1:11-16.
77. Moyer R.S., Bayer R.H. Mental comparison and the symbolic distance effect. Cognitive Psychology 1976, 8:228-246.
78. Newman M.E.J. Power laws, Pareto distributions, and Zip's law. Contemporary Physics 2005, 46:323-351.
79. Nisbett R.E., Borgida E. Attribution and the psychology of prediction. Journal of Personality and Social Psychology 1975, 32:932-943.
80. Nosofsky R.M. Attention, similarity, and the identification-categorization relationship. Journal of Experimental Psychology. General 1986, 115:39-57.
81. Nosofsky R.M., Bergert F.B. Limitations of exemplar models of multi-attribute probabilistic inference. Journal of Experimental Psychology: Learning, Memory, and Cognition 2007, 33:999-1019.
82. Oppenheimer D. Spontaneous discounting of availability in frequency judgment tasks. Psychological Science 2004, 15:100-105.
83. Pachur T. Recognition-based inference: When is less more in the real world?. Psychonomic Bulletin and Review 2010, 17:589-598.
84. Pachur T., Aebi-Forrer E. Selection of decision strategies after conscious and unconscious thought. Journal of Behavioral Decision Making 2013, (in press, Advance online publication). 10.1002/bdm.1780.
85. Pachur T., Hertwig R. On the psychology of the recognition heuristic: Retrieval primacy as a key determinant of its use. Journal of Experimental Psychology: Learning, Memory, and Cognition 2006, 32:983-1002.
86. Pachur T., Hertwig R., Rieskamp J. The mind as an intuitive pollster: Frugal search in social spaces. Simple heuristics in a social world 2013, 261-291. Oxford University Press, New York, NY. R. Hertwig, U. Hoffrage, the ABC Research Group (Eds.).
87. Pachur T., Hertwig R., Steinmann F. How do people judge risks: Availability heuristic, affect heuristic, or both?. Journal of Experimental Psychology. Applied 2012, 18:314-330.
88. Pachur T., Marinello G. Expert intuitions: How to model the decision strategies of airport customs officers?. Acta Psychologica 2013, 144:97-103.
89. Pachur T., Olsson H. Type of learning task impacts performance and strategy selection in decision making. Cognitive Psychology 2012, 65:207-240.
90. Pachur T., Schooler L.J., Stevens J.R. When will we meet again? Regularities of social connectivity and their reflections in memory and decision making. Simple heuristics in a social world 2013, 199-224. Oxford University Press, New York. R. Hertwig, U. Hoffrage, the ABC Research Group (Eds.).
91. Pachur T., Todd P.M., Gigerenzer G., Schooler L.J., Goldstein D.G. The recognition heuristic: A review of theory and tests. Frontiers in Cognitive Science 2011, 2:147.
92. Payne J.W., Bettman J.R., Johnson E.J. The adaptive decision-maker 1993, Cambridge University Press, Cambridge, UK.
93. Persson M., Rieskamp J. Inferences from memory: Strategy- and exemplar-based judgment models compared. Acta Psychologica 2009, 130:25-37.
94. Pirolli P., Card S.K. Information foraging. Psychological Review 1999, 106:643-675.
95. Rands S.A., Pettifor R.A., Rowcliffe J.M., Cowlishaw G. State-dependent foraging rules for social animals in selfish herds. Proceedings of the Royal Society B: Biological Sciences 2004, 271:2613-2620.
96. Richerson P.J., Boyd R. Not by genes alone: How culture transformed human evolution 2005, University of Chicago Press, Chicago, IL.
97. Rieskamp J., Hoffrage U. Inferences under time pressure: How opportunity costs affect strategy selection. Acta Psychologica 2008, 127:258-276.
98. Ross L., Greene D., House P. The "false consensus effect": An egocentric bias in social perception and attribution processes. Journal of Experimental Social Psychology 1977, 13:279-301.
99. Salganik M.J., Dodds P.S., Watts D.J. Experimental study of inequality and unpredictability in an artificial cultural market. Science 2006, 311:854-856.
100. Schooler L.J., Hertwig R. How forgetting aids heuristic inference. Psychological Review 2005, 112:610-627.
101. Schwarz N., Bless H., Strack F., Klumpp G., Rittenauer-Schatka H., Simons A. Ease of retrieval as information: Another look at the availability heuristic. Journal of Personality and Social Psychology 1991, 61:195-202.
102. Schweickart O., Brown N.R. Magnitude comparison extended: How lack of knowledge informs comparative judgments under uncertainty. Journal of Experimental Psychology. General 2013, (in press, Advance online publication). 10.1037/a0031451.
103. Sedlmeier P., Hertwig R., Gigerenzer G. Are judgments of the positional frequencies of letters systematically biased due to availability?. Journal of Experimental Psychology: Learning, Memory, and Cognition 1998, 24:754-770.
104. Simon H.A. Invariants of human behavior. Annual Review of Psychology 1990, 41:1-19.
105. Singer P. The expanding circle: Ethics and sociobiology 1981, Oxford University Press, Oxford, UK.
106. Smallman-Raynor M., Cliff A.D. Avian influenza A (H5N1) age distribution in humans. Emerging Infectious Diseases 2007, 13:510.
107. Statistisches Bundesamt Statistisches Jahrbuch 2001 für die Bundesrepublik. Deutschland 2002, Author, Wiesbaden, Germany.
108. Ecological rationality: Intelligence in the world 2012, Oxford University Press, New York, NY. P.M. Todd, G. Gigerenzer, the ABC Research Group (Eds.).
109. Tversky A. Elimination by aspects: A theory of choice. Psychological Review 1972, 79:281-299.
110. Tversky A., Kahneman D. Availability: A heuristic for judging frequency and probability. Cognitive Psychology 1973, 5:207-232.
111. Wasserman L. Bayesian model selection and model averaging. Journal of Mathematical Psychology 2000, 44:92-107.
112. Whelan R. Effective analysis of reaction time data. Psychological Record 2008, 58:475-482.
113. Wilson T.D., Brekke N.C. Mental contamination and mental correction: Unwanted influences on judgments and evaluations. Psychological Bulletin 1994, 116:117-142.
114. Zhou W.-X., Sornette D., Hill R.A., Dunbar R.I.M. Discrete hierarchical organization of social group sizes. Proceedings of the Royal Society B 2005, 272:439-444.