Missing the dog that failed to bark in the nighttime: On the overestimation of occurrences over non-occurrences in hypothesis testing

Psychological Research

Volumn 77, Issue 3, 2013, Pages 348-370

  Cherubini, Paolo ^a   Rusconi, Patrice ^a   Russo, Selena ^b   Crippa, Franca ^a  

^a UNIVERSITY OF MILANO BICOCCA   (Italy)

^b UNIVERSITY OF TRENTO   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84876190529     PISSN: 03400727     EISSN: 14302772     Source Type: Journal    
DOI: 10.1007/s00426-012-0430-3     Document Type: Article

References (58)

1. Baron, J., Beattie, J., & Hershey, J. C. (1988). Heuristics and biases in diagnostic reasoning: II. Congruence, information, and certainty. Organizational Behavior and Human Decision Processes, 42, 88-110. doi: 10. 1016/0749-5978(88)90021-0.
2. Beyth-Marom, R. (1982). Perception of correlation reexamined. Memory & Cognition, 10, 511-519. doi: 10. 3758/BF03202433.
3. Beyth-Marom, R., & Fischhoff, B. (1983). Diagnosticity and pseudodiagnosticity. Journal of Personality and Social Psychology, 45, 1185-1195. doi: 10. 1037//0022-3514. 45. 6. 1185.
4. Blom, E., & Baayen, H. R. (2012). The impact of verb form, sentence position, home language and proficiency on subject-verb agreement in child L2 Dutch. Applied Psycholinguistics (in press).
5. Bourne, L. E, Jr, & Guy, D. E. (1968). Learning conceptual rules. II: The role of positive and negative instances. Journal of Experimental Psychology, 77, 488-494. doi: 10. 1037/h0025952.
6. Cherubini, P., Rusconi, P., Russo, S., Di Bari, S., & Sacchi, S. (2010). Preferences for different questions when testing hypotheses in an abstract task: Positivity does play a role, asymmetry does not. Acta Psychologica, 134, 162-174. doi: 10. 1016/j. actpsy. 2010. 01. 007.
7. Cherubini, P., Russo, S., Rusconi, P., D'Addario, M., & Boccuti, I. (2009). Il ragionamento probabilistico nella diagnosi medica: sensibilità e insensibilità alle informazioni. In P. Giaretta, A. Moretto, G. F. Gensini, & M. Trabucchi (Eds.), Filosofia della medicina: Metodo, modelli, cura ed errori (pp. 541-564). Bologna: Il Mulino.
8. Christensen-Szalanski, J. J. J., & Bushyhead, J. B. (1981). Physicians' use of probabilistic information in a real clinical setting. Journal of Experimental Psychology: Human Perception and Performance, 7, 928-935. doi: 10. 1037//0096-1523. 7. 4. 928.
9. Cohen, L. J. (1977). The probable and the provable. Oxford: Clarendon Press.
10. Crupi, V., Tentori, K., & Gonzalez, M. (2007). On Bayesian measures of evidential support: Theoretical and empirical issues. Philosophy of Science, 74, 229-252. doi: 10. 1086/520779.
11. Doyle, A. C. (1974). The memories of sherlock holmes. London: Murray & Cape.
12. Estes, W. K. (1976). The cognitive side of probability learning. Psychological Review, 83, 37-64. doi: 10. 1037//0033-295X. 83. 1. 37.
13. Fazio, R. H., Sherman, S. J., & Herr, P. M. (1982). The feature-positive effect in the self-perception process: Does not doing matter as much as doing? Journal of Personality and Social Psychology, 42, 404-411. doi: 10. 1037/0022-3514. 42. 3. 404.
14. Feeney, A., Evans, J. St. B. T., & Clibbens, J. (2000). Background beliefs and evidence interpretation. Thinking and Reasoning, 6, 97-124. doi: 10. 1080/135467800402811.
15. Feeney, A., Evans, J., & Venn, S. (2008). Rarity, pseudodiagnosticity and Bayesian reasoning. Thinking & Reasoning, 14, 209-230. doi: 10. 1080/13546780801934549.
16. Fiedler, K., Eckert, C., & Poysiak, C. (1989). Asymmetry in human discrimination learning: Feature positive effect or focus of hypothesis effect? Acta Psychologica, 70, 109-127. doi: 10. 1016/0001-6918(89)90015-2.
17. Fiedler, K., & Walther, E. (2004). Stereotyping as inductive hypothesis testing. Hove, U. K.: Psychology Press.
18. Fischhoff, B., & Beyth-Marom, R. (1983). Hypothesis evaluation from a Bayesian perspective. Psychological Review, 90, 239-260. doi: 10. 1037//0033-295X. 90. 3. 239.
19. Green, D. W., & Over, D. E. (2000). Decision theoretic effects in testing a causal conditional. Current Psychology of Cognition, 19, 51-68.
20. Griffiths, T. L., & Tenenbaum, J. B. (2006). Optimal predictions in everyday cognition. Psychological Science, 17, 767-773. doi: 10. 1111/j. 1467-9280. 2006. 01780. x.
21. Hearst, E., & Wolff, W. T. (1989). Addition versus deletion as a signal. Animal Learning & Behavior, 17, 120-133. doi: 10. 3758/BF03207627.
22. Hovland, C. I., & Weiss, W. (1953). Transmission of information concerning concepts through positive and negative instances. Journal of Experimental Psychology, 45, 175-182. doi: 10. 1037/h0062351.
23. Jaeger, T. F. (2008). Categorical data analysis: Away from ANOVAs (transformation or not) and towards logit mixed models. Journal of Memory and Language, 59, 434-446. doi: 10. 1016/j. jml. 2007. 11. 007.
24. Jenkins, H. M., & Sainsbury, R. S. (1969). The development of stimulus control through differential reinforcement. In N. J. Mackintosh & W. K. Honig (Eds.), Fundamental issues in associative learning (pp. 123-161). Halifax: Dalhousie University Press.
25. Jenkins, H. M., & Sainsbury, R. S. (1970). Discrimination learning with the distinctive feature on positive or negative trials. In D. Mostofsky (Ed.), Attention: Contemporary theory and analysis. New York: Appleton-Century-Crofts.
26. Jenkins, H. M., & Ward, W. C. (1965). Judgment of contingency between responses and outcomes. Psychological Monographs: General and Applied, 79, 1-17. doi: 10. 1037/h0093874.
27. Kao, S.-F., & Wasserman, E. A. (1993). Assessment of an information integration account of contingency judgment with examination of subjective cell importance and method of information presentation. Journal of Experimental Psychology. Learning, Memory, and Cognition, 19, 1363-1386. doi: 10. 1037//0278-7393. 19. 6. 1363.
28. Klayman, J. (1995). Varieties of confirmation bias. The Psychology of Learning and Motivation, 32, 385-418. doi: 10. 1016/S0079-7421(08)60315-1.
29. Klayman, J., & Ha, Y. W. (1987). Confirmation, disconfirmation, and information in hypothesis testing. Psychological Review, 94, 211-228. doi: 10. 1037/0033-295X. 94. 2. 211.
30. Loftus, E. F. (1976). Unconscious transference in eyewitness identification. Law and Psychology Review, 2, 93-98.
31. Mandel, D. R., & Lehman, D. R. (1998). Integration of contingency information in judgments of cause, covariation, and probability. Journal of Experimental Psychology: General, 127, 269-285. doi: 10. 1037//0096-3445. 127. 3. 269.
32. McKenzie, C. R. M. (2004). Hypothesis testing and evaluation. In D. J. Koehler & N. Harvey (Eds.), Blackwell handbook of judgment and decision making (pp. 200-219). Malden, MA, USA: Blackwell Publishing.
33. McKenzie, C. R. M. (2006). Increased sensitivity to differentially diagnostic answers using familiar materials: Implications for confirmation bias. Memory & Cognition, 34, 577-588. doi: 10. 3758/BF03193581.
34. McKenzie, C. R. M., & Mikkelsen, L. A. (2000). The psychological side of Hempel's paradox of confirmation. Psychonomic Bulletin & Review, 7, 360-366. doi: 10. 3758/BF03212994.
35. McKenzie, C. R. M., & Mikkelsen, L. A. (2007). A Bayesian view of covariation assessment. Cognitive Psychology, 54, 33-61. doi: 10. 1016/j. cogpsych. 2006. 04. 004.
36. Nahinsky, I. D., & Slaymaker, F. L. (1970). Use of negative instances in conjunctive concept identification. Journal of Experimental Psychology, 84, 64-68. doi: 10. 1037/h0028951.
37. Neisser, U. (1963). Decision-time without reaction-time: Experiments in visual scanning. The American Journal of Psychology, 76, 376-385. doi: 10. 2307/1419778.
38. Nelson, J. D. (2005). Finding useful questions: On Bayesian diagnosticity, probability, impact, and information gain. Psychological Review, 112, 979-999. doi: 10. 1037/0033-295X. 112. 4. 979.
39. Nelson, J. D. (2008). Towards a rational theory of human information acquisition. In N. Chater & M. Oaksford (Eds.), The probabilistic mind: Prospects for Bayesian cognitive science (pp. 143-163). Oxford, UK: Oxford University Press.
40. Nelson, J. D., McKenzie, C. R. M., Cottrell, G. W., & Sejnowski, T. J. (2010). Experience matters: Information acquisition optimizes probability gain. Psychological Science, 21, 960-969. doi: 10. 1177/0956797610372637.
41. Newman, J., Wolff, W. T., & Hearst, E. (1980). The feature-positive effect in adult human subjects. Journal of Experimental Psychology: Human Learning and Memory, 6, 630-650. doi: 10. 1037//0278-7393. 6. 5. 630.
42. Nickerson, R. S. (1998). Confirmation bias: A ubiquitous phenomenon in many guises. Review of General Psychology, 2, 175-220. doi: 10. 1037/1089-2680. 2. 2. 175.
43. Oaksford, M., & Chater, N. (1994). A rational analysis of the selection task as optimal data selection. Psychological Review, 101, 608-631. doi: 10. 1037//0033-295X. 101. 4. 608.
44. Oaksford, M., & Chater, N. (2003). Optimal data selection: Revision, review, and reevaluation. Psychonomic Bulletin & Review, 10, 289-318. doi: 10. 3758/BF03196492.
45. Rassin, E., Muris, P., Franken, I., & van Straten, M. (2008). The feature-positive effect and hypochondriacal concerns. Behaviour Research and Therapy, 46, 263-269. doi: 10. 1016/j. brat. 2007. 11. 003.
46. Ross, L. (1978). The intuitive psychologist and his shortcomings: distortions in the attribution process. In L. Berkowitz (Ed.), Cognitive theories in social psychology: papers from advances in experimental social psychology. New York: Academic Press.
47. Scandellari, C. (2005). La diagnosi clinica: Principi metodologici del procedimento decisionale. Milan: Masson.
48. Shannon, C. E. (1948). A mathematical theory of communication. The Bell System Technical Journal, 27, 379-423, 623-656.
49. Skov, R. B., & Sherman, S. J. (1986). Information-gathering processes: Diagnosticity, hypothesis-confirmatory strategies, and perceived hypothesis confirmation. Journal of Experimental Social Psychology, 22, 93-121. doi: 10. 1016/0022-1031(86)90031-4.
50. Slovic, P., & Lichtenstein, S. (1971). Comparison of Bayesian and regression approaches to the study of information processing in judgment. Organizational Behavior and Human Performance, 6, 649-744. doi: 10. 1016/0030-5073(71)90033-X.
51. Slowiaczek, L. M., Klayman, J., Sherman, S. J., & Skov, R. B. (1992). Information selection and use in hypothesis testing: What is a good question, and what is a good answer? Memory & Cognition, 20, 392-405. doi: 10. 3758/BF03210923.
52. Smedslund, J. (1963). The concept of correlation in adults. Scandinavian Journal of Psychology, 4, 165-173. doi: 10. 1111/j. 1467-9450. 1963. tb01324. x.
53. Snyder, M., & Swann, W. B. (1978). Hypothesis-testing processes in social interaction. Journal of Personality and Social Psychology, 36, 1202-1212. doi: 10. 1037/0022-3514. 36. 11. 1202.
54. Téglás, E., Vul, E., Girotto, V., Gonzalez, M., Tenenbaum, J. B., & Bonatti, L. L. (2011). Pure reasoning in 12-month-old infants as probabilistic inference. Science, 332, 1054-1059. doi: 10. 1126/science. 1196404.
55. Tenenbaum, J. B., Griffiths, T. L., & Kemp, C. (2006). Theory-based Bayesian models of inductive learning and reasoning. Trends in Cognitive Sciences, 10, 309-318. doi: 10. 1016/j. tics. 2006. 05. 009.
56. Treisman, A., & Souther, J. (1985). Search asymmetry: A diagnostic for preattentive processing of separable features. Journal of Experimental Psychology: General, 114, 285-310. doi: 10. 1037//0096-3445. 114. 3. 285.
57. Wason, P. C. (1960). On the failure to eliminate hypotheses in a conceptual task. The Quarterly Journal of Experimental Psychology, 12, 129-140. doi: 10. 1080/17470216008416717.
58. Wells, G. L., & Lindsay, R. C. L. (1980). On estimating the diagnosticity of eyewitness nonidentifications. Psychological Bulletin, 88, 776-784. doi: 10. 1037//0033-2909. 88. 3. 776.