When decision heuristics and science collide

Psychonomic Bulletin and Review

Volumn 21, Issue 2, 2014, Pages 268-282

  Yu, Erica C ^a   Sprenger, Amber M ^a,c   Thomas, Rick P ^b   Dougherty, Michael R ^a  

^a UNIVERSITY OF MARYLAND   (United States)

^b UNIVERSITY OF OKLAHOMA   (United States)

^c MITRE CORPORATION   (United States)

Author keywords

Bayes factor; Decision making; Heuristics; Law of small numbers; Sampling policies

Indexed keywords

ADULT; BAYES THEOREM; DECISION MAKING; HUMAN; INFORMATION PROCESSING; METHODOLOGY; PROCEDURES; SCIENCE; STANDARDS; STATISTICS;

ADULT; BAYES THEOREM; DATA COLLECTION; DECISION MAKING; HUMANS; RESEARCH DESIGN; SCIENCE; STATISTICS AS TOPIC;

EID: 84897374692     PISSN: 10699384     EISSN: 15315320     Source Type: Journal    
DOI: 10.3758/s13423-013-0495-z     Document Type: Article

References (35)

1. Bem, D. J. (2011). Feeling the future: Anomalous retroactive influences on cognition and affect. Journal of Personality and Social Psychology, 100, 407-425.
2. Bernardo, J. M., & Smith, A. F. M. (1994). Bayesian theory. New York: Wiley.
3. Carey, B. (2011, November 2). Fraud case seen as a red flag for psychology research. The New York Times. Retrieved from http://www. nytimes. com.
4. Dijksterhuis, A., Bos, M. W., Nordgren, L. F., & van Baaren, R. B. (2006). On making the right choice: The deliberation without attention effect. Science, 311, 1005-1007.
5. Edwards, W., Lindman, H., & Savage, L. J. (1963). Bayesian statistical inference for psychological research. Psychological Review, 70, 193-241.
6. Fiedler, K. (2011). Voodoo correlations are everywhere-not only in neuroscience. Perspectives on Psychological Science, 6, 163-171.
7. Francis, G. (2012). Too good to be true: Publication bias in two prominent studies from experimental psychology. Psychonomic Bulletin & Review, 19, 151-156.
8. Frick, R. W. (1998). A better stopping rule for conventional statistical tests. Behavior Research Methods, Instruments, & Computers, 30, 690-697.
9. Ferguson, C., & Brannick, M. (2012). Publication bias in psychological science: Prevalence, methods for identifying and controlling, and implications for the use of meta-analyses. Psychological Methods, 17, 120-128.
10. Gallistel, C. R. (2009). The importance of proving the null. Psychological Review, 116, 439-453.
11. Ioannidis, J. P. A. (2008). Why most discovered true associations are inflated. Epidemiology, 19, 640-648.
12. Jeffreys, H. (1961). Theory of probability. Oxford: Oxford University Press.
13. Jennison, C., & Turnbull, B. W. (2000). Group sequential methods with applications to clinical trials. Boca Raton: CRC Press.
14. John, L. K., Loewenstein, G., & Prelec, D. (2012). Measuring the prevalence of questionable research practices with incentives for truth-telling. Psychological Science, 23, 524-532.
15. Kadane, J. B., Schervish, M. J., & Seidenfeld, T. (1996). Reasoning to a foregone conclusion. Journal of the American Statistical Association, 91, 1228-1235.
16. Kareev, Y., & Trope, Y. (2011). Correct acceptance weighs more than correct rejection: A decision bias induced by question framing. Psychonomic Bulletin Review, 18, 103-109.
17. Kass, R. E., & Raftery, A. E. (1995). Bayes factors. Journal of the American Statistical Association, 90, 377-395.
18. Kruschke, J. K. (2010). What to believe: Bayesian methods for data analysis. Trends in Cognitive Sciences, 14, 293-300.
19. Masson, M. E. J. (2011). A tutorial on a practical Bayesian alternative to null-hypothesis significance testing. Behavior Research Methods, 43, 679-690.
20. Newell, B. R., & Rakow, T. (2011). Revising beliefs about the merit of unconscious thought: Evidence in favor of the null hypothesis. Social Cognition, 29, 711-726.
21. Pfeiffer, T., Rand, D. G., & Dreber, A. (2009). Decision-making in research tasks with sequential testing. PLoS ONE, 4, e4607.
22. Raftery, A. E. (1995). Bayesian model selection in social research. Sociological Methodology, 25, 111-163.
23. Rosenbaum, P. R., & Rubin, D. B. (1984). Sensitivity of Bayes inference with data-dependent stopping rules. American Statistician, 38, 106-109.
24. Rouder, J. N., & Morey, R. D. (2011). A Bayes-factor meta analysis of Bem's ESP claim. Psychonomic Bulletin & Review, 18, 682-689.
25. Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009). Bayesian t tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin & Review, 16, 225-237.
26. Simmons, J., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359-1366.
27. Simonsohn, U. (in press). Just post it: The lesson from two cases of fabricated data detected by statistics alone. Psychological Science.
28. Soyer, E., & Hogarth, R. M. (2012). The illusion of predictability: How regression statistics mislead experts. International Journal of Forecasting, 28, 695-711.
29. Strube, M. J. (2006). A program for demonstrating the consequences of premature and repeated null hypothesis testing. Behavior Research Methods, 38, 24-27.
30. Tversky, A., & Kahneman, D. (1971). Belief in the law of small numbers. Psychological Bulletin, 76, 105-110.
31. Wagenmakers, E.-J. (2007). A practical solution to the pervasive problems of p values. Psychonomic Bulletin & Review, 14, 779-804.
32. Wagenmakers, E.-J., Wetzels, R., Borsboom, D., & van der Maas, H. L. J. (2011). Why psychologists must change the way they analyze their data: The case of psi: Comment on Bem (2011). Journal of Personality and Social Psychology, 100, 426-432.
33. Wald, A. (1947). Sequential analysis. New York: John Wiley and Sons.
34. Wallsten, T. S., Bender, R. H., & Li, Y. (1999). Dissociating judgement from response processes in statement verification: The effects of experience on each component. Journal of Experimental Psychology: Learning, Memory, Cognition, 25, 96-115.
35. Wetzels, R., Matzke, D., Lee, M. D., Rouder, J. N., Iverson, G. J., & Wagenmakers, E.-J. (2011). Statistical evidence in experimental psychology: An empirical comparison using 855 t tests. Perspectives on Psychological Science, 6, 291-298.