An Agenda for Purely Confirmatory Research

Perspectives on Psychological Science

Volumn 7, Issue 6, 2012, Pages 632-638

  Wagenmakers, Eric Jan ^a   Wetzels, Ruud ^a   Borsboom, Denny ^a   van der Maas, Han L J ^a   Kievit, Rogier A ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Bayesian hypothesis test; confirmatory experiments; ESP; wonky statistics

Indexed keywords

EID: 84869042391     PISSN: 17456916     EISSN: 17456924     Source Type: Journal    
DOI: 10.1177/1745691612463078     Document Type: Article

References (45)

1. Anderson D. R.,Burnham K. P.,Gould W. R.,Cherry S.Concerns about finding effects that are actually spurious.Wildlife Society Bulletin. 2001;29:311-316.
2. Bakker M.,van Dijk A.,Wicherts J. M.The rules of the game called psychological science.Perspectives on Psychological Science. 2012;7:543-554.
3. Begley C. G.,Ellis L. M.Raise standards for preclinical cancer research.Nature. 2012;483:531-533.
4. Bem D. J.Feeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect.Journal of Personality and Social Psychology. 2011;100:407-425.
5. Bem D. J.,Utts J.,Johnson W. O.Must psychologists change the way they analyze their data?.Journal of Personality and Social Psychology. 2011;101:716-719.
6. Carpenter S.Psychology's bold initiative.Science. 2012;335:1558-1560.
7. Dienes Z.Bayesian versus orthodox statistics: Which side are you on?.Perspectives on Psychological Science. 2011;6:274-290.
8. Edwards W.,Lindman H.,Savage L. J.Bayesian statistical inference for psychological research.Psychological Review. 1963;70:193-242.
9. Feynman R. P.Cargo cult science.Engineering & Science. 1974;37:10-13.
10. Frank M. C.,Saxe R.Teaching replication to promote a culture of reliable science.Perspectives on Psychological Science. 2012;7:600-604.
11. Galak J.,LeBoeuf R. A.,Nelson L. D.,Simmons J. P.Correcting the past: Failures to replicate psi.Journal of Personality and Social Psychology.
12. Gallistel C. R.The importance of proving the null.Psychological Review. 2009;116:439-453.
13. Goldacre B.Bad science. London, England: Fourth Estate; 2009:.
14. Grahe J.,Reifman A.,Herman A.,Walker M.,Oleson K.,Nario-Redmond M.,Wiebe R.Harnessing the undiscovered resource of student research projects.Perspectives on Psychological Science. 2012;:.
15. Hoijtink H.,Klugkist I.,Boelen P.Bayesian evaluation of informative hypotheses. New York, NY: Springer; 2008:.
16. Ioannidis J. P. A.Why most published research findings are false.PLoS Medicine. 2005;2:696-701.
17. Jasny B. R.,Chin G.,Chong L.,Vignieri S.Again, and again, and again.Science. 2011 1225;334:.
18. Jeffreys H.Theory of probability. 1961). Theory of probability (3rd ed.). Oxford, England: Oxford University Press.Oxford, England: Oxford University Press; 1961:.
19. John L. K.,Loewenstein G.,Prelec D.Measuring the prevalence of questionable research practices with incentives for truth-telling.Psychological Science. 2012;23:524-532.
20. Kass R. E.,Raftery A. E.Bayes factors.Journal of the American Statistical Association. 1995;90:773-795.
21. Kerr N. L.HARKing: Hypothesizing after the results are known.Personality and Social Psychology Review. 1998;2:196-217.
22. Kerridge D.Bounds for the frequency of misleading Bayes inferences.The Annals of Mathematical Statistics. 1963;34:1109-1110.
23. Kriegeskorte N.,Simmons W. K.,Bellgowan P. S. F.,Baker C. I.Circular analysis in systems neuroscience: The dangers of double dipping.Nature Neuroscience. 2009;12:535-540.
24. MacCallum R. C.,Roznowski M.,Necowitz L. B.Model modifications in covariance structure analysis: The problem of capitalization on chance.Psychological Bulletin. 1992;111:490-504.
25. Mackay C.Extraordinary popular delusions and the madness of crowds. 1932). Extraordinary popular delusions and the madness of crowds (2nd ed.). Boston, MA: Page. (Original work published 1852)Boston, MA: Page; 1932:.
26. The nine circles of scientific hell.Perspectives on Psychological Science. 2012;7:643-644.
27. Nickerson R. S.Confirmation bias: A ubiquitous phenomenon in many guises.Review of General Psychology. 1998;2:175-220.
28. Nosek B. A.,Spies J. R.,Motyl M.Scientific utopia: II. Restructuring incentives and practices to promote truth over publishability.Perspectives on Psychological Science. 2012;7:615-631.
29. Osherovich L.Hedging against academic risk.Science-Business eXchange. 2011;4:.
30. Prinz F.,Schlange T.,Asadullah K.Believe it or not: How much can we rely on published data on potential drug targets?.Nature Reviews Drug Discovery. 2011;10:712-713.
31. Ritchie S. J.,Wiseman R.,French C. C.Failing the future: Three unsuccessful attempts to replicate Bem's "retroactive facilitation of recall" effect.PLoS ONE. 2012;7:e33423.
32. Roediger H. L.Psychology's woes and a partial cure: The value of replication.APS Observer. 2012;25 (2): 9 27-29.
33. Roese N.,Vohs K.Hindsight bias.Perspectives on Psychological Science. 2012;7:411-426.
34. Rouder J. N.,Speckman P. L.,Sun D.,Morey R. D.,Iverson G.Bayesian t tests for accepting and rejecting the null hypothesis.Psychonomic Bulletin & Review. 2009;16:225-237.
35. Sarewitz D.Beware the creeping cracks of bias.Nature. 2012;485:149.
36. Sellke T.,Bayarri M. J.,Berger J. O.Calibration of p values for testing precise null hypotheses.The American Statistician. 2001;55:62-71.
37. Simmons J. P.,Nelson L. D.,Simonsohn U.False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant.Psychological Science. 2011;22:1359-1366.
38. Sterling T. D.Publication decisions and their possible effects on inferences drawn from tests of significance-Or vice versa.Journal of the American Statistical Association. 1959;54:30-34.
39. Sterling T. D.,Rosenbaum W. L.,Weinkam J. J.Publication decisions revisited: The effect of the outcome of statistical tests on the decision to publish and vice versa.The American Statistician. 1995;49:108-112.
40. Vul E.,Harris C.,Winkielman P.,Pashler H.Puzzlingly high correlations in fMRI studies of emotion, personality, and social cognition.Perspectives on Psychological Science. 2009;4:274-290.
41. Wagenmakers E.-J.A practical solution to the pervasive problems of p values.Psychonomic Bulletin & Review. 2007;14:779-804.
42. Wagenmakers E.-J.,Wetzels R.,Borsboom D.,van der Maas H. L. J.Why psychologists must change the way they analyze their data: The case of psi.Journal of Personality and Social Psychology. 2011;100:426-432.
43. Wetzels R.,Matzke D.,Lee M. D.,Rouder J. N.,Iverson G. J.,Wagenmakers E.-J.Statistical evidence in experimental psychology: An empirical comparison using 855 t tests.Perspectives on Psychological Science. 2011;6:291-298.
44. Wetzels R.,Raaijmakers J. G. W.,Jakab E.,Wagenmakers E.-J.How to quantify support for and against the null hypothesis: A flexible WinBUGS implementation of a default Bayesian t test.Psychonomic Bulletin & Review. 2009;16:752-760.
45. Yong E.Bad copy.Nature. 2012;485:298-300.