The consistency test does not-and cannot-deliver what is advertised: A comment on Francis (2013)

Journal of Mathematical Psychology

Volumn 57, Issue 5, 2013, Pages 180-183

  Morey, Richard D ^a  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84886716519     PISSN: 00222496     EISSN: 10960880     Source Type: Journal    
DOI: 10.1016/j.jmp.2013.03.004     Document Type: Note

References (23)

1. Berger J.O., Sellke T. Testing a point null hypothesis: the irreconcilability of p values and evidence. Journal of the American Statistical Association 1987, 82(397):112-122. Retrieved from http://www.jstor.org/stable/2289131.
2. Carpenter S. Psychology's bold initiative. Science 2012, 335:1558-1561.
3. Cohen J. A power primer. Psychological Bulletin 1992, 112:155-159.
4. Cohen J. The earth is round (p <.05). American Psychologist 1994, 49:997-1003.
5. Falk R., Konold C. Making sense of randomness: implicit encoding as a basis for judgment. Psychological Review 1997, 104:301-318.
6. Francis G. Evidence that publication bias contaminated studies relating social class and unethical behavior. Proceedings of the National Academy of Sciences 2012, 109:E1587.
7. Francis G. Replication initiative: beware misinterpretation. Science 2012, 336:802.
8. Francis G. The psychology of replication and replication in psychology. Perspectives on Psychological Science 2012, 7:585-594.
9. Francis G. The same old new look: publication bias in a study of wishful seeing. i-Perception 2012, 3:176-178.
10. Francis G. Too good to be true: publication bias in two prominent studies from experimental psychology. Psychonomic Bulletin & Review 2012, 19:151-156.
11. Francis G. Replication, statistical consistency, and publication bias. Journal of Mathematical Psychology 2013, 57:153-169.
12. Francis, G. Publication bias in "Red, rank, and romance in women viewing men" by Elliot et al. (2010). Journal of Experimental Psychology: General (in press).
13. Francis, G. Follow the argument where it leads: Simonsohn's criticisms on publication bias critiques are unfounded. Retrieved from (unpublished manuscript). http://www1.psych.purdue.edu/~gfrancis/Publications/FrancisRebuttal2012b.pdf.
14. Gelman A., Shalizi C.R. Philosophy and the practice of Bayesian statistics. British Journal of Mathematical and Statistical Psychology 2013, 66:57-64.
15. Ioannidis J.P.A., Trikalinos T.A. An exploratory test for an excess of significant findings. Clinical Trials 2007, 4:245-253.
16. Morey R.D., Romeijn J.-W., Rouder J.N. The humble Bayesian: model checking from a fully Bayesian perspective. British Journal of Mathematical and Statistical Psychology 2013, 66:68-75.
17. Neyman J. "Inductive behavior" as a basic concept of philosophy of science. Review of the International Statistical Institute 1957, 25:7-22.
18. Rouder J.N., Speckman P.L., Sun D., Morey R.D., Iverson G. Bayesian t-tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin and Review 2009, 16:225-237. Retrieved from http://dx.doi.org/10.3758/PBR.16.2.225.
19. Royall R. Statistical evidence: a likelihood paradigm 1997, CRC Press, New York.
20. Sellke T., Bayarri M.J., Berger J.O. Calibration of p values for testing precise null hypotheses. American Statistician 2001, 55:62-71.
21. Simonsohn U. It does not follow: evaluating the one-off publication bias critiques by Francis (2012a, 2012b, 2012c, 2012d, 2012e, in press). Perspectives on Psychological Science 2012, 7:597-599.
22. Wagenmakers E.-J. A practical solution to the pervasive problem of p values. Psychonomic Bulletin and Review 2007, 14:779-804.
23. Wetzels R., Matzke D., Lee M.D., Rouder J.N., Iverson G., Wagenmakers E.-J. Statistical evidence in experimental psychology: An empirical comparison using 855 t tests. Perspectives on Psychological Science 2011, 6:291-298. Retrieved from http://dx.doi.org/10.1177/1745691611406923.