The life of p: "Just significant" results are on the rise

Quarterly Journal of Experimental Psychology

Volumn 66, Issue 12, 2013, Pages 2303-2309

  Leggett, Nathan C ^a   Thomas, Nicole A ^a   Loetscher, Tobias ^a   Nicholls, Michael E R ^a  

^a FLINDERS UNIVERSITY   (Australia)

Author keywords

Hypothesis testing; p value; Publication; Statistical inference; Statistics

Indexed keywords

BIBLIOGRAPHIC DATABASE; HUMAN; PSYCHOLOGY; PUBLICATION; PUBLISHING; STATISTICS; STATISTICS AND NUMERICAL DATA;

DATABASES, BIBLIOGRAPHIC; HUMANS; PERIODICALS AS TOPIC; PSYCHOLOGY; PUBLICATION BIAS; STATISTICS AS TOPIC;

EID: 84890792616     PISSN: 17470218     EISSN: 17470226     Source Type: Journal    
DOI: 10.1080/17470218.2013.863371     Document Type: Article

References (20)

1. American Psychological Association. (2010). Publication manual of the American psychological association (6th Ed.). Washington, DC: Author.
2. Bakker, M., & Wicherts, J. M. (2011). The (mis)reporting of statistical results in psychology journals. Behavior Research Methods, 43(3), 666-678. doi:10.3758/s13428-011-0089-5 doi: 10.3758/s13428-011-0089-5
3. Chambers, C. D. (2013). Registered reports: A new publishing initiative at Cortex. Cortex, 49(3), 609-610. doi: 10.1016/j.cortex.2012.12.016
4. Cox, M. K., & Key, C. H. (1993). Post hoc pair-wise comparisons for the chi-square test of homogeneity of proportions. Educational and Psychological Measurement, 53(4), 951-962. doi:10.1177/0013164493053004008 doi: 10.1177/0013164493053004008
5. Cumming, G. (2008). Replication and p intervals: p values predict the future only vaguely, but confidence intervals do much better. Perspectives on Psychological Science, 3(4), 286-300. doi:10.1111/j.1745-6924.2008.00079.x doi: 10.1111/j.1745-6924.2008.00079.x
6. Fanelli, D. (2010). Do pressures to publish increase scoemtosts' bias? An empirical support for US stats data. PLoS ONE, 5(4). doi:10.1371/journal.pone.0010271.g001
7. John, L. K., Loewenstein, G., & Prelec, D. (2012). Measuring the prevalence of questionable research practices with incentives for truth telling. Psychological Science, 23(5), 524-532. doi:10.1177/0956797611430953 doi: 10.1177/0956797611430953
8. Kline, R. B. (2004). Beyond significance testing: Reforming data analysis methods in the behavioral sciences. Washington, DC: American Psychological Association.
9. Kyvik, S. (2003). Changing trends in publishing behaviour among university faculty, 1980-2000. Scientometrics, 58(1), 35-48. doi: 10.1023/A:1025475423482
10. LeBel, E. P., Borsboom, D., Giner-Sorolla, R., Hasselman, F., Peters, K. R., Ratliff, K. A., & Smith, C. T. (2013). PsychDisclosure.org: Grassroots Support for Reforming Reporting Standards in Psychology. Perspectives on Psychological Science, 8(4), 424-432. doi:10.1177/1745691613491437 doi: 10.1177/1745691613491437
11. Masicampo, E. J., & Lalande, D. R. (2012). A peculiar prevalence of p values just below.05. The Quarterly Journal of Experimental Psychology, 65(11), 2271-2279. doi: 10.1080/17470218.2012.711335
12. National Institute of Health. (2008). Actual of NIH R01 equivalent success rate FY 1970-2008 and estimates of NIH R01 success rates, FY 1962-1969 from CGAF.
13. Nickerson, R. S. (2000). Null hypothesis significance testing: A review of an old and continuing controversy. Psychological Methods, 5(2), 241-301. doi: 10.1037/1082-989X.5.2.241
14. Rosenthal, R. (1979). The "filedrawer problem" and tolerance for null results. Psychological Bulletin, 86(3), 638-641. doi: 10.1037/0033-2909.86.3.638
15. Sacket, D. L. (1979). Bias in analytic research. Journal of Chronic Diseases, 32, 51-63. doi: 10.1016/0021-9681(79)90012-2
16. Sellke, T., Bayarri, M. J., & Berger, J. O. (2001). Calibration of p values for testing precise null hypotheses. The American Statistician, 55, 62-71. doi: 10.1198/000313001300339950
17. Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22(11), 1359-1366. doi:10.1177/0956797611417632 doi: 10.1177/0956797611417632
18. Song, F., Eastwood, A. J., Gilbody, S., Duley, L., & Sutton, A. J. (2000). Publication and related biases. Health Technology Assessment, 4(10). doi:10.3310/hta4100
19. Wagenmakers, E.-J. (2007). A practical solution to the pervasive problems of p values. Psychonomic Bulletin & Review, 14(5), 779-804. doi: 10.3758/BF03194105
20. Wicherts, J. M., Kievit, R. A., Bakker, M., & Borsboom, D. (2012). Letting the daylight in: Reviewing the reviewers and other ways to maximize transparency in science. Frontiers in Computational Neuroscience, 6. doi:10.3389/fncom.2012.00020 doi: 10.3389/fncom.2012.00020