A Powerful Nudge? Presenting Calculable Consequences of Underpowered Research Shifts Incentives Toward Adequately Powered Designs

Social Psychological and Personality Science

Volumn 6, Issue 7, 2015, Pages 847-854

  Gervais, Will M ^a   Jewell, Jennifer A ^a   Najle, Maxine B ^a   Ng, Ben K L ^a  

^a UNIVERSITY OF KENTUCKY   (United States)

Author keywords

incentives; methods; power; replication; research practices

Indexed keywords

EID: 84938595133     PISSN: 19485506     EISSN: 19485514     Source Type: Journal    
DOI: 10.1177/1948550615584199     Document Type: Article

References (22)

1. J.B.AsendorpfM.ConnerF.De FruytJ.De HouwerJ.J.DenissenK.Fiedler…J.M.Wicherts (2013). Recommendations for increasing replicability in psychology. European Journal of Personality, 27, 108–119.
2. M.BakkerA.van DijkJ.M.Wicherts (2012). The rules of the game called psychological science. Perspectives on Psychological Science, 7, 543–554.
3. R.F.BaumeisterK.D.VohsD.C.Funder (2007). Psychology as the science of self-reports and finger movements: Whatever happened to actual behavior?Perspectives on Psychological Science, 2, 396–403.
4. M.BertaminiM.R.Munafò (2012). Bite-size science and its undesired side effects. Perspectives on Psychological Science, 7, 67–71.
5. K.S.ButtonJ.P.IoannidisC.MokryszB.A.NosekJ.FlintE.S.RobinsonM.R.Munafò (2013). Power failure: Why small sample size undermines the reliability of neuroscience. Nature Reviews Neuroscience, 14, 365–376.
6. J.Cohen (1962). The statistical power of abnormal-social psychological research: A review. Journal of Abnormal and Social Psychology, 65, 145–153.
7. J.Cohen (1992a). A power primer. Psychological Bulletin, 112, 155.
8. J.Cohen (1992b). Statistical power analysis. Current Directions in Psychological Science, 1, 98–101.
9. D.Colquhoun (2014). An investigation of the false discovery rate and the misinterpretation of p-values. Royal Society Open Science, 1, 140216.
10. R.C.FraleyS.Vazire (2014). The N-pact factor: Evaluating the quality of empirical journals with respect to sample size and statistical power. PloS One, 9, e109019.
11. Z.FrancisM.MilyavskayaM.Inzlicht (2015). Flipping the self-control switch: A novel within-subject paradigm to test the effects of ego depletion. Poster presented at the 2015 SPSP conference, Long Beach, California.
12. E.MiguelC.CamererK.CaseyJ.CohenK.M.EsterlingA.Gerber…M.Van der Laan (2014). Promoting transparency in social science research. Science, 343, 30–31.
13. B.A.NosekJ.R.SpiesM.Motyl (2012). Scientific utopia II. Restructuring incentives and practices to promote truth over publishability. Perspectives on Psychological Science, 7, 615–631.
14. J.E.Overall (1969). Classical statistical hypothesis testing within the context of Bayesian theory. Psychological Bulletin, 71, 285–292.
15. F.D.RichardC.F.BondJ.J.Stokes-Zoota (2003). One hundred years of social psychology quantitatively described. Review of General Psychology, 7, 331–363.
16. R Core Team. (2012). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0. Retrieved fromhttp://www.R-project.org/
17. U.Schimmack. (2012). The ironic effect of significant results on the credibility of multiple-study articles. Psychological Methods, 17(4), 551.
18. J.P.SimmonsL.D.NelsonU.Simonsohn (2011). False-positive psychology undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359–1366.
19. J.P.SimmonsL.D.NelsonU.Simonsohn (2013). Life after p-hacking. Meeting of the Society for Personality and Social Psychology, New Orleans, LA, 17-19 January 2013. Retrieved from SSRN: http://ssrn.com/abstract=2205186 or http://dx.doi.org/10.2139/ssrn.220518
20. P.SedlmeierG.Gigerenzer (1989). Do studies of statistical power have an effect on the power of studies?Psychological Bulletin, 105, 309.
21. A.TverskyD.Kahneman (1971). Belief in the law of small numbers. Psychological Bulletin, 76, 105–110.
22. I.VankovJ.BowersM.R.Munafò (2014). On the persistence of low power in psychological science. The Quarterly Journal of Experimental Psychology, 67, 1037–1040.