Analytic Review as a Solution to the Misreporting of Statistical Results in Psychological Science

Perspectives on Psychological Science

Volumn 9, Issue 6, 2014, Pages 652-660

  Sakaluk, John ^a   Williams, Alexander ^a   Biernat, Monica ^a  

^a UNIVERSITY OF KANSAS   (United States)

Author keywords

data analysis; misreporting; peer review; scientific accuracy

Indexed keywords

HUMAN; PEER REVIEW; PROCEDURES; PSYCHOLOGY; PUBLISHING; SCIENTIFIC MISCONDUCT; STATISTICS;

EDITORIAL POLICIES; HUMANS; PEER REVIEW, RESEARCH; PSYCHOLOGY; SCIENTIFIC MISCONDUCT; STATISTICS AS TOPIC;

EID: 84911156875     PISSN: 17456916     EISSN: 17456924     Source Type: Journal    
DOI: 10.1177/1745691614549257     Document Type: Article

References (37)

1. Retraction notice.Journal of the American College of Cardiology. 2012 1919;59 (21):
2. Publication manual of the American Psychological Association. 2010. Publication manual of the American Psychological Association (6th ed.). Washington, DC: Author.Washington, DC: Author; 2010:
3. Bakker M.,Wicherts J. M.The (mis)reporting of statistical results in psychology journals.Behavior Research Methods. 2011;43:666-678
4. Bem D. J.Feeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect.Journal of Personality and Social Psychology. 2011;100:407-425
5. Burke B. L.,Martens A.,Faucher E. H.Two decades of terror management theory: A meta-analysis of mortality salience research.Personality and Social Psychology Review. 2010;14:155-195
6. CareyB. (2011, November). Fraud case seen as a red flag for psychology research. Available from http://www.nytimes.com
7. Crocker J.,Cooper M. L.Addressing scientific fraud.Science. 2011;334:1182
8. Cumming G.The new statistics: Why and how.Psychological Science. 2014;25:7-29
9. Cumming G.,Fidler F.,Leonard M.,Kalinowski P.,Christiansen A.,Kleing A.,.. Wilson S.Statistical reform in psychology: Is anything changing?.Psychological Science. 2007;18:230-232
10. Fanelli D.How many scientists fabricate and falsify research? A systematic review and meta-analysis of survey data.PLoS ONE. 2009;4:e5738
11. Fidler F.,Cumming G.,Thomason N.,Pannuzzo D.,Smith J.,Fyffe P.,.. Schmitt R.Toward improving statistical reporting in the journal of consulting and clinical psychology.Journal of Consulting and Clinical Psychology. 2005;73:136-143
12. Fuchs H. M.,Jenny M.,Fiedler S.Psychologists are open to change, yet wary of rules.Perspectives on Psychological Science. 2012;7:639-642
13. Funder D. C.,Levine J. M.,Mackie D. M.,Morf C. C.,Sansone C.,Vazire S.,West S. G.Improving the dependability of research in personality and social psychology: Recommendations for research and educational practice.Personality and Social Psychology Review. 2014;18:3-12
14. Herndon T.,Ash M.,Pollin R.Does high public debt consistently stifle economic growth? A critique of Reinhart and Rogoff.Cambridge Journal of Economics. 2013;38:1-23
15. Hofmann S. G.,Smits J. A. J.Cognitive-behavioral therapy for adult anxiety disorders: Meta-analysis of randomized placebo-controlled trials.Journal of Clinical Psychiatry. 2008;69:621-632
16. John L. K.,Loewenstein G.,Prelec D.Measuring the prevalence of questionable research practices with incentives for truth telling.Psychological Science. 2012;23:524-532
17. Le R. J.,Fenstad E. R.,Maradit-Kremers H.,McCully R. B.,Frantz R. P.,McGoon M. D.,Kane G. C.Syncope in adults with pulmonary arterial hypertension.Journal of American College of Cardiology. 2011;59:863-867
18. Levine T. R.,Hullet C. R.Eta squared, partial eta squared, and misreporting of effect size in communication research.Human Communication Research. 2002;28:612-625
19. McNutt M.Reproducibility.Science. 2014;343:229
20. Miguel E.,Camerer C.,Casey K.,Cohen J.,Esterling K. M.,Gerber A.,.. Van der Laan M.Promoting transparency in social science research.Science. 2014;343:30-31
21. Nelson L. D.,Simmons J. P.,Simonsohn U.Let’s publish fewer papers.Psychological Inquiry. 2012;23:291-293
22. NelsonL. D.SimonsohnU.SimmonsJ. P. (2014). P-curve fixes publication bias: Obtaining unbiased effect size estimates from published studies alone. Manuscript in preparation. Retrieved from http://ssrn.com/abstract=2377290
23. Nosek B. A.,Bar-Anan Y.Scientific utopia I: Opening scientific communication.Psychological Inquiry. 2012;23:217-243
24. Nosek B. A.,Spies J. R.,Motyl M.Scientific utopia II: Restructuring incentives and practices to promote truth over publishability.Perspectives on Psychological Science. 2012;7:615-631
25. Office of Research Integrity. (2012). Case summary: Hauser, Marc. Available from http://ori.hhs.gov
26. Petersen J. L.,Hyde J. S.A meta-analytic review of research on gender differences in sexuality, 1993-2007.Psychological Bulletin. 2010;136:21-38
27. Petty R. E.,Fleming M. A.,Fabrigar L. R.The review process at PSPB: Correlates of interreviewier agreement and manuscript acceptance.Personality and Social Psychology Bulletin. 1999;25:188-203
28. Reinhart C. M.,Rogoff K. S.Growth in a time of debt.American Economic Review: Papers and Proceedings. 2010;100:573-578
29. Rosenthal R.The “file drawer problem” and tolerance for null results.Psychological Bulletin. 1979;86:638-641
30. Simmons J. P.,Nelson L. D.,Simonsohn U.False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant.Psychological Science. 2011;22:1359-1366
31. Simonsohn U.Just post it: The lesson learned from two cases of fabricated data detected by statistics alone.Psychological Science. 2013;24:1875-1888
32. Simonsohn U.,Nelson L. D.,Simmons J. P.P-curve: A key to the file drawer.Journal of Experimental Psychology: General. in press;:
33. Stroebe W.Scientific fraud: Lessons to be learnt.European Bulletin of Social Psychology. 2013;25:5-12
34. Tilburg University. (2011). Interim report regarding the breach of scientific integrity committed by Prof. D.A. Stapel. Available from http://www.tilburguniversity.edu
35. Voyer D.,Voyer S. D.Gender differences in scholastic achievement: A meta-analysis.Psychological Bulletin. 2014;140:1174-1204
36. Wicherts J. M.,Bakker M.,Molenaar D.Willingness to share research data is related to the strength of evidence and the quality of reporting of statistical results.PLoS ONE. 2011;6:e26828
37. Wicherts J. M.,Borsboom D.,Kats J.,Molenaar D.The poor availability of psychological research data for reanalysis.American Psychologist. 2006;61:726-728