Statistical reporting errors and collaboration on statistical analyses in psychological science

PLoS ONE

Volumn 9, Issue 12, 2014, Pages

  Veldkamp, Coosje L S ^a   Nuijten, Michele B ^a   Dominguez Alvarez, Linda ^a   Van Assen, Marcel A L M ^a   Wicherts, Jelte M ^a  

^a TILBURG UNIVERSITY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYTICAL ERROR; ARTICLE; AUTHOR; AUTOANALYSIS; HUMAN; INFORMATION PROCESSING; MEDICAL INFORMATION; PREVALENCE; PROBABILITY; PSYCHOLOGIST; PSYCHOLOGY; PUBLISHING; SCIENTIFIC LITERATURE; STATISTICAL ANALYSIS; COOPERATION; INFORMATION DISSEMINATION; MEASUREMENT ACCURACY; METHODOLOGY; PROCEDURES; PUBLICATION; STANDARDS; STATISTICS; STATISTICS AND NUMERICAL DATA;

COOPERATIVE BEHAVIOR; DATA ACCURACY; DATA INTERPRETATION, STATISTICAL; HUMANS; INFORMATION DISSEMINATION; PERIODICALS AS TOPIC; PSYCHOLOGY; RESEARCH DESIGN; STATISTICS AS TOPIC;

EID: 84918578159     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0114876     Document Type: Article

References (40)

1. Cohen J (1994) The earth is round (P less-than.05). American Psychologist 49: 997-1003.
2. Hubbard R, Ryan PA (2000) The historical growth of statistical significance testing in psychology-and its future prospects. Educational and Psychological Measurement 60: 661-681.
3. Sterling TD, Rosenbaum WL, Weinkam JJ (1995) Publication decisions revisited-The effect of the outcome of statistical tests on the decision to publish and vice-versa. American Statistician 49: 108-112.
4. Krueger J (2001) Null hypothesis significance testing-On the survival of a flawed method. American Psychologist 56: 16-26.
5. Levine TR, Weber R, Hullet C, Park HS, Lindsey LLM (2008) A critical assessment of null hypothesis significance testing in quantitative communication research. Human Communication Research 34: 171-U175.
6. Nickerson RS (2000) Null hypothesis significance testing: A review of an old and continuing controversy. Psychological Methods 5: 241-301.
7. Cumming G (2013) The New Statistics: Why and How. Psychological Science.
8. Gigerenzer G, Edwards A (2003) Simple tools for understanding risks: From innumeracy to insight. BMJ: British Medical Journal 327: 741.
9. Wagenmakers EJ, Wetzels R, Borsboom D, Van Der Maas HLJ (2011) Why psychologists must change the way they analyze their data: The case of psi: Comment on Bem (2011). Journal of Personality and Social Psychology 100: 426-432.
10. Wetzels R, Matzke D, Lee MD, Rouder JN, Iverson GJ, et al. (2011) Statistical evidence in experimental psychology: An empirical comparison using 855 t tests. Perspectives on Psychological Science 6: 291-298.
11. Bakker M, Wicherts JM (2011) The (mis)reporting of statistical results in psychology journals. Behavior Research Methods 43: 666-678.
12. Berle D, Starcevic V (2007) Inconsistencies between reported test statistics and p-values in two psychiatry journals. International Journal of Methods in Psychiatric Research 16: 202-207.
13. Garcia-Berthou E, Alcaraz C (2004) Incongruence between test statistics and P values in medical papers. BMC Medical Research Methodology 4: 13.
14. Wicherts JM, Bakker M, Molenaar D (2011) Willingness to share research data is related to the strength of the evidence and the quality of reporting of statistical results. PLoS ONE 6: E26828.
15. Caperos JM, Pardo A (2013) Consistency errors in p-values reported in Spanish psychology journals. Psicothema 25: 408-414.
16. Bakker M, Wicherts JM (in press) Outlier Removal and the Relation with Reporting Errors and Quality of Psychological Research. PLoS ONE.
17. Leggett NC, Thomas NA, Loetscher T, Nicholls ME (2013) The life of p: ?Just significant' results are on the rise The Quarterly Journal of Experimental Psychology: 1-16.
18. Zuckerman M, Hodgins HS, Zuckerman A, Rosenthal R (1993) Contemporary-Issues in the Analysis of Data-A Survey of 551 Psychologists. Psychological Science 4: 49-53.
19. Reason J (1990) Human error. Cambridge, UK: Cambridge University Press.
20. Beaty D (2004) The naked pilot. The human factor in aircraft accidents. Ramsbury, England: The Crowood Press.
21. Wiegman DA, Shappell SA (2003) A human error approach to aviation accident analysis. The human factors analysis and classification system. Aldershot, England: Ashgate Publishing.
22. Lindvall M, Muthig D, Dagnino A, Wallin C, Stupperich M, et al. (2004) Agile software development in large organizations. Computer 37: 26-34.
23. Wicherts JM (2011) Psychology must learn a lesson from fraud case. Nature 480: 7.
24. Over R (1982) Collaborative research and publication in psychology. American Psychologist 37: 996.
25. Mendenhall M, Higbee KL (1982) Psychology of the scientist: XLVIII. Recent trends in multiple authorship in psychology. Psychological Reports 51: 1019-1022.
26. Cronin B, Shaw D, La Barre K (2003) A cast of thousands: Coauthorship and subauthorship collaboration in the 20th century as manifested in the scholarly journal literature of psychology and philosophy. Journal of the American Society for Information Science and Technology 54: 855-871.
27. American Psychological Association (2010) Publication Manual of the American Psychological Association. Sixth Edition. Washington, DC: American Psychological Association.
28. Epskamp S, Nuijten MB (2013) stacheck: Extract statistics from articles and recompute p-values. R package version 0.1.0.
29. R Core Team (2013) R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.
30. Qualtrics (2012). 500235 ed., Provo, Utah, USA.
31. American Psychological Association (2002) American Psychological Association ethical principles of psychologists and code of conduct.
32. Vines TH, Albert AY, Andrew RL, Débarre F, Bock DG, et al. (2013) The availability of research data declines rapidly with article age. Current Biology.
33. Wicherts JM, Bakker M (2012) Publish (your data) or (let the data) perish! Why not publish your data too? Intelligence.
34. Simonsohn U (2013) Just post it: The lesson from two cases of fabricated data detected by statistics alone. Psychological Science.
35. Wicherts JM, Borsboom D, Kats J, Molenaar D (2006) The poor availability of psychological research data for reanalysis. American Psychologist 61: 726-728.
36. Wicherts JM (2013) Science revolves around the data. Journal of Open Psychology Data 1: E1.
37. Ceci SJ (1988) Scientists Attitudes toward Data Sharing. Science Technology & Human Values 13: 45-52.
38. Ceci SJ, Walker E (1983) Private archives and public needs. American Psychologist 38: 414-423.
39. Vogeli C, Yucel R, Bendavid E, Jones LM, Anderson MS, et al. (2006) Data withholding and the next generation of scientists: Results of a national survey. Academic Medicine 81: 128-136.
40. Balon R (2005) By whom and how is the quality of research data collection assured and checked? Psychotherapy and psychosomatics 74: 331-335.