Publication bias in psychological science: Prevalence, methods for identifying and controlling, and implications for the use of meta-analyses

Psychological Methods

Volumn 17, Issue 1, 2012, Pages 120-128

  Ferguson, Christopher J ^a   Brannick, Michael T ^b  

^a TEXAS A AND M INTERNATIONAL UNIVERSITY   (United States)

^b UNIVERSITY OF SOUTH FLORIDA   (United States)

Author keywords

Meta analysis; Publication bias; Statistics

Indexed keywords

ARTICLE; EPIDEMIOLOGY; HUMAN; META ANALYSIS (TOPIC); PREVALENCE; PSYCHOLOGY; PUBLISHING; QUALITY CONTROL; STATISTICAL ANALYSIS; STATISTICS;

DATA INTERPRETATION, STATISTICAL; HUMANS; META-ANALYSIS AS TOPIC; PREVALENCE; PSYCHOLOGY; PUBLICATION BIAS; QUALITY CONTROL; SELECTION BIAS;

EID: 84861217389     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0024445     Document Type: Article

References (26)

1. Baumeister, R., DeWall, C., & Vohs, K. (2009). Social rejection, control, numbness, and emotion: How not to be fooled by Gerber and Wheeler (2009). Perspectives on Psychological Science, 4, 489-493. doi: 10.1111/j.1745-6924.2009.01159.x
2. Bonett, D. G. (2008). Meta-analytic interval estimation for bivariate cor- relations. Psychological Methods, 13, 173-181. doi:10.1037/a0012868
3. Campbell Collaboration. (2010). What is a systematic review? Retrieved from http://www.campbellcollaboration.org/what_is_a_systematic_review/index.phpComprehensiveMeta-Analysis (Version 2) [Computer software]. Engle- wood, NJ: Biostat
4. Cook, D. J., Guyatt, G. H., Ryan, G., Clifton, J., Buckingham, L., Willan, A.,... Oxman, A. D. (1993). Should unpublished data be included in meta-analyses? Current convictions and controversies. Journal of the American Medical Association, 269, 2749-2753.
5. Davis, H., & Crombie, I. (2001). What are meta-analyses? What Is ..., 1, 1-8. Retrieved from http://meds.queensu.ca/medicine/obgyn/pdf/what_is/WhatisMetaAn.pdf.
6. Egger, M., & Davey-Smith, G. (1998). Meta-analysis: Bias in location and selection of studies. British Medical Journal, 316, 61. Retrieved from http://www.bmj.com/content/316/7124/61.full
7. Frattaroli, J. (2006). Experimental disclosure and its moderators: A meta- analysis. Psychological Bulletin, 132(6), 823-865. doi:10.1037/0033- 2909.132.6.823
8. Hanson, R. K., & Morton-Bourgon, K. (2005). The characteristics of persistent sexual offenders: A meta-analysis of recidivism studies. Journal of Consulting and Clinical Psychology, 73, 1154-1163. doi:10.1037/ 0022-006X.73.6.1154
9. Hawkins, A. J., Blanchard, V., Baldwin, S., & Fawcett, E. (2008). Does marriage and relationship education work? A meta-analytic study. Journal of Consulting and Clinical Psychology, 76, 723-734. doi:10.1037/ a0012584
10. Kromrey, J., & Rendina-Gobioff, G. (2006). On knowing what we do not know: An empirical comparison of methods to detect publication bias in meta-analysis. Educational and Psychological Measurement, 66, 357- 373. doi:10.1177/0013164405278585
11. Lexchin, J., Bero, L., Djulbejovic, B., & Clark, O. (2003). Pharmaceutical industry sponsorship and research outcome and quality: Systematic review. British Medical Journal. 326. 1167-1170. doi:10.1136/ bmj.326.7400.1167
12. Macaskill, P., Walter, S., & Irwig, L. (2001). A comparison of methods to detect publication bias in meta-analysis. Statistics in Medicine, 20, 641-654. doi:10.1002/sim.698
13. Mathieu, S., Boutron, I., Moher, D., Altman, D., & Ravaud, P. (2009). Comparison of registered and published primary outcomes in random- ized controlled trials. Journal of the American Medical Association, 302, 977-984. doi:10.1001/jama.2009.1242
14. McLeod, B. D., & Weisz, J. (2004). Using dissertations to examine potential bias in child and adolescent clinical trials. Journal of Consulting and Clinical Psychology, 72, 235-251. doi:10.1037/0022- 006X.72.2.235
15. Peters, J. L., Sutton, A., Jones, D., Abrams, K., & Rushton, L. (2007). Performance of the trim and fill method in the presence of publication bias and between study heterogeneity. Statistics in Medicine, 26, 4544- 4562. doi:10.1002/sim.2889
16. Pettigrew, T., & Tropp, L. (2006). A meta-analytic test of intergroup contact theory. Journal of Personality and Social Psychology, 90, 751- 783. doi:10.1037/0022-3514.90.5.751
17. Robinson, D. (2008). Evidence-based medicine and publication bias. Primary Psychiatry, 15, 30-33.
18. Rosenthal, R. (1979). The file drawer problem and tolerance for null results. Psychological Bulletin, 86, 638-641. doi:10.1037/0033- 2909.86.3.638
19. Rosenthal, R. (1991). Quality-weighting of studies in meta-analytic research. Psychotherapy Research, 1, 25-28. doi:10.1080/10503309112331334031
20. Rothstein, H. R., Sutton, A. J., & Borenstein, M. (Eds.) (2005). Publication bias in meta-analysis: Prevention, assessment, and adjustments. New York, NY: Wiley. doi:10.1002/0470870168
21. Shadish, W., & Baldwin, S. (2005). Effects of behavioral marital therapy: A meta-analysis of randomized controlled trials. Journal of Consulting and Clinical Psychology, 73, 6-14. doi:10.1037/0022-006X.73.1.6
22. Slavin, R. E. (1986). Best evidence synthesis: An alternative to meta- analytic and traditional reviews. Educational Researcher, 15, 5-11.
23. Turner, E. H., Matthews, A., Linardatos, E., Tell, R., & Rosenthal, R. (2008). Selective publication of antidepressant trials and its influence on apparent efficacy. The New England Journal of Medicine, 358, 252-260. doi:10.1056/NEJMsa065779
24. Vevea, J. L., & Woods, C. M. (2005). Publication bias in research synthesis: Sensitivity analysis using a priori weight functions. Psychological Methods, 10, 428-443. doi:10.1037/1082-989X.10.4.428
25. White, H. D. (1994). Scientific communication and literature retrieval. In H. Cooper & Hedges, L. V. (Eds). The handbook of research synthesis (pp. 41-56). New York, NY: Russell Sage Foundation.
26. Wilson, D. (2009). Missing a critical piece of the pie: Simple document search strategies inadequate for systematic reviews. Journal of Experimental Criminology, 5, 429-440. doi:10.1007/s11292-009-9085-5