The identification and prevention of publication bias in the social sciences and economics

Jahrbucher fur Nationalokonomie und Statistik

Volumn 231, Issue 5-6, 2011, Pages 661-684

  Weiß, Bernd ^a   Wagner, Michael ^a  

^a UNIVERSITY OF COLOGNE   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84855181825     PISSN: 00214027     EISSN: None     Source Type: Journal    
DOI: 10.1515/jbnst-2011-5-608     Document Type: Article

References (85)

1. Allen, M. (2009), Meta-Analysis. Communication Monographs 76(4): 398-407.
2. Amato, P.R., B. Keith (1991), Parental Divorce and Adult Well-being: A Meta-analysis. Journal of Marriage and the Family 53: 43-58.
3. Amato, P.R., J.G. Gilbreth (1999), Nonresident Fathers and Children's Well-Being: A Meta-Analysis. Journal of Marriage and the Family 61: 557-573.
4. Ashenfelter, O., C. Harmon, H. Oosterbeek (1999), A review of estimates of the schooling/earnings relationship, with tests for publication bias. Labour Economics 6: 453-470.
5. Auspurg, K., T. Hinz (2011), New Impulses for Publication Bias Research. Journal of Economics and Statistics 231(5+6): 636-660.
6. Becker, B.J. (2005), Fail-safe N or File-Drawer Number. Pp. 111-125 in: H.R. Rothstein, A.J. Sutton, M. Borenstein (eds.), Publication Bias in Meta-Analysis. Prevention, Assessment and Adjustments, The Atrium, Southern Gate, Chichester: Wiley.
7. Begg, C.B. (1994), Publication Bias. Pp. 399-422 in: H. Cooper, L.V. Hedges (eds.), The Handbook of Research Synthesis, New York: Russell Sage Foundation.
8. Begg, C.B., M. Mazumdar (1994), Operating characteristics of a rank correlation test for publication bias. Biometrics 50: 1088-1101.
9. Berlin, J.A., D. Ghersi (2005), Preventing Publication Bias: Registries and Prospective Meta-Analysis. Pp. 35-48 in: H.R. Rothstein, A.J. Sutton, M. Borenstein (eds.), Publication Bias in Meta-Analysis. Prevention, Assessment and Adjustments, The Atrium, Southern Gate, Chichester: Wiley.
10. Bleck, M., M. Wagner (2006), Stadt-Umland-Wanderungen in Nordrhein-Westfalen - eine Meta-Analyse. Raumforschung und Raumordnung 64(2): 104-115.
11. Borenstein, M. (2005), Software for Publication Bias. Pp. 193-220 in: H.R. Rothstein, A.J. Sutton, M. Borenstein (eds.), Publication Bias in Meta-Analysis. Prevention, Assessment and Adjustments, The Atrium, Southern Gate, Chichester: Wiley.
12. Card, D., A.B. Krueger (1995), Time-Series Minimum-Wage Studies: A Meta-analysis. American Economic Review 85(2): 238-243.
13. Carpenter, J., G. Schwarzer (2009), copas: Statistical methods to model and adjust for bias in meta-analysis. R package version 0.6-3. http://CRAN.R-project.org/package=copas
14. Cooper, H.M., L.V. Hedges (2009), Research Synthesis as a Scientific Process. Pp. 3-16 in: H. Cooper, L.V. Hedges, J.C. Valentine (eds.), The Handbook of Research Synthesis and Meta-Analysis, New York: Russel Sage Foundation.
15. Copas, J. (1999), What works?: selectivity models and meta-analysis. Journal of the Royal Statistical Society: Series A (Statistics in Society) 162(1): 95-109.
16. Copas, J.B., J.Q. Shi (2000), Reanalysis of epidemiological evidence on lung cancer and passive smoking. British Medical Journal 320: 417-418. (Pubitemid 30175771)
17. Copas, J.B., J.Q. Shi (2001), A sensitivity analysis for publication bias in systematic reviews. Statistical Methods in Medical Research 10: 251-265. (Pubitemid 32691155)
18. Crain, R.L., R.E. Mahard (1983), The Effect of Research Methodology on Desegregation-Achievement Studies: A Meta-Analysis. American Journal of Sociology 88(5): 839-854.
19. Dear, K.B.G., C.B. Begg (1992), An Approach for Assessing Publication Bias Prior to Performing a Meta-Analysis. Statistical Science 7(2): 237-245.
20. De Long, J.B., K. Lang (1992), Are All Economic Hypotheses False? Journal of Political Economy 100(6): 1257-1272.
21. Dickersin, K. (2005), Publication Bias: Recognizing the Problem, Understanding Its Origins and Scope, and Preventing Harm. Pp. 11-33 in: H.R. Rothstein, A.J. Sutton, M. Borenstein (eds.), Publication Bias in Meta-Analysis. Prevention, Assessment and Adjustments, The Atrium, Southern Gate, Chichester: Wiley.
22. Diekmann, A. (1997), Empirische Sozialforschung. Grundlagen, Methoden, Anwendungen, 3. Auflage. Hamburg: Rowohlt.
23. Doucouliagos, C. (2005), Publication Bias in the Economic Freedom and Economic Growth Literature. Journal of Economic Surveys 19(3): 367-387. (Pubitemid 40924039)
24. Drinkmann, A. (1990), Methodenkritische Untersuchungen zur Metaanalyse. Weinheim: Deutscher Studienverlag.
25. Dubben, H.H., H.P. Beck-Bornholdt (2005), Systematic review of publication bias in studies on publication bias. BMJ 331: 433-434.
26. Duval, S., R. Tweedie (2000), Trim and Fill: A Simple Funnel-Plot-Based Method of Testing and Adjusting for Publication Bias in Meta-Analysis. Biometrics 56: 455-463. (Pubitemid 30422636)
27. Duval, S. (2005), The Trim and the Fill Method. Pp. 127-147 in: H.R. Rothstein, A.J. Sutton, M. Borenstein (eds.), Publication Bias in Meta-Analysis. Prevention, Assessment and Adjustments, The Atrium, Southern Gate, Chichester: Wiley.
28. Egger, M., G. Davey Smith, M. Schneider, C. Minder (1997), Bias in meta-analysis detected by a simple, graphical test British Medical Journal 315: 629-634. (Pubitemid 27387172)
29. Gerber, A.S., D.P. Green, D. Nickerson (2001), Testing for Publication Bias in Political Science. Political Analysis 9(4): 385-392.
30. Gerber, A.S., N. Malhorta (2006), Can Political Science Literatures Be Believed? A Study of Publication Bias in the APSR and the AJPS. Presented at the annual meeting of the Midwest Political Science Association, April 20-23, Chicago, IL.
31. Gerber, A.S., N. Malhotra (2008a), Publication Bias in Empirical Sociological Research. Do Arbitrary Significance Levels Distort Published Results. Sociological Methods & Research 37(1): 3-30.
32. Gerber, A.S., N. Malhotra (2008b), Do Statistical Reporting Standards Affect What Is Published? Publication Bias in Two Leading Political Science Journals. Quarterly Journal of Political Science 3: 313-326.
33. Görg, H., E. Strobl (2001), Multinational Companies and Productivity Spillovers: A Meta-Analysis. The Economic Journal 111: F723-F739. (Pubitemid 33109771)
34. Hedges, L.V. (1984), Estimation of Effect Sizes under Nonrandom Sampling: The Effects of Censoring Studies Yielding Statistically Insignificant Mean Differences. Journal of Educational Statistics 9(1): 61-85.
35. Hedges, L.V., I. Olkin (1985), Statistical Methods for Meta-Analysis. Orlando: Academic Press.
36. Hedges, L.V. (1987), How Hard Is Hard Science, How Soft Is Soft Science? The Empirical Cumulativeness of Research. American Psychologist 42(2): 443-455.
37. Hedges, L.V. (1992), Modeling Publication Selection Effects in Meta-Analysis. Statistical Science 7(2): 246-255.
38. Hedges, L.V., J.L. Vevea (2005), Selection Method Approaches. Pp. 145-174 in: H.R. Rothstein, A.J. Sutton, M. Borenstein (eds.), Publication Bias in Meta-Analysis. Prevention, Assessment and Adjustments, The Atrium, Southern Gate, Chichester: Wiley.
39. Hopewell, S., M. Clarke, S. Mallett (2005), Gray Literature and Systematic Reviews. Pp. 49-72 in: H.R. Rothstein, A.J. Sutton, M. Borenstein (eds.), Publication Bias in Meta-Analysis. Prevention, Assessment and Adjustments, The Atrium, Southern Gate, Chichester: Wiley.
40. Light, R.J., D.B. Pillemer (1984), Summing up: The Science of Reviewing Research. Cambridge, Massachusetts: Harvard University Press.
41. Macaskill, P., S.D. Walter, L. Irwing (2001), A comparison of methods to detect publication bias in meta-analysis. Statistics in Medicine 20: 641-654. (Pubitemid 32166424)
42. Matysiak, A., D. Vignoli (2008), Fertility and Women's Employment: A Meta-analysis. European Journal of Population 24: 363-384.
43. nd Edition. New York.
44. McNemar, Q. (1960), At random: sense and nonsense. American Psychologist 15: 295-300.
45. Misakian, A.L., L.A. Bero (1998), Publication Bias and Research on Passive Smoking. JAMA: The Journal of the American Medical Association 280: 250-253.
46. Peters, J.L., A.J. Sutton, D.R. Jones, K.R. Abrams, L. Rushton (2006), Comparison of two methods to detect publication bias in meta-analysis. Journal of the American Medical Association 295: 676-80. (Pubitemid 43209069)
47. Peters, J.L., A.J. Sutton, D.R. Jones, K.R. Abrams, L. Rushton (2008), Contour-enhanced meta-analysis funnel plots help distinguish publication bias from other causes of asymmetry. Journal of Clinical Epidemiology 61: 991-996.
48. Petticrew, M., H. Roberts (2006), Systematic Reviews in the Social Sciences. A Practical Guide. Malden, MA: Blackwell Publishing.
49. Pigott, T.D. (2009), Handling Missing Data. Pp. 399-416 in: H. Cooper, L.V. Hedges, J.C. Valentine (eds), The Handbook of Research Synthesis and Meta-Analysis, New York: Russel Sage Foundation.
50. Proulx, C.M., H.M. Helms, C. Buehler (2007), Marital Quality and Personal Well-Being: A Meta-Analysis. Journal of Marriage and the Family 69: 576-593.
51. R Development Core Team (2011), R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0, URL http://www.R-project.org/.
52. Riley, R.D., M.C. Simmonds, M.P. Look (2007), Evidence synthesis combining individual patient data and aggregate data: a systematic review identified current practice and possible methods. Journal of Clinical Epidemiology 60: 431-439.
53. Roberts, C.J., T.D. Stanley (eds.) (2005), Meta-Regression Analysis. Issues of Publication Bias in Economics. Malden, MA: Blackwell Publishing.
54. Rosenthal, R. (1979), The "File Drawer Problem" and Tolerance for Null Results. Psychological Bulletin 86(3): 638-641.
55. Rosenthal, R. (1991), Meta-Analytic Procedures for Social Research. Newbury Park: Sage Publications.
56. Rothstein, H.R. (2008), Publication bias as a threat to the validity of meta-analytic results. Journal of Experimental Criminology 4: 61-81.
57. Rothstein, H., A.J. Sutton, M. Borenstein (2005a), Publication Bias in Meta-Analysis. Prevention, Assessment and Adjustments, The Atrium, Southern Gate, Chichester: Wiley.
58. Rothstein, H., A.J. Sutton, M. Borenstein (2005b), Publication Bias in Meta-Analysis. Pp. 1-7 in: H.R. Rothstein, A.J. Sutton, M. Borenstein (eds.), Publication Bias in Meta-Analysis. Prevention, Assessment and Adjustments, The Atrium, Southern Gate, Chichester: Wiley.
59. Rufibach, K. (2011a), selectMeta: Estimation of weight functions in meta analysis. R package version 1.0.3. http://CRAN.R-project.org/package=selectMeta.
60. Rufibach, K. (2011b), Selection models with monotone weight functions in meta analysis. Biometrical Journal. 53(4): n/a (article first published online).
61. Rustenbach, S.J. (2003), Metaanalyse. Eine anwendungsorientierte Einführung. Bern: Hans Huber.
62. Sahner, H. (1979), Veröffentlichte empirische Sozialforschung: Eine Kumulation von Artefakten? Eine Analyse von Periodika. Zeitschrift für Soziologie 8(3): 267-278.
63. Sahner, H. (1982), Zur Selektivität von Herausgebern: Eine Input-output-Analyse der "Zeitschrift für Soziologie". Zeitschrift für Soziologie 11(1): 82-98.
64. Simmonds, M.C., J.P.T. Higgins, L.A. Stewart, J.F. Tierney, M.J. Clarke, S.G. Thompson (2005), Meta-analysis of individual patient data from randomized trials: a review of methods used in practice. Clinical Trails 2: 209-217. (Pubitemid 40910470)
65. Smart, R.G. (1964), The importance of negative results in psychological research. The Canadian Psychologist 5(4): 225-232.
66. Smith, M.L. (1980), Publication bias and meta-analysis. Evaluation in Education 4: 22-24.
67. Song, F., A.J. Eastwood, S. Gilbody, L. Duley, A.J. Sutton (2000), Publication and other selection biases in systematic reviews. Health Technology Assessment 4: 10.
68. Stanley, T.D. (2005), Beyond Publication Bias. Journal of Economic Surveys 19(3): 310-345.
69. Stanley, T.D. (2008), Meta-Regression Methods for Detecting and Estimating Empirical Effect in the Presence of Publication Selection. Oxford Bulletin of Economics and Statistics 70: 103-127.
70. Sterling, T.D. (1959), Publication decisions and their possible effects on inferences drawn from tests of significance - or vice versa. Journal of the American Statistical Association 54(285): 30-34.
71. Sterne, J.A.C., D. Gavaghan, M Egger (2000), Publication and related bias in meta-analysis: power of statistical tests and prevalence in the literature. Journal of Clinical Epidemiology: 1119-1129.
72. Sterne, J.A.C., M. Egger (2001), Funnel plots for detecting bias in meta-analysis: Guidelines on choice of axis. Journal of Clinical Epidemiology 54:1046-1055. (Pubitemid 32888370)
73. Sterne, J.A.C., M. Egger (2005), Regression Methods to Detect Publication and Other Bias in Meta-Analysis. Pp. 99-110 in: H.R. Rothstein, A.J. Sutton, M. Borenstein (eds.), Publication Bias in Meta-Analysis. Prevention, Assessment and Adjustments, The Atrium, Southern Gate, Chichester: Wiley.
74. Sterne, J.A.C., B.J. Becker, M. Egger (2005), The funnel plot. Pp. 75-98 in: H.R. Rothstein, A.J. Sutton, M. Borenstein (eds.), Publication Bias in Meta-Analysis. Prevention, Assessment and Adjustments, The Atrium, Southern Gate, Chichester: Wiley.
75. Stewart, L.A., J.F. Tierney (2002), To IPD or not IPD? Advantages and disadvantages of systematic reviews using individual patient data. Evaluation and The Health Professions 25(1): 76-97. (Pubitemid 34157785)
76. Stewart, L., J. Tierney, S. Burdett (2005), Do Systematic Reviews Based on Individual Patient Data Offer a Means of Circumventing Biases Associated with Trial Publications? Pp. 261-286 in: H.R. Rothstein, A.J. Sutton, M. Borenstein (eds.), Publication Bias in Meta-Analysis. Prevention, Assessment and Adjustments, The Atrium, Southern Gate, Chichester: Wiley.
77. Sutton, A.J., F. Song, S.M. Gilbody, K.R. Abrams (2000), Modelling publication bias in meta-analysis: a review. Statistical Methods in Medical Research 9: 421-445. (Pubitemid 32050882)
78. Torgerson, C.J. (2006), Publication Bias: The Achilles' Heel of Systematic Reviews? British Journal of Educational Studies 54: 89-102. (Pubitemid 43882917)
79. Verhoeven, W.J., W. Jansen, J. Dessens (2005), Income Attainment During Transformation Processes. A Meta-Analysis of the Market Transition Theory. European Sociological Review 21(3): 201-226.
80. Wagner, M., B. Weiß (2003), Bilanz der deutschen Scheidungsforschung. Versuch einer MetaAnalyse. Zeitschrift für Soziologie 32(1): 1-21.
81. Wagner, M., B. Weiß (2004), Scheidungsrisiken in Deutschland. Eine Meta-Analyse von empirischen Befunden der Jahre 1987 bis 2003. Pp. 381-407 in: R. Kecskes, M. Wagner, C. Wolf (eds.), Angewandte Soziologie, Wiesbaden: Verlag für Sozialwissenschaften.
82. Wagner, M., B. Weiß (2006a), Meta-Analyse als Methode der Sozialforschung. Pp. 479-504 in: Andreas Diekmann (ed.), Methoden der Sozialforschung. Sonderheft 44 der Kölner Zeitschrift für Soziologie und Sozialpsychologie, Wiesbaden: Verlag für Sozialwissenschaften.
83. Wagner, M., B. Weiß (2006b), On the Variation of Divorce Risks in Europe: Findings from a Meta-Analysis of European Longitudinal Studies. European Sociological Review 22(5): 483-500. (Pubitemid 44853613)
84. Weiß, B. (2008), Meta-Analyse als Verfahren der Forschungssynthese in der Soziologie. Dargestellt anhand zweier Fallbeispiele zum Schulabsentismus [Dissertation]. Wirtschafts- und Sozialwissenschaftliche Fakultät, Universität zu Köln.
85. Wilson, F.D., G.L. Smoke, J.D. Martin (1973), The Replication Problem in Sociology: A Report and a Suggestion. Sociological Inquiry 43(2) 141-149.