Publication bias: The achilles' heel of systematic reviews?

British Journal of Educational Studies

Volumn 54, Issue 1, 2006, Pages 89-102

  Torgerson, Carole J ^a  

^a UNIVERSITY OF YORK   (United Kingdom)

Author keywords

Controlled trials; Educational research; Meta analysis; Publication bias; Systematic reviews

Indexed keywords

EID: 33745107234     PISSN: 00071005     EISSN: 14678527     Source Type: Journal    
DOI: 10.1111/j.1467-8527.2006.00332.x     Document Type: Article

References (31)

1. BEGG, C.B. and BERLIN, J.A. (1988) Publication bias: a problem in interpreting medical data, Journal of the Royal Statistical Society, Series A (Statistics in Society) 151 (3), 419-463.
2. BLOK, H. (1999) Reading to young children in educational settings: a meta-analysis of recent research, Language Learning, 49 (2), 343-371.
3. COHEN, J. (1962), The statistical power of abnormal-social psychology research: a review, Journal of Abnormal and Social Psychology, 65 (3), 145-153.
4. DEAR, K.B.G. and BEGG, C.B. (1992) An approach for assessing publication bias prior to performing a mete-analysis, Statistical Science, 7 (2), 237-245.
5. DICKERSIN, K. (1997) How important is publication bias? A synthesis of available data, AIDS Education and Prevention, 9 (Supplement A), 15-21.
6. DICKERSIN, K. (2002) Reducing reporting biases. In I. CHALMERS, I. MILNE and U. TROHLER (Eds) The James Lind. Library (www.jameslindlibraty.org).
7. DICKERSIN, K., CHAN, S., CHALMERS, T.C., SACKS H.S. and SMITH, H. (1987) Publication bias and clinical trials, Controlled Clinical Trials, 8, 343-353.
8. DURLAK, J.A. and LIPSEY, M.W. (1991) A practitioner's guide to meta-analysis, American Journal of Community Psychology, 19 (3), 291-332.
9. EGGER, M., JUNI, P., BARTLETT, G., HOLENSTEIN, F. and STERNE, J. (2003) How important are comprehensive literature searches and the assessment, of trial quality in systematic reviews? Empirical Study Health Technology Assessment, 7 (1), 1-76.
10. EHRI, L.C, NUNES, S.R., STAHL, S.A. and WILLOWS, D.M. (2001) Systematic phonics instruction helps students learn to read: evidence from the national reading panel's meta-analysis, Retriew of Educational Research, 71, 393-447.
11. FITZ-GIBBON, C. (2004) Editorial: The need for randomized trials in social research, Journal of Royal Statistical Society, 167 (1), 1-4.
12. GREENWALD, A.G. (1975) Consequences of prejudice against the null hypothesis, Psychological Bulletin, 82 (1), 1-20.
13. HEDGES, L.V. and OLKIN, I. (1980) Vote counting methods in research synthesis, Psychological Bulletin, 88 (2), 359-369.
14. IYENGAR, S. and GREENHOUSE, J.B. (1988) Selection models and the file drawer problem, Statistical Science, 3 (1), 109-117.
15. KULIK, J.A. and KULIK, C.L.C. (1989) Meta-analysis in education, International Journal of Educational Research, 13, 221-340.
16. LIGHT, R.J. and PILLEMER, D.B. (1984) Summing up: the Science of Reviewing Research (Cambridge, MA, Harvard University Press).
17. LIPSEY, M.W., CROSSE, S., DUNKLE, J., POLIARD, J. and STOBART, G. (1985) Evaluation: the state of the art and the sorry state of the science, New Directions for Program Evaluation, 27.
18. LIPSEY, M.W. and WILSON, D.B. (1993) The efficacy of psychological, educational and behavioural treatment: confirmation from meta-analysis, American Psychologist, 12, 1181-1209.
19. NORRIS, J.M. and ORTEGA, L. (2000) Effectiveness of L2 instruction: a research synthesis and quantitative meta-analysis, Language Learning, 50 (3), 417-528.
20. ROSENTHAL, R. (1978) Combining results of independent studies, Psychological Bulletin, 85, 185-193.
21. ROSENTHAL, R. (1979) The 'file drawer problem' and tolerance for null results, Psychological Bulletin, 86 (3), 638-641.
22. SMART, R.G. (1964) The importance of negative results in psychological research, Canadian Psychologist, 5, 225-232.
23. SMITH, M.L. (1980) Publication bias and meta-analysis, Evaluation in Education, 4, 22-24.
24. STERLING, T.D. (1959) Publication decisions and their possible effects on inferences drawn from tests of significance - or vice versa, Journal of American Statistical Association, 54, 30-34.
25. STERLING, T.D., ROSENBAUM, W.L. and WEINKAM, J.J. (1995) Publication decisions revisited: the effect of the outcome of statistical tests on the decision to publish and vice versa, The American Statistician, 49 (1), 108-112.
26. STERNE, A.C., GAVAGHAN, D. and EGGER, M. (2000) Publication and related bias in meta-analysis, Journal of Clinical Epidemiology, 53 (11), 1119-1129.
27. SUTTON, A.J., DUVAL, S.J., TWEEDIE, R.L., ABRAMS, K.R.A. and JONES, D.R. (2000) Empirical assessment of effect of publication bias on meta-analyses, British Medical Journal, 320, 1574-1577.
28. TORGERSON, C.J. (2003) Systematic Reviews (London, Continuum Books).
29. TORGERSON, C.J., PORTHOUSE, J., BROOKS, G. (2003) A systematic review and meta-analysis of randomised controlled trials evaluating interventions in adult literacy and numeracy, Journal of Research in Reading, 26 (2), 234-255.
30. TRUSCOTT, J. (2004) The effectiveness of grammar instruction: analysis of a meta-analysis, English Teaching and Learning, 28 (3), 17-29.
31. WILSON, D.B. and LIPSEY, M.W. (2001) The role of method in treatment effectiveness research: evidence from meta-analysis, Psychological Methods, 6 (4), 413-429.