Bias in meta-analysis induced by incompletely reported studies

Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments

Volumn , Issue , 2006, Pages 223-239

  Sutton, Alexander J ^a   Pigott, Therese D Terri ^b  

^a UNIVERSITY OF LEICESTER   (United Kingdom)

^b LOYOLA UNIVERSITY CHICAGO   (United States)

Author keywords

Hot deck techniques; Intention to treat analysis; Missing completely at random (MCAR); Missing data levels in meta analysis; Missing data methods; Outcome reporting bias; Sensitivity analysis framework; Simple to implement methods and model based methods; standard funnel plot methods

Indexed keywords

EID: 84889377761     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/0470870168.ch12     Document Type: Chapter

References (30)

1. Abrams, K.R., Lambert, P.C., Sanso, B., Shaw, C. and Marteau, T.M. (2000). Meta-analysis of heterogeneously reported study results -a Bayesian approach. In D.K. Stangl and D.A. Berry (eds), Meta-analysis in Medicine and Health Policy. New York: Marcel Dekker.
2. Bown, M.J., Sutton, A.J., Nicholson, M.L. and Bell, R.F. (2002). A meta-analysis of 50 years of ruptured abdominal aortic aneurysm repair. British Journal of Surgery, 89, 1-18.
3. Buck, S.F. (1960). A method of estimation of missing values in multivariate data suitable for use with an electronic computer. Journal of the Royal Statistical Society, Series B, 22, 302-306.
4. Bushman, B.J. and Wang, M.C. (1995). A procedure for combining sample correlation coefficients and vote counts to obtain an estimate and a confidence interval for the population correlation coefficient. Psychological Bulletin, 117, 530-546.
5. Bushman, B.J. and Wang, M.C. (1996). A procedure for combining sample standardized mean differences and vote counts to estimate the population standardized mean difference in fixed effect models. Psychological Methods, 1, 66-80.
6. Chan, A.-W., Hróbjartsson, A., Haahr, M.T., Gøtzsche, P.C. and Altman, D.G. (2004a). Empirical evidence for selective reporting of outcomes in randomized trials. Comparison of protocols to published articles. Journal of the American Medical Association, 291, 2457-2465.
7. Chan, A.-W., Krleza-Jeric, K., Schmid, I. and Altman, D.G. (2004b) Outcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research. Canadian Medical Association Journal, 17, 735-740.
8. Ehri, L.C., Nunes, S., Stahl, S. and Willows, D. (2001). Systematic phonics instruction helps students learn to read: Evidence from the National Reading Panel’s meta-analysis. Review of Educational Research, 71, 393-448.
9. Fahrbach, K.R. (2001). An investigation of methods for mixed-model meta-anlaysis in the presence of missing data. Unpublished doctoral dissertation, Michigan State University.
10. Gilks, W.R., Richardson, S. and Spiegelhalter, D.J. (1996). Markov Chain Monte Carlo in Practice. London: Chapman & Hall.
11. Hahn, S., Williamson, P.R., Hutton, J.L., Garner, P. and Flynn, E.V. (2000). Assessing the potential for bias in meta-analysis due to selective reporting of subgroup analyses within studies. Statistics in Medicine, 19, 3325-3336.
12. Hahn, S., Williamson, P.R. and Hutton, J.L. (2002). Investigation of within-study selective reporting in clinical research: Follow-up of applications submitted to a local research ethics committee. Journal of Evaluation in Clinical Practice, 8, 353-359.
13. Higgins, J.P.T., White, I.R. and Wood, A.M. (2003) Dealing with missing outcome data in meta-analysis of clinical trials [abstract]. Controlled Clinical Trials, 24, 88S.
14. Hutton, J.L. and Williamson, P.R. (2000). Bias in meta-analysis due to outcome variable selection within studies. Applied Statistics, 49, 359-370.
15. Jackson, D., Copas, J. and Sutton, A. (2005). Modelling reporting bias: The operative reporting rate for ruptured abdominal aortic aneurysm repair. Journal of the Royal Statistical Society, Series A (in press)
16. Lambert, P.C., Abrams, K.R., Sanso, B. and Jones, D.R. (1997). Synthesis of incomplete data using Bayesian hierarchical models: An illustration based on data describing survival from neuroblastoma. Technical Report 97-03, Department of Epidemiology and Public Health, University of Leicester, UK.
17. Lipsey, M.W. and Wilson, D.B. (2001). The way in which intervention studies have ‘personality’ and why it is important to meta-analysis. Evaluation and the Health Professions, 24, 236-254.
18. Little, R.J.A. (1992). Regression with missing X’s: A review. Journal of the American Statistical Association, 87, 1227-1237.
19. Little, R.J.A. and Rubin, D.B. (1987). Statistical Analysis with Missing Data. New York: John Wiley & Sons, Inc.
20. Orwin, R.G. and Cordray, D.S. (1985). Effects of deficient reporting on meta-analysis: A conceptual framework and reanalysis. Psychological Bulletin, 97, 134-147.
21. Pigott, T.D. (2001). Missing predictors in models of effect size. Evaluation and the Health Professions, 24, 277-307.
22. Preston, C. and Hollis, S. (2002) Method of investigating the effect of missing data on meta-analysis. Paper presented at the 4th Symposium on Systematic Reviews: Pushing the boundaries, Oxford, UK, July. Abstract available at http://www.ihs.ox.ac.uk/csm/pushingtheboundaries/poster/20_pres.html accessed May 2005.
23. Rubin, D.B. (1976). Inference and missing data. Biometrika, 63, 581-592.
24. Rubin, D.B. (1987). Multiple imputation for nonresponse in surveys. New York: John Wiley.
25. Schafer, J.L. (1997). Analysis of Incomplete Multivariate Data. New York: Chapman & Hall.
26. Sinhary, S., Stern, H.S. and Russell, D. (2001). The use of multiple imputation for the analysis of missing data. Psychological Methods, 6, 317-329.
27. Song, F., Freemantle, N., Sheldon, T.A., House, A., Watson, P. and Long, A. (1993) Selective serotonin reuptake inhibitors: Meta-analysis of efficacy and acceptability. British Medical Journal, 306, 683-687.
28. SPSS (1999). SPSS for Windows (Version 9.0). Chicago.
29. Sutton, A.J., Abrams, K.R., Jones, D.R., Sheldon, T.A. and Song, F. (2000) Methods for Meta-analysis in Medical Research. Chichester: John Wiley & Sons, Ltd.
30. Whitley Jr., B.E., McHugh, M.C. and Frieze, I.H. (1986). Assessing the theoretical models for sex differences in causal attributions of success and failure. In J.S. Hyde and M.C. Linn (eds), The Psychology of Gender. Baltimore, MD: Johns Hopkins University Press.