A re-evaluation of fixed effect(s) meta-analysis

Journal of the Royal Statistical Society. Series A: Statistics in Society

Volumn 181, Issue 1, 2018, Pages 205-227

  Rice, Kenneth ^a   Higgins, Julian P T ^b   Lumley, Thomas ^c  

^a UNIVERSITY OF WASHINGTON   (United States)

^b UNIVERSITY OF BRISTOL   (United Kingdom)

^c UNIVERSITY OF AUCKLAND   (New Zealand)

Author keywords

Common effect; Fixed effect; Fixed effects; Meta analysis; Meta regression; Random effect

Indexed keywords

EID: 85017341550     PISSN: 09641998     EISSN: 1467985X     Source Type: Journal    
DOI: 10.1111/rssa.12275     Document Type: Article

References (81)

1. Ades, A., Welton, N., Caldwell, D., Price, M., Goubar, A. and Lu, G. (2008) Multiparameter evidence synthesis in epidemiology and medical decision-making. J. Hlth Serv. Res. Poly, 13, suppl. 3, 12–22.
2. Anzures-Cabrera, J. and Higgins, J. (2010) Graphical displays for meta-analysis: an overview with suggestions for practice. Res. Synth. Meth., 1, 66–80.
3. de Bakker, P., Ferreira, M., Jia, X., Neale, B., Raychaudhuri, S. and Voight, B. (2008) Practical aspects of imputation-driven meta-analysis of genome-wide association studies. Hum. Molec. Genet., 17, R122–R128.
4. Berkey, C., Hoaglin, D., Mosteller, F. and Colditz, G. (1995) A random-effects regression model for meta-analysis. Statist. Med., 14, 395–411.
5. Berlin, J., Santanna, J., Schmid, C., Szczech, L. and Feldman, H. (2002) Individual patient-versus group-level data meta-regressions for the investigation of treatment effect modifiers: ecological bias rears its ugly head. Statist. Med., 21, 371–387.
6. Berman, M. (1988) A theorem of Jacobi and its generalization. Biometrika, 75, 779–783.
7. Berman, N. and Parker, R. (2002) Meta-analysis: neither quick nor easy. BMC Med. Res. Methodol., 2, no. 1, article 10.
8. Bernardo, J. and Smith, A. (2003) Bayesian Theory. Chichester: Wiley.
9. Berrington de González, A. and Cox, D. (2007) Interpretation of interaction: a review. Ann. Appl. Statist., 1, 371–385.
10. Borenstein, M., Hedges, L., Higgins, J. and Rothstein, H. (2009) Introduction to Meta-analysis. Hoboken: Wiley.
11. Brazzale, A. (2005) hoa: an R package bundle for higher order likelihood inference. R News, 5, no. 1, 20–27.
12. Brazzale, A., Davison, A. and Reid, N. (2007) Applied Asymptotics: Case Studies in Small-sample Statistics. Cambridge: Cambridge University Press.
13. Breslow, N. (1981) Odds ratio estimators when the data are sparse. Biometrika, 68, 73–84.
14. Breslow, N. (1996) Statistics in epidemiology: the case-control study. J. Am. Statist. Ass., 91, 14–28.
15. Brooker, R. (1999) Genetics: Analysis and Principles. Menlo Park: Addison-Wesley.
16. Buja, A., Berk, R., Brown, L., George, E., Pitkin, E., Traskin, M., Zhao, L. and Zhang, K. (2016) Models as approximations: a conspiracy of random regressors and model deviations against classical inference in regression. Statist. Sci., to be published.
17. Casella, G. and Berger, R. (2001) Statistical Inference. Pacific Grove: Duxbury.
18. Caspi, A. and Moffitt, T. (2006) Gene–environment interactions in psychiatry: joining forces with neuroscience. Nat. Rev. Neursci., 7, 583–590.
19. Day, N. and Byar, D. (1979) Testing hypotheses in case-control studies—equivalence of Mantel-Haenszel statistics and logit score tests. Biometrics, 35, 623–630.
20. DerSimonian, R. and Laird, N. (1986) Meta-analysis in clinical trials. Contr. Clin. Trials, 7, 177–188.
21. Donner, A. and Hauck, W. (1986) The large-sample relative efficiency of the Mantel-Haenszel estimator in the fixed-strata case. Biometrics, 42, 537–545.
22. Early Breast Cancer Trialists’ Collaborative Group (1998) Tamoxifen for early breast cancer: an overview of the randomised trials. Lancet, 351, 1451–1467.
23. Fleiss, J. (1993) The statistical basis of meta-analysis. Statist. Meth. Med. Res., 2, 121–145.
24. Gögele, M., Minelli, C., Thakkinstian, A., Yurkiewich, A., Pattaro, C., Pramstaller, P., Little, J., Attia, J. and Thompson, J. (2012) Methods for meta-analyses of genome-wide association studies: critical assessment of empirical evidence. Am. J. Epidem., 175, 739–749.
25. Greenland, S. (1982) Interpretation and estimation of summary ratios under heterogeneity. Statist. Med., 1, 217–227.
26. Guolo, A. (2012) Higher-order likelihood inference in meta-analysis and meta-regression. Statist. Med., 31, 313–327.
27. Hartung, J., Knapp, G. and Sinha, B. (2011) Statistical Meta-analysis with Applications. New York: Wiley-Interscience.
28. Hauck, W. and Donner, A. (1988) The asymptotic relative efficiency of the Mantel-Haenszel estimator in the increasing-number-of-strata case. Biometrics, 44, 379–384.
29. Hedges, L. and Pigott, T. (2001) The power of statistical tests in meta-analysis. Psychol. Meth., 6, 203–217.
30. Hedges, L., Tipton, E. and Johnson, M. (2010) Robust variance estimation in meta-regression with dependent effect size estimates. Res. Synth. Meth., 1, 39–65.
31. Hedges, L. and Vevea, J. (1998) Fixed- and random-effects models in meta-analysis. Psychol. Meth., 3, 486.
32. Higgins, J. and Green, S. (eds) (2011) Cochrane Handbook for Systematic Reviews of Interventions, version 5.1.0. Cochrane Collaboration.
33. Higgins, J. and Thompson, S. (2002) Quantifying heterogeneity in a meta-analysis. Statist. Med., 21, 1539–1558.
34. Higgins, J. and Thompson, S. (2004) Controlling the risk of spurious findings from meta-regression. Statist. Med., 23, 1663–1682.
35. Higgins, J., Thompson, S., Deeks, J. and Altman, D. (2003) Measuring inconsistency in meta-analyses. Br. Med. J., 327, 557–560.
36. Higgins, J. P. T., Thompson, S. G. and Spiegelhalter, D. J. (2009) A re-evaluation of random-effects meta-analysis. J. R. Statist. Soc. A, 172, 137–159.
37. Higgins, J., Whitehead, A., Turner, R., Omar, R. and Thompson, S. (2001) Meta-analysis of continuous outcome data from individual patients. Statist. Med., 20, 2219–2241.
38. Hoaglin, D. C. (2015) We know less than we should about methods of meta-analysis. Res. Synth. Meth., 6, 287–289.
39. Hoaglin, D. C. (2016) Misunderstandings about Q and Cochran's Q test in meta-analysis. Statist. Med., 35, 485–495.
40. Hong, F., Breitling, R., McEntee, C. W., Wittner, B. S., Nemhauser, J. L. and Chory, J. (2006) Rankprod: a bioconductor package for detecting differentially expressed genes in meta-analysis. Bioinformatics, 22, 2825–2827.
41. Huber, P. (1967) The behavior of maximum likelihood estimates under nonstandard conditions. In Proc. 5th Berkeley Symp. Mathematical Statistics and Probability (eds L. M. Le Cam and J. Neyman), vol. 1, pp. 221–233. Berkeley: University of California Press.
42. Hunter, J. and Schmidt, F. (2004) Methods of Meta-analysis: Correcting Error and Bias in Research Findings. New York: Sage.
43. Konstantopoulos, S. and Hedges, L. (2009) Analyzing effect sizes: fixed-effects models. The Handbook of Research Synthesis and Meta-analysis, pp. 279–293. New York: Russell Sage Foundation.
44. Kulinskaya, E., Dollinger, M. B. and Bjørkestøl, K. (2011a) On the moments of Cochran's q statistic under the null hypothesis, with application to the meta-analysis of risk difference. Res. Synth. Meth., 2, 254–270.
45. Kulinskaya, E., Dollinger, M. B. and Bjørkestøl, K. (2011b) Testing for homogeneity in meta-analysis: I, the one-parameter case: standardized mean difference. Biometrics, 67, 203–212.
46. Kuritz, S., Landis, J. and Koch, G. (1988) A general overview of Mantel-Haenszel methods: applications and recent developments. A. Rev. Publ. Hlth, 9, 123–160.
47. Laird, N., Fitzmaurice, S. and Ding, X. (2010) Comments on empirical vs natural weighting in random effects meta-analysis. Statist. Med., 29, 1266–1267.
48. Leeb, H. and Pötscher, B. (2005) Model selection and inference: facts and fiction. Econmetr. Theory, 21, 21–59.
49. Leeflang, M. M. G., Deeks, J. J., Gatsonis, C. and Bossuyt, P. M. M., on behalf of the Cochrane Diagnostic Test Accuracy Working Group (2008) Systematic reviews of diagnostic test accuracy. Ann. Intern. Med., 149, 889–897.
50. Levy, D., Ehret, G. B., Rice, K., Verwoert, G. C., Launer, L. J., Dehghan, A., Glazer, N. L., Morrison, A. C., Johnson, A. D., Aspelund, T., Aulchenko, Y., Lumley, T., Köttgen, A., Vasan, R. S., Rivadeneira, F., Eiriksdottir, G., Guo, X., Arking, D. E., Mitchell, G. F., Mattace-Raso, F. U. S., Smith, A. V., Taylor, K., Scharpf, R. B., Hwang, S.-J., Sijbrands, E. J. G., Bis, J., Harris, T. B., Ganesh, S. K., O’Donnell, C. J., Hofman, A., Rotter, J. I., Coresh, J., Benjamin, E. J., Uitterlinden, A. G., Heiss, G., Fox, C. S., Witteman, J. C. M., Boerwinkle, E., Wang, T. J., Gudnason, V., Larson, M. G., Chakravarti, A., Psaty, B. M. and van Duijn, C. M. (2009) Genome-wide association study of blood pressure and hypertension. Nat. Genet., 41, 677–687.
51. Li, J., Zhang, Q., Zhang, M. and Egger, M. (2007) Intravenous magnesium for acute myocardial infarction. In Cochrane Database of Systematic Reviews, issue 2, article CD002755.
52. Lin, D. and Zeng, D. (2010) On the relative efficiency of using summary statistics versus individual-level data in meta-analysis. Biometrika, 97, 321–332.
53. Lipsey, M. and Wilson, D. (2001) Practical Meta-analysis. New York: Sage.
54. Lu, G. and Ades, A. (2004) Combination of direct and indirect evidence in mixed treatment comparisons. Statist. Med., 23, 3105–3124.
55. Lumley, T. (2010) Complex Surveys: a Guide to Analysis using R. Hoboken: Wiley.
56. Mantel, N. and Haenszel, W. (1959) Statistical aspects of the analysis of data from retrospective studies of disease. J. Natn. Cancer Inst., 22, 719–748.
57. McKinlay, S. (1978) The effect of nonzero second-order interaction on combined estimators of the odds ratio. Biometrika, 65, 191–202.
58. Olkin, I. and Sampson, A. (1998) Comparison of meta-analysis versus analysis of variance of individual patient data. Biometrics, 54, 317–322.
59. Pereira, T., Patsopoulos, N., Salanti, G. and Ioannidis, J. (2009) Discovery properties of genome-wide association signals from cumulatively combined data sets. Am. J. Epidem., 170, 1197–1206.
60. Peto, R. (1987) Why do we need systematic overviews of randomized trials? Statist. Med., 6, 233–244.
61. Ritz, J., Demidenko, E. and Spiegelman, D. (2008) Multivariate meta-analysis for data consortia, individual patient meta-analysis, and pooling projects. J. Statist. Planng Inf., 138, 1919–1933.
62. Rubin, D. (1992) Meta-analysis: literature synthesis or effect-size surface estimation? J. Educ. Behav. Statist., 17, 363–374.
63. Rücker, G., Schwarzer, G., Carpenter, J. and Schumacher, M. (2010) Comments on empirical vs natural weighting in random effects meta-analysis by JJ Shuster. Statist. Med., 29, 2963–2965.
64. Schervish, M. (1995) Theory of Statistics. New York: Springer.
65. Schmidt, F. and Hunter, J. (2004) Methods of Meta-analysis: Correcting Error and Bias in Research Findings. New York: Sage.
66. Senn, S. (2007) Trying to be precise about vagueness. Statist. Med., 26, 1417–1430.
67. Shuster, J. (2010) Empirical vs natural weighting in random effects meta-analysis. Statist. Med., 29, 1259–1265.
68. Siegmund, D. (1985) Sequential Analysis: Tests and Confidence Intervals. New York: Springer.
69. Spiegelhalter, D., Abrams, K. and Myles, J. (2004) Bayesian Approaches to Clinical Trials and Health-care Evaluation. Chichester: Wiley.
70. Stephens, M. and Balding, D. (2009) Bayesian statistical methods for genetic association studies. Nat. Rev. Genet., 10, 681–690.
71. Teramukai, S., Matsuyama, Y., Mizuno, S. and Sakamoto, J. (2004) Individual patient-level and study-level meta-analysis for investigating modifiers of treatment effect. Jpn. J. Clin. Oncol., 34, 717–721.
72. Thompson, S. (1993) Controversies in meta-analysis: the case of the trials of serum cholesterol reduction. Statist. Meth. Med. Res., 2, 173–192.
73. Thompson, S. and Higgins, J. (2010) Comments on empirical vs natural weighting in random effects meta-analysis. Statist. Med., 29, 1270–1271.
74. Turner, R. M., Spiegelhalter, D. J., Smith, G. C. S. and Thompson, S. G. (2009) Bias modelling in evidence synthesis. J. R. Statist. Soc. A, 172, 21–47.
75. Van Den Noortgate, W. and Onghena, P. (2005) Parametric and nonparametric bootstrap methods for meta-analysis. Behav. Res. Meth., 37, 11–22.
76. Van Houwelingen, H., Arends, L. and Stijnen, T. (2002) Advanced methods in meta-analysis: multivariate approach and meta-regression. Statist. Med., 21, 589–624.
77. Waksman, J. (2010) Comments on empirical vs natural weighting in random effects meta-analysis. Statist. Med., 29, 1268–1269.
78. White, H. (1980) A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica, 48, 817–838.
79. Whitehead, A. and Whitehead, J. (1991) A general parametric approach to the meta-analysis of randomized clinical trials. Statist. Med., 10, 1665–1677.
80. Yanagimoto, T. (1990) Combining moment estimates of a parameter common through strata. J. Statist. Planng Inf., 25, 187–194.
81. Zhong, H. and Prentice, R. (2010) Correcting winner's curse in odds ratios from genomewide association findings for major complex human diseases. Genet. Epidem., 34, 78–91.