Measuring the statistical validity of summary meta-analysis and meta-regression results for use in clinical practice

Statistics in Medicine

Volumn 36, Issue 21, 2017, Pages 3283-3301

  Willis, Brian H ^a   Riley, Richard D ^b  

^a UNIVERSITY OF BIRMINGHAM   (United Kingdom)

^b KEELE UNIVERSITY   (United Kingdom)

Author keywords

data interpretation; decision making; meta analysis; models; statistical; validity

Indexed keywords

CLINICAL PRACTICE; CONTROLLED STUDY; DECISION MAKING; HUMAN; META ANALYSIS; SAMPLE SIZE; SIMULATION; STATISTICAL MODEL; VALIDATION PROCESS; VALIDITY; ALGORITHM; COMPUTER SIMULATION; GENERAL PRACTICE; META ANALYSIS (TOPIC); REGRESSION ANALYSIS; REPRODUCIBILITY; STATISTICAL ANALYSIS; STATISTICAL BIAS;

ALGORITHMS; BIAS; COMPUTER SIMULATION; DATA INTERPRETATION, STATISTICAL; GENERAL PRACTICE; HUMANS; META-ANALYSIS AS TOPIC; REGRESSION ANALYSIS; REPRODUCIBILITY OF RESULTS;

EID: 85021224190     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.7372     Document Type: Article

References (31)

1. Riley RD, Ahmed I, Debray TPA, Willis BH, Noordzij P, Higgins JPT, Deeks JJ. Summarising and validating the accuracy of a diagnostic or prognostic test across multiple studies: a new meta-analysis framework. Statistics in Medicine 2015; 34:2081–2103.
2. Debray TP, Moons KG, Ahmed I, Koffijberg H, Riley RD. A framework for developing, implementing, and evaluating clinical prediction models in an individual participant data meta-analysis. Statistics in Medicine 2013; 32:3158–3180.
3. Snell KIE, Hua H, Ensor J, Debray TP, Look MP, Moons KG, Riley RD. Multivariate meta-analysis of individual participant data helped externally validate the performance and implementation of a prediction model. Journal of Clinical Epidemiology 2016; 69:40–50.
4. Royston P, Parmar MKB, Sylvester R. Construction and validation of a prognostic model across several studies, with an application in superficial bladder cancer. Statistics in Medicine 2004; 23:907–926.
5. Willis BH, Hyde CJ. Estimating a test's accuracy using tailored meta-analysis—how setting-specific data may aid study selection. Journal of Clinical Epidemiology 2014; 67:538–546.
6. Willis BH, Hyde CJ. What is the test's accuracy in my practice population? Tailored meta-analysis provides a plausible estimate. Journal of Clinical Epidemiology 2015; 68:847–854.
7. Viechtbauer W. Conducting meta-analyses in R with the metafor package. Journal of Statistical Software 2010; 36(3):1–48.
8. Quenouille MH. Notes on bias in estimation. Biometrika 1956; 43(3–4):353–360.
9. Biggerstaff BJ, Jackson D. The exact distribution of Cochran's heterogeneity statistic in one-way random effects meta-analysis. Statistics in Medicine 2008; 27:6093–6110.
10. Duchesne P, Lafaye De Micheaux P. Computing the distribution of quadratic forms: further comparisons between the Liu–Tang–Zhang approximation and exact methods. Computational Statistics and Data Analysis 2010; 54:858–862.
11. Satterthwaite FE. An approximate distribution of estimates of variance components. Biometrics Bulletin 1946; 2:110–114.
12. Davies RB. Numerical inversion of a characteristic function. Biometrika 1973; 60(2):415–417.
13. 2 random variables. Journal of the Royal Statistical Society, Series C (Applied Statistics) 1980; 29:323–333.
14. Fleiss JL. On the distribution of a linear combination of independent chi-squares. Journal of the American Statistical Association 1971; 66:142–144.
15. Ruben H. Probability content of regions under spherical normal distributions. IV The distribution of homogeneous and non-homogeneous quadratic functions of normal variables. The Annals of Mathematical Statistics 1962; 33:542–570.
16. Farebrother RW. Algorithm AS 204: the distribution of a positive linear combination of χ random variables. Journal of the Royal Statistical Society, Series C (Applied Statistics) 1984; 33(3):332–339.
17. Cochran WG. The combination of estimates from different experiments. Biometrics 1954; 10:101–129.
18. Higgins JPT, Thompson SG. Quantifying heterogeneity in a meta-analysis. Statistics in Medicine 2002; 21:1539–1558.
19. Riley RD, Higgins JPT, Deeks JJ. Interpretation of random effects meta-analyses. The British Medical Journal 2011; 342:d549.
20. Hoaglin DC. Misunderstandings about Q and ‘Cochran's Q test’ in meta-analysis. Statistics in Medicine 2016; 35:485–495.
21. IntHout J, Ioannidis JP, Rovers MM, Goeman JJ. Plea for routinely presenting prediction intervals in meta-analysis. BMJ Open 2016; 6 e010247. DOI: https://doi.org/10.1136/bmjopen-2015-010247.
22. Berkey CS, Hoaglin DC, Mosteller F, Colditz GA. A random-effects regression model for meta-analysis. Statistics in Medicine 1995; 14:395–411.
23. Leeflang MM, Debets-Ossenkopp YJ, Visser CE, Scholten RJPM, Hooft L, Bijlmer HA, Reitsma JB, Bossuyt PMM, Vandenbroucke-Grauls CM. Galactomannan detection for invasive aspergillosis in immunocompromized patients. Cochrane Database of Systematic Reviews 2008 Issue 4. Art. No.: CD007394. DOI: https://doi.org/10.1002/14651858.CD007394.
24. Lachenbruch PA, Mickey MR. Estimation of error rates in discriminant analysis. Technometrics 1968; 10:1–11.
25. Stone M. Cross-validatory choice and assessment of statistical predictions. Journal of the Royal Statistical Society. Series B (Methodological) 1974; 36(2):111–147.
26. Hardy RJ, Thompson SG. Detecting and describing heterogeneity in meta-analysis. Statistics in Medicine 1998; 17:841–856.
27. 2 in assessing heterogeneity may mislead. BMC Medical Research Methodology 2008; 8:79.
28. 2 index? Psychological Methods 2006; 11(2):193–206.
29. Smith GD, Ebrahim S. Data dredging, bias, or confounding. The British Medical Journal 2002; 325(7378):1437–1438.
30. Altman DG, Royston P. What do we mean by validating a prognostic model? Statistics in Medicine 2000; 19:453–473.
31. Partlett C, Riley RD. Random effects meta-analysis: coverage performance of 95% confidence and prediction intervals following REML estimation. Statistics in Medicine 2017; 36(2):301–317.