Multiparameter evidence synthesis in epidemiology and medical decision-making: Current approaches

Journal of the Royal Statistical Society. Series A: Statistics in Society

Volumn 169, Issue 1, 2006, Pages 5-35

  Ades, A E ^a   Sutton, A J ^b  

^a UNIVERSITY OF BRISTOL   (United Kingdom)

^b UNIVERSITY OF LEICESTER   (United Kingdom)

Author keywords

Bayesian methods; Decision making; Evidence synthesis; Hierarchical models

Indexed keywords

EID: 33645089927     PISSN: 09641998     EISSN: 1467985X     Source Type: Journal    
DOI: 10.1111/j.1467-985X.2005.00377.x     Document Type: Review

References (113)

1. Abrams, K. R., Sutton, A. J., Cooper, N. J., Sculpher, M., Palmer, S., Ginelly, L. and Robinson, M. (2003) Populating economic decision models using meta-analyses of heterogeneously reported studies augmented with expert beliefs. Developing Economic Evaluation Methods 4 Wrkshp, Bristol, Sept. 3rd-4th. (Available from http://www.here.ox.ac.uk/DEEM/index, html.)
2. Ades, A. E. (2003) A chain of evidence with mixed comparisons: models for multiparameter evidence synthesis and consistency of evidence. Statist. Med., 22, 2995-3016.
3. Ades, A. E. and Cliffe, S. (2002) Markov Chain Monte Carlo estimation of a multi-parameter decision model: consistency of evidence and the accurate assessment of uncertainty. Med. Decsn Makng, 22, 359-371.
4. Ades, A. E. and Lu, G. (2003) Correlations between parameters in risk models: estimation and propagation of uncertainty by Markov chain Monte Carlo. Risk Anal., 6, 1165-1172.
5. Ades, A., Lu, G. and Claxton, K. (2004) Expected value of sample information calculations in medical decision modeling. Med. Decsn Makng, 24, 207-227.
6. Antithrombotic Trialists' Collaboration (2002) Collaborative meta-analysis of randomized trials of antiplatelet therapy for prevention of death, myocardial infarction, and stroke in high risk patients. Br. Med. J., 324, 71-86.
7. Beck, M. B. and Chen, J. (2000) Assuring the quality of models designed for predictive tasks. In Sensitivity Analysis (eds A. Saltelli, K. Chan and E. M. Scott), pp. 401-420. New York: Wiley.
8. Bedford, T. and Cooke, R. (2001) Probabilistic Risk Analysis: Foundations and Methods. Cambridge: Cambridge University Press.
9. Begg, C. B. (1992) Review of Cross-design Synthesis: a New Strategy for Medical Effectiveness Research. Statist. Med., 11, 1627-1630.
10. Begg, C. B. and Pilote, L. (1991) A model for incorporating historical controls into a meta-analysis. Biometrics, 47, 899-906.
11. Benson, K. and Hartz, A. (2000) A comparison of observational studies and randomized controlled trials. New Engl. J. Med., 342, 1878-1886.
12. Berkey, C. S., Hoaglin, D. C., Antczak-Bouckoms, A., Mosteler, F. and Colditz, G. A. (1998) Meta-analysis of multiple outcomes by regression with random effects. Statist. Med., 17, 2537-2550.
13. Brand, K. P. and Small, M. J. (1995) Updating uncertainty in an integrated risk assessment: conceptual framework and methods. Risk Anal., 15, 719-731.
14. Briggs, A. H. (1999) A Bayesian approach to stochastic cost-effectiveness analysis. Hlth Econ., 8, 257-261.
15. Burzykowski, T., Molenberghs, G. and Buyse, M. (2004) The validation of surrogate end points by using data from randomized clinical trials: a case-study in advanced colorectal cancer. J. R. Statist. Soc. A, 167, 103-124.
16. Buyse, M., Molenberghs, G., Burzykowski, T., Renard, D. and Geys, H. (2000) The validation of surrogate endpoints in meta-analyses of randomised experiments. Biostatistics, 1, 49-67.
17. Carlin, B. (1999) Analysis of local decisions using hierarchical modeling, applied to home radon measurement and remediation. Statist. Sci., 14, 328-330.
18. Chilcott, J., Brennan, A., Booth, A., Karnon, J. and Tappenden, P. (2003) The role of modelling in the planning and prioritisation of clinical trials. Hlth Technol. Assessmnt, 7, 1-138.
19. Claxton, K. and Posnett, J. (1996) An economic approach to clinical trial design and research priority-setting. Hlth Econ., 5, 513-524.
20. Cooper, N. J., Abrams, K. R., Sutton, A. J., Turner, D. and Lambert, P. C. (2003) A Bayesian approach to Markov modelling in cost-effectiveness analyses: application to taxane use in advanced breast cancer. J. R. Statist. Soc. A, 166, 389-405.
21. D'Agostino, R. B. (1998) Propensity score methods for bias reduction in the comparison of a treatment to a non-randomised control group. Statist. Med., 17, 2265-2281.
22. Daniels, M. J. and Hughes, M. D. (1997) Meta-analysis for the evaluation of potential surrogate markers. Statist. Med., 16, 1965-1982.
23. Davis, D., Kisiel, C. and Duckstein, L. (1972) Bayesian decision theory applied to design in hydrology. Wat. Res. J., 8, 33-41.
24. Deeks, J. J. (2002) Issues on the selection of a summary statistic for meta-analysis of clinical trials with binary outcomes. Statist. Med., 21, 1575-1600.
25. DerSimonian, R. and Laird, N. (1986) Meta-analysis of clinical trials. Contr. Clin. Trials, 7, 177-188.
26. Dominici, F., Parmigiani, G., Wolpert, R. L. and Hasselblad, V. (1999) Meta-analysis of migraine headache treatments: combining information from heterogenous designs. J. Am. Statist. Ass., 94, 16-28.
27. Doubilet, P., Begg, C. B., Weinstein, M. C., Braun, P. and McNeill, B. J. (1985) Probabilistic sensitivity analysis using Monte Carlo simulation: a practical approach. Med. Decsn Makng, 5, 157-177.
28. Droitcour, F., Silberman, G. and Chelimsky, E. (1993) Cross design synthesis: a new form of meta-analysis for combining the results from randomised clinical trials and medical-practice databases. Int. J. Technol. Assessmnt Hlth Care, 9, 440-449.
29. DuMouchel, W. (1996) Predictive cross-validation of Bayesian meta-analyses. In Bayesian Statistics 5 (eds J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith), pp. 107-127. Oxford: Oxford University Press.
30. DuMouchel, W. (1997) Repeated measures meta-analysis. Bull. Int. Statist. Inst., 57, 285-288.
31. DuMouchel, W. and Groer, P. G. (1989) A Bayesian methodology for scaling radiation studies from animals toman. Hlth Phys., 57, 411-418.
32. DuMouchel, W. H. and Harris, J. E. (1983) Bayes methods for combining the results of cancer studies in humans and other species. J. Am. Statist. Ass., 78, 293-307.
33. Eddy, D. M. (1989) The confidence profile method: a Bayesian method for assessing health technologies. Ops Res., 37, 210-228.
34. Eddy, D. M., Hasselblad, V. and Shachter, R. (1990) An introduction to a Bayesian method for meta-analysis: the confidence profile method. Med. Decsn Makng, 10, 15-23.
35. Eddy, D. M., Hasselblad, V. and Shachter, R. (1992) Meta-analysis by the Confidence Profile Method. London: Academic Press.
36. Felli, J. C. and Hazen, G. B. (1998) Sensitivity analysis and the expected value of perfect information. Med. Decsn Makng, 18, 95-109.
37. Felli, J. C. and Hazen, G. (1999) A Bayesian approach to sensitivity analysis. Hlth Econ., 8, 263-268.
38. Fenwick, L. and Claxton, K. (2005) The value of implementation and the value of information: combined and uneven development. Med. Decsn Makng, 25, E9.
39. Fleming, T. R. and DeMets, D. L. (1996) Surrogate end-points in clinical trials: are we being misled? Ann. Intern. Med., 125, 605-613.
40. Freedman, L. S., Graubard, B. I. and Schatzkin, A. (1992) Statistical validation of intermediate endpoints for chronic diseases. Statist. Med., 11, 167-178.
41. Gail, M. H., Pfeiffer, R., van Houwelingen, H. C. and Carroll, R. J. (2000) On meta-analytic assessment of surrogate outcomes. Biostatistics, 1, 231-246.
42. Gaver, D., Draper, D., Goel, P., Greenhouse, L., Hedges, L., Morris, C. and Waternaux, C. (1992) Combining Information; Statistical Issues and Opportunities for Research. Washington DC: National Academy Press.
43. Gelman, A., Carlin, J. G., Stern, H. S. and Rubin, D. B. (1995) Bayesian Data Analysis, 1 st edn. London: Chapman and Hall.
44. General Accounting Office (1992) Cross-design synthesis: a new strategy for medical effectiveness research. Report GAO/PEMD-92-18. US General Accounting Office, Gaithersburg.
45. Glenny, A. M., Altman, D. G., Song, F., Sakarovitch, C., Deeks, J. J., D'Amico, R., Bradburn, M. and Eastwood, A. J. (2005) Indirect comparisons of competing interventions. Hlth Technol. Assessmnt, to be published.
46. Gleser, L. J. and Olkin, I. (1994) Stochastically dependent effect sizes. In The Handbook of Research Synthesis (eds H. Cooper and L. V. Hedges), pp. 339-355. New York: Russell Sage Foundation.
47. Gleser, L. J. and Olkin, I. (2000) Meta-analysis for 2 × 2 tables with multiple treatment groups. In Meta-analysis in Medicine and Health Policy (eds D. K. Stangl and D. A. Berry). New York: Dekker.
48. Goldstein, H. (1995) Multi-level Statistical Models. London: Arnold.
49. Greenland, S. (2005) Multiple-bias modelling for analysis of observational data (with discussion). J. R. Statist. Soc. A, 168, 267-306.
50. Hardy, R. J. and Thompson, S. G. (1998) Detecting and describing heterogeneity in meta-analysis. Statist. Med., 17, 841-856.
51. Hasselblad, V. (1998) Meta-analysis of multi-treatment studies. Med. Decsn Makng, 18, 37-43.
52. Hasselblad, V. and McCrory, D. C. (1995) Meta-analytic tools for medical decision making: a practical guide. Med. Decsn Makng, 15, 81-96.
53. Heckman, J. and Hotz, V. (1989) Choosing among alternative non-experimental methods for estimating the impact of social programs: the case of manpower training. J. Am. Statist. Ass., 84, 862-878.
54. Higgins, J. P. T. and Whitehead, J. (1996) Borrowing strength from external trials in a meta-analysis. Statist. Med., 15, 2733-2749.
55. Hirotsu, C. and Yamada, Y. (1999) Estimating odds ratios through connected comparative experiments. Communs Statist. Theory Meth., 28, 905-928.
56. van Houwelingen, H. C., Arends, L. R. and Stijnen, T. (2002) Advanced methods in meta-analysis: multi-variate approach and meta-regression. Statist. Med., 21, 589-624.
57. van Houwelingen, H. C., Zwinderman, K. H. and Stijnen, T. (1993) A bivariate approach to meta-analysis. Statist. Med., 12, 2273-2284.
58. Ibrahim, J. G. and Chen, M. H. (2000) Power prior distributions for regression models. Statist. Sci., 15, 46-60.
59. Ioannidis, J., Haidich, A.-B., Pappa, M., Pantzakis, N., Kokori, S. I., Tektonidou, M. G., Contopoulos-Ioannidis, D. G. and Lau, J. (2001) Comparison of evidence of treatment effects in randomised and non-randomised studies. J. Am. Med. Ass., 286, 821-830.
60. Juni, P., Altman, D. and Egger, M. (1995) Assessing the quality of randomized controlled trials. In Systematic Reviews (eds M. Egger, G. Davey Smith and D. G. Altaian), pp. 87-108. London: British Medical Journal.
61. Kennedy, M. C. and O'Hagan, A. (2001) Bayesian calibration of computer models (with discussion). J. R. Statist. Soc. B, 63, 425-464.
62. Kunz, R. and Paavonen, J. (1998) The unpredictability paradox: review of empirical comparisons of randomised and non randomised clinical trials. Br. Med. J., 317, 1185-1190.
63. Lancet (1992) Cross design synthesis: a new strategy for studying medical outcomes? Lancet, 340, 944-945.
64. Larose, D. T. and Dey, D. K. (1997) Grouped random effects models for Bayesian meta-analysis. Statist. Med., 16, 1817-1829.
65. Li, Z. and Begg, C. B. (1994) Random effects models for combining results from controlled and uncontrolled studies in meta-analysis. J. Am. Statist. Ass., 89, 1523-1527.
66. Lindley, D. V., Tversky, A. and Brown, R. V. (1979) On the reconciliation of probability assessments (with discussion). J. R. Statist. Soc. A, 142, 146-180.
67. Lu, G. and Ades, A. E. (2004) Combination of direct and indirect evidence in mixed treatment comparisons. Statist. Med., 23, 3105-3124.
68. Lumley, T. (2002) Network meta-analysis for indirect treatment comparisons. Statist. Med., 21, 2313-2324.
69. Mandelblatt, J. S., Fryback, D. G., Weinstein, M. C., Russell, L. B., Gold, M. R. and Hadorn, D. C. (1996) Assessing the effectiveness of health interventions. In Cost-effectiveness in Health and Medicine (eds M. R. Gold, J. E. Siegel, L. B. Russell and M. C. Weinstein), pp. 135-175. New York: Oxford University Press.
70. Manning, W. G., Fryback, D. G. and Weinstein, M. C. (1996) Reflecting uncertainty in decision analysis. In Cost-effectiveness in Health and Medicine (eds M. R. Gold, J. E. Siegel, L. B. Russell and M. Weinstein), pp. 247-275. New York: Oxford University Press.
71. Marshall, E. C. and Spiegelhalter, D. J. (2003) Approximate cross-validatory predictive checks in disease mapping models. Statist. Med., 22, 1649-1660.
72. McAlistair, F., Laupacis, A., Wells, G. A. and Sackett, D. L. (1999) Users' guides to the medical literature: XIX, applying clinical trial results; B, guidelines for determining whether a drug is exerting (more than) a class effect. J. Am. Statist. Ass., 282, 1371-1377.
73. Mulrow, C. D. (1995) Rationale for systematic reviews. In Systematic Reviews (eds I. Chalmers and D. G. Altman), pp. 1-8. London: British Medical Journal.
74. Naglie, G., Krahn, M. D., Naimark, D., Redelmeier, D. A. and Detsky, A. S. (1997) Primer on medical decision analysis: part 3 - estimating probabilities and utilities. Med. Decsn Makng, 17, 136-141.
75. Nam, I.-S., Mengersen, K. and Garthwaite, P. (2003) Multi-variate meta-analysis. Statist. Med., 22, 2309-2333.
76. National Institute for Clinical Excellence (2004) Guide to methods of technology appraisal (reference N0515).
77. National Institute for Clinical Excellence, London. (Available from http://www.cebm.net/levels_of_ evidence.asp.)
78. Palmer, S. and Smith, P. (2000) Incorporating option values into the economic evaluation of health care technologies. J. Hlth Econ., 19, 755-766.
79. Parmigiani, G. (2002) Modeling in Medical Decision Making. Chichester: Wiley.
80. Petitti, D. B. (2000) Meta-analysis, Decision Analysis, and Cost-effectiveness Analysis: Methods for Quantitative Synthesis in Medicine, 2nd edn. New York: Oxford University Press.
81. Peto, R. and Baigent, C. (1998) Trials: the next 50 years. Large scale randomised evidence of moderate benefits. Br. Med. J., 317, 1170.
82. Phillips, B., Ball, C., Sackett, D. L., Badenoch, D., Straus, S., Haynes, B. and Dawes, M. (2001) Levels of evidence and grades of recommendation. Oxford Centre for Evidence Based Medicine, Oxford. (Available from http://www.cebm.net/levels_of.evidence.asp.)
83. Phillips, C. (2001) The economics of more research is needed. Int. J. Epidem., 30, 71-776.
84. Poole, D. and Raftery, A. E. (2000) Inference for deterministic simulation models: the Bayesian melding approach. J. Am. Statist. Ass., 95, 1244-1255.
85. Prentice, R. L. (1989) Surrogate endpoints in clinical trials: definitions and operational criteria. Statist. Med., 16, 431-440.
86. Prévost, T. C., Abrams, K. R. and Jones, D. R. (2000) Hierarchical models in generalised synthesis of evidence: an example based on studies of breast cancer screening. Statist. Med., 19, 3359-3376.
87. Psaty, B. M., Weiss, N. M., Furberg, C. D., Koepsell, T. D., Siscovick, D. S., Rosendaal, F. R., Smith, N. L., Heckbert, S. R., Kaplan, R. L., Lin, D., Fleming, T. R. and Wagner, E. H. (1999) Surrogate end points, health outcomes, and the drug-approval process for the treatment of risk factors for cardiovascular disease. J. Am. Med. Ass., 282, 786-790.
88. Raftery, A. E., Givens, G. H. and Zeh, J. E. (1995) Inference from a deterministic population dynamics model for Bowhead whales (with discussion). J. Am. Statist. Ass., 90, 402-430.
89. Ratcliffe, J., Ades, A. E., Gibb, D., Sculpher, M. J. and Briggs, A. H. (1998) Prevention of mother-to-child transmission of HIV-1 infection: alternative strategies and their cost-effectiveness. AIDS, 12, 1381-1388.
90. Rubin, D. B. (1988) Using the SIR algorithm to simulate posterior distributions. In Bayesian Statistics 3 (eds J. M. Bernardo, J. O. Berger, M. H. De Groot, D. V. Lindley and A. F. M. Smith), pp. 395-402. Oxford: Clarendon.
91. Sackett, D. L. and Rosenberg, W. (1995) On the need for evidence-based medicine. Hlth Econ., 4, 249-254.
92. Sackett, D. L., Rosenberg, W., Gray, J., Haynes, R. B. and Richardson, W. (1996) Evidence based medicine: what it is and what it isn't. Br. Med. J., 312, 71-72.
93. Schlaifer, R. (1958) Probability and Statistics for Business Decisions. New York: McGraw-Hill.
94. Schweder, T. (1998) Fisherian or Bayesian methods of integrating diverse statistical information? Fish. Res., 37, 61-75.
95. Sculpher, M. J., Drummond, M. F. and Buxton, M. J. (1997) The iterative use of economic evaluation as part of the process of health technology assessment. J. Hlth Serv. Res. Poly, 2, 26-30.
96. Sharp, S. J. and Thompson, S. G. (2000) Analysing the relationship between treatment effect and underlying risk in meta-analysis: comparison and development of approaches. Statist. Med., 19, 3251-3274.
97. Smith, T. C., Spiegelhalter, D. J. and Thomas, S. L. (1995) Bayesian approaches to random-effects meta-analysis: a comparative study. Statut. Med., 14, 2685-2699.
98. Song, F., Altman, D., Glenny, M. A. and Deeks, J. (2003) Validity of indirect comparison for estimating efficacy of competing interventions: evidence from published meta-analyses. Br. Med. J., 326, 472-476.
99. Song, F., Eastwood, A. J., Gilbody, S. and Sutton, A. J. (2000) Publication and related biases. Hlth Technol. Assessmnt, 4, 1-115.
100. Spear, R. C. and Hornberger, G. M. (1980) Eutrophication in Peel Inlet - II, Identification of critical uncertainties via generalized sensitivity analysis. Wat. Res., 14, 43-49.
101. Spiegelhalter, D. J., Abrams, K. R. and Myles, J. (2004) Bayesian Approaches to Clinical Trials and Health-care Evaluation. New York: Wiley.
102. Spiegelhalter, D. J. and Best, N. G. (2003) Bayesian approaches to multiple sources of evidence and uncertainty in complex cost-effectiveness modelling. Statist. Med., 22, 3687-3709.
103. Sterne, J. A. C. and Davey Smith, G. (2001) Sifting the evidence - what's wrong with significance tests. Br. Med. J., 322, 226-231.
104. Sutton, A. J. and Abrams, E. J. (2001) Bayesian methods in meta-analysis and evidence synthesis. Statist. Meth. Med. Res., 10, 277-303.
105. Sutton, A., Abrams, K. and Jones, D. (2002) Generalised synthesis of evidence and the threat of publication bias: the example of electronic fetal heart rate monitoring (EFM). J. Clin. Epidem., 55, 1013-1024.
106. Sutton, A. J., Abrams, K. R., Jones, D. R., Sheldon, T. A. and Song, F. (2000) Methods for Meta-analysis in Medical Research. London: Wiley.
107. Thompson, K. M. and Evans, J. S. (1997) The value of improved national exposure information for perchloro-ethylene (Perc): a case study for dry cleaners. Risk Anal., 17, 253-271.
108. Thompson, S. G. and Sharp, S. J. (1999) Explaining heterogeneity in meta-analysis: a comparison of methods. Statist. Med., 18, 2693-2708.
109. Vanness, D. J. and Kim, W. R. (2002) Bayesian estimation, simulation, and uncertainty analysis: the cost-effectiveness of ganciclovir prophylaxis in liver transplantation. Hlth Econ., 11, 551-566.
110. Warn, D. E., Thompson, S. G. and Spiegelhalter, D. J. (2002) Bayesian random effects meta-analysis of trials with binary outcomes: method for absolute risk difference and relative risk scales. Statist. Med., 21, 1601-1623.
111. Welton, N. J. and Ades, A. E. (2005) A model of toxoplasmosis incidence in the UK: evidence synthesis and consistency of evidence. Appl. Statist., 54, 385-404.
112. Whitehead, A. (2002) Meta-analysis of Controlled Clinical Trials. Chichester: Wiley.
113. Wolpert, R. L. and Mengersen, K. (2005) Adjusted likelihoods for synthesizing empirical evidence from studies that differ in quality and design: effects of environmental tobacco smoke. Statist. Sci., to be published.