Evidence synthesis, economics and public policy

Research Synthesis Methods

Volumn 1, Issue 2, 2010, Pages 126-135

  Shemilt, Ian ^a   Mugford, Miranda ^a   Vale, Luke ^b   Marsh, Kevin ^c   Donaldson, Cam ^d   Drummond, Michael ^e  

^a UNIVERSITY OF EAST ANGLIA   (United Kingdom)

^b UNIVERSITY OF ABERDEEN   (United Kingdom)

^c Matrix Knowledge Group   (United Kingdom)

^d GLASGOW CALEDONIAN UNIVERSITY   (United Kingdom)

^e UNIVERSITY OF YORK   (United Kingdom)

Author keywords

decision making; Economics; evidence synthesis; public policy; systematic review

Indexed keywords

EID: 85147491785     PISSN: None     EISSN: 17592887     Source Type: Journal    
DOI: 10.1002/jrsm.14     Document Type: Article

References (103)

1. Cooper H, Hedges LV (eds). The Handbook of Research Synthesis. Russell Sage Foundation: New York, 1994.
2. Centre for Reviews and Dissemination. Systematic Reviews: CRD's Guidance for Undertaking Reviews in Health Care. Centre for Reviews and Dissemination: York, 2009.
3. Higgins JPT, Green S (eds). Cochrane Handbook for Systematic Reviews of Interventions. Wiley: Chichester, 2008.
4. Shemilt I, Mugford M, Vale L, Marsh K, Donaldson C (eds). Evidence-based Decisions and Economics: Health Care, Social Welfare, Education and Criminal Justice. Wiley-Blackwell: Oxford, 2010.
5. Briggs A, Sculpher M, Claxton K. Decision Modelling for Health Economic Evaluation. Oxford University Press: Oxford, 2006.
6. Marsh K. The role of review and synthesis methods in decision models. In Evidence-based Decisions and Economics: Health Care, Social Welfare, Education and Criminal Justice, Shemilt I, Mugford M, Vale L, Marsh K, Donaldson C (eds). Wiley-Blackwell: Oxford, 2010; 8–22.
7. Drummond M, Iglesias C, Cooper NJ. Systematic reviews and economic evaluations conducted for the National Institute for Health and Clinical Excellence in the United Kingdom: a game of two halves? International Journal of Technology Assessment in Health Care 2008; 24:146–150.
8. Glanville J, Paisley S. Searching for evidence for cost-effectiveness decisions. In Evidence-based Decisions and Economics: Health Care, Social Welfare, Education and Criminal Justice, Shemilt I, Mugford M, Vale L, Marsh K, Donaldson C (eds). Wiley-Blackwell: Oxford, 2010; 79–92.
9. Lefebvre C, Manheimer E, Glanville J. Searching for studies. In Cochrane Handbook for Systematic Reviews of Interventions, Higgins JPT, Green S (eds). Wiley: Chichester, 2008; 95–150.
10. Petticrew M, Roberts H. How to find the studies: the literature search. In Systematic Reviews in the Social Sciences: A Practical Guide, Petticrew M, Roberts H (eds). Blackwell Publishing: Oxford, 2006.
11. Centre for Reviews and Dissemination. NHS Economic Evaluation Database. Centre for Reviews and Dissemination: York, 2010. Available from: www.crd.york.ac.uk/crdweb.
12. HEED: Health Economics Evaluation Database. Wiley Interscience: Chichester, 2010. Available from: http://heed.wiley.com.
13. Centre for Evaluation of Value and Risk in Health. Cost-Effectiveness Analysis Registry. Tufts Medical Center: Boston, 2010. Available from: https://research.tufts-nemc.org/cear/default.aspx.
14. Collège des Économistes de la Santé. CODECS. Collège des Économistes de la Santé: Paris, 2010. Available from: http://infodoc.inserm.fr/codecs/codecsanglais.nsf.
15. Hospital for Sick Children. Paediatric Economic Database Evaluation. Hospital for Sick Children: Toronto, 2010. Available from: http://pede.bioinfo.sickkids.on.ca/pede/index.jsp.
16. InterTASC Information Specialists Subgroup. Search Filter Resource: Economic Evaluations. InterTASC Information Specialists Subgroup, 2010. Available from: www.york.ac.uk/inst/crd/intertasc/econ.htm.
17. Sargent R. Validation and verification of simulation models. In Proceedings of the 2004 Winter Simulation Conference, Ingalls R, Rossetti M, Smith J, Peters B (eds), Washington, 2004.
18. Brazier JE, Papaioannou D, Cantrell A, Paisley S, Herrmann KH. Identifying and reviewing health state utility values for populating decision models. In Evidence-based Decisions and Economics: Health Care, Social Welfare, Education and Criminal Justice, Shemilt I, Mugford M, Vale L, Marsh K, Donaldson C (eds). Wiley-Blackwell: Oxford, 2010; 93–105.
19. Cooper N, Coyle D, Abrams K, Mugford M, Sutton A. Use of evidence in decision models: an appraisal of health technology assessments in the U.K. since 1997. Journal of Health Services Research and Policy 2005; 10(4):245–250.
20. Coyle D, Lee KM, Cooper NJ. Use of evidence in decision models. In Evidence-based Decisions and Economics: Health Care, Social Welfare, Education and Criminal Justice, Shemilt I, Mugford M, Vale L, Marsh K, Donaldson C (eds). Wiley-Blackwell: Oxford, 2010; 106–113.
21. Shemilt I, Mugford M, Byford S, Drummond M, Eisenstein E, Knapp M, Mallender J, McDaid D, Vale L, Walker D. Incorporating economics evidence. In Cochrane Handbook for Systematic Reviews of Interventions, Higgins JPT, Green S (eds). Wiley: Chichester, 2008; 449–479.
22. Sterne JAC, Egger M, Moher D (eds). Addressing reporting biases. In Cochrane Handbook for Systematic Reviews of Interventions, Higgins JPT, Green S (eds). Wiley: Chichester, 2008; 297–333.
23. Gilbody S, Bower P, Sutton AJ. Randomized trials with concurrent economic evaluations reported unrepresentatively large clinical effect sizes. Journal of Clinical Epidemiology 2007; 60(8):781–786.
24. Stanley TD. Meta-regression models of economics and medical research. In Evidence-based Decisions and Economics: Health Care, Social Welfare, Education and Criminal Justice, Shemilt I, Mugford M, Vale L, Marsh K, Donaldson C (eds). Wiley-Blackwell: Oxford, 2010; 134–145.
25. Canadian Task Force on the Periodic Health Examination. The periodic health examination. Canadian Medical Association Journal 1979; 121(9):1193–1254.
26. Field MJ, Lohr KN (eds). Guidelines for Clinical Practice: From Development to Use. Institute of Medicine: Washington, 1992.
27. GRADE Working Group. Grading quality of evidence and strength of recommendations. British Medical Journal 2004; 328(7454):1490–1499.
28. Guyatt GH, Oxman AD, Vist G, Kunz R, Falck-Ytter Y, Alonso-Coello P, Schünemann HJ, for the GRADE Working Group. Rating quality of evidence and strength of recommendations GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. British Medical Journal 2008; 336:924–926.
29. Guyatt GH, Oxman AD, Kunz R, Vist GE, Brozek J, Alonso-Coello P, Montori VM, Djulbegovic B, Atkins D, Falck-Ytter Y, Williams JW, Norris S, Akl E, Schünemann HJ. GRADE guidelines: 4. Rating the quality of evidence study limitations (risk of bias) and publication bias. Journal of Clinical Epidemiology, in press.
30. Guyatt GH, Oxman AD, Kunz R, Brozek J, Devereaux PJ, Alonso-Coello P, Montori VM, Freyschuss B, Vist GE, Jaeschke R, Rind D, Williams JW, Murad MH, Falck-Ytter Y, Meerpohl J, Whittington C, Schünemann HJ. GRADE guidelines: 5. Rating the quality of evidence—Imprecision. Journal of Clinical Epidemiology, in press.
31. Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, Alonso-Coello P, Glasziou P, Jaeschke R, Akl E, Norris S, Vist GE, Dahm P, Higgins JPT, Schünemann HJ. GRADE guidelines: 6. Rating the quality of evidence—Inconsistency. Journal of Clinical Epidemiology, in press.
32. Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, Alonso-Coello P, Glasziou P, Jaeschke R, Vist GE, Akl E, Norris S, Higgins JPT, Meerpohl J, Schünemann HJ. GRADE guidelines: 7. Rating the quality of evidence—Indirectness. Journal of Clinical Epidemiology, in press.
33. Brunetti M, Ruiz F, Lord J, Pregno S, Oxman AD. Grading economic evidence. In Evidence-based Decisions and Economics: Health Care, Social Welfare, Education and Criminal Justice, Shemilt I, Mugford M, Vale L, Marsh K, Donaldson C (eds). Wiley-Blackwell: Oxford, 2010; 114–133.
34. Brunetti M, Shemilt I, Oxman AD, Pregno S, Lord J, Vale L, Sisk J, Ruiz F, Hill S, Guyatt GH, Jaeschke R, Helfand M, Harbour R, Schünemann HJ. GRADE guidelines: 11. Special challenges—Quality of evidence for resource use. Journal of Clinical Epidemiology, in press.
35. Coyle D, Lee KM. The problem of protocol driven costs in pharmacoeconomic analysis. Pharmacoeconomics 1998; 14(4):357–363.
36. Glick HA, Doshi JA, Sonnad SS, Polsky D. Economic Evaluation in Clinical Trials. Oxford University Press: Oxford, 2007.
37. Drummond MF, Sculpher MJ, Torrance GW, O'Brien BJ, Stoddart GL. Methods for the Economic Evaluation of Health Care Programmes (3rd edn). Oxford University Press: Oxford, 2005.
38. Wilson E, Abrams K. From evidence-based economics to economics-based medicine: using systematic review to inform the design of future research. In Evidence-based Decisions and Economics: Health Care, Social Welfare, Education and Criminal Justice, Shemilt I, Mugford M, Vale L, Marsh K, Donaldson C (eds). Wiley-Blackwell: Oxford, 2010; 146–161.
39. Walker DG, Teerawattananon Y, Anderson R, Richardson G. Generalisability, transferability, complexity and relevance. In Evidence-based Decisions and Economics: Health Care, Social Welfare, Education and Criminal Justice, Shemilt I, Mugford M, Vale L, Marsh K, Donaldson C (eds). Wiley-Blackwell: Oxford, 2010; 56–66.
40. Anderson R, Shemilt I. The role of economic perspectives and evidence in systematic review. In Evidence-based Decisions and Economics: Health Care, Social Welfare, Education and Criminal Justice, Shemilt I, Mugford M, Vale L, Marsh K, Donaldson C (eds). Wiley-Blackwell: Oxford, 2010; 23–42.
41. Drummond M, Pang F. Transferability of economic evaluation results. In Economic Evaluation in Health Care: Merging Theory with Practice, Drummond M, McGuire A (eds). Oxford University Press: Oxford, 2001.
42. Sculpher MJ, Pang FS, Manca A, Drummond MF, Golder S, Urdahl H, Davies LM, Eastwood A. Generalisability in economic evaluation studies in healthcare: a review and case studies. Health Technology Assessment 2004; 8(49):1–192.
43. Welte R, Feenstra T, Jager H, Leidl R. A decision chart for assessing and improving the transferability of economic evaluation results between countries. Pharmacoeconomics 2004; 22(13):857–876.
44. Sculpher M, Drummond M. Analysis sans frontiers: can we ever make economic evaluations generalisable across jurisdictions? Pharmacoeconomics 2006; 24(11):1087–1099.
45. Goeree R, Burke N, O'Reilly D, Blackhouse G, Tarride J-E. Transferability of economic evaluations: approaches and factors to consider when using results from one geographic area for another. Current Medical Research and Opinion 2007; 23(4):671–682.
46. Craig N, Sutton M. Opportunity costs on trial: new options for encouraging implementation of results from economic evaluations. In Getting Research Findings into Practice, Donald A, Haines A (eds). BMJ Books: London, 1998.
47. Shiell A, Hawe P, Gold L. Complex interventions or complex systems? Implications for health economic evaluation. British Medical Journal 2008; 336(7656):1281–1283.
48. Birch S. As a matter of fact: evidence-based decision-making unplugged. Health Economics 1997; 6(6):547–559.
49. Birch S, Gafni A. Economics and the evaluation of health care programmes: generalisability of methods and implications for generalisability of results. Health Policy 2003; 64(2):207–219.
50. Kraemer HC, Frank E, Kupfer DJ. Moderators of treatment outcomes: clinical, research, and policy importance. Journal of the American Medical Association 2006; 296(10):1286–1289.
51. Kravitz R, Duan N, Braslow J. Evidence-based medicine, heterogeneity of treatment effects, and the trouble with averages. Milbank Quarterly 2004; 82(4):661–687.
52. Menzin J, Oster G, Davies L, Drummond MF, Greiner W, Lucioni C, Merot JL, Rossi F, vd Schulenburg JG, Souêtre E. A multinational economic evaluation of rhDNase in the treatment of cystic fibrosis. International Journal of Technology Assessment in Healthcare 1996; 12(1):52–61.
53. Jonsson B, Weinstein MC. Economic evaluation alongside multinational clinical trials. Study considerations for GUSTO IIb. International Journal of Technology Assessment in Healthcare 1997; 13(1):49–58.
54. Cook JR, Drummond M, Glick H, Heyse JF. Assessing the appropriateness of combining economic data from multinational clinical trials. Statistics in Medicine 2003; 22(12):1955–1976.
55. Drummond M, Manca A, Sculpher M. Increasing the generalisability of economic evaluations: recommendations for the design, analysis, and reporting of studies. International Journal of Technology Assessment in Healthcare 2005; 21(2):165–171.
56. Manca A, Rice N, Sculpher MJ, Briggs AH. Assessing generalisability by location in trial-based cost-effectiveness analysis: the use of multilevel models. Health Economics 2005; 14(5):471–485.
57. Manca A, Willan AR. Lost in translation: accounting for between-country differences in the analysis of multinational cost-effectiveness data. Pharmacoeconomics 2006; 24(11):1101–1119.
58. Grieve R, Nixon R, Thompson S, Cairns J. Multilevel models for estimating incremental net benefit in multinational studies. Health Economics 2007; 16(8):815–826.
59. Drummond M, Barbieri M, Cook J, Glick H, Lis J, Malik F, Reed S, Rutten F, Sculpher M, Severens J. Transferability of economic evaluations across jurisdictions: ISPOR Good Practices Task Force report. Value in Health 2009; 12:409–418.
60. Kumaranayake L. The real and the nominal? Making inflationary adjustments to cost and other economic data. Health Policy and Planning 2000; 15(2):230–234.
61. Wordsworth S, Ludbrook A. Comparing costing results in across country economic evaluations: the use of technology specific purchasing power parities. Health Economics 2005; 14(1):93–99.
62. Busse R, Schreyögg J, Smith PC. Variability in healthcare treatment costs amongst nine EU countries—Results from the HealthBASKET project. Health Economics 2008; 17(Suppl. 1):S1–S8.
63. Schreyögg J, Tiemann O, Stargardt T, Busse R. Cross-country comparisons of costs: the use of episode-specific transitive purchasing power parities with standardised cost categories. Health Economics 2008; 17(Suppl. 1):S95–S103.
64. Shemilt I, Thomas J, Morciano M. A web-based tool for adjusting costs to a specific target currency and price year. Evidence and Policy 2010; 6(1):51–59.
65. Peasgood T, Herrmann K, Kanis JA, Brazier JE. An updated systematic review of Health State Utility Values for osteoporosis related conditions. Osteoporosis International 2009; 20(6):853–868.
66. Tengs TO, Lin TH. A meta-analysis of utility estimates for HIV/AIDS. Medical Decision Making 2002; 22(6):475–481.
67. Bremner KE, Chong CAKY, Tomlinson G, Alibhai SMH, Krahn MD. A review and meta-analysis of prostate cancer utilities. Medical Decision Making 2007; 27(3):288–298.
68. Peasgood T, Brazier JE. A review of utility values in breast cancer. Health Economics and Decision Science Discussion Paper 07/09, University of Sheffield, Sheffield, 2009. Available from: http://www.shef.ac.uk/scharr/sections/heds/discussion.html.
69. Anderson R. Systematic reviews of economic evaluations: utility or futility? Health Economics 2010; 19:350–364.
70. Drummond M. Evidence-based decisions and economics: an agenda for research. In Evidence-based Decisions and Economics: Health Care, Social Welfare, Education and Criminal Justice, Shemilt I, Mugford M, Vale L, Marsh K, Donaldson C (eds). Wiley-Blackwell: Oxford, 2010; 179–185.
71. Bower P, Byford S, Barber J, Beecham J, Simpson S, Friedli K, Corney R, King M, Harvey I. Meta-analysis of data on costs from trials of counselling in primary care: using individual patient data to overcome sample size limitations in economic analyses. British Medical Journal 2003; 326(7401):1247–1252.
72. Shemilt I, Mugford M, Byford S, Drummond M, Eisenstein E, Knapp M, Mallender J, Marsh K, McDaid D, Vale L, Walker D. Campbell Collaboration Methods Policy Brief: Economics Methods. The Campbell Collaboration: Oslo, 2008.
73. Centre for Reviews and Dissemination. Systematic Reviews of Economic Evaluations. Systematic Reviews: CRD's Guidance for Undertaking Reviews in Health Care. Centre for Reviews and Dissemination: York, 2009.
74. Sefton TAJ, Byford S, McDaid D, Hills J, Knapp M. Making the Most of It. Economic Evaluation in the Social Welfare Field. Joseph Rowntree Foundation: York, 2002.
75. Marsh K. Economic evaluation of criminal justice interventions: a methodological review of the recent literature. In Cost-Benefit Analysis of Criminal Justice Interventions, Dunworth T, Marsh K, Roman J, Mallender J (eds). Urban Institute Press: Washington, D.C., 2010.
76. Lessard C, Birch S. Complex problems or simple solutions? Enhancing evidence-based economics to reflect reality. In Evidence-based Decisions and Economics: Health Care, Social Welfare, Education and Criminal Justice, Shemilt I, Mugford M, Vale L, Marsh K, Donaldson C (eds). Wiley-Blackwell: Oxford, 2010; 162–172.
77. Pawson R. Evidence-based policy: the promise of ‘realist synthesis’. Evaluation 2002; 8(3):340–358.
78. Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review—A new method of systematic review designed for complex policy interventions. Journal of Health Services Research and Policy 2005; 10(Suppl. 1):S1:21–S1:34.
79. Pawson R. Evidence-based Policy: A Realist Perspective. Sage Publications: London, 2006.
80. Deeks JJ, Higgins JPT, Altman DG. Analysing data and undertaking meta-analyses. In Cochrane Handbook for Systematic Reviews of Interventions, Higgins JPT, Green S (eds). Wiley: Chichester, 2008; 243–296.
81. Vale L. Evidence-based decisions and economics: lessons for practice. In Evidence-based Decisions and Economics: Health Care, Social Welfare, Education and Criminal Justice, Shemilt I, Mugford M, Vale L, Marsh K, Donaldson C (eds). Wiley-Blackwell: Oxford, 2010; 173–178.
82. Byford S, Barrett B, Dubourg R, Francis J, Sisk J. The role of economic evidence in formulation of public policy and practice. In Evidence-based Decisions and Economics: Health Care, Social Welfare, Education and Criminal Justice, Shemilt I, Mugford M, Vale L, Marsh K, Donaldson C (eds). Wiley-Blackwell: Oxford, 2010; 43–55.
83. Tan-Torres Edejer T, Baltussen RMPM, Adam T, Hutubessy RCW, Acharya A, Evans DB, Murray CJL. Making Choices in Health: WHO Guide to Cost-Effectiveness Analysis. World Health Organization: Geneva, 2003.
84. Treasury HM. The Green Book: Appraisal and Evaluation in Central Government. The Stationery Office: London, 2003.
85. Hjelmgren J, Berggren F, Andersson F. Health economic guidelines—Similarities, differences and some implications. Value in Health 2001; 4(3):225–250.
86. Williams A. The cost–benefit approach. British Medical Bulletin 1974; 30(3):252–256.
87. Drummond MF. Principles of Economic Appraisal in Healthcare. Oxford Medical Publications: Oxford, 1980.
88. National Institute for Clinical Excellence, Revised Guidelines for Manufacturers, Sponsors of Technologies: Making Submissions to the Institute. National Institute for Clinical Excellence: London, 2001.
89. National Institute for Health and Clinical Excellence. Guide to the Methods of Technology Appraisal. National Institute for Health and Clinical Excellence: London, 2008.
90. National Institute for Health and Clinical Excellence, Methods for the Development of NICE Public Health Guidance (2nd edn). National Institute for Health and Clinical Excellence: London, 2009.
91. Anderson GF, Frogner BK. Health spending in OECD countries: obtaining value per dollar. Health Affairs 2008; 27(6):1718–1727.
92. Oakley A. Experiments in Knowing: Gender and Method in the Social Sciences. Polity Books: Oxford, 2000.
93. Tarn Y-H, Hu S, Kamae I, Yang B-M, Li S-C, Tangcharoensathien V, Teerawattananon Y, Limwattananon S, Hameed A, Aljunid SM, Bapna JS. Health-care systems and pharmacoeconomic research in Asia-Pacific region. Value in Health 2008; 11(Suppl. 1):S137–S155.
94. Teerawattananon Y, Chaikledkaew U. Thai health technology assessment guideline development. Journal of the Medical Association of Thailand 2008; 91(Suppl. 2):11–15.
95. Iglesias CP, Drummond MF. Healthcare decision-making processes in Latin America: problems and prospects for the use of economic evaluation. International Journal of Health Technology Assessment in Healthcare 2005; 21(1):1–14.
96. Roman J. Can cost-benefit analysis answer criminal justice policy questions, and if so, how? Journal of Contemporary Criminal Justice 2004; 20(3):257–275.
97. Swaray RB, Bowles R, Pradiptyo R. The application of economic analysis to criminal justice interventions: a review of the literature. Criminal Justice and Policy Review 2005; 16(2):141–163.
98. Francis J. SCIE's Approach to Economic Evaluation in Social Care. Social Care Institute for Excellence: London, 2010.
99. Williams A. Health economics: the cheerful face of a dismal science. In Health and Economics, Williams A (ed.). Macmillan: London, 1987.
100. McDaid D, Sassi F. Equity, efficiency and research synthesis. In Evidence-based Decisions and Economics: Health Care, Social Welfare, Education and Criminal Justice, Shemilt I, Mugford M, Vale L, Marsh K, Donaldson C (eds). Wiley-Blackwell: Oxford, 2010; 67–78.
101. Sassi F, Archard L, Le Grand J. Equity and the economic evaluation of healthcare. Health Technology Assessment 2001; 5(3):1–138.
102. Cookson R, Drummond M, Weatherly H. Explicit incorporation of equity considerations into economic evaluation of public health interventions. Health Economics, Policy and Law 2009; 4(3):231–245.
103. Mugford M, Shemilt I, Vale L, Marsh K, Donaldson C, Mallender J. From effectiveness to efficiency? An introduction to evidence-based decisions and economics for health care, social welfare, education and criminal justice. In Evidence-based Decisions and Economics: Health Care, Social Welfare, Education and Criminal Justice, Shemilt I, Mugford M, Vale L, Marsh K, Donaldson C (eds). Wiley-Blackwell: Oxford, 2010; 67–78.