Risk of bias in trial-based economic evaluations: Identification of sources and bias-reducing strategies

Psychology and Health

Volumn 30, Issue 1, 2015, Pages 52-71

  Evers, Silvia M A A ^a,b   Hiligsmann, Mickaël ^a   Adarkwah, Charles Christian ^a,c  

^a MAASTRICHT UNIVERSITY   (Netherlands)

^b NETHERLANDS INSTITUTE OF MENTAL HEALTH AND ADDICTION   (Netherlands)

^c PHILIPPS UNIVERSITY MARBURG   (Germany)

Author keywords

bias; bias reducing strategies; cost and outcomes; economic evaluation; systematic error

Indexed keywords

COST BENEFIT ANALYSIS; ECONOMICS; HUMAN; PROCEDURES; RANDOMIZED CONTROLLED TRIAL (TOPIC); RISK; STATISTICAL BIAS;

BIAS (EPIDEMIOLOGY); COST-BENEFIT ANALYSIS; HUMANS; RANDOMIZED CONTROLLED TRIALS AS TOPIC; RISK;

EID: 84918534711     PISSN: 08870446     EISSN: 14768321     Source Type: Journal    
DOI: 10.1080/08870446.2014.953532     Document Type: Article

References (73)

1. Alayli-Goebbels, A. F., Evers, S. M., Alexeeva, D., Ament, A. J., de Vries, N. K., Tilly, J. C., & Severens, J. L. (2014). A review of economic evaluations of behavior change interventions: Setting an agenda for research methods and practice. Journal of Public Health, 36, 336–344. doi:10.1093/pubmed/fdt080
2. Alton, V., Eckerlund, I., & Norlund, A. (2006). Health economic evaluations: How to find them. International Journal of Technology Assessment in Health Care, 22, 512–517. doi:10.1017/S0266462306051452
3. Ament, A., Evers, S., & Baltussen, R. (2000). The usefulness of ratios for allocation decisions: The case of stroke. Cerebrovascular Diseases, 10, 283–288. doi:10.1159/00001607110.1159/000016071
4. Ayling, K., Brierley, S., Johnson, B., Heller, S., & Eiser, C. (2015). How standard is standard care? Exploring control group outcomes in behaviour change interventions for young people with type 1 diabetes. Psychology & Health, 30(1), 85–103.
5. Azimi, N. A., & Welch, H. G. (1998). The effectiveness of cost-effectiveness analysis in containing costs. Journal of General Internal Medicine, 13, 664–669.10.1046/j.1525-1497.1998.00201.x
6. Baker, C. B., Johnsrud, M. T., Crismon, M. L., Rosenheck, R. A., & Woods, S. W. (2003). Quantitative analysis of sponsorship bias in economic studies of antidepressants. The British Journal of Psychiatry, 183, 498–506.10.1192/bjp.183.6.498
7. Barnes, R., & Heaton, A. (1999). Panel 6: Addressing questions of bias, credibility, and quality in health economic evaluations. Value in Health, 2, 99–102. doi:10.1046/j.1524-4733.1999.02207.x10.1046/j.1524-4733.1999.02207.x
8. Bell, C. M., Urbach, D. R., Ray, J. G., Bayoumi, A., Rosen, A. B., Greenberg, D., & Neumann, P. J. (2006). Bias in published cost effectiveness studies: Systematic review. British Medical Journal, 332, 699–703. doi: 10.1136/bmj.38737.607558.8010.1136/bmj.38737.607558.80
9. Berger, M. L. (1995). Design of prospective cost-effectiveness clinical trials: The critical role of the comparator group. Drug Information Journal, 29, 1415–1420.
10. Bero, L. A., & Rennie, D. (1996). Influences on the quality of published drug studies. International Journal of Technology Assessment in Health Care, 12, 209–237.10.1017/S0266462300009582
11. Bishop, F. L., Fenge-Davies, A. L., Kirby, S., & Geraghty, A. W. A. (2015). Context effects and behaviour change techniques in randomized trials: A systematic review using the example of trials to increase adherence to physical activity in musculoskeletal pain. Psychology & Health, 30(1), 104–121.
12. Bonneux, L., & Birnie, E. (2001). The discount rate in the economic evaluation of prevention: A thought experiment. Journal of Epidemiology and Community Health, 55, 123–125.10.1136/jech.55.2.123
13. Brazier, J. E., Harper, R., Jones, N. M., O’Cathain, A., Thomas, K. J., Usherwood, T., & Westlake, L. (1992). Validating the SF-36 health survey questionnaire: New outcome measure for primary care. British Medical Journal, 305, 160–164.10.1136/bmj.305.6846.160
14. Brazier, J., Roberts, J., & Deverill, M. (2002). The estimation of a preference-based measure of health from the SF-36. Journal of Health Economics, 21, 271–292.10.1016/S0167-6296(01)00130-8
15. Brennan, A., & Akehurst, R. (2000). Modelling in health economic evaluation. What is its place? What is its value? PharmacoEconomics, 17, 445–459.10.2165/00019053-200017050-00004
16. Briggs, A., Sculpher, M., & Buxton, M. (1994). Uncertainty in the economic evaluation of health care technologies: The role of sensitivity analysis. Health Economics, 3, 95–104.10.1002/(ISSN)1099-1050
17. Brouwer, W. B., Niessen, L. W., Postma, M. J., & Rutten, F. F. (2005). Need for differential discounting of costs and health effects in cost effectiveness analyses. British Medical Journal, 331, 446–448. doi:10.1136/bmj.331.7514.44610.1136/bmj.331.7514.446
18. Brown, G. W. (1947). On small-sample estimation. The Annals of Mathematical Statistics, 18, 582–585.10.1214/aoms/1177730349
19. Cain, D. M., & Detsky, A. S. (2008). Everyone’s a little bit biased (even physicians). The Journal of the American Medical Association, 299, 2893–2895. doi:10.1001/jama.299.24.289310.1001/jama.299.24.2893
20. Cain, D. M., Loewenstein, G., & Moore, D. A. (2005). The dirt on coming clean: Perverse effects of disclosing conflicts of interest. The Journal of Legal Studies, 34, 1–25. doi:10.1086/42669910.1086/426699
21. de Bruin, M. (2015). Risk of bias in randomised controlled trials of health behaviour change interventions: Evidence, practices and challenges. Psychology & Health, 30(1), 1–7.
22. de Bruin, M., Viechtbauer, W., Hospers, H. J., Schaalma, H. P., & Kok, G. (2009). Standard care quality determines treatment outcomes in control groups of HAART-adherence intervention studies: Implications for the interpretation and comparison of intervention effects. Health Psychology, 28, 668–674. doi:10.1037/a001598910.1037/a0015989
23. de Bruin, M., Viechtbauer, W., Schaalma, H. P., Kok, G., Abraham, C., & Hospers, H. J. (2010). Standard care impact on effects of highly active antiretroviral therapy adherence interventions: A meta-analysis of randomized controlled trials. Archives of Internal Medicine, 170, 240–250. doi:10.1001/archinternmed.2009.53610.1001/archinternmed.2009.536
24. Detsky, A. S. (2006). Sources of bias for authors of clinical practice guidelines. Canadian Medical Association Journal, 175, 1033–1035. doi:10.1503/cmaj.061181
25. Dolan, P. (1997). Modeling valuations for EuroQol health states. Medical Care, 35, 1095–1108.10.1097/00005650-199711000-00002
26. Drost, R., Paulus, A., Ruwaard, D., & Evers, S. (2013). Inter-sectoral costs and benefits of mental health prevention: Towards a new classification scheme. Journal of Mental Health Policy and Economics, 16, 179–186.
27. Drummond, M. (1991). Economic evaluation of Pharamaceuticals: Science or marketing? (Discussion paper 91.) York: Centre for Health Economics, Health Economics Consortoum.
28. Drummond, M. F., & McGuire, A. (2010). Economic evaluation in health care: Merging theory with practice. Oxford: Oxford University Press.
29. Drummond, M., & Sculpher, M. (2005). Common methodological flaws in economic evaluations. Medical Care, 43, 5–14.
30. Drummond, M. F., Sculpher, M. J., Torrance, G. W., O’Brien, B. J., & Stoddart, G. L. (2005). Methods for the economic evaluation of health care programmes (3rd ed.). New York, NY: Oxford University Press.
31. Eble, A., Boone, P., & Elbourne, D. (2013). Risk and evidence of bias in randomized controlled trials in economics. (CEP Discussion Paper No 1240.) Retrieved from http://cep.lse.ac.uk/pubs/download/dp1240.pdf
32. Eichler, H. G., Kong, S. X., Gerth, W. C., Mavros, P., & Jönsson, B. (2004). Use of cost-effectiveness analysis in health-care resource allocation decision-making: How are cost-effectiveness thresholds expected to emerge? Value in Health, 7, 518–528. doi:10.1111/j.1524-4733.2004.75003.x10.1111/j.1524-4733.2004.75003.x
33. Evers, S., Goossens, M., de Vet, H., van Tulder, M., & Ament, A. (2005). Criteria list for assessment of methodological quality of economic evaluations: Consensus on health economic criteria. International Journal of Technology Assessment in Health Care, 21, 240–245.
34. Evers, S., Salvador-Carulla, L., Halsteinli, V., McDaid, D., & The MHEEN Group. (2007). Implementing mental health economic evaluation evidence: Building a bridge between theory and practice. Journal of Mental Health, 16, 223–241.
35. Finkler, S. A. (1982). The distinction between cost and charges. Annals of Internal Medicine, 96, 102–109.10.7326/0003-4819-96-1-102
36. Friedberg, M., Saffran, B., Stinson, T. J., Nelson, W., & Bennett, C. L. (1999). Evaluation of conflict of interest in economic analyses of new drugs used in oncology. The Journal of the American Medical Association, 282, 1453–1457.10.1001/jama.282.15.1453
37. Garattini, L., Koleva, D., & Casadei, G. (2010). Modeling in pharmacoeconomic studies: Funding sources and outcomes. International Journal of Technology Assessment in Health Care, 26, 330–333. doi:10.1017/S026646231000032210.1017/S0266462310000322
38. Goossens, M. E., Rutten-van Molken, M. P., Vlaeyen, J. W., & van der Linden, S. M. (2000). The cost diary. Journal of Clinical Epidemiology, 53, 688–695.10.1016/S0895-4356(99)00177-8
39. Hendriks, M. R., Al, M. J., Bleijlevens, M. H., van Haastregt, J. C., Crebolder, H. F., van Eijk, J. T., & Evers, S. M. (2013). Continuous versus intermittent data collection of health care utilization. Medical Decision Making, 33, 998–1008. doi:10.1177/0272989X13482045
40. Higgins, J. P., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., … Cochrane Statistical Methods Group. (2011). The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. British Medical Journal, 343, d5928. doi: 10.1136/bmj.d592810.1136/bmj.d5928
41. Higgins, J. P., & Green, S. (2011). Cochrane handbook for systematic reviews of interventions version 5.1.0 [updated March 2011]. The Cochrane Collaboration. Retrieved from www.cochrane-handbook.org
42. Hill, S. R., Mitchell, A. S., & Henry, D. A. (2000). Problems with the interpretation of pharmacoeconomic analyses: A review of submissions to the Australian Pharmaceutical Benefits Scheme. The Journal of the American Medical Association, 283, 2116–2121.10.1001/jama.283.16.2116
43. Hillman, A. L., Eisenberg, J. M., Pauly, M. V., Bloom, B. S., Glick, H., Kinosian, B., & Schwartz, J. S. (1991). Avoiding bias in the conduct and reporting of cost-effectiveness research sponsored by pharmaceutical companies. New England Journal of Medicine, 324, 1362–1365. doi:10.1056/NEJM19910509324191110.1056/NEJM199105093241911
44. Hillman, A. L., & Kim, M. S. (1995). Economic decision making in healthcare. A standard approach to discounting health outcomes. PharmacoEconomics, 7, 198–205.10.2165/00019053-199507030-00003
45. Husereau, D., Drummond, M., Petrou, S., Carswell, C., Moher, D., Greenberg, D., … Force, Ispor Health Economic Evaluation Publication Guidelines-CHEERS Good Reporting Practices Task. (2013). Consolidated health economic evaluation reporting standards (CHEERS) – Explanation and elaboration: A report of the ISPOR health economic evaluation publication guidelines good reporting practices task force. Value in Health, 16, 231–250. doi:10.1016/j.jval.2013.02.00210.1016/j.jval.2013.02.002
46. Jacobs, P., & Baladi, J. F. (1996). Biases in cost measurement for economic evaluation studies in health care. Health Economics, 5, 525–529. doi:10.1002/(SICI)1099-1050(199611)5:6<525:AID-HEC233>3.0.CO;2-E10.1002/(ISSN)1099-1050
47. Johannesson, M. (1997). Avoiding double-counting in pharmacoeconomic studies. PharmacoEconomics, 11, 385–388.10.2165/00019053-199711050-00001
48. John-Baptiste, A., & Bell, C. (2010). Industry sponsored bias in cost effectiveness analyses. British Medical Journal, 341, c5350. doi:10.1136/bmj.c535010.1136/bmj.c5350
49. Jönsson, B. (2009). Ten arguments for a societal perspective in the economic evaluation of medical innovations. The European Journal of Health Economics, 10, 357–359. doi:10.1007/s10198-009-0173-210.1007/s10198-009-0173-2
50. Karlsson, G., & Johannesson, M. (1996). The decision rules of cost-effectiveness analysis. PharmacoEconomics, 9, 113–120.10.2165/00019053-199609020-00003
51. Katz, D. A., & Welch, H. G. (1993). Discounting in cost-effectiveness analysis of healthcare programmes. PharmacoEconomics, 3, 276–285.10.2165/00019053-199303040-00004
52. Knies, S., Severens, J. L., Ament, A. J., & Evers, S. M. (2010). The transferability of valuing lost productivity across jurisdictions. Differences between national pharmacoeconomic guidelines. Value in Health, 13, 519–527. doi:10.1111/j.1524-4733.2010.00699.x10.1111/j.1524-4733.2010.00699.x
53. Lamoureux, E. L., Chou, S. L., Larizza, M. F., & Keeffe, J. E. (2006). The reliability of data collection periods of personal costs associated with vision impairment. Ophthalmic Epidemiology, 13, 121–126. doi:10.1080/0928658050053678110.1080/09286580500536781
54. Lexchin, J., Bero, L. A., Djulbegovic, B., & Clark, O. (2003). Pharmaceutical industry sponsorship and research outcome and quality: Systematic review. British Medical Journal, 326, 1167–1170. doi:10.1136/bmj.326.7400.116710.1136/bmj.326.7400.1167
55. Luce, B. R., & Elixhauser, A. (1990). Estimating Costs in the economic evaluation of medical technologies. International Journal of Technology Assessment in Health Care, 6, 57–75.10.1017/S026646230000893X
56. Matthews, G. A., Dumville, J. C., Hewitt, C. E., & Torgerson, D. J. (2011). Retrospective cohort study highlighted outcome reporting bias in UK publicly funded trials. Journal of Clinical Epidemiology, 64, 1317–1324. doi:10.1016/j.jclinepi.2011.03.01310.1016/j.jclinepi.2011.03.013
57. Miners, A. H., Garau, M., Fidan, D., & Fischer, A. J. (2005). Comparing estimates of cost effectiveness submitted to the National Institute for Clinical Excellence (NICE) by different organisations: Retrospective study. British Medical Journal, 330, 65. doi:10.1136/bmj.38285.482350.8210.1136/bmj.38285.482350.82
58. Palumbo, F. B., Barnes, R., Deverka, P., McGhan, W., Mullany, L., & Wertheimer, A. (2004). ISPOR code of ethics for researchers background article – Report of the ISPOR task force on code of ethics for researchers. Value in Health, 7, 111–117.10.1111/j.1524-4733.2004.72366.x
59. Pannucci, C. J., & Wilkins, E. G. (2010). Identifying and avoiding bias in research. Plastic and Reconstructive Surgery, 126, 619–625. doi:10.1097/Prs.0b013e3181de24bc10.1097/PRS.0b013e3181de24bc
60. Raad voor de Volksgezondheid en Zorg (2006). Bijlage 3 Prioriteren op basis van gegevens bij het rapport Zinnige en duurzame zorg [Appendix 3 Prioritizing based on evidence in relation to the report sensible and sustainable care]. Zoetermeer: Author.
61. Ramsey, S., Willke, R., Briggs, A., Brown, R., Buxton, M., Chawla, A., … Reed, S. (2005). Good research practices for cost-effectiveness analysis alongside clinical trials: The ISPOR RCT-CEA Task Force Report. Value in Health, 8, 521–533. doi:10.1111/j.1524-4733.2005.00045.x10.1111/j.1524-4733.2005.00045.x
62. Rennie, D., & Luft, H. S. (2000). Pharmacoeconomic analyses. The Journal of the American Medical Association, 283, 2158–2160.10.1001/jama.283.16.2158
63. Ridyard, C. H., Hughes, D. A., & DIRUM Team. (2012). Development of a database of instruments for resource-use measurement: Purpose, feasibility, and design. Value in Health, 15, 650–655. doi:10.1016/j.jval.2012.03.00410.1016/j.jval.2012.03.004
64. Sassi, F., Archard, L., & McDaid, D. (2002). Searching literature databases for health care economic evaluations: How systematic can we afford to be? Medical Care, 40, 387–394.10.1097/00005650-200205000-00004
65. Sculpher, M. J., Claxton, K., Drummond, M., & McCabe, C. (2006). Whither trial-based economic evaluation for health care decision making? Health Economics, 15, 677–687. doi:10.1002/hec.109310.1002/(ISSN)1099-1050
66. Tan, S. S., Bouwmans, C. A., Rutten, F. F., & Hakkaart-van Roijen, L. (2012). Update of the dutch manual for costing in economic evaluations. International Journal of Technology Assessment in Health Care, 28, 152–158. doi:10.1017/S026646231200006210.1017/S0266462312000062
67. Tarn, T. Y. H., & Dix Smith, M. (2004). Pharmacoeconomic guidelines around the world. ISPOR Connections, 10, 5–15.
68. The EuroQol Group. (1990). EuroQol–a new facility for the measurement of health-related quality of life. Health Policy, 16, 199–208.
69. The International Statistical Institute. (2003). The oxford dictionary of statistical terms (Y. Dodge, Ed.). New York, NY: Oxford University Press.
70. Thorn, J. C., Coast, J., Cohen, D., Hollingworth, W., Knapp, M., Noble, S. M., … Hughes, D. (2013). Resource-use measurement based on patient recall: Issues and challenges for economic evaluation. Applied Health Economics and Health Policy, 11, 155–161. doi:10.1007/s40258-013-0022-410.1007/s40258-013-0022-4
71. Walker, D. G., Wilson, R. F., Sharma, R., Bridges, J., Niessen, L., Bass, E. B., & Frick, K. (October, 2012). Best practices for conducting economic evaluations in health care: A systematic review of quality assessment tools. Methods Research Report. (Prepared by Johns Hopkins University Evidence-based Practice Center under contract No. 290-2007-10061-I.) AHRQ Publication No. 12(13)-EHC132-EF. Rockville, MD: Agency for Healthcare Research and Quality. Retrieved from www.effectivehealthcare.ahrq.gov/reports/final.cfm
72. Weatherly, H., Drummond, M., Claxton, K., Cookson, R., Ferguson, B., Godfrey, C., … Sowden, A. (2009). Methods for assessing the cost-effectiveness of public health interventions: Key challenges and recommendations. Health Policy, 93, 85–92. doi:10.1016/j.healthpol.2009.07.01210.1016/j.healthpol.2009.07.012
73. Williams, A. (1997). Cochrane lecture. All cost effective treatments should be free. or, how Archie Cochrane changed my life! Journal of Epidemiology and Community Health, 51, 116–120.10.1136/jech.51.2.116