Performing economic evaluation of integrated care: Highway to hell or stairway to heaven?

International Journal of Integrated Care

Volumn 16, Issue 4, 2016, Pages

  Tsiachristas, Apostolos ^a   Stein, K Viktoria ^b   Evers, Silvia ^c   Rutten van Mölken, Maureen ^d  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b International Foundation for Integrated Care   (United Kingdom)

^c MAASTRICHT UNIVERSITY   (Netherlands)

^d ERASMUS UNIVERSITY ROTTERDAM   (Netherlands)

Author keywords

Complex intervention; Economic evaluation; Health economics; Health technology assessment; Integrated care

Indexed keywords

EID: 84992109100     PISSN: None     EISSN: 15684156     Source Type: Journal    
DOI: 10.5334/ijic.2472     Document Type: Article

References (96)

1. WHO Global status report on noncommunicable diseases: 2010. Geneva: World Health Organization, 2011.
2. Busse, R, Blümel, M, Scheller-Kreinsen, D, et al. Tackling chronic disease in Europe: Strategies, interventions and challenges. European Observatory on Health Systems and Policies, 2010.
3. Nolte, E and Pitchforth, E. What is the evidence on the economic impacts of integrated care? Copenhagen: European Observatory on Health Systems and Policies, 2014.
4. Epping-Jordan, JE, Pruitt, SD, Bengoa, R, et al. Improving the quality of health care for chronic conditions. Quality & safety in health care. 2004; 13: 299-305. DOI: http://dx.doi.org/10.1136/qshc.2004.010744
5. Berwick, DM, Nolan, TW and Whittington, J. The triple aim: care, health, and cost. Health affairs (Project Hope). 2008; 27: 759-69. DOI: http://dx.doi.org/10.1377/hlthaff.27.3.759
6. Conklin, A, Nolte, E and Vrijhoef, H. Approaches to chronic disease management evaluation in use in Europe: a review of current methods and performance measures. International Journal of Technology Assessment in Health Care. 2013; 29: 61-70. DOI: http://dx.doi.org/10.1017/S0266462312000700
7. Nolte, E, Knai, C and Saltman, RB. Assesing chronic disease management in European health systems: concepts and approaches. Observatory studies series: European Observatory on Health Systems and Policies, 2014.
8. Payne, K, McAllister, M and Davies, LM. Valuing the economic benefits of complex interventions: when maximising health is not sufficient. Health Econ. 2013; 22: 258-71. DOI: http://dx.doi.org/10.1002/hec.2795
9. NICE Guide to the methods of technology appraisal 2013. National Institute for Health and Care Excellence, 2013.
10. Craig, P, Dieppe, P, Macintyre, S, et al. Developing and evaluating complex interventions: the new Medical Research Council guidance. Bmj. 2008; 337: a1655.
11. Gröne, O and Garcia-Barbero, M. Integrated care: a position paper of the WHO European Office for Integrated Health Care Services. Int J Integr Care. 2001; 1. DOI: http://dx.doi.org/10.5334/ijic.28
12. Kodner, DL and Spreeuwenberg, C. Integrated care: meaning, logic, applications, and implications--a discussion paper. International journal of integrated care. 2002; 2: e12. DOI: http://dx.doi.org/10.5334/ijic.67
13. Nolte, E and McKee, M. Caring for people with chronic conditions: a health systems perspective. WHO: European Observatory on Health Systems and Policies, 2008.
14. Shiell, A, Hawe, P and Gold, L. Complex interventions or complex systems? Implications for health economic evaluation. Bmj. 2008; 336: 1281-3. DOI: http://dx.doi.org/10.1136/bmj.39569.510521.AD
15. Wagner, EH, Austin, BT, Davis, C, et al. Improving chronic illness care: translating evidence into action. Health affairs (Project Hope). 2001; 20: 64-78. DOI: http://dx.doi.org/10.1377/hlthaff.20.6.64
16. Tsiachristas, A, Burgers, L and Rutten-van Mölken, MPMH. Cost-effectiveness of disease management programs for cardiovascular risk and COPD in the Netherlands. Value in Health. 2015; 18: 977-86. DOI: http://dx.doi.org/10.1016/j.jval.2015.07.007
17. Tsiachristas, A, Cramm, JM, Nieboer, AP, et al. Changes in costs and effects after the implementation of disease management programs in the Netherlands: variability and determinants. Cost effectiveness and resource allocation: C/E. 2014; 12: 17-7547-12-17. eCollection 2014.
18. NICE Behaviour change: the principles for effective intervenions. 2007.
19. Bodenheimer, T and Handley, MA. Goal-setting for behavior change in primary care: an exploration and status report. Patient Educ Couns. 2009; 76: 174-80. DOI: http://dx.doi.org/10.1016/j.pec.2009.06.001
20. Conklin, A and Nolte, E. Disease management evaluation: a comprehensive review of current state of the art. Cambridge: RAND Europe, 2010.
21. Rickles, D. Causality in complex interventions. Med Health Care Philos. 2009; 12: 77-90. DOI: http://dx.doi.org/10.1007/s11019-008-9140-4
22. Hawe, P, Shiell, A and Riley, T. Complex interventions: how “out of control” can a randomised controlled trial be? Bmj. 2004; 328: 1561-3. DOI: http://dx.doi.org/10.1136/bmj.328.7455.1561
23. Boaz, A, Baeza, J, Fraser, A, et al. Effective implementation of research into practice: an overview of systematic reviews of the health literature. BMC Res Notes. 2011; 4: 212. DOI: http://dx.doi.org/10.1186/1756-0500-4-212
24. Craig, P, Cooper, C, Gunnell, D, et al. Using natural experiments to evaluate population health interventions: new Medical Research Council guidance. J Epidemiol Community Health. 2012; 66: 1182-6. DOI: http://dx.doi.org/10.1136/jech-2011-200375
25. Stuart, EA, Huskamp, HA, Duckworth, K, et al. Using propensity scores in difference-in-differences models to estimate the effects of a policy change. Health Serv Outcomes Res Methodol. 2014; 14: 166-82. DOI: http://dx.doi.org/10.1007/s10742-014-0123-z
26. Mattke, S, Bergamo, G, Balakrishnan, A, et al. Measuring and reporting the performance of disease management programs. RAND Health, 2006.
27. Nolte, E, Conklin, A, Adams, J, et al. Evaluating chronic disease management: Recommendations for funders and users. Cambridge: RAND Europe, 2012.
28. Knai, C, Nolte, E, Brunn, M, et al. Reported barriers to evaluation in chronic care: Experiences in six European countries. Health policy. (Amsterdam, Netherlands). 2013; 110: 220-28. DOI: http://dx.doi.org/10.1016/j.healthpol.2013.01.019
29. Mathes, T, Jacobs, E, Morfeld, JC, et al. Methods of international health technology assessment agencies for economic evaluations—a comparative analysis. BMC Health Serv Res. 2013; 13: 371. DOI: http://dx.doi.org/10.1186/1472-6963-13-371
30. Serxner, S, Baker, K and Gold, D. Guidelines for analysis of economic return from health management programs. Am J Health Promot. 2006; 20: suppl 1-17.
31. Steuten, L, Vrijhoef, B, Van Merode, F, et al. Evaluation of a regional disease management programme for patients with asthma or chronic obstructive pulmonary disease. International journal for quality in health care: journal of the International Society for Quality in Health Care/ISQua. 2006; 18: 429-36. DOI: http://dx.doi.org/10.1093/intqhc/mzl052
32. Tsiachristas, A, Hipple Waters, B, Adams, SA, et al. Identifying and explaining the variability in development and implementation costs of disease management programs in the Netherlands. BMC Health ServRes. 2014; 14. DOI: http://dx.doi.org/10.1186/s12913-014-0518-0
33. Tsiachristas, A, Cramm, JM, Nieboer, A, et al. Broader economic evaluation of disease management programs using multi-criteria decision analysis. International Journal of Technology Assessment in Health Care. 2013; 29: 301-08. DOI: http://dx.doi.org/10.1017/S0266462313000202
34. Steuten, L, Vrijhoef, B, Severens, H, et al. Are we measuring what matters in health technology assessment of disease management? Systematic literature review. International Journal of Technology Assessment in Health Care. 2006; 22: 47-57. DOI: http://dx.doi.org/10.1017/S0266462306050835
35. Huber, M, Knottnerus, JA, Green, L, et al. How should we define health? Bmj. 2011; 343: d4163. DOI: http://dx.doi.org/10.1136/bmj.d4163
36. Coast, J, Smith, R and Lorgelly, P. Should the capability approach be applied in health economics? Health Econ. 2008; 17: 667-70. DOI: http://dx.doi.org/10.1002/hec.1359
37. Coast, J, Smith, RD and Lorgelly, P. Welfarism, extra-welfarism and capability: the spread of ideas in health economics. Soc Sci Med. 2008; 67: 1190-8. DOI: http://dx.doi.org/10.1016/j.socscimed.2008.06.027
38. Kind, P, Lafata, JE, Matuszewski, K, et al. The use of QALYs in clinical and patient decision-making: issues and prospects. Value Health. 2009; 12 Suppl 1: S27-30. DOI: http://dx.doi.org/10.1111/j.1524-4733.2009.00519.x
39. Downing, A, Rudge, G, Cheng, Y, et al. Do the UK government’s new Quality and Outcomes Framework (QOF) scores adequately measure primary care performance? A cross-sectional survey of routine healthcare data. BMC health services research. 2007; 7: 166. DOI: http://dx.doi.org/10.1186/1472-6963-7-166
40. WHO People-centred and integrated health services: an overview of the evidence (interim report). Geneva: World Health Organization, 2015.
41. Tsiachristas, A. Payment and economic evaluation of integrated care. Health Economics. Rotterdam: Erasmus University Rotterdam, 2015.
42. Van Herck, P, Annemans, L, De Smedt, D, et al. Pay-for-performance step-by-step: introduction to the MIMIQ model. Health policy (Amsterdam, Netherlands). 2011; 102: 8-17. DOI: http://dx.doi.org/10.1016/j.healthpol.2010.09.014
43. Vondeling, H. Economic evaluation of integrated care: an introduction. International journal of integrated care. 2004; 4: e20. DOI: http://dx.doi.org/10.5334/ijic.95
44. Johns, B, Baltussen, R and Hutubessy, R. Programme costs in the economic evaluation of health interventions. Cost effectiveness and resource allocation: C/E. 2003; 1: 1. DOI: http://dx.doi.org/10.1186/1478-7547-1-1
45. Beecham, J and Knapp, M. Costing psychiatric interventions. In: Thornicroft G, Brewin C, Wing J, eds., Measuring mental health needs. London: Gaskell, 1992.
46. Bouwmans, C, Krol, M, Severens, H, et al. The iMTA Productivity Cost Questionnaire: A Standardized Instrument for Measuring and Valuing Health-Related Productivity Losses. Value Health. 2015; 18: 753-8. DOI: http://dx.doi.org/10.1016/j.jval.2015.05.009
47. Thorn, JC, Coast, J, Cohen, D, et al. Resource-use measurement based on patient recall: issues and challenges for economic evaluation. Applied Health Economics and Health Policy. 2013; 11: 155-61. DOI: http://dx.doi.org/10.1007/s40258-013-0022-4
48. Gray, AM, Clarke, PM, Wolstenholme, JL, et al. Applied methods of cost-effectiveness analysis in health care. Oxford: Oxford University Press, 2011.
49. Paulus, AT, van Raak, AJ and Maarse, HJ. Is integrated nursing home care cheaper than traditional care? A cost comparison. Int J Nurs Stud. 2008; 45: 1764-77. DOI: http://dx.doi.org/10.1016/j.ijnurstu.2008.05.005
50. Paulus, A, Van Raak, A and Keijzer, F. ABC: the pathway to comparison of the costs of integrated care. Public money and Management. 2002; Jul-Sep. DOI: http://dx.doi.org/10.1111/1467-9302.00315
51. Mogyorosy, Z and Smith, P. The main methodological issues in costing health care services: a literature review. York: Centre for Health Economics, University of York, 2005.
52. Drummond, MF, Sculpher, MJ, Torrance, GW, et al. Methods for the economic evaluation of health care programmes. Oxford: Oxford University Press, 2005.
53. Evers, SM. Value of integrated care: revival of the monetary valuation of health care benefits. International journal of integrated care. 2010; 10: e045. DOI: http://dx.doi.org/10.5334/ijic.534
54. Baltussen, R and Niessen, L. Priority setting of health interventions: the need for multi-criteria decision analysis. Cost effectiveness and resource allocation: C/E. 2006; 4: 14. DOI: http://dx.doi.org/10.1186/1478-7547-4-14
55. Goetghebeur, MM, Wagner, M, Khoury, H, et al. Bridging health technology assessment (HTA) and efficient health care decision making with multicriteria decision analysis (MCDA): applying the EVIDEM framework to medicines appraisal. Medical decision making: an international journal of the Society for Medical Decision Making. 2012; 32: 376-88. DOI: http://dx.doi.org/10.1177/0272989X11416870
56. Bots, PWG and Hulshof, JAM. Designing multi-criteria decision analysis processes for priority setting in health care. Journal of Multi-Criteria Decision Analysis. 2000; 9: 56-75. DOI: http://dx.doi.org/10.1002/1099-1360(200001/05)9:1/3<56::AID-MCDA267>3.0.CO;2-E
57. Baltussen, R. Question is not whether but how to use MCDA. Value and Outcomes Spotlight. 2015; Jan-Feb.
58. Claxton, K. Three questions to ask when examining MCDA. Value and Outcomes Spotlight. 2015; Jan-Feb.
59. Thokala, P, Devlin, N, Marsh, K, et al. Multiple Criteria Decision Analysis for Health Care Decision Making-An Introduction: Report 1 of the ISPOR MCDA Emerging Good Practices Task Force. Value Health. 2016; 19: 1-13. DOI: http://dx.doi.org/10.1016/j.jval.2015.12.003
60. Weatherly, H, Drummond, M, Claxton, K, et al. Methods for assessing the cost-effectiveness of public health interventions: key challenges and recommendations. Health policy (Amsterdam, Netherlands). 2009; 93: 85-92. DOI: http://dx.doi.org/10.1016/j.healthpol.2009.07.012
61. Tsai, AC, Morton, SC, Mangione, CM, et al. A meta-analysis of interventions to improve care for chronic illnesses. American Journal of Managed Care. 2005; 11: 478-88.
62. Ouwens, M, Wollersheim, H, Hermens, R, et al. Integrated care programmes for chronically ill patients: a review of systematic reviews. International journal for quality in health care: journal of the International Society for Quality in Health Care/ISQua. 2005; 17: 141-46. DOI: http://dx.doi.org/10.1093/intqhc/mzi016
63. Zwar, N, Harris, M, Griffiths, R, et al. A systematic review of chronic disease management. Canberra: Australian Primary Health Care Research Institute, 2006.
64. Weingarten, SR, Henning, JM, Badamgarav, E, et al. Interventions used in disease management programmes for patients with chronic illness-which ones work? Meta-analysis of published reports. Bmj. 2002; 325: 925. DOI: http://dx.doi.org/10.1136/bmj.325.7370.925
65. Coleman, K, Austin, BT, Brach, C, et al. Evidence on the Chronic Care Model in the new millennium. Health affairs (Project Hope). 2009; 28: 75-85. DOI: http://dx.doi.org/10.1377/hlthaff.28.1.75
66. Ham, C. The ten characteristics of the high-performing chronic care system. Health economics, policy, and law. 2010; 5: 71-90. DOI: http://dx.doi.org/10.1017/S1744133109990120
67. Boland, MRS, Kruis, AL, Huygens, SA, et al. Exploring the variation in implementation of a COPD disease management program and its impact on health outcomes: a post-hoc analysis of the RECODE cluster randomized trial. Primary Care Respiratory Medicine 2015; (forthcoming). DOI: http://dx.doi.org/10.1038/npjpcrm.2015.71
68. McDaid, D, Oliver, A and Merkur, S. What do we know about the strengths and weakness of different policy mechanisms to infl uence health behaviour in the population? Copenhagen: European Observatory on Health Systems and Policies, 2014.
69. Tsiachristas, A, Dikkers, C, Boland, MR, et al. Exploring payment schemes used to promote integrated chronic care in Europe. Health policy. (Amsterdam, Netherlands). 2013; 113: 296-304. DOI: http://dx.doi.org/10.1016/j.healthpol.2013.07.007
70. Busse, R and Mays, N. Paying for chronic disease care. In: Nolte E, McKee M, eds., Caring for people with chronic conditions: a health system perspective: Open University Press, 2008.
71. Scheller-Kreinsen, D, Blümel, M and Busse, R. Chronic disease management in Europe. Eurohealth. 2009; 15: 1-4.
72. Eijkenaar, F, Emmert, M, Scheppach, M, et al. Effects of pay for performance in health care: a systematic review of systematic reviews. Health policy (Amsterdam, Netherlands). 2013; 110: 115-30. DOI: http://dx.doi.org/10.1016/j.healthpol.2013.01.008
73. Song, Z, Rose, S, Safran, DG, et al. Changes in health care spending and quality 4 years into global payment. The New England journal of medicine. 2014; 371: 1704-14. DOI: http://dx.doi.org/10.1056/NEJMsa1404026
74. Rosenthal, MB, Fernandopulle, R, Song, HR, et al. Paying for quality: providers’ incentives for quality improvement. Health affairs (Project Hope). 2004; 23: 127-41. DOI: http://dx.doi.org/10.1377/hlthaff.23.2.127
75. de Bakker, DH, Struijs, JN, Baan, CB, et al. Early results from adoption of bundled payment for diabetes care in the Netherlands show improvement in care coordination. Health affairs (Project Hope). 2012; 31: 426-33. DOI: http://dx.doi.org/10.1377/hlthaff.2011.0912
76. Tsiachristas, A, Dikkers, C, Boland, M, et al. Impact of financial agreements in European chronic care on health care expenditure growth. Health policy. 2016; 120: 420-30. DOI: http://dx.doi.org/10.1016/j.healthpol.2016.02.012
77. Hoomans, T, Fenwick, EA, Palmer, S, et al. Value of information and value of implementation: application of an analytic framework to inform resource allocation decisions in metastatic hormone-refractory prostate cancer. Value Health. 2009; 12: 315-24. DOI: http://dx.doi.org/10.1111/j.1524-4733.2008.00431.x
78. Mason, J, Freemantle, N, Nazareth, I, et al. When is it cost-effective to change the behavior of health professionals? JAMA: the journal of the American Medical Association. 2001; 286: 2988-92. DOI: http://dx.doi.org/10.1001/jama.286.23.2988
79. Husereau, D, Drummond, M, Petrou, S, et al. Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement. Bmj. 2013; 346: f1049. DOI: http://dx.doi.org/10.1136/bmj.f1049
80. von Elm, E, Altman, DG, Egger, M, et al. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Lancet. 2007; 370: 1453-7. DOI: http://dx.doi.org/10.1016/S0140-6736(07)61602-X
81. Steuten, LM, Vrijhoef, HJ, van Merode, GG, et al. The Health Technology Assessment-disease management instrument reliably measured methodologic quality of health technology assessments of disease management. Journal of clinical epidemiology. 2004; 57: 881-88. DOI: http://dx.doi.org/10.1016/j.jclinepi.2004.01.017
82. Gandjour, A. A model to predict the cost-effectiveness of disease management programs. Health economics. 2010; 19: 697-715.
83. Scott, A, Schurer, S, Jensen, PH, et al. The effects of an incentive program on quality of care in diabetes management. Health Econ. 2009; 18: 1091-108. DOI: http://dx.doi.org/10.1002/hec.1536
84. Cuellar, AE and Gertler, PJ. Strategic integration of hospitals and physicians. J Health Econ. 2006; 25: 1-28. DOI: http://dx.doi.org/10.1016/j.jhealeco.2005.04.009
85. Dusheiko, M, Gravelle, H, Martin, S, et al. Does better disease management in primary care reduce hospital costs? Evidence from English primary care. J Health Econ. 2011; 30: 919-32. DOI: http://dx.doi.org/10.1016/j.jhealeco.2011.08.001
86. McCullough, JS and Snir, EM. Monitoring technology and firm boundaries: physician-hospital integration and technology utilization. J Health Econ. 2010; 29: 457-67. DOI: http://dx.doi.org/10.1016/j.jhealeco.2010.03.003
87. Tsiachristas, A. Finding the royal way to stimulate and evaluate integrated care in Europe. International Journal of Care Coordination. 2015; 18: 48-50. DOI: http://dx.doi.org/10.1177/2053434515589013
88. Evers, SM and Paulus, AT. Health economics and integrated care: a growing and challenging relationship. Int J Integr Care. 2015; 15: e024. DOI: http://dx.doi.org/10.5334/ijic.2201
89. Parkin, D, Morris, S and Devlin, N. Economic appraisal in public healthcare: assessing efficiency and equity. In: Detels R, Gulliford M, Karim QA, et al., eds., Oxford Textbook of Global Public Health. 6 ed. Oxford: Oxford University Press, 2015. DOI: http://dx.doi.org/10.1093/med/9780199661756.003.0129
90. Rychetnik, L, Frommer, M, Hawe, P, et al. Criteria for evaluating evidence on public health interventions. Journal of epidemiology and community health. 2002; 56: 119-27. DOI: http://dx.doi.org/10.1136/jech.56.2.119
91. Glasgow, RE, Klesges, LM, Dzewaltowski, DA, et al. Evaluating the impact of health promotion programs: using the RE-AIM framework to form summary measures for decision making involving complex issues. Health Educ Res. 2006; 21: 688-94. DOI: http://dx.doi.org/10.1093/her/cyl081
92. Collins, LM, Murphy, SA, Nair, VN, et al. A strategy for optimizing and evaluating behavioral interventions. Ann Behav Med. 2005; 30: 65-73. DOI: http://dx.doi.org/10.1207/s15324796abm3001_8
93. May, C. A rational model for assessing and evaluating complex interventions in health care. BMC Health Serv Res. 2006; 6: 86. DOI: http://dx.doi.org/10.1186/1472-6963-6-86
94. Campbell, M, Fitzpatrick, R, Haines, A, et al. Framework for design and evaluation of complex interventions to improve health. Bmj. 2000; 321: 694-6. DOI: http://dx.doi.org/10.1136/bmj.321.7262.694
95. Paulus, D, Van den Heede, K, Gerkens, S, et al. Development of a national position paper for chronic care: example of Belgium. Health policy. 2013; 111: 105-9. DOI: http://dx.doi.org/10.1016/j.healthpol.2013.04.010
96. Tsiachristas, A, Lionis, C and Yfantopoulos, J. Bridging knowledge to develop an action plan for integrated care for chronic diseases in Greece. International journal of integrated care. 2015; 15. DOI: http://dx.doi.org/10.5334/ijic.2228