Development, appraisal and synthesis of complex interventions - A methodological challenge;Entwicklung, Bewertung und Synthese von komplexen Interventionen - eine methodische Herausforderung

Zeitschrift fur Evidenz, Fortbildung und Qualitat im Gesundheitswesen

Volumn 105, Issue 10, 2011, Pages 751-761

  Mühlhauser, Ingrid ^a   Lenz, Matthias ^a   Meyer, Gabriele ^b  

^a UNIVERSITY OF HAMBURG   (Germany)

^b UNIVERSITY OF WITTEN HERDECKE   (Germany)

Author keywords

complex interventions; evaluation studies; meta analyses; systematic reviews

Indexed keywords

EID: 83655211375     PISSN: 18659217     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.zefq.2011.11.001     Document Type: Article

References (75)

1. B. Blackwood Methodological issues in evaluating complex healthcare interventions J Adv Nurs 54 2006 612 622 (Pubitemid 43806630)
2. N.C. Campbell, E. Murray, J. Darbyshire, J. Emery, A. Farmer, and F. Griffiths Designing and evaluating complex interventions to improve health care BMJ 334 2007 455 459 (Pubitemid 46586602)
3. M. Egan, C. Bambra, M. Petticrew, and M. Whitehead Reviewing evidence on complex social interventions: appraising implementation in systematic reviews of the health effects of organisational-level workplace interventions J Epidemiol Community Health 63 2009 4 11
4. P. Glasziou, I. Chalmers, D.G. Altman, H. Bastian, I. Boutron, and A. Brice Taking healthcare interventions from trial to practice BMJ 341 2010 c3852
5. R.D. Herbert, and K. Bo Analysis of quality of interventions in systematic reviews BMJ 331 2005 507 509 (Pubitemid 41248136)
6. M. Lenz, A. Steckelberg, B. Richter, and I. Muhlhauser Meta-analysis does not allow appraisal of complex interventions in diabetes and hypertension self-management: a methodological review Diabetologia 50 2007 1375 1383 (Pubitemid 46879008)
7. H. Pfaff, U.S. Albert, and R. Bornemann Methoden für die organisationsbezogene Versorgungsforschung Gesundheitswesen 71 2009 777 790
8. H. Raspe Unterschiede in der Bewertung von medikamentösen und nichtmedikamentösen Maßnahmen? Z Evid Fortbild Qual Gesundhwes 103 2009 253 260
9. S. Shepperd, S. Lewin, S. Straus, M. Clarke, M.P. Eccles, and R. Fitzpatrick Can we systematically review studies that evaluate complex interventions? PLoS Med 6 2009 e1000086
10. H. Walach, T. Falkenberg, V. Fonnebo, G. Lewith, and W.B. Jonas Circular instead of hierarchical: methodological principles for the evaluation of complex interventions BMC Med Res Methodol 6 2006 29
11. G.A. Lancaster, M.J. Campbell, and S. Eldridge Trials in primary care: statistical issues in the design, conduct and evaluation of complex interventions Stat Methods Med Res 19 2010 349 377
12. D. Ogilvie, D. Fayter, and M. Petticrew The harvest plot: a method for synthesising evidence about the differential effects of interventions BMC Med Res Methodol 8 2008 8
13. S. Andrew, and E.J. Halcomb Mixed methods research is an effective method of enquiry for community health research Contemp Nurse 23 2006 145 153
14. L.A. Curry, I.M. Nembhard, and E.H. Bradley Qualitative and mixed methods provide unique contributions to outcomes research Circulation 119 2009 1442 1452
15. U. Kelle, and T. Krones "Evidence based Medicine" und "Mixed Methods" - wie methodologische Diskussionen in der Medizin und den Sozialwissenschaften voneinander profitieren könnten Z Evid Fortbild Qual Gesundhwes 104 2010 630 635
16. S. Lewin, C. Glenton, and A.D. Oxman Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study BMJ 339 2009 b3496
17. C.L. Miller, B.G. Druss, and R.M. Rohrbaugh Using qualitative methods to distill the active ingredients of a multifaceted intervention Psychiatric Services 54 2003 568 571 (Pubitemid 36752991)
18. S.I. Miller, and M. Fredericks Mixed-methods and evaluation research: trends and issues Qual Health Res 16 2006 567 579
19. B.K. Nastasi, and J. Hitchcock Challenges of evaluating multilevel interventions Am J Community Psychol 43 2009 360 376
20. L.A. Palinkas, G.A. Aarons, S. Horwitz, P. Chamberlain, M. Hurlburt, and J. Landsverk Mixed method designs in implementation research Adm Policy Ment Health 38 2011 44 53
21. C. Paterson, C. Baarts, L. Launso, and M.J. Verhoef Evaluating complex health interventions: a critical analysis of the 'outcomes' concept BMC Complement Altern Med 9 2009 18
22. P. Pluye, M.P. Gagnon, F. Griffiths, and J. Johnson-Lafleur A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in Mixed Studies Reviews Int J Nurs Stud 46 2009 529 546
23. K.E. Schifferdecker, and V.A. Reed Using mixed methods research in medical education: basic guidelines for researchers Med Educ 43 2009 637 644
24. R. Whitley Mixed-methods studies J Ment Health 16 2007 697 701 (Pubitemid 350146695)
25. H. Yoshikawa, T.S. Weisner, A. Kalil, and N. Way Mixing qualitative and quantitative research in developmental science: Uses and Methodological Choices Dev Psychol 44 2008 344 354
26. K.S. Hunt, and S. Sridharan A realist evaluation approach to unpacking the impacts of the sentencing guidelines AJE 31 2010 463 485
27. R. Pawson, T. Greenhalgh, G. Harvey, and K. Walshe Realist review - a new method of systematic review designed for complex policy interventions J Health Serv Res Policy 10 Suppl 1 2005 21 34 (Pubitemid 40993882)
28. R. Emsley, G. Dunn, and I.R. White Mediation and moderation of treatment effects in randomised controlled trials of complex interventions Stat Methods Med Res 19 2010 237 270
29. A. Oakley, V. Strange, C. Bonell, E. Allen, and J. Stephenson Process evaluation in randomised controlled trials of complex interventions BMJ 332 2006 413 416 (Pubitemid 43797387)
30. R. Perera, C. Heneghan, and P. Yudkin Graphical method for depicting randomised trials of complex interventions BMJ 334 2007 127 129 (Pubitemid 46173954)
31. Higgins JPT, Green S. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. www.cochrane-handbook.org/, accessed 15.6.2011.
32. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: new guidance. UK Medical Research Council, 2008. www.mrc.ac.uk/complexinterventionsguidance, accessed 16.6.2011.
33. Centre for Reviews and Dissimination. Systematic Reviews: CRD's guidance for undertaking reviews in health care. 2009. www.york.ac.uk/inst/crd/pdf/ Systematic-Reviews.pdf, accessed 16.6.2011.
34. Social Care Institute for Excellence (SCIE). SCIE systematic research reviews: guidelines (2nd edition, 2010). www.scie.org.uk/publications/ researchresources/rr01.pdf, accessed 16.6.2011.
35. M. Petticrew, and H. Roberts Systematic reviews in the social sciences: a practical guide 2006 Blackwell Malden
36. I. Boutron, D. Moher, D.G. Altman, K.F. Schulz, and P. Ravaud Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration Ann Intern Med 148 2008 295 309 (Pubitemid 351665487)
37. P.A. Briss, S. Zaza, and M. Pappaioanou Developing an evidence-based guide to community preventive services - methods. The Task Force on Community Preventive Services Am J Prev Med 18 1 Suppl 2000 35 43 (Pubitemid 30114233)
38. A. Coote, J. Allen, and D. Woodhead Finding out what works: understanding complex, community-based initiatives 2004 King's Fund London
39. Cochrane Effective Practice and Organisation of Care (EPOC) Review Group. Data collection checklist. Ottawa: 2000.
40. M. Newman, and D. Elbourne Improving the usability of educational research: Guidelines for the REPOrting of primary empirical research Studies in Education (The REPOSE Guidelines) Evaluation and Research in Education 18 2005 201 212 (Pubitemid 43256208)
41. R.E. Glasgow, L.M. Klesges, D.A. Dzewaltowski, P.A. Estabrooks, and T.M. Vogt Evaluating the impact of health promotion programs: using the RE-AIM framework to form summary measures for decision making involving complex issues Health Educ Res 21 2006 688 694 (Pubitemid 44453592)
42. D.C. Des Jarlais, C. Lyles, and N. Crepaz Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: the TREND statement Am J Public Health 94 2004 361 366 (Pubitemid 38269486)
43. E. von Elm, D.G. Altman, M. Egger, S.J. Pocock, P.C. Gotzsche, and J.P. Vandenbroucke The strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies J Clin Epidemiol 61 2008 344 349 (Pubitemid 351289042)
44. Writing Group for the Women's Health Initiative Investigators Risks and Benefits of Estrogen plus progestin in healthy postmenopausal women JAMA 288 2002 321 333
45. I. Mühlhauser, and M. Berger Patient education - evaluation of a complex intervention Diabetologia 45 2002 1723 1733 (Pubitemid 35478144)
46. A. Warsi, P.S. Wang, M.P. LaValley, J. Avorn, and D.H. Solomon Self-management education programs in chronic disease: a systematic review and methodological critique of the literature Arch Intern Med 164 2004 1641 1649 (Pubitemid 39037943)
47. Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen (IQWiG). Allgemeine Methoden. Entwurf für Version 4.0 vom 09.03.2011. www.iqwig.de/download/IQWiG-Entwurf-Methoden-Version-4-0.pdf, accessed 1.8.2011.
48. The Action to Control Cardiovascular Risk in Diabetes Study Group Effects of intensive glucose lowering in type 2 diabetes N Eng J Med 358 2008 2545 2559
49. P. Kronsbein, V. Jörgens, I. Mühlhauser, V. Scholz, A. Venhaus, and M. Berger Evaluation of a structured treatment and teaching programme on non-insulin-dependent diabetes Lancet 2 8625 1988 1407 1411 (Pubitemid 19004491)
50. S. Bott, U. Bott, M. Berger, and I. Mühlhauser Intensified insulin therapy and the risk of severe hypoglycaemia Diabetologia 40 1997 926 932 (Pubitemid 27316573)
51. D. Atkins, D. Best, P. Briss, G. Guyatt, D. Henry, S. Hill GRADE Working Group Grading quality of evidence and strength of recommendations BMJ 328 2004 1490
52. M. Campbell, R. Fitzpatrick, A. Haines, A. Kinmonth, P. Sandercock, and D. Spiegelhalter Framework for design and evaluation of complex interventions to improve health BMJ 321 2000 694 696
53. E.M. Antman, J. Lau, B. Kupelnick, F. Mosteller, and T.C. Chalmers A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts Treatments for myocardial infarction. JAMA 268 1992 240 248
54. J. Lau, E.M. Antman, J. Jimenez-Silva, B. Kupelnick, F. Mosteller, and T.C. Chalmers Cumulative meta-analysis of therapeutic trials for myocardial infarction N Engl J Med 327 1992 248 254
55. G. Meyer, S. Köpke, B. Haastert, and I. Mühlhauser Restraint use among nursing home residents: cross-sectional study and prospective cohort study J Clin Nurs 18 2009 981 990
56. J.P.H. Hamers, G. Meyer, S. Köpke, R. Lindenmann, R. Groven, and A.R. Huizing Attitudes of Dutch German and Swiss nursing staff towards physical restraint use in nursing home residents, a cross-sectional study. Int J Nurs Stud 46 2009 248 255
57. A. Haut, N. Kolbe, S. Strupeit, H. Mayer, and G. Meyer Attitudes of relatives of nursing home residents towards physical restraints J Nurs Scholarsh 42 2010 448 456
58. R. Möhler, T. Richter, S. Köpke, and G. Meyer Interventions for preventing and reducing the use of physical restraints in long-term geriatric care Cochrane Database Syst Rev 2 2011 CD007546
59. S. Köpke, G. Meyer, A. Haut, and A. Gerlach Methodenpapier zur Entwicklung einer Praxisleitlinie zur Vermeidung von freiheitseinschrä nkenden Maßnahmen in der beruflichen Altenpflege Z Evid Fortbild Qual Gesundh wesen 102 2008 45 53
60. A. Haut, S. Köpke, A. Gerlach, I. Mühlhauser, B. Haastert, and G. Meyer Evaluation of an evidence-based guidance on the reduction of physical restraints in nursing homes: a cluster-randomised controlled trial [ISRCTN34974819] BMC Geriatrics 9 2009 42
61. G. Meyer, A. Haut, A. Gerlach, and S. Köpke Evaluation of a guidance on the reduction of physical restraints in nursing homes: a cluster-RCT Abstract J Clin Nurs 19 Suppl. 1 2010 58
62. S. Clark, and R. Horton Putting research into context - revisited Lancet 376 2010 10 11
63. M. Clarke, S. Hopewell, and I. Chalmers Clinical trials should begin and end with systematic reviews of relevant evidence: 12 years and waiting Lancet 376 2010 20 21
64. R.D. Riley, J.P. Higgins, and J.J. Deeks Interpretation of random effects meta-analyses BMJ 342 2011 d549
65. J.P. Ioannidis, and F.B. Karassa The need to consider the wider agenda in systematic reviews and meta-analyses: breadth, timing, and depth of the evidence BMJ 341 2010 c4875
66. I.D. Cameron, G.R. Murray, L.D. Gillespie, M.C. Robertson, K.D. Hill, and R.G. Cumming Interventions for preventing falls in older people in nursing care facilities and hospitals Cochrane Database Syst Rev 1 2010 CD005465
67. L.D. Gillespie, M.C. Robertson, and W.J. Gillespie Interventions for preventing falls in older people living in the community Cochrane Database Syst Rev 2 2009 CD007146
68. P. Bower, S. Gilbody, D. Richards, J. Fletcher, and A. Sutton Collaborative care for depression in primary care Making sense of a complex intervention: systematic review and meta-regression. Br J Psychiatry 89 2006 484 493
69. M. Rodgers, A. Sowden, and M. Petticrew Testing methodological guidance on the conduct of narrative synthesis in systematic reviews Evaluation 15 2009 047 71
70. S.S. Kane, B. Gerretsen, R. Scherpbier, M. Dal Poz, and M. Dieleman A realist synthesis of randomised control trials involving use of community health workers for delivering child health interventions in low and middle income countries BMC Health Serv Res 10 2010 286
71. J. Rycroft-Malone, M. Fontenla, D. Bick, and K. Seers A realistic evaluation: the case of protocol-based care Implement Sci 5 2010 38
72. C. Walshe, and K.A. Luker 'District nurses' role in palliative care provision: a realist review Int J Nurs Stud 47 2010 1167 1183
73. L.M. Van der Knaap, F.L. Leeuw, S. Bogaerts, and L.T.J. Nijssen Combining Campbell Standards and the realist evaluation approach: The best of two worlds? AJE 29 2008 48 57
74. J. Leeman, Y.K. Chang, E.J. Lee, C.I. Voils, J. Crandell, and M. Sandelowski Implementation of antiretroviral therapy adherence interventions: a realist synthesis of evidence J Adv Nurs 66 2010 1915 1930
75. G. Wong, T. Greenhalgh, and R. Pawson Internet-based medical education: a realist review of what works, for whom and in what circumstances BMC Med Educ 10 2010 12