Synthesizing evidence on complex interventions: How meta-analytical, qualitative, and mixed-method approaches can contribute

Journal of Clinical Epidemiology

Volumn 66, Issue 11, 2013, Pages 1230-1243

  Petticrew, Mark ^a   Rehfuess, Eva ^b   Noyes, Jane ^c   Higgins, Julian P T ^d,e   Mayhew, Alain ^f   Pantoja, Tomas ^g   Shemilt, Ian ^h   Sowden, Amanda ^e  

^a LONDON SCHOOL OF HYGIENE AND TROPICAL MEDICINE   (United Kingdom)

^b UNIVERSITY OF MUNICH   (Germany)

^c BANGOR UNIVERSITY   (United Kingdom)

^d UNIVERSITY OF BRISTOL   (United Kingdom)

^e UNIVERSITY OF YORK   (United Kingdom)

^f OTTAWA HOSPITAL RESEARCH INSTITUTE   (Canada)

^g PONTIFICIA UNIVERSIDAD CATÓLICA DE CHILE   (Chile)

^h UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Complex interventions; Evaluation; Evidence synthesis; Meta analysis; Mixed methods; Systematic review

Indexed keywords

ARTICLE; BAYES THEOREM; CANADA; CONCEPTUAL FRAMEWORK; DATA SYNTHESIS; METHODOLOGY; NARRATIVE; PRIORITY JOURNAL; QUALITATIVE RESEARCH; QUANTITATIVE ANALYSIS; REGRESSION ANALYSIS; STUDY DESIGN; SYSTEMATIC REVIEW (TOPIC); THEMATIC ANALYSIS; WORKSHOP;

COMPLEX INTERVENTIONS; EVALUATION; EVIDENCE SYNTHESIS; META-ANALYSIS; MIXED METHODS; SYSTEMATIC REVIEW;

DATA INTERPRETATION, STATISTICAL; HUMANS; RESEARCH DESIGN; REVIEW LITERATURE AS TOPIC;

EID: 84885021768     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2013.06.005     Document Type: Article

References (68)

1. D. Ogilvie, D. Fayter, M. Petticrew, A. Sowden, S. Thomas, and M. Whitehead The harvest plot: a method for synthesising evidence about the differential effects of interventions BMC Med Res Methodol 25 2008 1
2. Anderson LM, Petticrew M, Chandler J, Grimshaw J, Tugwell P, O'Neill J, et al. Introduction: systematic reviews of complex interventions. In press.
3. P. Craig, P. Dieppe, S. Macintyre, S. Michie, M. Petticrew, and I. Nazareth Developing and evaluating complex interventions: the new Medical Research Council guidance BMJ 337 2008 a1655
4. A. Shiell, P. Hawe, and L. Gold Complex interventions or complex systems? Implications for health economic evaluation BMJ 336 2008 1281 1283
5. P. Hawe, A. Shiell, and T. Riley Theorising interventions as events in systems Am J Community Psychol 43 3-4 2009 267 276
6. T. Greenhalgh, G. Wong, G. Westhorp, and R. Pawson Protocol - realist and meta-narrative evidence synthesis: evolving standards (RAMESES) BMC Med Res Methodol 11 2011 115
7. C. Pope, N. Mays, and J. Popay Synthesizing qualitative and quantitative health evidence. A guide to methods 2007 OUP/McGraw-Hill Berkshire, UK
8. Noyes J, Booth A, Hannes K, Harden A, Harris J, Lewin S, Lockwood C (editors), Supplementary Guidance for Inclusion of Qualitative Research in Cochrane Systematic Reviews of Interventions. Version 1 (updated August 2011). Available at: http://cqrmg.cochrane.org/supplemental-handbook-guidance. Accessed 22nd July 2013.
9. L.M. Anderson, M. Petticrew, E. Rehfuess, R. Armstrong, E. Ueffing, and P. Baker Using logic models to capture complexity in systematic reviews Res Synth Methods 2 1 2011 33 42
10. S. Shepperd, S. Lewin, S. Straus, M. Clarke, M.P. Eccles, and R. Fitzpatrick Can we systematically review studies that evaluate complex interventions? PLoS Med 6 8 2009 e1000086
11. A. Rithalia, C. McDaid, S. Suekarran, L. Myers, and A. Sowden Impact of presumed consent for organ donation on donation rates: a systematic review BMJ 338 2009 a3162
12. J.E. Squires, J.C. Valentine, and J.M. Grimshaw Systematic reviews of complex interventions: framing the review question J Clin Epidemiol 66 2013 1215 1222 [in this issue]
13. M. Petticrew When are complex interventions "complex"? When are simple interventions "simple"? Eur J Public Health 21 4 2011 397 399
14. M. Joffe, M. Gambhir, M. Chadeau-Hyam, and P. Vineis Causal diagrams in systems epidemiology. Emerg Themes Epidemiol 9 1 2012 1
15. S. Galea, M. Riddle, and G. Kaplan Causal thinking and complex system approaches in epidemiology Int J Epidemiol 39 2010 97 106
16. M. Petticrew, L. Anderson, R. Elder, J. Grimshaw, D. Hopkins, and R. Hahn Complex interventions and their implications for systematic reviews: a pragmatic approach J Clin Epidemiol 66 2013 1209 1214 [in this issue]
17. D. Gough, S. Oliver, and J. Thomas An introduction to systematic reviews 2012 Sage Publications Ltd London, UK
18. L. Anderson, S. Oliver, S. Michie, E. Rehfuess, J. Noyes, and I. Shemilt Investigating complexity in systematic reviews of interventions by using a spectrum of methods J Clin Epidemiol 66 2013 1223 1229 [in this issue]
19. Higgins J, Green S. Cochrane handbook for systematic reviews of interventions version 5.1.0 [updated March 2011]. In: The Cochrane Collaboration, 2011. Available at http://www.cochrane-handbook.org.
20. E.A. Kristjansson, V. Robinson, M. Petticrew, B. MacDonald, J. Krasevec, and L. Janzen School feeding for improving the physical and psychosocial health of disadvantaged elementary school children Cochrane Database Syst Rev 1 2007 CD004676
21. T. Greenhalgh, E. Kristjansson, and V. Robinson Realist review to understand the efficacy of school feeding programmes BMJ 335 2007 858
22. M. Petticrew, and H. Roberts Systematic reviews in the social sciences. A practical guide 2006 Blackwell Oxford, UK
23. S. Shepherd, and T. Pigot Identifying, documenting and examining heterogeneity in systematic reviews of complex interventions J Clin Epidemiol 66 2013 1244 1250 [in this issue]
24. E. Barnett-Page, and J. Thomas Methods for the synthesis of qualitative research: a critical review BMC Med Res Methodol 9 2009 59
25. K. Hannes, and C. Lockwood Synthesizing qualitative research: choosing the right approach 2012 Wiley-Blackwell Chichester, UK
26. N. Ivers, G. Jamtvedt, S. Flottorp, J.M. Young, J. Odgaard-Jensen, and S.D. French Audit and feedback: effects on professional practice and healthcare outcomes Cochrane Database Syst Rev 6 2012 CD000259
27. C. Arditi, M. Rège-Walther, J. Wyatt, P. Durieux, and B. Burnand Computer-generated reminders delivered on paper to healthcare professionals; effects on professional practice and health care outcomes Cochrane Database Syst Rev 12 2012 CD001175
28. H. Thomson, R. Atkinson, M. Petticrew, and A. Kearns Do urban regeneration programmes improve public health and reduce health inequalities? A synthesis of the evidence from UK policy and practice (1980-2004) J Epidemiol Community Health 60 2006 108 115
29. G. Wong, T. Greenhalgh, G. Westhorp, J. Buckingham, and R. Pawson RAMESES publication standards: meta-narrative reviews BMC Med 11 2013 20
30. J. Grimshaw, N. Freemantle, P. Langhorne, and F. Song Complexity and systematic reviews. Report to the U.S. Congress of Technology Assessment 1995 Office of Technology Assessment Washington, DC
31. WHO The solid facts: palliative care 2004 World Health Organization Copenhagen, Denmark
32. D. De Savingny, and T. Adam Systems thinking for health systems strengthening Alliance for health policy and systems research 2009 World Health Organization Geneva, Switzerland
33. F. Song, D. Altman, A. Glenny, and J. Deeks Validity of indirect comparison for estimating efficacy of competing interventions: empirical evidence from published meta-analyses BMJ 326 2003 472
34. N. Welton, D. Caldwell, E. Adamopoulos, and K. Vedhara Mixed treatment comparison meta-analysis of complex interventions: psychological interventions in coronary heart disease Am J Epidemiol 169 2009 1158 1165
35. M. Campbell, R. Fitzpatrick, A. Haines, A.L. Kinmonth, P. Sandercock, and D. Spiegelhalter Framework for design and evaluation of complex interventions to improve health BMJ 321 2000 694 696
36. Z. Lassi, B. Haider, and Z. Bhutta Community-based intervention packages for reducing maternal and neonatal morbidity and mortality and improving neonatal outcomes Cochrane Database Syst Rev 11 2010 CD007754
37. S. Gogia, and H. Sachdev Home visits by community health workers to prevent neonatal deaths in developing countries: a systematic review Bull World Health Organ 88 2011 658 666B
38. P. Hawe, A. Shiell, and T. Riley Complex interventions: how "out of control" can a randomised controlled trial be? BMJ 328 2004 1561 1563
39. P. Plsek, and T. Greenhalgh The challenge of complexity in health care BMJ 323 2001 625 628
40. E. Rehfuess Fuel for life: household energy and health 2006 WHO Geneva, Switzerland
41. Rehfuess E, Puzzolo E, Stanistreet D, Pope D, Bruce N. Enablers and barriers to large-scale uptake of improved solid fuel stoves: a systematic review. Environmental Health Perspectives, in press.
42. M. Gibson, H. Thomson, A. Kearns, and M. Petticrew Understanding the psychosocial impacts of housing type: qualitative evidence from a housing and regeneration intervention Housing Stud 26 4 2011 555 573
43. A. Mills, L. Gilson, K. Hanson, N. Palmer, and M. Lagarde What do we mean by rigorous health-systems research? Lancet 372 2008 1527 1529
44. M. Borenstein, L. Hedges, J. Higgins, and H. Rothstein Introduction to meta analysis: statistics in practice 2009 Wiley Chichester, UK
45. X. Sun, M. Briel, S. Walter, and G. Guyatt Is a subgroup effect believable? Updating criteria to evaluate the credibility of subgroup analyses BMJ 340 2010 850 854
46. S. Thompson, and J. Higgins How should meta-regression analyses be undertaken and interpreted? Stat Med 21 2002 1559 1573
47. D. Jackson, R. Riley, and I. White Multivariate meta-analysis: potential and promise Stat Med 30 2011 2481 2498
48. S. Raudenbush, and A. Bryk Hierarchical linear models: applications and data analysis methods 2nd ed. 2002 Sage Publications Inc Thousand Oaks, CA
49. A. Sutton, and K. Abrams Bayesian methods in meta-analysis and evidence synthesis Stat Methods Med Res 10 4 2001 277 303
50. N. Welton, A. Ades, J. Carlin, D. Altman, and J. Sterne Models for potentially biased evidence in meta-analysis using empirically based priors J R Stat Soc Ser A 172 1 2009 119 136
51. S. Thompson, U. Ekelund, S. Jebb, A.K. Lindroos, A. Mander, and S. Sharp A proposed method of bias adjustment for meta-analyses of published observational studies Int J Epidemiol 40 2011 765 777
52. R. Turner, D. Spiegelhalter, G. Smith, and S. Thompson Bias modelling in evidence synthesis J R Stat Soc Ser A Stat Soc 172 1 2009 21 47
53. I. Shrier Structural approach to bias in meta-analyses Res Synth Methods 2 4 2012 223 237
54. Best N, Jackson C, Richardson S. Modelling complexity in health and social sciences: Bayesian graphical models as a tool for combining multiple sources of information. Paper presented at: Proceedings of the 3rd ASC International Conference on Survey Research Methods 2005.
55. S. Lauritzen Graphical models 1996 Clarendon Press Oxford, UK
56. G. Noblit, and R.D. Hare Meta-ethnography: synthesizing qualitative studies 1988 Sage London, UK
57. R. Campbell, P. Pound, C. Pope, N. Britten, R. Pill, and M. Morgan Evaluating meta-ethnography: a synthesis of qualitative research on lay experiences of diabetes and diabetes care Soc Sci Med 56 2003 671 684
58. J. Thomas, and A. Harden Methods for the thematic synthesis of qualitative research in systematic reviews BMC Med Res Methodol 8 2008 45
59. A. Harden, J. Garcia, S. Oliver, R. Rees, J. Shepherd, and G. Brunton Applying systematic review methods to studies of people's views: an example from public health J Epidemiol Community Health 59 2004 794 800
60. M. Dixon-Woods, D. Cavers, S. Agarwal, E. Annandale, A. Arthur, and J. Harvey Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups BMC Med Res Methodol 6 2006 35
61. M. Dixon-Woods, S. Bonas, A. Booth, D.R. Jones, T. Miller, and R.L. Shaw How can systematic reviews incorporate qualitative research? A critical perspective Qual Res 6 2006 27 44
62. J. Ritchie, and L. Spencer Qualitative data analysis for applied policy research A. Bryman, R. Burgess, Analyzing qualitative data 1993 Sage London, UK 173 194
63. S.R. Oliver, R.W. Rees, L. Clarke-Jones, R. Milne, A.R. Oakley, and J. Gabbay A multidimensional conceptual framework for analysing public involvement in health services research Health Expect 11 2008 72 84
64. C. Carroll, A. Booth, and K. Cooper A worked example of "best fit" framework synthesis: a systematic review of views concerning the taking of some potential chemopreventive agents BMC Med Res Methodol 11 2011 29
65. Pawson R. Does Megan's Law work? A theory-driven systematic review. ESRC UK Centre for Evidence Based Policy and Practice, Working paper No. 8, Available at: http://www.kcl.ac.uk/sspp/departments/politicaleconomy/research/cep/pubs/ papers/paper-08.aspx. Accessed July 17, 2013.
66. R. Pawson, T. Greenhalgh, G. Harvey, and K. Walshe Realist review - a new method of systematic review designed for complex policy interventions J Health Serv Res Policy 10 Suppl 1 2005 21 34
67. Popay J, Roberts H, Sowden A, Petticrew M, Arai L, Rodgers M, et al. Guidance on the conduct of narrative synthesis in systematic review., In: ESRC 2006; 2006. Available at http://www.lancs.ac.uk/shm/research/nssr/research/ dissemination/publications/NS-Synthesis-Guidance-v1.pdf. Accessed June 7, 2012.
68. L. Arai, J. Popay, H. Roberts, and K. Roen Preventing accidents in children - how can we improve our understanding of what really works? Exploring methodological and practical issues in the systematic review of factors affecting the implementation of child injury prevention initiatives 2003 Health Development Agency London, UK