Meta-analysis, complexity, and heterogeneity: A qualitative interview study of researchers' methodological values and practices

Systematic Reviews

Volumn 5, Issue 1, 2016, Pages

  Lorenc, Theo ^a   Felix, Lambert ^b   Petticrew, Mark ^b   Melendez Torres, G J ^c   Thomas, James ^d   Thomas, Sian ^b   O'Mara Eves, Alison ^d   Richardson, Michelle ^d  

^a UNIVERSITY OF YORK   (United Kingdom)

^b LONDON SCHOOL OF HYGIENE AND TROPICAL MEDICINE   (United Kingdom)

^c Division of Health Sciences   (United Kingdom)

^d UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Complexity; Heterogeneity; Meta analysis; Qualitative research; Systematic review methodology

Indexed keywords

ARTICLE; CONCEPTUAL FRAMEWORK; DECISION MAKING; METHODOLOGY; PRIORITY JOURNAL; PUBLISHING; QUALITATIVE RESEARCH; TELEPHONE INTERVIEW; ATTITUDE TO HEALTH; HUMAN; LITERATURE; MEDICAL RESEARCH; META ANALYSIS (TOPIC); PERSONNEL;

BIOMEDICAL RESEARCH; DECISION MAKING; HEALTH KNOWLEDGE, ATTITUDES, PRACTICE; HUMANS; META-ANALYSIS AS TOPIC; QUALITATIVE RESEARCH; RESEARCH DESIGN; RESEARCH PERSONNEL; REVIEW LITERATURE AS TOPIC;

EID: 84997471543     PISSN: None     EISSN: 20464053     Source Type: Journal    
DOI: 10.1186/s13643-016-0366-6     Document Type: Article

References (42)

1. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.
2. Petticrew M. When are complex interventions 'complex'? When are simple interventions 'simple'? Eur J Public Health. 2011;21:397-8.
3. Shiell A, Hawe P, Gold L. Complex interventions or complex systems? Implications for health economic evaluation. BMJ. 2008;336:1281-3.
4. Shepperd S, Lewin S, Straus S, Clarke M, Eccles MP, Fitzpatrick R, et al. Can we systematically review studies that evaluate complex interventions? PLoS Med. 2009;6:e1000086.
5. Pigott T, Shepperd S. Identifying, documenting, and examining heterogeneity in systematic reviews of complex interventions. J Clin Epidemiol. 2013;66:1244-50.
6. Glasziou P, Sanders S. Investigating causes of heterogeneity in systematic reviews. Stat Med. 2002;21:1503-11.
7. Anderson LM, Oliver SR, Michie S, Rehfuess E, Noyes J, Shemilt I. Investigating complexity in systematic reviews of interventions by using a spectrum of methods. J Clin Epidemiol. 2013;66:1223-9.
8. Waters E, Hall BJ, Armstrong R, Doyle J, Pettman TL, de Silva-Sanigorski A. Essential components of public health evidence reviews: capturing intervention complexity, implementation, economics and equity. J Public Health. 2011;33:462-5.
9. Petticrew M. Time to rethink the systematic review catechism? Moving from 'what works' to 'what happens'. Syst Rev. 2015;4:36.
10. Petticrew M, Anderson L, Elder R, Grimshaw J, Hopkins D, Hahn R, et al. Complex interventions and their implications for systematic reviews: a pragmatic approach. J Clin Epidemiol. 2013;66:1209-14.
11. Gough D, Oliver S, Thomas J. An introduction to systematic reviews. London: Sage; 2012.
12. Dixon-Woods M, Agarwal S, Jones D, Young B, Sutton A. Synthesising qualitative and quantitative evidence: a review of possible methods. J Health Serv Res Policy. 2005;10:45-53.
13. Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review-a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005;10 suppl 1:21-34.
14. Thomas J, O'Mara-Eves A, Brunton G. Using qualitative comparative analysis (QCA) in systematic reviews of complex interventions: a worked example. Syst Rev. 2014;3:1-14.
15. Gøtzsche PC. Why we need a broad perspective on meta-analysis. It may be crucially important for patients. BMJ. 2000;321:585-6.
16. Melendez-Torres G, Bonell C, Thomas J. Emergent approaches to the meta-analysis of multiple heterogeneous complex interventions. BMC Med Res Meth. 2015;15:47.
17. Moreira T. Entangled evidence: knowledge making in systematic reviews in healthcare. Sociol Health Ill. 2007;29:180-97.
18. Shepherd J. Judgment, resources, and complexity: a qualitative study of the experiences of systematic reviewers of health promotion. Eval Health Prof. 2013;36:247-67.
19. Pope C, Ziebland S, Mays N. Analysing qualitative data. BMJ. 2000;320:114-16.
20. Lévi-Strauss C. The savage mind. Chicago: University of Chicago Press; 1966.
21. Polanyi M. The tacit dimension. Chicago: University of Chicago Press; 2009.
22. Bowker GC, Star SL. Sorting things out: classification and its consequences. Cambridge: MIT Press; 2000.
23. Mol A. The body multiple: ontology in medical practice. Durham: Duke University Press; 2002.
24. Sandelowski M. Reading, writing and systematic review. J Adv Nurs. 2008;64:104-10.
25. Lee RP, Hart RI, Watson RM, Rapley T. Qualitative synthesis in practice: some pragmatics of meta-ethnography. Qual Res. 2015;15:334-50.
26. Toye F, Seers K, Allcock N, Briggs M, Carr E, Andrews J, Barker K. 'Trying to pin down jelly'-exploring intuitive processes in quality assessment for meta-ethnography. BMC Med Res Meth. 2013;13:1-12.
27. Knorr-Cetina K. Epistemic cultures: how the sciences make knowledge. Cambridge: Harvard University Press; 2009.
28. Nowotny H, Scott P, Gibbons M. Re-thinking science: knowledge and the public in an age of uncertainty. Cambridge: Polity; 2001.
29. Funtowicz SO, Ravetz JR. Science for the post-normal age. Futures. 1993;25:739-55.
30. Higgins J, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions. The Cochrane Collaboration; 2011. Available from handbook.cochrane.org. Accessed 10 Nov. 2016.
31. Campbell Collaboration. Campbell Collaboration systematic reviews: policies and guidelines. Oslo: Campbell Collaboration; 2015.
32. Wong G, Greenhalgh T, Westhorp G, Buckingham J, Pawson R. RAMESES publication standards: realist syntheses. BMC Med. 2013;11:21.
33. Chandler J, Churchill R, Higgins J, Lasserson T, Tovey D. Methodological standards for the conduct of new Cochrane Intervention Reviews. S.l.: Cochrane Collaboration, 2013.
34. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA Statement. Ann Intern Med. 2009;151:264-9.
35. Cooper H, Hedges LV, Valentine JC. The handbook of research synthesis and meta-analysis. New York: Russell Sage; 2009.
36. Petticrew M, Roberts H. Systematic reviews in the social sciences: a practical guide. Oxford: Blackwell; 2006.
37. Littell JH, Corcoran J, Pillai V. Systematic reviews and meta-analysis. Oxford: Oxford University Press; 2008.
38. Saini M, Shlonsky A. Systematic synthesis of qualitative research. Oxford: Oxford University Press; 2012.
39. Popay J, Roberts H, Sowden A, Petticrew M, Arai L, Rodgers M, et al. Guidance on the conduct of narrative synthesis in systematic reviews. A Product from the ESRC Methods Programme. S.l.: ESRC; 2006.
40. Centre for Reviews and Dissemination. Systematic reviews: CRD's guidance for undertaking reviews in health care. York: Centre for Reviews and Dissemination; 2009.
41. Effective Practice and Organisation of Care (EPOC) Group. EPOC resources for review authors. Oslo: Norwegian Knowledge Centre for the Health Services; 2015.
42. Rutter D, Francis J, Coren E, Fisher M. SCIE systematic research reviews: guidelines. London: Social Care Institute for Excellence; 2010.