Applying GRADE-CERQual to qualitative evidence synthesis findings: Introduction to the series

Implementation Science

Volumn 13, Issue , 2018, Pages

  Lewin, Simon ^a,b   Booth, Andrew ^c   Glenton, Claire ^a   Munthe Kaas, Heather ^a   Rashidian, Arash ^d,e   Wainwright, Megan ^f   Bohren, Meghan A ^e   Tunçalp, Özge ^e   Colvin, Christopher J ^f   Garside, Ruth ^g   Carlsen, Benedicte ^h   Langlois, Etienne V ^e   Noyes, Jane ⁱ  

^a NORWEGIAN INSTITUTE OF PUBLIC HEALTH   (Norway)

^b SOUTH AFRICAN MEDICAL RESEARCH COUNCIL   (South Africa)

^c UNIVERSITY OF SHEFFIELD   (United Kingdom)

^d TEHRAN UNIVERSITY OF MEDICAL SCIENCES   (Iran)

^e WORLD HEALTH ORGANIZATION   (Switzerland)

^f UNIVERSITY OF CAPE TOWN   (South Africa)

^g UNIVERSITY OF EXETER MEDICAL SCHOOL   (United Kingdom)

^h Uni Research Rokkan Centre   (Norway)

ⁱ BANGOR UNIVERSITY   (United Kingdom)

Author keywords

Confidence; Evidence based practice; GRADE; Guidance; Methodology; Qualitative evidence synthesis; Qualitative research; Recommendations for practice; Research design; Systematic review methodology

Indexed keywords

ARTICLE; COMPARATIVE EFFECTIVENESS; DECISION MAKING; HUMAN; PHYSICIAN; QUALITATIVE RESEARCH; SCIENTIST; SYNTHESIS; SYSTEMATIC REVIEW; CONFIDENCE INTERVAL; EVIDENCE BASED MEDICINE; MEASUREMENT ACCURACY; MEDICAL RESEARCH; PUBLISHING; STANDARDS;

BIOMEDICAL RESEARCH; CONFIDENCE INTERVALS; DATA ACCURACY; DECISION MAKING; EVIDENCE-BASED MEDICINE; HUMANS; PUBLISHING; QUALITATIVE RESEARCH; SYSTEMATIC REVIEWS AS TOPIC;

EID: 85041615872     PISSN: None     EISSN: 17485908     Source Type: Journal    
DOI: 10.1186/s13012-017-0688-3     Document Type: Article

References (58)

1. Oxman AD, Lavis JN, Lewin S, Fretheim A. SUPPORT Tools for evidence-informed health Policymaking (STP) 1: what is evidence-informed policymaking? Health Res Policy Syst. 2009;7(Suppl 1):S1.
2. Nabyonga-Orem J, Mijumbi R. Evidence for informing health policy development in low-income countries (LICs): perspectives of policy actors in Uganda. Int J Health Policy Manag. 2015;4(5):285-93.
3. Rashidian A, Eccles MP, Russell I. Falling on stony ground? A qualitative study of implementation of clinical guidelines' prescribing recommendations in primary care. Health Policy. 2008;85(2):148-61.
4. Treweek S, Oxman AD, Alderson P, Bossuyt PM, Brandt L, Brozek J, Davoli M, Flottorp S, Harbour R, Hill S, et al. Developing and Evaluating Communication Strategies to Support Informed Decisions and Practice Based on Evidence (DECIDE): protocol and preliminary results. Implement Sci. 2013;8:6.
5. Davies P: Evidence-based government: how can we make it happen? CHSRF (Canada Health Services Research Foundation) 7th annual invitational workshop - leveraging knowledge: tools and strategies for action. Montreal, Canada; 2005.
6. Colvin CJ, de Heer J, Winterton L, Mellenkamp M, Glenton C, Noyes J, Lewin S, Rashidian A. A systematic review of qualitative evidence on barriers and facilitators to the implementation of task-shifting in midwifery services. Midwifery. 2013;29(10):1211-21.
7. Glenton C, Colvin CJ, Carlsen B, Swartz A, Lewin S, Noyes J, Rashidian A. Barriers and facilitators to the implementation of lay health worker programmes to improve access to maternal and child health: qualitative evidence synthesis. Cochrane Database Syst Rev. 2013;10:CD010414.
8. Rashidian A, Shakibazadeh E, Karimi-Shahanjarini A, Glenton C, Noyes J, Lewin S, Colvin C, Laurant M. Barriers and facilitators to the implementation of doctor-nurse substitution strategies in primary care: qualitative evidence synthesis (protocol). Cochrane Database Syst Rev. 2013;2:CD010412.
9. Leach-Kemon K, Chou DP, Schneider MT, Tardif A, Dieleman JL, Brooks BP, Hanlon M, Murray CJ. The global financial crisis has led to a slowdown in growth of funding to improve health in many developing countries. Health Aff (Millwood). 2012;31(1):228-35.
10. Gough D, Oliver S, Thomas J. An introduction to systematic reviews. Thousand Oaks: Sage Publications; 2012.
11. Noyes J, Popay J, Pearson A, Hannes K, Booth A, Cochrane Qualitative Research Methods Group. Chapter 20: Qualitative research and Cochrane reviews. In: Higgins JPT, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions Version 510 [updated March 2011]: The Cochrane Collaboration; 2011. Available from: http://handbook-5-1.cochrane.org/
12. Saini M, Shlonsky A. Systematic synthesis of qualitative research. Oxford, UK: Oxford University Press; 2012.
13. Ansari S, Rashidian A. Guidelines for guidelines: are they up to the task? A comparative assessment of clinical practice guideline development handbooks. PLoS One. 2012;7(11):e49864.
14. The SURE Collaboration: SURE Guides for Preparing and Using Evidence-Based Policy Briefs. Version 2.1 [updated November 2011]: The SURE Collaboration; 2011. Available from: http://www.who.int/evidence/sure/guides/en/
15. Lewin S, Bosch-Capblanch X, Oliver S, Akl EA, Vist GE, Lavis J, Ghersi D, Røttingen J, Steinmann P, Gulmezoglu M, et al. Guidance for evidence-informed policies about health systems: assessing how much confidence to place in the research evidence. PLoS Med. 2012;9(3):e1001187.
16. Lewin S, Glenton C, Munthe-Kaas H, Carlsen B, Colvin CJ, Gulmezoglu M, Noyes J, Booth A, Garside R, Rashidian A. Using qualitative evidence in decision making for health and social interventions: an approach to assess confidence in findings from qualitative evidence syntheses (GRADE-CERQual). PLoS Med. 2015;12(10):e1001895.
17. Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, Norris S, Falck-Ytter Y, Glasziou P, DeBeer H, et al. GRADE guidelines: 1. Introduction-GRADE evidence profiles and summary of findings tables. J Clin Epidemiol. 2011;64(4):383-94.
18. Hsu J, Brozek JL, Terracciano L, Kreis J, Compalati E, Stein AT, Fiocchi A, Schunemann HJ. Application of GRADE: making evidence-based recommendations about diagnostic tests in clinical practice guidelines. Implement Sci. 2011;6:62.
19. Sandelowski M, Docherty S, Emden C. Focus on qualitative methods qualitative metasynthesis: issues and techniques. Res Nurs Health. 1997;20:365-72.
20. Thorne S. Metasynthetic madness: what kind of monster have we created? Qual Health Res. 2017;27(1):3-13.
21. Thorne S, Jensen L, Kearney M, Noblit G, Sandelowski M. Reflections on the methodological and ideological agenda in qualitative meta-synthesis. Qual Health Res. 2004;14:1342-65.
22. Hammersley M. What's wrong with ethnography?-methodological explorations. London: Routledge; 1992.
23. Barth F. Analytical dimensions in the comparison of social organizations. Am Anthropol. 1972;74(1-2):207-20.
24. Pope C, Mays N, Popay J. Synthesising qualitative and quantitative health evidence: a guide to methods. United Kingdom: McGraw-Hill Education; 2007.
25. Lewin S, Bohren M, Rashidian A, Glenton C, Munthe-Kaas HM, Carlsen B, Colvin CJ, Tuncalp Ö, Noyes J, Booth A et al. Applying GRADE-CERQual to qualitative evidence synthesis findings-paper 2: how to make an overall CERQual assessment of confidence and create a Summary of Qualitative Findings table. Implement Sci. 2018;13(Suppl 1). https://doi.org/10.1186/s13012-017-0689-2.
26. Ames HMR, Glenton C, Lewin S. Parents' and informal caregivers' views and experiences of communication about routine childhood vaccination: a synthesis of qualitative evidence. Cochrane Database Syst Rev. 2017;2:CD011787.
27. Aslam RW, Hendry M, Carter B, Noyes J, Rycroft Malone J, Booth A, Pasterfield D, Charles JM, Craine N, Tudor Edwards R et al: Interventions for preventing unintended repeat pregnancies among adolescents (Protocol). Cochrane Database of Systematic Reviews. 2015(1):Art. No.: CD011477.
28. Bohren MA, Hunter EC, Munthe-Kaas HM, Souza JP, Vogel JP, Gulmezoglu AM. Facilitators and barriers to facility-based delivery in low- and middle-income countries: a qualitative evidence synthesis. Reprod Health. 2014;11(1):71.
29. Bohren MA, Vogel JP, Hunter EC, Lutsiv O, Makh SK, Souza JP, Aguiar C, Saraiva Coneglian F, Diniz AL, Tuncalp O, et al. The mistreatment of women during childbirth in health facilities globally: a mixed-methods systematic review. PLoS Med. 2015;12(6):e1001847. discussion e1001847
30. Munabi-Babigumira S, Glenton C, Lewin S, Fretheim A, Nabudere H. Factors that influence the provision of intrapartum and postnatal care by skilled birth attendants in low- and middle-income countries: a qualitative evidence synthesis. Cochrane Database Syst Rev. 2017;(11):CD011558.
31. Munthe-Kaas HM, Hammerstrøm KT, et al. Effekt av og erfaringer med kontinuitetsfremmende tiltak i barnevernsinstitusjoner. Norwegian Knowledge Centre for the Health Services: Oslo; 2013.
32. O'Brien TD, Noyes J, Spencer LH, Kubis HP, Hastings RP, Edwards RT, Bray N, Whitaker R. Keep fit exercise interventions to improve health, fitness and well-being of children and young people who use wheelchairs: mixed-method systematic review protocol. J Adv Nurs. 2014;70(12):2942-51.
33. Whitaker R, Hendry M, Booth A, Carter B, Charles J, Craine N, Edwards RT, Lyons M, Noyes J, Pasterfield D, et al. Intervention Now To Eliminate Repeat Unintended Pregnancy in Teenagers (INTERUPT): a systematic review of intervention effectiveness and cost-effectiveness, qualitative and realist synthesis of implementation factors and user engagement. BMJ Open. 2014;4(4):e004733.
34. Downe S, Finlayson K, Tuncalp Ö, Metin Gulmezoglu A. What matters to women: a systematic scoping review to identify the processes and outcomes of antenatal care provision that are important to healthy pregnant women. BJOG. 2016;123(4):529-39.
35. Odendaal WA, Goudge J, Griffiths F, Tomlinson M, Leon N, Daniels K: Healthcare workers' perceptions and experience on using mHealth technologies to deliver primary healthcare services: qualitative evidence synthesis (Protocol). Cochrane Database of Systematic Reviews 2015(11):Art. No.: CD011942.
36. Moher D, Schulz KF, Simera I, Altman DG. Guidance for developers of health research reporting guidelines. PLoS Med. 2010;7(2):e1000217.
37. Booth A, Lewin S, Glenton C, Munthe-Kaas HM, Meerpohl J, Rees R, Noyes J, Rashidian A, Berg R, Nyakango B, et al. Applying GRADE-CERQual to qualitative evidence synthesis findings-paper 7: understanding the potential impacts of dissemination bias. Implement Sci. 2018;13(Suppl 1). https://doi.org/10.1186/s13012-017-0694-5.
38. Toews I, Booth A, Berg RC, Lewin S, Glenton C, Munthe-Kaas HM, Noyes J, Schroter S, Meerpohl JJ. Further exploration of dissemination bias in qualitative research required to facilitate assessment within qualitative evidence syntheses. J Clin Epidemiol. 2017;88:133-39.
39. Toews I, Glenton C, Lewin S, Berg RC, Noyes J, Booth A, Marusic A, Malicki M, Munte-Kaas HM, Meerpohl JJ. Extent, awareness and perception of dissemination bias in qualitative research: an explorative survey. PLoS One. 2016;11(8):e0159290.
40. Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, Schunemann HJ, Group GW. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924-6.
41. Barnett-Page E, Thomas J. Methods for the synthesis of qualitative research: a critical review. BMC Med Res Methodol. 2009;9:59.
42. Booth A, Noyes J, Flemming K, Gerhardus A, Wahlster P, Van Der Wilt GJ, Mozygemba K, Refolo P, Sacchini D, Tummers M et al: Guidance on choosing qualitative evidence synthesis methods for use in health technology assessments of complex interventions [online]. Available from: http://www.integrate-hta.eu/downloads/ 2016.
43. Colvin CJ, Garside R, Wainwright M, Lewin S, Bohren M, Glenton C, Munthe-Kaas HM, Carlsen B, Tuncalp Ö, Noyes J, et al. Applying GRADE-CERQual to qualitative evidence synthesis findings-paper 4: how to assess coherence. Implement Sci. 2018;13(Suppl 1). https://doi.org/10.1186/s13012-017-0691-8.
44. Glenton C, Carlsen B, Lewin S, Munthe-Kaas HM, Colvin CJ, Tuncalp Ö, Bohren M, Noyes J, Booth A, Garside R, et al. Applying GRADE-CERQual to qualitative evidence synthesis findings-paper 5: how to assess adequacy of data. Implement Sci. 2018;13(Suppl 1). https://doi.org/10.1186/s13012-017-0692-7.
45. Munthe-Kaas HM, Bohren M, Carlsen B, Glenton C, Lewin S, Colvin CJ, Tuncalp Ö, Noyes J, Booth A, Garside R, et al. Applying GRADE-CERQual to qualitative evidence synthesis findings-paper 3: how to assess methodological limitations. Implement Sci. 2018;13(Suppl 1). https://doi.org/10.1186/s13012-017-0690-9.
46. Noyes J, Booth A, Lewin S, Carlsen B, Glenton C, munthe-Kaas HM, Colvin CJ, Garside R, Bohren M, Rashidian A, et al. Applying GRADE-CERQual to qualitative evidence synthesis findings-paper 6: how to assess relevance of the data. Implement Sci. 2018;13(Suppl 1). https://doi.org/10.1186/s13012-017-0693-6.
47. Glenton C, Lewin S, Norris SL. Using evidence from qualitative research to develop WHO guidelines (Chapter 15). In: World Health Organization, editor. Handbook for Guideline Development. 2nd ed. Geneva: WHO; 2016.
48. Oxman AD, Lewin S, Lavis JN, Fretheim A. SUPPORT tools for evidence-informed health policymaking (STP) 15: engaging the public in evidence-informed policymaking. Health Syst Policy Res. 2009;7(Suppl 1):S15.
49. Abelson J, Blacksher EA, Li KK, Boesveld SE, Goold SD. Public deliberation in health policy and bioethics: mapping an emerging, interdisciplinary field. J Public Deliberation. 2013;9(1)
50. Davies C, Wetherell M, Barnett E. Citizens at the centre: deliberative participation in healthcare decisions. Bristol: Policy Press; 2006.
51. Street J, Duszynski K, Krawczyk S, Braunack-Mayer A. The use of citizens' juries in health policy decision-making: a systematic review. Soc Sci Med. 2014;109:1-9.
52. McCoy DC, Hall JA, Ridge M. A systematic review of the literature for evidence on health facility committees in low- and middle-income countries. Health Policy Plan. 2012;27(6):449-66.
53. Molyneux S, Atela M, Angwenyi V, Goodman C. Community accountability at peripheral health facilities: a review of the empirical literature and development of a conceptual framework. Health Policy Plan. 2012;27(7):541-54.
54. NICE. Community engagement: improving health and wellbeing and reducing health inequalities. NICE Guideline. London, UK: National Institute for Health and Care Excellence (NICE); 2016.
55. Lavis JN, Boyko JA, Oxman AD, Lewin S, Fretheim A. SUPPORT Tools for evidence-informed health Policymaking (STP) 14: organising and using policy dialogues to support evidence-informed policymaking. Health Res Policy Syst. 2009;7(Suppl 1):S14.
56. WHO. Handbook for guideline development (2nd edition). Geneva: World Health Organization; 2016.
57. Daniels N. Accountability for reasonableness. BMJ. 2000;321(7272):1300-1.
58. Daniels N, Sabin JE. Accountability for reasonableness: an update. BMJ. 2008;337:a1850.