Systematic reviews of clinical practice guidelines: a methodological guide

Journal of Clinical Epidemiology

Volumn 108, Issue , 2019, Pages 64-76

  Johnston, Amy ^a   Kelly, Shannon E ^a   Hsieh, Shu Ching ^a   Skidmore, Becky ^b   Wells, George A ^a,c  

^a UNIVERSITY OF OTTAWA HEART INSTITUTE   (Canada)

^b Independent information specialist   (Canada)

^c UNIVERSITY OF OTTAWA   (Canada)

Author keywords

Clinical practice guidelines; Evidence based medicine; Research methodology; Systematic review

Indexed keywords

ARTICLE; HUMAN; PRACTICE GUIDELINE; SCIENTIST; SYNTHESIS; SYSTEMATIC REVIEW; EVIDENCE BASED MEDICINE; PUBLICATION;

EVIDENCE-BASED MEDICINE; HUMANS; PRACTICE GUIDELINES AS TOPIC; PUBLICATIONS; SYSTEMATIC REVIEWS AS TOPIC;

EID: 85059481178     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2018.11.030     Document Type: Article

References (71)

1. Clinical practice guidelines we can trust. Graham, R., Mancher, M., Miller Wolman, D., Greenfield, S., Steinberg, E., (eds.) Institute of Medicine (US) Committee on Standards for Developing Trustworthy Clinical Practice Guidelines, 2011, National Academies Press (US), Washington, DC.
2. Crosby, E., Review article: the role of practice guidelines and evidence-based medicine in perioperative patient safety. Can J Anesth 60:2 (2013), 143–151.
3. Rosenfeld, R.M., Nnacheta, L.C., Corrigan, M.D., Clinical consensus statement development manual. Otolaryngol Head Neck Surg 153:2 suppl (2015), S1–S14.
4. Guidelines for clinical practice: from development to use. Field, M.J., Lohr, K.N., (eds.) Institute of Medicine (US) Committee on Clinical Practice Guidelines, 1992, National Academies Press (US), Washington, DC.
5. The Cochrane Collaboration. About Cochrane reviews: what is a systematic review?. Available at http://www.cochranelibrary.com/about/about-cochrane-systematic-reviews.html, 2018.
6. Aromataris, E., Fernandez, R., Godfrey, C.M., Holly, C., Khalil, H., Tungpunkom, P., Summarizing systematic reviews: methodological development, conduct and reporting of an umbrella review approach. Int J Evid Based Healthc 13:3 (2015), 132–140.
7. Higgins, J.P.T., Green, S., (eds.) Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration, 2011, The Cochrane Collaboration Available from: www.handbook.cochrane.org.
8. Gough, D., Oliver, S., Thomas, J., An introduction to systematic reviews. 2012, SAGE Publications, Thousand Oaks, California.
9. Uman, L.S., Information management for the busy practitioner: systematic reviews and meta-analyses. J Am Acad Child Adolesc Psychiatry 20:1 (2011), 57–59.
10. Khan, K.S., Kunz, R., Kleijnen, J., Antes, G., Five steps to conducting a systematic review. J R Soc Med 96:3 (2003), 118–121.
11. Godfrey, C., Harrison, M., Systematic review resource package. Joanna Briggs Inst Reviewers’ Man, 4, 2015, 30.
12. Centre for Reviews and Dissemination. Systematic reviews: CRD's guidance for undertaking reviews in health care. 2009, University of York, York, UK.
13. Dixon-Woods, M., Agarwal, S., Jones, D., Young, B., Sutton, A., Synthesising qualitative and quantitative evidence: a review of possible methods. J Health Serv Res Policy 10 (2005), 45–53.
14. Grant, M.J., Booth, A., A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J 26 (2009), 91–108.
15. Korhonen, A., Hakulinen-Viitanen, T., Jylha, V., Holopainen, A., Meta-synthesis and evidence-based health care–a method for systematic review. Scand J Caring Sci 27:4 (2013), 1027–1034.
16. Yao, L., Chen, Y., Wang, X., Shi, X., Wang, Y., Guo, T., et al. Appraising the quality of clinical practice guidelines in traditional Chinese medicine using AGREE II instrument: a systematic review. Int J Clin Pract 71 (2017), 1–8.
17. O'Donoghue, K.J.M., Reed, R.D., Knight, S.R., O'Callaghan, J.M., Ayaz-Shah, A.A., Hassan, S., et al. Systematic review of clinical practice guidelines in kidney transplantation. BJS Open 1:4 (2017), 97–105.
18. Knight, S., Takagi, M., Fisher, E., Anderson, V., Lannin, N.A., Tavender, E., et al. A systematic critical appraisal of evidence-based clinical practice guidelines for the rehabilitation of children with moderate or severe acquired brain injury. Arch Phys Med Rehabil, 2018 pii: S0003-9993(18)30392-7.
19. Jiang, M., Guan, W., Fang, Z., Xie, Y., Xie, J., Chen, H., et al. A critical review of the quality of cough clinical practice guidelines. Chest 150 (2016), 777–788.
20. MacQueen, G., Santaguida, P., Keshavarz, H., Jaworska, N., Levine, M., Beyene, J., et al. Systematic review of clinical practice guidelines for failed antidepressant treatment response in major depressive disorder, dysthymia, and subthreshold depression in adults. Can J Psychiatry 62:1 (2017), 11–23.
21. Acuna, S.A., Lam, W., Daly, C., Kim, S.J., Baxter, N.N., Cancer evaluation in the assessment of solid organ transplant candidates: a systematic review of clinical practice guidelines. Transplant Rev (Orlando) 32:1 (2018), 29–35.
22. Erickson, J., Sadeghirad, B., Lytvyn, L., Slavin, J., Johnston, B.C., The scientific basis of guideline recommendations on sugar intake: a systematic review. Ann Intern Med 166 (2017), 257–267.
23. Kim, J.K., Chua, M.E., Ming, J.M., Santos, J.D., Zani-Ruttenstock, E., Marson, A., et al. A critical review of recent clinical practice guidelines on management of cryptorchidism. J Pediatr Surg 53 (2018), 2041–2047.
24. Simons, P., Cosgrove, L., Shaughnessy, A.F., Bursztajn, H., Antipsychotic augmentation for major depressive disorder: a review of clinical practice guidelines. Int J Law Psychiatry 55 (2017), 64–71.
25. Chiappini, E., Bortone, B., Galli, L., de Martino, M., Guidelines for the symptomatic management of fever in children: systematic review of the literature and quality appraisal with AGREE II. BMJ Open, 7(7), 2017, e015404.
26. Molenaar, N.M., Kamperman, A.M., Boyce, P., Bergink, V., Guidelines on treatment of perinatal depression with antidepressants: an international review. Aust N Z J Psychiatry 52:4 (2018), 320–327.
27. Unit, Ontario Drug Policy Research Network Systematic Review, Low molecular weight heparin: a review of clinical guidelines across indications. 2015, 5 Toronto.
28. Bush, S.H., Marchington, K.L., Agar, M., Davis, D.H.J., Sikora, L., Tsang, T.W.Y., Quality of clinical practice guidelines in delirium: a systematic appraisal. BMJ Open, 7(3), 2017, e013809.
29. Jakes, A.D., Marec-berard, P., Phillips, R.S., Cantab, M.A., Oxon, B.M., Stark, D.P., et al. Critical review of clinical practice guidelines for fertility preservation in teenagers and young adults with cancer., 3(4), 2014, 144–152.
30. Tonelli, M., Conner Gorber, S., Moore, A., Thombs, B.D., Recommendations on routine screening pelvic examination. Can Fam Physician 62 (2016), 2014–2017.
31. Mattivi, J.T., Buchberger, B., [Rapid reviews: Sisyphos' salvation? - an inventory]. Gesundheitswesen 79:5 (2017), 438–442.
32. Tricco, A.C., Antony, J., Zarin, W., Strifler, L., Ghassemi, M., Ivory, J., et al. A scoping review of rapid review methods. BMC Med, 13(1), 2015, 224.
33. Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., Moher, D., Evidence summaries: the evolution of a rapid review approach. Syst Rev, 1(1), 2012, 10.
34. Kelly, S.E., Moher, D., Clifford, T.J., Defining rapid reviews: a modified Delphi consensus approach. Int J Technol Assess Health Care 32:4 (2016), 265–275.
35. Jolliffe, L., Lannin, N., Hoffmann, T., Evidence-based rehabilitation interventions for adults with acquired brain injury: a systematic review of clinical practice guidelines to identify current best practice recommendations. 2016, PROSPERO International prospective register of systematic reviews, University of York, York, UK.
36. Methley, A.M., Campbell, S., Chew-Graham, C., McNally, R., Cheraghi-Sohi, S., PICO, PICOS and SPIDER: a comparison study of specificity and sensitivity in three search tools for qualitative systematic reviews. BMC Health Serv Res, 14, 2014, 579.
37. DistillerSR, 2018, Evidence Partners, Ottawa, ON.
38. Covidence, 2018, Cochrane, London, UK.
39. Woolf, S.H., Grol, R., Hutchinson, A., Eccles, M., Grimshaw, J., Potential benefits, limitations, and harms of clinical guidelines. BMJ, 318, 1999, 527.
40. Siering, U., Eikermann, M., Hausner, E., Hoffmann-Eßer, W., Neugebauer, E.A., Appraisal tools for clinical practice guidelines: a systematic review. PLoS One, 8, 2013, e82915.
41. Kashyap, N., Dixon, J., Michel, G., Brandt, C., Shiffman, R., GLIA Guideline Implementability Appraisal V. 2.0. 2011, Yale University: Yale Center for Medical Informatics, New Haven, CT.
42. Brouwers, M.C., Kho, M.E., Browman, G.P., Burgers, J.S., Cluzeau, F., Feder, G., et al. AGREE II: advancing guideline development, reporting and evaluation in health care. CMAJ 182:18 (2010), 1308–1311.
43. German instrument for methodological guideline appraisal in deutsches instrument zur methodischen leitlinien-bewertung (DELBI). Kopp, I., Thole, H., Selbmann, H.K., Ollenschlaeger, G., (eds.) Association of the scientific medical societies in germany and agency for quality in medicine, 2008 Available from: https://www.leitlinien.de/mdb/edocs/pdf/literatur/german-guideline-appraisal-instrument-delbi.pdf.
44. Hoffmann-Eßer, W., Siering, U., Neugebauer, E.A.M., Brockhaus, A.C., Lampert, U., Eikermann, M., Guideline appraisal with AGREE II: systematic review of the current evidence on how users handle the 2 overall assessments. PLoS One 12 (2017), 1–15.
45. The, A.C., Collaboration, A., Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project. Qual Saf Health Care 12 (2003), 18–23.
46. Brouwers, M.C., Kerkvliet, K., Spithof, K., The AGREE reporting checklist: a tool to improve reporting of clinical practice guidelines. BMJ, 352, 2016, i1152.
47. Hoffmann-Eßer, W., Siering, U., Neugebauer, E.A.M., Lampert, U., Eikermann, M., Systematic review of current guideline appraisals performed with the appraisal of guidelines for research & evaluation II instrument—a third of AGREE II users apply a cut-off for guideline quality. J Clin Epidemiol 95 (2018), 120–127.
48. Brouwers, M., Florez, I.D., Spithoff, K., Evaluating the clinical credibility and implementability of clinical practice guideline recommendations using the AGREE-REX tool. Global Evidence Summit, 2017, Cochrane Colloquium Abstracts, Cape Town, South Africa.
49. Brouwers, M.C., Team, AGREE-REX Research, AGREE-REX: Recommendation EXcellence Application, AGREE-REX. 2016 Available from: http://www.agreetrust.org/wp-content/uploads/2016/01/AGREE-REX-Manual-Appl-testing.pdf McMaster University.
50. Johnston, A., Hsieh, S.C., Carrier, M., Kelly, S.E., Bai, Z., Skidmore, B., et al. A systematic review of clinical practice guidelines on the use of low molecular weight heparin and fondaparinux for the treatment and prevention of venous thromboembolism: implications for research and policy decision-making. PLoS One, 13, 2018, e0207410.
51. Watine, J., Friedberg, B., Nagy, E., Onody, R., Oosterhuis, W., Bunting, P.S., et al. Conflict between guideline methodologic quality and recommendation validity: a potential problem for practitioners. Clin Chem 52 (2006), 65–72.
52. Guyatt, G.H., Oxman, A.D., Vist, G.E., Kunz, R., Falck, Y., Alonso-coello, P., et al. Rating quality of evidence and strength of recommendations: GRADE: an emerging consensus on rating quality of evidence and strength of recommendations rating quality of evidence of recommendations grade: of evidence an emerging and consensus of on rati. Br Med J 336 (2008), 924–926.
53. Finfgeld-Connett, D., A guide to qualitative meta-synthesis. 2018, Taylor & Francis, New York, NY.
54. Mohammed, M.A., Moles, R.J., Chen, T.F., Meta-synthesis of qualitative research: the challenges and opportunities. Int J Clin Pharm 38:3 (2016), 695–704.
55. Graham, I.D., Harrison, M.B., Evaluation and adaptation of clinical practice guidelines. Evid Based Nurs 8:3 (2005), 68–72.
56. Sprague, A.E., Oppenheimer, L., McCabe, L., Brownlee, J., Graham, I.D., Davies, B., The Ottawa hospital's clinical practice guidelinefor the second stage of labour. J Obstet Gynaecol Can 28:9 (2006), 769–779.
57. Bates, S.M., Greer, I.A., Middeldorp, S., Veenstra, D.L., Prabulos, A.M., Vandvik, P.O., et al. VTE, thrombophilia, antithrombotic therapy, and pregnancy: antithrombotic therapy and prevention of thrombosis, 9th ed.: American College of Chest Physicians Evidence-Based Clinical Practice Guidelines. Chest 141 (2012), e691S–e736S.
58. Cardiovascular Disease Educational Research Trust, European Venous Forum, North American Thrombosis Forum, International Union of Angiology, Union Internationale du Phlebologie, Prevention and treatment of venous thromboembolism: international consensus statement (guidelines according to scientific evidence). Clin Appl Thromb Hemost 19:2 (2013), 116–225.
59. James, A., Obstetrics Committee On Practice Bulletins, Practice bulletin no. 123: thromboembolism in pregnancy. Obstet Gynecol 118:3 (2011), 718–729.
60. Guyatt, A.D., Oxman, Kunz, R., Vist, G.E., Falck-Ytter, Y., Schünemann, H.J., et al. What is “quality of evidence” and why is it important to clinicians?. BMJ 336:7651 (2008), 995–998.
61. Schünemann, H.J., Fretheim, A., Oxman, A.D., Improving the use of research evidence in guideline development: 9. Grading evidence and recommendations. Health Res Policy Syst 4 (2006), 1–7.
62. Hoffmann, T., Bennett, S., Del Mar, C., Chapter 13- clinical practice guidelines. Evidence-Based Practice Across the Health Professions, 2017, Elsevier, Chatswood, NSW.
63. Team Members, Abikus Project, ABIKUS Acquired Brain Injury Knowledge Uptake Strategy ABIKUS evidence-based recommendations for rehabilitation of moderate to severe acquired brain injury (2007). 2007 Available from: https://www.abiebr.com/pdf/abikus_aug_07.pdf.
64. Hsieh, H.F., Shannon, S.E., Three approaches to qualitative content analysis. Qual Health Res 15 (2005), 1277–1288.
65. Jolliffe, L., Lannin, N.A., Cadilhac, D.A., Hoffmann, T., Systematic review of clinical practice guidelines to identify recommendations for rehabilitation after stroke and other acquired brain injuries. BMJ Open, 8(2), 2018, e018791.
66. Bosch, M., Tavender, E., Bragge, P., Gruen, R., Green, S., How to define 'best practice' for use in Knowledge Translation research: a practical, stepped and interactive process. J Eval Clin Pract 19 (2013), 763–768.
67. NVivo qualitative data analysis Software, 2012, QSR International Pty Ltd, Doncaster, VIC.
68. Hess, D.R., How to write an effective discussion. Respir Care 49:10 (2004), 1238–1241.
69. Moher, D., Liberati, A., Tetzlaff, J., Altman, D.G., PRISMA Group, Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med 151 (2009), 264–269 w64.
70. Murad, M.H., Wang, Z., Guidelines for reporting meta-epidemiological methodology research. Evid Based Med 22:4 (2017), 139–142.
71. G. Guest, K.M. MacQueen, and E.E. Namey. Writing up thematic analyses, in Applied thematic analysis 2012, SAGE Publications, Inc.: Thousand Oaks, CA. p. 241-278.