Health systems guidance appraisal-a critical interpretive synthesis

Implementation Science

Volumn 11, Issue 1, 2016, Pages

  Ako Arrey, Denis E ^a   Brouwers, Melissa C ^a   Lavis, John N ^a   Giacomini, Mita K ^a   Haines, Andy ^b   Dolea, Carmen Mihaela ^c   El Jardali, Fadi ^d   Cluzeau, Francoise ^e   Govin, Govin Permanand ^c   Gómez, Iván Darío Flórez ^f   Ross, Jillian ^g   Cuervo, Luis Gabriel ^h   Wilson, Mike ^a   Perel, Pablo ^b   Warde, Paidgraig ^g   Ongolo, Pierre ⁱ   McNair, Sheila ^j   Panisset, Ulysses ^c   Bosch Capblanch, Xavier ^k   Chen, Yaolong ^l  

^a MCMASTER UNIVERSITY   (Canada)

^b LONDON SCHOOL OF HYGIENE AND TROPICAL MEDICINE   (United Kingdom)

^c WORLD HEALTH ORGANIZATION   (Switzerland)

^d AMERICAN UNIVERSITY OF BEIRUT   (Lebanon)

^e NATIONAL INSTITUTE FOR HEALTH AND CARE EXCELLENCE   (United Kingdom)

^f UNIVERSIDAD DE ANTIOQUIA   (Colombia)

^g CANCER CARE ONTARIO   (Canada)

^h PAN AMERICAN HEALTH ORGANIZATION   (United States)

ⁱ Centre for the Development of Best Practices in Health   (Cameroon)

^j Program for Evidence Based Care   (Canada)

^k SWISS TROPICAL AND PUBLIC HEALTH INSTITUTE   (Switzerland)

^l LANZHOU UNIVERSITY   (China)

more..

Author keywords

AGREE HS; Guidance appraisal; Guidance development; Guidance reporting; Health systems arrangements; Health systems challenges; Health systems guidance

Indexed keywords

DATA BASE; DATA EXTRACTION; DATA SYNTHESIS; HUMAN; NARRATIVE; SCREENING; SYSTEMATIC REVIEW; HEALTH CARE DELIVERY; HEALTH CARE QUALITY; LITERATURE; QUALITATIVE RESEARCH; STANDARDS;

DELIVERY OF HEALTH CARE; HUMANS; QUALITATIVE RESEARCH; QUALITY OF HEALTH CARE; REVIEW LITERATURE AS TOPIC;

EID: 84957977566     PISSN: None     EISSN: 17485908     Source Type: Journal    
DOI: 10.1186/s13012-016-0373-y     Document Type: Review

References (93)

1. Roemer M. I. National health systems of the world, vol. 1: the countries. New York: Oxford University Press; 1991. p. 97.
2. World Health Organization. The World Health Report 2000. Health systems: improving performance. Geneva, 2000. [accessed 9 July 2013] Available from: http://www.who.int/whr/2000/en/
3. Hoffman S, Rottingen J-A, Bennett S, Lavis J, Edge J, Frenk J. Background paper on conceptual issues related to health systems research to inform a WHO global strategy on health systems research-a working paper in progress. Geneva: World Health Organisation; 2012. p. 2013.
4. Bosch-Capblanch X, Lavis JN, Lewin S, Atun R, Røttingen JA, Dröschel D, et al. Guidance for evidence-informed decisions about health systems: rationale for and challenges of guidance development. PLoS Med. 2012;9:e1001185.
5. Lavis JN, Røttingen JA, Bosch-Capblanch X, Atun R, El-Jardali F, Gilson L, et al. Guidance for evidence-informed policies about health systems: linking guidance development to policy development. PLoS Med. 2012;9:e1001186.
6. Remme JHF, Adam T, Becerra-Posada F, D'Arcangues C, Devlin M, Gardner C, et al. Defining research to improve health systems. PLoS Med. 2010;7(11):e1001000.
7. Fryatt R, Mills A, Nordstrom A. Financing of health systems to achieve the health Millennium Development Goals in low-income countries. Lancet. 2010;375:419-26.
8. Murray C, Frenk J. A WHO framework for health system performance assessment. Bull World Health Organ. 2000;78:717-31.
9. World Health Organization. Fifty-eighth World Health Assembly, A58/22, 1-7. Geneva: Author; 2005. WHA58.34: Ministerial Summit on Health Research.
10. Bosch-Capblanch X. Handbook for developing health systems guidance. Swiss: TPH; 2010. Analytical framework for health systems guidance.
11. World Health Organization. Health system strengthening: improving support to policy dialogue around national health policies, strategies and plans. Report by the Secretariat to the 64th World Health Assembly. A64/12. Geneva: World Health Organization; 2011. Retrieved on October 4th 2013 from http://apps.who.int/gb/ebwha/pdf_files/WHA64/A64_12-en.pdf.
12. Wilson MG, Moat KA, Lavis JN. The global stock of research evidence relevant to health systems policymaking. Health Res Policy Syst. 2013;11(32):10-1186.
13. Bosch-Capblanch X. Handbook for supporting the development of health system guidance. Basel: Swiss Centre for International Health; 2011.
14. Travis P, Bennett S, Haines A, Pang T, Bhutta Z, Hyder A, et al. Overcoming health-systems constraints to achieve the Millennium Development Goals. Lancet. 2004;364:900-6.
15. Chopra M, Lawn J, Sanders D, Barron P. Achieving the health millennium development goals for South Africa: challenges and priorities. Lancet. 2009;374:1023-31.
16. Brouwers M, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al.Appraisal of Guidelines for Research and Evaluation. AGREE II Instrument. The AGREE Next Steps Consortium. 2009. Available from: http://www.agreetrust.org/resource-centre/agree-ii/. [Accessed: 2013 Aug 23].
17. SUPPORT. Supporting policy relevant reviews and trials. 2012. Available: http://www.support-collaboration.org/index.htm. Accessed 30 January 2013.
18. Brettle A. Information skills training: a systematic review of the literature. Health Info Libr J. 2003;20 Suppl 1:3-9.
19. Heaton J, Corden A, Parker G. 'Continuity of care': a critical interpretive synthesis of how the concept was elaborated by a national research programme (2012). Int J Integrated Care. 2012;12.
20. Dixon-Woods M, Agarwal S, Jones D, Young B, Sutton A. Synthesising qualitative and quantitative evidence: a review of possible methods. J Health Serv Res Policy. 2005;10(1):45-53.
21. Dixon-Woods M, Kirk MD, Agarwal MS, Annandale E, Arthur T, Harvey J, et al. Vulnerable groups and access to health care: a critical interpretive review. National Coordinating Centre NHS Service Delivery Organ RD (NCCSDO). 2005.
22. Taylor TL, Killaspy H, Wright C, Turton P, White S, Kallert TW, et al. A systematic review of the international published literature relating to quality of institutional care for people with longer term mental health problems. BMC Psychiatry. 2009;9(1):55.
23. Barnett-Page E, Thomas J. Methods for the synthesis of qualitative research: a critical review. BMC Med Res Methodol. 2009;9(1):59.
24. Gysels MH, Evans C, Higginson IJ. Patient, caregiver, health professional and researcher views and experiences of participating in research at the end of life: a critical interpretive synthesis of the literature. BMC Med Res Methodol. 2012;12(1):123.
25. Entwistle V, Firnigl D, Ryan M, Francis J, Kinghorn P. Which experiences of health care delivery matter to service users and why? A critical interpretive synthesis and conceptual map. J Health Serv Res Policy. 2012;17(2):70-8.
26. Kazimierczak KA, Skea ZC, Dixon-Woods M, Entwistle VA, Feldman-Stewart D, N'dow JM, et al. Provision of cancer information as a "support for navigating the knowledge landscape": findings from a critical interpretive literature synthesis. Eur J Oncol Nurs. 2013;17(3):360-9.
27. Dixon-Woods M, Cavers D, Agarwal S, Annandale E, Arthur A, Harvey J, et al. Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups. BMC Med Res Methodol. 2006;6:35. doi: 10.1186/1471-2288-6-35.
28. Dixon-Woods M, Bonas S, Booth A, Jones DR, Miller T, Sutton AJ, et al. How can systematic reviews incorporate qualitative research? A critical perspective. Qual Res. 2006;6(1):27-44.
29. Talseth AG, Gilje FL. Nurses' responses to suicide and suicidal patients: a critical interpretive synthesis. J Clin Nurs. 2011;20(11-12):1651-67.
30. Morrison LG, Yardley L, Powell J, Michie S. What design features are used in effective e-health interventions? A review using techniques from critical interpretive synthesis. Telemedicine and e-Health. 2012;18(2):137-44.
31. Noblit GW, Hare RD. Meta-ethnography: synthesising qualitative studies. London: Sage; 1988.
32. Markoulakis R, Kirsh B. Difficulties for university students with mental health problems: a critical interpretive synthesis. Rev High Educ. 2013;37(1):77-100.
33. Eakin JM, Mykhalovskiy E. Reframing the evaluation of qualitative health research: reflections on a review of appraisal guidelines in the health sciences. J Eval Clin Pract. 2003;9:187-94.
34. Flemming K. Synthesis of quantitative and qualitative research: an example using critical interpretive synthesis. J Adv Nurs. 2010;66(1):201-17.
35. Dickersin K, Scherer R, Lefebvre C. Identifying relevant studies for systematic reviews. BMJ. 1994;309(6964):1286-91.
36. Seale C. The quality of qualitative research. London: Sage Publications; 1999.
37. Annandale E, Harvey J, Cavers D, Dixon-Woods M. Gender and access to healthcare in the UK: a critical interpretive synthesis of the literature. Evid Policy. 2007;3(4):463-86.
38. Sandelowski M, Docherty S, Emden C. Focus on qualitative methods. Qualitative meta-synthesis: issues and techniques. Res Nurs Health. 1997;20:365-71.
39. Dixon-Woods M, Shaw R, Agarwal S, Smith J. The problem of appraising qualitative research. Qual Saf Health Care. 2004;13:223-5.
40. Gough D. Weight of evidence: a framework for the appraisal of the quality and relevance of evidence. In: Furlong J, Oancea A, editors. Special Edition of Research Papers in Education, 22 (2): 213-228. 2007.
41. Burnard P. A method of analysing transcripts in qualitative research. Nurse Educ Today. 1991;11:461-6.
42. Graneheim UH, Lundman B. Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness. Nurse Educ Today. 2004;24:105-12.
43. Strauss A, Corbin J. Basics of qualitative research: grounded theory procedures and techniques. 2nd ed. Newbury Park: Sage; 1998.
44. Walt G, Gibson L. Reforming the health sector in developing countries: the central role of policy analysis. Health Policy Plan. 1994;9:353-70.
45. Walt G, Shiffman J, Schneider H, Murray SF, Brugha R, Gilson L. 'Doing' health policy analysis: methodological and conceptual reflections and challenges. Health Policy Plan. 2008;23(5):308-17.
46. Buse K, Mays N, Walt G. Making health policy. Berkshire: Open University Press; 2005.
47. Ostrom E. Institutional rational choice: an assessment of the institutional analysis and development framework. In: Sabatier PA, editor. Theories of the policy process. 2nd ed. Boulder: Westview Press; 2007. p. 21-64.
48. Collins C, Green A, Hunter D. Health sector reform and the interpretation of policy context. Health Policy Plan. 1999;47:69-83.
49. WHO, World Health Organization. Sound choices: enhancing capacity for evidence-informed health policy. Geneva. 2007
50. Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder Get al. AGREE II: advancing guideline development, reporting and evaluation in health care. CMAJ 2010. DOI:10.1503/cmaj.090449
51. World Health Organization. "Guidelines for WHO guidelines." EIP/GPE/EqC/2003.1. Geneva: Author; 2003. Retrieved Jan 28, 2013.
52. Health Canada. Recognition and use of standards under the medical devices regulations. 2009. Retrieved on October 1st, 2013 from http://www.hc-sc.gc.ca/dhp-mps/md-im/applic-demande/guide-ld/md_gd_standards_im_ld_normes-eng.php.
53. Davies E, Littlejohns P. Views of directors of public health about NICE appraisal guidance: results of a postal survey. J Public Health. 2002;24(4):319-25.
54. Shaw CD, Kalo I. A background for national quality policies in health systems. 2002. Retrieved on August 19th 2013 from http://apps.who.int/iris/handle/10665/107458.
55. Arah OA, Klazinga NS, Delnoij DMJ, Ten Asbroek AHA, Custers T. Conceptual frameworks for health systems performance: a quest for effectiveness, quality, and improvement. Int J Qual Health Care. 2003;15(5):377-98.
56. Islam M. Health systems assessment approach: a how-to manual. 2007. Retrieved on August 17th 2013 from http://www.urc-chs.com/uploads/resourcefiles/Health_Systems_Assessment.pdf.
57. National Health and Medical Research Council - NHMRC. Standards and procedures for externally developed guidelines. 2007. Retrieved on August 16th 2013 from https://www.nhmrc.gov.au/_files_nhmrc/publications/attachments/nh56_nhmrc_standards_procedures_externally_developed_guidelines_131223.pdf.
58. World Health Organization - WHO. The health systems assessment approach: a how to manual: guidance on assessing health system building blocks. 2012. Retrieved on October 4th 2013 from http://www.healthsystemassessment.com/wp-content/uploads/2012/06/Section-3-Module-3-1-_HSAA-Manual-August-2012-11.pdf.
59. Funk M, Drew N, Faydi E. Checklist for evaluating a mental health policy. Retrieved August 19th 2013 from http://www.who.int/mental_health/policy/WHOPolicyChecklist_forwebsite.pdf.
60. National Health Services - NHS. How to use NICE guidance to commission high quality services. 2009. Retrieved October 4th 2013 from http://www.gserve.nice.org.uk/media/027/17/HowToCommissioningGuideFinal.pdf.
61. Øvretveit J, Klazinga N. Guidance on developing quality and safety strategies with a health system approach. 2008. Retrieved on August 17th 2013 from http://www.euro.who.int/__data/assets/pdf_file/0011/96473/E91317.pdf.
62. Van der Sluijs JP, Petersen AC, Janssen PH, Risbey JS, Ravetz JR. Exploring the quality of evidence for complex and contested policy decisions. Environ Res Lett. 2008;3(2):024008. anual.
63. Lewin S, Bosch-Capblanch X, Oliver S, kl EA, Vist GE, Lavis JN, et al. Guidance for evidence-informed policies about health systems: assessing how much confidence to place in the research evidence. PLoS Med. 2012;9(3):e1001187.
64. Arah OA, Westert GP, Hurst J, Klazinga NS. A conceptual framework for the OECD health care quality indicators project. Int J Qual Health Care. 2006;18 suppl 1:5-13.
65. Oxman AD, Fretheim A, Schünemann HJ. Improving the use of research evidence in guideline development: 14. Reporting guidelines. Health Res Policy Syst. 2006;4:26.
66. National Health Services - NHS. Methods for the development of NICE public health guidance (second edition). 2009. Retrieved October 4th 2013 from http://www.gserve.nice.org.uk/media/CE1/F7/CPHE_Methods_manual_LR.pdf.
67. Moga C, Guo B, Schopflocher D, Harstall C. Development of a quality appraisal tool for case series studies using a modified delphi technique. Edmonton: Institute of Health Economics (IHE); 2012.
68. International Centre for Allied Health Evidence - iCAHE. The iCAHE guideline quality checklist. Retrieved on August 19th 2013 from http://www.biomedcentral.com/content/supplementary/1471-2288-14-63-s1.pdf.
69. World Health Organization - WHO. Practical guidance for scaling up health service innovations. 2009. Retrieved on October 5th 2013 from http://www.expandnet.net/PDFs/WHO_ExpandNet_Practical_Guide_published.pdf.
70. Bosch-Capblanch X, Allen C. Health systems strengthening and conflict: transformation in fragile states. 2012. Retrieved on August 17th 2013 from http://www.evidenceaid.org/wp-content/uploads/2013/05/MMI_for_Evidence:Aid_XBC_revised_by_MC.pdf.
71. German RR, Lee LM, Horan JM, Milstein RL, Pertowski CA, Waller MN. Updated guidelines for evaluating public health surveillance systems: recommendations from the Guidelines Working Group. MMWR Morb Mortal Wkly Rep Recomm Rep. 2001;50:1-35.
72. Murray CJ, Frenk J. A WHO framework for health system performance assessment. Evidence and information for policy, World Health Organization. 1999.
73. Atun R. Health systems, systems thinking and innovation. Health Policy Plan. 2012;27 suppl 4:iv4-8.
74. Orem JN, Wavamunno JB, Bakeera SK, Criel B. Do guidelines influence the implementation of health programs?-Uganda's experience. Implement Sci. 2012;7(1):1-16.
75. Oxman AD, Lavis JN, Lewin S, Fretheim A. SUPPORT Tools for evidence-informed health Policymaking (STP) 1: What is evidence-informed policymaking? Health Res Policy Syst. 2009;7 Suppl 1:S1.
76. Moher D, Schulz KF, Simera I, Altman DG. Guidance for developers of health research reporting guidelines. PLoS Med. 2010;7(2):e1000217.
77. Phillips AC, Lewis LK, McEvoy MP, Galipeau J, Glasziou P, Hammick M, et al. Protocol for development of the guideline for reporting evidence based practice educational interventions and teaching (GREET) statement. BMC Med Educ. 2013;13(1):9.
78. Lomas J, Culyer T, Mccutcheon C, Law S, Tetroe J. Conceptualizing and combining evidence for health system guidance. 2005. Retrieved on October 4th 2013 from http://www.cfhi-fcass.ca/migrated/pdf/insightAction/evidence:e.pdf.
79. Bryce J, Requejo JH, Moulton LH, Ram M, Black RE. A common evaluation framework for the African Health Initiative. BMC Health Serv Res. 2013;13 Suppl 2:S10.
80. American Psychological Association -APA- Criteria for practice guideline development and evaluation. Am Psychol. 2002;57:1048-51.
81. Wilson P. How to find the good and avoid the bad or ugly: a short guide to tools for rating quality of health information on the internet. BMJ. 2002;324(7337):598.
82. German BACKUP Initiative - GIZ. Guidance on integrating gender-specific issues into health systems strengthening activities. 2011. Retrieved on October 4th 2013 from http://www.genderingermandevelopment.net/files/images/pdf/Gender_Mainstreaming/giz2011-en-gender-dimensions-in-health-systems.pdf.
83. Hoffman S, Lavis J, Bennett S. The use of research evidence in two international organizations' recommendations about health systems. Healthcare Policy. 2009;5(1):66-86.
84. Perpiñán Abellán JM, Sánchez Martínez FI, Martínez Pérez JE. Quality assessment of economic evaluations in health care: a checklist and user guide. Rev Esp Salud Publica. 2009;83(1):71-84.
85. Kingdon JW, Thurber JA. Agendas, alternatives, and public policies (vol. 45). Boston: Little, Brown. Chicago; 1984.
86. Murray CJ, Evans DB. Health system performance assessment: debates, methods, and empiricism. Geneva: World Health Organization; 2003. Retrieved on August 17th 2013 from http://whqlibdoc.who.int/publications/2003/9241562455.pdf.
87. Travis P, Bennett S, Haines A, Pang T, Bhutta Z, Hyder AA, et al. Overcoming health-systems constraints to achieve the Millennium Development Goals. Lancet. 2004;364(9437):900-6.
88. Schünemann HJ, Fretheim A, Oxman AD, WHO Advisory Committee on Health Research. Improving the use of research evidence in guideline development: 1. Guidelines for guidelines. Health Res Policy Syst. 2006;4(13):1-6.
89. Savigny D, Adam T (Eds.). Systems thinking for health systems strengthening. World Health Organization. 2009. Retrieved on August 17th 2013 from http://apps.who.int/iris/bitstream/10665/44204/1/9789241563895_eng.pdf.
90. Swanson RC, Bongiovanni A, Bradley E, Murugan V, Sundewall J, Betigeri A, et al. Toward a consensus on guiding principles for health systems strengthening. PLoS Med. 2010;7(12):e1000385.
91. Etienne C, Asamoa-Baah A, Evans DB. Health systems financing: the path to universal coverage. World Health Organization. (2010): Retrieved on August 17th 2013 from http://apps.who.int/iris/bitstream/10665/44371/1/9789241564021_eng.pdf.
92. Sheikh K, Gilson L, Agyepong IA, Hanson K, Ssengooba F, Bennett S. Building the field of health policy and systems research: framing the questions. PLoS Med. 2011;8(8):e1001073.
93. Peters DH, Bennett S. Better guidance is welcome, but without blinders. PLoS Med. 2012;9(3):e1001188.