Evaluating health systems strengthening interventions in low-income and middle-income countries: Are we asking the right questions?

Health Policy and Planning

Volumn 27, Issue SUPPL. 4, 2012, Pages

  Adam, Taghreed ^a   Hsu, Justine ^b   De Savigny, Don ^c   Lavis, John N ^d,e   Rottingen, John Arne ^f,g   Bennett, Sara ^h  

^a WORLD HEALTH ORGANIZATION   (Switzerland)

^b LONDON SCHOOL OF HYGIENE AND TROPICAL MEDICINE   (United Kingdom)

^c UNIVERSITY OF BASEL   (Switzerland)

^d MCMASTER UNIVERSITY   (Canada)

^e MCMASTER UNIVERSITY   (Canada)

^f HARVARD UNIVERSITY   (United States)

^g UNIVERSITY OF OSLO   (Norway)

^h JOHNS HOPKINS BLOOMBERG SCHOOL OF PUBLIC HEALTH   (United States)

Author keywords

Evaluation; health policy and health systems research; health systems; methods; systems thinking

Indexed keywords

DEVELOPING COUNTRY; EVALUATION; HEALTH CARE QUALITY; REVIEW; STANDARD;

DEVELOPING COUNTRIES; EVALUATION STUDIES AS TOPIC; PROGRAM EVALUATION; QUALITY ASSURANCE, HEALTH CARE;

EID: 84866913834     PISSN: 02681080     EISSN: 14602237     Source Type: Journal    
DOI: 10.1093/heapol/czs086     Document Type: Review

References (44)

1. Adam T, Ahmad S, Bigdeli M, Ghaffar A, Røttingen J-A. 2011. Trends in health policy and systems research over the past decade: still too little capacity in low-income countries. Plos One 6: e27263.
2. Alliance for Health Policy and Systems Research. 2011. Implementation Research Platform. Online at: http://www.who.int/alliance-hpsr/projects/ implementationresearch/en/index.html, accessed 30 August 2012.
3. Arifeen SE, Hoque DME, Akter T et al. 2009. Effect of the Integrated Management of Childhood Illness strategy on childhood mortality and nutrition in a rural area in Bangladesh: a cluster randomised trial. The Lancet 374: 393-403.
4. Bennett S, Adam T, Zarowsky C et al. 2008. From Mexico to Mali: progress in health policy and systems research. The Lancet 372: 1571-8.
5. Bennett S, Agyepong IA, Sheikh K et al. 2011. Building the field of health policy and systems research: an agenda for action. Plos Medicine 8(8): e1001081.
6. Best A, Clark PI, Leischow SJ, Trochim WM. 2007. Greater Than the Sum: Systems Thinking in Tobacco Control. Bethesda, MD: National Cancer Institute, US Department of Health and Human Services, National Institutes of Health.
7. Butland B, Jebb S, Kopelman P et al. 2007. Foresight: Tackling Obesities: Future Choices. London: UK Government Office for Science.
8. Celletti F, Wright A, Palen J et al. 2010. Can the deployment of community health workers for the delivery of HIV services represent an effective and sustainable response to health workforce shortages? Results of a multicountry study. AIDS 24: S45-57.
9. Cohen J. 1960. A coefficient of agreement for nominal scales. Educational and Psychological Measurement 20: 37-46.
10. de Savigny D, Adam T. 2009. Systems Thinking for Health Systems Strengthening. Geneva: Alliance for Health Policy and Systems Research, World Health Organization.
11. Doherty T, Chopra M, Nsibande D, Mngoma D. 2009. Improving the coverage of the PMTCT programme through a participatory quality improvement intervention in South Africa. BMC Public Health 9: 406.
12. El-Jardali F, Adam T, Ataya N, Jamal D, Jaafar M. Constraints to applying systems thinking concepts in health systems: a regional perspective from Eastern Mediterranean countries. Forthcoming.
13. Evans T, Nishtar S, Atun R, Etienne C. 2008. Scaling up research and learning for health systems: time to act. The Lancet 372: 1529-31.
14. Gilson L, Hanson K, Sheikh K et al. 2011. Building the field of health policy and systems research: social science matters. Plos Medicine 8(8): e1001079.
15. Hawe P, Shiell A, Riley T, Gold L. 2004. Methods for exploring implementation variation and local context within a cluster randomised community intervention trial. Journal of Epidemiology & Community Health 58: 788-93.
16. Landis JR, Koch GG. 1977. Measurement of observer agreement for categorical data. Biometrics 33: 159-74.
17. Leischow SJ, Best A, Trochim WM et al. 2008. Systems thinking to improve the public's health. American Journal of Preventive Medicine 35(2 Suppl.): S196-203.
18. Leischow SJ, Milstein B. 2006. Systems thinking and modeling for public health practice. American Journal of Public Health 96: 403-5.
19. Lewin S, Lavis JN, Oxman AD et al. 2008. Alma-Ata: Rebirth and revision 2-Supporting the delivery of cost-effective interventions in primary health-care systems in low-income and middle-income countries: an overview of systematic reviews. The Lancet 372: 928-39.
20. Loevinsohn B, ul Haq I, Couffinhal A, Pande A. 2009. Contracting-in management to strengthen publicly financed primary health services-The experience of Punjab, Pakistan. Health Policy 91: 17-23.
21. Masiye F, Chitah BM, McIntyre D. 2010. From targeted exemptions to user fee abolition in health care: Experience from rural Zambia. Social Science & Medicine 71: 743-50.
22. Mills A. 2012. Health policy and systems research: defining the terrain; identifying the methods. Health Policy and Planning 27: 1-7.
23. Mills A, Gilson L, Hanson K, Palmer N, Lagarde M. 2008. What do we mean by rigorous health-systems research? The Lancet 372: 1527-9.
24. Oakley A, Strange V, Bonell C, Allen E, Stephenson J. 2006. Process evaluation in randomised controlled trials of complex interventions. British Medical Journal 332: 413-6.
25. Paina L, Peters DH. 2011. Understanding pathways for scaling up health services through the lens of complex adaptive systems. Health Policy and Planning 27: 365-73.
26. Remme JHF. 2010. Community-directed interventions for priority health problems in Africa: results of a multicountry study. Bulletin of the World Health Organization 88: 509-18.
27. Remme JHF, Adam T, Becerra-Posada F et al. 2010. Defining research to improve health systems. Plos Medicine 7(11): e1001000.
28. Ritz LS, Adam T, Laing R. 2010. A bibliometric study of publication patterns in access to medicines research in developing countries. Southern Medical Review 3: 2-6.
29. Rocha R, Soares RR. 2010. Evaluating the impact of community-based health interventions: evidence from Brazil's family health program. Health Economics 19: 126-58.
30. Rychetnik L, Frommer M, Hawe P, Shiell A. 2002. Criteria for evaluating evidence on public health interventions. Journal of Epidemiology and Community Health 56: 119-27.
31. Savedoff WD, Levine R, Birdsall N. 2006. When Will We Ever Learn? Improving lives through impact evaluation. Washington, DC: Centre for Global Development.
32. Schellenberg JRM, Adam T, Mshinda H et al. 2004. Effectiveness and cost of facility-based Integrated Management of Childhood Illness (IMCI) in Tanzania. The Lancet 364: 1583-94.
33. Shiell A, Hawe P, Gold L. 2008. Complex interventions or complex systems? Implications for health economic evaluation. British Medical Journal 336: 1281-3.
34. Swanson RC, Bongiovanni A, Bradley E et al. 2010. Toward a consensus on guiding principles for health systems strengthening. Plos Medicine 7(12): e1000385.
35. Swanson RC, Mosley H, Sanders D et al. 2009. Call for global health-systems impact assessments. The Lancet 374: 433-5.
36. Trochim WM, Cabrera DA, Milstein B, Gallagher RS, Leischow SJ. 2006. Practical challenges of systems thinking and modeling in public health. American Journal of Public Health 96: 538-46.
37. van Etten G, Baltussen R, Bijlmakers L, Niessen L. 2006. Advancing the Mexico agenda for health systems research-from clinical efficacy to population health. Tropical Medicine & International Health 11: 1145-6.
38. Victora CG, Habicht JP, Bryce J. 2004. Evidence-based public health: moving beyond randomized trials. American Journal of Public Health 94: 400-5.
39. Witter S, Dieng T, Mbengue D, Moreira I, De Brouwere V. 2010. The national free delivery and caesarean policy in Senegal: evaluating process and outcomes. Health Policy and Planning 25: 384-92.
40. World Bank. 2011. World Development Indicators 2011. Washington, DC: World Bank.
41. World Health Organization. 2000. The World Health Report 2000: Health systems: Improving performance. Geneva: World Health Organization.
42. World Health Organization. 2005. World Health Assembly Resolution (WHA58.34) Ministerial Summit on Health Research. Geneva: World Health Organization.
43. World Health Organization. 2007. Everybody's Business: Strengthening Health Systems to Improve Health Outcomes: WHO's Framework for Action. Geneva: World health Organization.
44. Youngleson MS, Nkurunziza P, Jennings K et al. 2010. Improving a mother to child HIV transmission programme through health system redesign: quality improvement, protocol adjustment and resource addition. Plos One 5(11): e13891.