Evaluation of capacity-building program of district health managers in India: A contextualized theoretical framework

Frontiers in Public Health

Volumn 2, Issue JUL, 2014, Pages

  Prashanth, N S ^a,b   Marchal, Bruno ^b   Kegels, Guy ^b   Criel, Bart ^b  

^a Institute of Public Health   (India)

^b INSTITUTE OF TROPICAL MEDICINE   (Belgium)

Author keywords

Capacity building; District health management; Health man agers; Health manpower; Human resources for health; Local health system; Realist evaluation; Theory driven research

Indexed keywords

EID: 84995733893     PISSN: None     EISSN: 22962565     Source Type: Journal    
DOI: 10.3389/fpubh.2014.00089     Document Type: Article

References (68)

1. van Olmen J, Criel B, Bhojani U, Marchal B, van Belle S, Chenge MF, et al. The Health System Dynamics Framework: the introduction of an analytical model for health system analysis and its application to two case-studies. Health Cult Soc (2012) 2(1):1-12. doi:10.5195/hcs.2012.71
2. TannerM. Strengthening district health systems. BullWorldHealthOrgan (2005) 83(6):403. doi:10.1590/S0042-96862005000600003
3. World Health Organization. Working Together for Health: The World Health Report 2006.World Health Organization (2006).
4. Cavalli A, Bamba SI, TraoreMN, BoelaertM,Coulibaly Y, Polman K, et al. Inter-actions between global health initiatives and country health systems: the case of a neglected tropical diseases control programinMali. PLoS Negl Trop Dis (2010) 4(8):e798. doi:10.1371/journal.pntd.0000798
5. Keugoung B,Macq J,BuvéA,Meli J,Criel B.The interface between health systems and vertical programmes in francophoneAfrica: themanagers'perceptions.Trop Med Int Health (2011) 16(4):478-85. doi:10.1111/j.1365-3156.2010.02716.x
6. Biesma RG, Brugha R, Harmer A, Walsh A, Spicer N, Walt G. The effects of global health initiatives on country health systems: a review of the evidence from HIV/AIDS control. Health Policy Plan (2009) 24(4):239-52. doi:10.1093/ heapol/czp025
7. DielemanM,Gerretsen B, van derWilt GJ. Human resourcemanagement inter-ventions to improve health workers' performance in low and middle income countries: a realist review. Health Res Policy Syst (2009) 7(1):7. doi:10.1186/ 1478-4505-7-7
8. Adam T, de Savigny D. Systems thinking for strengthening health systems in LMICs: need for a paradigm shift. Health Policy Plan (2012) 27(Suppl 4):iv1-3. doi:10.1093/heapol/czs084
9. Sheikh K, Gilson L, Agyepong IA, Hanson K, Ssengooba F, Bennett S. Building the field of health policy and systems research: framing the questions. PLoSMed (2011) 8(8):e1001073. doi:10.1371/journal.pmed.1001073
10. World Health Organization. Everybody's Business -Strengthening Health Sys-tems to Improve Health Outcomes.WHO's Framework for Action. Geneva:World Health Organization (2007).
11. Siddiqi K, Newell J, Robinson M. Getting evidence into practice: what works in developing countries? Int J Qual Health Care (2005) 17(5):447-53. doi:10.1093/ intqhc/mzi051
12. Goicolea I, Coe AB, Hurtig AK, San Sebastian M. Mechanisms for achieving adolescent-friendly services in Ecuador: a realist evaluation approach. Global Health Action (2012) 5(January):1-14. doi:10.3402/gha.v5i0.18748
13. Wong G, Greenhalgh T,Westhorp G, Buckingham J, Pawson R. RAMESES pub-lication standards: realist syntheses. BMC Med (2013) 11(1):21. doi:10.1186/ 1741-7015-11-21
14. Pawson R, Greenhalgh T,Harvey G,Walshe K. Realist review -a newmethod of systematic review designed for complex policy interventions. J Health Serv Res Policy (2005) 10(Suppl 1):21. doi:10.1258/1355819054308530
15. Prashanth NS,Marchal B, Hoeree T, Devadasan N,Macq J, Kegels G, et al. How does capacity building of health managers work? A realist evaluation study pro-tocol. BMJ Open (2012) 2(2):e000882. doi:10.1136/bmjopen-2012-000882
16. Pawson R. The Science of Evaluation: A Realist Manifesto. 1st ed. London: Sage Publications (2013).
17. Pawson R, Tilley N. Realistic evaluation bloodlines. Am J Eval (2001) 22(3):317-24. doi:10.1177/109821400102200305
18. Marchal B, van Belle S, van Olmen J, Hoeree T, Kegels G. Is realist eval-uation keeping its promise? A review of published empirical studies in the field of health systems research. Evaluation (2012) 18(2):192-212. doi:10.1177/ 1356389012442444
19. Chee G, Pielemeier N, Lion A, Connor C. Why differentiating between health system support and health system strengthening is needed. Int J Health Plann Manage (2013) 28(1):85-94. doi:10.1002/hpm.2122
20. Bennett S, Agyepong IA, Sheikh K, Hanson K, Ssengooba F, Gilson L. Building the field of health policy and systems research: an agenda for action. PLoS Med (2011) 8(8):e1001081. doi:10.1371/journal.pmed.1001081
21. Swanson RC, Bongiovanni A, Bradley E, Murugan V, Sundewall J, Betigeri A, et al. Toward a consensus on guiding principles for health systems strengthen-ing. PLoS Med (2010) 7(12):e1000385. doi:10.1371/journal.pmed.1000385
22. Prashanth NS, Marchal B, Criel B. Evaluating healthcare interventions: answering the "how" question. Indian Anthropol (2013) 43(1):35-50. Avail-able from: http://www.mendeley.com/download/public/160002/6034808704/ 2e50d9be7b137c8126f34dacb27149c4008af420/dl.pdf
23. Svoronos T,Mate KS. Evaluating large-scale health programmes at a district level in resource-limited countries. Bull World Health Organ (2011) 89(11):831-7. doi:10.2471/BLT.11.088138
24. Marchal B, Dedzo M, Kegels G. A realist evaluation of the management of a well-performing regional hospital in Ghana. BMC Health Serv Res (2010) 10:24. doi:10.1186/1472-6963-10-24
25. Kernick D. The demise of linearity in managing health services: a call for post normal health care. J Health Serv Res Policy (2002) 7(2):121-4. doi:10.1258/ 1355819021927782
26. Lipsey MW, Pollard JA. Driving toward theory in program evaluation: more models to choose from. Eval Program Plann (1989) 12:317-28. doi:10.1016/ 0149-7189(89)90048-7
27. Connelly JB. Evaluating complex public health interventions: theory, meth-ods and scope of realist enquiry. J Eval Clin Pract (2007) 13(6):935-41. doi:10.1111/j.1365-2753.2006.00790.x
28. Marchal B, Hoerée T, da Silveira VC, Van Belle S, Prashanth NS, Kegels G. Building on the EGIPPS performance assessment: the multipolar frame-work as a heuristic to tackle the complexity of performance of public ser-vice oriented health care organisations. BMC Public Health (2014) 14(1):378. doi:10.1186/1471-2458-14-378
29. Sicotte C, Champagne F, Contandriopoulos AP, Barnsley J, Béland F, Leggat SG, et al. A conceptual framework for the analysis of health care organization's performance. Health Serv Manage Res (1998) 11(1):24-48.
30. Marchal B. Why Do Some Hospitals Perform Better than Others? A Realist Eval-uation of the Role of Health Workforce Management in Well-Performing Health Care Organisations. Brussels: Faculty of Medicine and Pharmacy, Vrije Univer-siteit Brussel & Institute of Tropical Medicine, Antwerp (2011). Available from: www.itg.be/itgtool_v2/PersonalPages/PersonalPage.asp?Persnr=1665&L=E
31. IPH Tumkur Team. Swasthya Karnataka Training in Tumkur. Bangalore: Insti-tute of Public Health (2011). Available from: https://docs.google.com/file/d/ 0Bxp4UKSObSs9ODI5ZjYwNzktN2U4ZS00MTgyLTk0ZTAtZWQ2YTQzMTE yNzQ4/edit?hl=en_US
32. Hoeree T, Prasad V, Jiang L, Pongsupap Y. External Evaluation of the Tumkur Training Course. Bangalore: Institute of Public Health (2012). Available from: https://docs.google.com/a/iphindia.org/file/d/0B-h6Rqii7VzEdTYyaWtkMjZ MbWs/edit
33. Government of India. National Rural Health Mission (2005-2012) Mission Doc-ument. New Delhi (2005). Available from: http://www.nird.org.in/Brgf/doc/ Rural%20HealthMission_Document.pdf
34. Rowe A, Desavigny D, Lanata C, Victora C. How can we achieve and maintain high-quality performance of health workers in low-resource settings? Lancet (2005) 366(9490):1026-35. doi:10.1016/S0140-6736(05)67028-6
35. Chopra M, Munro S, Lavis JN, Vist G, Bennett S. Effects of policy options for human resources for health: an analysis of systematic reviews. Lancet (2008) 371(9613):668-74. doi:10.1016/S0140-6736(08)60305-0
36. Buchan J. Human resources for health what difference does ("good") HRM make? Hum Resour Health (2004) 2(6):1-7. doi:10.1186/1478-4491-2-6
37. Kirkpatrick DL, Kirkpatrick JD. Evaluating Training Programmes: The Four Lev-els. 3rd ed. San Fransico, CA: Berrett-Koehler Publishers (2006).
38. Bates R. A critical analysis of evaluation practice: the Kirkpatrick model and the principle of beneficence. Eval Program Plann (2004) 27(3):341-7. doi:10.1016/j.evalprogplan.2004.04.011
39. Bandura A. Self-efficacy mechanism in human agency. Am Psychol (1982) 37:122-47. doi:10.1037/0003-066X.37.2.122
40. Meyer JP, Sampo VP, Ian RG, Richard DG, Douglas NJ. Organizational com-mitment and job performance: it's the nature of the commitment that counts. J Appl Psychol (1989) 74(1):152-6. doi:10.1037/0021-9010.74.1.152
41. Maheshwari S, Bhat R, Saha S. Commitment among state health officials & its implications for health sector reform: lessons from Gujarat. Indian J Med Res (2008) 127(2):148-53.
42. MosadeghradAM,Ferlie E,RosenbergD.Astudy of the relationship between job satisfaction, organizational commitment and turnover intention among hospi-tal employees. Health Serv Manage Res (2008) 21(4):211-27. doi:10.1258/hsmr. 2007.007015
43. Marchal B, Dedzo M, Kegels G. Turning around an ailing district hospital: a realist evaluation of strategic changes at Ho Municipal Hospital (Ghana). BMC Public Health (2010) 10(1):787. doi:10.1186/1471-2458-10-787
44. Clarke N. Workplace learning environment and its relationship with learn-ing outcomes in healthcare organizations. Hum Resource Dev Int (2005) 8(2):185-205. doi:10.1080/13678860500100228
45. Jacobs RL, Park Y. A proposed conceptual framework of workplace learn-ing: implications for theory development and research in human resource development. Hum Resource Dev Rev (2009) 8(2):133-50. doi:10.1177/ 1534484309334269
46. Mbindyo P, Gilson L, Blaauw D, English M. Contextual infiuences on health worker motivation in district hospitals in Kenya. Implement Sci (2009) 4(January):43. doi:10.1186/1748-5908-4-43
47. Gray BH. The infiuence of context on quality improvement success in health care: a systematic review of the literature. Milbank Q (2008) 86(4):529-32. doi:10.1111/j.1468-0009.2010.00611.x
48. Squires JE, Estabrooks CA, Scott SD, Cummings GG, Hayduk L, Kang SH, et al. The infiuence of organizational context on the use of research by nurses in Canadian pediatric hospitals. BMC Health Serv Res (2013) 13(1):351. doi:10.1186/1472-6963-13-351
49. Victora CG, Schellenberg JA, Huicho L, Amaral J, El Arifeen S, Pariyo G, et al. Context matters: interpreting impact findings in child survival evaluations. Health Policy Plan (2005) 20(Suppl 1):i18-31. doi:10.1093/heapol/czi050
50. Kapiriri L,Martin DK. Priority setting in developing countries health care insti-tutions: the case of a Ugandan hospital. BMC Health Serv Res (2006) 6:127. doi:10.1186/1472-6963-6-127
51. Byng R, Norman I, Redfern S, Jones R. Exposing the key functions of a com-plex intervention for shared care in mental health: case study of a process evaluation. BMC Health Serv Res (2008) 8(January):274. doi:10.1186/1472-6963-8-274
52. Bigdeli M, Zafar S, Assad H, Ghaffar A. Health system barriers to access and use of magnesium sulfate for women with severe pre-eclampsia and eclampsia in Pakistan: evidence for policy and practice. PLoS One (2013) 8(3):e59158. doi:10.1371/journal.pone.0059158
53. Mills A, Vaughan JP, Smith DL, Tabibzadeh I. Health System Decentraliza-tion: Concepts, Issues and Country Experience (1990). Available from: http: //libdoc.who.int/publications/9241561378.pdf
54. Segall M. District health systems in a neoliberal world: a review of five key policy areas. Int J Health PlannManage (2003) 18(Suppl 1):S5-26. doi:10.1002/ hpm.719
55. Oliveira-Cruz V, Hanson K, Mills A. Approaches to overcoming constraints to effective health service delivery: a review of the evidence. J Int Dev (2003) 15:41-65. doi:10.1002/jid.965
56. Gill K. A Primary Evaluation of Service Delivery under the National Rural Health Mission (NRHM): Findings from a Study in Andhra Pradesh, Uttar Pradesh, Bihar and Rajasthan. Working Paper 1/2009. Planning Com-mission of India, New Delhi (2009). Available from: http://workspace.unpan. org/sites/internet/Documents/primary%20evaluation%20of%20service%20 delivery.pdf
57. Rae-Dupree J. Disruptive Innovation, Applied to Health Care. The New York Times (2009). Available from: http://www.nytimes.com/2009/02/01/business/ 01unbox.html
58. Tuli K. The innovator's prescription: a disruptive solution for health care.NEngl J Med (2009) 360(19):2038-39. doi:10.1056/NEJMbkrev0810803
59. WorldHealthOrganization. TheWorldHealth Report 2008: PrimaryHealth Care Now More than Ever. Geneva:World Health Organization (2008).
60. Bossert TJ. Analyzing the decentralization of health systems in developing countries: decision space, innovation and performance. Soc Sci Med (1998) 47(10):1513-27. doi:10.1016/S0277-9536(98)00234-2
61. Fritzen SA. Strategic management of the health workforce in developing coun-tries: what have we learned? Hum Resour Health (2007) 5:4. doi:10.1186/1478-4491-5-4
62. Bossert TJ, Mitchell AD. Health sector decentralization and local decision-making: decision space, institutional capacities and accountability in Pakistan. Soc Sci Med (2011) 72(1):39-48. doi:10.1016/j.socscimed.2010.10.019
63. Devadasan N, Elias MA. Training Needs Assessment for District Health Man-agers. Bangalore: Institute of Public Health (2008). Available from: http://www. iphindia.org; https://docs.google.com/file/d/0Bxp4UKSObSs9ODlhNjQwNjct MGNlNC00MjhlLWJmY2QtMGVmN2I3YmY2YWE2/edit?hl=en_US
64. Astbury B, Leeuw FL. Unpacking black boxes: mechanisms and theory building in evaluation. Am J Eval (2010) 31(3):363-81. doi:10.1177/1098214010371972
65. Chen HT. Issues in constructing program theory. New Dir Program Eval (2004) 1990(47):7-18. doi:10.1002/ev.1551
66. Pawson R, Tilley N. Realist evaluation. In: DPRN ThematicMeeting 2006 Report on Evaluation. Development Policy Review Network (2008). 35 p.
67. Pawson R, Sanjeev S. Theory-driven evaluation of public health programmes. In: Killoran A, KellyMP, editors. Evidence-Based Public Health: Effectiveness and Efficiency. Oxford: Oxford University Press (2009). p. 41-62.
68. Mitleton-Kelly E. Ten principles of complexity & enabling infrastructures. In: Mitleton-Kelly E, editor. Complex Systems and Evolutionary Perspectives on Organisations: The Application of Complexity Theory to Organisations. Amster-dam: Elsevier (2003). p. 23-50.