Development and validation of an index to measure the quality of facility-based labor and delivery care processes in sub-Saharan Africa

PLoS ONE

Volumn 10, Issue 6, 2015, Pages

  Tripathi, Vandana ^b   Stanton, Cynthia ^a   Strobino, Donna ^a   Bartlett, Linda ^a  

^a JOHNS HOPKINS BLOOMBERG SCHOOL OF PUBLIC HEALTH   (United States)

^b ENGENDERHEALTH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AFRICA SOUTH OF THE SAHARA; ARTICLE; CLINICAL OBSERVATION; COMMUNITY CARE; CONTROLLED STUDY; DELIVERY; DEVELOPING COUNTRY; HEALTH CARE; HEALTH CARE DELIVERY; HEALTH CARE FACILITY; HEALTH CARE QUALITY; HEALTH SERVICE; HUMAN; INTRAPARTUM CARE; KENYA; LABOR; MADAGASCAR; MAJOR CLINICAL STUDY; MATERNAL CARE; MATERNAL MORTALITY; MATERNAL WELFARE; NEWBORN CARE; NEWBORN MORTALITY; PERINATAL MORBIDITY; PUERPERIUM; QUALITY CONTROL; RELIABILITY; TANZANIA; VALIDATION PROCESS; AREA UNDER THE CURVE; FEMALE; INTERNATIONAL COOPERATION; NEWBORN; OBSTETRIC DELIVERY; OBSTETRICS; ORGANIZATION AND MANAGEMENT; PERINATAL CARE; PREGNANCY; PROBABILITY; PROGRAM DEVELOPMENT; RECEIVER OPERATING CHARACTERISTIC; STANDARDS; VALIDATION STUDY;

AFRICA SOUTH OF THE SAHARA; AREA UNDER CURVE; DELIVERY, OBSTETRIC; FEMALE; HUMANS; INFANT, NEWBORN; INTERNATIONAL COOPERATION; KENYA; LABOR, OBSTETRIC; MADAGASCAR; OBSTETRICS; PERINATAL CARE; PREGNANCY; PROBABILITY; PROGRAM DEVELOPMENT; QUALITY ASSURANCE, HEALTH CARE; QUALITY INDICATORS, HEALTH CARE; QUALITY OF HEALTH CARE; ROC CURVE; TANZANIA;

EID: 84939215741     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0129491     Document Type: Article

References (88)

1. World Health Organization. Trends in maternal mortality: 1990 to 2013. Estimates developed by WHO, UNICEF, UNFPA and the World Bank. Geneva: WHO; 2014. 56 p. doi:10.1186/1471-2393-14-299 PMID: 25174573.
2. Lozano R, Wang H, Foreman KJ, Rajaratnam JK, Naghavi M, Marcus JR, et al. Progress towards Millennium Development Goals 4 and 5 on maternal and child mortality: An updated systematic analysis. Lancet 2011; 378: 1139-65. doi:10.1016/S0140-6736(11)61337-8 PMID: 21937100.
3. Hogan MC, Foreman KJ, Naghavi M, Ahn SY, Wang M, Makela SM, et al. Maternal mortality for 181 countries, 1980-2008: A systematic analysis of progress towards millennium development goal 5. Lancet 2010; 375: 1609-23. doi:10.1016/S0140-6736(10)60518-1 PMID: 20382417.
4. Lawn JE, Kerber K, Enweronu-Laryea C, Cousens S. 3.6 million neonatal deaths-what is progressing and what is not? Semin Perinatol 2010; 34: 371-86. doi:10.1053/j.semperi.2010.09.011 PMID: 21094412.
5. Oestergaard MZ, Inoue M, Yoshida S, Mahanani WR, Gore FM, Cousens S, et al; United Nations Inter-Agency Group for Child Mortality Estimation and the Child Health Epidemiology Reference Group. Neonatal mortality levels for 193 countries in 2009 with trends since 1990: A systematic analysis of progress, projections, and priorities. PLoS Med 2011; 8: e1001080. doi:10.1371/journal.pmed.1001080 PMID: 21918640.
6. Lawn JE, Lee AC, Kinney M, Sibley L, Carlo WA, Paul VK, et al. Two million intrapartum-related stillbirths and neonatal deaths: where, why, and what can be done? Int J Gynaecol Obstet 2009; 107 Suppl 1: S5-S18, S19. doi:10.1016/j.ijgo.2009.07.016 PMID: 19815202.
7. United Nations Statistics Division [Internet]. New York: United Nations; c2008. Millennium Development Goals Indicators. Available from: http://mdgs.un.org/unsd/mdg/Host.aspx?Content=Indicators/OfficialList.htm.
8. Dzakpasu S, Soremekun S, Manu A, Ten Asbroek G, Tawiah C, Hurt L, et al. Impact of free delivery care on health facility delivery and insurance coverage in Ghana's Brong Ahafo Region. PLoS One 2012; 7: e49430. doi:10.1371/journal.pone.0049430 PMID: 23173061.
9. Lim SS, Dandona L, Hoisington JA, James SL, Hogan MC, Gakidou E. India's Janani Suraksha Yojana, a conditional cash transfer programme to increase births in health facilities: An impact evaluation. Lancet 2010; 375: 2009-23. doi:10.1016/S0140-6736(10)60744-1 PMID: 20569841.
10. Hodgins S. Achieving better maternal and newborn outcomes: coherent strategy and pragmatic, tailored implementation. Glob Health Sci Pract 2013; 1: 146-153. doi:10.9745/GHSP-D-13-00030 PMID: 25276527.
11. World Health Organization. Pregnancy, Childbirth, Postpartum and Newborn Care: A Guide for Essential Practice, Integrated Management of Pregnancy and Childbirth Toolkit. Geneva: WHO; 2006. 180 p.
12. Shankar A, Bartlett L, Fauveau V, Islam M, Terreri N. Countdown to 2015 Maternal Health Group. Delivery of MDG 5 by active management with data. Lancet 2008; 371: 1223-4. doi:10.1016/S0140-6736(08)60536-X PMID: 18406844.
13. Miller S, Cordero M, Coleman AL, Figueroa J, Brito-Anderson S, Dabagh R, et al. Quality of care in institutionalized deliveries: The paradox of the Dominican Republic. Int J Gynaecol Obstet 2003; 82: 89, 103; discussion 87-8. PMID: 12834953.
14. Randive B, Diwan V, De-Costa A. India's Conditional Cash Transfer Programme (the JSY) to Promote Institutional Birth: Is There an Association between Institutional Birth Proportion and Maternal Mortality? PLoS One 2013; 8: e67452. PMID: 23826302.
15. Powell-Jackson T, Neupane BD, Tiwari S, Tumbahangphe K, Manandhar D. The impact of Nepal's national incentive programme to promote safe delivery in the district of Makwanpur. Adv Health Econ Health Serv Res 2009; 21: 221-49. PMID: 19791705.
16. Baral G. An assessment of the safe delivery incentive program at a tertiary level hospital in Nepal. J Nepal Health Res Counc 2012; 10: 118-24. PMID: 23034373.
17. Firoz T, Sanghvi H, Merialdi M, von-Dadelszen P. Pre-eclampsia in low and middle income countries. Best Pract Res Clin Obstet Gynaecol 2011; 25: 537-48. doi:10.1016/j.bpobgyn.2011.04.002 PMID: 21592865.
18. Harvey SA, Blandón YC, McCaw-Binns A, Sandino I, Urbina L, Rodríguez C, et al. Nicaraguan Maternal and Neonatal Health Quality Improvement Group. Are skilled birth attendants really skilled? A measurement method, some disturbing results and a potential way forward. Bull World Health Organ 2007; 85:783-90. PMID: 18038060.
19. Stanton C, Armbruster D, Knight R, Ariawan I, Gbangbade S, Getachew A, et al. Use of active management of the third stage of labour in seven developing countries. Bull World Health Organ 2009; 87: 207-15. PMID: 19377717.
20. Wall SN, Lee AC, Niermeyer S, English M, Keenan WJ, Carlo W, et al. Neonatal resuscitation in low-resource settings: what, who, and how to overcome challenges to scale up? Int J Gynaecol Obstet 2009; 107: S47-S62, S63-4. doi:10.1016/j.ijgo.2009.07.013 PMID: 19815203.
21. Souza JP, Gülmezoglu AM, Vogel J, Carroli G, Lumbiganon P, Qureshi Z, et al. Moving beyond essential interventions for reduction of maternal mortality (the WHO Multi-country Survey on Maternal and Newborn Health): A cross-sectional study. Lancet 2013; 381: 1747-55. doi:10.1016/S0140-6736(13)60686-8 PMID: 23683641.
22. Campbell OM, Graham WJ; Lancet Maternal Survival Series steering group. Strategies for reducing maternal mortality: getting on with what works. Lancet 2006; 368: 1284-99. PMID: 17027735.
23. Lawn JE, Kerber K, Enweronu-Laryea C, Massee Bateman O. Newborn survival in low resource settings-are we delivering? BJOG 2009; 116: 49-59. doi:10.1111/j.1471-0528.2009.02328.x PMID: 19740173.
24. Ronsmans C, Campbell O. Quantifying the fall in mortality associated with interventions related to hypertensive diseases of pregnancy. BMC Public Health 2011; 11 Suppl 1: S8. doi:10.1186/1471-2458-11-S1-S8PMID: 21356137.
25. Wall SN, Lee AC, Carlo W, Goldenberg R, Niermeyer S, Darmstadt GL, et al. Reducing intrapartum-related neonatal deaths in low-and middle-income countries-what works? Semin Perinatol 2010; 34:395-407. doi:10.1053/j.semperi.2010.09.009 PMID: 21094414.
26. Hinderaker SG, Olsen BE, Bergsjo PB, Gasheka P, Lie RT, Havnen J, et al. Avoidable stillbirths and neonatal deaths in rural Tanzania. BJOG 2003; 110: 616-23. PMID: 12798482.
27. Kongnyuy EJ, Mlava G, van-den-Broek N. Facility-based maternal death review in three districts in the central region of Malawi: An analysis of causes and characteristics of maternal deaths. Womens Health Issues 2009; 19: 14-20. doi:10.1016/j.whi.2008.09.008 PMID: 19111783.
28. Pattinson RC. Challenges in saving babies-avoidable factors, missed opportunities and substandard care in perinatal deaths in South Africa. S Afr Med J 2003; 93: 450-5. PMID: 12916386.
29. Abouchadi S, Alaoui AB, Meski FZ, Bezad R, De-Brouwere V. Preventable maternal mortality in Morocco: The role of hospitals. Trop Med Int Health 2013; 18: 444-50. doi:10.1111/tmi.12065 PMID: 23360349.
30. Kruk ME, Mbaruku G, McCord CW, Moran M, Rockers PC, Galea S. Bypassing primary care facilities for childbirth: A population-based study in rural Tanzania. Health Policy Plan 2009; 24: 279-88. doi:10.1093/heapol/czp011 PMID: 19304785.
31. Parkhurst JO, Ssengooba F. Assessing access barriers to maternal health care: Measuring bypassing to identify health centre needs in rural Uganda. Health Policy Plan 2009; 24: 377-84. doi:10.1093/heapol/czp023 PMID: 19520736.
32. Mselle LT, Moland KM, Mvungi A, Evjen-Olsen B, Kohi TW. Why give birth in health facility? Users' and providers' accounts of poor quality of birth care in Tanzania. BMC Health Serv Res 2013; 13: 174. doi:10.1186/1472-6963-13-174 PMID: 23663299.
33. World Health Organization. Managing Complications in Pregnancy and Childbirth: A Guide for Midwives and Doctors. Geneva, Switzerland: WHO; 2003. 19 p.
34. Maine D. What's So Special About Maternal Mortality? In: Barzelatto J, Berer M, Sundari RTK, editors. Safe motherhood initiatives: critical issues. Oxford: Blackwell Science/Reproductive Health Matters; 1999. p.175-182.
35. Granja AC, Machungo F, Bergstrom S. Avoidability of maternal death in Mozambique: Audit and retrospective risk assessment in 106 consecutive cases. Afr J Health Sci 2008; 7: 83-7.
36. Donabedian A. The Definition of Quality and Approaches to Its Management, Vol 1: Explorations in Quality Assessment and Monitoring. Ann Arbor: Health Administration Press; 1980. 163 p.
37. Donabedian A. The quality of care. How can it be assessed? JAMA 1988; 260: 1743-8. PMID: 3045356.
38. Salinas AM, Coria I, Reyes H, Zambrana M. Effect of quality of care on preventable perinatal mortality. Int J Qual Health Care 1997; 9: 93-9. PMID: 9154495.
39. Anwar I. Perceptions of quality of care for serious illness at different levels of facilities in a rural area of Bangladesh. J Health Popul Nutr 2009; 27: 396-405. PMID: 19507755.
40. Baltussen RM, Ye Y, Haddad S, Sauerborn RS. Perceived quality of care of primary health care services in Burkina Faso. Health Policy Plan 2002; 17: 42-8. PMID: 11861585.
41. Admasu K, Haile-Mariam A, Bailey P. Indicators for availability, utilization, and quality of emergency obstetric care in Ethiopia, 2008. Int J Gynaecol Obstet 2011; 115: 101-5. doi:10.1016/j.ijgo.2011.07.010 PMID: 21855065.
42. Bailey P, Paxton A, Lobis S, Fry D. The availability of life-saving obstetric services in developing countries: An in-depth look at the signal functions for emergency obstetric care. Int J Gynaecol Obstet 2006; 93: 285-91. PMID: 16687145.
43. Spector JM, Agrawal P, Kodkany B, Lipsitz S, Lashoher A, Dziekan G, et al. Improving quality of care for maternal and newborn health: prospective pilot study of the WHO safe childbirth checklist program. PLoS One 2012; 7:e35151. doi:10.1371/journal.pone.0035151 PMID: 22615733.
44. Gouws E, Bryce J, Pariyo G, Armstrong Schellenberg J, Amaral J, Habicht JP. Measuring the quality of child health care at first-level facilities. Soc Sci Med 2005; 61:613-25. PMID: 15899320.
45. Broughton EI, Ikram AN, Sahak I. How accurate are medical record data in Afghanistan's maternal health facilities? An observational validity study. BMJ Open 2014; 3: 10.
46. Chiba Y, Oguttu MA, Nakayama T. Quantitative and qualitative verification of data quality in the childbirth registers of two rural district hospitals in Western Kenya. Midwifery 2012; 28: 329-39. doi:10.1016/j.midw.2011.05.005PMID: 21684639.
47. Duffy S, Crangle M. Delivery room logbook-fact or fiction? Trop Doct 2009; 39: 145-9. doi:10.1258/td.2009.080433PMID: 19535748.
48. Hermida J, Nicholas DD, Blumenfeld SN. Comparative validity of three methods for assessment of the quality of primary health care. Int J Qual Health Care 1999; 11: 429-33 PMID: 10561036.
49. Flood M, Small R. Researching labour and birth events using health information records: methodological challenges. Midwifery 2009; 25: 701-10. doi:10.1016/j.midw.2007.12.003 PMID: 18321619.
50. Lain SJ, Hadfield RM, Raynes-Greenow CH, Ford JB, Mealing NM, Algert CS, et al. Quality of data in perinatal population health databases: A systematic review. Med Care 2012; 50: e7-20 doi:10.1097/MLR.0b013e31821d2b1dPMID: 21617569.
51. Yasmeen S, Romano PS, Schembri ME, Keyzer JM, Gilbert WM. Accuracy of obstetric diagnoses and procedures in hospital discharge data. Am J Obstet Gynecol 2006; 194: 992-1001. PMID: 16580288.
52. Hulton LA, Matthews Z, Stones RW. Applying a framework for assessing the quality of maternal health services in urban India. Soc Sci Med 2007; 64: 2083-95. PMID: 17374551.
53. Bazant E, Rakotovao JP, Rasolofomanana JR, Tripathi V, Gomez P, Favero R, et al. [Quality of care to prevent and treat postpartum hemorrhage and pre-eclampsia/eclampsia: An observational assessment in Madagascar's hospitals]. Med Sante Trop 2013; 23: 168-75. doi:10.1684/mst.2013.0161 PMID: 23694783.
54. Geller SE, Cox SM, Callaghan WM, Berg CJ. Morbidity and mortality in pregnancy: laying the groundwork for safe motherhood. Women's Health Issues 2006; 16: 176-88.
55. Holt J, Fagerli I, Holdø B, Vold IN. Audit of neonatal deaths of nonmalformed infants of 34 or more weeks' gestation: unavoidable catastrophic events or suboptimal care? Acta Obstet Gynecol Scand 2002; 81: 899-904. PMID: 12366478.
56. Lawn JE, Cousens S, Zupan J; Lancet Neonatal Survival Steering Team. 4 million neonatal deaths: when? Where? Why? Lancet 2005; 365: 891-900. PMID: 15752534.
57. Ronsmans C, Graham WJ; Lancet Maternal Survival Series steering group. Maternal mortality: who, when, where, and why. Lancet 2006; 368:1189-200. PMID: 17011946.
58. Boulkedid R, Abdoul H, Loustau M, Sibony O, Alberti C. Using and reporting the Delphi method for selecting healthcare quality indicators: A systematic review. PLoS One 2011; 6:e20476. doi:10.1371/journal.pone.0020476 PMID: 21694759.
59. Hsu C-C, Sandford BA. The Delphi technique: Making sense of consensus. Practical Assessment, Research and Evaluation [Internet]. 2007; 12. Available at: http://pareonline.net/getvn.asp?v=12&n=10.
60. UNICEF [Internet]. Info by Country. New York: UNICEF; c2012. Available at: http://www.unicef.org/infobycountry/.
61. UNICEF. Levels and Trends in Child Mortality; Report 2010. Estimates Developed by the UN Inter-Agency Group for Child Mortality Estimation. New York: 2010. 24p.
62. World Health Organization [Internet]. Geneva: WHO; c2011. Atlas of Health Statistics of the African Region 2011. Available at: http://www.afro.who.int/index.php?option=com-docman&task=doc-download&gid=7011.
63. ACCESS Project. Best Practices in Maternal and Newborn Care: A Learning Resource Package for Essential and Basic Emergency Obstetric and Newborn Care. Baltimore: Jhpiego; 2008. 522 p.
64. Prevention of Postpartum Hemorrhage Initiative [Internet]. Seattle: PATH; c2006. AMTSL Survey: Tools to Conduct a National Survey. Available at: https://www.k4health.org/toolkits/postpartumhemorrhage/amtsl-survey-tools-conduct-national-survey.
65. MCHIP [Internet]. Washington: MCHIP; c2012. Maternal and Newborn Quality of Care Surveys. Available: http://www.mchip.net/node/968.
66. Plotkin M, Tibaijuka G, Makene CL, Currie S, Lacoste M. Quality of Care for Prevention and Management of Common Maternal and Newborn Complications: A study of 12 regions in Tanzania. Baltimore: MCHIP/Jhpiego; 2011. 48 p.
67. Rasolofomanana JR, Rakotovao JP, Bazant E, Tripathi V. Quality of Care of the Prevention and Management of Common Maternal and Newborn Complications in Health Facilities in Madagascar. Baltimore: MCHIP/Jhpiego; 2011. 43 p. 68.
68. Kagema F, Ricca J, Rawlins B, Rosen H, Lynam P, Kidula N. Quality of Care for Prevention and Management of Common Maternal and Newborn Complications: Findings from a National Health Facility Survey in Kenya: Are Services Provided According to International Standards? Baltimore: MCHIP/Jhpiego; 2011. 34 p. 69.
69. Kenya National Coordinating Agency for Population and Development, Kenya Ministry of Medical Services, Kenya Ministry of Public Health and Sanitation, Kenya National Bureau of Statistics, ICF Macro. Kenya Service Provision Assessment Survey 2010. Nairobi: National Coordinating Agency for Population and Development, Ministry of Medical Services, Ministry of Public Health and Sanitation, Kenya National Bureau of Statistics, and ICF Macro; 2011. 695 p.
70. Makene C, Plotkin M, Currie S, Bishanga D, Ugwi P, Louis H, et al. Improvements in newborn care and newborn resuscitation following a quality improvement program at scale: results from a before and after study in Tanzania. BMC Pregnancy Childbirth 2014; 14:381. doi:10.1186/s12884-014-0381-3 PMID: 25406496.
71. Akobeng AK. Understanding diagnostic tests 3: Receiver operating characteristic curves. Acta Paediatr 2007; 96: 644-7. PMID: 17376185.
72. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982; 143: 29-36. PMID: 7063747.
73. Leonard KL, Masatu MC. The use of direct clinician observation and vignettes for health services quality evaluation in developing countries. Soc Sci Med 2005; 61: 1944-51. PMID: 15936863.
74. Gabrysch S, Civitelli G, Edmond KM, Mathai M, Ali M, Bhutta ZA, et al. New signal functions to measure the ability of health facilities to provide routine and emergency newborn care. PLoS Med 2012; 9: e1001340. doi:10.1371/journal.pmed.1001340 PMID: 23152724.
75. De-Bruin-kooistra M, Amelink-Verburg M, Buitendijk SE, Westert GP. Finding the right indicators for assessing quality midwifery care. Int J Qual Health Care 2012; 24: 301-10. doi:10.1093/intqhc/mzs006 PMID: 22457241.
76. Lawn JE, Cousens S, Darmstadt GL, Paul V, Martines J. Why are 4 million newborn babies dying every year? Lancet 2004; 364: 2020. PMID: 15582058.
77. Althabe F, Sosa C, Belizán JM, Gibbons L, Jacquerioz F, Bergel E. Cesarean section rates and maternal and neonatal mortality in low-, medium-, and high-income countries: An ecological study. Birth 2006; 33: 270-7. PMID: 17150064.
78. Souza JP, Cecatti JG, Haddad SM, Parpinelli MA, Costa ML, Katz L, et al; Brazilian Network for Surveillance of Severe Maternal Morbidity Group; Brazilian Network for Surveillance of Severe Maternal Morbidity. The WHO maternal near-miss approach and the maternal severity index model (MSI): Tools for assessing the management of severe maternal morbidity. PLoS One 2012; 7: e44129. doi:10.1371/journal.pone.0044129PMID: 22952897.
79. Villar J, Valladares E, Wojdyla D, Zavaleta N, Carroli G, Velazco A, et al; WHO 2005 global survey on maternal and perinatal health research group. Caesarean delivery rates and pregnancy outcomes: The 2005 WHO global survey on maternal and perinatal health in Latin America. Lancet 2006; 367: 1819-29. PMID: 16753484.
80. Bailit JL. Measuring the quality of inpatient obstetrical care. Obstet Gynecol Surv 2007; 62: 207-13 PMID: 17306043.
81. Mainz J. Defining and classifying clinical indicators for quality improvement. Int J Qual Health Care 2003; 15: 523-30. PMID: 14660535.
82. Paxton A, Bailey P, Lobis S. The United Nations Process Indicators for emergency obstetric care: Reflections based on a decade of experience. Int J Gynaecol Obstet 2006; 95: 192-208. PMID: 17074557.
83. Goodburn EA. Using process indicators to monitor and evaluate obstetric services in developing countries. J Am Med Womens Assoc 2002; 57: 145-8. PMID: 12146605.
84. Dettrick Z, Firth S, Jimenez Soto E. Do strategies to improve quality of maternal and child health care in lower and middle income countries lead to improved outcomes? A review of the evidence. PLoS One 2013; 8: e83070. doi:10.1371/journal.pone.0083070 PMID: 24349435.
85. Nechochea E, Bossemeyer D. Standards-based management and recognition: A field guide. Baltimore: Jhpiego; 2003. 83 p.
86. Rusa L, Ngirabega Jde D, Janssen W, Van-Bastelaere S, Porignon D, et al. Performance-based financing for better quality of services in Rwandan health centres: 3-year experience. Trop Med Int Health 2009; 14: 830-7. doi:10.1111/j.1365-3156.2009.02292.x PMID: 19497081.
87. Eichler R, Auxila P, Pollock J. Performance-based payment to improve the impact of health services: Evidence fromHaiti.World Bank Institute Online Journal: Flagship Program on Health Sector Reform and Sustainable Financing [Internet]. 2001. Available at: http://info.worldbank.org/etools/docs/library/122031/bangkokCD/BangkokMarch05/Week2/2Tuesday/S4GroupWork/performancebasedpayment.pdf.
88. Rowe AK. Potential of integrated continuous surveys and quality management to support monitoring, evaluation, and the scale-up of health interventions in developing countries. Am J Trop Med Hyg 2009; 80:971-9. PMID: 19478260.