Measuring Coverage in MNCH: Design, Implementation, and Interpretation Challenges Associated with Tracking Vaccination Coverage Using Household Surveys

PLoS Medicine

Volumn 10, Issue 5, 2013, Pages

  Cutts, Felicity T ^a   Izurieta, Hector S ^b   Rhoda, Dale A ^c  

^a Independent consultant ^*  (France)

^b CENTER FOR DRUG EVALUATION AND RESEARCH   (United States)

^c BATTELLE MEMORIAL INSTITUTE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BCG VACCINE; DIPHTHERIA PERTUSSIS TETANUS VACCINE; HAEMOPHILUS INFLUENZAE TYPE B VACCINE; MEASLES VACCINE; ORAL POLIOMYELITIS VACCINE; ROTAVIRUS VACCINE;

ARTICLE; COMMUNITY CARE; DECISION MAKING; HEALTH CARE PERSONNEL; HEALTH CARE PLANNING; HEALTH CARE SYSTEM; HEALTH SURVEY; HOUSEHOLD; HUMAN; PROBABILITY; QUALITY CONTROL; QUESTIONNAIRE; VACCINATION; CHILD; CHILD HEALTH CARE; DEVELOPING COUNTRY; EPIDEMIOLOGY; FAMILY SIZE; HEALTH; HEALTH CARE DELIVERY; HEALTH CARE QUALITY; HEALTH CARE SURVEY; HEALTH SERVICES RESEARCH; IMMUNIZATION; INFANT; METHODOLOGY; NEWBORN; PATIENT ATTITUDE; PRESCHOOL CHILD; REPRODUCIBILITY; REVIEW; SAMPLE SIZE; SOCIOECONOMICS; STATISTICAL ANALYSIS; TIME;

CHILD; CHILD HEALTH SERVICES; CHILD, PRESCHOOL; DATA INTERPRETATION, STATISTICAL; DEVELOPING COUNTRIES; FAMILY CHARACTERISTICS; HEALTH CARE SURVEYS; HEALTH SERVICES ACCESSIBILITY; HEALTH SERVICES RESEARCH; HUMANS; IMMUNIZATION SCHEDULE; INFANT; INFANT, NEWBORN; PATIENT ACCEPTANCE OF HEALTH CARE; PROGRAM EVALUATION; QUESTIONNAIRES; REPRODUCIBILITY OF RESULTS; RESEARCH DESIGN; SAMPLE SIZE; SELECTION BIAS; SOCIOECONOMIC FACTORS; TIME FACTORS; VACCINATION; WORLD HEALTH;

EID: 84878279690     PISSN: 15491277     EISSN: 15491676     Source Type: Journal    
DOI: 10.1371/journal.pmed.1001404     Document Type: Article

References (67)

1. Hadler SC, Dietz V, Okwo-Bele JM, Cutts FT (2008) Vaccination programs in developing countries. In: Plotkin SA, Orenstein WA, editors. Vaccines, 5th edition. Philadelphia: Saunders.
2. Brenzel L, Measham A, Naimoli J, Batson A, Bredenkamp C, et al. (2009) Taking stock: World Bank experience with results-based financing (RBF) for health. Washington: The World Bank. Available: http://www.rbfhealth.org/rbfhealth/library/doc/taking-stock-world-bank-experience-results-based-financing-rbf-health. Accessed 29 August 2012.
3. Millenium Challenge Corporation (2011) Report on the criteria and methodology for determining the eligibility of candidate countries for Millennium Challenge Account assistance in fiscal year 2012. Available: https://www.mcc.gov/documents/reports/report-2011001066201-fy12-selection-criteria.pdf. Accessed 29 August 2012.
4. GAVI Alliance (2012) Country eligibility policy. Available: http://www.gavialliance.org/about/governance/programme-policies/country-eligibility/. Accessed 29 August 2012.
5. Lim SS, Stein DB, Charrow A, Murray CJL, (2008) Tracking progress towards universal childhood immunisation and the impact of global initiatives: a systematic analysis of three-dose diphtheria, tetanus, and pertussis immunisation coverage. Lancet 372: 2031-2046.
6. Murray CJL, Shengelia B, Gupta N, Moussavi S, Tandon A, et al. (2003) Validity of reported vaccination coverage in 45 countries. Lancet 362: 1022-1027.
7. Bosch-Capblanch X, Ronveaux O, Doyle V, Remedios V, Bchir A, (2009) Accuracy and quality of immunization information systems in forty-one low income countries. Trop Med Int Health 14: 2-10.
8. Burton T, Neil M, Okwo-Bele JM, Salama P, Wardlaw T, (2009) Measurement of immunisation coverage. Lancet 373: 210-211.
9. Dietz V, Venczel L, Izurieta H, Stroh G, Zell ER, et al. (2004) Assessing and monitoring vaccination coverage levels: lessons from the Americas. Rev Panam Salud Publica 16: 432-442.
10. Hull B, Dey A, Mahajan D, Menzies R, McIntyre PB, (2011) Immunisation coverage annual report, 2009. Commun Dis Intell Q Rep 35: 132-148.
11. Ronveaux O, Arrieta F, Curto S, Laurani H, Danovaro-Holliday M, (2009) Assessment of the quality of immunization data produced by the national individual registration system in Uruguay, 2006. Rev Panam Salud Publica 26: 153-160.
12. Luhm KR, Cardoso MRA, Waldman EA, (2011) Vaccination coverage among children under two years of age based on electronic immunization registry in Southern Brazil. Rev Saude Publica 45: 90-98.
13. Crowcroft NS, (2009) Action on immunisation: no data, no action. Arch Dis Child 94: 829-830.
14. PATH (2012) Rethinking the vaccine supply chain. Available: http://www.path.org/projects/project-optimize. Accessed 29 August 2012.
15. Burton A, Monasch R, Lautenbach B, Gacic-Dobo M, Neill M, et al. (2009) WHO and UNICEF estimates of national infant immunization coverage: methods and processes. Bull World Health Organ 87: 535-541.
16. MEASURE DHS Demographic and Health Surveys. Available: http://www.measuredhs.com/. Accessed 1 June 2012.
17. UNICEF. Statistics and Monitoring: Multiple Indicator Cluster Survey. Available: http://www.unicef.org/statistics/index_24302.html. Accessed 29 June 2012.
18. Hancioglu A, Arnold F, (2013) Measuring coverage in MNCH: Tracking progress in health for women and children using DHS and MICS household surveys. PLoS Med 10: e1001391 doi:10.1371/journal.pmed.1001391.
19. Henderson RH, Sundaresan T, (1982) Cluster sampling to assess immunization coverage: a review of experience with a simplified sampling method. Bull World Health Organ 60: 253-260.
20. World Health Organization (1991) Facilitator guide for the EPI coverage survey. Available: http://www.who.int/immunization_monitoring/routine/Facilitator_guide_EPI_coverage_survey.pdf. Accessed 3 January 2013.
21. World Health Organization (2005) Immunization coverage cluster survey-reference manual. Available: http://whqlibdoc.who.int/hq/2005/WHO_IVB_04.23.pdf. Accessed 29 October 2012.
22. Grais RF, Rose AMC, Guthmann JP, (2007) Don't spin the pen: two alternative methods for second-stage sampling in urban cluster surveys. Emerg Themes Epidemiol 4: 8.
23. Luman ET, Worku A, Berhane Y, Martin R, Cairns L, (2007) Comparison of two survey methodologies to assess vaccination coverage. Int J Epidemiol 36: 633-641.
24. Milligan P, Alpha N, Bennett S, (2004) Comparison of two cluster sampling methods for health surveys in developing countries. Int J Epidemiol 33: 469-476.
25. Myatt M, Feleke T, Sadler K, Collins S, (2005) A field trial of a survey method for estimating the coverage of selective feeding programmes. Bull World Health Organ 83: 20-26.
26. Turner AG, Magnani RJ, Shuaib M, (1996) A not quite as quick but much cleaner alternative to the Expanded Programme on Immunization (EPI) cluster survey design. Int J Epidemiol 25: 198-203.
27. World Health Organization (2012) Sample design and procedures for hepatitis B immunization surveys: a companion to the WHO cluster survey reference manual. Available: http://whqlibdoc.who.int/hq/2011/WHO_IVB_11.12_eng.pdf. Accessed 29 August 2012.
28. Cotter B, Bremer V, Stroh G, Msambichaka K, Mabuzane E, et al. (2003) Assessment of neonatal tetanus elimination in an African setting by lot quality assurance cluster sampling (LQA-CS). Epidemiol Infect 130: 221-226.
29. Pezzoli L, Pineda S, Halkyer P, Crespo G, Andrews N, et al. (2009) Cluster-sample surveys and lot quality assurance sampling to evaluate yellow fever immunisation coverage following a national campaign, Bolivia, 2007. Trop Med Int Health 14: 355-361.
30. Kim SH, Pezzoli L, Yacouba H, Coulibaly T, Djingarey MH, et al. (2012) Whom and where are we not vaccinating? Coverage after the introduction of a new conjugate vaccine against group A meningococcus in Niger in 2010. PLoS ONE 7: e29116 doi:10.1371/journal.pone.0029116.
31. World Health Organization (2012) Assessing vaccination coverage levels using clustered Lot Quality Assurance Sampling: field manual-version edited for the Global Polio Eradication Initiative (GPEI). Available: http://www.polioeradication.org/Portals/0/Document/Research/OPVDelivery/LQAS.pdf. Accessed 29 August 2012.
32. Jahn A, Floyd S, Mwinuka V, Mwafilaso J, Mwagomba D, et al. (2008) Ascertainment of childhood vaccination histories in northern Malawi. Trop Med Int Health 13: 129-138.
33. Cutts FT, Smith PG, Colombo S, Mann G, Ascherio A, et al. (1990) Field evaluation of measles vaccine efficacy in Mozambique. Am J Epidemiol 131: 349-355.
34. World Health Organization (2012) World immunization week 2012. Available: http://www.who.int/immunization/newsroom/events/immunization_week/en/index.html. Accessed 15 May 2012.
35. Gareaballah ET, Loevinsohn BP, (1989) The accuracy of mother's reports about their children's vaccination status. Bull World Health Organ 67: 669-674.
36. Langsten R, Hill K, (1998) The accuracy of mothers' reports of child vaccination: evidence from rural Egypt. Soc Sci Med 46: 1205-1212.
37. Valadez JJ, Weld LH, (1992) Maternal recall error of child vaccination status in a developing nation. Am J Public Health 82: 120-122.
38. Clark A, Sanderson C, (2009) Timing of children's vaccinations in 45 low-income and middle-income countries: an analysis of survey data. Lancet 373: 1543-1549.
39. Dayan GH, Shaw KM, Baughman AL, Orellana LC, Forlenza R, et al. (2006) Assessment of delay in age-appropriate vaccination using survival analysis. Am J Epidemiol 163: 561-570.
40. Luman ET, Barker LE, Shaw KM, McCauley MM, Buehler JW, et al. (2005) Timeliness of childhood vaccinations in the United States. JAMA 293: 1204-1211.
41. Babirye JN, Engebretsen IMS, Makumbi F, Fadnes LT, Wamani H, et al. (2012) Timeliness of childhood vaccinations in Kampala Uganda: a community-based cross-sectional study. PLoS ONE 7: e35432 doi:10.1371/journal.pone.0035432.
42. Eisele T, Rhoda DA, Cutts FT, Keating J, Ren R, et al. (2013) Measuring coverage in MNCH: Total survey error and the interpretation of intervention coverage estimates from household surveys. PLoS Med 10: e1001386 doi:10.1371/journal.pmed.1001386.
43. Bennett S, Radalowicz A, Vella V, Tomkins A, (1994) A computer simulation of household sampling schemes for health surveys in developing countries. Int J Epidemiol 23: 1282-1291.
44. Lemeshow S, Tserkovnyi AG, Tulloch JL, Dowd JE, Lwanga SK, et al. (1985) A computer simulation of the EPI survey strategy. Int J Epidemiol 14: 473-481.
45. Brown J, Monasch R, Bicego G, Burton A, Boerma JT (2002) An assessment of the quality of national child immunization coverage estimates in population-based surveys. Chapel Hill (North Carolina): MEASURE Evaluation, Carolina Population Center, University of North Carolina at Chapel Hill. Available: http://www.cpc.unc.edu/measure/publications/wp-02-53/at_download/document. Accessed 29 August 2012.
46. Little RJA, Rubin DB (2002) Statistical analysis with missing data. Hoboken (New Jersey): John Wiley & Sons.
47. Schafer JL (1997) Analysis of incomplete multivariate data. Boca Raton (Florida): Chapman & Hall/CRC.
48. Rutstein SO, Rojas G (2006) Guide to DHS statistics. Calverton (Maryland): Demographic and Health Surveys, ORC Macro.
49. Bosch-Capblanch X, Banerjee K, Burton A, (2012) Unvaccinated children in years of increasing coverage: how many and who are they? Evidence from 96 low- and middle-income countries. Trop Med Int Health 17: 697-710.
50. de Quadros CA, Olive JM, Hersh BS, Strassburg MA, Henderson DA, et al. (1996) Measles elimination in the Americas. Evolving strategies. JAMA 275: 224-229.
51. Simons E, Ferrari M, Fricks J, Wannemuehler K, Anand A, et al. (2012) Assessment of the 2010 global measles mortality reduction goal: results from a model of surveillance data. Lancet 379: 2173-2178.
52. Orenstein WA, Bernier RH, Dondero TJ, Hinman AR, Marks JS, et al. (1985) Field evaluation of vaccine efficacy. Bull World Health Organ 63: 1055-1068 Available: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2536484/pdf/bullwho00089-0084.pdf. Accessed 29 August 2012.
53. Bharti N, Tatem AJ, Ferrari MJ, Grais RF, Djibo A, et al. (2011) Explaining seasonal fluctuations of measles in Niger using nighttime lights imagery. Science 334: 1424-1427.
54. Brown DW, (2012) Child immunization cards: essential yet underutilized in national immunization programmes. Open Vaccine J 5: 1-7.
55. World Health Organization (2011) India: WHO and UNICEF estimates of immunization coverage: 2011 revision. Available: http://www.who.int/immunization_monitoring/data/ind.pdf. Accessed 29 June 2012.
56. World Health Organization (2011) Nigeria: WHO and UNICEF estimates of immunization coverage: 2011 revision. Available: http://www.who.int/immunization_monitoring/data/nga.pdf. Accessed 29 August 2012.
57. World Health Organization (2006) Tetanus vaccine WHO position paper. Wkly Epidemiol Rec 85: 197-208.
58. Izurieta H, Venczel L, Dietz V, Tambini G, Barrezueta O, et al. (2003) Monitoring measles eradication in the region of the Americas: critical activities and tools. J Infect Dis 187: S133-S139.
59. Cutts F, Hall A, (2004) Vaccines for neonatal viral infections: hepatitis B vaccine. Expert Rev Vaccines 3: 349-352 Accessed 29 August 2012.
60. Tapia MD, Pasetti MF, Cuberos L, Sow SO, Doumbia MN, et al. (2006) Measurement of tetanus antitoxin in oral fluid: a tool to conduct serosurveys. Pediatr Infect Dis J 25: 819-825.
61. Fortuin M, Maine N, Mendy M, Hall A, George M, et al. (1995) Measles, polio and tetanus toxoid antibody levels in Gambian children aged 3 to 4 years following routine vaccination. Trans R Soc Trop Med Hyg 89: 326-329.
62. Nigatu W, Nokes D, Enquselassie F, Brown D, Cohen B, et al. (1999) Detection of measles specific IgG in oral fluid using an FITC/anti-FITC IgG capture enzyme linked immunosorbent assay (GACELISA). J Virol Methods 83: 135-144.
63. Nigatu W, Samuel D, Cohen B, Cumberland P, Lemma E, et al. (2008) Evaluation of a measles vaccine campaign in Ethiopia using oral-fluid antibody surveys. Vaccine 26: 4769-4774.
64. Ahmed S, Ali D, Bisharat L, Hill A, LaFond A, et al. (2009) Evaluation of UNICEF Multiple Indicator Cluster Surveys round 3 (MICS3) final report. Boston (Massachusetts): John Snow. Available: http://www.unicef.org/evaldatabase/files/MICS.pdf. Accessed 29 August 2012.
65. Rheingans R, Atherly D, Anderson J, (2012) Distributional impact of rotavirus vaccination in 25 GAVI countries: estimating disparities in benefits and cost-effectiveness. Vaccine 30 (Suppl 1) (): A15--A23 Available: http://ac.els-cdn.com/S0264410X12000333/1-s2.0-S0264410X12000333-main.pdf?_tid=41e1f1f9a28236cbe2409273fa8fecc4&acdnat=1340737914_ce1e78df52b569cf4a045350c373885c. Accessed 29 August 2012.
66. Rhoda DA, Fernandez SA, Fitch DJ, Lemeshow S, (2010) LQAS: user beware. Int J Epidemiol 39: 60-68.
67. World Health Organization (2012) Table 2: summary of WHO position papers-recommended routine immunizations for children. Available: http://www.who.int/immunization/policy/Immunization_routine_table2.pdf. Accessed 23 July 2012.