Theoretical Basis of the Test-Negative Study Design for Assessment of Influenza Vaccine Effectiveness

American Journal of Epidemiology

Volumn 184, Issue 5, 2016, Pages 345-353

  Sullivan, Sheena G ^a,b,c   Tchetgen, Eric J Tchetgen ^d   Cowling, Benjamin J ^e  

^a PETER DOHERTY INSTITUTE FOR INFECTION AND IMMUNITY   (Australia)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF MELBOURNE   (Australia)

^d HARVARD SCHOOL OF PUBLIC HEALTH   (United States)

^e UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

causal inference; directed acyclic graphs; epidemiologic methods; influenza; observational studies; test negative study design; vaccine effectiveness

Indexed keywords

INFLUENZA VACCINE;

EPIDEMIOLOGY; EXPERIMENTAL DESIGN; HEALTH CARE; INFLUENZA; OBSERVATIONAL METHOD; THEORETICAL STUDY; VACCINATION; VACCINE;

ARTICLE; CONTROLLED STUDY; DRUG EFFICACY; GENERAL PRACTITIONER; HUMAN; INFLUENZA; INFLUENZA VACCINATION; LABORATORY TEST; MEDICAL HISTORY; OBSERVATIONAL STUDY; SELECTION BIAS; STUDY DESIGN; TEST NEGATIVE STUDY DESIGN; THEORETICAL STUDY; AGE; CASE CONTROL STUDY; DRUG EFFECTS; DRUG SCREENING; EPIDEMIOLOGY; HEALTH SURVEY; IMMUNOLOGY; INFLUENZA, HUMAN; ISOLATION AND PURIFICATION; ORTHOMYXOVIRIDAE; PATIENT ATTITUDE; PROCEDURES; SEX DIFFERENCE; STANDARDS; VIROLOGY;

ORTHOMYXOVIRIDAE;

AGE FACTORS; CASE-CONTROL STUDIES; CONFOUNDING FACTORS (EPIDEMIOLOGY); DRUG EVALUATION; EPIDEMIOLOGIC RESEARCH DESIGN; HUMANS; INFLUENZA VACCINES; INFLUENZA, HUMAN; ORTHOMYXOVIRIDAE; PATIENT ACCEPTANCE OF HEALTH CARE; POPULATION SURVEILLANCE; SEX FACTORS;

EID: 84994701903     PISSN: 00029262     EISSN: 14766256     Source Type: Journal    
DOI: 10.1093/aje/kww064     Document Type: Article

References (72)

1. Barr IG, McCauley J, Cox N, et al. Epidemiological, antigenic and genetic characteristics of seasonal influenza A(H1N1), A(H3N2) and B influenza viruses: basis for the WHO recommendation on the composition of influenza vaccines for use in the 2009-2010 Northern Hemisphere season. Vaccine. 2010;28(5):1156-1167.
2. Jackson ML, Nelson JC. The test-negative design for estimating influenza vaccine effectiveness. Vaccine. 2013;31(17): 2165-2168.
3. Sullivan SG, Feng S, Cowling BJ. Potential of the test-negative design for measuring influenza vaccine effectiveness: a systematic review. Expert Rev Vaccines. 2014;13(12):1571-1591.
4. Broome CV, Facklam RR, Fraser DW. Pneumococcal disease after pneumococcal vaccination: an alternative method to estimate the efficacy of pneumococcal vaccine. N Engl J Med. 1980;303(10):549-552.
5. Skowronski D, Gilbert M, Tweed S, et al. Effectiveness of vaccine against medical consultation due to laboratoryconfirmed influenza: results from a sentinel physician pilot project in British Columbia, 2004-2005. Can Commun Dis Rep. 2005;31(18):181-191.
6. Orenstein EW, De Serres G, Haber MJ, et al. Methodologic issues regarding the use of three observational study designs to assess influenza vaccine effectiveness. Int J Epidemiol. 2007; 36(3):623-631.
7. Jackson ML, Rothman KJ. Effects of imperfect test sensitivity and specificity on observational studies of influenza vaccine effectiveness. Vaccine. 2015;33(11):1313-1316.
8. De Serres G, Skowronski DM, Wu XW, et al. The test-negative design: validity, accuracy and precision of vaccine efficacy estimates compared to the gold standard of randomised placebo-controlled clinical trials. Euro Surveill. 2013;18(37): pii:20585.
9. Foppa IM, Haber M, Ferdinands JM, et al. The case test-negative design for studies of the effectiveness of influenza vaccine. Vaccine. 2013;31(30):3104-3109.
10. Wacholder S, McLaughlin JK, Silverman DT, et al. Selection of controls in case-control studies. I. Principles. Am J Epidemiol. 1992;135(9):1019-1028.
11. Butler J, Hooper KA, Petrie S, et al. Estimating the fitness advantage conferred by permissive neuraminidase mutations in recent oseltamivir-resistant A(H1N1)pdm09 influenza viruses. PLoS Pathog. 2014;10(4):e1004065.
12. Greenland S, Pearl J, Robins JM. Causal diagrams for epidemiologic research. Epidemiology. 1999;10(1):37-48.
13. Pearl J. Causality. Cambridge, United Kingdom: Cambridge University Press; 2009.
14. Glymour M, Greenland S. Causal diagrams. In: Rothman KJ, Greenland S, Lash TL, eds. Modern Epidemiology. 3rd ed. Philadelphia, PA: LippincottWilliams&Wilkins; 2008:183-209.
15. Sullivan SG, Cowling BJ. "Crude vaccine effectiveness" is a misleading term in test-negative studies of influenza vaccine effectiveness. Epidemiology. 2015;26(5):E60.
16. Westreich D. Berkson's bias, selection bias, and missing data. Epidemiology. 2012;23(1):159-164.
17. Cornfield J. A method of estimating comparative rates from clinical data; applications to cancer of the lung, breast, and cervix. J Natl Cancer Inst. 1951;11(6):1269-1275.
18. Wacholder S. The case-control study as data missing by design: estimating risk differences. Epidemiology. 1996;7(2): 144-150.
19. Daniel RM, Kenward MG, Cousens SN, et al. Using causal diagrams to guide analysis in missing data problems. Stat Methods Med Res. 2012;21(3):243-256.
20. Valenciano M, Ciancio B, Moren A. First steps in the design of a system to monitor vaccine effectiveness during seasonal and pandemic influenza in EU/EEA Member States. Euro Surveill. 2008;13(43):pii:19015.
21. Widdowson MA, Monto AS. Epidemiology of influenza. In: Wenster RG, Monto AS, Braciole TJ, et al., eds. Textbook of Influenza. Chichester, United Kingdom: Wiley Blackwell; 2013:254-255.
22. Haq K, McElhaney JE. Immunosenescence: influenza vaccination and the elderly. Curr Opin Immunol. 2014;29: 38-42.
23. Australian Government Department of Health and Ageing. Part 4. Vaccine-preventable diseases. In: The Australian Immunisation Handbook. Canberra, Australia: National Health and Medical Research Council; 2015:251-256.
24. Beck CR, McKenzie BC, Hashim AB, et al. Influenza vaccination for immunocompromised patients: systematic review and meta-analysis from a public health policy perspective. PLoS One. 2011;6(12):e29249.
25. Immunise Australia Program, Australian Government Department of Health and Ageing. Influenza (flu). 2014. http:// www.immunise.health.gov.au/internet/immunise/publishing. nsf/Content/immunise-influenza. Accessed July 29, 2014.
26. Kissling E, Valenciano M, Larrauri A, et al. Low and decreasing vaccine effectiveness against influenza A(H3) in 2011/12 among vaccination target groups in Europe: results from the I-MOVE multicentre case-control study. Euro Surveill. 2013;18(5):pii:20390.
27. Australian Institute of Health and Welfare. 2009 Adult Vaccination Survey. Canberra, Australia: Australian Institute of Health and Welfare; 2011:9.
28. Bureau of Labor Statistics, US Department of Labor. American Time Use Survey summary. Washington, DC: US Department of Labor; 2014. http://www.bls.gov/news.release/atus.nr0.htm. Accessed August 31, 2015.
29. Statistics Finland, Statistics Sweden. Harmonised European Time Use Survey [online database, version 2.0]. Helsinki, Finland and Stockholm, Sweden: Statistics Finland and Statistics Sweden; 2007. https://www.h5.scb.se/tus/tus/default. htm. Accessed August 31, 2015.
30. Hancock K, Veguilla V, Lu X, et al. Cross-reactive antibody responses to the 2009 pandemic H1N1 influenza virus. N Engl J Med. 2009;361(20):1945-1952.
31. Miller E, Hoschler K, Hardelid P, et al. Incidence of 2009 pandemic influenza A H1N1 infection in England: a cross-sectional serological study. Lancet. 2010;375(9720): 1100-1108.
32. Smith DJ, Forrest S, Ackley DH, et al. Variable efficacy of repeated annual influenza vaccination. Proc Natl Acad Sci U S A. 1999;96(24):14001-14006.
33. Ohmit SE, Petrie JG, Malosh RE, et al. Influenza vaccine effectiveness in the community and the household. Clin Infect Dis. 2013;56(10):1363-1369.
34. Sullivan SG, Kelly H. Stratified estimates of influenza vaccine effectiveness by prior vaccination: caution required. Clin Infect Dis. 2013;57(3):474-476.
35. McLean HQ, Thompson MG, Sundaram ME, et al. Impact of repeated vaccination on vaccine effectiveness against influenza A(H3N2) and B during 8 seasons. Clin Infect Dis. 2014;59(10): 1375-1385.
36. Greenland S, Lanes S, Jara M. Estimating effects from randomized trials with discontinuations: the need for intent-totreat design and G-estimation. Clin Trials. 2008;5(1):5-13.
37. Robins J. Causal inference from complex longitudinal data. In: Berkane M, ed. Latent Variable Modeling and Applications to Causality. (Lecture Notes in Statistics, vol 120). New York, NY: Springer Verlag New York; 1997:69-117.
38. Robins JM, Hernán MA, Brumback B. Marginal structural models and causal inference in epidemiology. Epidemiology. 2000;11(5):550-560.
39. Jackson LA, Jackson ML, Nelson JC, et al. Evidence of bias in estimates of influenza vaccine effectiveness in seniors. Int J Epidemiol. 2006;35(2):337-344.
40. Wong VW, Cowling BJ, Aiello AE. Hand hygiene and risk of influenza virus infections in the community: a systematic review and meta-analysis. Epidemiol Infect. 2014;142(5): 922-932.
41. VanderWeele TJ, Shpitser I. On the definition of a confounder. Ann Stat. 2013;41(1):196-220.
42. Ogburn EL, VanderWeele TJ. On the nondifferential misclassification of a binary confounder. Epidemiology. 2012; 23(3):433-439.
43. Salas M, Hofman A, Stricker BH. Confounding by indication: an example of variation in the use of epidemiologic terminology. Am J Epidemiol. 1999;149(11):981-983.
44. Didelez V, Kreiner S, Keiding N. Graphical models for inference under outcome-dependent sampling. Stat Sci. 2010; 25(3):368-387.
45. Druce J, Tran T, Kelly H, et al. Laboratory diagnosis and surveillance of human respiratory viruses by PCR in Victoria, Australia, 2002-2003. J Med Virol. 2005;75(1): 122-129.
46. Hernán MA, Cole SR. Invited commentary: causal diagrams and measurement bias. Am J Epidemiol. 2009;170(8):959-962.
47. Carrat F, Vergu E, Ferguson NM, et al. Time lines of infection and disease in human influenza: a review of volunteer challenge studies. Am J Epidemiol. 2008;167(7):775-785.
48. Kelly H, Jacoby P, Dixon GA, et al. Vaccine effectiveness against laboratory-confirmed influenza in healthy young children: a case-control study. Pediatr Infect Dis J. 2011;30(2): 107-111.
49. Levy A, Sullivan SG, Tempone SS, et al. Influenza vaccine effectiveness estimates forWestern Australia during a period of vaccine and virus strain stability, 2010 to 2012. Vaccine. 2014; 32(47):6312-6318.
50. Landry ML. Diagnostic tests for influenza infection. Curr Opin Pediatr. 2011;23(1):91-97.
51. Greenland S, Lash TL. Bias analysis. In: Rothman KJ, Greenland S, Lash TL, eds. Modern Epidemiology. 3rd ed. Philadelphia, PA: Lippincott Williams & Wilkins; 2008: 345-380.
52. Howard PF, McCaw JM, Richmond PC, et al. Virus detection and its association with symptoms during influenza-like illness in a sample of healthy adults enrolled in a randomised controlled vaccine trial. Influenza Other Respir Viruses. 2013; 7(3):330-339.
53. He XS, Holmes TH, Zhang C, et al. Cellular immune responses in children and adults receiving inactivated or live attenuated influenza vaccines. J Virol. 2006;80(23):11756-11766.
54. Hoft DF, Babusis E, Worku S, et al. Live and inactivated influenza vaccines induce similar humoral responses, but only live vaccines induce diverse T-cell responses in young children. J Infect Dis. 2011;204(6):845-853.
55. Lillie PJ, Berthoud TK, Powell TJ, et al. Preliminary assessment of the efficacy of a T-cell-based influenza vaccine, MVA-NP +M1, in humans. Clin Infect Dis. 2012;55(1):19-25.
56. Jurek AM, Greenland S, Maldonado G. How far from non-differential does exposure or disease misclassification have to be to bias measures of association away from the null? Int J Epidemiol. 2008;37(2):382-385.
57. Irving SA, Donahue JG, Shay DK, et al. Evaluation of self-reported and registry-based influenza vaccination status in a Wisconsin cohort. Vaccine. 2009;27(47):6546-6549.
58. Mangtani P, Shah A, Roberts JA. Validation of influenza and pneumococcal vaccine status in adults based on self-report. Epidemiol Infect. 2007;135(1):139-143.
59. Greenland S. Basic methods for sensitivity analysis of biases. Int J Epidemiol. 1996;25(6):1107-1116.
60. Rothman KJ, Greenland S, Lash TL. Validity in epidemiologic studies. In: Rothman KJ, Greenland S, Lash TL, eds. Modern Epidemiology. 3rd ed. Philadelphia, PA: LippincottWilliams & Wilkins; 2008:128-147.
61. Hall CB, Douglas RG Jr, Geiman JM, et al. Viral shedding patterns of children with influenza B infection. J Infect Dis. 1979;140(4):610-613.
62. Frank AL, Taber LH, Wells CR, et al. Patterns of shedding of myxoviruses and paramyxoviruses in children. J Infect Dis. 1981;144(5):433-441.
63. Li CC,Wang L, Eng HL, et al. Correlation of pandemic (H1N1) 2009 viral load with disease severity and prolonged viral shedding in children. Emerg Infect Dis. 2010;16(8): 1265-1272.
64. Pascalis H, Temmam S, Turpin M, et al. Intense co-circulation of non-influenza respiratory viruses during the first wave of pandemic influenza pH1N1/2009: a cohort study in Reunion Island. PLoS One. 2012;7(9):e44755.
65. Mac Donald R, Baken L, Nelson A, et al. Validation of self-report of influenza and pneumococcal vaccination status in elderly outpatients. Am J Prev Med. 1999;16(3): 173-177.
66. Hernán MA, Hernández-Díaz S, Werler MM, et al. Causal knowledge as a prerequisite for confounding evaluation: an application to birth defects epidemiology. Am J Epidemiol. 2002;155(2):176-184.
67. Howards PP, Schisterman EF, Heagerty PJ. Potential confounding by exposure history and prior outcomes: an example from perinatal epidemiology. Epidemiology. 2007; 18(5):544-551.
68. Schisterman EF, Cole SR, Platt RW. Overadjustment bias and unnecessary adjustment in epidemiologic studies. Epidemiology. 2009;20(4):488-495.
69. Greenland S. Small-sample bias and corrections for conditional maximum-likelihood odds-ratio estimators. Biostatistics. 2000; 1(1):113-122.
70. Christenfeld NJ, Sloan RP, Carroll D, et al. Risk factors, confounding, and the illusion of statistical control. Psychosom Med. 2004;66(6):868-875.
71. Maldonado G, Greenland S. Simulation study of confounderselection strategies. Am J Epidemiol. 1993;138(11):923-936.
72. Becher H. The concept of residual confounding in regression models and some applications. Stat Med. 1992;11(13): 1747-1758.