Lessons learned in the analysis of high-dimensional data in vaccinomics

Vaccine

Volumn 33, Issue 40, 2015, Pages 5262-5270

  Oberg, Ann L ^a   McKinney, Brett A ^b   Schaid, Daniel J ^a   Pankratz, V Shane ^c   Kennedy, Richard B ^a   Poland, Gregory A ^a  

^a MAYO CLINIC   (United States)

^b The University of Tulsa   (United States)

^c UNIVERSITY OF NEW MEXICO HEALTH SCIENCES CENTER   (United States)

Author keywords

Data interpretation, statistical; Immunogenetics; Systems biology; Vaccination; Vaccines

Indexed keywords

VACCINE;

ARTICLE; GOLD STANDARD; HUMAN; IMMUNE RESPONSE; IMMUNOGENETICS; INNATE IMMUNITY; NEXT GENERATION SEQUENCING; PRIORITY JOURNAL; QUALITY CONTROL; STATISTICAL ANALYSIS; STATISTICAL MODEL; STATISTICAL SIGNIFICANCE; SYSTEMS BIOLOGY; VACCINATION; DATA MINING; GENE EXPRESSION PROFILING; GENOMICS; IMMUNOLOGY; INFORMATION PROCESSING; MEASUREMENT ACCURACY; PROCEDURES;

DATA ACCURACY; DATA INTERPRETATION, STATISTICAL; DATA MINING; DATASETS AS TOPIC; GENE EXPRESSION PROFILING; GENOMICS; HUMANS; SYSTEMS BIOLOGY; VACCINES;

EID: 84941801673     PISSN: 0264410X     EISSN: 18732518     Source Type: Journal    
DOI: 10.1016/j.vaccine.2015.04.088     Document Type: Article

References (81)

1. Poland G.A. Pharmacology, vaccinomics, and the second golden age of vaccinology. Clin Pharmacol Ther 2007, 82(Dec (6)):623-626.
2. Poland G.A., Ovsyannikova I.G., Jacobson R.M. Personalized vaccines: the emerging field of vaccinomics. Expert Opin Biol Ther 2008, 8(11):1659-1667.
3. Poland G.A., Oberg A.L. Vaccinomics and bioinformatics: accelerants for the next golden age of vaccinology. Vaccine 2010, 28(Apr (20)):3509-3510.
4. Poland G.A., Kennedy R.B., McKinney B.A., Ovsyannikova I.G., Lambert N.D., Jacobson R.M., et al. Vaccinomics, adversomics, and the immune response network theory: individualized vaccinology in the 21st century. Semin Immunol 2013, 25(June):89-103.
5. Oberg A.L., Kennedy R.B., Li P., Ovsyannikova I.G., Poland G.A. Systems biology approaches to new vaccine development. Curr Opin Immunol 2011, 23(May):436-443.
6. Ransohoff D.F. How to improve reliability and efficiency of research about molecular markers: roles of phases, guidelines, and study design. J Clin Epidemiol 2007, 60(12):1205-1219.
7. Ransohoff D.F. Bias as a threat to the validity of cancer molecular-marker research. Nat Rev Cancer 2005, 5:142-149.
8. Leek J.T., Scharpf R.B., Bravo H.C., Simcha D., Langmead B., Johnson W.E., et al. Tackling the widespread and critical impact of batch effects in high-throughput data. Nat Rev 2010, 11(10):733-739.
9. Ransohoff D.F. Lessons from controversy: ovarian cancer screening and serum proteomics. J Natl Cancer Inst 2005, 97(Feb (4)):315-319.
10. Croswell J.M., Ransohoff D.F., Kramer B.S. Principles of cancer screening: lessons from history and study design issues. Semin Oncol 2010, 37(3):202-215.
11. Oberg A.L., Vitek O. Statistical design of quantitative mass spectrometry-based proteomic experiments. J Proteome Res 2009, 8(5):2144-2156.
12. Oberg A.L., Mahoney D.W. Statistical methods for quantitative mass spectrometry proteomic experiments with labeling. BMC Bioinf 2012, 13(Suppl. 16):S7.
13. Plotkin S.A. Correlates of protection induced by vaccination. Clin Vaccine Immunol: CVI 2010, 17(7):1055-1065.
14. Harrell F.E. Regression modeling strategies: with applications to linear models, logistic regression, and survival analysis 2001, Springer, New York.
15. Zhao Y., Simon R. Gene expression deconvolution in clinical samples. Genome Med 2010, 2(12):93.
16. Shen-Orr S.S., Tibshirani R., Khatri P., Bodian D.L., Staedtler F., Perry N.M., et al. Cell type-specific gene expression differences in complex tissues. Nat Methods 2010, 7(4):287-289.
17. Shalek A.K., Satija R., Adiconis X., Gertner R.S., Gaublomme J.T., Raychowdhury R., et al. Single-cell transcriptomics reveals bimodality in expression and splicing in immune cells. Nature 2013, 498(Jun (7453)):236-240.
18. Cunningham J.M., Oberg A.L., Borralho P.M., Kren B.T., French A.J., Wang L., et al. Evaluation of a new high-dimensional miRNA profiling platform. BMC Med Genet 2009, 2:57.
19. Bibikova M., Barnes B., Tsan C., Ho V., Klotzle B., Le J.M., et al. High density DNA methylation array with single CpG site resolution. Genomics 2011, 98(4):288-295.
20. Marabita F., Almgren M., Lindholm M.E., Ruhrmann S., Fagerstrom-Billai F., Jagodic M., et al. An evaluation of analysis pipelines for DNA methylation profiling using the Illumina HumanMethylation450 BeadChip platform. Epigenetics 2013, 8(3):333-346.
21. Teschendorff A.E., Marabita F., Lechner M., Bartlett T., Tegner J., Gomez-Cabrero D., et al. A beta-mixture quantile normalization method for correcting probe design bias in Illumina Infinium 450 k DNA methylation data. Bioinformatics 2013, 29(Jan (2)):189-196.
22. Robinson M.D., Smyth G.K. Moderated statistical tests for assessing differences in tag abundance. Bioinformatics 2007, 23(Nov (21)):2881-2887.
23. Robinson M.D., Smyth G.K. Small-sample estimation of negative binomial dispersion, with applications to SAGE data. Biostatistics 2008, 9(Apr (2)):321-332.
24. Robinson M.D., McCarthy D.J., Smyth G.K. edgeR: a Bioconductor package for differential expression analysis of digital gene expression data. Bioinformatics 2010, 26(Nov (1)):139-140.
25. Oberg A.L., Bot B.M., Grill D.E., Poland G.A., Therneau T.M. Technical and biological variance structure in mRNA-Seq data: life in the real world. BMC Genet 2012, 13:304.
26. Draper N., Smith H. Applied regression analysis 1998, John Wiley & Sons Inc. 3rd ed.
27. Kutner M.H., Nachtsheim C., Neter J. Applied linear regression models 2004, McGraw-Hill/Irwin, Boston. 4th ed.
28. Durrleman S., Simon R. Flexible regression models with cubic splines. Stat Med 1989, 8(5):551-561.
29. van Meerloo J., Kaspers G.J., Cloos J. Cell sensitivity assays: the MTT assay. Methods Mol Biol 2011, 731:237-245.
30. Musselli C., Ragupathi G., Gilewski T., Panageas K.S., Spinat Y., Livingston P.O. Reevaluation of the cellular immune response in breast cancer patients vaccinated with MUC1. Int J Cancer 2002, 97(Feb (5)):660-667.
31. Kennedy R.B., Ovsyannikova I.G., Pankratz V.S., Vierkant R.A., Jacobson R.M., Ryan M.A., et al. Gender effects on humoral immune responses to smallpox vaccine. Vaccine 2009, 27(May (25-26)):3319-3323.
32. Lambert N.D., Haralambieva I.H., Ovsyannikova I.G., Larrabee B.R., Pankratz V.S., Poland G.A. Characterization of humoral and cellular immunity to rubella vaccine in four distinct cohorts. Immunol Res 2014, 58(1):1-8.
33. Kennedy R.B., Ovsyannikova I.G., Haralambieva I.H., Lambert N.D., Pankratz V.S., Poland G.A., Genome-wide S.N.P. associations with rubella-specific cytokine responses in measles-mumps-rubella vaccine recipients. Immunogenetics 2014, 66(Aug (7-8)):493-499.
34. Poland G.A., Ovsyannikova I.G., Jacobson R.M., Vierkant R.A., Jacobsen S.J., Pankratz V.S., et al. Identification of an association between HLA class II alleles and low antibody levels after measles immunization. Vaccine 2001, 20(Nov (3-4)):430-438.
35. Ovsyannikova I.G., Jacobson R.M., Vierkant R.A., Jacobsen S.J., Pankratz V.S., Poland G.A. The contribution of HLA class I antigens in immune status following two doses of rubella vaccination. Hum Immunol 2004, 65(12):1506-1515.
36. Schumann A., Fiedler M., Dahmen U., Grosse-Wilde H., Roggendorf M., Lindemann M. Cellular and humoral immune response to a third generation hepatitis B vaccine. J Viral Hepat 2007, 14(8):592-598.
37. Roponen M., Yerkovich S.T., Hollams E., Sly P.D., Holt P.G., Upham J.W. Toll-like receptor 7 function is reduced in adolescents with asthma. Eur Respir J 2010, 35(1):64-71.
38. Fitzmaurice G.M., Laird N.M., Ware J.H. Applied longitudinal analysis 2011, John Wiley & Sons Inc., Hoboken, NJ. 2nd ed.
39. Norman G.R. Issues in the use of change scores in randomized trials. J Clin Epidemiol 1989, 42(11):1097-1105.
40. Oakes J.M., Feldman H.A. Statistical power for nonequivalent pretest-posttest designs The impact of change-score versus ANCOVA models. Eval Rev 2001, 25(Feb (1)):3-28.
41. Lord F.M. A paradox in the interpretation of group comparisons. Psychol Bull 1967, 68(Nov (5)):304-305.
42. Storey J.D., Tibshirani R. Statistical significance for genomewide studies. Proc Natl Acad Sci USA 2003, 100(16):9440-9445.
43. Frazer K.A., Ballinger D.G., Cox D.R., Hinds D.A., Stuve L.L., Gibbs R.A., et al. A second generation human haplotype map of over 3.1 million SNPs. Nature 2007, 449(Oct (7164)):851-861.
44. Goeman J.J., Buhlmann P. Analyzing gene expression data in terms of gene sets: methodological issues. Bioinformatics 2007, 23(Apr (8)):980-987.
45. Subramanian A., Tamayo P., Mootha V.K., Mukherjee S., Ebert B.L., Gillette M.A., et al. Gene set enrichment analysis: a knowledge-based approach for interpreting genome-wide expression profiles. Proc Natl Acad Sci USA 2005, 102(Oct (43)):15545-15550.
46. Schaid D.J., Sinnwell J.P., Jenkins G.D., McDonnell S.K., Ingle J.N., Kubo M., et al. Using the gene ontology to scan multilevel gene sets for associations in genome wide association studies. Genet Epidem 2012, 36(Dec):3-16.
47. Wang L., Jia P., Wolfinger R.D., Chen X., Zhao Z. Gene set analysis of genome-wide association studies: methodological issues and perspectives. Genomics 2011, 98(April):1-8.
48. Ioannidis J.P. Why most published research findings are false. PLoS Med 2005, 2(8):e124.
49. Nuzzo R. Scientific method: statistical errors. Nature 2014, 506(Feb (7487)):150-152.
50. Chanock S.J., Manolio T., Boehnke M., Boerwinkle E., Hunter D.J., Thomas G., et al. Replicating genotype-phenotype associations. Nature 2007, 447(Jun (7145)):655-660.
51. Price A.L., Patterson N.J., Plenge R.M., Weinblatt M.E., Shadick N.A., Reich D. Principal components analysis corrects for stratification in genome-wide association studies. Nat Genet 2006, 38(8):904-909.
52. Skol A.D., Scott L.J., Abecasis G.R., Boehnke M. Joint analysis is more efficient than replication-based analysis for two-stage genome-wide association studies. Nat Genet 2006, 38(2):209-213.
53. McKinney B.A., Reif D.M., Rock M.T., Edwards K.M., Kingsmore S.F., Moore J.H., et al. Cytokine expression patterns associated with systemic adverse events following smallpox immunization. J Infec Dis 2006, 194(Aug (4)):444-453.
54. Reif D.M., Motsinger-Reif A.A., McKinney B.A., Rock M.T., Crowe J.E., Moore J.H. Integrated analysis of genetic and proteomic data identifies biomarkers associated with adverse events following smallpox vaccination. Genes Immun 2009, 10(Mar (2)):112-119.
55. Querec T.D., Akondy R.S., Lee E.K., Cao W., Nakaya H.I., Teuwen D., et al. Systems biology approach predicts immunogenicity of the yellow fever vaccine in humans. Nat Immunol 2009, 10(1):116-125.
56. Nakaya H.I., Wrammert J., Lee E.K., Racioppi L., Marie-Kunze S., Haining W.N., et al. Systems biology of vaccination for seasonal influenza in humans. Nat Immunol 2011, 12(8):786-795.
57. Gallagher R.J., Lee E.K., Patterson D.A. Constrained discriminant analysis via 0/1 mixed integer programming. Ann Oper Res 1997, 74(0):65-88.
58. Breiman L. Random forests. Mach Lear 2001, 45:5-32.
59. Hastie T., Tibshirani R., Friedman J. The elements of statistical learning: data mining, inference, and prediction. Springer series in statistics Feb. 2009, Springer, New York. 2nd ed.
60. James G., Witten D., Hastie T., Tibshirani R. An introduction to statistical learning: with applications in R 2013, Springer, New York, NY.
61. Shi L., Campbell G., Jones W.D., Campagne F., Wen Z., Walker S.J., et al. The microarray quality control (MAQC)-II study of common practices for the development and validation of microarray-based predictive models. Nat Biotechnol 2010, 28(8):827-838.
62. Varma S., Simon R. Bias in error estimation when using cross-validation for model selection. BMC Bioinf 2006, 7:91.
63. Simon R., Radmacher M.D., Dobbin K., McShane L.M. Pitfalls in the use of DNA microarray data for diagnostic and prognostic classification. J Natl Cancer Inst 2003, 95(1):14-18.
64. Dobbin K.K., Simon R.M. Sample size planning for developing classifiers using high-dimensional DNA microarray data. Biostatistics 2007, 8(1):101-117.
65. Dobbin K.K., Zhao Y., Simon R.M. How large a training set is needed to develop a classifier for microarray data?. Clin Cancer Res 2008, 14(1):108-114.
66. Tsang J.S., Schwartzberg P.L., Kotliarov Y., Biancotto A., Xie Z., Germain R.N., et al. Global analyses of human immune variation reveal baseline predictors of postvaccination responses. Cell 2014, 157(Apr (2)):499-513.
67. Newton M.A., Quintana F.A., Den Boon J.A., Sengupta S., Ahlquist P. Random-set methods identify distinct aspects of the enrichment signal in gene-set analysis. Ann Appl Stat 2007, 1(1):85-106.
68. Efron B., Tibshirani R. On testing the significance of sets of genes. Ann Appl Stat 2007, 1(1):107-129.
69. Chaussabel D., Quinn C., Shen J., Patel P., Glaser C., Baldwin N., et al. A modular analysis framework for blood genomics studies: application to systemic lupus erythematosus. Immunity 2008, 29(Jul (1)):150-164.
70. Segal E., Shapira M., Regev A., Pe'er D., Botstein D., Koller D., et al. Module networks: identifying regulatory modules and their condition-specific regulators from gene expression data. Nat Genet 2003, 34(Jun (2)):166-176.
71. Tan Y., Tamayo P., Nakaya H., Pulendran B., Mesirov J.P., Haining W.N. Gene signatures related to B-cell proliferation predict influenza vaccine-induced antibody response. Eur J Immunol 2014, 44(1):285-295.
72. Li S., Rouphael N., Duraisingham S., Romero-Steiner S., Presnell S., Davis C., et al. Molecular signatures of antibody responses derived from a systems biology study of five human vaccines. Nat Immunol 2014, 15(2):195-204.
73. Furman D., Hejblum B.P., Simon N., Jojic V., Dekker C.L., Thiebaut R., et al. Systems analysis of sex differences reveals an immunosuppressive role for testosterone in the response to influenza vaccination. Proc Natl Acad Sci USA 2014, 111(Jan (2)):869-874.
74. Furman D., Jojic V., Kidd B., Shen-Orr S., Price J., Jarrell J., et al. Apoptosis and other immune biomarkers predict influenza vaccine responsiveness. Mol Syst Biol 2013, 9:659.
75. Barbie D.A., Tamayo P., Boehm J.S., Kim S.Y., Moody S.E., Dunn I.F., et al. Systematic RNA interference reveals that oncogenic KRAS-driven cancers require TBK1. Nature 2009, 462(Nov (7269)):108-112.
76. Davis N.A., Crowe J.E., Pajewski N.M., McKinney B.A. Surfing a genetic association interaction network to identify modulators of antibody response to smallpox vaccine. Genes Immun 2010, 11(Jul (8)):630-636.
77. McKinney B.A., White B.C., Grill D.E., Li P.W., Kennedy R.B., Poland G.A., et al. ReliefSeq: a gene-wise adaptive-K nearest-neighbor feature selection tool for finding gene-gene interactions and main effects in mRNA-Seq gene expression data. PLoS ONE 2013, 8(12):e81527.
78. McKinney B.A., Crowe J.E., Guo J., Tian D. Capturing the spectrum of interaction effects in genetic association studies by simulated evaporative cooling network analysis. PLoS Genet 2009, 5(3):e1000432.
79. Poland G.A., Ovsyannikova I.G., Jacobson R.M. Adversomics: the emerging field of vaccine adverse event immunogenetics. Pediatr Infect Dis J 2009, 28(5):431-432.
80. Poland G.A. Vaccidents and adversomics. Vaccine 2010, 28(Sep (40)):6549-6550.
81. Hansen K.D., Irizarry R.A., Wu Z. Removing technical variability in RNA-seq data using conditional quantile normalization. Biostatistics 2012, 13(Apr (2)):204-216.