Reuse, recycle, reweigh: Combating influenza through efficient sequential Bayesian computation for massive data

Annals of Applied Statistics

Volumn 4, Issue 4, 2010, Pages 1722-1748

  Tom, Jennifer A ^a   Sinsheimer, Janet S ^a   Suchard, Marc A ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Gibbs variable selection; Hierarchical Bayesian model; Importance sampling; Influenza A; Markov chain Monte Carlo; Massive data

Indexed keywords

EID: 84858068293     PISSN: 19326157     EISSN: 19417330     Source Type: Journal    
DOI: 10.1214/10-AOAS349     Document Type: Article

References (56)

1. Allison, D. B., Visscher, P. M., Rosa, G. J. M. and Amos, C. I. (2009). Statistical genetics and statistical genomics: Where biology, epistemology, statistics, and computation collide. Comput. Statist. Data Anal. 53 1531-1534.
2. Anderson, C. (2008). The end of theory: The data deluge makes the scientific method obsolete. Wired 16. Available at http://wired.com/science/discoveries/magazine/16-07/pb_theory.
3. Balakrishnan, S. and Madigan, D. (2006). A one-pass sequential Monte Carlo method for Bayesian analysis of massive datasets. Bayesian Anal. 1 345-362.
4. Boscardin, W. J. and Zhang, X. (2004). Modeling the covariance and correlation matrix of repeated measures. In Applied Bayesian Modeling and Causal Inference from Incomplete Data Perspectives (A. Gelman, ed.) 215-226. Wiley, Chichester.
5. Butler, D. (2009). Swine flu goes global. Nature 458 1082-1083.
6. Cacoullos, T. (1964). Estimation of a multivariate density. Ann. Inst. Statist. Math. 18 179-189.
7. Cappé, O., Godsill, S. J. and Moulines, E. (2007). An overview of existing methods and recent advances in sequential Monte Carlo. IEEE Proceedings 95 899-924.
8. Carlin, J. B. (1992). Meta-analysis for 2×2 tables: A Bayesian approach. Stat. Med. 11 141-158.
9. Celeux, G., Hurn, M. and Robert, C. P. (2000). Computational and inferential difficulties with mixture posterior distributions. J. Amer. Statist. Assoc. 95 957-970.
10. Chen, M. H. (1994). Importance-weighted marginal Bayesian posterior density estimation. J. Amer. Statist. Assoc. 89 818-824.
11. Chen, S. X. (2000). Probability density function estimation using gamma kernels. Ann. Inst. Statist. Math. 52 471-480.
12. Chopin, N. (2002). A sequential particle filter method for static models. Biometrika 89 539-552.
13. Clercq, E. D. (2006). Antiviral agents active against influenza A viruses. Nature Reviews Drug Discovery 5 1015-1025.
14. Cressie, N., Olsen, A. and Cook, D. (1997). Massive data sets: Problems and possibilities, with application to environmental monitoring. In Massive Data Sets: Proceedings of a Workshop 115-119. National Academy Press, Washington, DC.
15. Dellaportas, P., Forster, J. J. and Ntzoufras, I. (2002). On Bayesian model and variable selection using MCMC. Statist. Comput. 12 27-36.
16. Doucet, A., de Freitas, N. and Gordon, N. (2001). An introduction to sequential Monte Carlo methods. In Sequential Monte Carlo Methods in Practice (A. Doucet, N. de Freitas and N. Gordon, eds.) 3-13. Springer, New York.
17. Drummond, A. J., Nicholls, G. K., Rodrigo, A. G. and Solomon, W. (2002). Estimating mutation parameters, population history and genealogy simultaneously from temporally spaced sequence data. Genetics 161 1307-1320.
18. Drummond, A. J., Rambaut, A., Shapiro, B. and Pybus, O. G. (2005). Bayesian coalescent inference of past population dynamics from molecular sequences. Mol. Biol. Evol. 22 1185-1192.
19. Efron, B. (1986). Why isn't everyone a Bayesian? Amer. Statist. 40 1-11.
20. Efron, B. and Morris, C. (1977). Stein's paradox in statistics. Scientific American 236 119-127.
21. Fauci, A. S. (2005). Race against time. Nature 435 423-424.
22. Gelman, A. (2004). Bayesian Data Analysis. Chapman and Hall, Boca Raton, FL.
23. Geweke, J. (1992). Evaluating the accuracy of sampling-based approaches to calculating posterior moments. In Bayesian Statistics, vol. 4 (J. M. Bernado, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) 169-193. Oxford Univ. Press, New York.
24. Ghedin, E., Sengamalay, N. A., Shumway, M., Zaborsky, J., Feldblyum, T., Subbu, V., Spiro, D. J., Sitz, J., Koo, H., Bolotov, P., Dernovoy, D., Tatusova, T., Bao, Y., St George, K., Taylor, J., Lipman, D. J., Fraser, C. M., Taubenberger, J. K. and Salzberg, S. L. (2005). Large-scale sequencing of human influenza reveals the dynamic nature of viral genome evolution. Nature 427 1162-1166.
25. Glymour, C., Madigan, D., Pregibon, D. and Smyth, P. (1997). Statistical themes and lessons for data mining. Data Mining and Knowledge Discovery 1 11-28.
26. Härdle, W. (1990). Smoothing Techniques with Implementation in S. Springer, New York.
27. Härdle, W., Müller, M., Sperlich, S. and Werwatz, A. (2004). Nonparametric and Semiparameteric Models. Springer, New York.
28. Hein, J., Schierup, M. H. and Wiuf, C. (2005). Gene Genealogies, Variation and Evolution: A Primer in Coalescent Theory. Oxford Univ. Press.
29. Holmes, E. C., Ghedin, E., Miller, N., Taylor, J., Bao, Y., St George, K., Grenfell, B. T., Salzberg, S. L., Fraser, C. M., Lipman, D. J. and Taubenberger, J. K. (2005). Whole-genome analysis of human influenza A virus reveals multiple persistent lineages and reassortment among recent H3N2 viruses. PLoS Biology 3 1579-1589.
30. Hudson, R. R. (1991). Gene genealogies and the coalescent process. Oxford Surveys in Evolutionary Biology 7 1-44.
31. Kass, R. E. and Wasserman, L. (1996). The selection of prior distributions by formal rules. J. Amer. Statist. Assoc. 91 1343-1370.
32. Kettenring, J. R. (2009). Massive datasets. Comput. Statist. 1 25-32.
33. Knowles, L. L. (2004). The burgeoning field of statistical phylogeography. J. Evol. Biol. 17 1-10.
34. Kuo, L. and Mallick, B. (1998). Variable selection for regression models. Sankhya: The Indian Journal of Statistics B 60 65-81.
35. Lagakos, S. W. (2006). The challenge of subgroup analysis-reporting without distorting. New England Journal of Medicine 354 1667-1669.
36. Lambert, D. (2003). What use is statistics for massive data? In Lecture Notes-Monograph Series, Crossing Boundaries: Statistical Essays in Honor of Jack Hall (J. E. Kolassa and D. Oakes, eds.) 217-228. IMS, Beachwood, OH.
37. Liang, L. J. and Weiss, R. E. (2007). A hierarchical semiparametric regression model for combining HIV-1 phylogenetic analysis using iterative reweighting algorithm. Biometrics 63 733-741.
38. Liang, L. J., Weiss, R. E., Redelings, B. and Suchard, M. A. (2009). Improving phylogenetic analyses by incorporating additional information from genetic sequence databases. Bioinformatics 25 2530-2536.
39. Minin, V. M., Bloomquist, E. W. and Suchard, M. A. (2008). Smooth skyride through a rough skyline: Bayesian coalescent-based inference of population dynamics. Mol. Biol. Evol. 25 1459-1471.
40. Nelson, M. I. and Holmes, E. C. (2007). The evolution of the epidemic influenza. Nature Reviews Genetics 8 196-204.
41. Rambaut, A., Pybus, O. G., Nelson, M. I., Viboud, C., Taubenberger, J. K. and Holmes, E. C. (2008). The genomic and epidemiological dynamics of human influenza A virus. Nature 453 615-620.
42. Ridgeway, G. and Madigan, D. (2003). A sequential Monte Carlo method for Bayesian analysis of massive datasets. Data Mining and Knowledge Discovery 7 301-319.
43. Robert, C. P. and Casella, G. (2004). Monte Carlo Statistical Methods, 2nd ed. Springer, New York.
44. Rubin, D. B. (1988). Using the SIR algorithm to simulate posterior distributions. In Bayesian Statistics 3 (J. M. Bernardo, M. H. DeGroot, D. V. Lindley and A. F. M. Smith, eds.) 395-402. Oxford Univ. Press.
45. Salomon, R. and Webster, R. G. (2009). The influenza virus enigma. Cell 136 402-410.
46. Scott, D. W. (1992). Multivariate Density Estimation: Theory, Practice and Visualization. Wiley, New York.
47. Smith, G. J. D., Vijaykrishna, D., Bahl, J., Lycett, S. J., Worobey, M., Pybus, O. G., Ma, S. K., Cheung, C. L., Raghwani, J., Bhatt, S., Peiris, J. S. M., Guan, Y. and Rambaut, A. (2009). Origins and evolutionary genomics of the 2009 swine-origin H1N1 influenza A epidemic. Nature 459 1122-1125.
48. Suchard, M. A. and Rambaut, A. (2009). Many-core algorithms for statistical phylogenetics. Bioinformatics 25 1370-1376.
49. Suchard, M. A., Kitchen, C. M. R., Sinsheimer, J. S. and Weiss, R. E. (2003). Hierarchical phylogenetic models for analyzing multipartite sequence data. Systematic Biology 52 649-664.
50. Suchard, M. A., Wang, Q., Chan, C., Frelinger, J., Cron, A. and West, M. (2010). Understanding GPU programming for statistical computation: Studies in massively parallel massive mixtures. J. Comput. Graph. Statist. 19 419-438.
51. Tom, J. A., Sinsheimer, J. S. and Suchard, M. A. (2010). Supplement to "Reuse, recycle, reweigh: Combating influenza through efficient sequential Bayesian computation for massive data". DOI: 10.1214/10-AOAS349SUPP.
52. Warn, D. E., Thompson, S. G. and Spiegelhalter, D. J. (2002). Bayesian random effects meta-analysis of trials with binary outcomes: Methods for the absolute risk difference and relative risk scales. Stat. Med. 21 1601-1623.
53. Webster, R. G. and Walker, E. J. (2003). The world is teetering on the edge of a pandemic that could kill a large fraction of the human population. Amer. Sci. 91 122.
54. Wright, S. (1931). Evolution in Mendelian populations. Genetics 16 97-159.
55. Yewdell, J. and Garcia-Sastre, A. (2002). Influenza virus still surprises. Current Opinion in Microbiology 5 414-418.
56. Zwickl, D. J. and Holder, M. T. (2004). Model parameterization, prior distributions, and the general time-reversible model in Bayesian phylogenetics. Systematic Biology 53 877-888.