Bayesian learning in sparse graphical factor models via variational mean-field annealing

Journal of Machine Learning Research

Volumn 11, Issue , 2010, Pages 1771-1798

  Yoshida, Ryo ^a   West, Mike ^b  

^a INSTITUTE OF STATISTICAL MATHEMATICS   (Japan)

^b Duke University   (United States)

Author keywords

Annealing; Gene expression profiling; Graphical factor models; MAP estimation; Sparse factor analysis; Variational mean field method

Indexed keywords

FACTOR ANALYSIS; FACTOR MODEL; GENE EXPRESSION PROFILING; MAP ESTIMATION; MEAN-FIELD METHODS; VARIATIONAL MEAN-FIELD METHOD;

ANNEALING; COMBINATORIAL OPTIMIZATION; COMPUTATION THEORY; COVARIANCE MATRIX; ESTIMATION; GENE EXPRESSION; IMAGE SEGMENTATION; VARIATIONAL TECHNIQUES;

LEARNING ALGORITHMS;

EID: 77953553836     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (35)

1. T.W. Anderson. An Introduction to Multivariate Statistical Analysis, 3rd ed. Wiley-Interscience; New Jersey, 2003.
2. C. Archambeau and F. Bach. Sparse probabilistic projections. In D. Koller, D. Schuurmans, Y. Bengio, and L. Bottou, editors, Advances in Neural Information Processing Systems 21, pages 73-80, Cambridge, MA, 2009. MIT Press.
3. H. Attias. Inferring parameters and structure of latent variable models by variational Bayes. Proceedings of the 15th Conference on Uncertainty in Artificial Intelligence (UAI99), pages 21-30, 1999.
4. C.M. Bishop. Probabilistic principal component analysis. Journal of the Royal Statistical Society (Series B), 61:611-622, 1999.
5. C.M. Bishop. Pattern Recognition and Machine Learning, 1st ed. Springer: Singapore, 2006.
6. C.M. Carvalho and M. West. Dynamic matrix-variate graphical models. Bayesian Analysis, 2: 69-98, 2007.
7. C.M. Carvalho, J.E. Lucas, Q. Wang, J.T. Chang, J.R. Nevins, and M. West. High-dimensional sparse factor modelling: Applications in gene expression genomics. Journal of the American Statistical Association, 103:1438-1456, 2008.
8. J. Chang, C.M. Carvalho, S. Mori, A. Bild, Q. Wang, M. West, and J.R. Nevins. Decomposing cellular signaling pathways into functional units: A genomic strategy. Molecular Cell, 34:104-114, 2009.
9. S.H. Cheng, M. West C.F. Horng, E. Huang, J. Pittman, H. Dressman M.H. Tsou, C.M. Chen, S.Y. Tsail, J.J. Jian, J.R. Nevins M.C Liu, and A.T. Huang. Genomic prediction of loco-regional recurrence following mastectomy in breast cancer. Journal of Clinical Oncology, 24:4594-4602, 2006.
10. A. d'Aspremont, L. El Ghaoui, M.I. Jordan, and G.R.G. Lanckriet. A direct formulation for sparse PCA using semidefinite programming. SIAM Review, 49(3):434-448, 2007.
11. A. Dobra, B. Jones, C Hans, J.R. Nevins, and M. West. Sparse graphical models for exploring gene expression data. Journal of Multivariate Analysis, 90:196-212, 2004.
12. T.L. Griffiths and Z Ghahramani. Infinite latent feature models and the indian buffet process. In Y. Weiss, B. Schölkopf, and J. Piatt, editors, Advances in Neural Information Processing Systems 18, pages 475-482, Cambridge, MA, 2006. MIT Press.
13. Y. Guan and J Dy. Sparse probabilistic principal component analysis. Proceedings of AISTATS 2009,5:185-192, 2009.
14. T. Hastie, R. Tibshirani, and J. Friedman. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Newv York: Springer, 2001.
15. O. Hirose, R. Yoshida, S. Imoto, R. Yamaguchi, T. Higuchi, D. S. Charnock-Jones, C Print, and S. Miyano. Statistical inference of transcriptional module-based gene networks from time course gene expression profiles by using state space models. Bioinformatics, 24(7):932-942, 2008.
16. E. Huang, S Chen, H. K. Dressman, J. Pittman, M. H. Tsou, C F Horng, A. Bild, E. S. Iversen, M. Liao, C M. Chen, M. West, J. R. Nevins, and A. T. Huang. Gene expression predictors of breast cancer outcomes. The Lancet, 361:1590-1596, 2003.
17. I. T. Jolliffe, N. T. Trendafilov, and M. Uddin. A modified principal component technique based on the lasso. Journal of Computational and Graphical Statistics, 112(3):531-547, 2003.
18. B. Jones, A. Dobra, C.M. Carvalho, C. Hans, C. Carter, and M. West. Experiments in stochastic computation for high-dimensional graphical models. Statistical Science, 20:388-400, 2005.
19. M.I. Jordan, editor. Learning in Graphical Models. Cambridge MA: MIT Press, 1999.
20. M.I. Jordan. Graphical models. Statistical Science, 19:140-155, 2004.
21. M. Katoh and M. Katoh. Evolutionary recombination hotspot around GSDML-GSDM locus is closely linked to the oncogenomic recombination hotspot around the PPP1R1B-ERBB2-GRB7 amplicon. International Journal of Oncology, 24:757-763, 2004.
22. J.E. Lucas, C.M. Carvalho, Q. Wang, A.H. Bild, J.R. Nevins, and M. West. Sparse statistical modelling in gene expression genomics. In P. Müller, K.A. Do, and M. Vannucci, editors, Bayesian Inference for Gene Expression and Proteomics, pages 155-176. Cambridge University Press, 2006.
23. J.E. Lucas, C.M. Carvalho, J-T.A. Chi, and M. West. Cross-study projections of genomic biomarkers: An evaluation in cancer genomics. PLoS ONE, 4(2):e4523, 2009.
24. D.J.C Mackay. Probable networks and plausible predictions - a review of practical Bayesian methods for supervised neural networks. Network: Computation in Neural Systems, 6:469-505, 1995.
25. J. Mairal, F. Bach, J. Ponce, and G. Sapiro. Online dictionary learning for sparse coding. In Proceedings of the 26th Annual International Conference on Machine Learning (ICML2009), pages 689-696, New York, NY, USA, 2009. ACM.
26. J. Pittman, E. Huang, H. Dressman, C. F. Horng, S. H. Cheng, M. H. Tsou, C M. Chen, A. Bild, E. S. Iversen, A. T. Huang, J. R. Nevins, and M. West. Integrated modeling of clinical and gene expression information for personalized prediction of disease outcomes. Proceedings of the National Academy of Sciences, 101:8431-8436, 2004.
27. P. Rai and H. Daumé. The infinite hierarchical factor regression model. In D. Koller, D. Schuurmans, Y. Bengio, and L. Bottou, editors, Advances in Neural Information Processing Systems 21, pages 1321-1328, Cambridge, MA, 2009. MIT Press.
28. N. Ueda and R. Nakano. Deterministic annealing EM algorithm. Neural Networks, 11:271-282, 1998.
29. M.J. Wainwright and M.I. Jordan. Graphical models, exponential families, and variational inference. Foundations and Trends in Machine Learning, 1:1-305, 2008.
30. Q. Wang, C.M. Carvalho, J.E. Lucas, and M. West. BFRM: Bayesian factor regression modelling. Bulletin of the International Society for Bayesian Analysis, 14(2):4-5, 2007.
31. M. West. Bayesian factor regression models in the "large p, small n" paradigm. In J.M. Bernardo, M.J. Bayarri, J.O. Berger, A.P. Dawid, D. Heckerman, A.F.M. Smith, and M. West, editors, Bayesian Statistics 7, pages 723-732. Oxford University Press, 2003.
32. M. West, C Blanchette, H. Dressman, E. Huang, S. Ishida, H. Zuzan R. Spang, J.R. Marks, and J.R. Nevins. Predicting the clinical status of human breast cancer utilizing gene expression profiles. Proceedings of the National Academy of Sciences, 98:11462-11467, 2001.
33. R. Yoshida, T. Higuchi, and S. Imoto. A mixed factors model for dimension reduction and extraction of a group structure in gene expression data. Proceedings of the 2004 IEEE Computational Systems Bioinformatics Conference, pages 161-172, 2004.
34. R. Yoshida, T. Higuchi, S. Imoto, and S. Miyano. Arraycluster: an analytic tool for clustering, data visualization and module finder on gene expression profiles. Bioinformatics, 22(12): 1538-1539, 2006.
35. H. Zou, T. Hastie, and R. Tibshirani. Sparse principal component analysis. Journal of Computational and Graphical Statistics, 15(2):265-286, 2006.