Variational Bayes Method for Mixture of Principal Component Analyzers

Systems and Computers in Japan

Volumn 34, Issue 11, 2003, Pages 55-66

  Oba, Shigeyuki ^a   Sato, Masa Aki ^b,c   Ishii, Shin ^a,c  

^a NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

^b ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^c JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

Author keywords

Bayesian inference; Feature extraction; Mixture of Principal Component Analyzers; Model selection; Variational Bayes method

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; INTEGRATION; PRINCIPAL COMPONENT ANALYSIS; PROBABILITY; PROBLEM SOLVING;

BAYES METHOD;

FEATURE EXTRACTION;

EID: 0141526271     PISSN: 08821666     EISSN: None     Source Type: Journal    
DOI: 10.1002/scj.10394     Document Type: Article

References (14)

1. Tipping ME, Bishop CM. Mixtures of probabilistic principal component analyzers. Neural Comput 1999; 11:443-482.
2. MacKay DJC. Probable networks and plausible predictions - A review of practical Bayesian methods for supervised neural networks. Network: Comput Neural Syst 1995;6:469-505.
3. Neal RM. Bayesian learning for neural networks. Springer-Verlag; 1996.
4. Attias H. Learning parameters and structure of latent variable models by variational Bayes. Proceedings of Uncertainty in Artificial Intelligence, 1999.
5. Sato M. On-line model selection based on the variational Bayes. Neural Comput 2001;13:1649-1681.
6. Ghahramani Z, Beal MJ. Variational inference for Bayesian mixture of factor analyzers. Adv Neural Inf Process Syst 2000;12:449-455.
7. Bishop CM. Variational principal components. IEE Conference Publication on Artificial Neural Networks, p 509-514, 1999.
8. Minka TP. Using lower bounds to approximate integrals. http://vismod.www.media.mit.edu/̃tpminka/papers/tutorial.html, 2001.
9. Rissanen J. Stochastic complexity. J R Stat Soc B 1987;49:223-239, 253-265.
10. Ueda N, Ghahramani Z. Bayesian model search for mixture models based on optimizing variational bounds. Neural Networks 2002;15:1223-1242.
11. Waterhouse S, Mackay D, Robinson T. Bayesian methods for mixture of experts, Adv Neural Inf Process Syst 1996;8:351-357.
12. Bishop CM, Bayesian PCA. Adv Neural Inf Process Syst 1999;11:509-514.
13. Neal RM, Hinton GE. A view of the EM algorithm that justifies incremental, sparse, and other variants. In: Jordan MI, et al (editors). Learning in graphical models. Kluwer Academic; 1999. p 355-368.
14. Moerland P. A comparison of mixture models for density estimation. Proc International Conference on Artificial Neural Networks (ICANN'99), p 15-30.