Variational learning of clusters of undercomplete nonsymmetric independent components

Journal of Machine Learning Research

Volumn 3, Issue 1, 2003, Pages 99-114

  Chan, Kwokleung ^a   Lee, Te Won ^b   Sejnowski, Terrence J ^a,c  

^a SALK INSTITUTE FOR BIOLOGICAL STUDIES   (United States)

^b UNIVERSITY OF CALIFORNIA SAN DIEGO   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Bayesian Learning; Density Estimations; ICA; Mixture Models

Indexed keywords

INDEPENDENT COMPONENT ANALYSIS; MAXIMUM LIKELIHOOD ESTIMATION; PATTERN RECOGNITION; PROBABILITY DENSITY FUNCTION;

BAYESIAN LEARNING;

LEARNING SYSTEMS;

EID: 0037848978     PISSN: 15324435     EISSN: None     Source Type: Journal    
DOI: 10.1162/153244303768966120     Document Type: Article

References (23)

1. S.-I. Amari. Natural gradient learning for over- and undercomplete bases in ICA. Neural Computation, 11 (8):1875-1883, Nov 1999.
2. Hagai Attias. Independent factor analysis. Neural Computation, 11(4):803-851, 1999a.
3. Hagai Attias. Inferring parameters and structure of latent variable models by variational Bayes. In Proceedings of 15th Conference on Uncertainty in Artificial Intelligence, pages 21-30, 1999b.
4. Christopher M. Bishop. Variational PCA. In Proc. Ninth Int. Conf. on Artificial Neural Networks, pages 509-514. ICANN, 1999.
5. Kwokleung Chan, Te-Won Lee, Pamela A. Sample, Michael Goldbaum, Robert N. Weinreb, and Terrence J. Sejnowski. Comparison of machine learning and traditional classifier in glaucoma diagnosis. IEEE Transactions on Biomedical Engineering, 2002. (accepted).
6. Kwokleung Chan, Te-Won Lee, and Terrence J Sejnowski. Variational learning of clusters of under-complete nonsymmetric independent components. In 3rd International Conference on Independent Component Analysis and Blind Signal Separation, pages 492-497, San Diego, Dec. 09-12 2001.
7. Rizwan A. Choudrey and Stephen J. Roberts. Variational mixture of Bayesian independent component analysers. Technical Report PARG-01-04, Department of Engineering Science, University of Oxford, 2001.
8. Zoubin Ghahramani and Matthew J. Beal. Variational inference for Bayesian mixtures of factor analysers. In S. Solla, Todd K. Leen, and K.-R. Muller, editors, Advances in Neural Information Processing Systems 12, pages 449-455. MIT Press, 2000.
9. R. A. Hitchings and G. L. Spaeth. The optic disc in glaucoma, II: correlation of appearance of the optic disc with the visual field. Br J Ophthalmol., 61:107-113, 1977.
10. Pedro A.d.F.R. Højen-Sørensen, Ole Winther, and Lars Kai Hansen. Mean-field approaches to independent component analysis. Neural Computation, 14(4):889-918, 2002.
11. Aapo Hyvarinen, Juha Karhunen, and Erkki Oja. Independent Component Analysis. J. Wiley, New York, 2001.
12. Edwin T. Jaynes. E. T. Jaynes: papers on probability, statistics, and statistical physics. Kluwer, Boston, 1983.
13. C. A. Johnson. Perimetry and visual field testing. In K. Zadnik, editor, The Ocular Examination: Measurements and Findings. W.B. Saunders, Philadelphia, 1997.
14. Michael I. Jordan, Zoubin Ghahramani, Tommi Jaakkola, and Lawrence K. Saul. An introduction to variational methods for graphical models. Machine Learning, 37(2):183-233, 1999.
15. Tzyy-Ping Jung, Scott Makeig, Martin J. McKeown, Anthony Bell, Te-Won Lee, and Terrence J. Sejnowski. Imaging brain dynamics using independent component analysis. Proceedings of the IEEE, 89(7):1107-22, 2001.
16. J. Karvanen, J. Eriksson, and V Koivunen. Maximum likelihood estimation of ICA model for wide class of source distributions. In B. Widrow, L. Guan, K. Paliwa, T. Adali, J. Larsen, E. Wilson, and S Douglas, editors, Neural Networks for Signal Processing X, 2000. Proceedings of the 2000 IEEE Signal Processing Society Workshop, volume 1, pages 445-454, Piscataway, NJ, USA, Dec. 11-13, 2000. IEEE.
17. H. Lappalainen. Ensemble learning for independent component analysis. In International Workshop on ICA and Blind Signal Separation, pages 7-12, Aussois, Jan. 11-15 1999.
18. T-W. Lee, M. S. Lewicki, and T. J. Sejnowski. ICA mixture models for unsupervised classification with non-Gaussian sources and automatic context switching in blind signal separation. IEEE Transactions on Pattern Recognition and Machine Learning, 22(10):1-12, Oct 2000.
19. James Miskin. Ensemble learning for independent component analysis. Ph.D. thesis, Department of Physics, University of Cambridge, UK, Jun. 2000.
20. Èric Moulines, Jean-Franşois Cardoso, and Elisabeth Gassiat. Maximum likelihood for blind separation and deconvolution of noisy signals using mixture models. In Proceedings of the ICASSP'97, volume 5, pages 3617-3620, Munich, Germany, 1997.
21. Radford M. Neal. Bayesian Learning for Neural Networks. Springer-Verlag, New York, 1996.
22. B. Olshausen and D. Field. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381:607-609, 1996.
23. Max Welling and Markus Weber. A constrained EM algorithm for independent component analysis. Neural Computation, 13(3):677-689, 2001.