A new algorithm of non-Gaussian component analysis with radial kernel functions

Annals of the Institute of Statistical Mathematics

Volumn 59, Issue 1, 2007, Pages 57-75

  Kawanabe, Motoaki ^a   Sugiyama, Masashi ^b   Blanchard, Gilles ^a,c   Müller, Klaus Robert ^a,d  

^a FRAUNHOFER FIRST   (Germany)

^b TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

^c CNRS   (France)

^d TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

Author keywords

Linear dimension reduction; Non Gaussian subspace; Projection pursuit; Semiparametric model; Stein's identity

Indexed keywords

ALGORITHMS; DATA HANDLING; GAUSSIAN NOISE (ELECTRONIC); ITERATIVE METHODS;

LINEAR DIMENSION REDUCTION; NON-GAUSSIAN SUBSPACE; PROJECTION PURSUIT; SEMIPARAMETRIC MODEL; STEIN'S IDENTITY;

RADIAL BASIS FUNCTION NETWORKS;

EID: 33847203655     PISSN: 00203157     EISSN: 15729052     Source Type: Journal    
DOI: 10.1007/s10463-006-0098-9     Document Type: Article

References (30)

1. Attias, H. (1999). Independent factor analysis. Neural Computation, 11(4), 803-851.
2. Bach, F. R., Jordan, M. I. (2002). Kernel independent component analysis. Journal of Machine Learning Research, 3, 1-48.
3. Belkin, M., Niyogi, P. (2003). Laplacian eigenmaps for dimensionality reduction and data representation. Neural Computation, 15(6), 1373-1396.
4. Bishop, C. M. (1995). Neural Networks for Pattern Recognition. Oxford: Oxford University Press.
5. Blanchard, O., Kawanabe, M., Sugiyama, M., Spokoiny, V., Müller, K.-R. (2006). In search of non-gaussian components of a high-dimensional distribution. Journal of Machine Learning Research, 7, 247-282.
6. Boscolo, R., Pan, H., Roychowdhury, V. P. (2004). Independent component analysis based on nonparametric density estimation. IEEE Transactions on Neural Networks, 15(1), 55-65.
7. Chen, A., Bickel, P. J. (2006). Efficient independent component analysis. Annals of Statistics, 34(6).
8. Comon, P. (1994). Independent component analysis - a new concept? Signal Processing, 36, 287-314.
9. Eriksson, J., Kankainen, A., Koivunen, V. (2001). Novel characteristic function based criteria for ica. In: Proceedings of Third International Workshop on Independent Component Analysis and Blind Source Separation (pp 108-113).
10. Eriksson, J., Karvanen, J., Koivunen, V. (2000). Source distribution adaptive maximum likelihood estimation of ica model. In: P. Pajunen, J. Karhunen, (Eds.), Proceedings of second international workshop on independent component analysis and blind source separation (pp. 227-232).
11. Friedman, J. H., Tukey, J. W. (1974). A projection pursuit algorithm for exploratory data analysis. IEEE Transactions on Computers, 23(9), 881-890.
12. Girolami, M., Fyfe, C. (1997). An extended exploratory projection pursuit network with linear and nonlinear anti-hebbian lateral connections applied to the cocktail party problem. Neural Networks, 10(9), 1607-1618.
13. Gretton, A., Herbrich, R., Smola, A., Bousquet, O., Schölkopf, B. (2005). Kernel methods for measuring independence. Journal of Machine Learning Research, 6, 2075-2129.
14. Harmeling, S., Ziehe, A., Kawanabe, M., Müller, K.-R. (2003). Kernel-based nonlinear blind source separation. Neural Computation, 15(5), 1089-1124.
15. Hastie, T., Tibshirani, R. (2003). Independent components analysis through product density estimation. In: S. Becker, S. T., Obermayer, K. (Eds.), Advances in Neural Information Processing Systems 15 (pp 649-656). Cambridge: MIT
16. Huber, P. J. (1985). Projection pursuit. The Annals of Statistics, 13, 435-475.
17. Hyvärinen, A. (1999). Fast and robust fixed-point algorithms for independent component analysis. IEEE Transactions on Neural Networks, 10(3), 626-634.
18. Hyvärinen, A., Karhunen, J., Oja, E. (2001). Independent Component Analysis. New York: Wiley
19. Learned-Miller, E. G., Fisher, J. W. (2003). ICA using spacing estimates of entropy. Journal of Machine Learning Research, 4, 1271-1295.
20. Lee, T. W., Girolami, M., Sejnowski, T. J. (1999). Independent component analysis using an extended informax algorithm for mixed subgaussian and supergaussian sources. Neural Computation, 11(2), 417-441.
21. Moody, J., Darken, C. (1989). Fast learning in networks of locally-tuned processing units. Neural Computation, 1, 281-294.
22. Müller, K.-R., Mika, S., Rätsch, G., Tsuda, K., Schölkopf, B. (2001). An introduction to kernel-based learning algorithms. IEEE Neural Networks, 12(2), 181-201.
23. Nason, G. (1992). Design and choice of projection indices. PhD thesis, University of Bath.
24. Roweis, S., Saul, L. (2000). Nonlinear dimensionality reduction by locally linear embedding. Science, 290(5500), 2323-2326.
25. Schölkopf, B., Smola, A. (2001). Learning with Kernels. New York: MIT.
26. Stein, C. M. (1981). Estimation of the mean of a multivariate normal distribution. Annals of Statistics, 9, 1135-1151.
27. Sugiyama, M., Kawanabe, M., Blanchard, G., Spokoiny, V., Müller, K.-R. (2006). Obtaining the best linear unbiased estimator of noisy signals by non-Gaussian component analysis. In Proceedings of 2006 IEEE international conference on acoustics, speech, and signal processing (pp. 608-611).
28. Tenenbaum, J. B., de Silva, V., Langford, J. C. (2000). A global geometric framework for nonlinear dimensionality reduction. Science, 290(5500), 2319-2323.
29. Theis, F. J., Kawanabe, M. (2006). Uniqueness of non-gaussian subspace analysis. In Proceedings of Sixth International Workshop on Independent Component Analysis and Blind Source Separation, LNCS vol. 3889 (pp 917-924). Berlin Heidelberg New York: Springer.
30. Vassis, N., Motomura, Y. (2001). Efficient source adaptivity in independent compoenent analysis. IEEE Transactions on Neural Networks, 12, 559-566.