Finding clusters and components by unsupervised learning

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3138, Issue , 2004, Pages 1-15

  Oja, Erkki ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; INDEPENDENT COMPONENT ANALYSIS; LEARNING SYSTEMS; PATTERN RECOGNITION; UNSUPERVISED LEARNING;

CLUSTERING METHODS; GENERATIVE MODEL; LEARNING VECTORS; NONLINEAR INDEPENDENT COMPONENT ANALYSIS; STATISTICAL PATTERN RECOGNITION; TUTORIAL SURVEYS; UNSUPERVISED LEARNING METHOD; UNSUPERVISED MACHINE LEARNING;

PRINCIPAL COMPONENT ANALYSIS;

EID: 33748412636     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-27868-9_1     Document Type: Article

References (62)

1. Amari, S.- I., Cichocki, A. and Yang, H., "A new learning algorithm for blind source separation". In Advances in Neural Information Processing Systems 8, Cambridge: MIT Press, 1996, pp. 757 - 763.
2. Attias, H., "Independent factor analysis", Neural Computation 11 (4), 1999, pp. 803 - 851.
3. Baldi, P. and Hornik, K., "Learning in linear neural networks: a survey", IEEE Trans. Neural Networks 6 (4), 1995, pp. 837 - 858.
4. Barlow, H., "Unsupervised learning", Neural Computation 1, 1989, pp. 295 - 311.
5. Bell, A. and Sejnowski, T., "An information-maximization approach to blind separation and blind deconvolution", Neural Computation 7, 1995, pp. 1129 - 1159.
6. Belouchrani, A., Meraim, K., Cardoso, J-F., and Moulines, E., "A blind source separation technique based on second order statistics", IEEE Trans. Signal Proc. 45, 1997, pp. 434 - 444.
7. Bishop, C., Svensen, M and Williams, C., "GTM: the generative topographic mapping", Neural Computation 10, 1998, pp. 215 - 234.
8. Bourlard, H. and Kamp, Y., "Auto-association by multilayer Perceptrons and singular value decomposition", Biol. Cybernetics 59, 1988, pp. 291 - 294.
9. Cardoso, J.- F., "Blind signal separation: statistical principles", Proc. of the IEEE 9 (10), 1998, pp. 2009 - 2025.
10. Cichocki, A. and Unbehauen, R., "Robust neural networks with on-line learning for blind identification and blind separation of sources", IEEE Trans, on Circuits and Systems 43 (11), 1996, pp. 894 - 906.
11. Cottrell, G., Munro, P. and Zipser, D., "Learning internal representations from gray-scale images: an example of extensional programming", Proc. 9th Ann. Conf. of the Cognitive Science Society, 1987, pp. 462 - 473.
12. Der, R. and Herrmann, M., "Second-order learning in Self-Organizing Maps", in Oja, E. and Kaski, S. (Eds.),Kohonen Maps. Amsterdam: Elsevier, 1999, pp. 293 -302.
13. Devijver, P. and Kittler, J., Pattern Recognition - a Statistical Approach. Englewood Cliffs, NJ: Prentice-Hall, 1982.
14. Diamantaras, K. and Kung, S.: Principal Component Neural Networks: Theory and Applications. New York: J. Wiley and Sons, 1996.
15. The FastICA package.Available from www.cis.hut.fi/projects/ica/
16. Foldiak, P., "Adaptive network for optimal linear feature extraction", Proc. Int. J. Conf. on Neural Networks, Washington, DC, 1989, pp. 401 - 406.
17. Funahashi, K., "On the approximate realization of continuous mappings by neural networks", Neural Networks S, 1989, pp. 183-192.
18. Harman, H.H., Modern Factor Analysis. Univ. of Chicago Press, 1967.
19. Hastie, T. and Stuetzle, W., "Principal curves", J. Am. Statist. Assoc. 84, 1989, pp. 502 - 516."
20. Haykin, S., Neural Networks - a Comprehensive Foundation. New York: MacMillan College Publ. Co., 1998.
21. Heskes, T., "Energy functions for Self-Organizing Maps", in Oja, E. and Kaski, S. (Eds.),Kohonen Maps. Amsterdam: Elsevier, 1999, pp. 303 - 316.
22. Hinton, G., Revow, M. and Dayan, P., "Recognizing handwritten digits using mixtures of linear models", in G. Tesauro, D. Tourctzky, and T. Leen (Eds.), Advances in Neural Information Processing Systems 6, San Mateo: Kauffman, 1995, pp. 1015 - 1022.
23. Hinton, G. and Sejnowski, T.J., Unsupervised Learning - Foundations of Neural Computation. Cambridge, MA: MIT Press, 1999.
24. Hornik, M., Stinchcombe, M., and White, H., "Multilayer Feedforward Networks are Universal Approximators", Neural Networks 2, 1989, pp. 359-368.
25. Hyvärinen, A. and Oja, E., "A fast fixed-point algorithm for Independent Component Analysis", Neural Computation 9 (7), 1997, pp. 1483 - 1492.
26. Hyvärinen, A., "Fast and robust fixed-point algorithms for Independent Component Analysis", IEEE Trans. Neural Networks 10 (3), 1999, pp. 626 - 634.
27. Hyvärinen, A., Karhunen, J. and Oja, E., Independent Component Analysis. New York, Wiley, 2001.
28. Hyvärinen, A. and Pajunen, P., "Nonlinear independent component analysis: existence and uniqueness results", Neural Networks 12, 1999, pp. 429 - 439.
29. Hin, A., Valpola, H. and Oja, E., "Nonlinear dynamical factor analysis for state change detection", IEEE Trans. Neural Networks 15, No. 3, May 2004.
30. Jain, A. K., Duin, P. W., and Mao, J., "Statistical pattern recognition: a review", IEEE Trans. Pattern Analysis and Machine Intelligence 22, 2000, pp. 4 - 37.
31. Japkowitz, N, Hanson, S and Gluck, A., "Nonlinear autoassociation is not equivalent to PCA", Neural Computation 12 (3), 2000, pp. 531 - 545.
32. Jutten, C. and Herault, J., "Blind separation of sources, part I: an adaptive algorithm based on neuromimetic architecture", Signal Processing 24, 1991, pp. 1 10.
33. Jutten, C. and Karhunen, J., "Advances in nonlinear blind source separation", Proc. 4th Int. Symp. on ICA and BSS, Nara, Japan, April 1-4, 2003, pp. 245 - 256.
34. Karhunen, J., Oja, E., Wang, L., Vigario, R., and Joutsensalo, J., "A class of neural networks for independent component analysis", IEEE Trans, on Neural Networks 8 (3), 1997, pp. 486 - 504.
35. Kendall, M and Stuart, A., The Advanced Theory of Statistics, Vols. 1 - 3. MacMillan, 1976 - 1979.
36. Kohonen, T., Self-Organizing Maps. Berlin: Springer, 1995. 3rd Edition, 2001.
37. Kohonen, T., Kaski, S., Lagus, K., Salojärvi, J., Paatero, V. and saarela, A., "Self organization of massive document collection", IEEE Trans. Neural Networks 11 (3), 2000, pp. 574 - 585.
38. von der Malsburg, C., "Self-organization of orientation sensitive cells in the striate cortex", Kybernetik 14, 1973, pp. 85 - 100.
39. Oja, E. "A Simplified Neuron Model as a Principal Components Analyzer", J. Math. Biol. 15, 1982, pp. 267-273.
40. Oja, E., Subspace Methods of Pattern Recognition. Letchworth: RSP and J. Wiley, 1983.
41. Oja, E., "Data Compression, Feature Extraction, and Autoassociation in Feedforward Neural Networks", Proc. 1CANN-91, Espoo, Finland, June 24 - 28, 1991, pp. 737 - 745.
42. Oja, E., "Principal Components, Minor Components, and Linear Neural Networks", Neural Networks 5, 1992, pp. 927 - 935.
43. Oja, E., "The nonlinear PCA learning rule in independent component analysis", Neurocomputing 17 (1), 1997, 25 - 46.
44. Oja, E. and Kaski, S. (Eds.),Kohonen Maps. Amsterdam: Elsevier, 1999.
45. Oja, E. and Wang, L., "Neural fitting: robustness by anti-Hebbian learning", Neurocomputing 12, 1976, pp. 155 - 170.
46. Pham, D. and Cardoso, J-P., "Blind separation of instantaneous mixtures of nonstationary sources", IEEE Trans. Signal Proc. 49, 2001, pp. 1837 - 1848.
47. Ritter, H., Martinetz, T., and Schulten, K., Neural Computation and SelfOrganizing Maps: an Introduction. Reading: Addison-Wesley, 1992.
48. Roweis, S. and Ghahramani, Z., "A unifying review of linear gaussian models", Neural Computation 11 (2), 1999, pp. 305 - 346.
49. Rubner, J. and Tavan, P., "A self-organizing network for Principal Component Analysis", Europhysics Letters 10 (7), 1989, pp. 693 - 698.
50. Sanger, T., "Optimal unsupervised learning in a single-layered linear feedforward network", Neural Networks 2, 1989, pp. 459 - 473.
51. Schalkoff, R., Pattern Recognition - Statistical, Structural, and Neural Approaches. J. Wiley, 1992.
52. Schölkopf, B., smola, A. J. and Müller, K.-R., "Nonlinear component analysis as a kernel eigenvalue problem", Neural Comput. 10, 1998, 1299 - 1319.
53. Bibliography of SOM papers: a reference list of over 4000 studies on the SelfOrganizing Map. Available at www.cis.hut.fi/research/som-bibl/.
54. The SOM Toolbox for Matlab. Available at www.cis.hut.fi/projects/ somtoolbox/.
55. Tipping, M. E. and Bishop, C. M., "Mixtures of probabilistic principal component analyzers", Neural Computation 11 (2), 1999, pp. 443 - 482.
56. Valpola, II., "Bayesian ensemble learning for nonlinear factor analysis", Ado. Polyt. Scand. Ma 108, Espoo, 2000. D.Sc. Thesis, Helsinki University of Technology.
57. Valpola, H., Oja, E., Hin, A., Honkela, A. and KArhunen, J., "Nonlinear blind source separation by variational Bayesian learning", IEICE Trans. E86-A, 2003, pp. 532 - 541.
58. VanHulle, M., Faithful Representations and Topographic Maps. New York: J. Wiley & Sons, 2000.
59. Villmann, T., "Topology preservation in Self - Organizing Maps". In Oja, E. and Kaski, S. (Eds.),Kohonen Maps. Amsterdam: Elsevier, 1999, pp. 267 - 292.
60. Wang, L. and Karhunen, J., " A unified neural bigradient algorithm for robust PC A and MCA", Int. J. of Neural Systems 7 (1), 1996, pp. 53 - 67.
61. Webb, A., Statistical Pattern Recognition. Arnold, 1999.
62. Xu, L., "Temporal BYY learning for state space approach, hidden Markov model, and blind source separation", IEEE Trans. Signal Proc. 48, 2000, pp. 2132 - 2144.