An extension of neural gas to local PCA

Neurocomputing

Volumn 62, Issue 1-4, 2004, Pages 305-326

  Möller, Ralf ^a   Hoffmann, Heiko ^b  

^a BIELEFELD UNIVERSITY   (Germany)

^b MAX PLANCK INSTITUTE FOR HUMAN COGNITIVE AND BRAIN SCIENCES   (Germany)

Author keywords

Handwritten digit recognition; Local principal component analysis; Neural gas; Unsupervised learning; Vector quantization

Indexed keywords

DATA REDUCTION; LEAST SQUARES APPROXIMATIONS; PATTERN RECOGNITION; PRINCIPAL COMPONENT ANALYSIS; VECTOR QUANTIZATION;

HANDWRITTEN DIGITS; NEURAL GAS; SQUARED RECONSTRUCTION ERRORS;

GASES;

ANALYSIS OF VARIANCE; ANALYTICAL ERROR; ARTICLE; COMPUTER SIMULATION; CONTROLLED STUDY; DATA ANALYSIS; HANDWRITING; MATHEMATICAL COMPUTING; MEASUREMENT; PRINCIPAL COMPONENT ANALYSIS; PRIORITY JOURNAL; QUANTITATIVE ANALYSIS; STATISTICAL DISTRIBUTION;

EID: 8644270422     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2003.09.014     Document Type: Article

References (27)

1. Albrecht S. Busch J. Kloppenburg M. Metze F. Tavan P. Generalized radial basis function networks for classification and novelty detection: Self-organization of optimal Bayesian decision Neural Networks 13 10 2000 1075-1093
2. Alpaydin E. Soft vector quantization and the EM algorithm Neural Networks 11 3 1998 467-477
3. Bannour S. Azimi-Sadjadi M.R. Principal component extraction using recursive least squares learning IEEE Trans. Neural Networks 6 2 1995 457-469
4. Bregler C. Omohundro S.M. Nonlinear image interpolation using manifold learning. In: Tesauro G. Touretzky D. Leen T. (Eds.). Advances in Neural Information Processing Systems Vol. 7 1995 973-980 MIT Press Cambridge, MA
5. Dempster A.P. Laird N.M. Rubin D.B. Maximum likelihood from incomplete data via EM algorithm J. Roy. Stat. Soc. Ser. B 39 1 1977 1-38
6. Diamantaras K.I. Kung S.Y. Principal Component Neural Networks, Theory and Applications 1996 Wiley New York
7. Dony R.D. Haykin S. Image segmentation using a mixture of principal components representation IEE Proc. Vision Image Signal Process. 144 2 1997 73-80
8. Golub G.H. van Loan C.F. Matrix Computations 3rd Edition 1996 Johns Hopkins University Press Baltimore, London
9. Hancock P.J.B. Baddeley R.J. Smith L.S. The principal components of natural images Network 3 1 1992 61-70
10. Hinton G.E. Dayan P. Revow M. Modeling the manifolds of images of handwritten digits IEEE Trans. Neural Networks 8 1 1997 65-74
11. Jordan M.I. Xu L. Convergence results for the EM approach to mixtures of experts architectures Neural Networks 8 9 1995 1409-1431
12. Kambhatla N. Leen T.K. Dimension reduction by local principal component analysis Neural Comput. 9 7 1997 1493-1516
13. Y. LeCun, The MNIST database of handwritten digits, NEC Research Institute, 1998. http://yann.lecun.com/exdb/mnist/index.html
14. Y. LeCun, L. Jackel, L. Bottou, A. Brunot, C. Cortes, J. Denker, H. Drucker, I. Guyon, U. Müller, E. Säckinger, P. Simard, V. Vapnik, Comparison of learning algorithms for handwritten digit recognition, in: F. Fogelman, P. Gallinari (Eds.), Proceedings of the International Conference on Artificial Neural Networks, 1995, pp. 53-60
15. Martinetz T.M. Berkovich S.G. Schulten K.J. "Neural-gas" network for vector quantization and its application to time-series prediction IEEE Trans. Neural Networks 4 4 1993 558-569
16. Meinicke P. Ritter H. Resolution-based complexity control for Gaussian mixture models Neural Comput. 13 2 2001 453-475
17. Möller R. Interlocking of learning and orthonormalization in RRLSA Neurocomputing 49 1-4 2002 429-433
18. I. Nabney, C. Bishop, Netlab neural network software, Neural Computing Research Group, Aston University, 2002. http://www.ncrg.aston.ac.uk/netlab/
19. Oja E. Neural networks, principal components, and subspaces Int. J. Neural Systems 1 1 1989 61-68
20. Ouyang S. Bao Z. Liao G.-S. Robust recursive least squares algorithm for principal component analysis IEEE Trans. Neural Networks 11 1 2000 215-221
21. Sanger T.D. Optimal unsupervised learning in a single-layer linear feedforward neural network Neural Networks 2 6 1989 459-473
22. Sung K.K. Poggio T. Example-based learning for view-based human face detection IEEE Trans. Pattern Anal. Mach. Intell. 20 1 1998 39-51
23. Tipping M.E. Bishop C.M. Mixtures of probabilistic principal component analyzers Neural Comput. 11 2 1999 443-482
24. Weingessel A. Hornik K. Local PCA algorithms IEEE Trans. Neural Networks 11 6 2000 1242-1250
25. Xu L. Jordan M.I. On convergence properties of the EM algorithm for Gaussian mixtures Neural Comput. 8 1 1996 129-151
26. Zhang B. Fu M. Yan H. Handwritten digit recognition by a mixture of local principal component analysis Neural Process. Lett. 8 3 1998 241-252
27. Zhang B. Fu M. Yan H. A nonlinear neural network model of mixture of local principal component analysis: Application to handwritten digits recognition Pattern Recogn. 34 2 2001 203-214