Algorithms and networks for accelerated convergence of adaptive LDA

Pattern Recognition

Volumn 38, Issue 4, 2005, Pages 473-483

  Moghaddam, Hamid Abrishami ^a   Matinfar, Mehdi ^a   Sadough, Seyed Mohammad Sajad ^a   Zadeh, Kh Amiri ^b  

^a K N TOOSI UNIVERSITY OF TECHNOLOGY   (Iran)

^b ISLAMIC AZAD UNIVERSITY   (Iran)

Author keywords

Adaptive linear discriminant analysis; Adaptive principal component analysis; Conjugate direction optimization; Convergence analysis; Gradient descent optimization; Newton Raphson optimization; Self organizing neural network; Steepest descent optimization

Indexed keywords

ADAPTIVE ALGORITHMS; CONVERGENCE OF NUMERICAL METHODS; IMAGE PROCESSING; ITERATIVE METHODS; NEURAL NETWORKS; ONLINE SYSTEMS; OPTIMIZATION; PRINCIPAL COMPONENT ANALYSIS; ROBUSTNESS (CONTROL SYSTEMS);

ADAPTIVE LINEAR DISCRIMINANT ANALYSIS; ADAPTIVE PRINCIPAL COMPONENT ANALYSIS; CONJUGATE DIRECTION OPTIMIZATION; CONVERGENCE ANALYSIS; GRADIENT DESCENT OPTIMIZATION; NEWTON-RAPHSON OPTIMIZATION; SELF-ORGANIZING NEURAL NETWORKS; STEEPEST DESCENT OPTIMIZATION;

PATTERN RECOGNITION;

EID: 10644260389     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2004.07.003     Document Type: Article

References (23)

1. C. Chang, H. Ren, An experiment-based quantitative and comparative analysis of target detection and image classification algorithms for hyperspectral imagery, IEEE Trans. Geosci. Remote Sensing 38 (2) (2000) 1044-1063.
2. C. Chatterjee, V.P. Roychowdhury, On self-organizing algorithm and networks for class-separability features, IEEE Trans. Neural Networks 8 (3) (1997) 663-678.
3. L. Chen, H. Mark Liao, J. Lin, M. Ko, G. Yu, A new LDA-based face recognition system which can solve the small sample size problem, Pattern Recog. 33 (10) (2000) 1713-1726.
4. W. Zhao, A. Krishnaswamy, R. Chellappa, D.L. Swets, J. Weng, Discriminant analysis of principal components for face recognition, in: H. Wechsler, P.J. Phillips, V. Bruce, F. Fogelman Soulie, T.S. Huang (Eds.), Face Recognition: From Theory to Applications, Springer, Berlin, 1998, pp. 73-85.
5. C. Lee, J. Hong, Optimizing feature extraction for multiclass cases, in: IEEE International Conference on Computational Cybernetics and Simulations, 1997, pp. 2545-2548.
6. X.D. Huang, Y. Akiri, M.A. Jack, Hidden Markov Models for Speech Recognition, Edinburgh University Press, UK, 1990.
7. Y. Maio, Y. Hua, Fast subspace tracking and neural-network learning by a novel information criterion, IEEE Trans. Signal Process. 46 (1998) 1964-1979.
8. S. Bannour, M.R. Azimi-Sadjadi, Principal component extraction using recursive least squares learning, IEEE Trans. Neural Networks 6 (1995) 457-469.
9. L. Xu, Least mean square error reconstruction principle for self-organizing neural-net. Neural Networks 6 (1993) 627-648.
10. J. Mao, A.K. Jain, Discriminant analysis neural networks, in: IEEE International Conference on Neural Networks, San Francisco, CA, 1993, pp. 300-305.
11. C. Chatterjee, Z. Kang, V.P. Roychowdhury, Algorithms for accelerated convergence of adaptive PCA, IEEE Trans. Neural Networks 11 (2) (2000) 338-355.
12. H. Abrishami Moghaddam, Kh. Amiri-Zadeh, Fast adaptive algorithms and networks for class-separability features, Pattern Recog. 36 (2003) 1695-1702.
13. S. Haykin, Neural Networks: A Comprehensive Foundation, Macmillan, 1994.
14. T.K. Sarkar, X. Yang, Application of conjugate gradient and steepest descent for computing the eigenvalues of an operator, Signal Processing 17 (1989) 31-37.
15. B. Widrow, S. Stearns, Adaptive Signal Processing, Prentice-Hall, Englewood Cliffs, NJ, 1985.
16. T.D. Sanger, Optimal unsupervised learning in a single-layer linear feed-forward neural network. Neural Networks 2 ( 1998) 459-473.
17. A. Benveniste, M. Metivier, P. Priouret, Adaptive Algorithms and Stochastic Approximations, Springer, Berlin, 1990.
18. K. Fukunaga, Introduction to Statistical Pattern Recognition, 2nd Edition, Academic Press, New York, 1990.
19. H. Abrishami Moghaddam, Kh. Amiri-Zadeh, Fast linear discriminant analysis for on-line pattern recognition applications, in: Proceedings of the 16th International Conference on Pattern Recognition (ICPR2002), Quebec, Canada, 2002.
20. L. Ljung, Analysis of recursive stochastic algorithms, IEEE Trans. Automat. Cont. 22 (4) (1997) 551-575.
21. D. Luenberger, Linear and Nonlinear Programming, Addison-Wesley, Reading, MA, 1984.
22. T. Okada, S. Tomita, An optimal orthonormal system for discriminant analysis, Pattern Recog. 18 (2) (1985) 139-144.
23. J.R. Magnus, H. Neudecker, Matrix Differential Calculus, Wiley, New York, 1999.