Analysis of the convergence and divergence of a constrained anti-hebbian learning algorithm

IEEE Transactions on Circuits and Systems II: Analog and Digital Signal Processing

Volumn 45, Issue 11, 1998, Pages 1494-1502

  Choy, Clifford Sze Tsan ^a   Siu, Wan Chi ^a  

^a HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

Constrainted anti hebbian learning algorithm; Convergence and divergence analysis; Stochastic approximation; Total least square 111

Indexed keywords

CONVERGENCE OF NUMERICAL METHODS; DIFFERENTIAL EQUATIONS; LEAST SQUARES APPROXIMATIONS; RANDOM PROCESSES;

ANTI-HEBBIAN LEARNING ALGORITHM; DIVERGENCE ANALYSIS;

LEARNING ALGORITHMS;

EID: 0032206153     PISSN: 10577130     EISSN: None     Source Type: Journal    
DOI: 10.1109/82.735361     Document Type: Article

References (15)

1. G.H. Golub and C. F. Van Loan, Matrix Computations, 2nd ed. Baltimore, MD: The Johns Hopkins University Press, 1989.
2. M.D. A. Rahman and K.-B. Yu, Total least squares approach for frequency estimation using linear prediction, IEEE Trans. Acoustics, Speech, Signal Processing, vol. ASSP-35, pp. 1440-1454, Oct. 1987.
3. L. Xu, E. Oja, and C.Y. Suen, Modified Hebbian learning for curve and surface fitting, Neural Networks, vol. 5, pp. 441-457, 1992.
4. C.E. Davila, An efficient recursive total least squares algorithm for FIR adaptive filtering, IEEE Trans. Signal Processing, vol. 42, pp. 268-280, Feb. 1994.
5. K. Gao, O. Ahmad, and M.N. S. Swamy, A constrained anti-Hebbian learning algorithm for total least-squares estimation with applications to adaptive FIR and IIR filtering, IEEE Trans. Circuits Syst. II, vol. 41, pp. 718-729, Nov. 1994.
6. K.D. Rao and D. C. Reddy, A new method for finding electromagnetic emitter location, IEEE Trans. Aerosp. Electron. Syst., vol. 30, pp. 1081-1085, Oct. 1994.
7. J. Rahman and T.K. Sarkar, Deconvolution and total least squares in finding the impulse response of an electromagnetic system from measured data, IEEE Trans. Antennas Propagat., vol. 43, pp. 416-421, Apr. 1995.
8. F.-L. Luo, R. Unbehauen, and A. Cichocki, A minor component analysis algorithm, Neural Networks, vol. 10, no. 2, pp. 291-297, 1997.
9. E. Oja, A simplified neuron model as a principal component analyzer, J. Math. Biology, vol. 15, pp. 267-273, 1982.
10. E. Oja and J. Karhunen, On stochastic approximation of the eigenvectors and eigenvalues of the expectation of a random matrix, J. Math. Analysis Applicat., vol. 106, pp. 69-84, 1985.
11. H. Robbins and S. Monro, A stochastic approximation method, Annals of Math. Stat., vol. 22, pp. 400-407, 1951.
12. L. Ljung, Analysis of recursive stochastic algorithms, IEEE Trans. Automat. Contr., vol. 22, pp. 551-574, Aug. 1977.
13. B. Widrow, Adaptive Signal Processing. Englewood Cliffs, NJ: Prentice-Hall, Signal Processing Series, 1985.
14. H.J. Kushner and D. S. Clark, Stochastic Approximation Methods for Constrained and Unconstrained Systems. Berlin: Springer-Verlag, 1978.
15. A.D. Polyanin and V. F. Zaitsev, Exact Solutions for Ordinary Differential Equations. Boca Raton, FL: CRC Press, 1995.