Total least mean squares algorithm

IEEE Transactions on Signal Processing

Volumn 46, Issue 8, 1998, Pages 2122-2130

  Feng, Da Zheng ^a   Bao, Zheng ^a   Jiao, Li Cheng ^a  

^a XIDIAN UNIVERSITY   (China)

Author keywords

Hebb learn rule; Lms algorithm; Stability; Statistical analysis; System identification; Unsupervised learning

Indexed keywords

ADAPTIVE CONTROL SYSTEMS; COMPUTER SIMULATION; CONVERGENCE OF NUMERICAL METHODS; ERROR ANALYSIS; LEAST SQUARES APPROXIMATIONS; SIGNAL PROCESSING; SIGNAL TO NOISE RATIO; STATISTICAL METHODS;

ADAPTIVE SIGNAL PROCESSING; LEAST MEAN SQUARES ALGORITHM; MINIMUM MEAN SQUARE ERROR; TOTAL LEAST MEAN SQUARES ALGORITHM;

ALGORITHMS;

EID: 0032142099     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/78.705421     Document Type: Article

References (32)

1. B. Widrow, "Adaptive filters," in Aspects of Network and System Theory, N. de Claris and E. Kaiman, Eds. New York: Holt, Rinehart, and Winston, 1971.
2. B. Widrow and S. D. Stearns, Adaptive Signal Processing. Englewood Cliffs, NJ: Prentice-Hall, 1985.
3. K. Pearson, "On lines and planes of closest fit to points in space," Philos. Mag., vol. 2, pp. 559-572, 1901.
4. G. Holub and C. F. Van Loan, "An analysis of the total least squares problem," S1AM Numer. Anal, vol. 17, no. 6, pp. 883-893, Dec. 1980.
5. S. Van Huffel and J. Vanderwalle, "The total least squares problem, computational aspects and analysis," in SIAM Frontiers in Applied Mathematics. Philadelphia, PA: SIAM, 1991.
6. M. A. Rahman and K. B. Yu, "Total least square approach for frequency estimation using linear prediction," IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-35, pp. 1440-1454, 1987.
7. T. J. Abatzoglou and J. M. Mendel, "Constrained total least squares," in Proc. 1CASSP, Dallas, TX, Apr. 6-9, 1987, pp. 1485-1488.
8. T. J. Abatzoglou, " Frequency superresolution performance of the constrained total least squares method," in Proc. ICASSP, 1990, pp. 2603-2605.
9. N. K. Bose, H. C. Kirn, and H. M. Valenzuela, "Recursive total least square algorithm for image reconstruction," Multidim. Syst. Signal Process., vol. 4, pp. 253-268, July 1993.
10. E. Oja, "A simplified neuron model as a principal component analyzer," J. Math. Bioi, vol. 5, pp. 267-273, 1982.
11. "Principal components, minor components, and linear neural networks," Neural Networks, vol. 15, pp. 927-935, 1992.
12. G. A. Carpenter and S. Grossberg, "The art of adaptive pattern recog-nition by self-organizing neural network," IEEE Comput., vol. 21, pp. 77-88, 1988.
13. T. Kohonen, K. Makisara, and T. Saramaki, "Phontopic maps insight-ful representation of phonologically features for speech recognition," in Proc. 7th Int. Conf. Pattern Recoil., Montreal, P.Q., Canada, pp. 182-185.
14. K. Fukushima, "Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position," Biolog. Cybern., vol. 36, no. 2, pp. 193-202,1980
15. E. Oja and J. Karhunen, "On stochastic approximation of the eigenvectors and eigenvalues of the expectation of random matrix," J. Math. Anal. Appl., vol. 106, pp. 69-94, 1985.
16. P. Baldi and K. Hornik, "Neural network and principal component analysis: Learning form example without local minimal," Neural Networks, vol. 2, no. 1, pp. 52-58, 1989.
17. P. Foldiak, "Adaptive network for optimal linear feature extraction," in Proc. Int. Joint Conf. Neural Networks, Washington, DC, 1989, vol. 1, pp. 401-05.
18. T. D. Sanger, "Optimal unsupervised learning in a single-layer linear feedforword neural network," Neural Networks, vol. 2, pp. 459-173, 1989.
19. J. Rubner and P. Tavan, "A self-organizing network for principal component analysis," Europhys. Lett., vol. 10, no. 7, pp. 693-698, 1989.
20. K. I. Diamantaras and S. Y. Kung, Principal Component Neural Networks: Theory and Applications. New York: Wiley, 1996.
21. J. Karhunen and J. Joutsensalo, "Generalizations of principal component analysis, optimization problems, and neural networks," Neural Networks, vol. 8, no. 4, pp. 549-562, 1995.
22. N. K. Böse and P. Liang, Neural Networks Fundamentals: Graphs, Algorithms, and Applications. New York: McGraw-Hill, 1996.
23. L. Xu, E. Oja, and C. Y. Suen, "Modified Hebbian learning for curve and surface fitting," Neural Networks, vol. 5, pp. 441-157, 1992.
24. L. Xu, A. Kryzak, and E. Oja, "Neural-net method for dual surface pattern recognition," in Proc. Int. Joint Conf. Neural Networks, Seattle, WA, July 1992, vol. 2, pp. II379-II384.
25. F. Deprettere, Ed., SVD and Signal Processing, Algorithms, Applications, and Architecture. Amsterdam, The Netherlands: North Holland, 1988.
26. M. G. Larimore, "Adaptive convergence of spectral estimation based on Pisarenko harmonic retrieval," IEEE Trans. Acoust., Speech, Signal Processing vol. ASSP-31, pp. 955-962, 1983.
27. S. Haykin, Adaptive Filter Theory, 2nd Ed. Englewood Cliffs, NJ: Prentice-Hall, 1991.
28. H. Robbins and S. Monro, "A stochastic approximation method," Ann. Math. Statist., vol. 22, pp. 400-07, 1951.
29. J. P. Lasalle, The Stability of Dynamical Systems. Philadelphia, PA: SIAM, 1976.
30. K. Q. Gao, M. Omair Ahmad, and M. N. S. Swamy, "Learning algorithm for total least squares adaptive signal processing," Electron. Lett., vol. 28, pp. 430-32, 1992.
31. "A constrained anti-Hebbian learning algorithm for total leastsquares estimation with applications to adaptive FIR and IIP filtering," IEEE Trans. Circuits Syst. II, vol. 41, 1994.
32. Q. F. Zhang and Z. Bao, "Neural networks for solving TLS problems," J. China Inst. Commun., vol. 16, no. 4, 1994 (in Chinese).