A Constrained Anti-Hebbian Learning Algorithm for Total Least-Squares Estimation with Applications to Adaptive FIR and IIR Filtering

IEEE Transactions on Circuits and Systems II: Analog and Digital Signal Processing

Volumn 41, Issue 11, 1994, Pages 718-729

  Gao, Keqin ^a   Ahmad, M Omair ^a   Swamy, M N S ^a  

^a Gina Cody School of Engineering and Computer Science   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE FILTERING; COMPUTER SIMULATION; CONSTRAINT THEORY; CONVERGENCE OF NUMERICAL METHODS; DIGITAL FILTERS; LEAST SQUARES APPROXIMATIONS; MATRIX ALGEBRA; OPTIMIZATION; PARAMETER ESTIMATION; VECTORS;

HEBBIAN TYPE LEARNING ALGORITHM; WEIGHT VECTOR;

ALGORITHMS;

EID: 0028547542     PISSN: 10577130     EISSN: None     Source Type: Journal    
DOI: 10.1109/82.331542     Document Type: Article

References (37)

1. D. O. Hebb, The Organization of Behavior. New York: Wiley, 1949.
2. G. H. Golub and C. F. Van Loan, Matrix Computations. Baltimore, MD: John Hopkins Univ. Press, 1983.
3. G. H. Golub and C. F. Van Loan, “An analysis of the total least squares problem,” SIAM J. Numer. Anal., vol. 17, no. 6, pp. 883–893, 1980.
4. F. Deprettere, Ed., SVD and Sig. Proc., Algorithms, Applications and Architecture. North-Holland, 1988.
5. S. V. Huffel and J. Vandewalle, “The use of total linear least squares techniques for identification and parameter estimation,” in IFAC Identification and Parameter Estimation. York, UK, 1985, pp. 1167–1172.
6. M. A. Rahman and K.-B. Yu, “Total least square approach for frequency estimation using linear prediction,” IEEE Trans. Acoust., Speech and Sig. Proc., vol. ASSP-35, no. 10, pp. 1440–1454, 1987.
7. C. E. Davila, “Recursive total least squares algorithm for adaptive filtering,” in Proc. IEEE Int. Conf. on Acoust. Speech and Sig. Proc., Toronto, Canada, 1853–1856, May 1991.
8. B. Widrow and M. A. Lehr, “30 years of adaptive neural networks: perceptron, madaline and backpropagation,” Proc. IEEE, vol. 78, pp. 1415–1441, Sept. 1990.
9. T. Kohonen, “The self-organizing map,” Proc. IEEE, vol. 78, pp. 1464–1480, Sept. 1990.
10. G. A. Carpenter and S. Crossberg, “The art of adaptive pattern recognition by a self-organizing neural network,” IEEE Comput., vol. 21, no. 3, 77–88, 1988.
11. T. Kohonen, K. Makisara, and T. Saramaki, “Phontopic maps—insightful representation of phonological features for speech recognition,” in Proc. 7th Int. Conf. Pattern Recog., Montreal, pp. 182–185, 1984.
12. K. Fukushima, “Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position,” Biolog. Cybem., vol. 36, no. 2, pp. 193–202, 1980.
13. E. Oja, “A simplified neuron model as a principal component analyzer,” J. Math. Bio., vol. 15, pp. 267–273, 1982.
14. E. Oja, Subspace Methods of Pattern Recognition. Research Studies, 1983.
15. E. Oja and J. Karhunen, “On stochastic approximation of the eigenvectors and eigenvalues of the expectation of a random matrix,” J. Math. Anal. and vol. 106, 69–84, 1985.
16. P. Baldi and K. Homik, “Neural network and principal component analysis: leaaming from examples without local minima,” Neural Networks, vol. 2, no. 1, pp. 52–58, 1989.
17. P. Foldiak, “Adaptive network for optimal linear feature extraction,” in Proc. Int. Joint Conf. Neural Networks, vol. 1, Washington, DC, pp. 401–405, June 1989.
18. T. D. Sanger, “Optimal unsupervised learning in a single-layer linear feedforward neural network,” Neural Networks, vol. 2, pp. 459–473, 1989.
19. J. Rubner and P. Tavan, “A self-organizing network for principal-component analysis,” Europhysics Lett., vol. 10, no. 7, pp. 693–698, 1989.
20. S. Y. Kung and K. I. Diamantaras, “A neural network learning algorithm for adaptive principal component extraction (APEX),” in Proc. IEEE Int. Conf. on Acoust., Speech and Sig. Proc., Albuquerque, NM, pp. 861–864, Apr. 1990.
21. P. Baldi and H. Homik, “Back-propagation and unsupervised learning in linear networks,” in Back Propagation: Theory, Architectures and Applications. Earlbaum Associates, Y. Chauvin and D. E. Rumelhart, Eds., 1991.
22. S. Y. Kung, “Constrained principal component analysis via an orthogonal learning network,” in Proc. IEEE int. Symp. on Circuits Syst., New Orleans, LA, May 1990, pp. 719–722.
23. J. Hertz, A. Krogh, and R. Palmer, Introduction to Theory of Neural Computation. Reading, MA: Addison-Wesley, 1991.
24. L. Xu, E. Oja, and C. Y. Suen, “Modified Hebbian learning for curve and surface fitting,” Neural Networks, 1992.
25. L. Xu, A. Krzyzak, and F. Oja, “Neural-net method for dual subspace pattern recognition,” in Proc. Int’l. Joint Conf. Neural Networks, vol. 2, Seattle, WA, pp. II379–II384, July 1991.
26. B. Widrow, Adaptive Signal Processing. Englewood Cliffs, NJ: Prentice-Hall, 1985.
27. P. A. Thompson, “An adaptive spectral analysis technique for unbiased frequency estimation in the presence of white noise,” in Proc. 13th Asilomar Conf. Circuits, Syst., Comput., Pacific Grove, CA, Nov. 1979, pp. 529–533.
28. M. G. Larimore, “Adaptive convergence of spectral estimation based on pisarenko harmonic retrieval,” IEEE Trans. Acoust., Speech and Sig. Proc., vol. ASSP-31, no. 4, pp. 955–962, 1983.
29. S. Haykin, Adaptive Filter Theory. Englewood Cliffs, NJ: Prentice-Hall, 2nd ed., 1991.
30. J. J. Sllynk, “Adaptive IIR filtering,” IEEEASSP Mag., vol. 2, pp. 4–21, Apr. 1989.
31. H. Robbins and S. Monro, “A stochastic approximation method,” The Annals of Math. Stat., vol. 22, pp. 400–407, 1951.
32. L. Ljung, “Analysis of recursive stochastic algorithms,” IEEE Trans. Automat. Contr., vol. AC-22, no. 4, pp. 551–575, 1977.
33. S. L. Marple Jr., Digital Spectral Analysis with Applications. Englewood Cliffs, NJ: Prentice-Hall, 1987.
34. M. J. Levin, “Estimation of a system pulse transfer function in the presence of noise,” IEEE Trans. Automat. Contr., vol. AC-9, no. 7, pp. 229–235, 1964.
35. V. F. Pisarenko, “The retrieval of harmonics from a covariance function,” Geophys. J. Roy. Astron. Soc., 347–366, 1973.
36. V. U. Reddy, B. Egardt, and T. Kailath, “Least squares type algorithm for adaptive implementation of pisarenko’s harmonic retrieval method,” IEEE Trans. AcoustSpeech and Sig. Proc., vol. ASSP-30, no. 3, pp. 399–405, 1982.
37. S. Sagara and K. Wada, “On-line modified least-squares parameter estimation of linear discrete dynamic systems,” Int’l. J. Contr., vol. 25, no. 3, pp. 329–343, 1977.