Recursive total instrumental-variable algorithm for solving over-determined normal equations and its applications

Signal Processing

Volumn 87, Issue 5, 2007, Pages 918-936

  Feng, Da Zheng ^a   Zheng, Wei Xing ^b  

^a XIDIAN UNIVERSITY   (China)

^b UNIVERSITY OF WESTERN SYDNEY   (Australia)

Author keywords

Algorithm; Convergence; Harmonic retrieval; IIR filtering; Recursive least squares; Total instrumental variable

Indexed keywords

ALGORITHMS; ESTIMATION; INVERSE PROBLEMS; ITERATIVE METHODS; LEAST SQUARES APPROXIMATIONS;

HARMONIC RETRIEVAL; IIR FILTERING; RECURSIVE LEAST SQUARES; TOTAL INSTRUMENTAL VARIABLES;

RECURSIVE FUNCTIONS;

EID: 33846561683     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2006.09.015     Document Type: Article

References (46)

1. Haykin S. Adaptive Filter Theory. third ed (1996), Prentice-Hall, Englewood Cliffs, NJ
2. Kalouptsidis N., and Theodoridis S. Adaptive System Identification and Signal Processing Algorithms (1993), Prentice-Hall, Englewood Cliffs, NJ
3. Macchi O.M., and Bershad N.J. Adaptive recovery of a chirped sinusoid in noise, Part 1: Performance of the RLS algorithms. IEEE Trans. Signal Process. 39 3 (March 1991) 583-594
4. In: Deprettere F. (Ed). SVD and Signal Processing, Algorithms, Applications and Architecture (1988), Elsevier, North-Holland, Amsterdam
5. R. Vaccaro, On adaptive implementations of Pisarenko's harmonic retrieval, in: Proceedings of the ICASSP'84, vol. 9, San Diego, CA, March 1984, pp. 224-227.
6. Chen H., Sarkar T.K., Dianat S.A., and Brule J.D. Adaptive spectral estimation by the conjugate gradient method. IEEE Trans. Acoust. Speech Signal Process. ASSP-34 2 (April 1986) 272-284
7. Reddy V.U., Edgardt B., and Kailath T. Least squares-type algorithm for adaptive implementations of Pisarenko's harmonic retrieval method. IEEE Trans. Acoust. Speech Signal Process. ASSP-30 3 (June 1982) 399-405
8. Gao K.Q., Ahmad M.O., and Swamy M.N.S. A constrained anti-Hebbian learning algorithm for total least-squares estimation with applications to adaptive FIR and IIR filtering. IEEE Trans. Circuits Systems-II: Analog and Digital Signal Process. 41 11 (November 1994) 718-729
9. Feng D.-Z., Bao Z., and Jiao L.-C. Total least mean squares algorithm. IEEE Trans. Signal Process. 46 8 (August 1998) 2212-2220
10. Soderstrom T., and Stoica P. Instrumental Variable Methods for System Identification (1983), Springer, Berlin, Germany
11. Soderstrom T., and Stoica P. System Identification (1989), Prentice-Hall, London, UK
12. Moses R.L., and (Luois) Beex A.A. Instrumental variable adaptive array processing. IEEE Trans. Aerospace Electron. Syst. 24 2 (March 1988) 192-202
13. Viberg M., Stoica P., and Ottersten B. Array processing in correlated noise fields based on instrumental variable and subspace fitting. IEEE Trans. Signal Process. 43 5 (May 1995) 1187-1199
14. Belouchrani A., Abed-Meraim K., Cardoso J.-F., and Moulines E. A blind source separation technique using second-order statistics. IEEE Trans. Signal Process. 45 2 (February 1997) 434-444
15. Friedlander B. Instrumental variable methods for ARMA spectral estimation. IEEE Trans. Acoust. Speech, Signal Process. ASSP-31 2 (April 1983) 404-415
16. Friedlander B. The over-determined recursive instrumental variable methods. IEEE Trans. Automatic Control 29 4 (April 1984) 353-356
17. Porat B., and Friedlander B. The square root over-determined recursive instrumental variable algorithm. IEEE Trans. Automatic Control. 34 6 (June 1989) 656-658
18. Stoica P., Soderstrom T., and Friedlander B. Optimal instrumental variable estimates of the AR parameters of an ARMA process. IEEE Trans. Automatic Control 30 11 (November 1985) 1066-1074
19. Stoica P., Viberg M., and Ottersten B. Instrumental variable approach to array processing in spatially correlated noise fields. IEEE Trans. Signal Process. 42 1 (January 1994) 121-133
20. Pearson K. On lines and planes of closest fit to points in space. Philos. Mag. 2 (1901) 559-572
21. Golub G.H., and Van Loan C.F. An analysis of the total least squares problem. SIAM J. Numer. Anal. 17 6 (December 1980) 883-893
22. S. Van Huffel, J. Vanderwalle, The total least squares problem, computational aspects and analysis, Frontiers in Applied Mathematics, SIAM, Philadelphia, PA, 1991.
23. Rahman M.A., and Yu K.B. Total least square approach for frequency estimation using linear prediction. IEEE Trans. Acoust. Speech, Signal Process. ASSP-35 10 (October 1987) 1440-1454
24. T.J. Abatzoglou, J.M. Mendel, Constrained total least squares, in: Proceedings of the ICASSP'87, vol. 12, Dallas, TX, April 1987, pp. 1485-1488.
25. T.J. Abatzoglou, Frequency super-resolution performance of the constrained total least squares method, in: Proceedings of the ICASSP'90, vol. 5, Albuquerque, NM, April 1990, pp. 2603-2605.
26. Bose N.K., Kim H.C., and Valenzuela H.M. Recursive total least square algorithm for image reconstruction. Multidimensional Syst. Signal Process. 4 (July 1993) 253-268
27. Valaee S., Champagne B., and Kabal P. Localization of wide-band signals using least-squares and total least-squares approaches. IEEE Trans. Signal Process. 47 5 (May 1999) 1213-1222
28. Larimore M.G. Adaptation convergence of spectral estimation based on Pisarenko Harmonic retrieval. IEEE Trans. Acoust. Speech, Signal Process. ASSP-31 4 (August 1983) 955-962
29. Pisarenko V.F. The retrieval of harmonics from a covariance function. Geophys. J. R. Astonom. Soc. 33 (1973) 347-366
30. P.A. Thompson, Adaptive spectral analysis technique for unbiased frequency estimation in the presence white noise, in: Proceedings of the 13th Asilomar Conference on Circuits, Systems, and Computers, Pacific Grove, CA, November 1979, pp. 529-533.
31. N.L. Owsley, Adaptive data orthogonalization, in: Proceedings of the ICASSP'78, vol. 3, Tulsa, OK, April 1978, pp. 109-112.
32. Yang J.F., and Kaveh M. Adaptive eigen-subspace algorithms for direction or frequency estimation and tracking. IEEE Trans. Acoust. Speech, Signal Process. ASSP-36 2 (February 1988) 241-251
33. Oja E. Principal components, minor components, and linear neural networks. Neural Networks 5 6 (1992) 927-935
34. Xu L., Oja E., and Suen C.Y. Modified Hebbian learning for curve and surface fitting. Neural Networks 5 3 (1992) 441-457
35. Wang L., and Karhunen J. A unified neural bi-gradient algorithm for robust PCA and MCA. Int. J. Neural Syst. 7 (1996) 53-67
36. Luo F.-L., Unbehauen R., and Cichocki A. A minor component analysis algorithm. Neural Networks 10 2 (1997) 291-297
37. Choy C.S.-T., and Siu W.-C. Analysis of the convergence and divergence of a constrained anti-Hebbian learning algorithm. IEEE Trans. Circuits Systems-II: Analog Digital Signal Process. 45 11 (November 1998) 1494-1502
38. Zhang Q., and Leung Y.-W. Convergence of a Hebbian-type learning algorithm. IEEE Trans. Circuits System-II: Analog Digital Signal Process 45 12 (December 1998) 1599-1601
39. Solo V., and Kong X. Performance analysis of adaptive eigen-analysis algorithms. IEEE Trans. Signal Process. 46 3 (March 1998) 636-646
40. Ouyang S., Bao Z., and Liao G. Adaptive step-size minor component extraction algorithm. Electron. Lett. 35 6 (March 1999) 443-444
41. Golub G.H., and van Loan C.F. Matrix Computations (1989), The Johns Hopkins University Press, Baltimore, MD
42. Davila C.E. An efficient recursive total least squares algorithm for FIR adaptive filtering. IEEE Trans. Signal Process. 42 2 (February 1994) 268-280
43. Cadzow J.A. High performance spectral estimation: a new ARMA method. IEEE Trans. Acoust. Speech, Signal Process. ASSP-28 5 (October 1980) 524-529
44. Hua Y.-B., and Sarkar T.K. On the total least squares linear prediction method for frequency estimation. IEEE Trans. Acoust. Speech, Signal Process. ASSP-38 12 (December 1990) 2186-2189
45. Lawson C.L., and Hanson R.J. Solving Least-Squares Problems (1974), Prentice-Hall, Englewood Cliffs, NJ
46. LaSalle J.P. The Stability of Dynamical Systems (1976), SIAM, Philadelphia, PA