An Efficient Recursive Total Least Squares Algorithm for FIR Adaptive Filtering

IEEE Transactions on Signal Processing

Volumn 42, Issue 2, 1994, Pages 268-280

  Davila, Carlos E ^a  

^a SOUTHERN METHODIST UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE CONTROL SYSTEMS; ALGORITHMS; COMMUNICATION CHANNELS (INFORMATION THEORY); COMPUTER SIMULATION; DIGITAL FILTERS; EIGENVALUES AND EIGENFUNCTIONS; INTERFERENCE SUPPRESSION; LEAST SQUARES APPROXIMATIONS; PARAMETER ESTIMATION; RECURSIVE FUNCTIONS; SPURIOUS SIGNAL NOISE; WHITE NOISE;

BEST LINEAR UNBIASED ESTIMATE (BLUE); FINITE IMPULSE RESPONSE (FIR) FILTERS; MINIMUM VARIANCE UNBIASED ESTIMATE (MVUE); RECURSIVE TOTAL LEAST SQUARES ALGORITHM;

SIGNAL FILTERING AND PREDICTION;

EID: 0028377502     PISSN: 1053587X     EISSN: 19410476     Source Type: Journal    
DOI: 10.1109/78.275601     Document Type: Article

References (77)

1. J. G. Proakis, Digital Communications. New York: McGraw-Hill, 1983.
2. S. U. H. Qureshi, “Adaptive equalization,” in Proc. IEEE, vol. 73, no. 9, pp. 1349–1387, Sept. 1985.
3. D. D. Falconer and L. Ljung, “Application of fast Kalman estimation to adaptive equalization,” IEEE Trans. Comm., vol. COM-26, pp. 1439–1446, Oct. 1978.
4. D. Godard, “Channel equalization using a Kalman filter for fast data transmission,” IBM J. Res. Dev., 267–273, 1974.
5. L. Ljung and T. Soderstrom, Theory and Practice of Recursive Identification. Cambridge, MA: MIT Press, 1983.
6. T. Soderstrom and P. Stoica, System Identification. Englewood Cliffs, NJ: Prentice-Hall, 1989.
7. I. D. Landau, “A survey of model reference adaptive techniques—Theory and applications,” Automatica vol. 10, no. 4, 353–379, July 1974.
8. S. M. Kay, Modern Spectral Estimation: Theory & Application. Englewood Cliffs, NJ: Prentice-Hall, 1988.
9. S. L. Marple, Digital Spectral Analysis with Applications. Englewood Cliffs, NJ: Prentice-Hall, 1987.
10. S. M. Kay and S. L. Marple, “Spectrum analysis—A modem perspec-tive,” Proc. IEEE, vol. 69, pp. 1380–1419, Nov. 1981.
11. S. Haykin, Adaptive Filter Theory. Englewood Cliffs, NJ: Prentice-Hall, Hall, 1991.
12. D. G. Messerschmitt, “Echo cancellation in speech and data transmission,” IEEE J. Selected Areas Commun., vol. SAC-2, pp. 281–297, March 1984.
13. M. Sondhi and D. A. Berkley, “Silencing echos on the telephone network,” Proc. IEEE, vol. 68, 948–964, Aug. 1980.
14. M. Honig and D. Messerschmitt, Adaptive Filters: Structure, Algorithms, and Applications. Boston: Kluwer, 1984.
15. S. T. Alexander, Adaptive Signal Processing: Theory and Applications. New York: Springer-Verlag, 1986.
16. K. Murano et al., “Echo cancellation and applications,” IEEE Trans. Comm., vol. COM-28, 49–55, 1990.
17. K. Pearson, “On lines and planes of closest fit to points in space,” Phil. Mag., vol. 2, pp. 559–572, 1901.
18. G. H. Golub and C. F. Van Loan, “An analysis of the total least squares problem,” SIAM J. Numer. Anal., vol. 17, no. 6, pp. 883–893, Dec. 1980. [19] __, Matrix Computations. Baltimore, MD: Johns Hopkins Univ. Press, 1989.
19. —— Matrix Computations. Baltimore, MD: Johns Hopkins Univ. Press, 1989.
20. L. R. Klein, “The estimation of distributed lags,” Econometrica, vol. 26, pp. 553–565, 1958.
21. S. Sagara and K. Wada, “On-line modified least-squares parameter estimation of linear discrete dynamic systems,” Int. J. Control, vol. 25, no. 3, pp. 329–343, 1977.
22. M. J. Levin, “Estimation of a system pulse transfer function in the presence of noise,” IEEE Trans. Automat. Contr., vol. AC-9, pp. 229–235, July 1964.
23. K. Furuta and J. G. Paquet, “On the identification of timeinvariant discrete processes,” IEEE Trans. Automat. Contr., vol. AC-15, pp. 153–155, Feb. 1970.
24. H. Sakai and M. Arase, “Recursive parameter estimation of an autoregressive gressive process distributed by white noise,” Int. J. Control, vol. 30, no. 6, 949–966, 1979.
25. S. Van Huffel and J. Venderwalle, “The use of total linear least squares for identification and parameter estimation,” IFAC Identification and System Parameter Estimation 1985, York, U.K., 1985.
26. M. A. Rahman and K. B. Yu, “Total least squares approach for frequency estimation using linear prediction,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-35, pp. 1440–1454, Oct. 1987.
27. T. J. Abatzoglou and J. M. Mendel, “Constrained total least squares,” in Proc. ICASSP-87, Apr. 6–9, Dallas, pp. 1485–1488.
28. T. J. Abatzoglou, “Frequency superresolution performance of the constrained total least squares method,” in Proc. ICASSP-90, pp. 2603–2605.
29. G. Alengrin, M. Barlaud, and J. Menez, “Unbiased parameter estimation of nonstationary signals in noise,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-34, pp. 1319–1321, Oct. 1986.
30. J. A. Cadzow and O. M. Solomon, “Algebraic approach to system identification,” IEEE Trans. Acoust. Speech Signal Processing, vol. ASSP-34, 462–469, June 1986.
31. N. K. Bose, H. C. Kim, and H. M. Valenzuela, “Recursive total least sqares algorithm for image recontruction,” Multidimensional Syst. Signal vol. 4, 253–268, 1993.
32. E. M. Kennaugh and D. L. Moffatt, “Transient and impulse response approximations,” Proc. IEEE, vol. 53, pp. 893–901, Aug. 1965.
33. D. L. Moffatt and R. K. Mains, “Detection and discrimination of radar targets,” IEEE Trans. Antennas Propagat., vol. AP-23, pp. 358–367, May 1975.
34. A. A. Ksienski, Y. Lin, and L. J. White, “Low frequency approach to target identification,” Proc. IEEE, vol. 63, no. 12, pp. 1651–1660, Dec. 1975.
35. J. D. Young, “Radar imaging from ramp response signatures,” IEEE Trans. Antennas Propagat., vol. AP-24, 276–282, May 1976.
36. L. C. Chan, D. L. Moffatt, and L. Peters, “A characterization of subsurface radar targets,” Proc. IEEE, vol. 67, no. 7, pp. 991–1000, 1979.
37. T. K. Sarkar, D. D. Weiner, V. K. Jain, and S. A. Dianat, “Impulse response determination in the time domain-theory,” IEEE Trans. Antennas vol. AP-30, 657–663, 1982.
38. U. Nickel, “Radar target parameter estimation with antenna arrays,” in Radar Array Processing, S. Haykin, J. Litva, and T. J. Shephard, Eds. New York: Springer-Verlag, 1991.
39. B. Widrow and S. D. Stearns, Adaptive Signal Processing. Englewood Cliffs, NJ: Prentice Hall, 1985.
40. J. M. Mendel, “Some modeling problems in reflection seismology,” IEEE ASSP Mag., vol. 3, pp. 4–17.
41. R. G. Newton, “Inversion of reflection data for layered media: A review of exact methods,” Geophys. J. R. Astr. Soc., vol. 65, pp. 191–215, 1981.
42. V. K. Arya and H. D. Holden, “Deconvolution of seismic data—An overview,” IEEE Trans. Geosci. Remote Sensing, vol. GE-16, pp. 95–98, 1978.
43. S. Prasad and A. K. Mahalanabis, “Adaptive filter structures for decon-volution volution of seismic signals,” IEEE Trans. Geosci. Remote Sensing, vol. GE-18, pp. 267–273, 1980.
44. F. R. Magee and J. G. Proakis, “Adaptive maximum-likelihood sequence estimation for digital signaling in the presence of intersymbol inter-ference,” IEEE Trans. Inform. Theory, vol. IT-19, pp. 120–124, Jan. 1973.
45. L. R. Rabiner, R. E. Crochiere, and J. B. Allen, “FIR system modeling and identification in the presence of noise and with band-limited inputs,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-26, pp. 319–333, Aug. 1987.
46. N. S. Jayant and P. Noll, Digital Coding of Waveforms: Principles and Applications to Speech and Video. Englewood Cliffs, NJ: Prentice Hall, 1984. [47] L. R. Rabiner and R. W. Schafer, Digital Processing of Speech Signals. Englewood Cliffs, NJ: Prentice Hall, 1978.
47. L. R. Rabiner and R. W. Schafer, Digital Processing of Speech Signals. Englewood Cliffs, NJ: Prentice Hall, 1978
48. B. Widrow, J. R. Glover, J. M. McCool, J. Kaunitz, C. S. Williams, R. H. Hearn, J. R. Zeidler, E. Dong, and R. C. Goodlin, “Adaptive noise cancelling: Principles and applications,” Proc. IEEE, vol. 63, pp. 1692–1716, Dec. 1975.
49. J. R. Treichler, “Transient and convergent behavior of the adaptive line enhancer,” IEEE Trans. Acoust., Speech, and Signal Processing, vol. ASSP-27, pp. 53–62, Feb. 1979.
50. J. R. Zeidler, E. H. Satorious, D. M. Chabries, and H. T. Wexler, “Adaptive enhancement of multiple sinusoids in uncorrelated noise,” IEEE Trans. Acoust., Speech, and Signal Processing, vol. ASSP-26, pp. 244–254, June 1978.
51. S. Florian and N. J. Bershad, “Error saturation effects in the LMS adaptive line enhancer-transient response,” IEEE Trans. Signal Processing, vol. SP-37, pp. 1176–1780, Nov. 1989.
52. B. Fisher and N. J. Bershad, “ALE behavior for two-sinusoidal signal models,” IEEE Trans. Acoust., Speech, and Signal Proc., vol. ASSP-33, pp. 658–665, June 1985.
53. __, “The complex LMS adaptive algorithm-Transient weight mean and covariance with applications to the ALE,” IEEE Trans. Acoust. Speech Signal Processing, vol. ASSP-31, 34–44, Feb. 1983.
54. J. R. Zeidler, “Performance analysis of LMS adaptive prediction filters,” Proc. IEEE, vol. 78, pp. 1781–1807, Dec. 1990.
55. T. Kailath, Linear Systems. Englewood Cliffs, NJ: Prentice Hall, 1980.
56. R. D. DeGroat and E. M. Dowling, “The data least squares problem and channel equalization,” IEEE Trans. Signal Processing, vol. ASSP-41, pp. 407–410, Jan. 1993.
57. C. E. Davila, “Recursive total least squares algorithms for adaptive filtering,” Proc. ICASSP-91, (Toronto), May 14–17, 1991.
58. J. M. Cioffi and T. Kailath, “Fast, recursive least-squares, transversal filters for adaptive filtering,” IEEE Trans. Acoust. Speech Signal Processing, vol. ASSP-32, 304–337, Apr. 1984.
59. J. L. Botto and G. V. Moustakides, “Stabilization of fast Kalman algorithms,” IEEE Trans. Acoust. Speech Signal Processing, vol. 37, pp. 1342–1348, Sept. 1989.
60. D. T. Slock and T. Kailath, “Numerically stable fast transversal filters for recursive least squares adaptive filtering,” IEEE Trans. Signal Procesing, vol. 39, pp. 92–114, Jan. 1991.
61. V. F. Pisarenko, “The retrieval of harmonics from a covariance function,” Geophys. J. Roy. Astronom. Soc., vol. 33, 347–366, 1973.
62. P. A. Thompson, “An adaptive spectral analysis technique for unbiased frequency estimation in the presence of white noise,” in Proc. 13th Asilomar Conf. Circuits Syst. Comput., Nov. 1979, 529–533.
63. M. G. Larimore and R. J. Calvert, “Convergence studies of Thompson's unbiased adaptive spectral estimator,” in Proc. 14th Asilornar Conf. Circuits Syst. Comput., Nov. 1980, pp. 258–262.
64. J. F. Yang and M. Kaveh, “Adaptive eigensubspace algorithms for direction or frequency estimation and tracking,” IEEE Trans. Acoust. Speech Signal Processing, vol. 36, pp. 241–251, Feb. 1988.
65. E. Oja and J. Karhunen, “On stochastic approximation of the eigenvectors tors and eigenvalues of the expectation of a random matrix,” J. Math. Anal. Applications, vol. 106, pp. 69–84, 1985.
66. R. Vaccaro, “On adaptive implementations of Pisarenko harmonic retrieval,” in Proc. ICASSP 85, Mar. 1984, p. 6.1.1.
67. T. S. Durrani and K. C. Sharman, “Extraction of an Eigenvector-oriented “spectrum” from the MESA coefficients,” IEEE Trans. Acoust. Speech Signal Processing, vol. ASSP-30, pp. 649—451, Aug. 1982.
68. V. U. Reddy, B. Edgardt, and T. Kailath, “Least squares-type algorithm for adaptive implementation of Pisarenko's harmonic retrieval method,” IEEE Trans. Acoust. Speech Signal Processing, vol. ASSP-34, pp. 272—284, Apr. 1986.
69. D. R. Furhmann and B. Liu, “Rotational search methods for adaptive Pisarenko harmonic retrieval,” IEEE Trans. Acoust. Speech Signal Processing, vol. ASSP-34, pp. 1550—1565, Dec. 1986.
70. M. H. Hayes and M. A. Clements, “An efficient algorithm for computing Pisarenko's harmonic decomposition using Levinson's recursion,” IEEE Trans Acoust. Speech Signal Processing, vol. ASSP-34, pp. 485—491, June 1986.
71. H. Chen, T. K. Sarkar, S. A. Dianat, and J. D. Brule, “Adaptive spectral estimation by the conjugate gradient method,” IEEE Trans. Acoust. Speech Signal Processing, vol. ASSP-34, pp. 272—284, Apr. 1986.
72. P. Comon and G. H. Golub, “Tracking a few extreme singular values and vectors in signal processing,” Proc. IEEE, vol. 78, pp. 1327—1343, Aug. 1990.
73. I. Karasolo, “Estimating the covariance matrix by signal subspace averaging,” IEEE Trans. Acoust. Speech Signal Processing, vol. ASSP-34. pp. 8—12, Feb. 1986.
74. M. S. Bazaraa and Shetty, “On the convergence of a class of algorithms using linearly independent search directions,” Math. Prog., vol. 18, pp. 89—93, 1980.
75. D. R. Fuhrmann, “On an approximate subspace method for eigenfilter computation,” IEEE Trans. Acoust. Speech Signal Processing, vol. ASSP-34, pp. 205—207, Feb. 1986.
76. D. K. Faddeev and V. N. Faddeeva, Computational Methods of Linear Algebra. San Francisco: Freeman, 1963.
77. I. Shavit, C. F. Bender, A. Pipano, and R. P. Hosteny, “The iterative calculation of several of the lowest or highest eigenvalues and corresponding eigenvectors of very large symmetric matrices,” J. Computat. Phy., vol. 11, pp. 90—108, 1973.