Stochastic analysis of the LMS algorithm for system identification with subspace inputs

IEEE Transactions on Signal Processing

Volumn 56, Issue 3, 2008, Pages 1018-1027

  Bershad, Neil J ^a   Bermudez, José Carlos M ^b   Tourneret, Jean Yves ^c  

^a University of California at Irvine   (United States)

^b FEDERAL UNIVERSITY OF SANTA CATARINA   (Brazil)

^c IRIT   (France)

Author keywords

Adaptive filters; Least mean square methods; Sparse impulse response; System identification

Indexed keywords

ADAPTIVE ALGORITHMS; ADAPTIVE FILTERS; ADDITIVE NOISE; COMPUTER SIMULATION; CORRELATION THEORY; MONTE CARLO METHODS; STOCHASTIC MODELS; VECTORS;

INDEPENDENCE THEORY; LEAST MEAN SQUARE METHOD; SPARSE IMPULSE RESPONSE;

ECHO SUPPRESSION;

EID: 40749144844     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2007.908967     Document Type: Article

References (30)

1. S. Haykin, Adaptive Filter Theory, 4th ed. Englewood Cliffs, NJ: Prentice-Hall, 2002.
2. A. H. Sayed, Fundamentals of Adaptive Filtering. New York:WIley- Interscience, 2003.
3. N. J. Bershad and A. Bist, "Fast coupled adaptation for sparse impulse responses using a partial Haar transform," IEEE Trans. Signal Process., vol. 53, no. 3, pp. 966-976, Mar. 2005.
4. M. M. Sondhi, "The history of echo cancellation," IEEE Signal Process. Mag., vol. 23, no. 5, pp. 95-102, Sept. 2006.
5. Digital Network Echo Cancellers ITU-T, 2004, ITU-T Recommendation G. 168.
6. O. Macchi, Adaptive Processing: The Least Mean Squares Approach with Applications in Transmission. West Sussex, U.K.: Wiley, 1995.
7. O. Macchi and E. Eweda, "Second order convergence analysis of stochastic adaptive linear filtering," IEEE Trans. Autom. Control vol. AC-28, no. 1, pp. 76-85, Jan. 1983.
8. J. Chao, S. Kawabe, and S. Tsujii, "Convergence analysis of gradient adaptive algorithms for arbitrary inputs without the independence assumption," in Proc. IEEE Int. Conf. Syst. Eng., Kobe, Japan, Sep. 1992, pp. 556-559.
9. S. C. Douglas and T. H. Y. Meng, "Exact expectation analysis of the LMS adaptive filter without the independence assumption," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., San Francisco, CA, Mar. 1992, vol. 4, pp. 61-64.
10. S. C. Douglas, "Exact expectation analysis of the LMS adaptive filter for correlated Gaussian input data," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., Mineapolis, MN, Apr. 1993, vol. 3, pp. 519-522.
11. S. C. Douglas and W. Pan, "Exact expectation analysis of the LMS adaptive filter," IEEE Trans. Signal Process., vol. 43, no. 12, pp. 2863-2871, Dec. 1995.
12. H. J. Butterweck, "A steady-state analysis of the LMS adaptive algorithm without use of the independence assumption," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., Detroit, MI, May 1995, vol. 2, pp. 1404-1407.
13. M. Rupp and H. J. Butterweck, "Overcoming the independence assumption in LMS filtering," in Proc. 37th Asilomar Conf. Signals, Syst. Comput., Monterey, CA, Nov. 2003, pp. 607-611.
14. L. Ljung, System Identification: Theory for the User, T. Kailath, Ed. Englewood Cliffs, NJ: Prentice-Hall, 1987, Inf. Syst. Sci..
15. T. Söderström and P. Stoica, System Identification, M. J. Grimble, Ed. Cambridge, U.K.: Prentice-Hall, 1989, Syst. Control Eng..
16. P. Strobach, "Low-rank adaptive filters," IEEE Trans. Signal Process., vol. 44, no. 12, pp. 2932-2947, Dec. 1996.
17. J. S. Goldstein and I. S. Reed, "Reduced-rank adaptive filtering," IEEE Trans. Signal Process., vol. 45, no. 2, pp. 492-496, Feb. 1997.
18. J. S. Goldstein, I. S. Reed, and L. L. Scharf, "A multistage representation of the wiener filter based on orthogonal projections," IEEE Trans. Inf. Theory, vol. 44, no. 7, pp. 2943-2959, Nov. 1998.
19. B. Raghothaman, D. Linebarger, and D. Begusia, "Analysis of low rank transform domain adaptive filtering algorithm," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., 1999, vol. 4, pp. 1869-1872.
20. M. Honig and M. K. Tsatsanis, "Adaptive techniques for multiuser CDMA receivers," IEEE Signal Process. Mag., vol. 17, no. 3, pp. 49-61, May 2000.
21. T. Gustafsson and B. D. Rao, "Statistical analysis of subspace-based estimation of reduced-rank linear regressors," IEEE Trans. Signal Process., vol. 50, no. 1, pp. 151-159, Jan. 2002.
22. K. Werner and M. Jansson, "Reduced rank linear regression and weighted low rank approximations," IEEE Trans. Signal Process., vol. 54, no. 6, pt. 1, pp. 2063-2075, Jun. 2006.
23. M. R. Petraglia and J. C. B. Torres, "Performance analysis of adaptive filter structure employing wavelet and sparse subfilters," Inst. Elect. Eng. Proc.-Vis. Image Signal Process., vol. 149, no. 2, pp. 115-119, Apr. 2002.
24. H. L. V. Trees, Detection, Estimation, and Modulation Theory - Part I New York: Wiley Intersci., 2001.
25. H. L. V. Trees, Detection, Estimation, and Modulation Theory - Part II: Nonlinear Modulation Theory. Hoboken, NJ: Wiley Interscience, 2003.
26. H. L. V. Trees, Detection, Estimation, and Modulation Theory - Part III: Radar-Sonar Signal Processing and Gaussian Signals in Noise. New York: Wiley Interscience, 2001.
27. H. L. V. Trees, Detection, Estimation, and Modulation Theory - Part IV: Optimum Array Processing. Iew York:Wiley Interscience, 2002.
28. S. Haykin, Adaptive Filter Theory, 2nd ed. Englewood Cliffs, NJ: Prentice-Hall, 1991.
29. D. G. Manolakis, V. K. Inglr, and S. M.Kogon, Statistical and Adaptive Signal Processing. Boston, MA: McGraw-Hill, 1999.
30. D. Han, S.-P. Kim, and J. C. Principe, "Sparse channel estimation with regularization method using convolution inequality for entropy," in Proc. 2005 IEEE Int. Joint Conf. Neural Networks, Quebec, Canada, 2005, vol. 4, pp. 2359-2362.