SPARLS: The sparse RLS algorithm

IEEE Transactions on Signal Processing

Volumn 58, Issue 8, 2010, Pages 4013-4025

  Babadi, Behtash ^a   Kalouptsidis, Nicholas ^b   Tarokh, Vahid ^a  

^a HARVARD UNIVERSITY   (United States)

^b UNIVERSITY OF ATHENS   (Greece)

Author keywords

Adaptive filters; compressed sensing; sparse system identification

Indexed keywords

ANALYTICAL RESULTS; COMPRESSED SENSING; COMPUTATIONAL REQUIREMENTS; EXPECTATION MAXIMIZATION; FIXED SUPPORTS; MEAN SQUARED ERROR; MULTI-PATH; NOISY OBSERVATIONS; RECURSIVE LEAST SQUARES ALGORITHMS; REGULARIZED LEAST SQUARES; RLS ALGORITHMS; SIMULATION STUDIES; SPARSE SYSTEM IDENTIFICATION; STATIONARY ENVIRONMENTS; STEADY STATE ERRORS; WEIGHT VECTOR; WIRELESS CHANNEL;

ADAPTIVE FILTERING; ADAPTIVE FILTERS; CONVERGENCE OF NUMERICAL METHODS; ELECTRIC FILTERS; OPTIMIZATION; SIGNAL RECONSTRUCTION;

ALGORITHMS;

EID: 77952558371     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2010.2048103     Document Type: Article

References (32)

1. M. Akçakaya and V. Tarokh, "Shannon theoretic limits on noisy compressive sampling," IEEE Trans. Inf. Theory, vol.56, no.1, pp. 492-504, Jan. 2010.
2. D. Andrews and C. Mallows, "Scale mixtures of normal distributions," J. R. Stat. Soc., vol.36, pp. 99-102, 1974.
3. D. Angelosante and G. Giannakis, "RLS-weighted LASSO for adaptive estimation of sparse signals," presented at the IEEE Int. Conf. Acoustics, Speech, Signal Process. (ICASSP), Taipei, Taiwan, Apr. 19-24, 2009.
4. B. Babadi, N. Kalouptsidis, and V. Tarokh, "Comparison of SPARLS and RLS algorithms for adaptive filtering," presented at the IEEE Sarnoff Symp., Princeton, NJ, Mar. 30-Apr. 1 2009.
5. Z. Ben-Haim, Y. C. Eldar, and M. Elad, "Near-oracle performance of basis pursuit under random noise," IEEE Trans. Signal Process. Mar. 2009 [Online]. Available: http://arxiv.org/abs/0903.4579, submitted for publication
6. W. Bajwa, J. Haupt, G. Raz, and R. Nowak, "Compressed channel sensing," in Proc. CISS, 2008.
7. J. Haupt, W. Bajwa, G. Raz, and R. Nowak, "Toeplitz compressed sensing matrices with applications to sparse channel estimation," IEEE Trans. Inf. Theory, submitted for publication.
8. A. Bruckstein, D. Donoho, and M. Elad, "From sparse solutions of systems of equations to sparse modeling of signals and images," SIAM Rev., vol.51, no.1, pp. 34-81, 2009.
9. E. Candès and T. Tao, "Decoding by linear programming," IEEE Trans. Inf. Theory, vol.51, no.12, pp. 4203-4215, Dec. 2005.
10. E. Candès and T. Tao, "The Dantzig selector: Statistical estimation when p is much larger than n," Ann. Statist., pp. 2313-2351, Dec. 2007.
11. Y. Chen, Y. Gu, and A. O. Hero, III, "Sparse LMS for system identification," presented at the IEEE Int. Conf. Acoustics, Speech, Signal Process. (ICASSP), Taipei, Taiwan, Apr. 19-24, 2009.
12. Y. S. Chow and T. L. Lai, "Limiting behavior of weighted sums of independent random variables," Ann. Probab., vol.1, no.5, pp. 810-824, 1973.
13. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. R. Stat. Soc. Series B (Methodologic.), vol.39, no.1, pp. 1-38, 1977.
14. D. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol.52, no.4, pp. 1289-1306, Apr. 2006.
15. M. Figueirado and R. Nowak, "An EM algorithm for wavelet-based image restoration," IEEE Trans. Image Process., vol.12, no.8, pp. 906-916, Aug. 2003.
16. M. Figueiredo, R. Nowak, and S. Wright, "Gradient projection for sparse reconstruction: Applications to compressed sensing and other inverse problems," IEEE J. Sel. Topics Signal Process., vol.1, no.4, pp. 586-597, Dec. 2007.
17. S. Haykin, Adaptive Filter Theory, 3rd ed. Englewood Cliffs, NJ: Prentice-Hall, 1996.
18. J. Haupt and R. Nowak, "Signal reconstruction from noisy random projections," IEEE Trans. Inf. Theory, vol.52, no.9, pp. 4036-4048, Sep. 2006.
19. , W. C. Jakes, Ed., Microwave Mobile Communications. New York: Wiley, 1975.
20. A. Jazwinski, "Adaptive filtering," Automatica, vol.5, pp. 475-485, 1969.
21. L. Ljung, "General structure of adaptive algorithms: Adaptation and tracking," in Adaptive System Identification and Signal Processing Algorithms, N. Kalouptsidis and S. Theodoridis, Eds. Englewood Cliffs, NJ: Prentice-Hall, 1993.
22. J. E. Mazo, "On the independence theory of equalizer convergence," Bell Syst. Tech. J., vol.58, pp. 963-993, 1979.
23. X. L. Meng and D. B. Rubin, "On the global and componentwise rates of convergence of the EM algorithm," Linear Algebra Appl., vol.199, pp. 413-425, 1997, Schafer.
24. S. Pafka, M. Potters, and I. Kondor, "Exponential weighting and random-matrix-theory-based filtering of financial covariance matrices for portfolio optimization," 2004 [Online]. Available: http://arxiv.org/abs/ cond-mat/0402573
25. C. Robert, The Bayesian Choice: A Decision Theoretic Motivation, 1st ed. New York: Springer-Verlag, 1994.
26. R. T. Rockafellar, Convex Analysis. Princeton, NJ: Princeton Univ. Press, 1970.
27. A. M. Sengupta and P. P. Mitra, "Distributions of singular values for some random matrices," Phys. Rev. E, vol.60, no.3, 1999.
28. J. Tropp, "Just relax: Convex programming methods for identifying sparse signals," IEEE Trans. Inf. Theory, vol.51, no.3, pp. 1030-1051, Mar. 2006.
29. H. L. Van Trees, Detection, Estimation, and Modulation Theory, Part I, 1st ed. New York: Wiley, 2001.
30. M. J. Wainwright, "Information-theoretic limits on sparsity recovery in the high-dimensional and noisy setting," Statistics Dept., University of California, Berkeley, Tech. Rep. 725, Jan. 2007 [Online]. Available: http://arxiv.org/abs/math/0702301
31. R. L. Wheeden and A. Zygmund, Measure and Integral: An Introduction to Real Analysis. New York: Dekker, 1977.
32. B.Widrow, J. M. McCool, M. G. Larimore, and C. R. Johnson, Jr., "Stationary and nonstationary learning characteristics of the LMS adaptive filter," Proc. IEEE, vol.64, pp. 1151-1162, 1976.