Sparse Bayesian learning for basis selection

IEEE Transactions on Signal Processing

Volumn 52, Issue 8, 2004, Pages 2153-2164

  Wipf, David P ^a   Rao, Bhaskar D ^a  

^a IEEE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SIMULATION; FUNCTIONS; INVERSE PROBLEMS; LEARNING ALGORITHMS; LEARNING SYSTEMS; MATHEMATICAL MODELS; OPTIMIZATION; PROBLEM SOLVING; REGRESSION ANALYSIS; SIGNAL TO NOISE RATIO; VARIATIONAL TECHNIQUES; VECTORS;

BASIS SELECTION ALGORITHMS; DIVERSITY MEASURES; LINEAR INVERSE PROBLEMS; SPARSE BAYESIAN LEARNING; SPARSE REPRESENTATIONS; VECTOR MACHINES;

SIGNAL PROCESSING;

EID: 3543103176     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2004.831016     Document Type: Article

References (36)

1. S. S. Chen, D. L. Donoho, and M. A. Saunders, "Atomic decomposition by Basis Pursuit," SIAM J. Sci. Comput., vol. 20, no. 1, pp. 33-61, 1999.
2. I. F. Gorodnitsky and B. D. Rao, "Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm," IEEE Trans. Signal Processing, vol. 45, pp. 600-616, Mar. 1997.
3. B. D. Rao and K. Kreutz-Delgado, "An affine scaling methodology for best basis selection," IEEE Trans. Signal Processing, vol. 47, pp. 187-200, Jan. 1999.
4. I. F. Gorodnitsky, J. S. George, and B. D. Rao, "Neuromagnetic source imaging with FOCUSS: a recursive weighted minimum norm algorithm," J. Electroencephalog. Clinical Neurophysiol., vol. 95, no. 4, pp. 231-251, Oct. 1995.
5. I. J. Fevrier, S. B. Gelfand, and M. P. Fitz, "Reduced complexity decision feedback equalization for multipath channels with large delay spreads," IEEE Trans. Commun., vol. 47, pp. 927-937, June 1999.
6. M. Kocic, D. Brady, and M. Stojanovic, "Sparse equalization for real-time digital underwater acoustic communications," in Proc. OCEANS, vol. 3, San Diego, CA, Oct. 1995, pp. 1417-1422.
7. S. F. Cotter and B. D. Rao, "Sparse channel estimation via Matching Pursuit with application to equalization," IEEE Trans. Commun., vol. 50, pp. 374-377, Mar. 2002.
8. H. Lee, D. P. Sullivan, and T. H. Huang, "Improvement of discrete band-limited signal extrapolation by iterative subspace modification," in Proc. ICASSP, vol. 3, Apr. 1987, pp. 1569-1572.
9. S. D. Cabrera and T. W. Parks, "Extrapolation and spectral estimation with iterative weighted norm modification," IEEE Trans. Acoust., Speech, Signal Processing, vol. 39, pp. 842-851, Apr. 1991.
10. B. D. Jeffs, "Sparse inverse solution methods for signal and image processing applications," in Proc. ICASSP, vol. 3, May 1998, pp. 1885-1888.
11. S. Chen and J. Wigger, "Fast orthogonal least squares algorithm for efficient subset model selection," IEEE Trans. Signal Processing, vol. 43, p. 1715, July 1995.
12. B. K. Natarajan, "Sparse approximate solutions to linear systems," SIAM J. Comput., vol. 24, pp. 227-234, Apr. 1995.
13. R. E. Carlson and B. K. Natarajan, "Sparse approximate multiquadric interpolation," Comput. Math Applicat., vol. 27, pp. 99-108, 1994.
14. D. L. Duttweiler, "Proportionate normalized least-mean-squares adaption in echo cancelers," IEEE Trans. Speech Audio Processing, vol. 8, pp. 508-518, Sept. 2000.
15. B. D. Rao and B. Song, "Adaptive filtering algorithms for promoting sparsity," in Proc. ICASSP, vol. 6, Apr. 2003, pp. 361-364.
16. B. Jeffs and M. Gunsay, "Restoration of blurred star field images by maximally sparse optimization," IEEE Trans. Image Processing, vol. 2, pp. 202-211, Feb. 1993.
17. M. E. Tipping, "The relevance vector machine," Neural Inform. Process. Syst., vol. 12, pp. 652-658, 2000.
18. M. E. Tipping, "Sparse Bayesian learning and the relevance vector machine," J. Machine Learning Res., vol. 1, pp. 211-244, 2001.
19. R. Herbrich, Learning Kernel Classifiers. Cambridge, MA: MIT Press, 2002.
20. B. D. Rao, K. Engan, S. F. Cotter, J. Palmer, and K. Kreutz-Delgado, "Subset selection in noise based on diversity measure minimization," IEEE Trans. Signal Processing, vol. 51, pp. 760-770, Mar. 2003.
21. R. M. Leahy and B. D. Jeffs, "On the design of maximally sparse beamforming arrays," IEEE Trans. Antennas Propagat., vol. 39, pp. 1178-1187, Aug. 1991.
22. p approximation," in Proc. Symp. Nonlinear Programming, May 1970, pp. 447-464.
23. D. J. C. MacKay, "Bayesian interpolation," Neural Comput., vol. 4, no. 3, pp. 415-447, 1992.
24. D. L. Donoho and X. Huo, "Uncertainty principles and ideal atomic decomposition," IEEE Trans. Inform. Theory, vol. 47, pp. 2845-2862, Nov. 2001.
25. 1 minimization," Proc. Nat. Acad. Sci., vol. 100, no. 5, pp. 2197-2202, Mar. 2003.
26. R. A. Horn and C. R. Johnson, Matrix Analysis. Cambridge, U.K.: Cambridge Univ. Press, 1990.
27. R. T. Rockafellar, Convex Analysis. Princeton, NJ: Princeton Univ. Press, 1970.
28. D. G. Luenberger, Linear and Nonlinear Programming, Second ed. Reading, MA: Addison-Wesley, 1984.
29. p diversity measures," in Proc. ICASSP, vol. 6, May 2004.
30. J. O. Berger, Statistical Decision Theory and Bayesian Analysis, Second ed. New York: Springer-Verlag, 1985.
31. M. I. Jordan, Z. Ghahramani, T. Jaakkola, and L. K. Saul, "An introduction to variational methods for graphical models," Machine Learning, vol. 37, no. 2, pp. 183-233, 1999.
32. C. M. Bishop and M. E. Tipping, "Variational relevance vector machines," in Proc. 16th Conf. Uncertainty Artificial Intell., 2000, pp. 46-53.
33. M. Girolami, "A variational method for learning sparse and overcomplete representations," Neural Comput., vol. 13, no. 11, pp. 2517-2532, 2001.
34. D. P. Wipf, J. A. Palmer, and B. D. Rao, "Perspectives on sparse Bayesian learning," Neural Inform. Process. Syst., vol. 16, 2004.
35. A. C. Faul and M. E. Tipping, "Analysis of sparse Bayesian learning," Neural Inform. Process. Syst., vol. 14, pp. 383-389, 2002.
36. K. V. Mardia, J. T. Kent, and J. M. Bibby, Multivariate Analysis. New York: Academic, 1979.