Multitask compressive sensing

IEEE Transactions on Signal Processing

Volumn 57, Issue 1, 2009, Pages 92-106

  Ji, Shihao ^a   Dunson, David ^b   Carin, Lawrence ^a  

^a Duke University   (United States)

^b DUKE UNIVERSITY   (United States)

Author keywords

Compressive sensing (CS); Hierarchical Bayesian modeling; Multitask learning; Relevance vector machine (RVM); Simultaneous sparse approximation

Indexed keywords

FOURIER TRANSFORMS; INFERENCE ENGINES; INVERSE PROBLEMS; SIGNAL RECONSTRUCTION; VECTORS; WAVELET TRANSFORMS;

COMPRESSIVE SENSING (CS); HIERARCHICAL BAYESIAN MODELING; MULTITASK LEARNING; RELEVANCE VECTOR MACHINE (RVM); SIMULTANEOUS SPARSE APPROXIMATION;

BAYESIAN NETWORKS;

EID: 58649110599     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2008.2005866     Document Type: Article

References (51)

1. I. Daubechies, Ten Lectures on Wavelets. Philadelphia, PA: SIAM, 1992.
2. S. Mallat, A Wavelet Tour of Signal Processing, 2nd ed. New York: Academic, 1998.
3. A. Said and W. A. Pearlman, "A new fast and efficient image codec based on set partitioning in hierarchical trees," IEEE Trans. Circuits Syst. Video Technol., vol. 6, pp. 243-250, 1996.
4. W. A. Pearlman, A. Islam, N. Nagaraj, and A. Said, "Efficient, low-complexity image coding with a set-partitioning embedded block coder," IEEE Trans. Circuits Syst. Video Technol., vol. 14, pp. 1219-1235, Nov. 2004.
5. E. Candès, J. Romberg, and T. Tao, "Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information," IEEE Trans. Inf. Theory, vol. 52, no. 2, pp. 489-509, Feb. 2006.
6. D. L. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, Apr. 2006.
7. S. Chen, D. L. Donoho, and M. A. Saunders, "Atomic decomposition by basis pursuit," SIAM J. Scientif. Comput., vol. 20, no. 1, pp. 33-61, 1999.
8. J. A. Tropp and A. C. Gilbert, "Signal recovery from random measurements via orthogonal matching pursuit," IEEE Trans. Inf. Theory, 2007, Preprint.
9. D. L. Donoho, Y. Tsaig, I. Drori, and J.-C. Starck, Sparse Solution of Underdetermined Linear Equations by Stagewise Orthogonal Matching Pursuit Mar. 2006, Preprint.
10. S. Ji, Y. Xue, and L. Carin, "Bayesian compressive sensing," IEEE Trans. Signal Process., vol. 56, no. 6, Jun. 2008.
11. M. Figueiredo, R. D. Nowak, and S. J. Wright, Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems 2007, Preprint.
12. D. Leviatan and V. N. Temlyakov, Simultaneous Approximation by Greedy Algorithms Univ. South Carolina, Dept. Math., Columbia, 2003, Tech. Rep..
13. S. F. Cotter, B. D. Rao, K. Engan, and K. Kreutz-Delgado, "Sparse solutions to linear inverse problems with multiple measurement vectors," IEEE Trans. Signal Process., vol. 53, no. 7, pp. 2477-2488, Jul. 2005.
14. J. A. Tropp, A. C. Gilbert, and M. J. Strauss, "Algorithms for simultaneous sparse approximation. Part I: Greedy pursuit," Signal Process., vol. 86, pp. 572-588, Apr. 2006.
15. J. A. Tropp, "Algorithms for simultaneous sparse approximation. Part II: Convex relaxation," Signal Process., vol. 86, pp. 589-602, Apr. 2006.
16. Ò. D. Escoda, L. Granai, and P. Vandergheynst, "On the use of a priori information for sparse signal approximations," IEEE Trans. Signal Process., vol. 54, no. 9, pp. 3468-3482, Sep. 2006.
17. D. P. Wipf and B. D. Rao, "An empirical Bayesian strategy for solving the simultaneous sparse approximation problem," IEEE Trans. Signal Process., vol. 55, no. 7, pp. 3704-3716, Jul. 2007.
18. D. Baron, M. B. Wakin, M. F. Duarte, S. Sarvotham, and R. G. Baraniuk, Distributed Compressed Sensing Nov. 2005, Preprint.
19. M. E. Tipping, "Sparse Bayesian learning and the relevance vector machine," J. Mach. Learn. Res., vol. 1, pp. 211-244, 2001.
20. M. Figueiredo, "Adaptive sparseness using Jeffreys prior," in Adv. Neural Inf. Process. Syst. (NIPS 14), 2002.
21. R. Tibshirani, "Regression shrinkage and selection via the lasso," J. Royal. Statist. Soc. B., vol. 58, no. 1, pp. 267-288, 1996.
22. B. Efron, T. Hastie, I. Johnstone, and R. Tibshirani, "Least angle regression," The Ann. Statist., vol. 32, no. 2, pp. 407-499, 2004.
23. R. Caruana, "Multitask learning," Mach. Learn., vol. 28, no. 1, pp. 41-75, 1997.
24. J. Baxter, "Learning internal representations," in COLT: Proc. Workshop on Computat. Learn. Theory, 1995.
25. J. Baxter, "A model of inductive bias learning," J. Artif. Intell. Res., 2000.
26. N. D. Lawrence and J. C. Platt, "Learning to learn with the informative vector machine," in Proc. 21st Int. Conf. Mach. Learn. (ICML 21), 2004.
27. K. Yu, V. Tresp, and A. Schwaighofer, "Learning Gaussian processes from multiple tasks," in Proc. 22nd Int. Conf. Mach. Learn. (ICML 22), 2005.
28. J. Zhang, Z. Ghahramani, and Y. Yang, "Learning multiple related tasks using latent independent component analysis," in Proc. Adv. Neural Inf. Process. Syst., 2005, vol. 18.
29. R. K. Ando and T. Zhang, "A framework for learning predictive structures from multiple tasks and unlabeled data," J. Mach. Learn. Res., vol. 6, pp. 1817-1853, 2005.
30. T. Evgeniou, C. A. Micchelli, and M. Pontil, "Learning multiple tasks with kernel methods," J. Mach. Learn. Res., vol. 6, pp. 615-637, 2005.
31. D. Burr and H. Doss, "A Bayesian semiparametric model for random-effects meta-analysis," J. Amer. Statist. Assoc., vol. 100, no. 469, pp. 242-251, Mar. 2005.
32. F. Dominici, G. Parmigiani, R. Wolpert, and K. Reckhow, "Combining information from related regressions," J. Agricult., Biolog. Environ. Statist., vol. 2, no. 3, pp. 294-312, 1997.
33. P. D. Hoff, Nonparametric modeling of hierarchically exchangeable data Univ. Wash. Statist. Dep., Tech. Rep. 421, 2003.
34. P. Müller, F. Quintana, and G. Rosner, "A method for combining inference across related nonparametric Bayesian models," J. Royal Statist. Soc. Ser. B, vol. 66, no. 3, pp. 735-749, 2004.
35. B. K. Mallick and S. G. Walker, "Combining information from several experiments with nonparametric priors," Biometrika, vol. 84, no. 3, pp. 697-706, 1997.
36. C. M. Bishop and M. E. Tipping, "Variational relevance vector machines," in Proc. 16th Conf. Uncertainty in Artif. Intell. (UAI 16), 2000, pp. 46-53.
37. D. P. Wipf and B. D. Rao, "Comparing the effects of different weight distributions on finding sparse representations," in Proc. Adv. Neural Inf. Process. Syst., 2006, vol. 18.
38. D. P. Wipf and S. Nagarajan, "A new view of automatic relevance determination," in Proc. Adv. Neural Inf. Process. Syst., 2008, vol. 20.
39. B. P. Carlin and T. A. Louis, Bayes and Empirical Bayes Methods for Data Analysis. London, U.K.: Chapman and Hall-CRC, 2000.
40. D. J. C. MacKay, "Bayesian interpolation," Neural Comput., vol. 4, no. 3, pp. 415-447, 1992.
41. D. MacKay, "Bayesian interpolation," Neural Comput., vol. 4, no. 3, pp. 415-447, 1992.
42. D. Wipf and B. Rao, "Sparse Bayesian learning for basis selection," IEEE Trans. Signal Process., vol. 52, no. 8, pp. 2153-2164, Aug. 2004.
43. M. E. Tipping and A. C. Faul, "Fast marginal likelihood maximisation for sparse Bayesian models," in Proc. 9th Int. Workshop on AIStats C. M. Bishop and B. J. Frey, Eds., 2003.
44. D. B. Dunson, "Empirical Bayes density regression," Statistica Sinica, vol. 17, pp. 481-504, 2007.
45. M. Svensén and C. M. Bishop, "Robust Bayesian mixture modelling," Neurocomput., vol. 64, pp. 235-252, 2004.
46. S. Yu, V. Tresp, and K. Yu, "Robust multitask learning with t-processes," in Proc. 24th Int. Conf. Mach. Learn. (ICML 24 , 2007.
47. J. A. Tropp, A. C. Gilbert, and M. J. Strauss, "Simultaneous sparse approximation via greedy pursuit," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Mar. 2005, vol. 5, pp. 721-724.
48. Y. Tsaig and D. L. Donoho, "Extensions of compressed sensing," Signal Process., vol. 86, no. 3, pp. 549-571, Mar. 2006.
49. M. Crouse, R. Nowak, and R. Baraniuk, "Wavelet-based statistical signal processing using hidden markov models," IEEE Trans. Signal Process. vol. 46, no. 4, pp. 886-902, April 1998.
50. T. S. Ferguson, "A Bayesian analysis of some nonparametric problems," Ann. Statist., vol. 1, no. 2, pp. 209-230, 1973.
51. A. C. Faul and M. E. Tipping, "Analysis of sparse Bayesian learning," in Proc. Adv. Neural Inf. Process. Syst. (NIPS) 14, 2002, pp. 383-389, MIT Press.