Sparse signal recovery and acquisition with graphical models

IEEE Signal Processing Magazine

Volumn 27, Issue 6, 2010, Pages 92-103

  Cevher, Volkan ^a   Indyk, Piotr ^b   Carin, Lawrence ^c   Baraniuk, Richard ^d  

^a UNIVERSITY OF MARYLAND   (United States)

^b UNIVERSITY OF WARSAW   (Poland)

^c Signal Innovations Group Inc   (Poland)

^d Rice University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DIGITAL SIGNAL PROCESSING; LEARNING SYSTEMS;

CODE-WORDS; DATA POINTS; DIMENSIONAL SPACES; GRAPHICAL MODEL; HIDDEN VARIABLE; LINEAR REGRESSION PROBLEMS; SPARSE SIGNAL RECOVERIES;

SIGNAL PROCESSING;

EID: 85032751046     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.2010.938029     Document Type: Review

References (32)

1. R. G. Baraniuk, V. Cevher, and M. Wakin, "Low-dimensional models for dimensionality reduction and signal recovery: A geometric perspective," Proc. IEEE, vol. 98, no. 6, pp. 959-971, 2010.
2. A. Gilbert and P. Indyk, "Sparse recovery using sparse matrices," Proc. IEEE, vol. 98, no. 6, pp. 937-947, 2010.
3. C. M. Bishop, Pattern Recognition and Machine Learning. New York: Springer-Verlag, 2006.
4. D. L. Donoho, "Compressed sensing," IEEE Trans. Inform. Theory, vol. 52, pp. 1289-1306, Sept. 2006.
5. E. J. Candès, "Compressive sampling," in Proc. Int. Congr. Mathematicians, Madrid, Spain, 2006, vol. 3, pp. 1433-1452.
6. A. Cohen, W. Dahmen, and R. DeVore, "Compressed sensing and best k-term approximation," Amer. Math. Soc., vol. 22, no. 1, pp. 211-231, 2009.
7. S. L. Lauritzen, Graphical Models. London, U.K.: Oxford Univ. Press, 1996.
8. M. I. Jordan, Z. Ghahramani, T. S. Jaakkola, and L. K. Saul, "An introduction to variational methods for graphical models," Mach. Learn., vol. 37, no. 2, pp. 183-233, 1999.
9. A. Willsky, "Multiresolution Markov models for signal and image processing," Proc. IEEE, vol. 90, no. 8, pp. 1396-1458, 2002.
10. J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. San Mateo, CA: Morgan Kaufmann, 1988.
11. D. Koller and N. Friedman, Probabilistic Graphical Models: Principles and Techniques. Cambridge, MA: MIT Press, 2009.
12. M. S. Crouse, R. D. Nowak, and R. G. Baraniuk, "Wavelet-based statistical signal processing using Hidden Markov Models," IEEE Trans. Signal Processing, vol. 46, pp. 886-902, Apr. 1998.
13. J. S. Yedidia, W. T. Freeman, and Y. Weiss, "Generalized belief propagation," Adv. Neural Inform. Process. Syst., vol. 13, pp. 689-695, 2001.
14. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. R. Statist. Soc., ser. B (Methodological), vol. 39, no. 1, pp. 1-38, 1977.
15. V. Cevher, "Learning with compressible priors," in Proc. Neural Information Processing Systems (NIPS'08), Vancouver, BC, Canada, Dec. 7-12, 2008, pp. 261-269.
16. S. Negahban and M. J. Wainwright, "Estimation of (near) low-rank matrices with noise and high-dimensional scaling," Proc. Int. Conf. Machine Learning (ICML'10), Haifa, Israel, June 21-24, 2010, pp. 823-831.
17. L. He and L. Carin. (2008). Exploiting structure in wavelet-based Bayesian compressive sensing [Online]. Available: http://people.ee.duke.edu/ lcarin/Pa-pers.html
18. V. Cevher, M. F. Duarte, C. Hegde, and R. G. Baraniuk, "Sparse signal recovery using Markov random fields," in Proc. Neural Information Processing Systems (NIPS'08), Vancouver, BC, Canada, Dec. 8-11, 2008, pp. 257-264.
19. I. Daubechies, R. DeVore, M. Fornasier, and C. S. Gunturk, "Iteratively re-weighted least squares minimization for sparse recovery," Commun. Pure Appl. Math., vol. 63, no. 1, pp. 1-38, 2010.
20. J. K. Romberg, H. Choi, and R. G. Baraniuk, "Bayesian tree-structured image modeling using wavelet-domain hidden Markov models," IEEE Trans. Image Processing, vol. 10, pp. 1056-1068, July 2001. (Pubitemid 32650882)
21. M. J. Wainwright and E. P. Simoncelli, "Scale mixtures of Gaussians and the statistics of natural images," in Proc. Neural Information Processing Systems (NIPS'2000), vol. 12, S. A. Solla, T. K. Leen, and K.-R. Müller, Eds. Cambridge, MA: MIT Press, Dec. 2000, pp. 855-861.
22. M. Zhou, H. Chen, J. Paisley, L. Ren, G. Sapiro, and L. Carin, "Non-parametric Bayesian dictionary learning for sparse image representations," in Proc. Neural Information Processing Systems (NIPS'09), 2009, pp. 2295-2303.
23. E. B. Sudderth and M. I. Jordan, "Shared segmentation of natural scenes using dependent Pitman-Yor processes," in Proc. Advances in Neural Information Processing Systems (NIPS'09), 2009, vol. 21, pp. 1585-1592.
24. M. Charikar, K. Chen, and M. Farach-Colton, "Finding frequent items in data streams," in Proc. Int. Colloquium Automata, Languages and Programming (ICALP'02), 2002, pp. 693-703.
25. G. Cormode and S. Muthukrishnan, "Improved data stream summaries: The Count-Min sketch and its applications," in Proc. Latin American Theoretical Informatics Symp. (LATIN'04), 2004, pp. 29-38.
26. D. Baron, S. Sarvotham, and R. G. Baraniuk, "Bayesian compressive sensing via belief propagation," IEEE Trans. Signal Processing, vol. 58, no. 1, pp. 269-280, 2010.
27. Y. Lu, A. Montanari, B. Prabhakar, S. Dharmapurikar, and A. Kabbani, "Counter braids: A novel counter architecture for per-flow measurement," in Proc. 2008 ACM SIGMETRICS Int. Conf. Measurement and Modeling of Computer Systems (ACM SIGMETRICS'08), New York, NY, pp. 121-132.
28. D. Donoho, A. Maleki, and A. Montanari, "Message passing algorithms for compressed sensing," Proc. Nat. Acad. Sci., vol. 106, no. 45, pp. 18914-18919, 2009.
29. C. Estan and G. Varghese, "New directions in traffic measurement and accounting: Focusing on the elephants, ignoring the mice," ACM Trans. Comput. Syst., vol. 21, no. 3, pp. 270-313, 2003.
30. S. Jafarpour, W. Xu, B. Hassibi, and A. R. Calderbank, "Efficient and robust compressed sensing using high-quality expander graphs," IEEE Trans. Inform. Theory, vol. 33, no. 9, pp. 4299-4308, 2009.
31. R. Berinde, A. Gilbert, P. Indyk, H. Karloff, and M. Strauss, "Combining geometry and combinatorics: A unified approach to sparse signal recovery," in Proc. Allerton Conf. Communication, Control, and Computing, 2008, pp. 798-805.
32. R. Berinde and P. Indyk, "Sequential sparse matching pursuit," in Proc. Allerton Conf. Communication, Control, and Computing, 2009, pp. 36-43.