Compressive sensing by learning a gaussian mixture model from measurements

IEEE Transactions on Image Processing

Volumn 24, Issue 1, 2015, Pages 106-119

  Yang, Jianbo ^a   Liao, Xuejun ^a   Yuan, Xin ^a   Llull, Patrick ^a   Brady, David J ^a   Sapiro, Guillermo ^a   Carin, Lawrence ^a  

^a USA   (United States)

Author keywords

Compressive sensing; Gaussian mixture model (GMM); High speed video; Hyperspectral imaging; Inpainting; Maximum marginal likelihood estimator (MMLE); Mixture of factor analyzers (MFA)

Indexed keywords

COVARIANCE MATRIX; GAUSSIAN DISTRIBUTION; HIGH SPEED CAMERAS; IMAGE SEGMENTATION; MAXIMUM LIKELIHOOD; MEAN SQUARE ERROR; SIGNAL RECONSTRUCTION; SPECTROSCOPY;

COMPRESSIVE SENSING; GAUSSIAN MIXTURE MODEL; HIGH-SPEED VIDEO; HYPERSPECTRAL IMAGING; INPAINTING; MARGINAL LIKELIHOOD; MIXTURE OF FACTOR ANALYZERS;

COMPRESSED SENSING;

EID: 84916898086     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2365720     Document Type: Article

References (34)

1. E. J. Candes, J. Romberg, and T. Tao, "Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information," IEEE Trans. Inf. Theory, vol. 52, no. 2, pp. 489-509, Feb. 2006.
2. E. J. Candes and T. Tao, "Near-optimal signal recovery from random projections: Universal encoding strategies?" IEEE Trans. Inf. Theory, vol. 52, no. 12, pp. 5406-5425, Dec. 2006.
3. E. J. Candès, J. K. Romberg, and T. Tao, "Stable signal recovery from incomplete and inaccurate measurements," Commun. Pure Appl. Math., vol. 59, no. 8, pp. 1207-1223, 2006.
4. E. J. Candes and T. Tao, "Decoding by linear programming," IEEE Trans. Inf. Theory, vol. 51, no. 12, pp. 4203-4215, Dec. 2005.
5. D. L. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, Apr. 2006.
6. Y. M. Lu and M. N. Do, "Sampling signals from a union of subspaces," IEEE Signal Process. Mag., vol. 25, no. 2, pp. 41-47, Mar. 2008.
7. R. G. Baraniuk, V. Cevher, M. F. Duarte, and C. Hegde, "Model-based compressive sensing," IEEE Trans. Inf. Theory, vol. 56, no. 4, pp. 1982-2001, Apr. 2010.
8. T. Blumensath and M. E. Davies, "Sampling theorems for signals from the union of finite-dimensional linear subspaces," IEEE Trans. Inf. Theory, vol. 55, no. 4, pp. 1872-1882, Apr. 2009.
9. M. Chen, J. Silva, J. Paisley, C. Wang, D. Dunson, and L. Carin, "Compressive sensing on manifolds using a nonparametric mixture of factor analyzers: Algorithm and performance bounds," IEEE Trans. Signal Process., vol. 58, no. 12, pp. 6140-6155, Dec. 2010.
10. G. Yu and G. Sapiro, "Statistical compressed sensing of Gaussian mixture models," IEEE Trans. Signal Process., vol. 59, no. 12, pp. 5842-5858, Dec. 2011.
11. G. Yu, G. Sapiro, and S. Mallat, "Solving inverse problems with piecewise linear estimators: From Gaussian mixture models to structured sparsity," IEEE Trans. Image Process., vol. 21, no. 5, pp. 2481-2499, May 2012.
12. J. Yang et al., "Video compressive sensing using Gaussian mixture models," IEEE Trans. Image Process., vol. 23, no. 11, pp. 4863-4878, Nov. 2014.
13. F. Renna, R. Calderbank, L. Carin, and M. R. D. Rodrigues, "Reconstruction of signals drawn from a Gaussian mixture via noisy compressive measurements," IEEE Trans. Signal Process., vol. 62, no. 9, pp. 2265-2277, May 2014.
14. W. R. Carson, M. Chen, M. R. D. Rodrigues, R. Calderbank, and L. Carin, "Communications-inspired projection design with application to compressive sensing," SIAM J. Imag. Sci., vol. 5, no. 4, pp. 1185-1212, 2012.
15. D. Zoran and Y. Weiss, "From learning models of natural image patches to whole image restoration," in Proc. IEEE ICCV, Nov. 2011, pp. 479-486.
16. D. Zoran and Y. Weiss, "Natural images, Gaussian mixtures and dead leaves," in Advances in Neural Information Processing Systems 25. Red Hook, NY, USA: Curran Associates, 2012, pp. 1745-1753.
17. Z. Ghahramani and G. E. Hinton, "The EM algorithm for mixtures of factor analyzers," Dept. Comput. Sci., Univ. Toronto, Toronto, ON, Canada, Tech. Rep. CRG-TR-96-1, 1997.
18. G. E. Hinton, P. Dayan, and M. Revow, "Modeling the manifolds of images of handwritten digits," IEEE Trans. Neural Netw., vol. 8, no. 1, pp. 65-74, Jan. 1997.
19. Z. Ghahramani and M. J. Beal, "Variational inference for Bayesian mixtures of factor analysers," in Advances in Neural Information Processing Systems, vol. 12. Cambridge, MA, USA: MIT Press, 2000, pp. 449-455.
20. D. Kittle, K. Choi, A. Wagadarikar, and D. J. Brady, "Multiframe image estimation for coded aperture snapshot spectral imagers," Appl. Opt., vol. 49, no. 36, pp. 6824-6833, Dec. 2010.
21. A. Rajwade, D. Kittle, T.-H. Tsai, and L. Carin, "Coded hyperspectral imaging and blind compressive sensing," SIAM J. Imag. Sci., vol. 6, no. 2, pp. 782-812, 2013.
22. P. Llull et al., "Coded aperture compressive temporal imaging," Opt. Exp., vol. 21, no. 9, pp. 10526-10545, 2013.
23. J. Yang et al., "Gaussian mixture model for video compressive sensing," in Proc. Int. Conf. Image Process., 2013, pp. 19-23.
24. X. Yuan et al., "Adaptive temporal compressive sensing for video," in Proc. IEEE Int. Conf. Image Process., Sep. 2013, pp. 14-18.
25. X. Yuan et al., "Low-cost compressive sensing for color video and depth," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2014, pp. 3318-3325.
26. P. Llull et al., "Compressive extended depth of field using image space coding," in Proc. Comput. Opt. Sens. Imag., 2014, pp. 1-3.
27. A. Levin, Y. Weiss, F. Durand, and W. T. Freeman, "Efficient marginal likelihood optimization in blind deconvolution," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 2657-2664.
28. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Roy. Statist. Soc. B, vol. 39, no. 1, pp. 1-38, 1977.
29. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge, U.K.: Cambridge Univ. Press, 2004.
30. M. Aharon, M. Elad, and A. Bruckstein, "K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation," IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, Nov. 2006.
31. J. M. Bioucas-Dias and M. A. T. Figueiredo, "A new TwIST: Two-step iterative shrinkage/thresholding algorithms for image restoration," IEEE Trans. Image Process., vol. 16, no. 12, pp. 2992-3004, Dec. 2007.
32. 2,1 minimization with applications to model-based compressive sensing," SIAM J. Imag. Sci., vol. 7, no. 2, pp. 797-823, 2014.
33. R. J. Steele and A. E. Raftery, "Performance of Bayesian model selection criteria for Gaussian mixture models," Dept. Statist., Univ. Washington, Seattle, WA, USA, Tech. Rep. 559, 2008.
34. R. Zhu, T.-H. Tsai, and D. J. Brady, "Coded aperture snapshot spectral imager based on liquid crystal spatial light modulator," in Proc. Frontiers Opt., 2013, pp. 1-2.