Nonparametric bayesian dictionary learning for analysis of noisy and incomplete images

IEEE Transactions on Image Processing

Volumn 21, Issue 1, 2012, Pages 130-144

  Zhou, Mingyuan ^a   Chen, Haojun ^a   Paisley, John ^a   Ren, Lu ^a   Li, Lingbo ^a   Xing, Zhengming ^a   Dunson, David ^b   Sapiro, Guillermo ^c   Carin, Lawrence ^a  

^a Duke University   (United States)

^b DUKE UNIVERSITY   (United States)

^c University of Minnesota   (United States)

Author keywords

Bayesian nonparametrics; compressive sensing; dictionary learning; factor analysis; image denoising; image interpolation; sparse coding

Indexed keywords

BAYESIAN NONPARAMETRICS; COMPRESSIVE SENSING; DICTIONARY LEARNING; FACTOR ANALYSIS; IMAGE DE-NOISING; IMAGE INTERPOLATIONS; SPARSE CODING;

BAYESIAN NETWORKS; SIGNAL RECONSTRUCTION;

RECOVERY;

ALGORITHM; ARTICLE; ARTIFACT; AUTOMATED PATTERN RECOGNITION; BAYES THEOREM; COMPUTER ASSISTED DIAGNOSIS; IMAGE ENHANCEMENT; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; STATISTICAL ANALYSIS;

ALGORITHMS; ARTIFACTS; BAYES THEOREM; DATA INTERPRETATION, STATISTICAL; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 84255204432     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2011.2160072     Document Type: Article

References (43)

1. M. Aharon, M. Elad, and A. M. Bruckstein, "K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation," IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, Nov. 2006. (Pubitemid 44637761)
2. R. G. Baraniuk, V. Cevher,M. F. Duarte, and C. Hegde, "Model-based compressive sensing," IEEE Trans. Inf. Theory, vol. 56, no. 4, pp. 1982-2001, Apr. 2010.
3. R. G. Baraniuk, "Compressive sensing," IEEE Signal Process. Mag., vol. 24, no. 4, pp. 118-121, Jul. 2007.
4. A. M. Bruckstein, D. L. Donoho, and M. Elad, "From sparse solutions of systems of equations to sparse modeling of signals and images," SIAM Rev., vol. 51, no. 1, pp. 34-81, Jan. 2009.
5. E. Candès and T. Tao, "Near-optimal signal recovery from random projections: Universal encoding strategies?," IEEE Trans. Inf. Theory, vol. 52, no. 12, pp. 5406-5425, Dec. 2006. (Pubitemid 46445381)
6. E. J. Candès and T. Tao, "The power of convex relaxation: Near-optimal matrix completion," IEEE Trans. Inf. Theory, vol. 56, no. 5, pp. 2053-2080, May 2010.
7. Y. Chung and D. B. Dunson, "Nonparametric Bayes conditional distribution modeling with variable selection," J. Amer. Stat. Assoc., vol. 104, no. 488, pp. 1646-1660, Dec. 2009.
8. K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian, "Image denoising by sparse 3D transform-domain collaborative filtering," IEEE Trans. Image Process., vol. 16, no. 8, pp. 2080-2095, Aug. 2007. (Pubitemid 47225460)
9. D. L. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, Apr. 2006.
10. D. L. Donoho, I. M. Johnstone, G. Kerkyacharian, and D. Picard, "Wavelet shrinkage: Asymptopia," J. Roy. Stat. Soc. B, vol. 57, no. 2, pp. 301-369, 1995.
11. M. F. Duarte, M. A. Davenport, D. Takhar, J. N. Laska, T. Sun, K. F. Kelly, and R. G. Baraniuk, "Single-pixel imaging via compressive sampling," IEEE Signal Process. Mag., vol. 25, no. 2, pp. 83-91, Mar. 2008.
12. J. M. Duarte-Carvajalino and G. Sapiro, "Learning to sense sparse signals: Simultaneous sensing matrix and sparsifying dictionary optimization," IEEE Trans. Image Process., vol. 18, no. 7, pp. 1395-1408, Jul. 2009.
13. M. Elad and M. Aharon, "Image denoising via sparse and redundant representations over learned dictionaries," IEEE Trans. Image Process., vol. 15, no. 2, pp. 3736-3745, Dec. 2006. (Pubitemid 44811686)
14. M. Elad and I. Yavneh, AWeighted Average of Sparse Representations is Better Than the Sparsest One Alone 2010, Preprint.
15. T. Ferguson, "A Bayesian analysis of some nonparametric problems," Ann. Stat., vol. 1, no. 2, pp. 209-230, Mar. 1973.
16. S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-6, no. 6, pp. 721-741, Nov. 1984. (Pubitemid 15453722)
17. S. Gleichman and Y. C. Eldar, Blind Compressed Sensing Technion-Israel Inst. Technol., Haifa, Israel, CCIT Rep. 759, 2010, Preprint (on Arxiv.org).
18. T. L. Griffiths and Z. Ghahramani, "Infinite latent feature models and the Indian buffet process," in Proc. Adv. Neural Inf. Process. Syst., 2005, pp. 475-482.
19. L. He and L. Carin, "Exploiting structure in wavelet-based Bayesian compressive sensing," IEEE Trans. Signal Process., vol. 57, no. 9, pp. 3488-3497, Sep. 2009.
20. E. J. Candès, J.-F. Cai, and Z. Shen, "A singular value thresholding algorithm for matrix completion," SIAM J. Optim., vol. 20, no. 4, pp. 1956-1982, Jan. 2008.
21. S. Ji, Y. Xue, and L. Carin, "Bayesian compressive sensing," IEEE Trans. Signal Process., vol. 56, no. 6, pp. 2346-2356, Jun. 2008. (Pubitemid 351795888)
22. D. Knowles and Z. Ghahramani, "Infinite sparse factor analysis and infinite independent components analysis," in Proc. Int. Conf. Ind. Compon. Anal. Signal Separation, 2007, pp. 381-388.
23. N. D. Lawrence and R. Urtasun, "Non-linear matrix factorization with Gaussian processes," in Proc. Int. Conf. Mach. Learn., 2009, pp. 601-608.
24. J. Mairal, F. Bach, J. Ponce, and G. Sapiro, "Online dictionary learning for sparse coding," in Proc. Int. Conf. Mach. Learn., 2009, pp. 689-696.
25. J. Mairal, F. Bach, J. Ponce, G. Sapiro, and A. Zisserman, "Supervised dictionary learning," in Proc. Neural Inf. Process. Syst., 2008, pp. 1033-1040.
26. J. Mairal, F. Bach, J. Ponce, G. Sapiro, and A. Zisserman, "Non-local sparse models for image restoration," in Proc. Int. Conf. Comput. Vis., 2009, pp. 2272-2279.
27. J. Mairal, M. Elad, and G. Sapiro, "Sparse representation for color image restoration," IEEE Trans. Image Process., vol. 17, no. 1, pp. 53-69, Jan. 2008.
28. J. Mairal, G. Sapiro, and M. Elad, "Learning multiscale sparse representations for image and video restoration," SIAM Multisc. Model. Simul., vol. 7, no. 1, pp. 214-241, 2008.
29. J. Paisley and L. Carin, "Nonparametric factor analysis with beta process priors," in Proc. Int. Conf. Mach. Learn., 2009, pp. 777-784.
30. R. Raina, A. Battle, H. Lee, B. Packer, and A. Y. Ng, "Self-taught learning: Transfer learning from unlabeled data," in Proc. Int. Conf. Mach. Learn., 2007, pp. 759-766.
31. M. Ranzato, C. Poultney, S. Chopra, and Y. Lecun, "Efficient learning of sparse representations with an energy-based model," in Proc. Neural Inf. Process. Syst., 2006, pp. 1137-1144.
32. L. Ren, L. Du, D. Dunson, and L. Carin, "The logistic stick breaking process," J. Mach. Learn. Res., preprint.
33. R. Salakhutdinov and A. Mnih, "Bayesian probabilistic matrix factorization using Markov chain Monte Carlo," in Proc. Int. Conf. Mach. Learn., 2008, pp. 880-887.
34. J. Sethuraman, "A constructive definition of Dirichlet priors," Stat. Sin., vol. 4, no. 2, pp. 639-650, 1994.
35. M. Shankar, N. P. Pitsianis, and D. J. Brady, "Compressive video sensors using multichannel imagers," Appl. Opt., vol. 49, no. 10, pp. B9-B17, Feb. 2010.
36. Y. W. Teh, M. I. Jordan, M. J. Beal, and D. M. Blei, "Hierarchical Dirichlet processes," J. Amer. Stat. Assoc., vol. 101, no. 476, pp. 1566-1581, Dec. 2006.
37. R. Thibaux and M. I. Jordan, "Hierarchical beta processes and the Indian buffet process," in Proc. Int. Conf. Artif. Intell. Stat., 2007, pp. 564-571.
38. R. Tibshirani, M. Saunders, S. Rosset, J. Zhu, and K. Knight, "Sparsity and smoothness via the fused Lasso," J. Roy. Stat. Soc. B., vol. 67, no. 1, pp. 91-108, Feb. 2005. (Pubitemid 40167043)
39. M. Tipping, "Sparse Bayesian learning and the relevance vector machine," J. Mach. Learn. Res., vol. 1, pp. 211-244, Jun. 2001. (Pubitemid 33687203)
40. J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry, and Y. Ma, "Robust face recognition via sparse representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
41. J. Yang, J. Wright, T. Huang, and Y. Ma, "Image super-resolution via sparse representation," IEEE Trans. Image Process., vol. 19, no. 11, pp. 2861-2873, Nov. 2009.
42. M. Zhou, H. Chen, J. Paisley, L. Ren, G. Sapiro, and L. Carin, "Nonparametric Bayesian dictionary learning for sparse image representations," in Proc. Neural Inf. Process. Syst., 2009, pp. 1-9.
43. M. Zhou, H. Yang, G. Sapiro, D. Dunson, and L. Carin, "Dependent hierarchical beta process for image interpolation and denoising," Proc. Int. Conf. Artificial Intelligence Statistics (AISTATS) JMLR W&CP, vol. 15, pp. 883-891, 2011.