Information-theoretic dictionary learning for image classification

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 36, Issue 11, 2014, Pages 2173-2184

  Qiu, Qiang ^a   Patel, Vishal M ^b   Chellappa, Rama ^b  

^a Duke University   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

Author keywords

Dictionary learning; entropy; image classification; information theory; mutual information

Indexed keywords

IMAGE CLASSIFICATION; INFORMATION THEORY;

DICTIONARY LEARNING; MUTUAL INFORMATIONS;

ENTROPY;

EID: 84907810914     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2014.2316824     Document Type: Article

References (34)

1. R. Rubinstein, A. Bruckstein, and M. Elad, "Dictionaries for sparse representation modeling," Proc. IEEE, vol. 98, no. 6, pp. 1045-1057, Jun. 2010.
2. J. Wright, Y. Ma, J. Mairal, G. Sapiro, T. Huang, and S. Yan, "Sparse representation for computer vision and pattern recognition," Proc. IEEE, vol. 98, no. 6, pp. 1031-1044, Jun. 2010.
3. M. Elad, M. Figueiredo, and Y. Ma, "On the role of sparse and redundant representations in image processing," Proc. IEEE, vol. 98, no. 6, pp. 972-982, Jun. 2010.
4. V. M. Patel and R. Chellappa, "Sparse representations, compressive sensing and dictionaries for pattern recognition," presented at the Asian Conf. Pattern Recognition, Beijing, China, 2011.
5. S. Chen, D. Donoho, and M. Saunders, "Atomic decomposition by basis pursuit," SIAM J. Sci. Comput., vol. 20, no. 1, pp. 33-61, 1998.
6. Y. C. Pati, R. Rezaiifar, and P. S. Krishnaprasad, "Orthogonal matching pursuit: Recursive function approximation with applications to wavelet decomposition," in Proc. 27th Asilomar Conf. Signals, Syst. and Comput., 1993, pp. 40-44.
7. J. A. Tropp, "Greed is good: Algorithmic results for sparse approximation," IEEE Trans. Info. Theory, vol. 50, no. 10, pp. 2231-2242, Oct. 2004.
8. B. A. Olshausen and D. J. Field, "Emergence of simple-cell receptive field properties by learning a sparse code for natural images," Nature, vol. 381, no. 6583, pp. 607-609, 1996.
9. V. M. Patel, T. Wu, S. Biswas, P. J. Phillips, and R. Chellappa, "Dictionary-based face recognition under variable lighting and pose," IEEE Trans. Inf. Forensics Security, vol. 7, no. 3, pp. 954-965, Jun. 2012.
10. M. Aharon, M. Elad, and A. Bruckstein, "k-SVD: An algorithm for designing overcomplete dictionaries for sparse representation," IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, Nov. 2006.
11. K. Etemand and R. Chellappa, "Separability-based multiscale basis selection and feature extraction for signal and image classification," IEEE Trans. Image Process., vol. 7, no. 10, pp. 1453-1465, Oct. 1998.
12. M. Yang, X. F. L. Zhang, and D. Zhang, "Fisher discrimination dictionary learning for sparse representation," in Proc. Int. Conf. Computer Vision, Barcelona, Spain, 2011, pp. 543-550.
13. F. Rodriguez and G. Sapiro, "Sparse representations for image classification: Learning discriminative and reconstructive nonparametric dictionaries," Tech. Rep. no. 2213, Univ. Minnesota, Minneapolis, MN, USA, Dec. 2007.
14. E. Kokiopoulou and P. Frossard, "Semantic coding by supervised dimensionality reduction," IEEE Trans. Multimedia, vol. 10, no. 5, pp. 806-818, Aug. 2008.
15. K. Huang and S. Aviyente, "Sparse representation for signal classification," presented at the Neural Information Processing Systems, Vancouver, BC, Canada, Dec. 2007.
16. J. Mairal, F. Bach, and J. Ponce, "Task-driven dictionary learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 4, pp. 791-804, Apr. 2012.
17. J. Mairal, F. Bach, J. Pnce, G. Sapiro, and A. Zisserman, "Discriminative learned dictionaries for local image analysis," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., Anchorage, Alaska, USA, 2008, pp. 1-8.
18. J. Mairal, F. Bach, J. Ponce, G. Sapiro, and A. Zisserman, "Supervised dictionary learning," presented at the Neural Information Processing Systems, Vancouver, BC, Canada, Dec. 2008.
19. Q. Zhang and B. Li, "Discriminative k-SVD for dictionary learning in face recognition," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Reccog., San Francisco, CA, USA, Jun. 2010, pp. 2691-2698.
20. Z. Jiang, Z. Lin, and L. S. Davis, "Learning a discriminative dictionary for sparse coding via label consistent k-SVD," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recog., Colorado Springs, CO, USA, Jun. 2011, pp. 1697-1704.
21. Q. Qiu, Z. Jiang, and R. Chellappa, "Sparse dictionary-based representation and recognition of action attributes," in Proc. Intl. Conf. Comput. Vision, Barcelona, Spain, Nov. 2011, pp. 707-714.
22. J. A. Tropp, A. C. Gilbert, and M. J. Strauss, "Algorithms for simultaneous sparse approximation. part i: Greedy pursuit," Signal Process., vol. 86, pp. 572-588, 2006.
23. A. Krause, A. Singh, and C. Guestrin, "Near-optimal sensor placements in Gaussian processes: Theory, efficient algorithms and empirical studies," J. Mach. Learn. Res., vol. 9, pp. 235-284, 2008.
24. M. E. Hellman and J. Raviv, "Probability of error, equivocation, and the Chernoff bound," IEEE Trans. Inf. Theory, vol. IT-16, no. 4, pp. 368-372, Jul. 1970.
25. C. M. Bishop, Pattern Recognition and Machine Learning. New York, NY, USA: Springer, 2006.
26. K. Torkkola, "Feature extraction by non parametric mutual information maximization," J. Mach. Learn. Res., vol. 3, pp. 1415-1438, Mar. 2003.
27. J. Kapur, Measures of Information and Their Applications. New York, NY, USA: Wiley, 1994.
28. A. S. Georghiades, P. N. Belhumeur, and D. J. Kriegman, "From few to many: Ilumination cone models for face recognition under variable lighting and pose," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 643-660, Jun. 2001.
29. USPS handwritten digit database. [Online]. Available: http://www-i6.informatik.rwth-aachen.de/keysers/usps.html.
30. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recog., New York, NY, USA, 2006, vol. 2, pp. 2169-2178.
31. J. Wright, A. Yang, A. Ganesh, S. Sastry, and Y. Ma, "Robust face recognition via sparse representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
32. J. Yang, K. Yu, Y. Gong, and T. Huang, "Linear spatial pyramid matching using sparse coding for image classification," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recog., Miami, FL, USA, Jun. 2009, pp. 1794-1801.
33. J. C. Gemert, J.-M. Geusebroek, C. J. Veenman, and A. W. Smeulders, "Kernel codebooks for scene categorization," in Proc. Eur. Conf. Comput. Vision, Marseiiles, France, Oct. 2008, pp. 696-709.
34. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong, "Localityconstrained linear coding for image classification," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recog., San Francisco, CA, USA, Jun. 2010 , pp. 3360-3367.