Design of non-linear kernel dictionaries for object recognition

IEEE Transactions on Image Processing

Volumn 22, Issue 12, 2013, Pages 5123-5135

  Van Nguyen, Hien ^a   Patel, Vishal M ^c   Nasrabadi, Nasser M ^d   Chellappa, Rama ^b  

^a SIEMENS CORPORATE RESEARCH   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

^c UNIVERSITY OF MARYLAND   (United States)

^d U S ARMY RESEARCH LABORATORY   (United States)

Author keywords

Dictionary learning; Kernel methods; KSVD; Method of optimal directions

Indexed keywords

DICTIONARY LEARNING; HIGH-DIMENSIONAL FEATURE SPACE; KERNEL CONSTRUCTION; KERNEL METHODS; KERNEL PRINCIPAL COMPONENT ANALYSES (KPCA); KSVD; METHOD OF OPTIMAL DIRECTIONS; SPARSE SIGNAL REPRESENTATION;

OBJECT RECOGNITION; OPTIMIZATION;

PRINCIPAL COMPONENT ANALYSIS;

EID: 84885661679     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2013.2282078     Document Type: Article

References (53)

1. R. Rubinstein, A. Bruckstein, and M. Elad, "Dictionaries for sparse representation modeling," Proc. IEEE, vol. 98, no. 6, pp. 1045-1057, Jun. 2010.
2. J. Wright, Y. Ma, J. Mairal, G. Sapiro, T. Huang, and S. Yan, "Sparse representation for computer vision and pattern recognition," Proc. IEEE, vol. 98, no. 6, pp. 1031-1044, Jun. 2010.
3. M. Elad, M. Figueiredo, and Y. Ma, "On the role of sparse and redundant representations in image processing," Proc. IEEE, vol. 98, no. 6, pp. 972-982, Jun. 2010.
4. A. M. Bruckstein, D. L. Donoho, and M. Elad, "From sparse solutions of systems of equations to sparse modeling of signals and images," SIAM Rev., vol. 51, no. 1, pp. 34-81, 2010.
5. S. Chen, D. Donoho, and M. Saunders, "Atomic decomposition by basis pursuit," SIAM J. Sci. Comput., vol. 20, no. 1, pp. 33-61, 1998. (Pubitemid 128689501)
6. Y. C. Pati, R. Rezaiifar, and P. S. Krishnaprasad, "Orthogonal matching pursuit: Recursive function approximation with applications to wavelet decomposition," in Proc. Conf. Rec. 27th Asilomar Conf. Signals, Syst. Comput., 1993, pp. 40-44.
7. J. A. Tropp, "Greed is good: Algorithmic results for sparse approximation," IEEE Trans. Inf. Theory, vol. 50, no. 10, pp. 2231-2242, Oct. 2004.
8. B. A. Olshausen and D. J. Field, "Emergence of simple-cell receptive field properties by learning a sparse code for natural images," Nature, vol. 381, no. 6583, pp. 607-609, 1996. (Pubitemid 26177476)
9. J. Mairal, F. Bach, J. Ponce, and G. Sapiro, "Online dictionary learning for sparse coding," in Proc. 26th Annu. Int. Conf. Mach. Learn., 2009, pp. 689-696.
10. J. Mairal, F. Bach, and J. Ponce, "Task-driven dictionary learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 4, pp. 791-804, Apr. 2012.
11. K. Engan, S. O. Aase, and J. H. Husoy, "Method of optimal directions for frame design," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., vol. 5. Mar. 1999, pp. 2443-2446.
12. M. Aharon, M. Elad, and A. M. Bruckstein, "The K-SVD: An algorithm for designing of overcomplete dictionaries for sparse representation," IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, Nov. 2006. (Pubitemid 44637761)
13. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Conf. CVPR, vol. 2. Jun. 2006, pp. 2169-2178. (Pubitemid 44931582)
14. O. Tuzel, F. M. Porikli, and P. Meer, "Region covariance: A fast descriptor for detection and classification," in Proc. ECCV, 2006, pp. 589-600. (Pubitemid 44029757)
15. Z. Jiang, Z. Lin, and L. Davis, "Learning a discriminative dictionary for sparse coding via label consistent K-SVD," in Proc. IEEE Conf. CVPR, Jun. 2011, pp. 1697-1704.
16. Q. Zhang and B. Li, "Discriminative K-SVD for dictionary learning in face recognition," in Proc. IEEE Conf. CVPR, Jun. 2010, pp. 2691-2698.
17. B. Schlkopf, A. J. Smola, and K. R. Müller, "Kernel principal component analysis," in Proc. Adv. Kernel Methods, Support Vector Learn., 1999, pp. 327-352.
18. H. V. Nguyen, V. M. Patel, N. M. Nasrabadi, and R. Chellappa, "Kernel dictionary learning," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., Mar. 2012, pp. 2021-2024.
19. S. Gao, I. W. Tsang, and L.-T. Chia, "Kernel sparse representation for image classification and face recognition," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 1-14.
20. X.-T. Yuan and S. Yan, "Visual classification with multi-task joint sparse representation," in Proc. IEEE Conf. CVPR, Jun. 2010, pp. 3493-3500.
21. L. Zhang, W.-D. Zhou, P.-C. Chang, J. Liu, Z. Yan, T. Wang, and F. Z. Li, "Kernel sparse representation-based classifier," IEEE Trans. Signal Process., vol. 60, no. 4, pp. 1684-1695, Apr. 2012.
22. Y. Chen, N. Nasrabadi, and T. Tran, "Hyperspectral image classification via kernel sparse representation," in Proc. 18th IEEE Int. Conf., Sep. 2011, pp. 1233-1236.
23. H. Li, Y. Gao, and J. Sun, "Fast kernel sparse representation," in Proc. DICTA, Dec. 2011, pp. 72-77.
24. J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry, and Y. Ma, "Robust face recognition via sparse representation," IEEE Trans. Pattern Analy. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
25. H. Qi and S. Hughes, "Using the kernel trick in compressive sensing: Accurate signal recovery from fewer measurements," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., May 2011, pp. 3940-3943.
26. V. Guigue, A. Rakotomamonjy, and S. Canu, "Kernel basis pursuit," New Methods Mach. Learn., vol. 20, no. 6, pp. 757-774, 2006. (Pubitemid 47299071)
27. P. Vincent and Y. Bengio, "Kernel matching pursuit," Mach. Learn., vol. 48, nos. 1-3, pp. 165-187, 2002. (Pubitemid 34247577)
28. S. Mallat and Z. Zhang, "Matching pursuits with time-frequency dictionaries," IEEE Trans. Signal Process., vol. 41, no. 12, pp. 3397-3415, Dec. 1993.
29. M. Harandi, C. Sanderson, R. Hartley, and B. Lovell, "Sparse coding and dictionary learning for symmetric positive definite matrices: A kernel approach," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 216-229.
30. R. Rubinstein, M. Zibulevsky, and M. Elad, "Double sparsity: Learning sparse dictionaries for sparse signal approximation," IEEE Trans. Signal Process., vol. 58, no. 3, pp. 1553-1564, Mar. 2010.
31. C. Cortes and V. Vapnik, "Support-vector networks," in Proc. Mach. Learn., 1995, pp. 273-297.
32. R. Courant and D. Hilbert, Methods of Mathematical Physics. New York, NY, USA: Interscience, 1953.
33. J. J. Hull, "A database for handwritten text recognition research," IEEE Trans. Pattern Anal. Mach. Intell., vol. 16, no. 5, pp. 550-554, May 1994.
34. B. Scholkopf and A. J. Smola, Learning With Kernels, Support Vector Machines, Regularization, Optimization, and Beyond. Cambridge, MA, USA: MIT Press, 2001.
35. J. T.-Y. Kwok and I. W.-H. Tsang, "The pre-image problem in kernel methods," IEEE Trans. Neural Netw., vol. 15, no. 6, pp. 1517-1525, Nov. 2004.
36. D. Keysers, J. Dahmen, T. Theiner, and H. Ney, "Experiments with an extended tangent distance," in Proc. ICPR, 2000, pp. 38-42.
37. P. Simard, Y. LeCun, J. S. Denker, and B. Victorri, "Transformation invariance in pattern recognition-tangent distance and tangent propagation," in Proc. Neural Netw., Tricks Trade, Book Outgrowth NIPS Workshop, 1998, pp. 239-270.
38. B. Schölkopf, P. Simard, A. J. Smola, and V. Vapnik, Prior Knowledge in Support Vector Kernels. Cambridge, MA, USA: MIT Press, 1997.
39. J. Mairal, F. Bach, J. Ponce, G. Sapiro, and A. Zisserman, "Supervised dictionary learning," CoRR, 2008, pp. 1-8.
40. P. Perona, R. Fergus, and F. F. Li, "Learning generative visual models from few training examples: An incremental bayesian approach tested on 101 object categories," in Proc. Workshop Generative Model Based Vis., 2004, pp. 1-178.
41. P. Gehler and S. Nowozin, "On feature combination for multiclass object classification," in Proc. Comput. Vis. IEEE 12th Int. Conf., Oct. 2009, pp. 221-228.
42. A. Bosch, A. Zisserman, and X. Munoz, "Representing shape with a spatial pyramid kernel," in Proc. 6th ACM Int. Conf. Image Video Retr., 2007, pp. 401-408. (Pubitemid 350229652)
43. T. Ojala, M. Pietikainen, and T. Maenpaa, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 971-987, Jul. 2002. (Pubitemid 34835471)
44. N. Pinto, D. D. Cox, and J. J. DiCarlo, "Why is real-world visual object recognition hard?" PLoS Comput. Biol., vol. 4, no. 1, pp. 1-10, 2008.
45. P. Jain, B. Kulis, and K. Grauman, "Fast image search for learned metrics," in Proc. IEEE CVPR, Jun. 2008, pp. 1-8.
46. H. Zhang, A. Berg, M. Maire, and J. Malik, "SVM-KNN: Discriminative nearest neighbor classification for visual category recognition," in Proc. IEEE Conf. CVPR, vol. 2. Feb. 2006, pp. 2126-2136. (Pubitemid 44931577)
47. G. Griffin, A. Holub, and P. Perona, "Caltech-256 object category dataset," Inst. Technol., Henrietta, NY, USA, Tech. Rep. CNS-TR-2007- 001, 2007.
48. O. Boiman, E. Shechtman, and M. Irani, "In defense of nearest-neighbor based image classification," in Proc. IEEE Conf. CVPR, Jun. 2008, pp. 1-8.
49. D.-S. Pham and S. Venkatesh, "Joint learning and dictionary construction for pattern recognition," in Proc. IEEE Conf. CVPR, Jun. 2008, pp. 1-8.
50. J. C. van Gemert, J. M. Geusebroek, C. J. Veenman, and A. W. M. Smeulders, "Kernel codebooks for scene categorization," in Proc. ECCV, 2008, pp. 696-709.
51. J. Yang, K. Yu, Y. Gong, and T. Huang, "Linear spatial pyramid matching using sparse coding for image classification," in Proc. IEEE CVPR, Jun. 2009, pp. 1794-1801.
52. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong, "Localityconstrained linear coding for image classification," in Proc. IEEE Conf. CVPR, Jun. 2010, pp. 3360-3367.
53. N. Kulkarni and B. Li, "Discriminative affine sparse codes for image classification," in Proc. IEEE Conf. CVPR, Jun. 2011, pp. 1609-1616.