Image classification with densely sampled image windows and generalized adaptive multiple kernel learning

IEEE Transactions on Cybernetics

Volumn 45, Issue 3, 2015, Pages 381-390

  Yan, Shengye ^a   Xu, Xinxing ^b   Xu, Dong ^b   Lin, Stephen ^c   Li, Xuelong ^d  

^a NANJING UNIVERSITY OF INFORMATION SCIENCE AND TECHNOLOGY   (China)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^c MICROSOFT RESEARCH   (United States)

^d XI AN INSTITUTE OF OPTICS AND PRECISION MECHANICS   (China)

Author keywords

Adapted classifier; image classification; multiple kernel learning; Spatial pyramid

Indexed keywords

ASPECT RATIO; CLASSIFICATION (OF INFORMATION); GENETIC ALGORITHMS; LEARNING ALGORITHMS; OBJECT RECOGNITION;

ADAPTED CLASSIFIERS; BENCHMARK DATASETS; LEVEL OF ABSTRACTION; MULTIPLE KERNEL LEARNING; REDUCED SENSITIVITY; SCENE RECOGNITION; SPATIAL PYRAMIDS; STATE OF THE ART;

IMAGE CLASSIFICATION;

EID: 85027917792     PISSN: 21682267     EISSN: 21682275     Source Type: Journal    
DOI: 10.1109/TCYB.2014.2326596     Document Type: Article

References (50)

1. G. Csurka, C. R. Dance, L. Fan, J. Willamowski, and C. Bray, "Visual categorization with bags of keypoints," in Proc. Workshop Stat. Learn. Comput. Vis., ECCV, 2004, pp. 1-22.
2. B. Fernandes, G. Cavalcanti, and T. I. Ren, "Lateral inhibition pyramidal neural network for image classification," IEEE Trans. Cybern., vol. 43, no. 6, pp. 2082-2092, Dec. 2013.
3. H. Li, Y. Wei, L. Li, and C. L. P. Chen, "Hierarchical feature extraction with local neural response for image recognition," IEEE Trans. Cybern., vol. 43, no. 2, pp. 412-424, Apr. 2013.
4. S. Lazebnik, C. Schmid, and J. Poncer, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2006, pp. 2169-2178.
5. Y.-L. Boureau, F. Bach, Y. LeCun, and J. Ponce, "Learning mid-level features for recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., San Francisco, CA, USA, 2010, pp. 2559-2566.
6. Y. Yang and S. Newsam, "Spatial pyramid co-occurrence for image classification," in Proc. IEEE ICCV, Barcelona, Spain, 2011, pp. 1465-1472.
7. J. Yang, K. Yu, Y. Gong, and T. S. Huang, "Linear spatial pyramid matching using sparse coding for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2009, pp. 1794-1801.
8. Y. Huang, K. Huang, Y. Yu, and T. Tan, "Salient coding for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA, 2011, pp. 1753-1760.
9. L. Liu, L. Wang, and X. Liu, "In defense of soft-assignment coding," in Proc. IEEE Int. Conf. Comput. Vis., Barcelona, Spain, 2011, pp. 2486-2493.
10. J. Feng, B. Ni, Q. Tian, and S. Yan, "Geometric-p-norm feature pooling for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA, 2011, pp. 2697-2704.
11. T. Chen and K.-H. Yap, "Discriminative BoW framework for mobile landmark recognition," IEEE Trans. Cybern., vol. 44, no. 5, pp. 695-706, May 2014.
12. T. Harada, Y. Ushiku, Y. Yamashita, and Y. Kuniyoshi, "Discriminative spatial pyramid," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2011, pp. 1617-1624.
13. S. Yan, S. Shan, X. Chen, W. Gao, and J. Chen, "Locally assembled binary (LAB) feature with feature-centric cascade for fast and accurate face detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Anchorage, AK, USA, 2008, pp. 874-879.
14. K. Zhang, L. Zhang, and M.-H. Yang, "Fast compressive tracking," IEEE Trans. Pattern Anal. Mach. Intell., 2014, to be published.
15. D. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
16. M. Varma and D. Ray, "Learning the discriminative power-invariance trade-off," in Proc. IEEE Int. Conf. Comput. Vis., Rio de Janeiro, Brazil, 2007, pp. 1-8.
17. J. Yang, Y. Li, Y. Tian, L. Duan, and W. Gao, "Group-sensitive multiple kernel learning for object categorization," in Proc. IEEE Int. Conf. Comput. Vis., Kyoto, Japan, 2009, pp. 436-443.
18. L. Duan, I. W. Tsang, and D. Xu, "Domain transfer multiple kernel learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 3, pp. 465-479, Mar. 2012.
19. X. Wu, D. Xu, L. Duan, and J. Luo, "Action recognition using context and appearance distribution features," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA, 2011, pp. 489-496.
20. G. Griffin, A. Holub, and P. Perona, "Caltech-256 object category dataset," California Instit. Technol., Pasadena, CA, USA, Tech. Rep. CNS-TR-2007-001, 2007.
21. F.-F. Li, R. Fergus, and P. Perona, "Learning generative visual models from few training examples: An incremental Bayesian approach tested on 101 object categories," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2004, pp. 59-70.
22. S. Yan, X. Xu, D. Xu, S. Li, and X. Li, "Beyond spatial pyramids: A new feature extraction framework with dense spatial sampling for image classification," in Proc. ECCV, Florence, Italy, 2012, pp. 473-487.
23. J. Wu and J. M. Rehg, "Beyond the Euclidean distance: Creating effective visual codebooks using the histogram intersection kernel," in Proc. IEEE Int. Conf. Comput. Vis., Kyoto, Japan, 2009, pp. 630-637.
24. M. Marszaek, C. Schmid, H. Harzallah, and J. Van DeWeijer, "Learning object representations for visual object class recognition," in Proc. IEEE Vis. Recognit. Chall. Workshop ICCV, Oct. 2007.
25. X. Zhou, K. Yu, T. Zhang, and T. S. Huang, "Image classification using super-vector coding of local image descriptors," in Proc. Euro. Conf. Comput. Vis., Heraklion, Greece, 2010, pp. 141-154.
26. J. Yang, K. Yu, and T. S. Huang, "Efficient highly over-complete sparse coding using a mixture model," in Proc. ECCV, Heraklion, Greece, 2010, pp. 113-126.
27. F. Perronnin, J. Sánchez, and T. Mensink, "Improving the fisher kernel for large-scale image classification," in Proc. ECCV, Heraklion, Greece, 2010, pp. 143-156.
28. X. Wang, X. Bai, W. Liu, and L. J. Latecki, "Feature context for image classification and object detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA, 2011, pp. 961-968.
29. Y. Jia, C. Huang, and T. Darrell, "Beyond spatial pyramids: Receptive field learning for pooling image features," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA, 2012, pp. 3370-3377.
30. N. Kulkarni and B. Li, "Discriminative affine sparse codes for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA, 2011, pp. 1609-1616.
31. Y.-L. Boureau, N. L. Roux, and F. Bach, "Ask the locals: Multi-way local pooling for image recognition," in Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 2651-2658.
32. A. Bosch, A. Zisserman, and X. Munoz, "Image classification using random forests and ferns," in Proc. IEEE Int. Conf. Comput. Vis., Rio de Janeiro, Brazil, 2007, pp. 1-8.
33. A. Agarwal and B. Triggs, "Multilevel image coding with hyperfeatures," Int. J. Comput. Vis., vol. 78, no. 1, pp. 15-27, Jun. 2008.
34. A. Kovashka and K. Grauman, "Learning a hierarchy of discriminative space-time neighborhood features for human action recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., San Francisco, CA, USA, 2010, pp. 2046-2053.
35. L.-J. Li, H. Su, E. P. Xing, and L. Fei-Fei, "Object bank: A highlevel image representation for scene classification & semantic feature sparsification," in Proc. NIPS, 2010, pp. 1378-1386.
36. L. Torresani, M. Szummer, and A. Fitzgibbon, "Efficient object category recognition using classemes," in Proc. ECCV, 2010, pp. 776-789.
37. Y. Su and F. Jurie, "Visual word disambiguation by semantic contexts," in Proc. IEEE Int. Conf. Comput. Vis., Barcelona, Spain, 2011, pp. 311-318.
38. O. Duchenne, A. Joulin, and J. Ponce, "A graph-matching kernel for object categorization," in Proc. IEEE Int. Conf. Comput. Vis., Barcelona, Spain, 2011, pp. 1792-1799.
39. O. Boiman, E. Shechtman, and M. Irani, "In defense of nearest-neighbor based image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Anchorage, AK, USA, 2008, pp. 1-8.
40. P. Gehler and S. Nowozin, "On feature combination for multiclass object classification," in Proc. IEEE Int. Conf. Comput. Vis., Kyoto, Japan, 2009, pp. 221-228.
41. L. Bo and C. Sminchisescu, "Efficient match kernels between sets of features for visual recognition," in Proc. NIPS, 2009, pp. 135-143.
42. L. Duan, D. Xu, I. W.-H. Tsang, and J. Luo, "Visual event recognition in videos by learning from web data," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 9, pp. 1667-1680, Dec. 2012.
43. L. Chen, D. Xu, I. W. Tsang, and J. Luo, "Tag-based image retrieval improved by augmented features and group-based refinement," IEEE Trans. Multimedia, vol. 14, no. 4, pp. 1057-1067, Aug. 2012.
44. M. Kloft, U. Brefeld, S. Sonnenburg, and A. Zien, "-p-norm multiple kernel learning," J. Mach. Learn. Res., vol. 12, pp. 663-709, Jul. 2011.
45. X. Xu, I. W. Tsang, and D. Xu, "Soft margin multiple kernel learning," IEEE Trans. Neural Netw. Learning Syst., vol. 24, no. 5, pp. 749-761, May 2013.
46. J. Wang et al., "Locality-constrained linear coding for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., San Francisco, CA, USA, 2010, pp. 3360-3367.
47. J. Xiao, J. Hays, K. A. Ehinger, A. Oliva, and A. Torralba, "Sun database: Large-scale scene recognition from abbey to zoo," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., San Francisco, CA, USA, 2010, pp. 3485-3492.
48. T. Ojala, M. Pietikainen, and T. Maenpaa, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 971-987, Jul. 2002.
49. X. Xu, I. W. Tsang, and D. Xu, "Handling ambiguity via input-output kernel learning," in Proc. ICDM, Brussels, Belgium, 2012, pp. 725-734.
50. C.-C. Chang and C.-J. Lin, "LIBSVM: A library for support vector machines," ACM Trans. Intell. Syst. Tech., vol. 2, no. 3, Apr. 2011.