Spatial pooling of heterogeneous features for image classification

IEEE Transactions on Image Processing

Volumn 23, Issue 5, 2014, Pages 1994-2008

  Xie, Lingxi ^a   Tian, Qi ^b   Wang, Meng ^c   Zhang, Bo ^a  

^a TSINGHUA UNIVERSITY   (China)

^b University of Texas at San Antonio   (United States)

^c HEFEI UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

BoF model; complementary descriptors; geometric phrases pooling; Image classification; spatial weighting

Indexed keywords

ALGORITHMS;

COMPLEMENTARY FEATURES; DESCRIPTOR EXTRACTIONS; DESCRIPTORS; GEOMETRIC PHRASES POOLING; HETEROGENEOUS FEATURES; SPATIAL CONTEXT MODELING; SPATIAL WEIGHTING; STATE-OF-THE-ART METHODS;

IMAGE CLASSIFICATION;

EID: 84898053449     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2310117     Document Type: Article

References (52)

1. G. Csurka, C. Dance, L. Fan, J. Willamowski, and C. Bray, "Visual Categorization with Bags of Keypoints," in Proc. Workshop Statist. Learn. Comput. Vis., Eur. Con. Comput. Vis., 2004, pp. 1-22.
2. M. Marszalek and C. Schmid, "Spatial weighting for bag-of-features," in Proc. Comput. Vis. Pattern Recognit., 2006, pp. 2118-2125. (Pubitemid 44931576)
3. E. Nowak, F. Jurie, and B. Triggs, "Sampling strategies for bag-offeatures image classification," in Proc. Comput. Vis. Pattern Recognit., 2006, pp. 490-503. (Pubitemid 44029653)
4. Y. Cao, C. Wang, Z. Li, L. Zhang, and L. Zhang, "Spatial-bag- offeatures," in Proc. Comput. Vis. Pattern Recognit., 2010, pp. 3352-3359.
5. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
6. D. Nister and H. Stewenius, "Scalable recognition with a vocabulary tree," in Proc. Comput. Vis. Pattern Recognit., 2006, pp. 2161-2168. (Pubitemid 44931581)
7. Y. Lu, L. Zhang, J. Liu, and Q. Tian, "Constructing lexica of high-level concepts with small semantic gap," IEEE Trans. Multimedia, vol. 12, no. 4, pp. 288-299, Jul. 2010.
8. J. Yuan, Y. Wu, and M. Yang, "Discovery of collocation patterns: From visual words to visual phrases," in Proc. Comput. Vis. Pattern Recognit., 2007, pp. 1-8.
9. A. Bosch, A. Zisserman, and X. Muoz, "Image classification using random forests and ferns," in Proc. 11th Comput. Vis. Pattern Recognit., 2007, pp. 1-8.
10. Y.-L. Boureau, F. Bach, Y. LeCun, and J. Ponce, "Learning mid-level features for recognition," in Proc. Comput. Vis. Pattern Recognit., 2010, pp. 2559-2566.
11. Y. Zhang, Z. Jia, and T. Chen, "Image retrieval with geometry-preserving visual phrases," in Proc. Comput. Vis. Pattern Recognit., 2011, pp. 809-816.
12. J. Feng, B. Ni, Q. Tian, and S. Yan, "Geometric-p-norm feature pooling for image classification," in Proc. Comput. Vis. Pattern Recognit., 2011, pp. 2609-2704.
13. M. Ruzon and C. Tomasi, "Color edge detection with the compass operator," in Proc. Comput. Vis. Pattern Recognit., 1999, pp. 160-166.
14. J. Canny, "A computational approach to edge detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 8, no. 6, pp. 679-698, Jun. 1986.
15. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. Comput. Vis. Pattern Recognit., 2006, pp. 2169-2178. (Pubitemid 44931582)
16. L. Xie, Q. Tian, and B. Zhang, "Spatial pooling of heterogeneous features for image applications," in Proc. 20th ACM Multimedia, 2012, pp. 539-548.
17. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. Comput. Vis. Pattern Recognit., 2005, pp. 886-893. (Pubitemid 43897286)
18. J. Matas, O. Chum, M. Urban, and T. Pajdla, "Robust wide-baseline stereo from maximally stable extremal regions," Image Vis. Comput., vol. 22, no. 10, pp. 761-767, 2004.
19. A. Bosch, A. Zisserman, and X. Munoz, "Scene classification via pLSA," in Proc. Int. Conf. Comput. Vis., 2006, pp. 517-530. (Pubitemid 44029655)
20. K. Van De Sande, T. Gevers, and C. Snoek, "Evaluating color descriptors for object and scene recognition," IEEE Tran. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1582-1596, Sep. 2010.
21. D. Li, L. Yang, X. Hua, and H. Zhang, "Large-scale robust visual codebook construction," in Proc. ACM Multimedia, 2010, pp. 1183-1186.
22. Q. Tian, S. Zhang, W. Zhou, R. Ji, B. Ni, and N. Sebe, "Building descriptive and discriminative visual codebook for large-scale image applications," Multimedia Tools Appl., vol. 51, no. 2, pp. 441-477, 2011.
23. S. Zhang, Q. Huang, G. Hua, S. Jiang, W. Gao, and Q. Tian, "Building contextual visual vocabulary for large-scale image applications," in Proc. Int. Conf. Multimedia, 2010, pp. 501-510.
24. H. Lee, A. Battle, R. Raina, and A. Ng, "Efficient sparse coding algorithms," in Proc. Neural Inf. Process. Syst., 2007, pp. 801-805.
25. J. Yang, K. Yu, Y. Gong, and T. Huang, "Linear spatial pyramid matching using sparse coding for image classification," in Proc. Comput. Vis. Pattern Recognit., 2009, pp. 1794-1801.
26. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong, "Localityconstrained linear coding for image classification," in Proc. Comput. Vis. Pattern Recognit., 2010, pp. 3360-3367.
27. W. Zhou, Y. Lu, H. Li, Y. Song, and Q. Tian, "Spatial coding for large scale partial-duplicate web image search," in Proc. Int. Conf. Multimedia, 2010, pp. 511-520.
28. L. Xie, J. Wang, B. Zhang, and Q. Tian, "Orientational pyramid matching for recognizing indoor scenes," in Proc. Comput. Vis. Pattern Recognit., 2014, pp. 1-4.
29. L. Fei-Fei, R. Fergus, and P. Perona, "Learning generative visual models from few training examples: An incremental bayesian approach tested on 101 object categories," Comput. Vis. Image Understand., vol. 106, no. 1, pp. 59-70, 2007. (Pubitemid 46528761)
30. D. Liu, G. Hua, P. Viola, and T. Chen, "Integrated feature selection and higher-order spatial feature extraction for object categorization," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
31. S. Zhang, Q. Tian, G. Hua, Q. Huang, and S. Li, "Descriptive visual words and visual phrases for image applications," in Proc. 17th ACM Int. Conf. Multimedia, 2009, pp. 75-84.
32. J. Yuan, M. Yang, and Y. Wu, "Mining discriminative co-occurrence patterns for visual recognition," in Proc. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 2777-2784.
33. L. Xie, Q. Tian, and B. Zhang, "Feature normalization for part-based image classification," in Proc. Int. Conf. Image Process., 2013, pp. 1-3.
34. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin, "LIBLINEAR: A library for large linear classification," J. Mach. Learn. Res., 2008, pp. 1817-1874.
35. F. Perronnin, J. Sánchez, and T. Mensink, "Improving the fisher kernel for large-scale image classification," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 143-156.
36. M. Nilsback and A. Zisserman, "A visual vocabulary for flower classification," in Proc. Comput. Vis. Pattern Recognit., 2006, pp. 1447-1454. (Pubitemid 44931490)
37. C. Wah, S. Branson, P. Welinder, P. Perona, and S. Belongie, "The caltech-UCSD birds-200-2011 dataset," California Inst. Technol., Pasadena, CA, USA, Tech. Rep. CNS-TR-2011-001, 2011.
38. L. Xie, Q. Tian, R. Hong, S. Yan, and B. Zhang, "Hierarchical part matching for fine-grained visual categorization," in Proc. Int. Conf. Comput. Vis., 2013, pp. 1-8.
39. Y. Chai, V. Lempitsky, and A. Zisserman, "Symbiotic segmentation and part localization for fine-grained categorization," in Proc. Int. Conf. Comput. Vis., 2013, pp. 1-10.
40. E. Gavves, B. Fernando, C. Snoek, A. Smeulders, and T. Tuytelaars, "Fine-grained categorization by alignments," in Proc. Int. Conf. Comput. Vis., 2013, pp. 1-10.
41. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, 1998. (Pubitemid 128742001)
42. A. Vedaldi and B. Fulkerson, "VLFeat: An open and portable library of computer vision algorithms," in Proc. Multimedia, 2010, pp. 1469-1472.
43. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman, "The PASCAL visual object classes challenge 2007 (VOC2007) results," 2011.
44. G. Griffin, A. Holub, and P. Perona, "Caltech-256 object category dataset," California Inst. Technol., Pasadena, CA, USA, Tech. Rep. CNSTR-2007-001, 2007.
45. S. Gao, I. Tsang, and L. Chia, "Kernel sparse representation for image classification and face recognition," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 1-14.
46. S. Lazebnik, C. Schmid, and J. Ponce, "Semi-local affine parts for object recognition," in Proc. Brit. Mach. Vis. Conf., 2004, pp. 959-968.
47. D. Larlus and F. Jurie, "Latent mixture vocabularies for object categorization and segmentation," Image Vis. Comput., vol. 27, no. 5, pp. 523-534, 2009.
48. P. Gehler and S. Nowozin, "On feature combination for multiclass object classification," in Proc. 12th Int. Conf. Comput. Vis., 2009, pp. 221-228.
49. L. Li, H. Su, E. Xing, and L. Fei-Fei, "Object bank: A high-level image representation for scene classification and semantic feature sparsification," Neuron Inf. Process. Syst., 2010, pp. 1-3.
50. A. Quattoni and A. Torralba, "Recognizing indoor scenes," in Proc. Comput. Vis. Pattern Recognit., 2009, pp. 413-420.
51. L. Bo, X. Ren, and D. Fox, "Hierarchical matching pursuit for image classification: Architecture and fast algorithms," Neural Inf. Process. Syst., vol. 1, no. 2, pp. 1-6, 2011.
52. S. Belongie, J. Malik, and J. Puzicha, "Shape matching and object recognition using shape contexts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 4, pp. 509-522, Apr. 2002. (Pubitemid 34448769)