Comparison of mid-level feature coding approaches and pooling strategies in visual concept detection

Computer Vision and Image Understanding

Volumn 117, Issue 5, 2013, Pages 479-492

  Koniusz, Piotr ^a   Yan, Fei ^a   Mikolajczyk, Krystian ^a  

^a UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

Analytical pooling; Bag of Words; Comparison; Locality constrained Linear Coding; Max pooling; Mid level features; Power Normalisation; Soft Assignment; Sparse Coding

Indexed keywords

ANALYTICAL POOLING; BAG OF WORDS; COMPARISON; LINEAR CODING; MAX-POOLING; MID-LEVEL FEATURES; NORMALISATION; SOFT ASSIGNMENT; SPARSE CODING;

CLASSIFICATION (OF INFORMATION); OBJECT RECOGNITION;

COMPUTER VISION;

EID: 84875920809     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2012.10.010     Document Type: Article

References (59)

1. J. Sivic, and A. Zisserman Video google: a text retrieval approach to object matching in videos ICCV 2 2003 1470 1477
2. G. Csurka, C.R. Dance, L. Fan, J. Willamowski, C. Bray, Visual categorization with bags of keypoints, in: ECCV Workshop, 2004, pp. 1-22.
3. D.G. Lowe Object recognition from local scale-invariant features CVPR 2 1999 1150 1157
4. K. Mikolajczyk, and C. Schmid A performance evaluation of local descriptors PAMI 27 2005 1615 1630
5. K.E.A. van de Sande, T. Gevers, and C.G.M. Snoek A comparison of color features for visual concept classification CIVR 2008 141 149
6. C. Cortes, and V. Vapnik Support-vector networks ML 20 1995 273 297
7. M. Tahir, J. Kittler, K. Mikolajczyk, F. Yan, K. van de Sande, T. Gevers, Visual category recognition using spectral regression and kernel discriminant analysis, in: ICCV Workshop, 2009.
8. J. van Gemert, J.-M. Geusebroek, C. Veenman, and A. Smeulders Kernel codebooks for scene categorization ECCV 5304 2008 696 709
9. J.C. van Gemert, C.J. Veenman, A.W.M. Smeulders, and J.M. Geusebroek Visual word ambiguity PAMI 2010
10. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman Lost in quantization: improving particular object retrieval in large scale image databases. CVPR 2008
11. P. Koniusz, and K. Mikolajczyk Soft assignment of visual words as linear coordinate coding and optimisation of its reconstruction error ICIP 2011
12. L. Lingqiao, L. Wang, and X. Liu In defence of soft-assignment coding ICCV 2011
13. H. Lee, A. Battle, R. Raina, and A.Y. Ng Efficient sparse coding algorithms NIPS 2007 801 808
14. J. Yang, K. Yu, Y. Gong, and T.S. Huang Linear spatial pyramid matching using sparse coding for image classification CVPR 2009 1794 1801
15. S. Mallat, and Z. Zhang Matching pursuit with time-frequency dictionaries SP 41 1993 3397 3415
16. J.A. Tropp Greed is good: algorithmic results for sparse approximation IT 50 2004 2231 2242
17. K. Yu, T. Zhang, and Y. Gong Nonlinear learning using local coordinate coding NIPS 2009
18. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong Locality-constrained linear coding for image classification CVPR 2010
19. S. Gao, I.W. Tsang, L. Chia, and P. Zhao Local features are not lonely-laplacian sparse coding for image classification CVPR 2010
20. J. Yang, K. Yu, and T. Huang Efficient highly over-complete sparse coding using a mixture model ECCV 2010 113 126
21. F. Perronnin, and C. Dance Fisher kernels on visual vocabularies for image categorization CVPR 2007 1 8
22. F. Perronnin, J. Sánchez, and T. Mensink Improving the fisher kernel for large-scale image classification ECCV 2010 143 156
23. X. Zhou, K. Yu, T. Zhang, and T.S. Huang Image classification using super-vector coding of local image descriptors ECCV 2010 141 154
24. H. Jegou, M. Douze, C. Schmid, and P. Pérez Aggregating local descriptors into a compact image representation CVPR 2010 3304 3311
25. R. Negrel, D. Picard, and P.-H. Gosselin Compact tensor based image representation for similarity search ICIP 2012
26. L. Wang Toward a discriminative codebook: codeword selection across multi-resolution CVPR 2007 1 8
27. M. Everingham, L. Van Gool, C.K.I. Williams, J. Winn, A. Zisserman, The PASCAL Visual Object Classes Challenge 2010 (VOC2010) Results, 2010. < http://pascallin.ecs.soton.ac.uk/challenges/VOC >.
28. Y. Boureau, F. Bach, Y. LeCun, and J. Ponce Learning mid-level features for recognition CVPR 2010
29. Y. Boureau, J. Ponce, and Y. LeCun A theoretical analysis of feature pooling in vision algorithms ICML 2010
30. S. Lazebnik, C. Schmid, and J. Ponce Beyond bags of features: spatial pyramid matching for recognizing natural scene categories CVPR 2 2006 2169 2178
31. Y. Boureau, N. Le Roux, F. Bach, J. Ponce, and Y. LeCun Ask the locals: multi-way local pooling for image recognition ICCV 2011
32. P. Koniusz, and K. Mikolajczyk Spatial coordinate coding to reduce histogram, representations, dominant angle and colour pyramid match ICIP 2011
33. K. Chatfield, V. Lempitsky, A. Vedaldi, and A. Zisserman The devil is in the details: an evaluation of recent feature encoding methods BMVC 2011
34. J. Yang, Y.-G. Jiang, A. G. Hauptmann, C.-W. Ngo, Evaluating bag-of-visual-words representations in scene classification, in: CVIR Workshop, 2007, pp. 197-206.
35. A. Coates, and A. Ng The importance of encoding versus training with sparse coding and vector quantization ICML 2011 921 928
36. I. Tosic, and P. Frossard Dictionary learning SPM 28 2011 27 38
37. T. Liu, A.W. Moore, A. Gray, and K. Yang An investigation of practical approximate nearest neighbor algorithms NIPS 2004 825 832
38. T. Tuytelaars, and C. Schmid Vector quantizing feature space with a regular lattice ICCV 2007
39. J. Bilmes, A Gentle Tutorial of the EM Algorithm and its Application to Parameter Estimation for Gaussian Mixture and Hidden Markov Models, typeTechnical, Report, 1998.
40. B. Efron, T. Hastie, I. Johnstone, and R. Tibshirani Least angle regression Annals of Statistics 32 2004 407 499
41. J. Mairal, F. Bach, J. Ponce, and G. Sapiro Online learning for matrix factorization and sparse coding JMLR 2010
42. The mosek optimization software, 2012. < http://www.mosek.com >.
43. S. Boughorbel, J.-P. Tarel, and N. Boujemaa Generalized histogram intersection kernel for image recognition ICIP 2005 161 164
44. H. Jégou, M. Douze, and C. Schmid On the burstiness of visual elements CVPR 2009 1169 1176
45. T. Jebara, R. Kondor, and A. Howard Probability product kernels JMLR 5 2004 819 844
46. L. Fei-fei, R. Fergus, P. Perona, Learning generative visual models from few training examples: an incremental bayesian approach tested on 101 object categories, in: CVPR Workshop on Generative-Model Based Vision, 2004.
47. M.E. Nilsback, and A. Zisserman Automated flower classification over a large number of classes ICVGIP 2008 722 729
48. S. Nowak, K. Nagel, and J. Liebetra The CLEF 2011 photo annotation and concept-based retrieval tasks CLEF 2011
49. M.J. Huiskes, and M.S. Lew The MIR flickr retrieval evaluation MIR 2008 39 43
50. M.J. Huiskes, B. Thomee, and M.S. Lew New trends and ideas in visual concept detection: the MIR flickr retrieval evaluation initiative MIR 2010 527 536
51. M.A. Tahir, F. Yan, M. Barnard, M. Awais, K. Mikolajczyk, and J. Kittler The university of surrey visual concept detection system at imageclef 2010: working notes ICPR 2010
52. J. Yang, Y. Tian, L.-Y. Duan, T. Huang, and W. Gao Group-sensitive multiple kernel learning for object recognition TIP 21 2012 2838 2852
53. N. Kulkarni, and B. Li Discriminative affine sparse codes for image classification CVPR 2011 1609 1616
54. A. Bosch, A. Zisserman, and X. Munoz Image classification using random forests and ferns ICCV 2007
55. O. Duchenne, A. Joulin, and J. Ponce A graph-matching kernel for object categorization ICCV 2011
56. J. Liu, C. Zhang, Q. Tian, C. Xu, H. Lu, and S. Ma One step beyond bags of features: visual categorization using components ICIP 2011
57. F. Yan, K. Mikolajczyk, M. Barnard, H. Cai, and J. Kittler Lp norm multiple kernel fisher discriminant analysis for object and image categorisation CVPR 2010
58. A. Binder, W. Samek, and M. Kawanabe The joint submission of the tu berlin and fraunhofer first (tubfi) to the imageclef2011 photo annotation task: Working notes CLEF 2011
59. Y. Su, and F. Jurie Semantic contexts and fisher vectors for the imageclef 2011 photo annotation task CLEF 2011