Feature representation for statistical-learning-based object detection: A review

Pattern Recognition

Volumn 48, Issue 11, 2015, Pages 3542-3559

  Li, Yali ^a,b   Wang, Shengjin ^a,b   Tian, Qi ^c   Ding, Xiaoqing ^a,b  

^a TSINGHUA UNIVERSITY   (China)

^b TSINGHUA NATIONAL LABORATORY FOR INFORMATION SCIENCE AND TECHNOLOGY   (China)

^c One UTSA Circle   (United States)

Author keywords

Dimension reduction; Feature combination; Feature learning; Feature representation; Object detection

Indexed keywords

COMPUTATIONAL EFFICIENCY; COMPUTER VISION; DRAWING (GRAPHICS); OBJECT DETECTION; OBJECT RECOGNITION; SEMANTICS;

DIMENSION REDUCTION; FEATURE COMBINATION; FEATURE LEARNING; FEATURE REPRESENTATION; OBJECT DETECTION METHOD; STATISTICAL LEARNING; VISUAL PROPERTIES; VISUAL REPRESENTATIONS;

FEATURE EXTRACTION;

EID: 84937811514     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2015.04.018     Document Type: Article

References (117)

1. A. Andreopoulos, and J.K. Tsotsos 50 years of object recognition: directions forward Comput. Vis. Image Underst. 117 2013 827 891
2. D. Lowe Distinctive image features from scale-invariant keypoints Int. J. Comput. Vis. 60 2 2004 91 110
3. Y. Ke, R. Sukthankar, Pca-sift: a more distinctive representation for local image descriptors, in: CVPR, 2004, pp. 506-513.
4. S. Lazebnik, C. Schmid, J. Ponce, Semi-local affine parts for object recognition, in: BMVC, 2004, pp. 779-788.
5. K. Mikolajczyk, and C. Schmid A performance evaluation of local descriptors IEEE Trans. Pattern Anal. Mach. Intell. 27 10 2005 1615 1630
6. H. Bay, A. Ess, T. Tuytelaars, and L.V. Gool Surf: speeded up robust features Comput. Vis. Image Underst. 110 3 2008 346 359
7. E. Tola, V. Lepetit, and P. Fua Daisy: an efficient dense descriptor applied to wide baseline stereo IEEE Trans. Pattern Anal. Mach. Intell. 32 5 2010 815 830
8. A. Torralba, A. Oliva, M. Castelhano, and J. Henderson Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search Psychol. Rev. 113 4 2006 766 786
9. G. Takacs, V. Chandrasekhar, S. Tsai, D. Chen, R. Grzeszczuk, B. Girod, Unified real-time tracking and recognition with rotation invariant fast features, in: CVPR, 2010, pp. 934-941.
10. J. Chen, S. Shan, C. He, G. Zhao, M. Pietikainen, X. Chen, and W. Gao Wld: a robust local image descriptor IEEE Trans. Pattern Anal. Mach. Intell. 32 9 2010 1705 1719
11. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: CVPR, vol. 1, 2005, pp. 886-893.
12. P. Felzenszwalb, R. Girshick, D. McAllester, and D. Ramanan Object detection with discriminatively trained part based models IEEE Trans. Pattern Anal. Mach. Intell. 32 9 2010 1627 1645
13. F. Porikli, Integral histogram: a fast way to extract histograms in cartesian spaces, in: CVPR, vol. 1, 2005, pp. 829-836.
14. Q. Zhu, S. Avidan, M.C. Yeh, K.T. Cheng, Fast human detection using a cascade of histograms of oriented gradients, in: CVPR, 2006, pp. 1491-1498.
15. R. Xu, B. Zhang, Q. Ye, J. Jiao, Cascaded l1-norm minimization learning (clml) classifier for human detection, in: ECCV, 2010, pp. 196-209.
16. T. Watanabe, S. Ito, K. Yokoi, Co-occurrence histograms of oriented gradients for pedestrian detection, in: PSIVT, 2009.
17. S. Maji, A. Berg, J. Malik, Classification using intersection kernel support vector machines is efficient, in: CVPR, 2008, pp. 1-8.
18. A. Sibiryakov, Fast and high-performance template matching method, in: CVPR, 2011, pp. 1417-1424.
19. B. Hariharan, J. Malik, D. Ramanan, Discriminative decorrelation for clustering and classification, in: ECCV, 2012, pp. 459-472.
20. R. Rautkorpi, J. Iivarinen, A novel shape feature for image classification and retrieval, in: ICIAR, Part I. Lecture Notes in Computer Science, vol. 3211, 2004, pp.753-760.
21. K. Levi, Y.Weiss, Learning object detection from a small number of examples: the importance of good features, in: CVPR, 2004, pp. 91-110.
22. S. Hinterstoisser, V. Lepetit, S. Ilic, P. Fua, N. Navab, Dominant orientation templates for real-time detection of texture-less objects, in: CVPR, 2010, pp. 2257-2264.
23. L. Bourdev, J. Malik, Poselets: body part detectors trained using 3d human pose annotations, in: ICCV, 2009, pp. 1365-1372.
24. L. Bourdev, S. Maji, T. Brox, J. Malik, Detecting people using mutually consistent poselet activations, in: ECCV, 2010, pp. 168-181.
25. TH. Pirsiavash, D. Ramanan, Steerable part models, in: CVPR, 2012, pp. 3226-3233.
26. H. Song, S. Zickler, T. Althoff, R. Girshick, M. Fritz, C. Geyer, P. Felzenszwalb, T. Darrell, Sparselet models for efficient multiclass object detection, in: ECCV, 2012, pp. 802-815.
27. R. Girshick, H. O. Song, T. Darrell, Discriminatively activated sparselets, in: ICML, 2013, pp. 196-204.
28. I. Kokkinos, Shufflets: shared mid-level parts for fast object detection, in: ICCV, 2013, pp. 1393-1400.
29. X.Wang, M. Yang, S. Zhu, Y. Lin, Regionlets for generic object detection, in: ICCV, 2013, pp. 17-24.
30. A.K. Jain, N.K. Ratha, and S. Lakshmanan Object detection using Gabor filters Pattern Recognit. 1997 295 309
31. T. Ojala, M. Pietikainen, and T. Maenpaa Multi-resolution gray-scale and rotation invariant texture classification with local binary patterns IEEE Trans. Pattern Anal. Mach. Intell. 24 7 2002 971 986
32. M. Heikkila, M. Pietikainen, and C. Schmid Description of interest regions with local binary patterns Pattern Recognit. 42 3 2009 425 436
33. D.T. Nguyen, P.O. Ogunbona, and W. Li A novel shape-based non-redundant local binary pattern descriptor for object detection Pattern Recognit. 46 2013 1485 1500
34. Y. Mu, S. Yan, Y. Liu, T. Huang, B. Zhou, Discriminative local binary patterns for human detection in personal album, in: CVPR, 2008, pp. 1-8.
35. N. Armanfard, M. Komeili, and E. Kabir Ted: A texture-edge descriptor for pedestrian detection in video sequences Pattern Recognit. 45 2012 983 992
36. C. K. Heng, S. Yokomitsu, Y. Matsumoto, H. Tamura, Shrink boost for selecting multi-lbp histogram features in object detection, in: CVPR, 2012, pp. 3250-3257.
37. X. Qi, R. Xiao, J. Guo, L. Zhang, Pairwise rotation invariant cooccurrence local binary pattern, in: ECCV, 2012, pp. 158-171.
38. P. Viola, and M. Jones Robust real-time object detection Int. J. Comput. Vis. 57 2 2002 137 154
39. R. Lienhart, J. Maydt, An extended set of haar-like features for rapid object detection, in: ICPR, 2002, pp. 900-903.
40. C. Huang, H. Ai, Y. Li, and S. Lao High-performance rotation invariant multiview face detection IEEE Trans. Pattern Anal. Mach. Intell. 29 4 2007 671 686
41. M.T. Pham, Y. Gao, V. Dung, D. Hoang, T.J. Cham, Fast polygonal integration and its application in extending haar-like features to improve object detection, in: CVPR, 2010, pp. 942-949.
42. W. Zheng, L. Liang, Fast car detection using image strip features, in: CVPR, 2009, pp. 2703-2710.
43. S. Yan, S. Shan, X. Chen, W. Gao, Locally assembled binary (lab) feature with feature-centric cascade for fast and accurate face detection, in: CVPR, 2008, pp. 1-7.
44. A. Roy, S. Marcel, Haar local binary pattern feature for fast illumination invariant face detection, in: BMVC, 2009.
45. M.P. Kumar, A. Zisserman, P.H. Torr, Efficient discriminative learning of parts-based models, in: ICCV, 2009, pp. 552-559.
46. J. Gall, A. Yao, N. Razavi, L.V. Gool, and V. Lempitsky Hough forests for object detection, tracking, and action recognition IEEE Trans. Pattern Anal. Mach. Intell. 33 11 2011 2188 2202
47. S. Belongie, J. Malik, and J. Puzicha Shape matching and object recognition using shape contexts IEEE Trans. Pattern Anal. Mach. Intell. 24 24 2002 509 521
48. P. Srinivasan, J. Shi, Bottom-up recognition and parsing of the human body, in: CVPR, 2007, pp. 1-8.
49. T. Ma, L.J. Latecki, From partial shape matching through local deformation to robust global shape similarity for object detection, in: CVPR, 2011, pp. 1441-1448.
50. H. Riemenschneider, M. Donoser, H. Bischof, Using partial edge contour matches for efficient object category localization, in: ECCV, 2009, pp. 29-42.
51. P. Kontschieder, H. Riemenschneider, M. Donoser, H. Bischof, Discriminative learning of contour fragments for object detection, in: BMVC, 2011, pp. 1-12.
52. V. Ferrari, L. Fevrier, F. Jurie, and C. Schmid Groups of adjacent contour segments for object detection IEEE Trans. Pattern Anal. Mach. Intell. 30 1 2008 36 51
53. X. Ren, Learning and matching line aspects for articulated objects, in: CVPR, 2007, pp. 1-8.
54. A.Y.S. Chia, S. Rahardja, D. Rajan, M.K. Leung, Object recognition by discriminative combinations of line segments and ellipses, in: CVPR, 2010, pp. 2225-2232.
55. F. Tombari, A. Franchi, L.D. Stefano, Bold features to detect texture-less objects, in: ICCV, 2013, pp. 1265-1272.
56. C. Beleznai, H. Bischof, Fast human detection in crowded scenes by contour integration and local shape estimation, in: CVPR, 2009, pp. 2246-2253.
57. A. Opelt, A. Pinz, A. Zisserman, A boundary-fragment-model for object detection, in: ECCV, 2006, pp. 575-588.
58. V. Sharma, J. Davis, Integrating appearance and motion cues for simultaneous detection and segmentation of pedestrians, in: ICCV, 2007, pp. 1-8.
59. J. Shotton, J. Winn, C. Rother, and A. Criminisi Textonboost for image understanding: multi-class object recognition and segmentation by jointly modeling texture, layout and context Int. J. Comput. Vis. 81 2008 2 23
60. X. Wang, X. Bai, T. Ma, W. Liu, L.J. Latecki, Fan shape model for object detection, in: CVPR, 2012, pp. 151-158.
61. T. Kadir, and M. Brady Saliency, scale and image description Int. J. Comput. Vis. 45 2 2001 83 105
62. T. Kadir, A. Zisserman, M. Brady, An affine invariant salient region detector, in: ECCV, 2004, pp. 228-241.
63. C. Palm Color texture classification by integrative co-occurrence matrices Pattern Recognit. 37 5 2004 965 976
64. R. Haralick, K. Shanmugam, and I. Dinstein Texture features for image classification IEEE Trans. Syst. Man Cybern. 3 6 1973 610 621
65. A. Vadivel, A. ShamikSural, and K. Majumdar An integrated color and intensity co-occurrence matrix Pattern Recognit. Lett. 28 8 2007 974 983
66. S.Walk, N. Majer, K. Schindler, B. Schiele, New features and insights for pedestrian detection, in: CVPR, 2010, pp. 1030-1037.
67. E. Shechtman, M. Irani, Matching local self-similarities across images and videos, in: CVPR, 2007, pp. 561-568.
68. T. Deselaers, V. Ferrari, Global and efficient self-similarity for object classification and detection, in: CVPR, 2010, pp. 1633-1640.
69. O. Tuzel, F. Porikli, P. Meer, Human detection via classification on Riemannian manifolds, in: CVPR, 2007, pp. 1-8.
70. G.J. Burghouts, and J.M. Geusebroek Performance evaluation of local colour invariant Comput. Vis. Image Underst. 113 2009 48 62
71. A. Bosch, A. Zisserman, and X. Munoz Scene classification using a hybrid generative/discriminative approach IEEE Trans. Pattern Anal. Mach. Intell. 30 4 2008 712 727
72. J. van de Weijer, C. Schmid, Coloring local feature extraction, in: ECCV, 2006, pp. 334-348.
73. K. van de Sande, T. Gevers, and C.G.M. Snoek Evaluating color descriptors for object and scene recognition IEEE Trans. Pattern Anal. Mach. Intell. 32 9 2010 1582 1596
74. J. van de Weijer, C. Schmid, J.J. Verbeek, and D. Larlus Learning color names for real-world applications IEEE Trans. Image Process. 18 7 2009 1512 1524
75. F.S. Khan, R.M. Anwer, J. van de Weijer, Color attributes for object detection, in: CVPR, 2012, pp. 3306-3313.
76. R. Khan, J. van de Weijer, F.S. Khan, D. Muselet, C. Ducottet, C. Barat, Discriminative color descriptors, in: CVPR, 2013, pp. 2866-2873.
77. A. Krizhevsky, H. Sutskever, G.E. Hinton, Imagenet classification with deep convolutional neural networks, in: NIPS, 2012, pp. 1097-1105.
78. J. Donahue, Y. Jia, O. Vinyals, J. Hoffman, N. Zhang, E. Tzeng, T. Darrell, Decaf: a deep convolutional activation feature for generic visual recognition, arXiv:1310.1531.
79. R. Girshick, J. Donahue, T. Darrell, J. Malik, Rich feature hierarchies for accurate object detection and semantic segmentation, in: CVPR, 2014, pp. 580-587.
80. P. Sermanet, D. Eigen, X. Zhang, M. Mathieu, R. Fergus, Y. LeCun, Overfeat: Integrated recognition, localization and detection using convolutional networks, arXiv:1312.6229.
81. K. He, X. Zhang, S. Ren, J. Sun, Spatial pyramid pooling in deep convolutional networks for visual recognition, in: ECCV, 2014, pp. 346-361.
82. M. Lin, Q. Chen, S. Yan, Network in network, arXiv:1312.4400.
83. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, A. Rabinovich, Going deeper with convolutions, arXiv:1409.4842.
84. K. Simonyan, A. Zisserman, Very deep convolutional networks for large-scale image recognition, arXiv:1409.1556.
85. W. Ouyang, P. Luo, X. Zeng, S. Qiu, Y. Tian, H. Li, S. Yang, Z. Wang, Y. Xiong, C. Qian, Z. Zhu, R. Wang, C.C. Loy, X. Wang, X. Tang, Deepid-net: multi-stage and deformable deep convolutional neural networks for object detection, arXiv:1409.3505.
86. J. Li, Y. Zhang, Learning surf cascade for fast and accurate object detection, in: CVPR, 2013, pp. 3466-3475.
87. S. Lazebnik, C. Schmid, J. Ponce, Beyond bags of features: spatial pyramid matching for recognizing natural scene categories, in: CVPR, 2006, pp. 2169-2178.
88. Y. N. Wu, Z. Si, C. Fleming, S.C. Zhu, Deformable template as active basis, in: ICCV, 2007, pp. 1-8.
89. S.K. Pavani, D. Delgado, and A.F. Frangi Haar-like features with optimally weighted rectangles for rapid object detection Pattern Recognit. 43 2010 160 172
90. D. Wesierski, M. Mkhinini, P. Horain, A. Jezierska, Fast recursive ensemble convolution of haar-like features, in: CVPR, 2012, pp. 3689-3696.
91. J. Canny A computational approach to edge detection IEEE Trans. Pattern Anal. Mach. Intell. 8 6 1986 679 698
92. D. Martin, C. Fowlkes, and J. Malik Learning to detect natural image boundaries using local brightness, color, and texture cues IEEE Trans. Pattern Anal. Mach. Intell. 26 5 2004 530 549
93. D. Zhang, and G. Lu Review of shape representation and description techniques Pattern Recognit. 37 1 2004 1 19
94. V. Ferrari, T. Tuytelaars, L.V. Gool, Object detection by contour segment networks, in: ECCV, 2006, pp. 14-28.
95. V. Ferrari, F. Jurie, and C. Schmid From images to shape models for object detection Int. J. Comput. Vis. 87 3 2010 284 303
96. X. Yu, L. Yi, C. Fermuller, D. Doermann, Object detection using a shape codebook, in: BMVC, 2007, pp. 1-10.
97. A.Y.S. Chia, D. Rajan, M.K. Leung, and S. Rahardja Object recognition by discriminative combinations of line segments, ellipses, and appearance features IEEE Trans. Pattern Anal. Mach. Intell. 34 9 2012 1758 1772
98. R. Fergus, P. Perona, A. Zisserman, Object class recognition by unsupervised scale-invariant learning, in: CVPR, vol. 2, 2003, pp. 264-271.
99. R. Fergus, P. Perona, A. Zisserman, A sparse object category model for efficient learning and exhaustive recognition, in: CVPR, 2005, pp. 380-387.
100. J. Zhang, Y. Barhomi, T. Serre, A new biologically inspired color image descriptor, in: ECCV, 2012, pp. 312-324.
101. X. Ren, D. Ramanan, Histograms of sparse codes for object detection, in: CVPR, 2013.
102. Y. LeCun, L. Bottou, G. Orr, K. Muller, Efficient backprop, in: Neural Networks, Tricks of the Trade, 1998.
103. Y. Bengio, A. Courville, and P. Vincent Representation learning: a review and new perspectives IEEE Trans. Pattern Anal. Mach. Intell. 35 8 2013 1798 1828
104. C. Szegedy, A. Toshev, D. Erhan, Deep neural networks for object detection, in: NIPS, 2013, pp. 2553-2561.
105. J.R.R. Uijlings, K.E.A. van de Sande, T. Gevers, and A.W.M. Smeulders Selective search for object recognition Int. J. Comput. Vis. 104 2 2013 154 171
106. L. van der Maaten, E.O. Postma, H. J. van den Herik, Dimensionality Reduction: a Comparative Review, TiCC TR 2009C005, Tilburg University.
107. L. Cayton, Algorithms for manifold learning, Technical Report CS2008-0923, Univ. of California.
108. D. Meng, Y. Leung, and Z. Xu Passage method for nonlinear dimensionality reduction of data on multi-cluster manifolds Pattern Recognit. 46 2013 2175 2186
109. A. Vedaldi, V. Gulshan, M. Varma, A. Zisserman, Multiple kernels for object detection, in: CVPR, 2009, pp. 606-613.
110. J. Zhang, K. Huang, Y. Yu, T. Tan, Boosted local structured hog-lbp for object localization, in: CVPR, 2010, pp. 1393-1400.
111. P. Dollar, Z. Tu, P. Perona, S. Belongie, Integral channel features, in: BMVC, 2009, pp. 561-568.
112. B. Leibe, K. Mikolajczyk, B. Schiele, Segmentation based multi-cue integration for object detection, in: BMVC, 2006, pp. 1169-1178.
113. Y. Yu, J. Zhang, Y. Huang, S. Zheng, W. Ren, C. Wang, K. Huang, T. Tan, Object detection by context and boosted hog-lbp, in: ECCV Workshop on PASCAL, 2010, p. 104.
114. Q. Chen, Z. Song, Y. Hua, Z. Huang, S. Yan, Hierarchical matching with side information for image classification, in: CVPR, 2012, pp. 3426-3433.
115. L. Zhu, Y. Chen, A. Yuille, W. Freeman, Latent hierarchical structural learning for object detection, in: CVPR, 2010, pp. 1062-1069.
116. K. van de Sande, C.G.M. Snoek, A. Smeulders, Fisher and vlad with flair, in: CVPR, 2014, pp. 2377-2384.
117. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, L. Fei-Fei., Imagenet large scale visual recognition challenge, arXiv:1409.0575.