HSOG: A novel local image descriptor based on histograms of the second-order gradients

IEEE Transactions on Image Processing

Volumn 23, Issue 11, 2014, Pages 4680-4695

  Huang, Di ^a   Zhu, Chao ^b   Wang, Yunhong ^a   Chen, Liming ^c  

^a BEIHANG UNIVERSITY   (China)

^b PEKING UNIVERSITY   (China)

^c ECOLE CENTRALE DE LYON   (France)

Author keywords

feature extraction; image matching; Local image descriptor; object categorization; scene classification; second order gradients

Indexed keywords

IMAGE MATCHING;

LOCAL IMAGE DESCRIPTORS; OBJECT CATEGORIZATION; SCENE CLASSIFICATION; SECOND ORDERS;

FEATURE EXTRACTION;

ALGORITHM; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOMIMETICS; COMPUTER ASSISTED DIAGNOSIS; COMPUTER SIMULATION; HUMAN; IMAGE ENHANCEMENT; PROCEDURES; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; STATISTICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOMIMETICS; COMPUTER SIMULATION; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MODELS, STATISTICAL; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 84907482016     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2353814     Document Type: Article

References (59)

1. D. G. Lowe, "Distinctive image features from scale-invariant keypoints, " Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
2. M. Brown and D. G. Lowe, "Automatic panoramic image stitching using invariant features, " Int. J. Comput. Vis., vol. 74, no. 1, pp. 59-73, 2007.
3. T. Tuytelaars and L. Van Gool, "Matching widely separated views based on affine invariant regions, " Int. J. Comput. Vis., vol. 59, no. 1, pp. 61-85, 2004.
4. N. Liu et al., "Multimodal recognition of visual concepts using histograms of textual concepts and selective weighted late fusion scheme, " Comput. Vis. Image Understand., vol. 117, no. 5, pp. 493-512, 2013.
5. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope, " Int. J. Comput. Vis., vol. 42, no. 3, pp. 145-175, 2001.
6. C. Zhu, C.-E. Bichot, and L. Chen, "Image region description using orthogonal combination of local binary patterns enhanced with color information, " Pattern Recognit., vol. 46, no. 7, pp. 1949-1963, 2013.
7. J. Philbin, M. Isard, J. Sivic, and A. Zisserman, "Descriptor learning for efficient retrieval, " in Proc. ECCV, 2010, pp. 677-691.
8. Y. Ke and R. Sukthankar, "PCA-SIFT: A more distinctive representation for local image descriptors, " in Proc. IEEE CVPR, Jun./Jul. 2004, pp. II-506-II-513.
9. K. Mikolajczyk and C. Schmid, "A performance evaluation of local descriptors, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 10, pp. 1615-1630, Oct. 2005.
10. K. E. A. van de Sande, T. Gevers, and C. G. M. Snoek, "Evaluating color descriptors for object and scene recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1582-1596, Sep. 2010.
11. S. Belongie, J. Malik, and J. Puzicha, "Shape matching and object recognition using shape contexts, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 4, pp. 509-522, Apr. 2002.
12. H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool, "Speeded-up robust features (SURF), " Comput. Vis. Image Understand., vol. 110, no. 3, pp. 346-359, 2008.
13. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection, " in Proc. IEEE CVPR, Jun. 2005, pp. 886-893.
14. M. Heikkila, M. Pietikainen, and C. Schmid, "Description of interest regions with local binary patterns, " Pattern Recognit., vol. 42, no. 3, pp. 425-436, 2009.
15. E. Tola, V. Lepetit, and P. Fua, "DAISY: An efficient dense descriptor applied to wide-baseline stereo, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 5, pp. 815-830, May 2010.
16. M. Brown, H. Gang, and S. Winder, "Discriminative learning of local image descriptors, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 1, pp. 43-57, Jan. 2011.
17. H. Bay, T. Tuytelaars, and L. Van Gool, "SURF: Speeded up robust features, " in Proc. ECCV, 2006, pp. 404-417.
18. E. Tola, V. Lepetit, and P. Fua, "A fast local descriptor for dense matching, " in Proc. IEEE CVPR, Jun. 2008, pp. 1-8.
19. K. E. A. van de Sande, T. Gevers, and C. G. M. Snoek, "Evaluating color descriptors for object and scene recognition, " in Proc. CVPR, Jun. 2008, pp. 1-8.
20. C. Zhu, C.-E. Bichot, and L. Chen, "Multi-scale color local binary patterns for visual object classes recognition, " in Proc. 20th ICPR, Aug. 2010, pp. 3065-3068.
21. I. Kokkinos and A. Yuille, "Scale invariance without scale selection, " in Proc. IEEE CVPR, Jun. 2008, pp. 1-8.
22. T. Hassner, V. Mayzels, and L. Zelnik-Manor, "On SIFTs and their scales, " in Proc. IEEE CVPR, Jun. 2012, pp. 1522-1528.
23. F. Moreno-Noguer, "Deformation and illumination invariant feature point descriptor, " in Proc. IEEE CVPR, Jun. 2011, pp. 1593-1600.
24. P. Ott and M. Everingham, "Implicit color segmentation features for pedestrian and object detection, " in Proc. IEEE ICCV, Sep./Oct. 2009, pp. 723-730.
25. E. Trulls, I. Kokkinos, A. Sanfeliu, and F. Moreno-Noguer, "Dense segmentation-aware descriptors, " in Proc. IEEE CVPR, Jun. 2013, pp. 2890-2897.
26. A. Bosch, A. Zisserman, and X. Muoz, "Scene classification using a hybrid generative/discriminative approach, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 4, pp. 712-727, Apr. 2008.
27. J. van de Weijer, T. Gevers, and A. D. Bagdanov, "Boosting color saliency in image feature detection, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 1, pp. 150-156, Jan. 2006.
28. T. Ojala, M. Pietikainen, and T. Maenpaa, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 971-987, Jul. 2002.
29. T. Ahonen, A. Hadid, and M. Pietikainen, "Face recognition with local binary patterns, " in Proc. ECCV, 2004, pp. 469-481.
30. C. Zhu, C.-E. Bichot, and L. Chen, "Visual object recognition using DAISY descriptor, " in Proc. IEEE ICME, Jul. 2011, pp. 1-6.
31. J. Zhang, M. Marszalek, S. Lazebnik, and C. Schmid, "Local features and kernels for classification of texture and object categories: A comprehensive study, " Int. J. Comput. Vis., vol. 73, no. 2, pp. 213-238, 2007.
32. J. Li and N. M. Allinson, "A comprehensive review of current local features for computer vision, " Neurocomputing, vol. 71, nos. 10-12, pp. 1771-1787, 2008.
33. D. H. Hubel and T. N. Wiesel, "Brain mechanisms of vision, " Sci. Amer., vol. 241, no. 3, pp. 150-162, 1979.
34. M. J. Morgan, "Features and the 'primal sketch', " Vis. Res., vol. 51, no. 7, pp. 738-753, 2011.
35. S. A. Wallis and M. A. Georgeson, "Mach bands and multiscale models of spatial vision: The role of first, second, and third derivative operators in encoding bars and edges, " J. Vis., vol. 12, no. 13, pp. 1-25, 2012.
36. W. Kuhnel, Differential Geometry: Curves, Surfaces, Manifolds. Providence, RI, USA: AMS, 2005.
37. D. H. Hubel and T. N. Wiesel, "Receptive fields, binocular interaction and functional architecture in the cat's visual cortex, " J. Physiol., vol. 160, no. 1, pp. 106-154, 1962.
38. D. Huang, C. Zhu, C.-E. Bichot, Y. Wang, and L. Chen, "HSOG: A novel local descriptor based on histograms of second order gradients for object categorization, " in Proc. ICMR, 2013, pp. 199-206.
39. D. Huang, M. Ardabilian, Y. Wang, and L. Chen, "Oriented gradient maps based automatic asymmetric 3D-2D face recognition, " in Proc. 5th ICB, Mar./Apr. 2012, pp. 125-131.
40. K. Simonyan, A. Vedaldi, and A. Zisserman, "Descriptor learning using convex optimisation, " in Proc. ECCV, 2012, pp. 243-256.
41. T. Trzcinski, M. Christoudias, V. Lepetit, and P. Fua, "Learning image descriptors with the boosting-trick, " in Proc. NIPS, 2012, pp. 278-286.
42. X. Boix, M. Gygli, G. Roig, and L. Van Gool, "Sparse quantization for patch description, " in Proc. IEEE CVPR, Jun. 2013, pp. 2842-2849.
43. T. Trzcinski, M. Christoudias, P. Fua, and V. Lepetit, "Boosting binary keypoint descriptors, " in Proc. IEEE CVPR, Jun. 2013, pp. 2874-2881.
44. G. Csurka, C. R. Dance, L. Fan, J. Willamowski, and C. Bray, "Visual categorization with bags of keypoints, " in Proc. ECCV Workshop, 2004, pp. 1-2.
45. F.-F. Li, R. Fergus, and P. Perona, "Learning generative visual models from few training examples: An incremental Bayesian approach tested on 101 object categories, " in Proc. IEEE CVPRW, Jun. 2004, p. 178.
46. G. Griffin, A. Holub, and P. Perona, "Caltech-256 object category dataset, " California Inst. Technol., Pasadena, CA, USA, Tech. Rep. CNS-TR-2007-001, 2007.
47. K. Mikolajczyk and C. Schmid, "Scale and affine invariant interest point detectors, " Int. J. Comput. Vis., vol. 60, no. 1, pp. 63-86, 2004.
48. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong, "Localityconstrained linear coding for image classification, " in Proc. IEEE CVPR, Jun. 2010, pp. 3360-3367.
49. H. Zhang, A. C. Berg, M. Maire, and J. Malik, "SVM-KNN: Discriminative nearest neighbor classification for visual category recognition, " in Proc. IEEE CVPR, Jun. 2006, pp. 2126-2136.
50. M. Varma and D. Ray, "Learning the discriminative power-invariance trade-off, " in Proc. IEEE 11th ICCV, Oct. 2007, pp. 1-8.
51. J. Yang, K. Yu, Y. Gong, and T. Huang, "Linear spatial pyramid matching using sparse coding for image classification, " in Proc. IEEE CVPR, Jun. 2009, pp. 1794-1801.
52. S. Gao, I. W. Tsang, and L. Chia, "Laplacian sparse coding, hypergraph Laplacian sparse coding, and applications, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 92-104, Jan. 2013.
53. L. Liu, L. Wang, and X. Liu, "In defense of soft-assignment coding, " in Proc. IEEE ICCV, Nov. 2011, pp. 2486-2493.
54. A. Shabou and H. LeBorgne, "Locality-constrained and spatially regularized coding for scene categorization, " in Proc. IEEE CVPR, Jun. 2012, pp. 3618-3625.
55. A. Kumar, A. Niculescu-Mizil, K. Kavukcuoglu, and H. Daumé, III, "A binary classification framework for two-stage multiple kernel learning, " in Proc. ICML, 2012, pp. 1-8.
56. P. Gehler and S. Nowozin, "On feature combination for multiclass object classification, " in Proc. IEEE 12th ICCV, Sep./Oct. 2009, pp. 221-228.
57. A. Bosch, A. Zisserman, and X. Munoz, "Scene classification via pLSA, " in Proc. ECCV, 2006, pp. 517-530.
58. A. Rakotomamonjy, F. Bach, S. Canu, and Y. Grandvalet, "Simplemkl, " J. Mach. Learn. Res., vol. 9, pp. 2491-2521, Nov. 2008.
59. J. Xiao, J. Hays, K. A. Ehinger, A. Oliva, and A. Torralba, "SUN database: Large-scale scene recognition from abbey to zoo, " in Proc. IEEE CVPR, Jun. 2010, pp. 3485-3492.