Shape vocabulary: A robust and efficient shape representation for shape matching

IEEE Transactions on Image Processing

Volumn 23, Issue 9, 2014, Pages 3935-3949

  Bai, Xiang ^a   Rao, Cong ^a   Wang, Xinggang ^a  

^a HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

Author keywords

2D shape; 3D shape; BoW; feature division; feature pooling; Shape matching; vocabulary learning

Indexed keywords

FEATURE EXTRACTION;

2D SHAPE; 3-D SHAPE; BOW; FEATURE DIVISION; FEATURE POOLING; SHAPE MATCHING; VOCABULARY LEARNING;

OBJECT RECOGNITION;

EID: 84905247930     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2336542     Document Type: Article

References (72)

1. F. Mokhtarian and R. Suomela, "Robust image corner detection through curvature scale space," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 12, pp. 1376-1381, Dec. 1998.
2. L. J. Latecki and R. Lakämper, "Shape similarity measure based on correspondence of visual parts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 10, pp. 1185-1190, Oct. 2000.
3. S. Belongie, J. Malik, and J. Puzicha, "Shape matching and object recognition using shape contexts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 4, pp. 509-522, Apr. 2002.
4. K. B. Sun and B. J. Super, "Classification of contour shapes using class segment sets," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), vol. 2. Jun. 2005, pp. 727-733.
5. H. Ling and D. W. Jacobs, "Shape classification using the inner-distance," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 2, pp. 286-299, Feb. 2007.
6. G. McNeill and S. Vijayakumar, "Hierarchical procrustes matching for shape retrieval," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), vol. 1. Jun. 2006, pp. 885-894.
7. X. Bai, X. Yang, L. J. Latecki, W. Liu, and Z. Tu, "Learning context-sensitive shape similarity by graph transduction," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 5, pp. 861-874, May 2010.
8. X. Yang, L. Prasad, and L. J. Latecki, "Affinity learning with diffusion on tensor product graph," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 28-38, Jan. 2013.
9. Y. Zhou, X. Bai, W. Liu, and L. J. Latecki, "Fusion with diffusion for robust visual tracking," in Proc. Conf. Neural Inf. Process. Syst., 2012, pp. 2987-2995.
10. X. Bai, B. Wang, C. Yao, W. Liu, and Z. Tu, "Co-transduction for shape retrieval," IEEE Trans. Image Process., vol. 21, no. 5, pp. 2747-2757, May 2012.
11. M. Donoser and H. Bischof, "Diffusion processes for retrieval revisited," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2013, pp. 1320-1327.
12. S. Biswas, G. Aggarwal, and R. Chellappa, "An efficient and robust algorithm for shape indexing and retrieval," IEEE Trans. Multimedia, vol. 12, no. 5, pp. 372-385, Aug. 2010.
13. Z. Li, W. Qu, J. Cao, Z. Su, and H. Qi, "Geometry-based 2D shape descriptor for retrieval in large database," in Proc. IEEE 11th Int. Conf. Signal Process. (ICSP), vol. 2. Oct. 2012, pp. 1096-1101.
14. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos," in Proc. 9th IEEE Int. Conf. Comput. Vis., Oct. 2003, pp. 1470-1477.
15. D. Nister and H. Stewenius, "Scalable recognition with a vocabulary tree," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog-nit. (CVPR), vol. 2. Jun. 2006, pp. 2161-2168.
16. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Object retrieval with large vocabularies and fast spatial matching," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR). Jun. 2007, pp. 1-8.
17. H. Jegou, M. Douze, and C. Schmid, "Hamming embedding and weak geometric consistency for large scale image search," in Proc. 10th Eur. Conf. Comput. Vis. (ECCV), 2008, pp. 304-317.
18. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
19. A. Opelt, A. Pinz, and A. Zisserman, "A boundary-fragment-model for object detection," in Proc. 9th Eur. Conf. Comput. Vis. (ECCV), 2006, pp. 575-588.
20. N. Alajlan, M. S. Kamel, and G. H. Freeman, "Geometry-based image retrieval in binary image databases," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 6, pp. 1003-1013, Jun. 2008.
21. P. F. Felzenszwalb and J. D. Schwartz, "Hierarchical matching of deformable shapes," in Proc. IEEE Conf. Comput. Vis. Pattern Recog-nit. (CVPR), Jun. 2007, pp. 1-8.
22. V. Ferrari, L. Fevrier, F. Jurie, and C. Schmid, "Groups of adjacent contour segments for object detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 1, pp. 36-51, Jan. 2008.
23. J. Wang, X. Bai, X. You, W. Liu, and L. J. Latecki, "Shape matching and classification using height functions," Pattern Recognit. Lett., vol. 33, no. 2, pp. 134-143, 2012.
24. C. Aslan, A. Erdem, E. Erdem, and S. Tari, "Disconnected skeleton: Shape at its absolute scale," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 12, pp. 2188-2203, Dec. 2008.
25. X. Bai and L. J. Latecki, "Path similarity skeleton graph matching," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 7, pp. 1282-1292, Jul. 2008.
26. X. Bai, W. Liu, and Z. Tu, "Integrating contour and skeleton for shape classification," in Proc. IEEE 12th Int. Conf. Comput. Vis. Workshops (ICCV), Sep./Oct. 2009, pp. 360-367.
27. T. B. Sebastian, P. N. Klein, and B. B. Kimia, "Recognition of shapes by editing their shock graphs," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 5, pp. 550-571, May 2004.
28. K. Siddiqi, A. Shokoufandeh, S. J. Dickinson, and S. W. Zucker, "Shock graphs and shape matching," Int. J. Comput. Vis., vol. 35, no. 1, pp. 13-32, 1999.
29. A. Khotanzad and Y. H. Hong, "Invariant image recognition by Zernike moments," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 5, pp. 489-497, May 1990.
30. D. Zhang and G. Lu, "Shape-based image retrieval using generic Fourier descriptor," Signal Process., Image Commun., vol. 17, no. 10, pp. 825-848, 2002.
31. L. Gorelick, M. Galun, E. Sharon, R. Basri, and A. Brandt, "Shape representation and classification using the Poisson equation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 12, pp. 1991-2005, Dec. 2006.
32. C.-C. Chang and C.-J. Lin, "LIBSVM: A library for support vector machines," ACM Trans. Intell. Syst. Technol, vol. 2, no. 3, pp. 27:1-27:27, 2011.
33. X. Wang, B. Feng, X. Bai, W. Liu, and L. J. Latecki, "Bag of contour fragments for robust shape classification," Pattern Recognit., vol. 47, no. 6, pp. 2116-2125, 2014.
34. H. Van Nguyen and F. Porikli, "Support vector shape: A classifier-based shape representation," IEEE Trans. Pattern Anal. Mach. Intell, vol. 35, no. 4, pp. 970-982, Apr. 2013.
35. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), vol. 2. Jun. 2006, pp. 2169-2178.
36. P. Shilane, P. Min, M. Kazhdan, and T. Funkhouser, "The princeton shape benchmark," in Shape Modeling Applications. Piscataway, NJ, USA: IEEE Press, 2004, pp. 167-178.
37. D.-Y. Chen, X.-P Tian, Y.-T. Shen, and M. Ouhyoung, "On visual similarity based 3D model retrieval," Comput. Graph. Forum, vol. 22, no. 3, pp. 223-232, 2003.
38. D. V. Vranic, "DESIRE: A composite 3D-shape descriptor," in Proc. IEEE Int. Conf. Multimedia Expo, Jul. 2005, pp. 1-4.
39. P. Papadakis, I. Pratikakis, T. Theoharis, G. Passalis, and S. Perantonis, "3D object retrieval using an efficient and compact hybrid shape descriptor," in Proc. 1st Eurograph. Workshop 3D Object Retrieval, 2008.
40. C. B. Akgul, B. Sankur, Y Yemez, and F. Schmitt, "3D model retrieval using probability density-based shape descriptors," IEEE Trans. Pattern Anal. Mach. Intell, vol. 31, no. 6, pp. 1117-1133, Jun. 2009.
41. P. Papadakis, I. Pratikakis, S. Perantonis, and T. Theoharis, "Efficient 3D shape matching and retrieval using a concrete radialized spherical projection representation," Pattern Recognit, vol. 40, no. 9, pp. 2437-2452, 2007.
42. M. Chaouch and A. Verroust-Blondet, "A new descriptor for 2D depth image indexing and 3D model retrieval," in Proc. IEEE Int. Conf. Image Process. (ICIP), vol. 6. Sep./Oct. 2007, pp. 373-376.
43. P. Papadakis, I. Pratikakis, T Theoharis, and S. Perantonis, "PANORAMA: A 3D shape descriptor based on panoramic views for unsupervised 3D object retrieval," Int. J. Comput. Vis., vol. 89, nos. 2-3, pp. 177-192, 2010.
44. Z. Lian, A. Godil, and X. Sun, "Visual similarity based 3D shape retrieval using bag-of-features," in Proc. Shape Model. Int. Conf. (SMI), 2010, pp. 25-36.
45. J. Hafner, H. S. Sawhney, W. Equitz, M. Flickner, and W. Niblack, "Efficient color histogram indexing for quadratic form distance functions," IEEE Trans. Pattern Anal. Mach. Intell, vol. 17, no. 7, pp. 729-736, Jul. 1995.
46. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), vol. 1. Jun. 2005, pp. 886-893.
47. T Ahonen, A. Hadid, and M. Pietikainen, "Face description with local binary patterns: Application to face recognition," IEEE Trans. Pattern Anal. Mach. Intell, vol. 28, no. 12, pp. 2037-2041, Dec. 2006.
48. E. Nowak, F. Jurie, and B. Triggs, "Sampling strategies for bag-of-features image classification," in Proc. 9th Eur. Conf. Comput. Vis. (ECCV), 2006, pp. 490-503.
49. J. Yang, Y.-G. Jiang, A. G. Hauptmann, and C.-W. Ngo, "Evaluating bag-of-visual-words representations in scene classification," in Proc. Int. Workshop Multimedia Inf. Retrieval, 2007, pp. 197-206.
50. G. Csurka, C. Dance, L. Fan, J. Willamowski, and C. Bray, "Visual categorization with bags of keypoints," in Proc. Workshop Statist. Learn. Comput. Vis. ECCV, vol. 1. 2004, p. 22.
51. K. Grauman and T Darrell, "The pyramid match kernel: Discriminative classification with sets of image features," in Proc. 10th IEEE Int. Conf. Comput. Vis. (ICCV), vol. 2. Oct. 2005, pp. 1458-1465.
52. J. Yang, K. Yu, Y Gong, and T Huang, "Linear spatial pyramid matching using sparse coding for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2009, pp. 1794-1801.
53. N. M. Nasrabadi and R. A. King, "Image coding using vector quantization: A review," IEEE Trans. Commun., vol. 36, no. 8, pp. 957-971, Aug. 1988.
54. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong, "Locality-constrained linear coding for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2010, pp. 3360-3367.
55. L. J. Latecki and R. Lakämper, "Convexity rule for shape decomposition based on discrete contour evolution," Comput. Vis. Image Understand., vol. 73, no. 3, pp. 441-454, 1999.
56. P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), vol. 1. Jun. 2001, pp. 511-518.
57. I. Jolliffe, Principal Component Analysis. New York, NY, USA: Wiley, 2005.
58. L. J. Latecki, R. Lakamper, and T. Eckhardt, "Shape descriptors for nonrigid shapes with a single closed contour," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), vol. 1. Jun. 2000, pp. 424-429.
59. D. Giorgi, S. Biasotti, and L. Paraboschi, "Shape retrieval contest 2007: Watertight models track," SHREC Competition, vol. 8, no. 1, pp. 1-11, 2007.
60. F. R. Schmidt, E. Toppe, and D. Cremers, "Efficient planar graph cuts with applications in computer vision," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2009, pp. 351-356.
61. M. R. Daliri and V. Torre, "Robust symbolic representation for shape recognition and retrieval," Pattern Recognit., vol. 41, no. 5, pp. 1782-1798, 2008.
62. M. Liu, B. C. Vemuri, S.-I. Amari, and F. Nielsen, "Total Bregman divergence and its applications to shape retrieval," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2010, pp. 3463-3468.
63. C. Xu, J. Liu, and X. Tang, "2D shape matching by contour flexibility," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 1, pp. 180-186, Jan. 2009.
64. Z. Wang and M. Liang, "Locally affine invariant descriptors for shape matching and retrieval," IEEE Signal Process. Lett., vol. 17, no. 9, pp. 803-806, Sep. 2010.
65. M. Liu, B. Vemuri, S.-I. Amari, and F. Nielsen, "Shape retrieval using hierarchical total Bregman soft clustering," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 12, pp. 2047-2419, Dec. 2012.
66. R. Gopalan, P. Turaga, and R. Chellappa, "Articulation-invariant representation of non-planar shapes," in Proc. 11th Eur. Conf. Comput. Vis. (ECCV), 2010, pp. 286-299.
67. X. Yang, X. Bai, L. J. Latecki, and Z. Tu, "Improving shape retrieval by learning graph transduction," in Proc. 10th Eur. Conf. Comput. Vis. (ECCV), 2008, pp. 788-801.
68. Y. Li, J. Zhu, and F. L. Li, "A hierarchical shape tree for shape classification," in Proc. 25th Int. Conf. Image Vis. Comput. New Zealand (IVCNZ), 2010, pp. 1-6.
69. K.-L. Lim and H. K. Galoogahi, "Shape classification using local and global features," in Proc. 4th Pacific-Rim Symp. Image Video Technol., 2010, pp. 115-120.
70. H. Tabia, M. Daoudi, J.-P. Vandeborre, and O. Colot, "A new 3D-matching method of nonrigid and partially similar models using curve analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 4, pp. 852-858, Apr. 2011.
71. G. Lavoué, "Combination of bag-of-words descriptors for robust partial shape retrieval," Vis. Comput., vol. 28, no. 9, pp. 931-942, 2012.
72. T. Hedi, L. Hamid, P. David, and G. Philippe-Henry, "Covariance descriptors for 3D shape matching and retrieval," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2014.