Skeleton search: Category-specific object recognition and segmentation using a skeletal shape model

International Journal of Computer Vision

Volumn 94, Issue 2, 2011, Pages 215-240

  Trinh, Nhon H ^a   Kimia, Benjamin B ^b  

^a SRI INTERNATIONAL   (United States)

^b BROWN UNIVERSITY   (United States)

Author keywords

Categorization; Dynamic programming; Generative shape model; Recognition; Segmentation; Shock graph; Skeleton; Top down modeling

Indexed keywords

CATEGORIZATION; RECOGNITION; SHAPE MODEL; SHOCK GRAPHS; SKELETON; TOPDOWN;

DYNAMIC PROGRAMMING; IMAGE MATCHING; IMAGE SEGMENTATION; LAKES; MUSCULOSKELETAL SYSTEM;

OBJECT RECOGNITION;

EID: 79960286925     PISSN: 09205691     EISSN: 15731405     Source Type: Journal    
DOI: 10.1007/s11263-010-0412-0     Document Type: Article

References (93)

1. N. Adluru L. J. Latecki 2009 Contour grouping based on contour-skeleton duality International Journal of Computer Vision 83 1 12 29 10.1007/s11263-009- 0208-2
2. Adluru, N., Latecki, L. J., Lakaemper, R., Yong, T., Bai, X., & Gross, A. (2005). Deformation invariant image matching. In ICCV '05: proceedings of the tenth IEEE international conference on computer vision (Vol. II, pp. 1466-1473). Los Alamitos: IEEE Computer Society Press.
3. Y. Amit A. Kong 1996 Graphical templates for model registration IEEE Transactions on Pattern Analysis and Machine Intelligence 18 3 225 236 10.1109/34.485529 (Pubitemid 126773881)
4. Bai, X., Wang, X., Latecki, L. J., Liu, W., & Tu, Z. (2009). Active skeleton for non-rigid object detection. In ICCV '09: proceedings of the twelfth IEEE international conference on computer vision. Los Alamitos: IEEE Computer Society Press.
5. Balan, A. O., & Black, M. J. (2006). An adaptive appearance model approach for model-based articulated object tracking. In CVPR'06 (pp. 758-765). Los Alamitos: IEEE Computer Society Press. (Pubitemid 44931401)
6. Barrow, H. (1977). Parametric correspondence and chamfer matching: two new techniques for image matching. In Proc 5th int joint conf artificial intelligence.
7. S. Belongie J. Malik J. Puzicha 2002 Shape matching and object recognition using shape contexts IEEE Transactions on Pattern Analysis and Machine Intelligence 24 4 509 522 10.1109/34.993558 (Pubitemid 34448769)
8. Berg, A. C., Berg, T. L., & Malik, J. (2005). Shape matching and object recognition using low distortion correspondences. In CVPR'05 (pp. 26-33). Los Alamitos: IEEE Computer Society Press.
9. Bertele, U., & Brioschi, F. (1972). Nonserial dynamic programming. Orlando: Academic Press.
10. Bishop, C. M. (2007). Pattern recognition and machine learning. Berlin: Springer.
11. H. Chui A. Rangarajan 2003 A new point matching algorithm for non-rigid registration Computer Vision and Image Understanding 89 2-3 114 141 10.1016/S1077-3142(03)00009-2 1053.68123 10.1016/S1077-3142(03)00009-2
12. J. Coughlan A. Yuille C. English D. Snow 2000 Efficient deformable template detection and localization without user initialization Computer Vision and Image Understanding 78 3 303 319 10.1006/cviu.2000.0842 10.1006/cviu.2000. 0842
13. Csurka, G., Dance, C. R., Fan, L., Willamowski, J., & Bray, C. (2004). Visual categorization with bags of keypoints. In ECCV international workshop on statistical learning in computer vision.
14. Dalal, N., & Triggs, B. (2005). Histograms of oriented gradients for human detection. In CVPR'05 (pp. 886-893). Los Alamitos: IEEE Computer Society Press. (Pubitemid 43897286)
15. M. F. Demirci A. Shokoufandeh S. J. Dickinson 2009 Skeletal shape abstraction from examples IEEE Transactions on Pattern Analysis and Machine Intelligence 31 5 944 952 10.1109/TPAMI.2008.267
16. Dorkó, G., & Schmid, C. (2003). Selection of scale-invariant parts for object class recognition. In ICCV '03: proceedings of the ninth IEEE international conference on computer vision (pp. 634-640). Los Alamitos: IEEE Computer Society Press.
17. Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2009). The PASCAL Visual Object Classes Challenge 2009 (VOC2009) Results. http://www.pascal-network.org/challenges/VOC/voc2009/workshop/index. html.
18. P. F. Felzenszwalb 2005 Representation and detection of deformable shapes IEEE Transactions on Pattern Analysis and Machine Intelligence 27 2 208 220 10.1109/TPAMI.2005.35 (Pubitemid 40377314)
19. P. F. Felzenszwalb D. P. Huttenlocher 2005 Pictorial structures for object recognition International Journal of Computer Vision 61 1 55 79 10.1023/B:VISI.0000042934.15159.49
20. Felzenszwalb, P. F., & Schwartz, J. D. (2007). Hierarchical matching of deformable shapes. In CVPR'07. Los Alamitos: IEEE Computer Society Press.
21. R. Fergus P. Perona A. Zisserman 2003 Object class recognition by unsupervised scale-invariant learning Proceedings of the IEEE computer society conference on computer vision and pattern recognition Madison, Wisconsin IEEE Computer Society Press Los Alamitos 264 271 URL citeseer.nj.nec.com/580536.html
22. Ferrari, V., Tuytelaars, T., & Gool, L. V. (2006). Object detection by contour segment networks. In Lecture notes in computer science: Vol. 3951. ECCV2006 (pp. 14-28). Berlin: Springer. (Pubitemid 44029664)
23. Ferrari, V., Jurie, F., & Schmid, C. (2007). Accurate object detection with deformable shape models learnt from images. In CVPR'07 (pp. 1-8). Los Alamitos: IEEE Computer Society Press.
24. V. Ferrari L. Fevrier F. Jurie C. Schmid 2008 Groups of adjacent contour segments for object detection IEEE Transactions on Pattern Analysis and Machine Intelligence 30 1 36 51 10.1109/TPAMI.2007.1144 (Pubitemid 350168354)
25. V. Ferrari F. Jurie C. Schmid 2010 From images to shape models for object detection International Journal of Computer Vision 87 3 284 303 10.1007/s11263-009-0270-9
26. S. Geman K. Kochanek 2001 Dynamic programming and the graphical representation of error-correcting codes IEEE Transactions on Information Theory 47 2 549 568 1820476 1050.90564 10.1109/18.910574 (Pubitemid 32318089)
27. P. J. Giblin B. B. Kimia 2003 On the intrinsic reconstruction of shape from its symmetries IEEE Transactions on Pattern Analysis and Machine Intelligence 25 7 895 911 10.1109/TPAMI.2003.1206518
28. P. J. Giblin B. B. Kimia 2003 On the local form and transitions of symmetry sets, medial axes, and shocks International Journal of Computer Vision 54 1-3 143 157 1076.68095 10.1023/A:1023761518825
29. Gu, C., Lim, J. J., Arbelaez, P., & Malik, J. (2009). Recognition using regions. In Proceedings of the IEEE computer society conference on computer vision and pattern recognition, Miami, Florida, USA (pp. 1030-1037). Los Alamitos: IEEE Computer Society Press.
30. D. P. Huttenlocher G. A. Klanderman W. Rucklidge 1993 Comparing images using the hausdorff distance IEEE Transactions on Pattern Analysis and Machine Intelligence 15 9 850 863 10.1109/34.232073 (Pubitemid 23703609)
31. V. Jain B. B. Kimia J. L. Mundy 2007 Segregation of moving objects using elastic matching Computer Vision and Image Understanding 108 230 242 10.1016/j.cviu.2006.11.024 (Pubitemid 350016965)
32. X. Jiang A. Münger H. Bunke 2001 On median graphs: Properties, algorithms, and applications IEEE Transactions on Pattern Analysis and Machine Intelligence 23 10 1144 1151 10.1109/34.954604 (Pubitemid 33047952)
33. Jurie, F., & Schmid, C. (2004). Scale-invariant shape features for recognition of object categories. In CVPR (Vol. II, pp. 90-96).
34. Jurie, F., & Triggs, B. (2005). Creating efficient codebooks for visual recognition. In ICCV '05: proceedings of the tenth IEEE international conference on computer vision (ICCV'05) (Vol. 1, pp. 604-610). Los Alamitos: IEEE Computer Society Press. (Pubitemid 44055011)
35. M. Kass A. Witkin D. Terzopoulos 1988 Snakes: active contour models International Journal of Computer Vision 1 4 321 331 10.1007/BF00133570
36. Kelly, M. F., & Levine, M. D. (1995). Annular symmetry operators: a method for locating and describing objects. In ICCV.
37. Kimia, B. (1991). Conservation laws and a theory of shape. Ph.D. dissertation, McGill Center for Intelligent Machines, McGill University, Montreal, Canada.
38. B. B. Kimia 2003 On the role of medial geometry in human vision Journal of Physiology-Paris 97 2-3 155 190 10.1016/j.jphysparis.2003.09.003 (Pubitemid 38177321)
39. Kimia, B. B. (2009). Shapes and shock graphs: from segmented shapes to shapes embedded in images. In S. J. Dickinson, A. Leonardis, B. Schiele, & M. J. Tarr (Eds.), Object categorization: computer and human vision perspectives (pp. 430-450). Cambridge: Cambridge University Press.
40. Kimia, B. B., Tannenbaum, A. R., & Zucker, S. W. (1990). Toward a computational theory of shape: an overview. In O. D. Faugeras (Ed.), Lecture notes in computer science: Vol. 427. ECCV (pp. 402-407). Berlin: Springer.
41. B. B. Kimia AR Tannenbaum S. W. Zucker 1995 Shapes, shocks, and deformations, I: the components of shape and the reaction-diffusion space International Journal of Computer Vision 15 3 189 224 10.1007/BF01451741
42. B. B. Kimia I. Frankel A. M. Popescu 2003 Euler spiral for shape completion International Journal of Computer Vision 54 159 182 1076.68096 10.1023/A:1023713602895
43. Kovesi, P. D. (2009). MATLAB and Octave functions for computer vision and image processing. School of Computer Science & Software Engineering, The University of Western Australia. Available from: http://www.csse.uwa.edu.au/~pk/ research/matlabfns/.
44. Kumar, M. P., Torr, P. H. S., & Zisserman, A. (2004a). Extending pictorial structures for object recognition. In BMVC'04, British Machine Vision Association (pp. 789-798).
45. Kumar, M. P., Torr, P. H. S., & Zisserman, A. (2004b). Learning layered pictorial structures from video. In B. Chanda, S. Chandran, & L. S. Davis (Eds.), ICVGIP 2004 (pp. 158-164). Mumbai: Allied Publishers.
46. Kumar, M. P., Torr, P. H. S., & Zisserman, A. (2005). Obj cut. In CVPR'05 (pp. 18-25). Los Alamitos: IEEE Computer Society Press.
47. Lazebnik, S., Schmid, C., & Ponce, J. (2006). Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In CVPR'06 (pp. 2169-2178). Los Alamitos: IEEE Computer Society Press. (Pubitemid 44931582)
48. Leibe, B., & Schiele, B. (2004). Scale-invariant object categorization using a scale-adaptive mean-shift search. In DAGM-Symposium (pp. 145-153).
49. Leordeanu, M., Hebert, M., & Sukthankar, R. (2007). Beyond local appearance: category recognition from pairwise interactions of simple features. In CVPR'07. Los Alamitos: IEEE Computer Society Press.
50. Lin, L., Peng, S., Porway, J., Zhu, S., & Wang, Y. (2007). An empirical study of object category recognition: sequential testing with generalized samples. In ICCV07 (pp. 1-8).
51. D. Lowe 2004 Distinctive image features from scale-invariant keypoints International Journal of Computer Vision 60 2 91 110 10.1023/B:VISI.0000029664. 99615.94
52. Maji, S., & Malik, J. (2009). Object detection using a max-margin hough transform. In Proceedings of the IEEE computer society conference on computer vision and pattern recognition (pp. 1038-1045). Los Alamitos: IEEE Computer Society Press.
53. D. R. Martin C. C. Fowlkes J. Malik 2004 Learning to detect natural image boundaries using local brightness, color, and texture cues IEEE Transactions on Pattern Analysis and Machine Intelligence 26 5 530 549 10.1109/TPAMI.2004. 1273918 10.1109/TPAMI.2004.1273918
54. K. Mikolajczyk C. Schmid 2005 A performance evaluation of local descriptors IEEE Transactions on Pattern Analysis and Machine Intelligence 27 10 1615 1630 10.1109/TPAMI.2005.188 (Pubitemid 41555406)
55. Mori, G. (2005). Guiding model search using segmentation. In ICCV '05: proceedings of the tenth IEEE international conference on computer vision (pp. 1417-1423). Los Alamitos: IEEE Computer Society Press. (Pubitemid 44042345)
56. D. Nilsson 1998 An efficient algorithm for finding the m most probable configurations in probabilistic expert systems Statistics and Computing 8 2 159 173 10.1023/A:1008990218483 10.1023/A:1008990218483 (Pubitemid 128119962)
57. C. F. Olson D. P. Huttenlocher 1997 Automatic target recognition by matching oriented edge pixels IEEE Transactions on Image Processing 6 1 103 113 10.1109/83.552100 (Pubitemid 127768360)
58. Ommer, B., & Malik, J. (2009). Multi-scale object detection by clustering lines. In ICCV '09: proceedings of the twelfth IEEE international conference on computer vision. Los Alamitos: IEEE Computer Society Press.
59. Opelt, A., Pinz, A., & Zisserman, A. (2006a). A boundary-fragment- model for object detection. In Lecture notes in computer science: Vol. 3951. ECCV'06 (pp. 575-588). Berlin: Springer. (Pubitemid 44029756)
60. Opelt, A., Pinz, A., & Zisserman, A. (2006b). Incremental learning of object detectors using a visual shape alphabet. In CVPR'06 (pp. 3-10). Los Alamitos: IEEE Computer Society Press. (Pubitemid 44931306)
61. A. Opelt A. Pinz A. Zisserman 2008 Learning an alphabet of shape and appearance for multi-class object detection International Journal of Computer Vision 80 1 16 44 10.1007/s11263-008-0139-3
62. Ozcanli, O. C., & Kimia, B. B. (2007). Generic object recognition via shock patch fragments. In N. M. Rajpoot & A. Bhalerao (Eds.), Proceedings of the British machine vision conference (pp. 1030-1039). Coventry: Warwick Print.
63. Ozcanli, O. C., Tamrakar, A., Kimia, B. B., & Mundy, J. L. (2006). Augmenting shape with appearance in vehicle category recognition. In CVPR'06 (pp. 935-942). Los Alamitos: IEEE Computer Society Press. (Pubitemid 44931423)
64. Ramanan, D. (2007). Learning to parse images of articulated bodies. In B. Schölkopf, J. Platt & T. Hoffman (Eds.), NIPS'06. Cambridge: MIT Press.
65. Sala, P., & Dickinson, S. (2008). Model-based perceptual grouping and shape abstraction. In Computer vision and pattern recognition workshops, CVPRW '08. IEEE computer society conference on (pp. 1-8). Los Alamitos: IEEE Computer Society Press.
66. T. Sebastian P. Klein B. Kimia 2004 Recognition of shapes by editing their shock graphs IEEE Transactions on Pattern Analysis and Machine Intelligence 26 551 571 10.1109/TPAMI.2004.1273924
67. Sebastian, T. B., Klein, P. N., & Kimia, B. B. (2001). Recognition of shapes by editing shock graphs. In Proceedings of the eighth international conference on computer vision, Vancouver, Canada (pp. 755-762). Los Alamitos: IEEE Computer Society Press.
68. A. Selinger R. C. Nelson 1999 A perceptual grouping hierarchy for appearance-based 3d object recognition Computer Vision and Image Understanding 76 1 83 92 10.1006/cviu.1999.0788 (Pubitemid 32080252)
69. Sharvit, D., Chan, J., & Kimia, B. B. (1998). Symmetry-based indexing of image databases. In Workshop on content-based access of image and video libraries, CVPR98 (pp. 56-62).
70. Shotton, J., Blake, A., & Cipolla, R. (2005). Contour-based learning for object detection. In ICCV (pp. 281-288).
71. Shotton, J., Winn, J. M., Rother, C., & Criminisi, A. (2006). TextonBoost: Joint appearance, shape and context modeling for multi-class object recognition and segmentation. In Lecture notes in computer science: Vol. 3951. ECCV'06 (pp. 1-15). Berlin: Springer. (Pubitemid 44029764)
72. J. Shotton A. Blake R. Cipolla 2008 Multiscale categorical object recognition using contour fragments IEEE Transactions on Pattern Analysis and Machine Intelligence 30 7 1270 1281 10.1109/TPAMI.2007.70772
73. K. Siddiqi B. B. Kimia 1995 Parts of visual form: computational aspects IEEE Transactions on Pattern Analysis and Machine Intelligence 17 3 239 251 10.1109/34.368189
74. Siddiqi, K., & Kimia, B. B. (1996). A shock grammar for recognition. In Proc. CVPR (pp. 507-513).
75. K. Siddiqi K. J. Tresness B. B. Kimia 1996 Parts of visual form: ecological and psychophysical aspects Perception 25 399 424 10.1068/p250399 (Pubitemid 126695540)
76. K. Siddiqi A. Shokoufandeh S. J. Dickinson S. W. Zucker 1999 Shock graphs and shape matching International Journal of Computer Vision 35 1 13 32 10.1023/A:1008102926703 (Pubitemid 30528015)
77. K. Siddiqi B. B. Kimia AR Tannenbaunm S. W. Zucker 2001 On the psychophysics of the shape triangle Vision Research 41 9 1153 1178 10.1016/S0042-6989(00)00274-1 (Pubitemid 32268614)
78. H. Tek B. B. Kimia 2003 Symmetry maps of free-form curve segments via wave propagation International Journal of Computer Vision 54 1-3 35 81 1076.68069 10.1023/A:1023753317008
79. Todorovic, S., & Ahuja, N. (2006). Extracting subimages of an unknown category from a set of images. In CVPR'06 (pp. 927-934). Los Alamitos: IEEE Computer Society Press. (Pubitemid 44931422)
80. Torralba, A., Murphy, K., & Freeman, W. (2004). Sharing features: efficient boosting procedures for multiclass object detection. In CVPR'04 (pp. 762-769). Los Alamitos: IEEE Computer Society Press.
81. Torsello, A. (2008). An importance sampling approach to learning structural representations of shape. In CVPR'08. Los Alamitos: IEEE Computer Society Press.
82. A. Torsello ER Hancock 2006 Learning shape-classes using a mixture of tree-unions IEEE Transactions on Pattern Analysis and Machine Intelligence 28 6 954 967 10.1109/TPAMI.2006.125
83. J. Triesch C. von der Malsburg 2002 Classification of hand postures against complex backgrounds using elastic graph matching Image and Vision Computing 20 13-14 937 943 10.1016/S0262-8856(02)00100-2 (Pubitemid 35452368)
84. Trinh, N. H., & Kimia, B. B. (2007). A symmetry-based generative model for shape. In ICCV '07: proceedings of the eleventh IEEE international conference on computer vision, Rio de Janeiro, Brazil. Los Alamitos: IEEE Computer Society Press.
85. Trinh, N. H., & Kimia, B. B. (2009). Category-specific object recognition and segmentation using a skeletal shape model. In BMVC'09: proceedings of the British Machine Vision Conference.
86. Trinh, N. H., & Kimia, B. B. (2010). Learning prototypical shapes for object categories. In Proceedings of CVPR workshop on structured models in computer vision (SMiCV'10). Los Alamitos: IEEE Computer Society Press.
87. Viola, P., & Jones, M. (2001). Rapid object detection using a boosted cascade of simple features. In Proceedings of the IEEE computer society conference on computer vision and pattern recognition, Kauai, Hawaii, USA (pp. 511-518). Los Alamitos: IEEE Computer Society Press.
88. Winn, J. M., & Jojic, N. (2005). Locus: Learning object classes with unsupervised segmentation. In ICCV '05: Proceedings of the tenth IEEE international conference on computer vision. (pp. 756-763). Los Alamitos: IEEE Computer Society Press. (Pubitemid 44055031)
89. Yanover, C., & Weiss, Y. (2004). Finding the m most probable configurations in arbitrary graphical models. In S. Thrun, L. K. Saul, & B. Schölkopf (Eds.), NIPS'03. Cambridge: MIT Press.
90. AL Yuille P. W. Hallinan D. S. Cohen 1992 Feature extraction from faces using deformable templates International Journal of Computer Vision 8 2 99 111 10.1007/BF00127169
91. Zhang, J., Luo, J., Collins, R. T., & Liu, Y. (2006). Body localization in still images using hierarchical models and hybrid search. In CVPR'06 (pp. 1536-1543). Los Alamitos: IEEE Computer Society Press. (Pubitemid 44931502)
92. Zhu, Q., Wang, L., Wu, Y., & Shi, J. (2008). Contour context selection for object detection: A set-to-set contour matching approach. In Lecture notes in computer science: Vol. 5303. ECCV (pp. 774-787). Berlin: Springer.
93. S. C. Zhu AL Yuille 1996 FORMS: a flexible object recognition and modeling system International Journal of Computer Vision 20 3 187 212 10.1007/BF00208719 (Pubitemid 126713900)