Semantic pyramids for gender and action recognition

IEEE Transactions on Image Processing

Volumn 23, Issue 8, 2014, Pages 3633-3645

  Khan, Fahad Shahbaz ^a   Van De Weijer, Joost ^b   Anwer, Rao Muhammad ^c   Felsberg, Michael ^a   Gatta, Carlo ^b  

^a LINKÖPING UNIVERSITY   (Sweden)

^b Barcelona Perception Computing Lab   (Spain)

^c AALTO UNIVERSITY   (Finland)

Author keywords

action recognition; bag of words.; Gender recognition; pyramid representation

Indexed keywords

EXPERIMENTS; FEATURE EXTRACTION; SEMANTICS;

ACTION RECOGNITION; ACTION RECOGNITION IN STILL IMAGES; BAG OF WORDS; GENDER RECOGNITION; PYRAMID REPRESENTATION; SEMANTIC INFORMATION; STATE-OF-THE-ART APPROACH; STATE-OF-THE-ART METHODS;

SOCIAL SCIENCES;

ACTIMETRY; ALGORITHM; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOMETRY; COMPUTER ASSISTED DIAGNOSIS; FEMALE; HUMAN; IMAGE ENHANCEMENT; MALE; PROCEDURES; REPRODUCIBILITY; SEMANTICS; SENSITIVITY AND SPECIFICITY; SEX DETERMINATION; WHOLE BODY IMAGING;

ACTIGRAPHY; ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOMETRY; FEMALE; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MALE; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SEMANTICS; SENSITIVITY AND SPECIFICITY; SEX DETERMINATION ANALYSIS; WHOLE BODY IMAGING;

EID: 84904293884     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2331759     Document Type: Article

References (60)

1. L. A. Alexandre, "Gender recognition: A multiscale decision fusion approach, " Pattern Recognit. Lett., vol. 31, no. 11, pp. 1422-1427, 2010.
2. A. Bosch, A. Zisserman, and X. Munoz, "Representing shape with a spatial pyramid kernel, " in Proc. ACM Int. Conf. Image Video Retr. (CIVR), 2007.
3. L. Bourdev, S. Maji, and J. Malik, "Describing people: A poselet-based approach to attribute classification, " in Proc. Int. Conf. Comput. Vis. (ICCV), 2011.
4. L. Bourdev and J. Malik, "Poselets: Body part detectors trained using 3D human pose annotations, " in Proc. Int. Conf. Comput. Vis. (ICCV), 2009.
5. J. Chen et al., "WLD: A robust local image descriptor, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1705-1720, Sep. 2010.
6. M. Collins, J. Zhang, P. Miller, and H. Wang, "Full body image feature representations for gender profiling, " in Proc. Int. Conf. Comput. Vis. (ICCV) Workshop, 2009.
7. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2005, pp. 886-893. (Pubitemid 43897286)
8. M. Dantone, J. Gall, G. Fanelli, and L. J. V. Gool, "Real-time facial feature detection using conditional regression forests, " in Proc. Comput. Vis. Pattern Recognit. (CVPR), 2012.
9. V. Delaitre, I. Laptev, and J. Sivic, "Recognizing human actions in still images: A study of bag-of-features and part-based representations, " in Proc. Brit. Mach. Vis. Conf. (BMVC), 2010.
10. V. Delaitre, J. Sivic, and I. Laptev, "Learning person-object interactions for action recognition in still images, " in Proc. 25th Annu. Conf. Neural Inform. Process. Syst. (NIPS), 2011.
11. K. Duan, D. Parikh, D. Crandall, and K. Grauman, "Discovering localized attributes for fine-grained recognition, " in Proc. Comput. Vis. Pattern Recognit. (CVPR), 2012.
12. M. Eichner, M. Marin-Jimenez, A. Zisserman, and V. Ferrari, "2D articulated human pose estimation and retrieval in (almost) unconstrained still images, " Int. J. Comput. Vis., vol. 99, no. 2, pp. 190-214, Feb. 2012.
13. N. Elfiky, F. S. Khan, J. van de Weijer, and J. Gonzalez, "Discriminative compact pyramids for object and scene recognition, " Pattern Recognit., vol. 45, no. 4, pp. 1627-1636, 2012.
14. M. Everingham, L. J. V. Gool, C. K. I. Williams, J. M. Winn, and A. Zisserman, "The pascal visual object classes (VOC) challenge, " Int. J. Comput. Vis., vol. 88, no. 2, pp. 303-338, 2010.
15. R. Farrell, O. Oza, N. Zhang, V. I. Morariu, T. Darrell, and L. S. Davis, "Birdlets: Subordinate categorization using volumetric primitives and pose-normalized appearance, " in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Nov. 2011, pp. 161-168.
16. P. F. Felzenszwalb, R. B. Girshick, D. A. McAllester, and D. Ramanan, "Object detection with discriminatively trained part-based models, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1627-1645, Sep. 2010.
17. P. F. Felzenszwalb and D. P. Huttenlocher, "Pictorial structures for object recognition, " Int. J. Comput. Vis., vol. 61, no. 1, pp. 55-79, 2005.
18. V. Ferrari, M. Marin-Jimenez, and A. Zisserman, "Progressive search space reduction for human pose estimation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2008, pp. 1-8.
19. M. A. Fischler and R. A. Elschlager, "The representation and matching of pictorial structures, " IEEE Trans. Comput., vol. 100, no. 1, pp. 67-92, Jan. 1973.
20. E. Gavves, B. Fernando, C. Snoek, A. Smeulders, and T. Tuytelaars, "Fine-grained categorization by alignments, " in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Sep. 2013, pp. 1-6.
21. Z. Guo, L. Zhang, and D. Zhang, "A completed modeling of local binary pattern operator for texture classification, " IEEE Trans. Image Process., vol. 19, no. 6, pp. 1657-1663, Jun. 2010.
22. Z. Guo, L. Zhang, and D. Zhang, "Rotation invariant texture classification using LBP variance (LBPV) with global matching, " Pattern Recognit., vol. 43, no. 3, pp. 706-719, 2010.
23. A. Gupta and L. Davis, "Objects in action: An approach for combining action understanding and object perception, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2007, pp. 1-8.
24. A. Gupta, A. Kembhavi, and L. Davis, "Observing human-object interactions: Using spatial and functional compatibility for recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 10, pp. 1775-1789, Oct. 2009.
25. M. Hussain, S. Al-Otaibi, G. Muhammad, H. Aboalsamh, G. Bebis, and A. M. Mirza, "Gender recognition using nonsubsampled contourlet transform and WLD descriptor, " in Proc. Scandin. Conf. Image Anal. (SCIA), 2013, pp. 373-383.
26. M. Juneja, A. Vedaldi, C. V. Jawahar, and A. Zisserman, "Blocks that shout: Distinctive parts for scene classification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), May 2013, pp. 1-7.
27. F. S. Khan, R. M. Anwer, J. van de Weijer, A. Bagdanov, A. Lopez, and M. Felsberg, "Coloring action recognition in still images, " Int. J. Comput. Vis., vol. 105, no. 3, pp. 205-221, 2013.
28. F. S. Khan, R. M. Anwer, J. van de Weijer, A. Bagdanov, M. Vanrell, and A. Lopez, "Color attributes for object detection, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2012, pp. 3306-3313.
29. F. S. Khan, J. van de Weijer, S. Ali, and M. Felsberg, "Evaluating the impact of color on texture recognition, " in Proc. Comput. Anal. Images Patterns (CAIP), 2013, pp. 154-162.
30. F. S. Khan, J. van de Weijer, A. Bagdanov, and M. Felsberg, "Scale coding bag-of-words for action recognition, " in Proc. Int. Conf. Pattern Recognit. (ICPR), 2014.
31. F. S. Khan, J. van de Weijer, A. D. Bagdanov, and M. Vanrell, "Portmanteau vocabularies for multi-cue image representations, " in Proc. Neural Inform. Process. Syst. (NIPS), Dec. 2011.
32. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), 2006, pp. 2169-2178. (Pubitemid 44931582)
33. C. Li and K. Kitani, "Pixel-level hand detection for ego-centric videos, " in Proc. Comput. Vis. Pattern Recognit. (CVPR), 2013.
34. L.-J. Li, H. Su, E. P. Xing, and F.-F. Li, "Object bank: A highlevel image representation for scene classification and semantic feature sparsification, " in Proc. Neural Inform. Process. Syst. (NIPS), 2010.
35. M. Li, S. Bao, W. Dong, Y. Wang, and Z. Su, "Head-shoulder based gender recogntion, " in Proc. 20th IEEE Int. Conf. Image Process. (ICIP), Sep. 2013, pp. 2753-2756.
36. S. Maji, L. D. Bourdev, and J. Malik, "Action recognition from a distributed representation of pose and appearance, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2011, pp. 3177-3184.
37. E. Makinen and R. Raisamo, "Evaluation of gender classification methods with automatically detected and aligned faces, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 3, pp. 541-547, Mar. 2008. (Pubitemid 351280060)
38. A. Mittal, A. Zisserman, and P. Torr, "Hand detection using multiple proposals, " in Proc. Brit. Mach. Vis. Conf. (BMVC), 2011.
39. A. Prest, C. Schmid, and V. Ferrari, "Weakly supervised learning of interactions between humans and objects, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 3, pp. 601-614, Mar. 2012.
40. W. R. Schwartz, A. Kembhavi, D. Harwood, and L. S. Davis, "Human detection using partial least squares analysis, " in Proc. IEEE 12th Int. Conf. Comput. Vis. (ICCV), Oct. 2009, pp. 24-31.
41. C. Shan, "Learning local binary patterns for gender classification on realworld face images, " Pattern Recognit. Lett., vol. 33, no. 4, pp. 431-437, 2012.
42. N. Shapovalova, W. Gong, M. Pedersoli, F. X. Roca, and J. Gonzalez, "On importance of interactions and context in human action recognition, " in Proc. Pattern Recognit. Image Anal. (PRIA), 2011, pp. 58-66.
43. G. Sharma, F. Jurie, and C. Schmid, "Discriminative spatial saliency for image classification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2012, pp. 3506-3513.
44. G. Sharma, F. Jurie, and C. Schmid, "Expanded parts model for human attribute and action recognition in still images, " in Proc. Int. Conf. Comput. Vis. Pattern Recognit. (CVPR), 2013, pp. 652-659.
45. K. van de Sande, T. Gevers, and C. G. M. Snoek, "Evaluating color descriptors for object and scene recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1582-1596, Sep. 2010.
46. J. van de Weijer, C. Schmid, J. J. Verbeek, and D. Larlus, "Learning color names for real-world applications, " IEEE Trans. Image Process., vol. 18, no. 7, pp. 1512-1524, Jul. 2009.
47. P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), vol. 1. 2001, pp. 511-518.
48. P. A. Viola and M. J. Jones, "Robust real-time face detection, " Int. J. Comput. Vis., vol. 57, no. 2, pp. 137-154, 2004.
49. S. Walk, N. Majer, K. Schindler, and B. Schiele, "New features and insights for pedestrian detection, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2010, pp. 1030-1037.
50. J. Wang, J. Yang, K. Yu, F. Lv, T. S. Huang, and Y. Gong, "Localityconstrained linear coding for image classification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2010, pp. 3360-3367.
51. J. Wu, W. Smith, and E. Hancock, "Facial gender classification using shape-from-shading, " Image Vis. Comput., vol. 28, no. 6, pp. 1039-1048, 2010.
52. J. Wu, W. Smith, and E. Hancock, "Gender discriminating models from facial surface normals, " Pattern Recognit., vol. 44, no. 12, pp. 2871-2886, 2011.
53. J. Xing, H. Ai, and S. Lao, "Multiple human tracking based on multiview upper-body detection and discriminative learning, " in Proc. 20th Int. Conf. Pattern Recognit. (ICPR), Aug. 2010, pp. 1698-1701.
54. Y. Yang, S. Baker, A. Kannan, and D. Ramanan, "Recognizing proxemics in personal photos, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (ICPR), Jun. 2012, pp. 1-5.
55. B. Yao, X. Jiang, A. Khosla, A. L. Lin, L. J. Guibas, and F.-F. Li, "Human action recognition by learning bases of action attributes and parts, " in Proc. Int. Conf. Comput. Vis. (ICCV), 2011.
56. B. Yao and F.-F. Li, "Modeling mutual context of object and human pose in human-object interaction activities, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2010, pp. 17-24.
57. B. Yao and F.-F. Li, "Recognizing human-object interactions in still images by modeling the mutual context of objects and human poses, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 9, pp. 1691-1703, Sep. 2012.
58. J. Zhang, M. Marszalek, S. Lazebnik, and C. Schmid, "Local features and kernels for classification of texture and object catergories: A comprehensive study, " Int. J. Comput. Vis., vol. 73, no. 2, pp. 213-218, 2007.
59. N. Zhang, R. Farrell, F. Iandola, and T. Darrell, "Deformable part descriptors for fine-grained recognition and attribute prediction, " in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Dec. 2013, pp. 729-736.
60. X. Zhu and D. Ramanan, "Face detection, pose estimation, and landmark localization in the wild, " in Proc. IEEE Conf. Biomet. Compendium, Comput. Vis. Pattern Recognit. (CVPR), Jun. 2012, pp. 2879-2886.