Sparse B-spline polynomial descriptors for human activity recognition

Image and Vision Computing

Volumn 27, Issue 12, 2009, Pages 1814-1825

  Oikonomopoulos, Antonios ^a   Pantic, Maja ^a,b   Patras, Ioannis ^c  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF TWENTE   (Netherlands)

^c QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

B splines; Gentleboost; Median filter; Optical flow; Relevance Vector Machine; Spatiotemporal salient points

Indexed keywords

CAMERAS; COUPLINGS; FLOW FIELDS; IMAGE PROCESSING; IMAGE RETRIEVAL; OPTICAL FLOWS; OPTICAL PROPERTIES; SHIP PROPELLERS; SPLINES; WINDOWS;

B-SPLINES; GENTLEBOOST; MEDIAN FILTER; RELEVANCE VECTOR MACHINE; SPATIOTEMPORAL SALIENT POINTS;

OPTICAL FILTERS;

EID: 70349286008     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2009.05.010     Document Type: Article

References (59)

1. Poppe R. Vision-based human motion analysis: an overview. Computer Vision and Image Understanding 108 (2007) 4-18
2. Pantic M., Pentland A., Nijholt A., and Huang T. Human computing and machine understanding of human behavior: a survey. Lecture Notes in Artificial Intelligence 4451 (2007) 47-71
3. Mitra S., and Acharya T. Gesture recognition: a survey. IEEE Transactions on Systems, Man and Cybernetics (SMC) Part C 37 (2007) 311-324
4. Moeslund T.B., Hilton A., and Krueger V. A survey of advances in vision-based human motion capture and analysis. Computer Vision and Image Understanding 104 (2006) 90-126
5. Aggarwal J., and Cai Q. Human motion analysis: a review. Computer Vision and Image Understanding 73 (1999) 428-440
6. L. Sigal, S. Bhatia, S. Roth, M. Black, M. Isard, Tracking loose-limbed people, in: Proceedings, IEEE Conference on Computer Vision and Pattern Recognition, vol. 1., 2004, pp. 421-428.
7. Ramanan D., Forsyth D.A., and Zisserman A. Tracking people by learning their appearance. IEEE Transactions on Pattern Analysis and Machine Intelligence 29 (2007) 65-81
8. Moon H., and Chellappa R. 3d shape-encoded particle filter for object tracking and its application to human body tracking. EURASIP Journal on Image and Video Processing (2008)
9. Abdelkader M., Roy-Chowdhury A., Chellappa R., and Akdemir U. Activity representation using 3d shapemodels. EURASIP Journal on Image and Video Processing (2008)
10. A. Oikonomopoulos, M. Pantic, Human body gesture recognition using adapted auxiliary particle filtering, in: Advanced Video and Signal Based Surveillance, 2007, pp. 441-446.
11. A. Yilmaz, M. Shah, Recognizing human actions in videos acquired by uncalibrated moving cameras, in: Proceedings of IEEE International Conference Computer Vision, vol. 1., 2005, pp. 150-157.
12. Y. Sheikh, M. Sheikh, M. Shah, Exploring the space of a human action, in: Proceedings of IEEE International Conference Computer Vision, vol. 1, 2005, pp. 144- 149.
13. Stenger B., Thayananthan A., Torr P., and Cipolla R. Model-based hand tracking using a hierarchical Bayesian filter. IEEE Transactions on Pattern Analysis and Machine Intelligence 28 (2006) 1372-1384
14. Guo F., and Qian G. Monocular 3d tracking of articulated human motion in silhouette and pose manifolds. EURASIP Journal on Image and Video Processing (2008)
15. Matthews I., Ishikawa T., and Baker S. The template update problem. IEEE Transactions on Pattern Analysis and Machine Intelligence 26 (2004) 810-815
16. Mikolajczyk K., and Schmid C. A performance evaluation of local descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence 27 (2005) 1615-1630
17. I. Laptev, T. Lindeberg, Space-time Interest Points, in: Proceedings, IEEE Conference on Computer Vision and Pattern Recognition, 2003, pp. 432-439.
18. C. Schuldt, I. Laptev, B. Caputo, Recognizing human actions: a local svm approach, in: Proceedings, IEEE Conference on Computer Vision and Pattern Recognition, vol. 3., 2004, pp. 32-36.
19. Dollar P., Rabaud V., Cottrell G., and Belongie S. Behavior recognition via sparse spatio-temporal features. VS-PETS (2005) 65-72
20. Oikonomopoulos A., Patras I., and Pantic M. Spatiotemporal salient points for visual recognition of human actions. IEEE Transactions on Systems, Man and Cybernetics Part B 36 (2005) 710-719
21. Kadir T., and Brady M. Scale saliency: a novel approach to salient feature and scale selection. International Conference on Visual Information Engineering (2000) 25-28
22. Lowe D. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60 (2004) 91-110
23. A. Agarwal, B. Triggs, Hyperfeatures multilevel local coding for visual recognition, in: European Conference on Computer Vision, vol. 1., 2006 pp. 30-43.
24. l.J. Li, L. Fei-Fei, What, where and who? classifying events by scene and object recognition, in: ICCV, 2007, pp. 1-8.
25. Sivic J., and Zisserman A. Video google: efficient visual search of videos. LNCS 4170 (2006) 127-144
26. Belongie S., Malik J., and Puzicha J. Shape matching and object recognition using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence 24 (2002) 509-522
27. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: Proceedings, IEEE Conference on Computer Vision and Pattern Recognition, vol. 1. 2005, pp. 886-893.
28. C. Thurau, Behavior histograms for action recognition and human detection, in: ICCV Workshop on Human Behavior, 2007, pp. 299-312.
29. E. Shechtman, M. Irani, Matching local self-similarities across images and videos, in: Proceedings, IEEE Conference on Computer Vision and Pattern Recognition, 2007.
30. I. Laptev, P. Perez, Retrieving actions in movies. in: Proceedings, IEEE International Conference on Computer Vision, 2007, pp. 1-8.
31. A. Klaeser, M. Marszalek, C. Schmid, A spatiotemporal descriptor based on 3d gradients, in: British Machine Vision Conference, 2008.
32. T. Serre, L. Wolf, T. Poggio, Object recognition with features inspired by visual cortex, in: Proceedings, IEEE Conference on Computer Vision and Pattern Recognition, vol. 2., 2005, pp. 994-1000.
33. H. Jhuang, T. Serre, L. Wolf, T. Poggio, A biologically inspired system for action recognition, in: Proceedings, IEEE International Conference on Computer Vision, 2007.
34. S. Wong, R. Cipolla, Extracting spatiotemporal interest points using global information, in: Proceedings, IEEE International Conference on Computer Vision, 2007, pp. 1-8.
35. Y. Ke, R. Sukthankar, M. Hebert, Efficient visual event detection using volumetric features, in: Proceedings, IEEE International Conference on Computer Vision, vol. 1, 2005, pp. 166-173.
36. H. Jiang, R. Martin, Finding actions using shape flows, in: European Conference on Computer Vision, 2008.
37. P. Natarajan, R. Nevatia, View and scale invariant action recognition using multiview shape-flow models, in: Proceedings, IEEE Conference on Computer Vision and Pattern Recognition, 2008, pp. 1-8.
38. A. Fathi, G. Mori, Action recognition by learning mid-level motion features, in: Proceedings, IEEE Conference on Computer Vision and Pattern Recognition, 2008, pp. 1-8.
39. Ahmad M., and Lee S. Human action recognition using shape and clg-motion flow from multi-view image sequences. Pattern Recognition 41 (2008) 2237-2252
40. E. Shechtman, M. Irani, Space-time behavior based correlation, in: Proceedings, IEEE Conference on Computer Vision and Pattern Recognition, vol. 1. 2005, pp. 405-412.
41. Bobick A., and Davis J. The recognition of human movement using temporal templates. IEEE Transactions on Pattern Analysis and Machine Intelligence 23 (2001) 257-267
42. Y. Ke, R. Sukthankar, M. Hebert, Event detection in crowded videos, in: Proceedings, IEEE International Conference on Computer Vision, 2007, pp. 1-8.
43. Moosmann F., Triggs B., and Jurie F. Fast discriminative visual codebooks using randomized clustering forests. NIPS (2006) 985-992
44. K. Mikolajczyk, H. Uemura, Action recognition with motion-appearance vocabulary forest, in: Proceedings, IEEE Conference on Computer Vision and Pattern Recognition, 2008, pp. 1-8.
45. Leibe B., Leonardis A., and Schiele B. Combined object categorization and segmentation with an implicit shape model. ECCV'04 Workshop on Statistical Learning in Computer Vision (2004) 17-32
46. Ikizler N., and Duygulu P. Human action recognition using distribution of oriented rectangular patches. Lecture Notes in Computer Science 4814 (2007) 271-284
47. M. Marszalek, C. Schmid, Spatial weighting for bag-of-features, in: Proceedings, IEEE Conference on Computer Vision and Pattern Recognition, vol. 2., 2006, pp. 2118-2125.
48. A. Opelt, A. Pinz, A. Zisserman, A boundary-fragment-model for object detection, in: Proceedings of the European Conference on Computer Vision, 2006.
49. J. Sivic, B. Russell, A. Efros, A. Zisserman, W. Freeman, Discovering Objects and their Location in Images, in: Proceedings, IEEE International Conference on Computer Vision, vol. 1., 2005, pp. 370-377.
50. J. Niebles, L. Fei-Fei, A hierarchical model of shape and appearance for human action classification, in: Proceedings, IEEE Conference on Computer Vision and Pattern Recognition, 2007.
51. J.C. Niebles, H. Wang, L. Fei-Fei, Unsupervised learning of human action categories using spatial-temporal words, in: British Machine Vision Conference, vol. 1, 2006.
52. M. Black, P. Anandan, A framework for the robust estimation of optical flow, in: ICCV, 1993, pp. 231-236.
53. Tipping M. The relevance vector machine. Advances in Neural Information Processing Systems (1999) 652-658
54. M. Blank, L. Gorelick, E. Shechtman, M. Irani, R. Basri, Actions as space-time shapes, in: Proceedings, IEEE International Conference on Computer Vision, vol. 2. 2005, pp. 1395-1402.
55. J. Friedman, T. Hastie, R. Tibshirani, Additive logistic regression: a statistical view of boosting, Stanford University Technical Report, 1993.
56. Shashua A., and Riklin-Raviv T. The quotient image: class-based re-rendering and recognition with varying illuminations. IEEE Transactions on Pattern Analysis and Machine Intelligence 23 (2001) 129-139
57. A. Torralba, K. Murphy, W. Freeman, Sharing features: efficient boosting procedures for multiclass object detection. in: CVPR, 2004, pp. 762-769.
58. Black M., and Rangarajan A. On the unification of line processes, outlier rejection, and robust statistics. International Journal of Computer Vision 19 (1996) 57-91
59. Fergus R., Perona P., and Zisserman A. Weakly supervised scale-invariant learning of models for visual recognition. International Journal of Computer Vision 71 (2007) 273-303