Tangent bundles on special manifolds for action recognition

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 22, Issue 6, 2012, Pages 930-942

  Lui, Yui Man ^a  

^a University Services Building   (United States)

Author keywords

Action recognition; Grassmann manifolds; special orthogonal group; Stiefel manifolds; tangent bundles

Indexed keywords

ACTION RECOGNITION; GRASSMANN MANIFOLD; SPECIAL ORTHOGONAL GROUP; STIEFEL MANIFOLD; TANGENT BUNDLES;

DATA PROCESSING; GESTURE RECOGNITION; MOTION ESTIMATION; VIDEO STREAMING;

TENSORS;

EID: 84861981746     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2011.2181452     Document Type: Article

References (53)

1. R. Poppe, "A survey on vision-based human action recognition," Image Vision Comput., vol. 28, no. 6, pp. 976-990, 2010.
2. P. Turaga, R. Chellappa, V. S. Subrahmanian, and O. Udrea, "Machine recognition of human activities: A survey," IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 11, pp. 1473-1488, Nov. 2008.
3. A. Kovashka and K. Grauman, "Learning a hierarchy of discriminative space-time neighborhood features for human action recognition," in Proc. IEEE Conf. Comput. Vision Patt. Recog., Jun. 2010, pp. 2046-2053.
4. M. Bregonzio, J. Li, S. Gong, and T. Xiang, "Discriminative topics modelling for action feature selection and recognition," in Proc. British Mach. Vision Conf., 2010, pp. 1-11.
5. H. Wang, M. Ullah, A. Klaser, I. Laptev, and C. Schmid, "Evaluation of local spatio-temporal features for action recognition," in Proc. British Mach. Vision Conf., 2009.
6. L. Gorelick, E. Shechtman, M. Irani, and R. Basri, "Actions as spacetime shapes," IEEE Trans. Patt. Anal. Mach. Intell., vol. 29, no. 12, pp. 2247-2253, Dec. 2007.
7. A. F. Bobick and J. Davis, "An appearance-based representation of action," in Proc. Int. Conf. Patt. Recog., Aug. 1996, pp. 307-312.
8. A. Fathi and G. Mori, "Action recognition by learning learning mid-level motion features," in Proc. IEEE Conf. Comput. Vision Patt. Recog., Jun. 2008, pp. 1-8.
9. A. Bissacco, A. Chiuso, Y. Ma, and S. Soatto, "Recognition of human gaits," in Proc. IEEE Conf. Comput. Vision Patt. Recog., 2001, pp. 52-57.
10. T. Mauthner, P. M. Roth, and H. Bischof, "Temporal feature weighting for prototype-based action recognition," in Proc. Asian Conf. Comput. Vision, 2010, pp. 566-579.
11. Z. Lin, Z. Jiang, and L. Davis, "Recognizing actions by shape-motion prototype trees," in Proc. IEEE Int. Conf. Comput. Vision, Sep.-Oct. 2009, pp. 444-451.
12. B. Krausz and C. Bauckhage, "Action recognition in videos using nonnegative tensor factorization," in Proc. Int. Conf. Patt. Recog., Aug. 2010, pp. 1763-1766.
13. T.-K. Kim and R. Cipolla, "Canonical correlation analysis of video volume tensors for action categorization and detection," IEEE Trans. Patt. Anal. Mach. Intell., vol. 31, no. 8, pp. 1415-1428, Aug. 2009.
14. H. Lu, K. N. Plataniots, and A. N. Venetsanopoulos, "MPCA: Multilinear principal component analysis of tensor objects," IEEE Trans. Neural Netw., vol. 19, no. 1, pp. 18-39, Jan. 2008. (Pubitemid 351279223)
15. M. A. O. Vasilescu, "Human motion signatures: Analysis, synthesis, recognition," in Proc. Int. Conf. Patt. Recog., 2002, pp. 456-460. (Pubitemid 44844525)
16. Y. M. Lui, "Advances in matrix manifolds for computer vision," Image Vision Comput., to be published.
17. A. Veeraraghavan, A. K. Roy-Chowdhury, and R. Chellappa, "Matching shape sequences in video with applications in human movement analysis," IEEE Trans. Patt. Anal. Mach. Intell., vol. 27, no. 12, pp. 1896-1909, Dec. 2005. (Pubitemid 43051387)
18. Y. M. Lui, J. R. Beveridge, and M. Kirby, "Canonical Stiefel quotient and its application to generic face recognition in illumination spaces," in Proc. IEEE Int. Conf. Biometrics: Theory, Applicat. Syst., Sep. 2009, pp. 1-8.
19. Y. M. Lui and J. R. Beveridge, "Tangent bundle for human action recognition," in Proc. IEEE Int. Conf. Automat. Face Gesture Recog., Mar. 2011, pp. 97-102.
20. T. Lin and H. Zha, "Riemannian manifold learning," IEEE Trans. Patt. Anal. Mach. Intell., vol. 30, no. 5, pp. 796-809, May 2008. (Pubitemid 351486749)
21. Y. M. Lui and J. R. Beveridge, "Grassmann registration manifolds for face recognition," in Proc. Eur. Conf. Comput. Vision, France, 2008, pp. 44-57.
22. M. Brand, "Charting a manifold," in Proc. Adv. Neural Inform. Proc. Syst., 2002, pp. 961-968.
23. J. A. Lee and M. Verleysen, Nonlinear Dimensionality Reduction. New York: Springer, 2007.
24. A. Veeraraghavan, A. Srivastava, A. K. Roy-Chowdhury, and R. Chellappa, "Rate-invariant recognition of humans and their activities," IEEE Trans. Image Process., vol. 18, no. 6, pp. 1326-1339, Jun. 2009.
25. P. Turaga, A. Veeraraghavan, A. Srivastava, and R. Chellappa, "Statistical computations on Grassmann and Stiefel manifolds for image and video-based recognition," IEEE Trans. Patt. Anal. Mach. Intell., vol. 33, no. 11, pp. 2273-2286, Nov. 2011.
26. A. Elgammal and C.-S. Lee, "Tracking people on a torus," IEEE Trans. Patt. Anal. Mach. Intell., vol. 31, no. 3, pp. 520-538, Mar. 2009.
27. L. Wang and D. Suter, "Learning and matching of dynamic shape manifolds for human action recognition," IEEE Trans. Image Process., vol. 16, no. 6, pp. 1646-1661, Jun. 2007. (Pubitemid 46796060)
28. M. Rodriguez, J. Ahmed, and M. Shah, "Action MACH: A spatiotemporal maximum average correlation height filter for action recognition," in Proc. IEEE Conf. Comput. Vision Patt. Recog., Jun. 2008, pp. 1-8.
29. K. Guo, P. Ishwar, and J. Konrad, "Action recognition using sparse representation on covariance manifold of optical flow," in Proc. IEEE Int. Conf. Adv. Video Signal-Based Surveillance, Aug.-Sep. 2010, pp. 188-195.
30. M. F. Abdelkader, W. Abd-Almageeda, A. Srivastavab, and R. Chellappa, "Silhouette-based gesture and action recognition via modeling trajectories on riemannian manifolds," Comput. Vision Image Understand., vol. 115, no. 3, pp. 439-455, 2011.
31. R. Chaudhry and Y. Ivanov, "Fast approximate nearest neighbor methods for non-Euclidean manifolds with applications to human activity analysis in videos," in Proc. Eur. Conf. Comput. Vision, 2010, pp. 735-748.
32. D. Kendall, "Shape manifolds, procrustean metrics and complex projective spaces," Bull. London Math. Soc., vol. 16, no. 2, pp. 81-121, 1984.
33. Y. M. Lui, J. R. Beveridge, and M. Kirby, "Action classification on product manifolds," in Proc. IEEE Conf. Comput. Vision Patt. Recog., Jun. 2010, pp. 833-839.
34. Y. Chikuse, Statistics on Special Manifolds. Springer: New York, 2003.
35. R. Li and R. Chellappa, "Aligning spatio-temporal signals on a special manifold," in Proc. Eur. Conf. Comput. Vision, 2010, pp. 547-560.
36. J. Carroll and J. Chang, "Analysis of individual differences in multidimensional scaling via an n-way generalization of "Eckart-Young" decomposition," Psychometrika, vol. 35, no. 3, pp. 283-319, Sep. 1970.
37. L. De Lathauwer, B. D. Moor, and J. Vandewalle, "A multilinear singular value decomposition," SIAM J. Matrix Anal. Appl., vol. 21, no. 4, pp. 1253-1278, 2000. (Pubitemid 33217068)
38. S. Gudmundsson and E. Kappos, "On the geometry of tangent bundles," Expositiones Mathematicae, vol. 20, no. 1, pp. 1-41, 2002.
39. A. T. James, "Normal multivariate analysis and the orthogonal group," Ann. Math. Statist., vol. 25, no. 1, pp. 40-75, 1954.
40. P.-A. Absil, R. Mahony, and R. Sepulchre, Optimization Algorithms on Matrix Manifolds. Princeton, NJ: Princeton Univ. Press, 2008.
41. J. Lee, Introduction to Smooth Manifolds. New York: Springer, 2003.
42. R. Goodman and N. R. Wallach, Representations and Invariants of the Classical Groups. Cambridge, MA: Cambridge Univ. Press, 1998.
43. A. Edelman, R. Arias, and S. Smith, "The geometry of algorithms with orthogonality constraints," SIAM J. Matrix Anal. Appl., vol. 20, no. 2, pp. 303-353, 1998. (Pubitemid 129333771)
44. T.-K. Kim and R. Cipolla, "Gesture recognition under small sample size," in Proc. Asian Conf. Comput. Vision, 2007, pp. 335-344.
45. T.-K. Kim, J. Kittler, and R. Cipolla, "Discriminative learning and recognition of image set classes using canonical correlations," IEEE Trans. Patt. Anal. Mach. Intell., vol. 29, no. 6, pp. 1005-1018, Jun. 2007. (Pubitemid 46667413)
46. Y. Yuan, H. Zheng, Z. Li, and D. Zhang, "Video action recognition with spatio-temporal graph embedding and spline modeling," in Proc. IEEE Int. Conf. Acou., Speech, Signal Process., Mar. 2010, pp. 2422-2425.
47. Q. Le, W. Zou, S. Yeung, and A. Ng, "Learning hierarchical invariant spatio-temporal features for action recognition with independent subspace analysis," in Proc. IEEE Conf. Comput. Vision Patt. Recog., Jun. 2011, pp. 3361-3368.
48. X. Wu, D. Xu, L. Duan, and J. Luo, "Action recognition using context and appearance distribution features," in Proc. IEEE Conf. Comput. Vision Patt. Recog., Jun. 2011, pp. 489-496.
49. S. Jones, L. Shao, J. Zhang, and Y. Liu, "Relevance feedback for realworld human action retrieval," Patt. Recog. Lett., to be published.
50. J. H. Ward, "Hierarchical grouping to optimize an objective function," J. Am. Statist. Assoc., vol. 58, no. 301, pp. 236-244, 1963.
51. C. Scḧuldt, I. Laptev, and B. Caputo, "Recognizing human actions: A local SVM approach," in Proc. Int. Conf. Patt. Recog., Aug. 2004, pp. 32-36.
52. J. Yuan, Z. Liu, and Y. Wu, "Discriminative subvolume search for efficient action detection," in Proc. IEEE Conf. Comput. Vision Patt. Recog., Jun. 2009, pp. 2442-2449.
53. C.-S. Lee, Y. M. Lui, and S. Chun, "Human action silhouette recognition based on tensor analysis using synthetic silhouette data," in Proc. IEEE Workshop Performance Eval. Recog. Human Actions Pose Estimation Methods (in Conjuction ICCV), to be published.