Using a minimal action grammar for activity understanding in the real world

IEEE International Conference on Intelligent Robots and Systems

Volumn , Issue , 2012, Pages 4104-4111

  Summers Stay, Douglas ^a   Teo, Ching L ^a   Yang, Yezhou ^a   Fermuller, Cornelia ^a   Aloimonos, Yiannis ^a  

^a University of Maryland ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

2D IMAGES; COMPLEX ACTIVITY; DATA SETS; GRAMMATICAL STRUCTURE; TIME-OF-FLIGHT CAMERAS; TREE STRUCTURES;

DATA PROCESSING; FORESTRY; INTELLIGENT SYSTEMS;

TREES (MATHEMATICS);

DATA PROCESSING; EXPERIMENTATION; PERFORMANCE; PROBLEM SOLVING;

EID: 84872358456     PISSN: 21530858     EISSN: 21530866     Source Type: Conference Proceeding    
DOI: 10.1109/IROS.2012.6385483     Document Type: Conference Paper

References (39)

1. E. E. Aksoy, A. Abramov, J. Dörr, K. Ning, B. Dellen, and F. Wörgötter. Learning the semantics of object-action relations by observation. International Journal of Robotics Research, 30(10):1229-1249, 2011.
2. P. Bauer. Recalling past events: from infancy to early childhood. Annals of Child Development, 11:25-71, 1995.
3. R. Chalodhorn, D. Grimes, R. R. Gabriel, and M. Asada. Learning humanoid motion dynamics through sensory-motor mapping in reduced dimensional spaces. In ICRA, 2006.
4. R. Chaudhry, A. Ravichandran, G. Hager, and R. Vidal. Histograms of oriented optical flow and binet-cauchy kernels on nonlinear dynamical systems for the recognition of human actions. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, 2009.
5. J. Chavaillon. Andr leroi-gourhan, le geste et la parole. L'Homme, 7(3):122-124, 1967.
6. N. Chomsky. Lectures on Government and Binding: The Pisa Lectures. Mouton de Gruyter, 1993.
7. P. Dollár, V. Rabaud, G. Cottrell, and S. Belongie. Behavior recognition via sparse spatio-temporal features. In VS-PETS, October 2005.
8. L. Fadiga, L. Fogassi, V. Gallese, and G. Rizzolatti. Visuomotor neurons: ambiguity of the discharge or motor perception? International Journal of Psychophysiology, 35:165-177, 2000.
9. L. Fogassi, P. F. Ferrari, B. Gesierich, S. Rozzi, F. Chersi, and G. Rizzolatti. Parietal lobe: From action organization to intention understanding. Science, 308:662-667, 2005.
10. S. Gong and T. Xiang. Recognition of group activities using dynamic probabilistic networks. In Proc. International Conference on Computer Vision, 2003.
11. L. Gorelick, M. Blank, E. Shechtman, M. Irani, and R. Basri. Actions as space-time shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(12):2247-2253, 2007.
12. A. Gupta and L. S. Davis. Objects in action: An approach for combining action understanding and object perception. In CVPR. IEEE Computer Society, 2007.
13. S. Hongeng and R. Nevatia. Large-scale event detection using semi-hidden markov models. In Proc. International Conference on Computer Vision, 2003.
14. Y. Ivanov and A. Bobick. Recognition of visual activities and interactions by stochastic parsing. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000.
15. A. Kale, A. Sundaresan, A. N. Rajagopalan, N. P. Cuntoor, A. K. Roy-Chowdhury, V. Kruger, and R. Chellappa. Identification of humans using gait. IEEE Transactions on Image Processing, 13(9):1163-1173, 2004.
16. H. Kjellstrom, J. Romero, and D. Kragic. Simultaneous visual recognition of manipulation actions and manipulated objects. In Proc. European Conference on Computer Vision, 2008.
17. F. D. la Torre, J. Hodgins, J. Montano, S. Valcarcel, R. Forcada, and J. Macey. Guide to the carnegie mellon university multimodal activity (cmu-mmac) database. Technical report, CMU-RI-TR-08-22, Robotics Institute, Carnegie Mellon University, July 2009.
18. I. Laptev. On space-time interest points. International Journal of Computer Vision, 64(2-3):107-123, 2005.
19. B. Laxton, J. Lim, and D. Kriegman. Leveraging temporal, contextual and ordering constraints for recognizing complex activities in video. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, 2007.
20. Y. Li, C. Fermuller, Y. Aloimonos, and H. Ji. Learning shift-invariant sparse representation of actions. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, 2010.
21. R. Messing, C. Pal, and H. Kautz. Activity recognition using the velocity histories of tracked keypoints. In ICCV '09: Proceedings of the Twelfth IEEE International Conference on Computer Vision, Washington, DC, USA, 2009. IEEE Computer Society.
22. T. B. Moeslund, A. Hilton, and V. Krüger. A survey of advances in vision-based human motion capture and analysis. Computer Vision and Image Understanding, 104:90-126, 2006.
23. D. Moore and I. Essa. Recognizing multitasked activities using stochastic context-free grammar from video. In Proceedings of AAAI Conference, 2002.
24. N. Oliver, E. Horvitz, and A. Garg. Layered representations for human activity recognition. In ICMI, 2003.
25. K. Pastra and Y. Aloimonos. The minimalist grammar of action. Phil. Trans. R Soc. B, 367(1585):103-117, 2012.
26. M. Pawlik and N. Augsten. Rted: a robust algorithm for the tree edit distance. Proc. VLDB Endow., 5(4):334-345, 2011.
27. C. Pinhanez and A. Bobick. Human action detection using pnf propagation of temporal constraints. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, 1998.
28. D. A. Rosenbaum, R. G. Cohen, S. A. Jax, D. J. Weiss, and R. Van Der Wel. The problem of serial order in behavior: Lashleys legacy. Human Movement Science, 26(4):525-554, 2007.
29. M. Ryoo and J. Aggarwal. Recognition of composite human activities through context-free grammar based representation. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, 2006.
30. P. Saisan, G. Doretto, Y. N. Wu, and S. Soatto. Dynamic texture recognition. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, 2001.
31. C. Schuldt, I. Laptev, and B. Caputo. Recognizing human actions: A local svm approach. In ICPR, 2004.
32. L. Sigal, A. O. Balan, and M. J. Black. Humaneva: Synchronized video and motion capture dataset and baseline algorithm for evaluation of articulated human motion. International Journal of Computer Vision, 87(1-2):4-27, 2010.
33. M. Sridhar, A. G. Cohn, and D. C. Hogg. Learning functional object-categories from a relational spatio-temporal representation. In Proc. 18th European Conference on Artificial Intelligence, pages 606-610, 2008.
34. P. Turaga, R. Chellappa, V. S. Subrahmanian, and O. Udrea. Machine recognition of human activities: A survey. IEEE Transactions on Circuits and Systems for Video Technology, 18(11):1473-1488, 2008.
35. I. Vicente, V. Kyrki, and D. Kragic. Action recognition and understanding through motor primitives. Advanced Robotics, 21:1687-1707, 2007.
36. J. Wang, D. Fleet, and A. Hertzmann. Gaussian process dynamical models for human motion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008.
37. A. Whiten, E. Flynn, K. Brown, and T. Lee. Imitation of hierarchical action structure by young children. Developmental Science, 9:574-582, 2006.
38. G. Willems, T. Tuytelaars, and L. J. V. Gool. An efficient dense and scaleinvariantspatio-temporal interest point detector. In Proc. European Conference on Computer Vision, 2008.
39. A. Yilmaz and M. Shah. Actions sketch: A novel action representation. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, pages 984-989, 2005.