Recognition of visual activities and interactions by stochastic parsing

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 22, Issue 8, 2000, Pages 852-872

  Ivanov, Yuri A ^a   Bobick, Aaron F ^a  

^a MIT MEDIA LAB   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; IMAGE ANALYSIS; PROBABILITY; RANDOM PROCESSES;

STOCHASTIC PARSING; VIDEO SURVEILLANCE;

COMPUTER VISION;

EID: 0034245366     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/34.868686     Document Type: Article

References (41)

1. J.K. Aggarwal and Q. Cai, "Human Motion Analysis: A Review," Computer Vision and Image Understanding, vol. 73, no. 3, pp. 428440, 1999.
2. A.V. Aho and J.D. Ullman, The Theory of Parsing, Translation, and Compiling. Volume 1: Parsing. Englewoods Cliffs, N.J.: Prentice Hall, 1972.
3. A.V. Aho and T.G. Peterson, "A Minimum Distance Error-Correcting Parser for Context-Free Languages," SIAM ]. Computing, vol. 1, pp. 305-312, 1972.
4. M.L. Baird and M.D. Kelly, "A Paradigm for Semantic Picture Recognition," Pattern Recognition, vol. 6, no. 1, pp. 61-74, 1974.
5. A.F. Bobick, "Movement, Activity, and Action: The Role of Knowledge in the Perception of Motion," Philosophical Trans. Royal Soc. London B, pp. 1,257-1,265, 1997.
6. A.F. Bobick and A.D. Wilson, "A State-Based Approach to the Representation and Recognition of Gesture," IEEE Trans. Pattern Analysis and Machince Intelligence, vol. 19, no. 12, pp. 1,325-1,337, Dec. 1997.
7. T.L. Booth and R.A. Thompson, "Applying Probability Measures to Abstract Languages," IEEE Trans. Computers, vol. 22, no. 5, pp. 442-450, May 1973.
8. M. Brand, "Understanding Manipulation in Video," Proc. Second Int'l Conf. Automatic Face and Gesture Recognition '96, pp. 94-99, 1996.
9. M. Brand and N. Oliver, "Coupled Hidden Markov Models for Complex Action Recognition," Computer Vision and Pattern Recognition, pp. 994-999, 1996.
10. F. Bremond and G. Medioni, "Scenario Recognition in Airborne Video Imagery," Proc. Workshop Interpretation of Visual Motion, pp. 57-64, 1998.
11. [II] T. Briscoe and N. Waegner, "Robust Stochastic Parsing Using Inside-Outside Algorithm," Proc. Am. Assoc. Artificial Intelligence Workshop Statistically-Based Natural Language Programming Techniques, 1992.
12. H. Bunke and D. Pasche, "Parsing Multivalued Strings and its Application to Image and Waveform Recognition," Structural Pattern Analysis, 1990.
13. E. Charniak, Statistical Language Learning. Cambridge, Mass, and London: MIT Press, 1993.
14. J.D. Courtney, "Automatic Video Indexing via Object Motion Analysis," Pattern Recognition, vol. 30, no. 4, pp. 607-625, 1997.
15. E. Csunhaj-Varju, J. Dassow, J. Kelemen, and G. Paun, Grammar Systems: A Grammatical Approach to Distribution and Cooperation. Gordon and Breach Science Publishers, 1994.
16. T.J. Darrell and A.P. Pentland, "Space-Time Gestures," Proc. Conf. Computer Vision and Pattern Recognition, pp. 335-340, 1993.
17. J.C. Earley, "An Efficient Context-Free Parsing Algorithm," PhD thesis, Carnegie-Mellon Univ., 1968.
18. W.E.L. Crimson, C. Stauffer, R. Romano, and L. Lee, "Using Adaptive Tracking to Classify and Monitor Activities," Computer Vision and Pattern Recognition, pp. 22-29, 1998.
19. F. Jelinek, J.D. Lafferty, and R.L. Mercer, "Basic Methods of Probabilistic Context Free Grammars," Speech Recognition and Understanding. Recent Advances, Trends, and Applications, Pietro Laface Mori and Renato Di, eds., vol. F75 of NATO Advanced Study Institute, pp. 345-360, Berlin: Springer Verlag, 1992.
20. F. Jelinek and J.D. Lafferty, "Computation of the Probability of Initial Substring Generation by Stochastic Context Free Grammars," Computational Linguistics, vol. 17, no. 3, pp. 315-323, 1991.
21. F. Jelinek, Statistical Methods for Speech Recognition. Cambridge, Mass.: MIT Press, 1999.
22. L Lee, "Learning of Context-Free Languages: A Survey of the Literature," Technical Report TR-12-96, Harvard Univ., 1996.
23. R. Narasimhan, "Labeling Schemata and Syntactic Descriptions of Pictures," InfoControl, vol. 7, no. 2, pp. 151-179, 1964.
24. H. Ney, "Stochastic Grammars and Pattern Recognition," Speech Recognition and Understanding, P. Laface and R. DeMori, eds., pp. 319-344, 1992.
25. N. Oliver, B. Rosario, and A. Pentland, "Statistical Modeling of Human Interactions," Proc. Computer Vision and Pattern Recognition, The Interpretation of Visual Motion Workshop, pp. 3916, 1998.
26. B.J. Oomen and R.L. Kashyap, "Optimal and Information Theoretic Syntactic Pattern Recognition for Traditional Errors," Lecture Notes in Computer Science, vol. 1,121, pp. 11-20, Springer, 1996.
27. L.R. Rabiner and B.H. Juang, Fundamentals of Speech Recognition. Englewood Cliffs: Prentice Hall, 1993.
28. M. Rudolf, The Grammar of Conducting: A Comprehensive Guide to Baton Techniques and Interpretation. New York: Schimmer Books, 1994.
29. A. Sanfeliu and R. Alquezar, "Efficient Recognition if a Class of Context-Sensitive Languages Described by Augmented Regular Expressions," Lecture Notes in Computer Science, vol. 1,121, pp. 110, Springer, 1996.
30. A. Sanfeliu and M. Sainz, "Automatic Recognition of Bidimensional Models Learned by Grammatical Inferrence in Outdoor Scenes," Lecture Notes on Computer Science, vol. 1,121, pp. 160-169, Springer, 1996.
31. R. Schalkoff, Pattern Recognition: Statistical, Structural, and Neural Approaches. New York: Wiley, 1992.
32. J. Schlenzig, E. Hunter, and R. Jain, "Recursive Identification of Gesture Inputs Using Hidden Markov Models," Proc. Second Ann. Conf. Applications of Computer Vision, pp. 187-194, 1994.
33. T. Starner, J. Weaver, and A. Pentland, "Real-Time American Sign Language Recognition Using Desk and Wearable ComputerBased Video," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 12, Dec. 1998.
34. T.E. Starner and A. Pentland, "Visual Recognition of American Sign Language Using Hidden Markov Models," Proc. Int'l Workshop Automatic Face- and Gesture-Recognition, pp. 189-194, 1995.
35. A. Stolcke, "An Efficient Probabilistic Context-Free Parsing Algorithm That Computes Prefix Probabilities," Computational Linguistics, vol. 21, no. 2, pp. 165-201, 1995.
36. M.G. Thomason, "Stochastic Syntax-Directed Translation Schemata for Correction of Errors in Context-Free Languages," IEEE Trans. Computers, vol. 24, pp. 1,211-1,216, 1975.
37. W.G. Tsai and K.S. Fu, "Attributed Grammars-A Tool for Combining Syntatctic and Statistical Approaches to Pattern Recognition," IEEE Trans. Systems, Man, and Cybernetics, vol. 10, no. 12, pp. 873-885, 1980.
38. A.D. Wilson, A.F. Bobick, and J. Cassell, "Temporal Classification of Natural Gesture and Application to Video Coding," Proc. Conf. Computer Vision and Pattern Recognition, pp. 948-954, 1997.
39. C. Wren, A. Azarbayejani, T. Darrell, and A. Pentland, "Pfinder: Real-time Tracking of the Human Body," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 780-785, July 1997.
40. J. Yamato, J. Ohya, and K. Ishii, "Recognizing Human Action in Time-Sequential Images Using Hidden Markov Model," Proc. Conf. Computer Vision and Pattern Recognition, pp. 379-385, 1992.
41. S.J. Young, N.H. Russell, and J.H.S. Thornton, "Token Passing: A Simple Conceptual Model for Connected Speech Recognition Systems," Technical Report CUED/F-INFENG/TR. 38, Univ. of Cambridge, July 1989.