Activity modeling using event probability sequences

IEEE Transactions on Image Processing

Volumn 17, Issue 4, 2008, Pages 594-607

  Cuntoor, Naresh P ^a   Yegnanarayana, B ^b   Chellappa, Rama ^c  

^a Signal Innovations Group   (United States)

^b INTERNATIONAL INSTITUTE OF INFORMATION TECHNOLOGY   (India)

^c UNIVERSITY OF MARYLAND   (United States)

Author keywords

Activity modeling; Event detection; Hidden Markov model (HMM)

Indexed keywords

HIDDEN MARKOV MODELS; MATHEMATICAL MODELS; MOTION ESTIMATION; PROBABILITY;

ACTIVITY MODELING; EVENT DETECTION;

IMAGE PROCESSING;

ALGORITHM; ARTICLE; AUTOMATED PATTERN RECOGNITION; BIOLOGICAL MODEL; COMPUTER ASSISTED DIAGNOSIS; COMPUTER SIMULATION; HUMAN; IMAGE ENHANCEMENT; METHODOLOGY; MOTOR ACTIVITY; MOVEMENT (PHYSIOLOGY); PHYSIOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; STATISTICAL MODEL; VIDEORECORDING;

ALGORITHMS; COMPUTER SIMULATION; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MODELS, BIOLOGICAL; MODELS, STATISTICAL; MOTOR ACTIVITY; MOVEMENT; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; VIDEO RECORDING;

EID: 41849144519     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2008.916991     Document Type: Article

References (46)

1. A. Kojima, T. Tamura, and K. Fukunaga, "Natural language description of human activities from video images based on concept of hierarchy of actions," Int. J. Comput. Vis., vol. 50, no. 2, pp. 171-184, Feb. 2002.
2. Y. A. Ivanov and A. F. Bobick, "Recognition of visual activities and interactions by stochastic parsing," IEEE Trans. Pattern Anal. Mach. Intell., Vol. 23, no. 8, pp. 852-872, Aug. 2000.
3. G. Medioni, I. Cohen, F. Bremond, S. Hongeng, and R. Nevatia, "Event detection and analysis from video streams," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 8, pp. 844-851, Aug. 2001.
4. A. R. J. Francois, R. Nevatia, J. Hobbs, and R. C. Bolles, "VERL: An ontology framework for representing and annotating video events," IEEE Trans. Multimedia, vol. 12, no 4, pp. 76-86, Oct. 2005.
5. V. T. Vu, F. Bremond, and M. Thonnat, "Temporal constraints for video interpretation," presented at the Eur. Conf. Artificial Intelligence, 2002.
6. J. Yamato, J. Ohya, and K. Ishii, "Recognizing human action in time-sequential images using hidden Markov model," in Proc. IEEE CVPR, 1992, pp. 994-999.
7. M. Brand, N. Oliver, and A. Pentland, "Coupled hidden Markov models for complex action recognition," in Proc. IEEE CVPR, 1992, pp. 379-385.
8. T. Izo and W. E. L. Grimson, "Simultaneous pose estimation and camera calibration from multiple views," in Proc. IEEE Workshop on Motion of Non-Rigid and Articulated Objects, 2004, vol. 1, pp. 14-21.
9. T. Starner and A. Pentland, "Real-time american sign language recognition from video using hidden Markov models," in Proc. Symp. Computer Vision, 1995, pp. 265-270.
10. D. Koller and U. Lerner, "Sampling in factored dynamic systems," in Sequential Monte Carlo Methods in Practice. New York: Springer, 2001, pp. 445-464.
11. Y. Shi and A. F. Bobick, "P-net: A representation for partially-sequenced, multi-stream activity, in Proc. IEEE Workshop on Event Mining, Madison, WI. 2003, vol. 4. pp. 40-47.
12. C. Rao, A. Yilmaz, and M. Shah, "View-invariant representation and recognition of actions," Int. J. Comput. Vis., vol. 50, no. 2, pp. 203-226. 2002.
13. D. D. Vecchio, R. M. Murray, and P. Perona, "Decomposition of human motion into dynamics based primitive with application to drawing tasks," Automatica, Vol. 39, no. 12, pp. 2085-2098, 2003.
14. A. Kale, A. N. Rajagopalan, A. Sundaresan, N. P. Cuntoor, A. K. Roy-Chowdhury, V. Kruger, and R. Chellappa, "Identification of humans using gait," IEEE Trans. Image Process., Vol. 13, no. 9, pp. 1163-1173, Sep. 2004.
15. A. F. Bobick and J. Davis, "Real-time recognition of activity using temporal templates," in Proc. IEEE Workshop Appl. Comput. Vis., 1996, pp. 39-42.
16. H. Zhong, J. Shi, and M. Visontai, "Detecting unusual activity in video," in Proc. IEEE CVPR, 2004, pp. 819-826.
17. N. Vaswani, A. R. Chowdhury, and R. Chellappa, "Activity recognition using the dynamics of the configuration of interacting objects," in Proc. IEEE CVPR, 2003, vol. 2, pp. 633-639.
18. T. Xiang and S. Gong, "Video behavior profiling and abnormality detection without manual labeling," in Proc. ICCV, 2005, pp. 1238-1245.
19. W. Chen and S. F. Chang, "Motion trajectory matching of video objects," in Proc. SPIE Storage and Retrieval for Media Databases 2000, pp. 544-553.
20. T. Syeda-Mahmood, "Segmenting actions in velocity curve space," in Proc. IEEE ICPR, 2002, vol. 4, pp. 170-175.
21. R. Chellappa, N. P. Cuntoor, S. W. Joo, V. Subrahmanian, and P. Turaga, "Computational vision approaches for event modeling," presented at the Understanding Events: How Humans See, Represent, and Act on Events.
22. S. Tsuji, A. Morizono, and S. Kuroda, "Understanding a simple cartoon film by a computer vision system," in Proc. IJCAI, 1977, pp. 609-610.
23. L. Zelnik-Manor and M. Irani, "Event based analysis of video," in Proc. IEEE CVPR, 2001, vol. 2, pp. 123-130.
24. V. Parameswaran and R. Chellappa. "View invariants for human action recognition," in Proc. IEEE CVPR, 2003, vol. 2, pp. 613-619.
25. A. K. R. Chowdhury and R. Chellappa, "A factorization approach tor activity recognition," in Proc. IEEE Workshop on Event Mining, 2003, vol. 4, pp. 41-46.
26. D. Meyer, "Human gait classification based on hidden Markov models," 3D Image Anal. Synthesis, pp. 139-146, 1997.
27. J. Aggarwal and O. Cai, "Human motion analysis: A review," Comput. Vis. Image Understand., vol. 73, no. 3, pp. 428-440, 1999.
28. F. I. Bashir, A. A. Khokhar, and D. Schonfeld, "Object trajectory-based activity classification and recognition using hidden Markov models," IEEE Trans. Image Process., vol. 16, no. pp. 1912-1919, Jul. 2007.
29. F. M. Porikli, "Clustering variable length sequences by eigenvector decompostion using HMM," in Proc. Int. Workshop on Structural and Syntactic Pattern Recognition, 2004, pp. 352-360.
30. F. I. Bashir, A. A. Khokhar, and D. Schonfeld, "A hybrid system for affine-invariant trajectory retrieval," in Proc. ACM SIGMM Int. Workshop on Multimedia Information Retrieval, 2004, pp. 235-242.
31. J.-F. Mari, J.-P. Haton, and A. Kriouile, "Automatic word recognition based on second-order hidden Markov models," IEEE Trans. Speech Audio Process., vol. 5, no. 1, pp. 22-25, Jan. 1997.
32. Y. Wang, L. Zhou J. Feng, J. Wang, and Z.-Q. Lin "Mining complex time-series data by learning Markovian models," in Proc. IEEE Int. Conf. Data Mining, 2006, pp. 1136-1140.
33. Z. Ghahramani and M. I. Jordan, "Factorial hidden Markov models," Mach. Learn., vol. 29, no. 2-3, pp. 245-273, 1997.
34. M. Brand and V. Kettnaker, "Discovery and segmentation of activities in video," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 873-899, Aug. 2000.
35. N. Oliver, E. Horvitz, and A. Garg, "Layered representations for human activitv recognition." in Proc. IEEE Int. Conf. Mulitmodal Interfaces, Pittsburgh, PA, 2002, pp. 3-7.
36. R. Hamid, Y. Huang, and I. Essa, "ARGmode - Activity recognition using graphical models," in Proc. IEEE CVPR, 2003, vol. 4, pp. 38-43.
37. T. Xiang and S. Gong, "Modeling activity and understanding behavior," Int. J. Comput. Vis., vol. 67, no. 1, pp. 21-51, 2006.
38. C. Stauffer and E. Grimson, "Learning patterns of activity using realtime tracing," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 747-757, Aug. 2000.
39. L. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech processing," Proc. IEEE, vol. 63, no. 2, pp. 257-285, Feb. 1989.
40. N. P. Cuntoor, B. Yegnanarayana, and R. Chellappa, "Interpretation of state sequences in HMM for activity representation," in Proc. IEEE Conf. Acoustic Speech and Signal Processing, Philadelphia" PA, 2005, vol. 2, pp. 709-712.
41. J. Bilmes, "A gentle tutorial on the EM algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models," Tech. Rep. ICSI-TR-97-021, 1997.
42. B. H. Juang, "On the hidden Markov model and dynamic time warping for speech recognition - A unified view," Tech. J., vol. 63, pp. 1213-1243, 1984.
43. I. Csiszar and P. Shields, "Consistency of the BIC Markov order estimator" Ann. Statist., vol. 28, pp. 1601-1619, 2000.
44. A. R. Chowdhury, A. Kale, and R. Chellappa, "Towards a view invariant gait recognition algorithm," in Proc. IEEE Int. Conf. Advanced Video and Signal Based Surveillance, 2003, pp. 143-150.
45. P. Perona and J. Malik, "Scale-space and edge detection using anisotropic diffusion," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 7, pp. 629-639, Jul. 19990.
46. B. D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," Int. J. CAI, pp. 674-679, 1981.