Video event modeling and recognition in generalized stochastic petri nets

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 20, Issue 1, 2010, Pages 102-118

  Lavee, Gal ^a   Rudzsky, Michael ^a   Rivlin, Ehud ^a   Borzin, Artyom ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Action; Activity; Behavior; Event; Petri Net; Scenario; Video analysis

Indexed keywords

ACTION; ACTIVITY BEHAVIOR; DATA SETS; DISCRETE TIME MARKOV CHAINS; EFFICIENT ALGORITHM; EVENT RECOGNITION; GENERALIZED STOCHASTIC PETRI NETS; RECOGNITION CAPACITY; SEMANTIC KNOWLEDGE; TRAFFIC MONITORING; VIDEO ANALYSIS; VIDEO DATA; VIDEO EVENTS; VIDEO SEQUENCES;

ALGORITHMS; GRAPH THEORY; MARKOV PROCESSES; PETRI NETS; STOCHASTIC SYSTEMS; VIDEO RECORDING;

SECURITY SYSTEMS;

EID: 74249101567     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2009.2031372     Document Type: Article

References (37)

1. R. Fisher, J. Santos-Victor, and J. Crowley (2004). "CAVIAR: Context Aware Vision Using Image-Based Active Recognition Project," [Online]. Available: http://homepages.inf.ed.ac.uk/rbf/caviar
2. R. Nevatia, T. Zhao, and S. Hongeng, "Hierarchical language-based representation of events in video streams," in Proc. Conf. Comput. Vision Pattern Recognit. Workshop (CVPRW), vol.4. Jun. 2003, p. 39.
3. R. Nevatia, J. Hobbs, and B. Bolles, "An ontology for video event representation," in Proc. Conf. Comput. Vision Pattern Recognit. Workshop (CVPRW), vol.7. 2004, p. 119.
4. e: A hierarchical event representation for the analysis of videos," in Proc. 18th Nat. Conf. Artif. Intell. (AAAI), 2004, pp. 263-268.
5. A. Hakeem and M. Shah, "Multiple agent event detection and representation in videos," in Proc. 19th Nat. Conf. Artif. Intell. (AAAI), 2005, p. 89.
6. M. Blank, L. Gorelick, E. Shechtman, M. Irani, and R. Basri, "Actions as space-time shapes," in Proc. 10th IEEE Int. Conf. Comput. Vision (ICCV), Washington D.C.: IEEE Computer Society, 2005, pp. 1395-1402.
7. L. Zelnik-Manor and M. Irani, "Statistical analysis of dynamic actions," IEEE Trans. Pattern Anal. Mach. Intell., vol.28, no.9, pp. 1530-1535, Sep. 2006.
8. M. Pittore, C. Basso, and A. Verri, "Representing and recognizing visual dynamic events with support vector machines," in Proc. Int. Conf. Image Anal. Process., 1999, pp. 18-23.
9. A. Howell and H. Buxton, "Gesture recognition for visually mediated interaction," in Proc. Int. Gesture Workshop, 1999, pp. 141-152.
10. W. N. Lie, T. C. Lin, and S. H. Hsia, "Motion-based event detection and semantic classification for baseball sport videos," in Proc. IEEE Int. Conf. Multimedia Expo, vol.3. Jun. 2004, pp. 1567-1570.
11. S. Intille and A. Bobick, "Representation and visual recognition of complex, multiagent actions using belief networks," in Proc. IEEE Workshop Interpretation Visual Motion, 1998, pp. 285-292.
12. H. Buxton and S. Gong, "Visual surveillance in a dynamic and uncertain world," Artif. Intell., vol.78, nos. 1-2, pp. 431-459, Oct. 1995.
13. S. Russell, J. Binder, D. Koller, and K. Kanazawa, "Adaptive probabilistic networks with hidden variables," Mach. Learning, vol.29, nos. 2-3, pp. 213-244, Nov.-Dec. 1997.
14. R. Higgins, "Automatic event recognition for enhanced situational awareness in UAV video," in Proc. IEEE Military Commun. Conf. (MILCOM), vol.3. Oct. 2005, pp. 1706-1711.
15. L. Davis, R. Chelappa, A. Rosenfeld, D. Harwood, I. Haritaoglu, and R. Cutler, "Visual surveillance and monitoring," in Proc. Defense Advanced Res. Projects Agency Image Understanding Workshop, 1998, pp. 73-76.
16. J. Yamato, J. Ohya, and K. Ishii, "Recognizing human action in time-sequential images using hidden Markov model," in Proc. IEEE Comput. Vision Pattern Recognit. (CVPR), Jun. 1992, pp. 379-385.
17. T. Starner and A. Pentland, "Real-time American sign language recognition from video using hidden Markov models," in Proc. Int. Symp. Comput. Vision (ISCV), 1995, p. 265.
18. A. Wilson and A. Bobick, "Recognition and interpretation of parametric gesture," in Proc. 6th Int. Conf. Comput. Vision (ICCV), 1998, p. 329.
19. S. Hongeng and R. Nevatia, "Large-scale event detection using semi-hidden Markov models," in Proc. 9th IEEE Int. Conf. Comput. Vision (ICCV), vol.2. Oct. 2003, pp. 1455-1462.
20. N. Oliver, B. Rosario, and A. Pentland, "A Bayesian computer vision system for modeling human interactions," IEEE Trans. Pattern Anal. Mach. Intell., vol.22, no.8, pp. 831-843, Aug. 2000.
21. N. Oliver, E. Horvitz, and A. Garg, "Layered representations for recognizing office activity," in Proc. IEEE Int. Conf. Multimodal Interaction, Oct. 2002, pp. 3-8.
22. Y. Ivanov and A. Bobick, "Recognition of visual activities and interactions by stochastic parsing," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit. (CVPR), vol.22. 1998, p. 852.
23. D. Moore and I. Essa, "Recognizing multitasked activities from video using stochastic context-free grammar," in Proc. Nat. Conf. Artif. Intell., 2002, pp. 770-776.
24. M. Brand, "Understanding manipulation in video," in Proc. 2nd Int. Conf. Automatic Face Gesture Recognit. (FG), Oct. 1996, pp. 94-99.
25. C. Castel, L. Chaudron, and C. Tessier, "What is going on? A high level interpretation of sequences of images," in Proc. Workshop Conceptual Descriptions Images (ECCV), Cambridge, U.K., 1996, pp. 13-27.
26. N. Ghanem, D. DeMenthon, D. Doermann, and L. Davis, "Representation and recognition of events in surveillance video using Petri Nets," in Proc. Conf. Comput. Vision Pattern Recognit. Workshop (CVPRW), vol.7. Washington D.C.: IEEE Computer Society, 2004, p. 112.
27. M. Albanese, R. Chellappa, V. Moscato, A. Picariello, V. S. Subrah-manian, P. Turaga, and O. Udrea, "A constrained probabilistic Petri Net framework for human activity detection in video," IEEE Trans. Multimedia, vol.10, no.6, pp. 982-996, Oct. 2008.
28. C. Pinhanez and A. Bobick, "Human action detection using PNF propagation of temporal constraints," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit. (CVPR), Jun. 1998, pp. 898-904.
29. G. Lavee, E. Rivlin, and M. Rudzsky, "Understanding video events: A survey of methods for automatic interpertations of semantic occurences in video," IEEE Trans. Syst. Man Cybernet. C, vol.39, no.5, pp. 489-504, Sep. 2009.
30. G. Lavee, A. Borzin, M. Rudzsky, and E. Rivlin, "Building Petri Nets from video event ontologies," in Proc. Int. Symp. Visual Comput., Nov. 2007, pp. 442-451.
31. M. A. Marsan, G. Balbo, G. Conte, S. Donatelli, and G. Franceschinis, Modeling with Generalized Stochastic Petri Nets (Wiley Series in Parallel Computing). New York: Wiley, 1995.
32. G. Lavee, M. Rudzsky, E. Rivlin, and A. Borzin, "Technical report cis-2008-06: Video event modeling and recognition in generalized stochastic Petri Nets," Technion Israel Inst. Technol., Tech. Rep. CIS-2008-2106, 2008.
33. V.-T. Vu, "Temporal scenarios for automatic video interpretation," Ph.D. dissertation, Univ. Nice Sophia Antipolis, Nice, France, 2004.
34. I. Leichter, M. Lindenbaum, and E. Rivlin., "Visual tracking by affine kernel fitting using color and object boundary," in Proc. IEEE Int. Conf. Comput. Vision, Oct. 2007, pp. 1-6.
35. R. B. Fisher, "Pets 04 surveillance ground truth data set," in Proc. 6th IEEE Int. Work. Performance Evaluation Tracking Surveillance (PETS), 2004, pp. 1-5.
36. D. Tweed, R. Fisher, J. Bins, and T. List, "Efficient hidden semi-Markov model inference for structured video sequences," in Proc. 2nd Joint IEEE Int. Workshop Visual Surveillance Performance Evaluation Tracking Surveillance, (VS-PETS), Beijing, China, Oct. 2005, pp. 247-254.
37. R. Fisher, J. Santos-Victor, and J. Crowley. "CAVIAR: Context aware vision using image-based active recognition hidden semi-Markov model behavior recognition" [Online]. Available: http://homepages.inf.ed.ac.uk/rbf/caviar/ hsmm.htm