Learning, detection and representation of multi-agent events in videos

Artificial Intelligence

Volumn 171, Issue 8-9, 2007, Pages 586-605

  Hakeem, Asaad ^a   Shah, Mubarak ^a  

^a University of Central Florida   (United States)

Author keywords

Edge weighted directed hypergraph; Event detection; Event learning; Event representation; Normalized cut; P CASE; Temporal logic

Indexed keywords

GRAPH THEORY; INTERFACES (MATERIALS); MULTI AGENT SYSTEMS; PROBLEM SOLVING; VIDEO SIGNAL PROCESSING;

EDGE WEIGHTED DIRECTED HYPERGRAPHS; EVENT DETECTION; EVENT LEARNING; EVENT REPRESENTATION; NORMALIZED CUT; TEMPORAL LOGICS;

LEARNING SYSTEMS;

EID: 34249677392     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.artint.2007.04.002     Document Type: Article

References (56)

1. A. Ali, J.K. Aggarwal, Segmentation and recognition of continuous human activity, in: IEEE Workshop of International Conference on Computer Vision, 2001, pp. 28-38
2. Allen J.F., and Ferguson G. Actions and events in interval temporal logic. Journal of Logic Computation 4 5 (1994) 531-579
3. Ayers D., and Shah M. Monitoring human behavior from video taken in an office environment. Image and Vision Computing 19 (2001) 833-846
4. N. Babaguchi, R. Jain, Event detection from continuous media, in: Proc. of International Conference on Pattern Recognition, 1998, pp. 1209-1212
5. N. Badler, Temporal scene analysis: Conceptual description of object movements, University of Toronto Technical Report No. 80, 1975
6. Ben-Arie J., and Rao K.R. Optimal template matching by non-orthogonal image expansion using restoration. International Journal of Machine Vision and Applications 7 2 (1994) 69-81
7. Ben-Arie J., Wang Z., Pandit P., and Rajaram S. Human activity recognition using multidimensional indexing. IEEE Transactions on Pattern Analysis and Machine Intelligence 24 8 (2002) 1091-1104
8. M. Brand, Understanding manipulation in video, in: International Conference on Face and Gesture Recognition, 1997, pp. 94-99
9. Brand M., and Kettnaker V. Discovery and segmentation of activities in video. IEEE Transactions of Pattern Analysis and Machine Intelligence 22 8 (2000) 844-851
10. Comaniciu D., Ramesh V., and Meer P. Kernel-based object tracking. IEEE Transactions of Pattern Analysis and Machine Intelligence 25 5 (2003) 564-577
11. C. Ding, Tutorial on spectral clustering, in: International Conference on Machine Learning, 2004
12. Fillmore C.J. The case for CASE. In: Bach E., and Harms R. (Eds). Universals in Linguistic Theory (1968), Holt, Rinehart, and Winston, New York 1-88
13. N. Friedman, K. Murphy, S. Russell, Learning the structure of dynamic probabilistic networks, in: Proc. Conference on Uncertainty in Artificial Intelligence (UAI), Madison, WI, 1998, pp. 139-147
14. S. Gong, T. Xiang, Recognition of group activities using dynamic probabilistic networks, in: Proc. of International Conference on Computer Vision, 2003, pp. 742-749
15. Haering N., Qian R.J., and Sezan M.I. A semantic event-detection approach and its application in wildlife hunts. IEEE Transactions on Pattern Analysis and Machine Intelligence 10 6 (2000) 857-868
16. A. Hakeem, M. Shah, Ontology and taxonomy collaborated framework for meeting classification, in: Proc. of International Conference on Pattern Recognition, 2004, pp. 219-222
17. E: A hierarchical event representation for the analysis of videos, in: Proc. of American Association of Artificial Intelligence (AAAI), 2004, pp. 263-268
18. A. Hakeem, M. Shah, Multi-agent event learning, detection, and representation in videos, in: Proc. of American Association of Artificial Intelligence (AAAI), 2005, in press
19. M. Harville, D. Li, Fast, integrated person tracking and activity recognition with plan-view templates from single stereo camera, in: Proc. of Computer Vision and Pattern Recognition, 2004, pp. 398-405
20. Hongeng S., Nevatia F., and Bremond R. Video-based event recognition: Activity representation and probabilistic recognition methods. Computer Vision and Image Understanding 96 2 (2004) 129-162
21. S. Intille, A.F. Bobick, A framework for recognizing multi-agent action from visual evidence, in: Proc. of American Association of Artificial Intelligence (AAAI), 1999, pp. 518-525
22. Ivanov Y.A., and Bobick A.F. Recognition of visual activities and interactions by stochastic parsing. IEEE Transactions of Pattern Analysis and Machine Intelligence 22 (2000) 852-872
23. O. Javed, M. Shah, Tracking and object classification for automated surveillance, in: Proc. of European Conference on Computer Vision, 2002, pp. 343-357
24. O. Javed, M. Shah, D. Comaniciu, A probabilistic framework for object recognition in video, in: Proc. of International Conference on Image Processing, 2004
25. D. Koller, N. Heinze, H.H. Nagel, Algorithmic characterization of vehicle trajectories from image sequences by motion verbs, in: Proc. of Computer Vision and Pattern Recognition, 1991, pp. 90-95
26. F. Lv, R. Nevatia, Recognition and segmentation of 3-D human action using HMM and multi-class AdaBoost, in: European Conf. on Computer Vision, vol. 4, 2006, pp. 359-372
27. N. Maillot, M. Thonnat, A. Boucher, Towards ontology based cognitive vision, in: Proc. of International Conference of Vision Systems, 2003, pp. 44-53
28. R. Mann, A. Jepson, Towards the computational perception of action, in: Proc. of Computer Vision and Pattern Recognition, 1998, pp. 794-799
29. Medioni G., Cohen F., Brémond I., Hongeng S., and Nevatia R. Event detection and analysis from video streams. IEEE Transactions on Pattern Analysis and Machine Intelligence 23 8 (2001) 873-889
30. D. Minnen, I. Essa, T. Starner, Expectation grammars: Leveraging high-level expectations for activity recognition, in: Proc. of Computer Vision and Pattern Recognition, 2003, pp. 626-632
31. R. Nevatia, T. Zhao, S. Hongeng, Hierarchical language-based representation of events in video streams, in: IEEE Workshop on Event Mining, Madison, WI, 2003
32. R. Nevatia, J. Hobbs, B. Bolles, An ontology for video event representation, in: IEEE Workshop on Event Detection and Recognition, 2004
33. N.T. Nguyen, H.H. Bui, S. Venkatesh, G. West, Recognising and monitoring high-level behaviours in complex spatial environments, in: Proc. of Computer Vision and Pattern Recognition, 2003, pp. 620-625
34. N. Oliver, B. Rosario, A. Pentland, A Bayesian computer vision system for modelling human interaction, in: Proc. of International Conference of Computer Vision Systems, 1999, pp. 255-272
35. B. Ozer, T. Lv, W. Wolf, A bottom-up approach for activity recognition in smart rooms, in: Proc. of International Conference on Multimedia Expo, 2002, pp. 917-920
36. Parameswaren V., and Chellappa R. Human action-recognition using mutual invariants. Computer Vision and Image Understanding 98 (2005) 295-325
37. Parameswaren V., and Chellappa R. Using 2D project invariance for human action recognition. International Journal of Computer Vision 66 1 (2006)
38. C. Pinhanez, A. Bobick, Human action detection using PNF propagation of temporal constraints, in: Proc. of Computer Vision and Pattern Recognition, 1998, pp. 898-904
39. Rao C., Yilmaz A., and Shah M. View-invariant representation and recognition of actions. International Journal of Computer Vision 50 (2002) 203-226
40. Y. Rui, P. Anandan, Segmenting visual actions based on spatio-temporal motion patterns, in: Proc. of Computer Vision and Pattern Recognition, 2000, pp. 11-118
41. Shafique K., and Shah M. A noniterative greedy algorithm for multiframe point correspondence. IEEE Transactions on Pattern Analysis and Machine Intelligence 27 1 (2005) 51-65
42. Shi J., and Malik J. Normalized cuts and image segmentation. IEEE Transactions of Pattern Analysis and Machine Intelligence 22 8 (2000) 888-905
43. Y. Shi, Y. Huang, D. Minnen, A. Bobick, I. Essa, Propagation networks for recognition of partially ordered sequential action, in: Proc. of Computer Vision and Pattern Recognition, 2004, pp. 862-870
44. Y. Shi, A. Bobick, I. Essa, Learning temporal sequence model from partially labeled data, in: Proc. of Computer Vision and Pattern Recognition, 2006
45. Siskind J.M. Visual event classification via force dynamics. Proc. of American Association of Artificial Intelligence (AAAI) (2000), AAAI Press, Menlo Park, CA 149-155
46. P. Smith, M. Shah, N. Lobo, Integrating and employing multiple levels of zoom for activity recognition, in: Proc. of Computer Vision and Pattern Recognition, 2004, pp. 928-935
47. N. Vaswani, A.R. Chowdhury, R. Chellapa, Activity recognition using the dynamics of the configuration of interacting objects, in: Proc. of Computer Vision and Pattern Recognition, 2003, pp. 633-642
48. Vaswani N., Chowdhury A.R., and Chellapa R. Shape activity: A continuous-state HMM for moving/deforming shapes with application to abnormal activity detection. IEEE Transactions on Image Processing 14 (2005) 1603-1616
49. Wang Z., and Ben-Arie J. Optimal ramp edge detection using expansion matching. IEEE Transactions on Pattern Analysis and Machine Intelligence 18 11 (1996) 1092-1098
50. Wren C.R., Azarbayejani A., Darrel T., and Pentland A.P. Pfinder: Real-time tracking of the human body. IEEE Transactions on Pattern Analysis and Machine Intelligence 19 7 (1997) 780-785
51. G. Xu, Y. Ma, H. Zhang, S. Yang, A HMM based semantic analysis framework for sports game event detection, in: Proc. of International Conference on Image Processing, 2003, pp. 25-28
52. L. Zelnik-Manor, M. Irani, Event-based analysis of video, in: Proc. of Computer Vision and Pattern Recognition, 2001, pp. 123-130
53. H. Zhong, J. Shi, M. Visontai, Detecting unusual activity in video, in: Proc. of Computer Vision and Pattern Recognition, 2004, pp. 819-826
54. CAVIAR: Context Aware Vision using Image-based Active Recognition. More details at. http://homepages.inf.ed.ac.uk/rbf/CAVIARDATA1/
55. PETS: Performance Evaluation for Tracking and Surveillance. More details at. http://www.cvg.cs.rdg.ac.uk/PETS-ICVS/pets-icvs-db.html
56. VACE: Video Analysis and Content Exploitation. More details at. http://www.informedia.cs.cmu.edu/arda/vaceI_integrate.html