Activity recognition using a combination of category components and local models for Video surveillance

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 18, Issue 8, 2008, Pages 1128-1139

  Lin, Weiyao ^a,b   Sun, Ming Ting ^a,b   Poovendran, Radha ^a,b   Zhang, Zhengyou ^a,c  

^a IEEE

^b University of Washington   (United States)

^c MICROSOFT RESEARCH   (United States)

Author keywords

Category components; Event detection; Local model; Video surveillance

Indexed keywords

COMPUTER NETWORKS; VIDEO AMPLIFIERS;

CATEGORY COMPONENTS; EVENT DETECTION; LOCAL MODEL; VIDEO FRAMES; VIDEO SURVEILLANCE;

SECURITY SYSTEMS;

EID: 50549098550     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2008.927111     Document Type: Article

References (38)

1. P. Harmo, T. Taipalus, J. Knuuttila, J. Wallet, and A. Halme, "Needs and solutions - Home automation and service robots for the elderly and disabled," in Proc. IEEE Int. Conf. Intell. Robots Syst., 2005, pp. 3201-3206.
2. D. Chen, J. Yang, and H. Wactlar, "Towards automatic analysis of social interaction patterns in a nursing home environment from video," in Proc. ACM Int. Workshop Multimedia Inf. Retrieval, 2004, pp. 283-290.
3. D. Hall, L. Eubanks, L. S. Meyyazhagan, R. D. Denny, and S. C. Johnson, "Evaluation of covert video surveillance in the diagnosis of Munchausen syndrome by proxy: Lessons from 41 cases," Pediatrics, vol. 105, no. 6, pp. 1305-1312, Jun. 2000.
4. D. Ayers and M. Shah, "Monitoring human behavior from video taken in an office environment," Image Vis. Computing, vol. 19, pp. 833-846, 2001.
5. L. Zelnik-Manor and M. Irani, "Event-based video analysis," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2001, vol. 2, pp. 123-130.
6. H. Zhong, J. Shi, and M. Visontai, "Detecting unusual activity in video," in Proc. Conf. Comput. Vis. Pattern Recognit., 2004, vol. 2, pp. 819-826.
7. D. Zhang, D. Gatica-Perez, S. Bengio, and I. McCowan, "Semi-supervised adapted HMMs for unusual event detection," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., 2005, vol. 1, pp. 611-618.
8. A. Datta, M. Shah, and N. Lobo, "Person-on-person violence detection in video data," in Proc. Int. Conf. Pattern Recognit., 2002, vol. 1, pp. 433-438.
9. J. Snoek, J. Hoey, L. Stewart, and R. S. Zemel, "Automated detection of unusual events on stairs," in Proc. Can. Conf. Comput. Robot Vis., 2006, pp. 5-12.
10. F. Lv, J. Kang, R. Nevatia, I. Cohen, and G. Medioni, "Automatic hacking and labeling of human activities in a video sequence," in Proc. IEEE Workshop Performance Eval. Tracking and Surveillance, 2004, pp. 33-40.
11. P. C. Ribeiro and J. Santos-Victor, "Human activity recognition from video: Modeling, feature selection and classification architecture," in Proc. Int. Workshop Human Activity Recognition and Modeling, 2005, pp. 61-70.
12. T. V. Duong, H. H. Bui, D. Q. Phung, and S. Venkatsh, "Activity recognition and abnormality detection with the switching hidden semi-Markov model," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2005, vol. 1, pp. 838-845.
13. S. Gong and T. Xiang, "Recognition of group activities using dynamic probabilistic networks," in Proc. IEEE Int. Conf. Comput. Vis., 2003, vol. 2, pp. 472-479.
14. N. Oliver, E. Horvitz, and A. Garg, "Layered representations for human activity recognition," in Proc. IEEE Conf. Multimodel Interfaces, 2002, pp. 3-8.
15. C. Liu, P. Chung, and Y. Chung, "Human home behavior interpretation from video stream," in Proc. IEEE Int. Conf. Networking, Sensing and Control, 2004, vol. 1, pp. 192-197.
16. P. Viola, M. Jones, and D. Snow, "Detecting pedestrians using patterns of motion and appearance," Int. J. Comput. Vis., vol. 63, no. 2, pp. 153-161, Jul. 2005.
17. T. Chaodhury, J. Rehg, V. Pavlovic, and A. Pentland, "Boosted learning in dynamic bayesian networks for multimodal detection," in Proc. Int. Conf. Inf. Fusion, 2002, vol. 1, pp. 550-556.
18. Y. Song, L. Goncalves, and P. Perona, "Unsupervised learning of human motion," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 7, pp. 814-827, Jul. 2003.
19. Y. A. Ivanov and A. F. Bobick, "Recognition of visual activities and interactions by stochastic parsing," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 852-872, Aug. 2000.
20. CAVIAR Project [Online]. Available: http://www.homepages.inf.ac.uk/brf/ CAVIAR/
21. B. Li, E. Chang, and C. T. Wu, "DPF-a perceptual distance function for image retrieval," in Proc. Int. Conf. Image Process., 2002, vol. 2, pp. 597-600.
22. M. Cristani, M. Bicego, and V. Murino, "Audio-visual event recognition in surveillance video sequences," IEEE Trans. Multimedia, vol. 9, no. 2, pp. 257-267, Feb. 2007.
23. A. Amer, "Voting-based simultaneous hacking of multiple video objects," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 11, pp. 1448-1462, Nov. 2005.
24. A. A. Efros, A. C. Berg, G. Mori, and J. Malik, "Recognizing action at a distance," in Proc. IEEE Conf. Comput. Vis., 2003, vol. 2, pp. 726-733.
25. D. Koller and M. Sahami, "Toward optimal feature selection," in Proc. 13th Conf. Machine Learning, 1996, pp. 284-292.
26. S. Amari and S. Wu, "Improving support vector machine classifiers by modifying kernel functions," Neural Networks, vol. 12, pp. 783-789, 1999.
27. G. Wu and E. Y. Chang, "Adaptive feature-space conformal transformation for imbalanced-data learning," in Proc. 12th Int. Conf. Machine Learning, 2003, pp. 816-823.
28. J. P. Hoffbeck and D. A. Landgrebe, "Covariance matrix estimation and classification with limited training data," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 6, pp. 763-767, Jun. 1996.
29. C. E. Thomaz, D. F. Gillies, and R. Q. Feitosa, "A new covariance estimate for Bayesian classifiers in biometric recognition," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 2, pp. 214-223, Feb. 2004.
30. P. Mitra, C. A. Murthy, and S. K. Pal, "Unsupervised feature selection using feature similarity," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 3, pp. 301-312, Mar. 2002.
31. B. Moghaddam and A. Pentland, "Probabilistic visual learning for object representation," IEEE Trans. Pattern Anal. Mach. Intel., vol. 19, no. 7, pp. 696-710, Jul. 1997.
32. F. I. Bashir, A. A. Khokhar, and D. Schonfeld, "Real-time motion trajectory-based indexing and retrieval of video sequences," IEEE Trans. Multimedia, vol. 9, no. 1, pp. 58-65, Jan. 2007.
33. D. A. Reynolds, T. F. Quatieri, and R. B. Dunn, "Speaker verification using adapted Gaussian mixture models," Digit. Signal Process., vol. 10, pp. 19-41, 2000.
34. J. Bilmes, A Gentle Tutorial of the EM Algirthm and Its Application to Parameter Estimation for Gaussian Mixture and Hidden Markov Models U.C. Berkeley, ICSI-TR-97-021, 1997.
35. D. Zhang, D. Gatica-Perez, S. Bengio, and I. McCowan, "Modeling individual and group actions in meetings with layered HMMs," IEEE Trans. Multimedia, vol. 8, no. 3, pp. 509-520, Jun. 2006.
36. S. Dupont and J. Luettin, "Audio-visual speech modeling for continuous speech recognition," IEEE Trans. Multimedia, vol. 2, no. 3, pp. 141-151, Sep. 2000.
37. I. Bloch, "Information combination operators for data fusion: A comparative review with, classification," IEEE Trans. Syst., Man Cybern., vol. 26, no. 1, pp. 52-67, Jan. 1996.
38. J. Tang, J. Gu, and Z. Cai, "Data fusion with different accuracy," in Proc. IEEE Conf. Robot. Biomimet., 2004, pp. 811-815.