A statistical video content recognition method using invariant features on object trajectories

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 18, Issue 11, 2008, Pages 1533-1543

  Hervieu, Alexandre ^a   Bouthemy, Patrick ^a   Cadre, Jean Pierre Le ^a  

^a INRIA   (France)

Author keywords

Hidden markov models; Motion analysis; Pattern classification; Video signal processing

Indexed keywords

COMPUTATIONAL GRAMMARS; LEARNING SYSTEMS; MARKOV PROCESSES; OBJECT RECOGNITION; PARAMETER ESTIMATION; SIGNAL PROCESSING; TRAJECTORIES; VIDEO RECORDING; VIDEO SIGNAL PROCESSING; VISUAL COMMUNICATION;

AND DETECTIONS; DATA SETS; FORMULA ONES; IMAGE SEQUENCE.; IMAGE TRANSLATIONS; INVARIANT FEATURES; MOTION ANALYSIS; MOTION TRAJECTORIES; NOVEL METHODS; OBJECT TRAJECTORIES; PATTERN CLASSIFICATION; PLANE ROTATIONS; QUANTIZED VALUES; REAL TRAJECTORIES; SPATIAL SCALING; SPORT VIDEOS; STATISTICAL TECHNIQUES; SVM CLASSIFICATIONS; TV PROGRAMS; UNEXPECTED EVENTS; VIDEO CONTENT RECOGNITIONS; VIDEO CONTENTS;

HIDDEN MARKOV MODELS;

EID: 55149089052     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2008.2005609     Document Type: Article

References (50)

1. N. Anjum and A. Cavallaro, "Unsupervised fuzzy clustering for trajectory analysis," in Proc. IEEE Int. Conf. Image Processing, ICIP'07, San Antonio, TX, Sep. 2007.
2. G. Antonini and J. P. Thiran, "Counting pedestrians in video sequences using trajectory clustering," IEEE Trans. Circuit Syst. Video Technol., vol. 16, no. 8, pp. 1008-1020, Aug. 2006.
3. F. I. Bashir, A. A. Khokhar, and D. Schonfeld, "View invariant motion trajectory-based activity classification and recognition," Multimedia Syst., vol. 12, no. 1, pp. 45-54, 2006.
4. F. I. Bashir, A. A. Khokhar, and D. Schonfeld, "Real-time motion trajectory-based indexing and retrieval of video sequences," IEEE Trans. Multimedia, vol. 9, no. 1, pp. 58-65, 2007.
5. F. T. Bashir, A. A. Khokhar, and D. Schonfeld, "Object trajectory-based activity classification and recognition using hidden Markov models," IEEE Trans. Image Process., vol. 16, no. 7, pp. 1912-1919, 2007.
6. O. Boiman and M. Irani, "Detecting irregularities in images and in video," in Proc. IEEE Int. Conf. Computer Vision, ICCV'05. Beijing, China, Oct. 2005, vol. 1, pp. 462-469.
7. C. Burges, "A tutorial on support vector machines for pattern recognition," in Data Mining and Knowledge Discovery. New York: Springer, 1998, vol. 2, pp. 121-167.
8. D. Buzan, S. Sclaroff, and O. Kollios, "Extraction and clustering of motion trajectories in video," in Proc. IEEE Int. Conf. Pattern Recognit., ICPR'04, Cambridge, U.K., Aug. 2004, pp. 521-524.
9. S.-F. Chang, W. Chen, H. J. Meng, H. Sundaram, and D. Zhong, "A fully automated content-based video search engine supporting spatiotemporal queries," IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 5, pp. 602-615, Sep. 1998.
10. M. T. Chan, A. Hoogs, J. Schmiederer, and M. Peterson, "Detecting rare events in video using semantic primitives with HMM," in Proc. IEEE Int. Conf. Pattern Recognit., ICPR'04, Cambridge, U.K., Aug. 2004, pp. 150-154.
11. M. T. Chan, A. Hoogs, R. Bhotika, and A. Perera, "Joint recognition of complex events and track matching," in Proc. IEEE Conf. Comput. Vis. Pattern Recagnit.,CVPR'06, New York, Jun. 2006, pp. 694-699.
12. R. Fablet and P. Bouthemy, "Motion recognition using non parametric image motion models estimated from temporal and multiscale cooccurrence statistics," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 12, pp. 1619-1624, Dec. 2003.
13. H. Fashandi and A. M. E. Moghaddam, "A new invariant similarity measure for trajectories," in Proc. IEEE Int. Symp. Comput. Intell. Robot. Automat., CIRA'05, Espoo, Finland, Jun. 05, pp. 631-634.
14. W. Feller, An Introduction to Probability Theory and Its Applications, 3rd ed. New York: Wiley, 1971, vol. 2.
15. J. Ford and J. Moore, "Adaptive estimation of HMM transition probabilities," IEEE Trans. Signal Process., vol. 46, no. 5, pp. 1374-1385, 1998.
16. Z. Fu, W. Hu, and T. Tan, "Similarity based vehicle trajectory clustering and anomaly detection," in Proc. IEEE Int. Conf. Image Process., ICIP'05, Geneva, Switzerland, Sep. 2005.
17. S. Gong and T. Xiang, "Recognition of group activities using dynamic probabilistic networks," in Proc. IEEE Int. Conf. Comput. Vis., ICCV'03, Nice, France, Oct. 2003, pp. 742-749.
18. N. Gengembre and P. Ferez, "Probabilistic color-based multi-object tracking with application to team sports," Tech. Rep., INRIA, RR-6555, 2008.
19. W. Härdle, M. Muller, S. Sperlich, and A. Werwatz, Nonparametric and Semiparametric Models. Berlin, Germany: Springer, 2004, Springer series in statistics.
20. A. Hervieu, P. Bouthemy, and J.-P. Le Cadre, "A HMM-based method for recognizing dynamic video contents from trajectories," in Proc. IEEE Int. Conf. Image Process., ICIP '07, San Antonio, TX, Sep. 2007.
21. A. Hervieu, P. Bouthemy, and J.-P. Le Cadre, "Video event classification and detection using 2D trajectories," in Proc. Int. Conf. Comput. Vis. Theory Applicat., VISAPP'08, Madeira, Portugal, Jan. 2008.
22. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning. Berlin, Germany: Springer, 2001, Springer series in statistics.
23. S. Hongeng, R. Nevatia, and F. Bremond, "Video-based event recognition: Activity representation and probabilistic recognition methods," Comput. Vis. Image Understand., vol. 96, no. 2, pp. 129-162, 2003.
24. W. Hu, X. Xiao, T. Tan, and S. Maybank, "Learning activity patterns using fuzzy self-organizing neural network," IEEE Trans. Syst., Man Cybern.-Part B: Cybern., vol. 34, no. 3, pp. 1618-1626, Jun. 2004.
25. W. Hu, X. Xiao, Z. Fu, D. Xie, T. Tan, and S. Maybank, "A system for learning statistical motion patterns," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 9, pp. 1450-1464, Sep. 2006.
26. W. Hu, D. Xie, Z. Fu, W. Zheng, and S. Maybank, "Semantic-based surveillance video retrieval," IEEE Trans. Image Process., vol. 16, no. 4, pp. 1168-1181, Apr. 2007.
27. T. Izo, "Visual attention models for far-field scene analysis," Ph.D. dissertation, Massachusetts Inst. Technol. (MIT), Cambridge, MA, 2007.
28. T. Izo and W. E. L. Crimson, "Unsupervised modeling of object tracks for fast anomaly detection," in Proc. IEEE Int. Conf. image Process., ICIP'07, San Antonio, US, Sep. 2007.
29. N. Johnson and D. Hogg, "Learning the distribution of object trajectories for event recognition," in Proc. British Machine Vision Conf., BMVC'95, Birmingham, U.K., Jul. 1995.
30. I. N. Junejo and H. Foroosh, "Trajectory rectification and path modeling for video surveillance," in Proc. IEEE Int. Conf. Comput. Vis., ICCV'07, Rio de Janeiro, Brazil, Oct. 2007.
31. S. Khalid and A. Naftel, "Classifying spatiotemporal object trajectories using unsupervised learning of basis function coefficients," in Proc. ACM Int. Workshop Video Surv. Sensor Netw., VSSN'05, Singapore, Nov. 2005.
32. A. Kokaram, N. Rea, R. Dahyot, M. Tekalp, P. Bouthemy, P. Gros, and I. Sezan, "Browsing sports video (Trends in sports-related indexing and retrieval work)," IEEE Signal Process. Mag., vol. 23, no. 2, pp. 47-58, Mar. 2006.
33. [33 ] X. Li, W. Hu, and W. Hu, "A coarse-to-fine strategy for vehicle motion trajectory clustering," in Proc. IEEE Int. Conf. Pattern Recognit., Hong Kong, Aug. 2006, pp. 591-594.
34. J. Lou, Q. Liu, T. Tan, and W. Hu, "Semantic interpretation of object activities in a surveillance system," in Proc. IEEE Int. Conf. Pattern Recognit., ICPR'02, Quebec, Canada, Aug. 2002, pp. 777-780.
35. D. Makris and T. Ellis, "Path detection in video surveillance," Image Vis. Comput., vol. 20, no. 12, pp. 895-903, 2002.
36. D. Makris and T. Ellis, "Learning semantic scene models from observing activity in visual surveillance," IEEE Trans. Syst., Man Cybern. - Part B: Cybern., vol. 35, no. 3, pp. 397-408, Jun. 2005.
37. J. Melo, A. Naftel, A. Bernardino, and J. S. Victor, "Retrieval of vehicle trajectories and estimation of lane geometry using non-stationary traffic surveillance cameras," in Proc. IEEE Int. Conf. Adv. Concepts for Intell. Vis. Syst., ACIVS'04, Brussels, Belgium, Aug.-Sep. 2004.
38. A. Naftel and S. Khalid, "Classifying spatiotemporal object trajectories using unsupervised learning in the coefficient feature space," Multimedia Syst., vol. 12, no. 3, pp. 227-238, 2006.
39. N. M. Oliver, B. Rosario, and A. P. Pentland, "A Bayesian computer vision system for modeling human interactions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 831-843, Aug. 2000.
40. P. Ferez, C. Hue, J. Vermaak, and M. Gangnet, "Color-based probabilistic tracking," in Proc. Eur. Conf. Computer Vision, ECCV'02, Copenhagen, Denmark, Jun. 2002.
41. C. Piciarelli, G. L. Foresti, and L. Snidaro, "Trajectory clustering and its applications for video surveillance," in Proc. IEEE Int. Conf. Adv. Video Signal Based Surveill, AVSS'05, Como, Italy, Sep. 2005, pp. 40-45.
42. G. Piriou, P. Bouthemy, and J.-F. Yao, "Recognition of dynamic video contents with global probabilistic models of visual motion," IEEE Trans. Image Process., vol. 15, no. 11, pp. 3417-3430, Nov. 2006.
43. F. Porikli, "Trajectory distance metric using hidden Markov model based representation," in Proc. Workshop on Perform. Eval. Tracking Surveill. (PETS), Pragia, Czech Republic, May 2004.
44. L. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. IEEE, vol. 77, pp. 257-285, 1989.
45. P. Remagnino, A. I. Shihab, and G. A. Jones, "Distributed intelligence for multi-camera visual surveillance," Pattern Recognit., vol. 37, no. 4, pp. 675-689, Apr. 2004.
46. C. Stauffer and W. E. L. Grimson, "Learning patterns of activity using real-time tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 747-757, Aug. 2000.
47. M. Vlachos, G. Kollios, and D. Gunopulos, "Discovering similar multidimensional trajectories," in Proc: IEEE Int. Conf. Data Engineering, ICDE'02, San Jose, CA, Feb. 2002.
48. X. Wang, K. Tieu, and E. Grimson, "Learning semantic scene models by trajectory analysis," in Proc. Eur. Conf. Comput. Vis., ECCV'06, Graz, Austria, May 2006.
49. Z. Zhang, K. Huang, and T. Tan, "Comparison of similarity measures for trajectory clustering in outdoor surveillance scenes," in Proc. IEEE Int. Conf. Pattern Recognit., ICPR'07, Hong Kong, Aug. 2006, pp. 1135-1138.
50. Z. Zhang, K. Huang, T. Tan, and L. Wang, "Trajectory series analysis based event rule induction for visual surveillance," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., CVPR'07, Minneapolis, MN, Jun.' 2007.