Surveillance video indexing and retrieval using object features and semantic events

International Journal of Pattern Recognition and Artificial Intelligence

Volumn 23, Issue 7, 2009, Pages 1439-1476

  Le, Thi Lan ^a,b   Thonnat, Monique ^b   Boucher, Alain ^c   Brémond, François ^b  

^a HANOI UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Viet Nam)

^b INRIA   (France)

^c Institut de la Francophonie Pour l'Informatique IFI   (Viet Nam)

Author keywords

Imprecise and incomplete indexing; Query language; Surveillance video retrieval

Indexed keywords

ABSTRACTION LEVEL; APPROXIMATE MATCHING; DATA MODELS; FLEXIBLE QUERIES; OBJECT MATCHING; OBJECT REPRESENTATIONS; PHYSICAL OBJECTS; SEMANTIC EVENT; STATE-OF-THE-ART APPROACH; SURVEILLANCE VIDEO; USER-CENTERED; USERS' INTERESTS; VIDEO CONTENTS;

ABSTRACTING; IMAGE RETRIEVAL; INDEXING (OF INFORMATION); LINGUISTICS; MODELS; MONITORING; SECURITY SYSTEMS; VISUAL COMMUNICATION;

QUERY LANGUAGES;

EID: 70450207075     PISSN: 02180014     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0218001409007648     Document Type: Article

References (38)

1. J. F. Allen, Maintaining knowledge about temporal intervals, Commun. ACM 26(11) (1983) 823-843.
2. A. Alper Yilmaz, O. Javed and M. Shah, Object tracking: A survey, ACM Comput. Surv. (CSUR) 38(4) (2006) 1-45.
3. S. Arya, D. M. Mount, N. S. Netanyahu, R. Silverman and A. Y. Wu, An optimal algorithm for approximate nearest neighbor searching fixed dimensions, J. ACM 45(6) (1998) 891-923.
4. A. Avanzi, F. Bŕemond, C. Tornieri and M. Thonnat, Design and assessment of an intelligent activity monitoring platform, EURASIP J. Appl. Sign. Process., Special Issue in Advances in Intelligent Vision Systems: Methods and Applications (2005), pp. 2359-2374.
5. S. Calderara, R. Cucchiara and A. Prati, Multimedia surveillance: Content-based retrieval with multicamera people tracking, in ACM Int. Workshop on Video Surveillance & Sensor Networks (VSSN'06), Santa Barbara, California, USA (27 October 2006), pp. 95-100.
6. X. Chen and C. Zhang, An interactive semantic video mining and retrieval platform- application in transportation surveillance video for incident detection, in Sixth Int. Conf. Data Mining (December 2006), pp. 129-138.
7. I. Cohen, Y. Ma and B. Miller, Associating moving objects across non-overlapping cameras: A query-by-example approach, in IEEE Conf. Technologies for Homeland Security, Waltham, MA, USA (2008), pp. 566-571.
8. O. Corby, R. Dieng-Kuntz and C. Faron-Zucker, Querying the semantic web with the CORESE search engine, Proc. 16th Eur. Conf. Artif. Intell. (ECAI'2004), subconference PAIS'2004, Valencia (22-27 August 2004) (IOS Press), pp. 705-709.
9. N. Durak and A. Yazici, Multimodal video database modeling, querying and browsing, in Int. Symp. Computer and Information Sciences (ISCIS), LNCS 3733 (2005), pp. 802-812.
10. N. Ghanem, D. DeMenthon, D. Doermann and L. Davis, Representation and recognition of events in surveillance video using petri nets, in Conf. Computer Vision and Pattern Recognition Workshop (CVPRW'04), Vol.7 (2004).
11. A. B. Hampapur, L. Feris, R. Senior, A. C. F. Shu, Y. Tian, Y. Zhai and L. Max, Searching surveillance video, in IEEE Conf. Advanced Video and Signal Based Surveillance (AVSS 2007 ) (5-7 September 2007), pp. 75-80.
12. W. Hu, D. Xie, Z. Fu, W. Zeng and S. Maybank, Semantic-based surveillance video retrieval, IEEE Trans. Imag. Process. 16(4) (2007) 1168-1181.
13. G. L. Foresti, L. Marcenaro and C. S. Regazzoni, Automatic detection and indexing of video-event shots for surveillance applications, IEEE Trans. Multimed. 4(4) (2002) 459-471.
14. F. Fusier, V. Valentin, F. Bŕemond, M. Thonnat, M. Borg, D. Thirde and J. Ferryman, Video understanding for complex activity recognition, Mach. Vis. Appl. J. 18 (2007) 167-188.
15. M. S. Lew, N. Sebe and R. Jain, Content-based multimedia information retrieval: State of the art and challenges, ACM Trans. Multimed. Comput. Commun. Appl. 2(1) (2006) 1-19.
16. D. Lowe, Distinctive image features from scale invariant keypoints, Int. J. Comput. Vis. 60(2) (2004) 91-110.
17. D. G. Lowe, Object recognition from local scale-invariant features, Proc. Int. Conf. Computer Vision (ICCV) (1999), pp. 1150-1157.
18. Y. Ma, B. Miller and I. Cohen, Video sequence querying using clustering of objects' appearance models, in Int. Symp. Visual Computing (ISVC'07) (November 26-28, 2007), pp. 328-339.
19. J. Meessen, X. Desurmont, J. F. Delaigle, C. De Vleeschouwer and B. Macq, Progressive learning for interactive surveillance scenes retrieval, in Workshop on Visual Surveillance (VS07) (2007), pp. 1-8.
20. K. Mikolajczyk, T. Tuytelaars, C. Schmid, A. Zisserman, J. Matas, F. Schaffalitzky, T. Kadir and L. V. Gool, A comparison of affine region detectors, Int. J. Comput. Vis. 65(1/2) (2005) 43-72.
21. H. Muller, S. Marchand-Maillet and T. Pun, The truth about corel - Evaluation in image retrieval, in Proc. CIVR, London (July 2002), pp. 28-49.
22. J. C. Nascimento and J. S. Marques, Performance evaluation of object detection algorithms for video surveillance, IEEE Trans. Multimed. 8(4) (2006) 761-774.
23. A. T. Nghiem, F. Bremond, M. Thonnat and V. Valentin, ETISEO, performance evaluation for video surveillance systems, Proc. IEEE Int. Conf. Advanced Video and Signal Based Surveillance (AVSS), London (United Kingdom) (September 2007).
24. J. L. Patino, H. Benhadda, E. Corvee, F. Bremond and M. Thonnat, Extraction of activity patterns on large video recordings, IET Comput. Vis. 2(2) (2008) 108-128.
25. K. Mikolajczyk and C. Schmid, A performance evaluation of local descriptors, PAMI 27(10) (2005) 1615-1630.
26. M. Petkovic and W. Wonker, An overview of data models and query languages for content-based video retrieval, in Proc. Int. Conf. Advances in Infrastructure for Electronic Business, Science, and Education on the Internet, l'Aquila, Italy (6 August 2000).
27. P. Remagnino, G. A. Jones, N. Paragios and C. S. Regazzoni, Video Based Surveillance Systems Computer Vision and Distributed Processing (Kluwer Academic Publishers, 2002).
28. L. A. Rowe and R. Jain, ACMSIGMMretreat report on future directions in multimedia research, ACMTrans. Multimed. Comput. Comm. Appl. 1(1) (2005) 3-13.
29. Y. Rubner, C. Tomasi and L. J. Guibas, A metric for distributions with applications to image databases, Proc. Int. Conf. Computer Vision (ICCV'98) (1998), pp. 59-66.
30. Y. Rui and T. S. Huang, Relevance feedback techniques in image retrieval, Principles of Visual Information Retrieval (Springer-Verlag, 2001), pp. 219-258.
31. J. Stottinger, N. Sebe, T. Gevers and A. Hanbury, Colour interest points for image retrieval, in Computer Vision Winter Workshop, St. Lambrecht, Austria (February 6, 2007), pp. 83-91.
32. J. Sivic and A. Zisserman, Video google: Efficient visual search of videos, Toward Category-Level Object Recognition, LNCS 4170 (2006), pp. 127-144.
33. E. Stringa and C. S. Regazzoni, Real-time video-shot detection for scene surveillance applications, IEEE Trans. Imag. Process. 9(1) (2000) 69-79.
34. M. J. Swain and D. H. Ballard, Color indexing, Int. J. Comput. Vis. 7(1) (1991) 11-32.
35. V. T. Vu, F. Bŕemond and M. Thonnat, Automatic video interpretation: A novel algorithm for temporal scenario recognition, Proc. Int. Joint Conf. Artif. Intell. (IJCAI'03), Acapulco, Mexico (9-15 August 2003), pp. 1295-1302.
36. D. Xie, W. Hu, T. Tan and J. Peng, Semantic-based traffic video retrieval using activity pattern analysis, Int. Conf. Image Processing 1 (2004) 693-696.
37. Z. Xiong, X. S. Zhou, Q. Tian, R. Rui and T. S. Huang, Semantic retrieval of video - Review of research on video retrieval in meetings, movies and broadcast news, and sports, IEEE Process. Mag. 3(2) (2006) 18-27.
38. J. S. C. Yuk, K. Y. K. Wong, R. H. Y. Chung, K. P. Chow, F. Y. L. Chin and K. S. H. Tsang, Object-based surveillance video retrieval system with real-time indexing methodology, in Int. Conf. Image Analysis and Recognition (ICIAR'07) (5-7 September 2007), pp. 626-637.