Automatic detection and indexing of video-event shots for surveillance applications

IEEE Transactions on Multimedia

Volumn 4, Issue 4, 2002, Pages 459-471

  Foresti, Gian Luca ^a   Marcenaro, Lucio ^b   Regazzoni, Carlo S ^b  

^a UNIVERSITY OF UDINE   (Italy)

^b UNIVERSITY OF GENOA   (Italy)

Author keywords

Information retrieval; Object detection; Surveillance; Video signal processing

Indexed keywords

AUTOMATIC INDEXING; IMAGE ANALYSIS; IMAGE COMMUNICATION SYSTEMS; IMAGE UNDERSTANDING; OBJECT RECOGNITION; ONLINE SYSTEMS; VIDEO SIGNAL PROCESSING;

OBJECT DETECTION; VIDEO EVENT SHOTS; VIDEO SEQUENCES;

CONTENT BASED RETRIEVAL;

EID: 0037002069     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2002.802024     Document Type: Article

References (49)

1. C. S. Regazzoni, G. Vernazza, and G. Fabri, Advanced Video-Based Surveillance Systems. Dordrecht, The Netherlands: Kluwer, 1998.
2. G. L. Foresti, P. Mahonen, and C. S. Regazzoni, Multimedia Video-Based Surveillance Systems: Requirements, Issues and Solutions. Dordrecht, The Netherlands: Kluwer, 2000.
3. E. Stringa and C. S. Regazzoni, "Content-based retrieval and real time detection from video sequences acquired by surveillance systems," Proc. IEEE Int. Conf. Image Processing, vol. 3, pp. 138-142, Oct. 4-7, 1998.
4. E. Stringa and C. S. Regazzoni, "Real-time video-shot detection for scene surveillance applications," IEEE Trans. Image Processing, vol. 9, pp. 69-79, Jan. 2000.
5. T. Rachidi, S. A. Maelainin, and A. Bensaid, "Scene change detection using adaptive skip factors," Proc. IEEE Int. Conf. Image Processing (ICIP97), Oct. 26-29, 1997.
6. H. H. Yu and W. Wolf, "A hierarchical multiresolution video shot transition detection scheme," Comput. Vis. Image Understand., vol. 75, no. 1-2, pp. 196-213, 1999.
7. N. V. Patel and I. K. Sethi, "Video shot detection and characterization for video databases," Pattern Recognit., vol. 30, no. 4, pp. 583-592, 1997.
8. A. D. Doulamis, N. D. Doulamis, and S. D. Kollias, "A fuzzy video content representation for video summarization and content-based retrieval," Signal Process., vol. 80, no. 6, pp. 1049-1067, 2000.
9. H. J. Zhang, J. H. Wu, D. Zhong, and S. W. Smoliar, "An integrated system for content-based video retrieval and browsing," Pattern Recognit., vol. 30, no. 4, pp. 643-658, 1997.
10. J. D. Courtney, "Automatic video indexing via object motion analysis," Pattern Recognit., vol. 30, no. 4, pp. 607-625, 1997.
11. M. S. Drew, J. Wei, and Z. N. Li, "Illumination-invariant image retrieval and video segmentation," Pattern Recognit., vol. 32, no. 8, pp. 1369-1388, 1999.
12. S. Dagtas, W. Al-Khatib, A. Ghafoor, and R. L. Kashyap, "Models for motion-based video indexing and retrieval," IEEE Trans. Image Processing, vol. 9, pp. 88-101, Jan. 2000.
13. V. Roth, "Content-based retrieval from digital video," Image Vis. Comput., vol. 17, no. 7, pp. 531-540, 1999.
14. W. G. Chen, G. B. Giannakis, and N. Nandhakumar, "A harmonic retrieval framework for discontinuous motion estimation," IEEE Trans. Image Processing, vol. 7, pp. 1242-1257, Sept. 1998.
15. T. Rachidi, S. A. Maelainin, and A. Bensaid, "Scene change detection using adaptive skip factors," Proc. IEEE Int. Conf. Image Processing (ICIP97), Oct. 26-29, 1997.
16. B. Furht, S. W. Smoliar, and H. Zhang, Video and Image Processing in Multimedia Systems. Dordrecht, The Netherlands: Kluwer, 1995.
17. H. Hampapur, R. Jain, and T. E. Weymouth, "Indexing in video databases," in Proc. SPIE, Storage and Retrieval for Image and Video Databases II, vol. 2420, Feb. 1995, pp. 292-306.
18. J. Y. A. Wang and E. H. Adelson, "Layered representation for image sequence coding," Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, pp. 221-224, Apr. 1993.
19. J. Y. A. Wang and E. H. Adelson, "Layered representation for motion analysis," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 361-366, June 1993.
20. H. S. Sawhney and S. Ayer, "Compact representations of videos through dominant and multiple motion estimation," IEEE Trans. Pattern Anal. Machine Intell., vol. 18, pp. 814-830, Aug. 1996.
21. M. Irani and P. Anandan, "Video indexing based on mosaic representations," Proc. IEEE, vol. 86, pp. 905-921, May 1998.
22. D. C. Hogg, "Model-based vision: A program to see a walking person," Image Vis. Comput., vol. 1, no. 1, pp. 5-20, 1983.
23. A. Baunberg and D. Hogg, "Learning flexible models from image sequences," in Proc. 3rd Eur. Conf. Computer Vision, vol. I, 1994, pp. 299-308.
24. R. Polana and R. Nelson, "Detecting activities," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 2-7, June 1993.
25. K. Rohr, "Incremental recognition of pedestrian from image sequences," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 8-13, June 1993.
26. A. J. Lipton, H. Fujiyoshi, and C. Thorpe, "Moving target classification and tracking from real-time video," Proc. 4th IEEE Workshop of Applications of Computer Vision, pp. 8-14, Oct. 1998.
27. H. Fujiyoshi, and A. J. Lipton, "Real-time human motion analysis by image skeletonization," Proc. 4th IEEE Workshop of Applications of Computer Vision, pp. 15-21, Oct. 1998.
28. A. Galton, "Toward an integrated logic of space, time and motion," presented at the Int. Joint Conf. Artificial Intelligence (IJCAI), Chambery, France, Aug. 1993.
29. M. Brand, N. Oliver, and A. Pentland, "Coupled hidden Markov models for complex action recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 1997.
30. N. Chleq and M. Thonnat, "Real-time image sequence interpretation for video-surveillance applications," Proc. IEEE Int. Conf. Image Processing (ICIP96), vol. III, pp. 801-804, Sept. 1996.
31. P. L. Rosin and T. J. Ellis, "Frame-based system for image interpretation," Image Vis. Comput., vol. 9, pp. 353-361, 1991.
32. R. Koenen, "Profiles and levels in MPEG-4: Approach and overview," Signal Process.: Image Commun., no. 4-5, pp. 463-478, Jan. 2000.
33. C. Wren, A. Azerbayejani, T. Darrel, and A. Pentalnd, "Pfinder: Real-time tracking of the human body," IEEE Trans. Pattern Anal. Machine Intell., vol. 19, pp. 780-785, July 1997.
34. 4: Real-time surveillance of people and their activities," IEEE Trans. Pattern Anal. Machine Intell., vol. 22, pp. 809-830, Aug. 2000.
35. S. J. McKenna, S. Jabri, Z. Duric, H. Wechsler, and A. Rosenfeld, "Tracking groups of people," Comput. Vis. Image Understand., vol. 80, pp. 42-56, 2000.
36. D. Gavrila, "The visual analysis of human movement: A survey," Comput. Vis. Image Understand., vol. 73, no. 1, pp. 82-98, 1999.
37. A. Tesei, A. Teschioni, C. S. Regazzoni, and G. Vernazza, "Long-memory matching of interacting complex objects from real image sequences," in Time-Varying Image Processing and Moving Object Recognition, V. Cappellini, E., Amsterdam, The Netherlands: Elsevier, 1997, pp. 283-288.
38. A. Chanda, "Application of binary mathematical morphology to separate overlapped objects," Pattern Recognit. Lett., vol. 13, no. 9, pp. 639-645, Sept. 1992.
39. M. Bogaert, N. Chleq, P. Cornez, C. S. Regazzoni, A. Teschioni, and M. Thonnat, "The Passwords project," Proc. IEEE Int. Conf. Image Processing, pp. 675-678, Sept. 1996.
40. M. J. Swain and D. H. Ballard, "Color indexing," Int. J. Comput. Vis., vol. 7, no. 1, pp. 11-32, 1991.
41. G. L. Foresti and F. Roli, "Real-time recognition of suspicious events for advanced visual-based surveillance," in Multimedia Video-Based Surveillance Systems: From User Requirements to Research Solutions, G. L. Foresti, C. S. Regazzoni, and P. Mahonen, Eds. Dordrecht, The Netherlands: Kluwer, 2000, pp. 84-93.
42. F. Bremond and M. Thonnat, "Tracking multiple nonrigid objects in video sequences,"IEEE Trans. Circuits Syst. Video Technol., vol. 8, pp. 585-591, 1998.
43. G. L. Foresti, "Outdoor scene classification by a neural tree based approach," Pattern Analysis and Applications, vol.2, pp. 129-142, 1999.
44. E. James, L. Hollins, D. J. Brown, I. C. Luckraft, and C. R. Gent, "Feature vectors for road vehicle scene classification," Neural Networks, vol. 9, no. 2, pp. 337-344, 1996.
45. L. Marcenaro, F. Oberti, and C. S. Regazzoni, "Multiple objects color-based tracking using multiple cameras in complex time-varying outdoor scenes," Proceedings of the 2nd IEEE Int. Workshop on PETS, Dec. 9, 2001.
46. F. Oberti, "Reconfigurable, Distributed and Intelligent Video Surveillance Networks," Ph.D. thesis, Univ. Genoa, Italy, Feb. 2002.
47. J. H. Piater and J. L. Crowley, "Multi-modal tracking targets using Gaussian approximations," Proc. 2nd IEEE Int. Workshop on PETS, Dec. 9, 2001.
48. G. L. Foresti, "Object detection and tracking in time-varying and badly illuminated outdoor environments," Opt. Eng., vol. 37, no. 9, pp. 2550-2564, 1998.
49. T. Kailath, "The divergence and Bhattacharyya distance measures in signal selection," IEEE Trans. Commun. Tech., vol. COM-15, pp. 52-60, 1967.