A multi-modal system for the retrieval of semantic video events

Computer Vision and Image Understanding

Volumn 96, Issue 2 SPEC. ISS., 2004, Pages 216-236

  Amir, Arnon ^a   Basu, Sankar ^b,c   Iyengar, Giridharan ^b   Lin, Ching Yung ^b   Naphade, Milind ^b   Smith, John R ^b   Srinivasan, Savitha ^a   Tseng, Belle ^b  

^a IBM ALMADEN RESEARCH CENTER   (United States)

^b IBM T J WATSON RESEARCH CENTER   (United States)

^c NATIONAL SCIENCE FOUNDATION   (United States)

Author keywords

Content based video retrieval; Event detection; Multimedia indexing; Semantic video annotation

Indexed keywords

ALGORITHMS; CAMERAS; GAIT ANALYSIS; IMAGE CODING; IMAGE SEGMENTATION; ITERATIVE METHODS; LEARNING SYSTEMS; MATHEMATICAL MODELS; MODAL ANALYSIS; MOTION PLANNING; MULTIMEDIA SYSTEMS; QUERY LANGUAGES; SEMANTICS;

CONTENT-BASED VIDEO RETRIEVAL; EVENT DETECTION; MULTIMDEIA INDEXING; SEMANTIC VIDEO ANNOTATION;

CONTENT BASED RETRIEVAL;

EID: 4944223458     PISSN: 10773142     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cviu.2004.02.006     Document Type: Conference Paper

References (33)

1. A. Anjum, J.K. Aggarwal, Segmentation and recognition of continuous human activity, in: Proc. IEEE Workshop on Detection and Recognition of Events in Video (EVENT-01), Vancouver, Canada, 2001.
2. A. Amir, M. Berg, G. Iyengar, C-Y. Lin, C. Dorai, M. Naphade, A. Natsev, C. Neti, H. Nock, I. Sachdev, J.R. Smith, Y. Wu, B. Tseng, D. Zhang, Ibm research trecvid-2003 video retrieval system, in: Proc. NIST TRECVID 2003, Gaithersburg, MD, 2003.
3. J.K. Aggarwal, Q. Cai, Human motion analysis: a review, Comput. Vision Image Understanding 73 (3) (1999) 428-440.
4. A. Del Bimbo, Visual Information Retrieval, Morgan Kaufmann, San Francisco, CA, 1999.
5. M. Brand, N. Oliver, A. Pentland, Coupled hidden Markov models for complex action recognition, Proc. Comput. Vision Pattern Recogn. (1997) 994-999.
6. E. Brown, S. Srinivasan, A. Coden, D. Ponceleon, J. Cooper, A. Amir, Towards speech as a knowledge resource, IBM Syst. J. 40 (4) (2001) 985-1001.
7. R.O. Duda, P.E. Hart, Pattern Classification and Scene Analysis, Wiley Eastern, New York, 1973.
8. A.P. Dempster, N.M. Laird, D.B. Rubin, Maximum likelihood from incomplete data via the EM algorithm, Proc. R. Stat. Soc. B (39) (1977) 1-38.
9. S. Srinivasan, A. Amir, G. Ashur, D. Petkovic, D. Ponceleon, The IBM CueVideo Toolkit Version 2.1. Available from: 〈http://www.almaden.ibm.com/ projects/cuevideo.shtml/〉.
10. J. Makhoul, et al., Speech and language technologies for audio indexing and retrieval, Proc. IEEE 88 (8) (2000) 1338-1353.
11. M. Flickner, H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovic, D. Steele, P. Yanker, Query by image and video content: the QBIC system, IEEE Comput. 28 (9) (1995) 23-32.
12. J. Garofolo, G. Auzanne, E. Voorhees, The trec spoken document retrieval track: a success story, November 16-19, 1999.
13. D.M. Gavrila, The visual analysis of human movement: a survey, Comput. Vision Image Understanding 73 (1) (1999) 82-98.
14. Y. Gong, L.T. Sin, C.H. Chuan, H.-J. Zhang, M. Sakauchi, Automatic parsing of tv soccer programs, in: Proc. IEEE Internat. Conf. on Multimedia Computing and Systems, Washington. DC, 1995, pp. 165-174.
15. Niels Haering, Niels da Vitoria Lobo, Visual Event Detection, the Kluwer Int. Series in Video Computing, Kluwer Academic Publishers, New York, NY, 1992.
16. ISO/IEC JTC 1/SC 29/WG 11/N3966. Text of 15938-5 FCD Information Technology - Multimedia Content Description Interface-Part 5 Multimedia Description Schemes, Final Committee Draft (FCD) edition, March 2001.
17. R. Jain, R. Kasturi, B. Schunck, Machine Vision, MIT Press and McGraw-Hill, New York, 1995.
18. Anil K. Jain, Aditya Vailaya, Shape-based retrieval: a case study with trademark image databases, Pattern Recogn. 31 (9) (1998) 1369-1390.
19. M. Naphade, S. Basu, C. Lin, J. Smith, B. Tseng, A statistical modeling approach to content-based video retrieval, in: Proc. 16th Internat. Conference on Pattern Recognition, ICPR 2002, Quebec City, Canada, vol. 2, 2002, pp. 953-956.
20. A. Natsev, Y.-C. Chang, J.R. Smith, C.-S. Li, J.S. Vitter, Supporting incremental join queries on ranked inputs, in: Proc. Conference on Very Large Databases (VLDB), Rome, Italy, September 2001.
21. Milind R. Naphade, Thomas S. Huang, Detecting semantic concepts using context and audiovisual features, in: Proc. IEEE Workshop on Detection and Recognition of Events in Video (EVENT-01), Vancouver, Canada, 2001.
22. R. Sharma, N. Krahnstover, M. Yeasin, Towards a unified framework for tracking and analysis of human motion, in: Proc. IEEE Workshop on Detection and Recognition of Events in Video (EVENT-01), Vancouver, Canada, 2001.
23. M. Naphade, I. Kozintsev, T.S. Huang, K. Ramchandran, A factor graph framework for semantic indexing and retrieval in video, in: Proc. IEEE Workshop on Content-based Access to Image and Video Libraries (CBAIVL). Hilton Head, SC, June 12, 2000.
24. M.R. Naphade, C.Y. Lin, J.R. Smith, B.L. Tseng, S. Basu, Learning to annotate video databases, in: IS&T/SPIE Symposium on Electronic Imaging: Science and Technology - Storage & Retrieval for Image and Video Databases 2002, vol. 4676, San Jose, CA, January, 2002.
25. P. Over, R. Taban, The trec-2001 video track framework, in: 10th Text Retrieval Conference (TREC-10), Gaithersburg, Maryland, USA, November 2001.
26. M. Petkovic, W. Jonker, Content-based video retrieval by integrating spatio-temporal and stochastic recognition of events, in: Proc. of IEEE Workshop on Detection and Recognition of Events in Video (Event 2001), Vancouver, BC, Canada, July 8, 2001.
27. H.V. Poor, An Introduction to Signal Detection and Estimation, second ed., Springer-Verlag, New York, 1999.
28. R. Qian, N. Hearing, I. Sezan, A computational approach to semantic event detection, in: Proceedings of Computer Vision and Pattern Recognition, Fort Collins, CO, vol. 1, June 1999, pp. 200-206.
29. S.E. Robertson, A. Walker, K. Sparck-Jones, M.M. Hancock-Beaulieu, M. Gatford, OKAPI at TREC-3, in: Proc. Third Text Retrieval Conference, 1995.
30. J.R. Smith, Mpeg-7 standard for multimedia databases, in: ACM Intl. Conference on Data Management (ACM SIGMOD), Santa Barbara, California, May 2001.
31. S. Srinivasan, D. Petkovic, Phonetic confusion matrix based spoken document retrieval, in: Proc. of Twenty-Third Annual Int. ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR-2000), Athens, Greece, July 2000.
32. E. Voorhees, D. Harman, Overview of the ninth text retrieval conference, in: Proceedings of the Ninth Text Retrieval Conference (TREC-9), Gaithersburg, Maryland, USA, November 16-19, 1999.
33. A. Yoshitaka, T. Ichikawa, A survey on content-based retrieval for multimedia databases, IEEE Trans. Knowledge Data Eng. 11(1) (1999) 81-93.