Integrated semantic-syntactic video modeling for search and browsing

IEEE Transactions on Multimedia

Volumn 6, Issue 6, 2004, Pages 839-851

  Ekin, Ahmet ^a,b   Tekalp, A Murat ^a,c   Mehrotra, Rajiv ^d  

^a University of Rochester   (United States)

^b PHILIPS RESEARCH LABORATORIES   (Netherlands)

^c KOÇ UNIVERSITY   (Turkey)

^d EASTMAN KODAK COMPANY   (United States)

Author keywords

Events; Integrated video model; Model based query formation; Object motion description; Query resolution by graph matching; Video objects

Indexed keywords

BROADCASTING; COMPUTER VISION; DATABASE SYSTEMS; INFORMATION RETRIEVAL; SEMANTICS; SYNTACTICS; WEB BROWSERS;

EVENTS; INTEGRATED VIDEO MODEL; MODEL-BASED QUERY FORMATION; OBJECT MOTION DESCRIPTION; QUERY RESOLUTION BY GRAPH MATCHING; VIDEO OBJECTS;

IMAGE PROCESSING;

EID: 10044296005     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2004.837238     Document Type: Article

References (44)

1. C. Colombo, A. Del Bimbo, and P. Pala, "Semantics in visual information retrieval," IEEE Multimedia, vol. 6, pp. 38-53, July-Sept. 1999.
2. E. Oomoto and K. Tanaka, "OVID: Design and implementation of a video-object database system," IEEE Trans. Knowledge Data Eng., vol. 5, pp. 629-643, Aug. 1993.
3. R. Hjelsvold and R. Midstraum, "Modeling and querying video data," in Proc. 20th VLDB Conf., Santiago, Chile, 1994.
4. S. Adali, K. S. Candan, S. S. Chen, K. Erol, and V. S. Subrahmanian, "The advanced video information system: Data structures and query processing," Multimedia Syst., vol. 4, pp. 172-186, 1996.
5. J. L. Koh, C. S. Lee, and A. L. P. Chen, "Semantic video model for content-based retrieval," in Proc. IEEE Int. Conf. Multimedia Computing and Syst., vol. 2, 1999, pp. 472-478.
6. L. A. E. AI Safadi and J. R. Getta, "Semantic modeling for video content-based retrieval systems," in Proc. 23rd AustralAsian Computer Science Conf., 2000, pp. 2-9.
7. J. R. Smith and A. B. Benitez, "Conceptual modeling of audio-visual content," in Proc. IEEE Int. Conf. Multimedia and Expo (ICME), vol. 2, 2000, pp. 915-918.
8. M. Flickner, H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovic, D. Steele, and P. Yanker, "Query by image and video content: The QBIC system," IEEE Computer, vol. 28, pp. 23-32, Sept. 1995.
9. J. R. Bach et al., "Virage image search engine: An open framework for image management," in Proc. IS&T/SPIE Conf. Storage and Retrieval for Image and Video Databases IV, Feb. 1996, pp. 76-87.
10. J. R. Smith and S. F. Chang, "VisualSEEk: A fully automated content-based image query system," in Proc. ACM Conf. Multimedia, Boston, MA, Nov. 1996.
11. S. F. Chang, W. Chen, H. J. Meng, H. Sundaram, and D. Zhong, "A fully automated content-based video search engine supporting spatio-temporal queries," IEEE Trans. Circuits Syst. Video Technol., vol. 8, pp. 602-615, Sept. 1998.
12. A. Yoshitaka, T. Ishii, M. Hirakawa, and T. Ichikawa, "VIOLONE: Video retrieval by motion example," J. Vis. Lang. Comput., vol. 7, no. 4, pp. 423-443, 1996.
13. K. Porkaew, M. Ortega, and S. Mehrotra, "Query reformulation for content based multimedia retrieval in MARS," in Proc. IEEE Int. Conf. Multimedia Computing and Syst., vol. 2, 1999, pp. 747-751.
14. S. Antani, R. Kasturi, and R. Jain, "A survey on the use of pattern recognition methods for abstraction, indexing, and retrieval of images and video," Pattern Recognit., vol. 35, no. 4, pp. 945-965, Apr. 2002.
15. A. W. M. Smoulders, M. Worring, S. Santini, A. Gupta, and R. Jain, "Content-based image retrieval at the end of early years," IEEE Trans. Pattern Anal. Machine Intell., vol. 22, pp. 1349-1380, Dec. 2000.
16. Y. Rui, T. S. Huang, and S.-F. Chang, "Image retrieval: Current techniques, promising directions, and open issues," J. Vis. Commun. Image Repres., vol. 10, no. 1, pp. 39-62, Mar. 1999.
17. Y. A. Aslandogan and C. T. Yu, "Techniques and systems for image and video retrieval," IEEE Trans. Knowledge Data Eng., vol. 11, pp. 56-63, Jan./Feb. 1999.
18. A. Yoshitaka and T. Ichikawa, "A survey on content-based retrieval for multimedia databases," IEEE Trans. Knowledge Data Eng., vol. 11, pp. 81-93, Jan./Feb. 1999.
19. F. Idris and S. Panchanathan, "Review of image and video indexing techniques," J. Vis. Commun. Image Represen., vol. 8, no. 2, pp. 146-166, June 1997.
20. A. Pentland, R. Picard, and S. Sclaroff, "Photobook: Tools for content-based manipulation of image databases," in Proc. IS&T/SPIE Conf. Storage and Retrieval for Image and Video Databases II, Feb. 1994.
21. S. W. Smoliar and H. Zhang, "Content-based video indexing and retrieval," IEEE Multimedia, vol. 1, pp. 62-72, 1994.
22. J.-Y. Chen, C. Taskiran, A. Albiol, C. A. Bouman, and E. J. Delp, "ViBE: A video indexing and browsing environment," in Proc. IS&T/SPIE Conf. Storage and Retrieval for Media Databases IV, Jan. 1999, pp. 199-207.
23. Y. Rui, T. S. Huang, M. Ortega, and S. Mehrotra, "Relevance feedback: A power tool for interactive content-based image retrieval," IEEE Trans. Circuits Syst. Video Technol., vol. 8, pp. 644-655, Sept. 1998.
24. I. J. Cox, M. L. Miller, T. P. Minka, T. V. Papathomas, and P. N. Yianilos, "The Bayesian image retrieval system, PicHunter: Theory, implementation, and psychological experiments," IEEE Trans. Image Processing, vol. 9, pp. 20-37, Jan. 2000.
25. S. Santini and R. Jain, "Integrated browsing and querying for image databases," IEEE Multimedia, vol. 7, pp. 26-39, July-Sept. 2000.
26. W. Chen and S.-F. Chang, "Creating semantic visual templates for video databases," in Proc. IEEE Int. Conf. Multimedia and Expo (ICME), vol. 3, 2000, pp. 1337-1340.
27. M. R. Naphade and T. S. Huang, "A probabilistic framework for semantic video indexing, filtering, and retrieval," IEEE Trans. Multimedia, vol. 3, pp. 141-151, Mar. 2001.
28. M.-S. Hacid, C. Decleir, and J. Kouloumdjian, "A database approach for modeling and querying video data," IEEE Trans. Knowledge Data Eng., vol. 12, pp. 729-749, Sept./Oct. 2000.
29. ISO/IEC Committee Draft 15938-5 Information Technology - Multimedia Content Description Interface: Multimedia Description Schemes, ISO/IEC/JTC1/SC29/WG11/N3966, Mar. 2001.
30. ISO/IEC Committee Draft 15938-5 Information Technology-Multimedia Content Description Interface: Multimedia Description Schemes, ISO/IEC/JTC1/SC29/WG11/N4242, Oct. 2001.
31. P. P. Chen, "The entity-relationship model-Toward a unified view of data," ACM Trans. Database Syst., vol. 1, no. 1, pp. 9-36, Mar. 1976.
32. MPEG-7 Visual Part of Experimentation Model Version 10.0, MPEG-7 Output Document ISO/IEC/JTC1/SC29/WG11/MPEG99/N4063, Mar. 2001.
33. J. F. Allen, "Maintaining knowledge about temporal intervals," Commun. ACM, vol. 26, no. 11, pp. 832-843, 1983.
34. J. Z. Li, M. T. Ozsu, and D. Szafron, "Modeling of video spatial relationships in an object database management system," in Proc. IEEE Proc. Int. Workshop on Multimedia DB Management Syst, 1996.
35. M. Egenhofer and R. Franzosa, "Point-set topological spatial relations," Int. J. Geograp. Inform. Syst., vol. 5, no. 2, pp. 161-174, 1991.
36. S. K. Chang, "Iconic indexing by 2D strings," IEEE Trans. Pattern Anal. Machine Intell., vol. 6, no. 4, pp. 413-428, 1984.
37. M. Gyssens, J. Paredaens, J. van den Bussche, and D. van Gucht, "A graph-oriented object database model," IEEE Trans. Knowledge Data Eng., vol. 6, pp. 572-586, Aug. 1994.
38. M. Andries, M. Gemis, J. Paradeans, I. Thyssens, and J. B. van den Bussche et al., "Concepts for graph-oriented object manipulation," in Advances in Database Tech. - EDBT'92, A. Pirotte et al., Eds. New York: Springer-Verlag, 1992, pp. 21-38.
39. Y. Fu, A. Ekin, A. M. Tekalp, and R. Mehrotra, "Temportal segmentation of video objects for hierarchial object-based motion description," IEEE Trans. Image Processing, vol. 11, pp. 135-145, Feb. 2002.
40. A. Ekin, A. M. Tekalp, and R. Mehrotra, "Automatic extraction of low-level object motion descriptors," in Proc. IEEE ICIP, Thessaloniki, Greece, Oct. 2001.
41. A. Ekin and A. M. Tekalp, "A framework for analysis and tracking of soccer video," in Proc. IS&T/SPIE Conf. Visual Communication and Image Processing (VCIP), Jan. 2002.
42. A. Ekin, A. M. Tekalp, and R. Mehrotra, "Automatic soccer video analysis and summarization," IEEE Trans. Image Processing., vol. 12, no. 7, pp. 796-807, July 2003.
43. M. R. Garey and D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness. San Francisco, CA: W. H. Freeman, 1979.
44. S. Dagtas, W. Al-Khatib, A. Ghafoor, and R. L. Kashyap, "Models for motion-based video idexing and retrieval," IEEE Trans. Image Processing, vol. 9, pp. 88-101, Jan. 2000.