Integrated mining of visual features, speech features, and frequent patterns for semantic video annotation

IEEE Transactions on Multimedia

Volumn 10, Issue 2, 2008, Pages 260-267

  Tseng, Vincent S ^a,b   Su, Ja Hwung ^b   Huang, Jhih Hong ^b   Chen, Chih Jen ^b  

^a IEEE

^b NATIONAL CHENG KUNG UNIVERSITY   (Taiwan)

Author keywords

Association rule; Data mining; Frequent semantic patterns; Sequential patterns; Video annotation

Indexed keywords

ASSOCIATION RULES; DATA MINING; DATA REDUCTION; MULTIMEDIA SERVICES; SEMANTICS; STATISTICAL METHODS;

FREQUENT SEMANTIC PATTERNS; SEQUENTIAL PATTERNS; VIDEO ANNOTATION; VIDEO CONTENT ANALYSIS;

FEATURE EXTRACTION;

EID: 38349194813     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2007.911832     Document Type: Article

References (26)

1. W. H. Adams, G. Iyengar, C. Y. Lin, M. R. Naphade, C. Neti, H. J. Nock, and J. R. Smith, "Semantic indexing of multimedia content using visual, audio, and text cues," EURASIP J. Appl. Signal Process., vol. 2003, no. 2, pp. 170-185, 2003.
2. R. Agrawal, T. Imielinski, and A. Swami, "Mining association rules between sets of items in large databases," in Proc. ACM SIGMOD Int. Conf. Manage. Data-SIGMOD, 1993, pp. 207-216.
3. A. Amir, M. Berg, S.-F. Chang, W. Hsu, G. Iyengar, C.-Y. Lin, M. Naphade, A. Natsev, C. Neti, H. Nock, J. R. Smith, B. Tseng, Y. Wu, and D. Zhang, "IBM research TRECVID-2003 video retrieval system," in Proc. TRECVID Workshop, 2003.
4. I. Bartolini, P. Ciaccia, V. Oria, and M. T. Ozsu, "Flexible integration of multimedia sub-queries with qualitative preferences," in Multimedia Tools Applicat., Jun. 2007, vol. 33, pp. 275-300.
5. W.-T. Balke and U. Guntzer, "Multi-Objective query processing for database systems," in Proc. 30th Int. Conf. Very Large Data Bases, Toronto, ON, Canada, Sep. 2004.
6. W.-T. Balke, U. Guntzer, and J. X. Zheng, "Efficient distributed skylining for web information systems," in Proc. 6th Int. Conf. Extending Database Technol., Crete, Greece, Mar. 2004.
7. S. F. Chang, W. Chen, H. J. Meng, H. Sundaram, and D. Zhong, "A fully automated content-based video search engine supporting spatiotemporal queries," IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 5, Sep. 1998.
8. A. Dorado, J. Calic, and E. Izquierdo, "A rule-based video annotation system," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 5, pp. 622-633, May. 2004.
9. R. Fagin, "Combining fuzzy information from multiple systems," in Proc. 15th ACM SIGACT-SIGMOD-SIGART Symp. Principles Database Syst., Montreal, QC, Canada, Jun. 1996.
10. R. Fagin, R. Kumar, and D. Sivakumar, "Efficient similarity search and classification via rank aggregation," in Proc. ACM SIGMOD Int. Conf. Manage. Data, San Diego, CA, Jun. 2003.
11. R. Fagin, A. Lotem, and M. Naor, "Optimal aggregation algorithms for middleware," in Proc. 20th ACM SIGACT-SIGMODSIGART Symp. Principles Database Syst., Santa Barbara, CA, May 2001.
12. S. L. Feng, R. Manmatha, and V. Lavrenko, "Multiple bernoulli relevance models for image and video annotation," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognition, 2004, vol. 2, pp. 1002-1009.
13. M. Flickner, H. Sawhney, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hafner, D. Lee, Petkovic, D. Steele, and P. Y. anker, "Query by image and video content: The QBIC system," IEEE Comput. Mag., Sep. 1995.
14. V. Lavrenko, S. L. Feng, and R. Manmatha, "Statistical models for automatic video annotation and retrieval," in Proc. Int. Conf. Acoustics, Speech Signal Process., May 2004.
15. Z.-N. Li, O. R. Zaiane, and Z. Tauber, "Illumination invariance and object model in content-based image and video retrieval," J. Vis. Commun. Image Represent., vol. 10, no. 3, pp. 219-244, 1999.
16. Y. Luo and J.-N. Hwang, "Video sequence modeling by dynamic Bayesian networks: A systematic application from coarse-to-fine grains," in Proc. IEEE Int. Conf. Image Process., Sep. 2003.
17. J. R. Smith and S.-F. Chang, "VisualSEEK: A fully automated content-based image query system," in Proc. ACM Multimedia Conf., Nov. 1996.
18. M. V. Srinivasan, S. Venkatesh, and R. Hosie, "Qualitative estimation of camera otion parameters from video sequences," Pattern Recognit., vol. 30, no. 4, pp. 93-606, 1997.
19. V. S. Tseng, M.-H. Wang, and J.-H. Su, "A new method for image classification by using multilevel association rules," in Proc. IEEE Int. Workshop Manag. Data For Emerging Multimedia Applicat., 2005.
20. V. S. Tseng, C-.J. Lee, and J.-H. Su, "Classify by representative or associations (CBROA): A hybrid approach for image classification," in Proc. 6th Int. Workshop Multimedia Data Min., Chicago, IL, Aug. 2005.
21. V. S. Tseng, J.-H. Su, and J.-H. Huang, "A novel video annotation method by integrating visual features and frequent patterns," in Proc. 7th Int. Workshop Multimedia Data Min., Philadelphia, PA, Aug. 2006.
22. Y. Zhang, M. A. Nascimento, and O. R. Zaïane, "Building image mosaics: An application of content-based image retrieval," in Proc. IEEE Int. Conf. Multimedia Expo, Baltimore, MD, Jul. 6-9, 2003.
23. X. Zhu and X. Wu, "Sequential association mining for video summarization," in Proc. IEEE Int. Conf. Multimedia Expo, Jul. 2003, vol. 3, pp. 333-336.
24. X. Zhu and X. Wu, "Mining video associations for efficient database management," in Proc. 18th Internal Joint Conf. Artificial Intell., Aug. 2003, pp. 1422-1424.
25. X. Zhu, X. Wu, A. K. Elmagarmid, Z. Feng, and L. Wu, "Video data mining: Semantic indexing and event detection from the association perspective," IEEE Trans. Knowl Data Eng., vol. 17, May 2005.
26. R. Zhang, Z. Zhang, M. Li, W. Ma, and H. Zhang, "A probabilistic semantic model for image annotation and multi-modal image retrieval," ACM Multimedia Syst. J., vol. 12, no. 1, pp. 27-33, Aug. 2006.