Learning rich semantics from news video archives by style analysis

ACM Transactions on Multimedia Computing, Communications and Applications

Volumn 2, Issue 2, 2006, Pages 91-108

  Snoek, Cees G M ^a   Worring, Marcel ^a   Hauptmann, Alexander G ^b  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Benchmark evaluation; Multimedia understanding; Multimodal detectors; News video indexing; Semantic classification; Statistical pattern recognition; Style analysis

Indexed keywords

MULTIMODAL DETECTORS; STATISTICAL CLASSIFIERS; TRECVID BENCHMARKS; VIDEO ARCHIVES;

AUTOMATION; BROADCASTING; DATA REDUCTION; INDEXING (OF INFORMATION); MATHEMATICAL MODELS; SEMANTICS;

LEARNING SYSTEMS;

EID: 33748994587     PISSN: 15516857     EISSN: 15516865     Source Type: Journal    
DOI: 10.1145/1142020.1142021     Document Type: Article

References (39)

1. ADAMS, B., DORAI, C., AND VENKATESH, S. 2002. Toward automatic extraction of expressive elements from motion pictures: Tempo. IEEE Trans. Multimedia 4, 4, 472-481.
2. ADAMS, W. H., IYENGAR, G., LIN, C.-Y., NAPHADE, M., NETT, C., NOCK, H., AND SMITH, J. 2003. Semantic indexing of multimedia content using visual, audio, and text cues. EURASIP J. Appl. Signal Process. 2003, 2, 170-185.
3. AMIR, A., BERG, M., CHANG, S.-F., HSU, W., IYENGAR, G., LIN, C.-Y., NAPHADE, M., NATSEV, A., NETI, C., NOCK, H., SMITH, J., TSENG, B., WU, Y., AND ZHANG, D. 2003. IBM research TRECVID-2003 video retrieval system. In Proceedings of the TRECVID Workshop. NIST Special Publication. Gaithersburg, Md.
4. BAAN, J., BALLEGOOIJ, A., GEUSEBROEK, J., HIEMSTRA, D., DEN HARTOG, J., LIST, J., SNOEK, C., PATRAS, I., RAAIJMAKERS, S., TODORAN, L., VENDRIG, J., DE VRIES, A., WESTERVELD, T., AND WORRING, M. 2001. Lazy users and automatic video retrieval tools in (the) lowlands. In Proceedings of the 10th Text REtrieval Conference, E. Voorhees and D. Harman, eds. NIST Special Publication, vol. 500-250. Gaithersburg, Md.
5. BARRY, B. AND DAVENPORT, G. 2003. Documenting life: Videography and common sense. In Proceedings of the IEEE International Conference on Multimedia, & Expo. Baltimore, Md.
6. BOGGS, J. AND PETRIE, D. 2000. The Art of Watching Films, 5th ed. Mayfield Publishing Mountain View, Calif.
7. BORDWELL, D. AND THOMPSON, K. 1997. Film Art: An Introduction, 5th ed. McGraw-Hill, New York.
8. BREIMAN, L. 1996. Bagging predictors. Mach. Learn. 24, 2, 123-140.
9. CHANG, C.-C. AND LIN, C.-J. 2001. LIBSVM: A Library for Support Vector Machines. Software available at http://www.csie.ntu. edu.tw/-cjlin/libsvm/.
10. DAVIS, M. 2003. Editing out video editing. IEEE Multimedia 10, 2, 54-64.
11. DEY, A. 2001. Understanding and using context. Personal Ubiquitous Comput. Journal 5, 1, 4-7.
12. DOURISH, P. 2004. What we talk about when we talk about context. Personal Ubiquitous Comput. 8, 1, 19-30.
13. GAUVAIN, J., LAMEL, L., AND ADDA, G. 2002. The LIMSI broadcast news transcription system. Speech Commun. 37, 1-2, 89-108.
14. HANJALIC, A., LAGENDLJK, R., AND BIEMOND, J. 1999. Automated high-level movie segmentation for advanced video-retrieval systems. IEEE Trans. Circuits Syst. Video Technol. 9, 4, 580-588.
15. HAUPTMANN, A., BARON, R., CHEN, M.-Y., CHRISTEL, M., DUYGULU, P., HUANO, C., JIN, R., LIN, W.-H., NG, T., MORAVEJI, N., PAPERNICK, N., SNOEK, C., TZANETAKIS, G., YANG, J., YAN, R., AND WACTLAR, H. 2003. Informedia at TRECVID 2003: Analyzing and searching broadcast news video. In Proceedings of the TRECVID Workshop. NIST Special Publication. Gaithersburg, Md.
16. JAIN, A., DUIN, R., AND MAO, J. 2000. Statistical pattern recognition: A review. IEEE Trans. Pattern Anal. Mach. Intel. 22, 1, 4-37.
17. NACK, F. AND PUTZ, W. 2004. Saying what it means: Semi-Automated (news) media annotation. Multimedia Tools Appl. 22, 3, 263-302.
18. NAPHADE, M., KOZINTSEV, I., AND HUANG, T. 2002. A factor graph framework for semantic video indexing. IEEE Trans. Circuits Syst. Video Technol. 12, 1, 40-52.
19. PLATT, J. 2000. Probabilities for SV machines. In Advances in Large Margin Classifiers, A. Smola, et al., eds. MIT Press, Cambridge, Mass., 61-74.
20. QUÉNOT, G., MORARU, D., BESACIER, L., AND MULHEM, P. 2002. CLIPS at TREC-11: Experiments in video retrieval. In Proceedings of the 11th TextREtrieval Conference, E. Voorhees and L. Buckland, eds. NIST Special Publication, vol. 500-251. Gaithersburg, Md.
21. SALTON, G. AND MCGILL, M. 1983. Introduction to Modern Information Retrieval. McGraw-Hill, New York.
22. SATO, T., KANADE, T., HUGHES, E., SMITH, M., AND SATOH, S. 1999. Video OCR: Indexing digital news libraries by recognition of superimposed caption. Multimedia Syst. 7, 5, 385-395.
23. SCHAPIRE, R. 1990. The strength of weak learnability. Mach. Learn. 6, 2, 197-227.
24. SCHNEIDERMAN, H. AND KANADE, T. 2004. Object detection using the statistics of parts. Int. J. Comput. Vision 56, 3, 151-177.
25. SMEATON, A., KRAAIJ, W., AND OVER, P. 2003. TRECVID 2003 - An introduction. In Proceedings of the TRECVID Workshop. NIST Special Publication. Gaithersburg, Md.
26. SMEULDERS, A., WORHING, M., SANTINI, S., GUPTA, A., AND JAIN, R. 2000. Content based image retrieval at the end of the early years. IEEE Trans. Pattern Anal. Mach. Intell. 22, 12, 1349-1380.
27. SMITH, J. AND Li, C.-S. 1998. Decoding image semantics using composite region templates. In Proceedings of the IEEE CVPR-98 Workshop on Content-Based Access to Image, Video Databases. Santa Barbara, Calif.
28. SNOEK, C. AND WOHRING, M. 2005a. Multimedia event-based video indexing using time intervals. IEEE Trans. Multimedia, 7, 4, 638-647.
29. SNOEK, C. AND WORRING, M. 2005b. Multimodal video indexing: A review of the state-of-the-art. Multimedia Tools Appl. 25, 1, 5-35.
30. SNOEK, C., WORHING, M., AND HAUPTMANN, A. 2004. Detection of TV news monologues by style analysis. In Proceedings of the IEEE International Conference on Multimedia & Expo. Taipei, Taiwan.
31. SUNDARAM, H. AND CHANG, S.-F. 2002. Computable scenes and structures in films. IEEE Trans. Multimedia 4, 4, 482-491.
32. TRUONG, B., VENKATESH, S., AND DORAI, C. 2005. Extraction of film takes for cinematic analysis. Multimedia Tools Appl. 26, 3, 277-298.
33. TSENG, B., LIN, C.-Y, NAPHADE, M., NATSEV, A., AND SMITH, J. 2003. Normalized classifier fusion for semantic visual concept detection. In Proceedings of the IEEE International Conference on Image Processing, vol. 2. Barcelona, Spain, 535-538.
34. VAPNIK, V. 2000. The Nature of Statistical Learning Theory, 2nd ed. Springer Verlag, New York.
35. VENDRIG, J. AND WORRING, M. 2002. Systematic evaluation of logical story unit segmentation. IEEE Trans. Multimedia 4, 4, 492-499.
36. WACTLAR, H., CHRISTEL, M., GONG, Y., AND HAUPTMANN, A. 1999. Lessons learned from building a terabyte digital video library. IEEE Computer 32, 2, 66-73.
37. WOLPERT, D. 1992. Stacked generalization. Neural Netw. 5, 241-259.
38. XIE, L., Xu, P., CHANG, S.-F., DIVAKARAN, A., AND SUN, H. 2004. Structure analysis of soccer video with domain knowledge and hidden Markov models. Pattern Recogn. Lett. 25, 7, 767-775.
39. ZHANG, H.-J., WU, J., ZHONG, D., AND SMOLIAR, S. 1997. An integrated system for content-based video retrieval and browsing. Pattern Recogn. 30, 4, 643-658.