A system for the semantic multimodal analysis of news audio-visual content

Eurasip Journal on Advances in Signal Processing

Volumn 2010, Issue , 2010, Pages

  Mezaris, Vasileios ^a   Gidaros, Spyros ^a   Papadopoulos, Georgios Th ^a,b   Kasper, Walter ^c   Steffen, Jörg ^c   Ordelman, Roeland ^d   Huijbregts, Marijn ^d,e   De Jong, Franciska ^d   Kompatsiaris, Ioannis ^a   Strintzis, Michael G ^a,b  

^a INFORMATICS AND TELEMATICS INSTITUTE   (Greece)

^b ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

^c GERMAN RESEARCH CENTER FOR ARTIFICIAL INTELLIGENCE DFKI   (Germany)

^d UNIVERSITY OF TWENTE   (Netherlands)

^e RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

AUDIO-VISUAL CONTENT; AUTOMATIC ANALYSIS; AUTOMATIC GENERATION; BROADCAST VIDEO; FUSION TECHNIQUES; INTELLIGENT SEARCH; MODALITY ANALYSIS; MULTIMEDIA CONTENTS; MULTIMODAL ANALYSIS; NEWS CONTENT; RELATED CONTENT; SEMANTIC ANNOTATIONS; STATE-OF-THE-ART METHODS;

VISUAL COMMUNICATION;

SEMANTICS;

EID: 77953521314     PISSN: 16876172     EISSN: 16876180     Source Type: Journal    
DOI: 10.1155/2010/645052     Document Type: Article

References (40)

1. Chang S.-F., The holy grail of content-based media analysis IEEE Multimedia 2002 9 2 6 10
2. Dasiopoulou S., Mezaris V., Kompatsiaris I., Papastathis V.-K., Strintzis M. G., Knowledge-assisted semantic video object detection IEEE Transactions on Circuits and Systems for Video Technology 2005 15 10 1210 1224
3. Assfalg J., Berlini M., Bimbo A. D., Nunziat W., Pala P., Soccer highlights detection and recognition using HMMs Proceedings of the IEEE International Conference on Multimedia and Expo (ICME '05) July 2005 Amsterdam, The Netherlands 825 828
4. Zhang L., Lin F., Zhang B., Support vector machine learning for image retrieval 2 Proceedings of the IEEE International Conference on Image Processing (ICIP01 '01) October 2001 Thessaloniki, Greece 721 724 (Pubitemid 33057807)
5. Hollink L., Little S., Hunter J., Evaluating the application of semantic inferencing rules to image annotation Proceedings of the 3rd International Conference on Knowledge Capture (K-CAP '05) October 2005 Banff, Canada
6. Papadopoulos G. Th., Mezaris V., Kompatsiaris I., Strintzis M. G., Combining global and local information for knowledge-assisted image analysis and classification EURASIP Journal on Advances in Signal Processing 2007 2007 15
7. Papandreou G., Katsamanis A., Pitsikalis V., Maragos P., Adaptive multimodal fusion by uncertainty compensation with application to audiovisual speech recognition IEEE Transactions on Audio, Speech and Language Processing 2009 17 3 423 435
8. Alexander J., Becker T., Overlay as the basic operation for discourse processing in the multimodal dialogue system Proceedings of the Workshop on Knowledge and Reasoning in Practical Dialogue Systems (IJCAI '01) August 2001 Seattle, Washington
9. Zhang J., A novel video searching model based on ontology inference and multimodal information fusion 2 Proceedings of the International Symposium on Computer Science and Computational Technology (ISCSCT '08), December 2008 Shanghai, China 489 492
10. Lin W.-H., Hauptmann A., News video classification using SVM-based multimodal classifiers and combination strategies Proceedings of the ACM International Multimedia Conference and Exhibition (MM '02) 2002 323 326
11. Lie W.-N., Su C.-K., News video classification based on multi-modal information fusion 1 Proceedings of the International Conference on Image Processing, (ICIP '05) September 2005 1213 1216
12. Laudy C., Ganascia J.-G., Information fusion in a TV program recommendation system Proceedings of the 11th International Conference on Information Fusion June 2008 1 8
13. Wahlster W., Fusion and fission of speech, gestures, and facial expressions 2821 Proceedings of the International Workshop on Man-Machine Symbiotic Systems 2002 Kyoto, Japan 213 225
14. Liu Y.-T., Liu T.-Y., Qin T., Ma Z.-M., Li H., Supervised rank aggregation Proceedings of the 16th International World Wide Web Conference, (WWW '07) 2007 481 490
15. Kennedy L., Chang S.-F., Natsev A., Query-adaptive fusion for multimodal search Proceedings of the IEEE 2008 96 4 567 588
16. Qi W., Gu L., Jiang H., Chen X.-R., Zhang H.-J., Integrating visual, audio and text analysis for news video 3 Proceedings of the IEEE International Conference on Image Processing (ICIP '00) September 2000 Vancouver, Canada 520 523
17. Luo H., Fan J., Satoh S., Yang J., Ribarsky W., Integrating multi-modal content analysis and hyperbolic visualization for large-scale news video retrieval and exploration Signal Processing Image Communication 2008 23 7 538 553
18. Chen M.-Y., Hauptmann A., Multi-modal classification in digital news libraries Proceedings of the ACM IEEE International Conference on Digital Libraries, (JCDL '04) June 2004 Tucson, Ariz, USA 212 213
19. Wang P., Cai R., Yang S.-Q., A hybrid approach to news video classification with multimodal features Proceedings of the 4th International Conference on Information, Communications and Signal Processing (ICICS-PCM '03) December 2003 Singapore 787 791
20. Wu Y., Lin C.-Y., Chang E. Y., Smith J. R., Multimodal information fusion for video concept detection 4 Proceedings of the International Conference on Image Processing, (ICIP '04) October 2004 Singapore 2391 2394
21. Laudy C., Ganascia J.-G., Sedogbo C., High-level fusion based on conceptual graphs Proceedings of the 10th International Conference on Information Fusion July 2007 Quebec, Canada 1 8
22. Lv Y., Ng W. W. Y., Lee J. W. T., Sun B., Yeung D. S., Information extraction based on information fusion from multiple news sources from the web Proceedings of the IEEE International Conference on Systems, Man and Cybernetics October 2008 Singapore 1471 1476
23. Papadopoulos G. Th., Mezaris V., Kompatsiaris I., Strintzis M. G., Ontology-driven semantic video analysis using visual information objects Proceedings of the International Conference on Semantics and Digital Media Technologies (SAMT '07) December 2007 Genova, Italy 56 69
24. Bescos J., Real-time shot change detection over online MPEG-2 video IEEE Transactions on Circuits and Systems for Video Technology 2004 14 4 475 484
25. Sikora T., The MPEG-7 visual standard for content descriptionan overview IEEE Transactions on Circuits and Systems for Video Technology 2001 11 6 696 702
26. Mezaris V., Kompatsiaris I., Strintzis M. G., Still image segmentation tools for object-based multimedia applications International Journal of Pattern Recognition and Artificial Intelligence 2004 18 4 701 725
27. Dalal N., Triggs B., Histograms of oriented gradients for human detection 1 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, (CVPR '05) June 2005 San Diego, Calif, USA 886 893
28. Vapnik V., Statistical Learning Theory 1998 New York, NY, USA John Wiley Sons
29. Tax D. M. J., Duin R. P. W., Using two-class classifiers for multiclass classification Proceedings of the 16th International Conference on Pattern Recognition (ICPR '02) August 2002 Quebec City, Canada 124 127
30. De Jong F. M. G., Westerveld T., De Vries A. P., Multimedia search without visual analysis: the value of linguistic and contextual information IEEE Transactions on Circuits and Systems for Video Technology 2007 17 3 365 371
31. Huijbregts M., Wooters C., Ordelman R., Filtering the unknown: speech activity detection in heterogeneous video collections 2 Proceedings of the 8th Annual Conference of the International Speech Communication Association (Interspeech '07) August 2007 Antwerp, Belgium 969 972
32. van Leeuwen D., Huijbregts M., The AMI speaker diarization system for NIST RT06s meeting data Machine Learning for Multimodal Interaction (MLMI) 2007 4299 Berlin, Germany Springer 371 384 Lecture Notes in Computer Science
33. Young S. J., Russell N., Thornton J., Token passing: a simple conceptual model for connected speech recognition systems 1989 Cambridge, UK Engineering Department, Cambridge University
34. Huijbregts M., Ordelman R., de Jong F., Fast N-Gram language model look-ahead for decoders with static pronunciation prefix trees proceedings of Interspeech September 2008 Brisbane, Australia
35. Carpenter B., The Logic of Typed Feature Structures 1992 Cambridge, UK CUP
36. Drozdzynski W., Krieger H.-U., Piskorski J., Schäfer U., Xu F., Shallow processing with unification and typed featurestructuresfoundations and applications Künstliche Intelligenz 2004 1 17 23
37. Drozdzynski W., Krieger H.-U., Piskorski J., Schäfer U., Sprout-a general-purpose nlp framework integrating finitestate and unification-based grammar formalisms Proceedings of the 5th International Workshop on Finite-State Methods and Natural Language Processing September 2005 Helsinki, Springer
38. Mezaris V., Gidaros S., Papadopoulos G. T., Knowledge-assisted cross-media analysis of audio-visual content in the news domain Proceedings of the International Workshop on Content-Based Multimedia Indexing (CBMI '08) June 2008 London, UK 280 287
39. Viola P., Jones M. J., Robust real-time face detection International Journal of Computer Vision 2004 57 2 137 154
40. Aslam J. A., Montague M., Models for metasearch Proceedings of the 24th International ACM SIGIR Conference on Research and Development in Information Retrieval September 2001 New Orleans, La, USA 276 284