An overview of multimodal video representation for semantic analysis

IET Seminar Digest

Volumn 2005, Issue 11099, 2005, Pages 39-45

  Ćalić, Janko ^a   Campbell, Neill ^a   Dasiopoulou, Stamatia ^b   Kompatsiaris, Yiannis ^b  

^a UNIVERSITY OF BRISTOL   (United Kingdom)

^b INFORMATICS AND TELEMATICS INSTITUTE   (Greece)

Author keywords

content based indexing and retrieval; multimodality; semantic gap; Video representation

Indexed keywords

ADAPTIVE REPRESENTATIONS; CONTENT-BASED INDEXING AND RETRIEVAL; DIGITAL MULTIMEDIA; LITERATURE SURVEY; MULTI-MODAL; MULTI-MODALITY; SEMANTIC ANALYSIS; SEMANTIC GAP; VIDEO REPRESENTATIONS;

DIGITAL STORAGE; INDEXING (OF INFORMATION); VIDEO RECORDING;

SEMANTICS;

EID: 78651471921     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1049/ic.2005.0708     Document Type: Conference Paper

References (54)

1. B.D. Adams. Where does computational media aesthetics fit? IEEE Multimedia Magazine, spec. ed. Computational Media Aesthetics, April-June 2003.
2. W. Al-Khatib, Y.F. Day, A. Ghafoor, and P.B. Berra. Semantic modeling and knowledge representation in multimedia databases. IEEE Transactions on Knowledge and Data Engineering, 11(1):64-80, Jan/Feb 1999.
3. Steve Anderson. Select and combine: The rise of database narratives. Res Magazine, 7(1):52-53, Jan/Feb 2004.
4. Kobus Barnard, Pinar Duygulu, David Forsyth, Nando de Freitas, David M. Blei, and Michael I. Jordan. Matching words and pictures. J. Mach. Learn. Res., 3:1107-1135, 2003.
5. M. Bertini, A. Del Bimbo, and W. Nunziati. Highlights modeling and detection in sports videos. Pattern Analysis and Applications, 2005.
6. S. Bloehdorn, K. Petridis, C. Saathoff, N. Simou, V. Tzouvaras, Y. Avrithis, S. Handschuh, I. Kompatsiaris, S. Staab, and M. G. Strintzis. Semantic annotation of images and videos for multimedia analysis. In Proceedings of the 2nd European Semantic Web Conference, ESWC 2005, Heraklion, Greece, May 2005.
7. John S. Boreczky and Lawrence A. Rowe. Comparison of video shot boundary detection techniques. In Storage and Retrieval for Image and Video Databases (SPIE), pages 170-179, 1996.
8. Tilo Burghardt, Janko Calic, and Barry Thomas. Tracking animals in wildlife videos using face detection. In European Workshop on the Integration of Knowledge, Semantics and Digital Media Technology, October 2004.
9. Tilo Burghardt, Barry Thomas, Peter J Barham, and Janko Calic. Automated visual recognition of individual african penguins. In Fifth International Penguin Conference, Ushuaia, Tierra del Fuego, Argentina, September 2004.
10. Janko Calic, Neill Campbell, Majid Mirmehdi, Barry Thomas, Ron Laborde, Sarah Porter, and Nishan Canagarajah. ICBR - multimedia management system for intelligent content based retrieval. In International Conference on Image and Video Retrieval CIVR 2004, pages 601-609. Springer LNCS 3115, July 2004.
11. Janko Calic and Barry Thomas. Spatial analysis in keyframe extraction using video segmentation. In Workshop on Image Analysis for Multimedia Interactive Services, April 2004.
12. Gert Cauwenberghs and Tomaso Poggio. Incremental and decremental support vector machine learning. In Proc. of Neural Information Processing Systems (NIPS) 2000, Denver, USA.
13. Glorianna Davenport, Thomas Aguirre Smith, and Natalio Pincever. Cinematic primitives for multimedia. IEEE Comput. Graph. Appl., 11(4):67-74, 1991.
14. Marc Davis. Media streams: representing video for retrieval and repurposing. In MULTIMEDIA '94: Proceedings of the second ACM international conference on Multimedia, pages 478-479, New York, NY, USA, 1994. ACM Press.
15. Marc Davis. Media streams: representing video for retrieval and repurposing. PhD thesis, Cambridge, MA, USA, 1995.
16. Nevenka Dimitrova. Context and memory in multimedia content analysis. IEEE MultiMedia, 11(3):7-11, 2004.
17. A. Dorado, J. Calic, and E. Izquierdo. A rule-based video annotation system. Circuits and Systems for Video Technology, IEEE Transactions on, 14(5):622-633, May 2004.
18. Chitra Dorai and Svetha Venkatesh. Media computing: computational media aesthetics. The Kluwer international series in video computing. Kluwer Academic Publishers, Boston; London, 2002.
19. Venkatesh S. Dorai, C. Bridging the semantic gap with computational media aesthetics. Multimedia, IEEE, 10:15-17, 2003.
20. Sergei Eisenstein and Jay Leyda. Film Form Essays in film theory. Dennis Dobson Ltd, [S.l.], 1949. edited and translated by Jay Leyda.
21. M. Flickner, H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovic, D. Steele, and P. Yanker. Query by image and video content: The qbic system. IEEE Computer, 28(9):23-32, 1995.
22. U. Gargi, R. Kasturi, and S. H. Strayer. Performance characterization of video-shot-change detection methods. Circuits and Systems for Video Technology, IEEE Transactions on, 10(1):1, 2000.
23. Louis D. Giannetti. Understanding movies. PrenticeHall; London: Prentice-Hall International (UK), Upper Saddle River, N.J., 9th ed. edition, 2002.
24. A. Hanjalic, L. Q. Xu. Affective video content representation and modeling. IEEE Transactions on Multimedia, 7, 1, 143-154, 2005.
25. Sion Hannuna, Neill Campbell, and David Gibson. Segmenting quadruped gait patterns from wildlife video. In The IEE International Conference on Visual Information Engineering: Convergence in Graphics and Vision., pages 235-243. Institution of Electrical Engineers, April 2005.
26. S. Kiranyaz, K. Caglar, E. Guldogan, and M. Gabbouj. Muvis: A content-based multimedia indexing and retrieval framework. In Proc. of the Third International Workshop on Content-Based Multimedia Indexing, CBMI 2003, pages 405-412, Rennes, France, Sept. 2003.
27. I. Kompatsiaris, Y. Avrithis, P. Hobson, T. May, and J. Tromp. Achieving Integration of Knowledge and Content Technologies: The AceMedia Project. In Proc. European Workshop on the Integration of Knowledge, Semantics and Digital Media Technology, Royal Statistical Society, London, UK, Nov. 2004.
28. Irena Koprinska and Sergio Carrato. Temporal video segmentation: A survey. Signal Processing: Image Communication, 16(5):477, 2001.
29. Lev Kuleshov and Ronald Levaco. Kuleshov on film: writings by Lev Kuleshov. University of California Press, Berkeley; London, 1974.
30. R. Leonardi and P. Migliorati. Semantic indexing of multimedia documents. Multimedia, IEEE, 9(2):44, 2002.
31. R. Leonardi, P. Migliorati, and M. Prandini. Semantic indexing of soccer audio-visual sequences: a multimodal approach based on controlled Markov chains. Circuits and Systems for Video Technology, IEEE Transactions on, 14(5):634, 2004.
32. Dongge Li, Nevenka Dimitrova, Mingkun Li, and Ishwar K. Sethi. Multimedia content processing through cross-modal association. In MULTIMEDIA '03: Proceedings of the eleventh ACM international conference on Multimedia, pages 604-611, New York, NY, USA, 2003. ACM Press.
33. Lev Manovich. The language of new media. Leonardo. MIT Press, Cambridge, Mass.; London, 2001.
34. Christian Metz. [Essais sur la signification au cińema.] Film language. A semiotics of the cinema. Translated by Michael Taylor. New York: Oxford University Press, 1974.
35. V. Mezaris, H. Doulaverakis, S. Herrmann, B. Lehane, N. OConnor, I. Kompatsiaris, and M. G. Strintzis. The SCHEMA Reference System: An Extensible Modular System for Content-based Information Retrieval. In Proc. Workshop on Image Analysis For Multimedia Interactive Services (WIAMIS), Montreux, Switzerland, April. 2005.
36. F. Nack and A. Parkes. Toward the automated editing of theme-oriented video sequences. Applied Artificial Intelligence, 11(4):331-366, 1997.
37. Milind R. Naphade. On supervision and statistical learning for semantic multimedia analysis. Journal of Visual Communication and Image Representation, 15(3):348-369, 2004.
38. Laurence Nigay and Jöelle Coutaz. A design space for multimodal systems: concurrent processing and data fusion. In CHI '93: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 172-178, New York, NY, USA, 1993. ACM Press.
39. M. Ramesh Naphade, I. V. Kozintsev, and T. S. Huang. Factor graph framework for semantic video indexing. Circuits and Systems for Video Technology, IEEE Transactions on, 12(1):40, 2002.
40. J.J. Rocchio, Jr. The SMART Retrieval System: Experiments in Automatic Document Processing, chapter Relevance Feedback in Information Retrieval, pages 313-323. Prentice-Hall, 1971.
41. S. Santini, A. Gupta, and R. Jain. Emergent semantics through interaction in image databases. Knowledge and Data Engineering, IEEE Transactions on, 13(3):337, 2001.
42. C. Saraceno and R. Leonardi. Indexing audiovisual databases through joint audio and video processing. IJIST, 9(5):320-331, 1999.
43. Ferdinand de Saussure. Course in general linguistics. Duckworth, London, 1983.
44. Arnold W. M. Smeulders, Marcel Worring, Simone Santini, Amarnath Gupta, and Ramesh Jain. Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Anal. Mach. Intell., 22(12):1349-1380, 2000.
45. J.R. Smith and S.F. Chang. Tools and techniques for color image retrieval. In Storage and Retrieval for Image and Video Databases (SPIE), pages 426-437, 1996.
46. J.R. Smith and S.F. Chang. Image and video search engine for the world wide web. In Storage and Retrieval for Image and Video Databases (SPIE), pages 84-95, 1997.
47. C.G.M. Snoek and M. Worring. Multimodal video indexing: A review of the state-of-the-art. Multimedia Tools and Applications, 25(1):5-35, 2005.
48. S. Staab. Emergent semantics. IEEE Intelligent Systems, 17(1):78-81, 2002.
49. J. Vendrig and M. Worring. Systematic evaluation of logical story unit segmentation. IEEE Transactions on Multimedia, 4(4):492-499, 2002.
50. M. E. J. Wood, N. W. Campbell and B. T. Thomas. Iterative refinement by relevance feedback in content-based digi tal image retrieval. In ACM Multimedia 98, 13-20. ACM September, 1998.
51. Wang Yao, Liu Zhu, and Huang Jin-Cheng. Multimedia content analysis-using both audio and visual clues. Signal Processing Magazine, IEEE, 17(6):12, 2000.
52. A. Yoshitaka and T. Ichikawa. A survey on content-based retrieval for multimedia databases. IEEE Transactions on Knowledge and Data Engineering, 11(1):81-93, Jan/Feb 1999.
53. HongJiang Zhang, Atreyi Kankanhalli, and Stephen W. Smoliar. Automatic partitioning of full-motion video. Multimedia Syst., 1(1):10-28, 1993.
54. Xiang Sean Zhou and Thomas S. Huang. Relevance feedback in image retrieval: A comprehensive review. Multimedia Syst., 8(6):536-544, 2003.