Multimedia Indexing and Retrieval Using Natural Language, Speech and Image Processing Methods

Multimedia Content and the Semantic Web: Standards, Methods and Tools

Volumn , Issue , 2005, Pages 279-297

  Papageorgiou, Harris ^a   Prokopidis, Prokopis ^a   Protopapas, Athanassios ^a   Carayannis, George ^a  

^a INSTITUTE FOR LANGUAGE AND SPEECH PROCESSING   (Greece)

Author keywords

Audio content analysis; CIWMOS architecture; Combined IMage and WOrd Spotting (CIMWOS); Image processing and understanding; Multimedia digital libraries; Multimedia information retrieval (MIR) system; Named entity detection (NED); Optical character recognition (OCR); Story detection and topic classification

Indexed keywords

CLASSIFICATION (OF INFORMATION); DIGITAL LIBRARIES; INDEXING (MATERIALS WORKING); NATURAL LANGUAGE PROCESSING SYSTEMS; OPTICAL CHARACTER RECOGNITION; OPTICAL DATA PROCESSING; SEARCH ENGINES;

AUDIO CONTENT ANALYSIS; MULTIMEDIA DIGITAL LIBRARIES; MULTIMEDIA INFORMATION RETRIEVAL; NAMED ENTITIES; OPTICAL CHARACTER RECOGNITION (OCR); TOPIC CLASSIFICATION; WORD SPOTTING;

IMAGE PROCESSING;

EID: 84947303307     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/0470012617.ch11     Document Type: Chapter

References (40)

1. H. Papageorgiou, A. Protopapas, CIMWOS: a multimedia, multimodal and multilingual indexing and retrieval system. In E. Izquierdo (ed.) Digital Media Processing for Multimedia Interactive Services, Proceedings of the 4th European Workshop on Image Analysis for Multimedia Interactive Services, Queen Mary, University of London, 9-11 April 2003, pp. 563-568. World Scientific, Singapore, 2003.
2. Y. Wang, Z. Liu, J.-C. Huang, Multimedia content analysis: using both audio and visual clues. IEEE Signal Processing Magazine, 17(6), 12-36, 2000.
3. Z. Liu,Y.Wang, T. Chen, Audio feature extraction and analysis for scene segmentation and classification. Journal of VLSI Signal Processing Systems for Signal, Image, and Video Technology, 20(1), 61-79, 1998.
4. J.-L. Gauvain, R. De Mori, L. Lamel, Advances in large vocabulary speech recognition. Computer Speech and Language, 16(1), 1-3, 2002.
5. J.-L. Gauvain, L. Lamel, G. Adda, Audio partitioning and transcription for broadcast data indexation. Multimedia Tools and Applications, 14, 187-200, 2001.
6. F. Kubala, J. Davenport, H. Jin, D. Liu, T. Leek, S. Matsoukas, D. Miller, L. Nguyen, F. Richardson, R. Schwartz, J. Makhoul, The 1997 BBN BYBLOS System applied to Broadcast News Transcription. In Proceedings of the DARPA Broadcast News Transcription and Understanding Workshop, Lansdowne, VA, 8-11 February 1998. National Institute of Standards and Technology, Gaithersburg, MD, 1998. Available at:http://www.nist.gov/speech/publications/darpa98/pdf/eng110.pdf.
7. J.L. Gauvain, L. Lamel, G. Adda, Transcribing broadcast news for audio and video indexing. Communications of the ACM, 43(2), 64-70, 2000.
8. E.F. Tjong Kim Sang, Introduction to the CoNLL-2002 shared task: language-independent named entity recognition. In D. Roth, A. van den Bosch (eds) CoNLL-2002, Sixth Conference on Natural Language Learning, Taipei, Taiwan, 31 August -1 September 2002. Available at: http://cnts.uia.ac.be/conll2002/proceedings.html.
9. I. Demiros, S. Boutsis, V. Giouli, M. Liakata, H. Papageorgiou, S. Piperidis, Named entity recognition in Greek texts. In Proceedings of the Second International Conference on Language Resources and Evaluation, LREC2000, Athens, Greece, 31 May-2 June 2000, pp. 1223-1228. ELRA, 2000.
10. C. Jacquemin, E. Tzoukermann, NLP for term variant extraction: synergy between morphology, lexicon and syntax. In T. Strzalkowski (ed.) Natural Language Information Retrieval. Kluwer, Dordrecht, 1999.
11. A. Hauptmann, M. Smith, Text, speech, and vision for video segmentation: the Informedia Project. In AAAI Fall 1995 Symposium on Computational Models for Integrating Language and Vision. American Association for Artificial Intelligence, 1995.
12. SRI Maestro Team, MAESTRO: conductor of multimedia analysis technologies. Communications of the ACM, 43(2), 57-63, 2000.
13. A. Merlino, D. Morey, M. Maybury, Broadcast news navigation using story segments. In Proceedings of the Fifth ACM International Conference on Multimedia, Seattle,WA, 9-13 November 1997, pp. 381-391. ACM, Seattle, WA, 1997.
14. F. Cardinaux, C. Sanderson, S. Marcel, Comparison of MLP and GMM classifiers for face verification on XM2VTS. In J. Kittler, M.S. Nixon (eds) Proceedings of the 4th International Conference on Audio- and Video-Based Biometric Person Authentication (AVBPA), Guildford, 9-11 June 2003. Springer-Verlag, Berlin, 2003.
15. The CombinedMIT/CMUTest Set with GroundTruth for Frontal Face Detection, http://vasc.ri.cmu.edu/idb/html/ face/frontal images/index.html.
16. D. Chen, H. Bourlard, J.-Ph. Thiran, Text identification in complex background using SVM. In Proceedings of the International Conference on Computer Vision and Pattern Recognition, Kauai, Hawaii, December 2001, vol. 2, pp. 621-626. IEEE, 2001.
17. J.M. Odobez, D. Chen, Robust video text segmentation and recognition with multiple hypotheses. In Proceedings of the International Conference on Image Processing, ICIP 2002. IEEE, 2002.
18. V. Ferrari, T. Tuytelaars, L. Van Gool, Wide-baseline muliple-view correspondences. In Proceedings of the International Conference on Computer Vision and Pattern Recognition ICIP 2003, Madison, WI, June 2003. IEEE, 2003.
19. T. Tuytelaars, A. Zaatri, L. Van Gool, H. Van Brussel, Automatic object recognition as part of an integrated supervisory control system. In Proceedings of IEEE Conference on Robotics and Automation, ICRA00, San Francisco, CA, April 2000, pp. 3707-3712. IEEE, 2000.
20. V. Ferrari, T. Tuytelaars, L. Van Gool, Real-time affine region tracking and coplanar grouping. In Proceedings of the International Conference on Computer Vision and Pattern Recognition, Kauai, Hawaii, December 2001, vol. 2. IEEE, 2001.
21. H. Papageorgiou, A. Protopapas, T. Netousek, Retrieving video segments based on combined text, speech and image processing. In Proceedings of the Broadcast Engineering Conference, April 2003, pp. 177-182. National Association of Broadcasters, 2003.
22. A.F. Smeaton, Paul Over, The TREC-2002 Video track report. In E.M. Voorhees, L.P. Buckland (eds) The Eleventh TExt Retrieval Conference (TREC 2002), Gaithersburg, MD, 19-22 November 2002. NIST Special Publication 500-251. National Institute of Standards and Technology, Gaithersburg, MD, 2002. Available at:http://trec.nist.gov/pubs/trec11/t11 proceedings.html.
23. N. Dimitrova, H.-J. Zhang, B. Shahraray, I. Sezan, T. Huang, A. Zakhor, Applications of video-content analysis and retrieval. IEEE Multimedia, 9(3), 42-55, 2002.
24. IEEE Multimedia, Special issue: Content-Based Multimedia Indexing and Retrieval, 9(2), 18-60, 2002.
25. A. Pentland, R.W. Picard, S. Sclaroff, Photobook: content-based manipulation of image databases. International Journal of Computer Vision, 18(3), 233-254, 1996.
26. V.E. Ogle, M. Stonebraker, Chabot: retrieval from a relational database of images. IEEE Computer, 28(9), 164-190, 1995.
27. DWR photo database, http://elib.cs.berkeley.edu/photos/dwr/about.html.
28. Blobworld, http://elib.cs.berkeley.edu/photos/blobworld.
29. J.R. Smith, S.-F. Chang, Tools and techniques for color image retrieval. In I.K. Sethi, R.C. Jain (eds) Storage and Retrieval for Still Image and Video Databases IV, SPIE vol. 2670, pp. 426-437. SPIE, 1996.
30. J.R. Smith and S.-F. Chang, Image and video search engine for the world wide web. In I.K. Sethi, R.C. Jain (eds) Storage and Retrieval for Image and Video Databases V, SPIE vol. 3022, pp. 84-95. SPIE, 1997.
31. S.-F. Chang, W. Chen, H.J. Meng, H. Sundaram, D. Zhong, VideoQ: an automated content-based video search system using visual cues. In Proceedings of International Multimedia Conference, Seattle,WA, November 1997, pp. 313-324. Addison-Wesley, Reading, MA, 1997.
32. T.S. Huang, S. Mehrotra, K. Ramchandran, Multimedia Analysis and Retrieval System (MARS) project. In P.B. Heidorn, B. Sandore (eds) Proceedings of the 33rd Annual Clinic on Library Application of Data Processing:Digital Image Access and Retrieval, Urbana, IL, March 1996, pp. 100-117. University of Illinois, 1997.
33. C. Nastar, M. Mitschke, C. Meilhac, N. Boujemaa, Surfimage: a flexible content-based image retrieval system. In Proceedings of International Multimedia Conference, Bristol, 12-16 September 1998, pp. 339-344. Addison-Wesley, Harlow, 1998.
34. K. Seidel, M. Datcu, G. Schwarz, L. Van Gool, Advanced remote sensing information system at ETH Zurich and DLR/DFD Oberpfaffenhofen. In IEEE International Geoscience and Remote Sensing Symposium IGARSS '99, Hamburg, Germany, pp. 2363-2365. IEEE, 1999.
35. W.Y. Ma, B.S. Manjunath, NeTra: a toolbox for navigating large image databases. In Proceedings of International Conference on Image Processing, Santa Barbara, CA, October 1997, vol. 1, pp 568-571. IEEE, 1997.
36. R. Manmatha, S. Ravela, A Syntactic characterization of appearance and its application to image retrieval. In B.E. Rogowitz, T.N. Pappas (eds) Human Vision and Electronic Imaging II, SPIE vol. 3016, pp. 484-495. SPIE, 1997.
37. Query By Image Content, http://wwwqbic.almaden.ibm.com.
38. Convera, http://www.convera.com.
39. Society of Motion Picture and Television Engineers, http://www.smpte.org.
40. Virage, http://www.virage.com.