Multimedia content processing through cross-modal association

Proceedings of the ACM International Multimedia Conference and Exhibition

Volumn , Issue , 2003, Pages 604-611

  Li, Dongge ^a   Dimitrova, Nevenka ^b   Li, Mingkun ^c   Sethi, Ishwar K ^c  

^a MOTOROLA INC   (United States)

^b PHILIPS RESEARCH LABORATORIES   (Netherlands)

^c OAKLAND UNIVERSITY   (United States)

Author keywords

Cross modal association; Cross modal factor analysis (CFA); Cross modal information retrieval; Talking head analysis

Indexed keywords

ALGORITHMS; COMMUNICATION CHANNELS (INFORMATION THEORY); IMAGE COMPRESSION; INFORMATION RETRIEVAL; MULTIMEDIA SYSTEMS; SEMANTICS; SPEECH RECOGNITION; SYNCHRONIZATION;

CROSS-MODAL ASSOCIATION; LATENT SEMANTIC INDEXING (LSI); TALKING HEAD ANALYSIS; VIDEO ANALYSIS;

DATA PROCESSING;

EID: 2342451199     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/957013.957143     Document Type: Conference Paper

References (18)

1. M. M. Cohen and D. Massaro, "Synthesis of visible speech," Behaviour Research Methods, Instruments and Computers, Vol. 22, No. 2, pp. 260-263, April 1990.
2. Harry McGurk and John MacDonald, "Hearing lips and seeing voices," Nature, 264:746-748, December 1976.
3. Michele Covell, Christoph Bregler. "Eigenpoints." Proc. Int. Conf. Image Processing, Lausanne, Switzerland, Vol. 3, pp. 471-474, 1996.
4. Mingkun Li, Dongge Li, Nevenka Dimitrova, and Ishwar K. Sethi, "Audio-visual talking face detection," Proc. International Conference on Multimedia and Expo (ICME), pp. 473-476, Baltimore, MD, July 2003.
5. Malcolm Slaney and Michele Covell, "FaceSync: A linear operator for measuring synchronization of video facial images and audio tracks," Proc. Advances in Neural Information Processing Systems (NIPS), pp. 814-820, November 2000.
6. John Hershey and Javier Movellan. "Using audio-visual synchrony to locate sounds," Proc. Advances in Neural Information Processing Systems (NIPS), pp. 813-819, December 1999.
7. Hani C. Yehia, Philip E. Rubin, Eric Vatikiotis-Bateson, "Quantitative association of vocal-tract and facial behavior," Speech Communication, Vol. 26, pp. 23-43, 1998.
8. Dongge Li, Gang Wei, Ishwar K. Sethi, N. Dimitrova, "Person Identification in TV programs," Journal on Electronic Imaging, Vol. 10, Issue. 4, pp. 930-938, October 2001.
9. John W. Fisher III, Trevor Darrell, William T. Freeman, Paul Viola, "Learning joint statistical models for audio-visual fusion and segregation," Advances in Neural Information Processing Systems (NIPS), pp. 772-778, November 2000.
10. G. Iyengar, H. Nock, C. Neti, "Audio-visual synchrony for detection of monologues in video archives" Proc. ICASSP, April 2003.
11. Ishwar K. Sethi, Ioana Coman, Brian Day, Feng Jiang, Dongge Li, Jose Segovia-Juarez, Gang Wei, and Bemon You, "Color-WISE: A system for image similarity retrieval using color," SPIE Proc. on Storage and Retrieval for Image and Video Database VI, vol. 3312, pp. 140-149, San Jose, CA, January 1998.
12. M. G. Brown, J. T. Foote, G. J. Jones, K. S. Jones, and S. J. Young, "Open-vocabulary speech indexing for voice and video mail retrieval," Proc. of ACM Multimedia 96, pp. 307-316, Boston, MA, 1996.
13. Fillia Makedon and Charles Owen, "Cross-modal retrieval of scripted speech audio," SPIE Proc. On Multimedia Computing and Networking, vol. 3310, pp. 226-235, San Jose, CA, January 1998.
14. Gang Wei and Ishwar K. Sethi "Omni-face detection for video/image content description", Proc. International Workshop on Multimedia Information Retrieval, in conjunction with ACM Multimedia Conference 2000, (MIR2000), pp. 185-189, November 2000.
15. Wojtek Krzanowski, Principles of multivariate analysis, Oxford University Press, Oxford, 1988.
16. Pei L. Lai and Colin Fyfe, "Canonical correlation analysis using artificial neural networks," Proc. European Symposium on Artificial Neural Networks (ESANN), 1998.
17. Barbara G. Tabachnick and Linda S. Fidell, Using multivariate statistics, Allyn and Bacon Press, 1996.
18. Dongge Li, Ishwar K. Sethi, Nevenka Dimitrova, Tom McGee, "Classification of general audio data for content-based retrieval", Pattern Recognition Letters, Vol. 22, No. 5, pp. 533-544, April 2001.