Optimal multimodal fusion for multimedia data analysis

ACM Multimedia 2004 - proceedings of the 12th ACM International Conference on Multimedia

Volumn , Issue , 2004, Pages 572-579

  Wu, Yi ^a   Chang, Kevin Chen Chuan ^b   Chang, Edward Y ^a   Smith, John R ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^c IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Curse of dimensionality; Independent analysis; Modality independence; Multimodal fusion; Super kernel fusion

Indexed keywords

DATA REDUCTION; FEATURE EXTRACTION; HEURISTIC METHODS; INFORMATION ANALYSIS; PROBABILITY; SEMANTICS;

CURSE OF DIMENSIONALITY; INDEPENDENT ANALYSIS; MODALITY INDEPENDENCE; MULTIMODAL FUSION; SUPER-KERNEL FUSION;

MULTIMEDIA SYSTEMS;

EID: 13444263342     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1027527.1027665     Document Type: Conference Paper

References (35)

1. S. Amari, A. Cichocki, and H. H. Yang. A new learning algorithm for blind signal separation. Advances in Neural Information Processing Systems, 8:757-763, 1996.
2. A. Amir, H. W, G. Iyengar, C.-Y.Lin, M. Naphade, A. Natsev, C. Neti, H. J. Nock, J. R. Smith, B. L. Tseng, Y. Wu, and D. Zhang. IBM research TRECVID-2003 system. NIST Text Retrieval Conf. (TREC), 2003.
3. F. R. Bach and M. I. Jordan. Kernel independent component analysis. Machine Learning Research, 3:1-48, 2002.
4. M. S. Bartlett, H. M. Lades, and T. J. Sejnowski. Independent component representation for face recognition. SPIE Conf. on Human Vision and Electronic Imaging III, 3299:528-539, 1998.
5. A. J. Bell and T. J. Sejnowski. An information-maximization approach to blind separation and blind deconvolution. Neural Computation, 7(6): 1129-1159, 1995.
6. R. Bellman. Adaptive control processes. Princeton, 1961.
7. K. Beyer, J. Goldstein, R. Ramakrishnan, and U. Shaft. When is "nearest neighbor" meaningful? International Conference on Database Theory, pages 217-235, 1999.
8. M. L. Cascia, S. Sethi, and S. Sclaroff. Combining textual and visual cues for content-based image retrieval on the world wide web. IEEE Workshop on Content-based Access of Image and Video Libaries, pages 24-28, 1998.
9. T. Dietterich and G. Bakiri. Solving multiclass learning problems via error-correcting output codes. Artifical Intelligence Research, 2:263-286, 1995.
10. C. H. Q. Ding, X. He, H. Zha, M. Gu, and H. D. Simon. A min-max cut algorithm for graph partitioning and data clustering. IEEE International Conference on Data Mining, pages 107-114, 2001.
11. D. L. Donoho. High-dimensional data analysis: The curses and blessings of dimensionality. American Math, Society Lecture - Match Challenges of the 21st Century, 2000.
12. R. Fagin, A. Lotem, and M. Naor. Optimal aggregation algorithms for middleware. ACM Symposium on Principles of Database Systems, 2001.
13. M. Flickner, H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovic, D. Steele, and P. Yanker. Query by image and video content: the QBIC system. Intelligent multimedia information retrieval, pages 7-22, 1997.
14. K. Goh, E. Chang, and K.-T. Cheng. SVM binary classifier ensembles for multi-class image classification. ACM International Conference on Information and Knowledgement Management (CIKM), pages 395-402, 2001.
15. L. Hansen, J. Larsen, and T. Kolenda, On independent component analysis for multimedia signals. Multimedia Image and VideoProcessing, CRC Press, 2000.
16. J. Hershey and J. Movellan. Using audio-visual synchrony to locate sounds. Advances in Neural Information Processing Systems 12. MIT Press, Cambridge MA, 2001.
17. A. Hyvarinen and E. Oja. A fast fixed-point algorithm for independent component analysis. Neural Computation archive, 9(7): 1483-1492, 1997.
18. J. F. III, T. Darrell, W. Freeman, and P. Viola. Learning joint statistical models for audio-visual fusion and segregation. Advances in Neural Information Processing Systems 13. MIT Press, Cambridge MA, 2000.
19. I. Joliffe. Principal component analysis. Springer-Verlag, New York, 1986.
20. J. Kittler, M. Hatef, and R. P. W. Duin. Combining classifiers. Intl. Pattern Recognition, pages 897-901, 1996.
21. T. Kolenda, L. K. Hansen, I. Larsen, and O. Winther. Independent component analysis for understanding multimedia content. IEEE Workshop on Neural Networks for Signal Processing, pages 757-766, 2002.
22. B. Li and E. Chang. Discovery of a perceptual distance function for measuring image similarity. ACM Multimedia Journal Special Issue on Content-Based Image Retrieval, 8(6):512-522, 2003.
23. A. S. Lukic, M. N. Wernick, L. K. Hansen, and S. C. Strother. An ICA algorithm for analyzing multiple data sets. IEEE Int. Conf. on Image Processing, pages 821-824, 2002.
24. J. Platt. Probabilistic outputs for support vector machines and comparison to regularized likelihood methods. Advances in Large Margin Classifiers, MIT Press, pages 61-74, 2000.
25. Y. Rui, T. S. Huang, and S. F. Chang. Image retrieval: Past, present, and future. International Symposium on Multimedia Information Processing, 1997.
26. Y. Rui, T. S. Huang, and S. Mehrotra. Content-based image retrieval with relevance feedback in mars. IEEE International Conference on Image, 1997.
27. P. Smaragdis and M. Casey. Audio/visual independent components. International Symposium on Independent Component Analysis and Blind Source Separation, pages 709-714, 2003.
28. J. R. Smith and S. F. Chang. Automatic image retrieval using color and texture. IEEE Trans Pattern Anal Mach Intell, 1996.
29. D. M. J. Tax, M. V. Breukelen, R. P. W. Duin, and J. Kittler. Combing multiple classifiers by averaging or by multiplying. Pattern Recognition, 33:1475-1485, 2000.
30. K. M. Ting and I. H. Wirten. Issues in styacked generalization. Artificial Intelligence Research, 10:271-289, 1999.
31. A. Velivelli, C. W. Ngo, and T. S. Huang. Detection of documentarty scene changes by audio-visual fusion. International conference on Image and video retrieval, pages 227-237, 2003.
32. A. Vinokourov, D. R. Hardoon, and J. Shawe-Taylor. Learning the semantics of multimedia content with application to web image retrieval and classification. Fourth International Symposium on Independent Component Analysis and Blind Source Separation, 2003.
33. A. Vinokourov, J. Shawe-Taylor, and N. Cristianini. Inferring a semantic representation of text via cross-language correlation analysis. Advances of Neural Information Processing, 2002.
34. T. Westerveld. Image retrieval: Content versus context. Content-Based Multimedia Information Access, RIAO, 2000.
35. R. Yan and A. G. Hauptmann. The combination limit in multimedia retrieval. ACM Multimedia, 2003.