Multimodal human behavior analysis: Learning correlation and interaction across modalities

ICMI'12 - Proceedings of the ACM International Conference on Multimodal Interaction

Volumn , Issue , 2012, Pages 27-30

  Song, Yale ^a   Morency, Louis Philippe ^b   Davis, Randall ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

Canonical correlation analysis; Kernel methods; Multi view latent variable discriminative models; Multimodal signal processing

Indexed keywords

AUDIO-VISUAL; CANONICAL CORRELATION ANALYSIS; DATA SETS; DISJOINT SETS; GRAPHICAL MODEL; HIDDEN CONDITIONAL RANDOM FIELDS; HIGH-DIMENSIONAL FEATURE SPACE; HUMAN BEHAVIORS; KERNEL CANONICAL CORRELATION ANALYSIS; KERNEL METHODS; LATENT VARIABLE; LEARNING CORRELATION; LEARNING INTERACTIONS; MULTI-MODAL; MULTI-MODAL DATA; MULTI-MODAL SIGNAL PROCESSING; MULTI-VIEWS; NON-LINEAR CORRELATIONS; NONLINEAR KERNELS; PROBLEM-BASED;

DATA PROCESSING; EQUIVALENCE CLASSES; INTERACTIVE COMPUTER SYSTEMS; SIGNAL PROCESSING; SPEECH RECOGNITION;

SOCIAL SCIENCES;

EID: 84870230742     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2388676.2388684     Document Type: Conference Paper

References (13)

1. K. Bousmalis, L.-P. Morency, and M. Pantic. Modeling hidden dynamics of multimodal cues for spontaneous agreement and disagreement recognition. In FG, 2011.
2. R. G. Cowell, A. P. Dawid, S. L. Lauritzen, and D. J. Spiegelhalter. Probabilistic Networks and Expert Systems. Springer-Verlag, 1999.
3. D. R. Hardoon, S. Szedmák, and J. Shawe-Taylor. Canonical correlation analysis: An overview with application to learning methods. Neural Comp., 16(12):2639-2664, 2004.
4. J. D. Lafferty, A. McCallum, and F. C. N. Pereira. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In ICML, 2001.
5. J. Nocedal and S. J. Wright. Numerical Optimization. Springer-Verlag, 1999.
6. G. Potamianos, C. Neti, J. Luettin, and I. Matthews. Audio-Visual Automatic Speech Recognition: An Overview. MIT Press, 2004.
7. A. Quattoni, S. B. Wang, L.-P. Morency, M. Collins, and T. Darrell. Hidden conditional random fields. TPAMI, 29(10):1848-1852, 2007.
8. L. R. Rabiner. A tutorial on hidden Markov models and selected applications in speech recognition, pages 267-296. Morgan Kaufmann Publishers Inc., 1990.
9. B. Scholkopf and A. J. Smola. Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press, Cambridge, MA, USA, 2001.
10. Y. Song, L.-P.Morency, and R. Davis. Multi-view latent variable discriminative models for action recognition. In CVPR, 2012.
11. A. Vinciarelli, A. Dielmann, S. Favre, and H. Salamin. Canal9: A database of political debates for analysis of social interactions. In ACII, 2009.
12. Z. Zeng, M. Pantic, G. I. Roisman, and T. S. Huang. A survey of affect recognition methods: Audio, visual, and spontaneous expressions. TPAMI, 31(1):39-58, 2009.
13. H. Zhang, Y. Zhuang, and F. Wu. Cross-modal correlation learning for clustering on image-audio dataset. In MM, pages 273-276, 2007.