Robust canonical correlation analysis: Audio-visual fusion for learning continuous interest

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2014, Pages 1522-1526

  Nicolaou, Mihalis A ^a   Panagakis, Yannis ^a   Zafeiriou, Stefanos ^a   Pantic, Maja ^a,b  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

Audio visual Fusion; Emotion Recognition; Interest Detection; Multi modal Fusion

Indexed keywords

ERRORS; SIGNAL PROCESSING; SPEECH RECOGNITION;

AUDIO-VISUAL FUSION; CANONICAL CORRELATION ANALYSIS; EMOTION RECOGNITION; FEATURE-LEVEL FUSIONS; FUSION TECHNIQUES; INTEREST DETECTION; MULTI-MODAL FUSION; REAL-WORLD PROBLEM;

FACE RECOGNITION;

EID: 84905284246     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2014.6853852     Document Type: Conference Paper

References (35)

1. Alex Pentland and Anmol Madan, "Perception of social interest," in Proc. IEEE Int. Conf. on Computer Vision, Workshop on Modeling People and Human Interaction (ICCV-PHI), 2005.
2. Björn Schuller, Ronald Müller, Florian Eyben, Jürgen Gast, Benedikt Hörnler, Martin Wöllmer, Gerhard Rigoll, Anja Höthker, and Hitoshi Konosu, "Being bored? recognising natural interest by extensive audiovisual integration for real-life application," Image and Vision Computing, vol. 27, no. 12, pp. 1760-1774, 2009.
3. Björn Schuller and Gerhard Rigoll, "Recognising interest in conversational speech-comparing bag of frames and supra-segmental features.," in INTERSPEECH, 2009, pp. 1999-2002.
4. Felix Arnold, Attention and interest: A study in psychology and education, Macmillan, 1910.
5. Silvan S Tomkins, "Affect, imagery, consciousness: Vol. i. The positive affects.," 1962.
6. Paul J Silvia, Exploring the psychology of interest, Oxford University Press, 2006.
7. Björn Schuller, Niels Köhler, Ronald Müller, and Gerhard Rigoll, "Recognition of interest in human conversational speech.," in INTERSPEECH, 2006.
8. Martin Wöllmer, Florian Eyben, Stephan Reiter, Björn Schuller, Cate Cox, Ellen Douglas-Cowie, and Roddy Cowie, "Abandoning emotion classes-towards continuous emotion recognition with modelling of long-range dependencies.," in INTERSPEECH, 2008, pp. 597-600.
9. Mihalis A Nicolaou, Hatice Gunes, and Maja Pantic, "Outputassociative rvm regression for dimensional and continuous emotion prediction," Image and Vision Computing, vol. 30, no. 3, pp. 186-196, 2012.
10. Angeliki Metallinou and Shrikanth S. Narayanan, "Annotation and processing of continuous emotional attributes: Challenges and opportunities," in 2nd International Workshop on Emotion Representation, Analysis and Synthesis in Continuous Time and Space (EmoSPACE 2013), Apr. 2013.
11. Angeliki Metallinou, Martin Wollmer, Athanasios Katsamanis, Florian Eyben, Björn Schuller, and Shrikanth Narayanan, "Context-sensitive learning for enhanced audiovisual emotion classification," Affective Computing, IEEE Transactions on, vol. 3, no. 2, pp. 184-198, 2012.
12. Hatice Gunes, Björn Schuller, Maja Pantic, and Roddy Cowie, "Emotion representation, analysis and synthesis in continuous space: A survey," in Automatic Face & Gesture Recognition and Workshops (FG 2011), 2011 IEEE International Conference on. IEEE, 2011, pp. 827-834.
13. Geovany A Ramirez, Tadas Baltrúsaitis, and Louis-Philippe Morency, "Modeling latent discriminative dynamic of multi-dimensional affective signals," in Affective Computing and Intelligent Interaction, pp. 396-406. Springer, 2011.
14. James A Russell, Maria Lewicka, and Toomas Niit, "A cross-cultural study of a circumplex model of affect.," Journal of personality and social psychology, vol. 57, no. 5, pp. 848, 1989.
15. Mihalis A Nicolaou, Hatice Gunes, and Maja Pantic, "Continuous prediction of spontaneous affect from multiple cues and modalities in valence-arousal space," Affective Computing, IEEE Transactions on, vol. 2, no. 2, pp. 92-105, 2011.
16. Hatice Gunes and Björn Schuller, "Categorical and dimensional affect analysis in continuous input: Current trends and future directions," Image and Vision Computing, 2012.
17. Peter J Lang, Mark K Greenwald, Margaret M Bradley, and Alfons O Hamm, "Looking at pictures: Affective, facial, visceral, and behavioral reactions," Psychophysiology, vol. 30, no. 3, pp. 261-273, 1993.
18. Tadas Baltrúsaitis, Ntombikayise Banda, and Peter Robinson, "Dimensional affect recognition using continuous conditional random fields," in IEEE FG, 2013.
19. Mihalis A. Nicolaou, Stefanos Zafeiriou, and Maja Pantic, "Correlatedspaces regression for learning continuous emotion dimensions," in Proceedings of the 21st ACM international conference on Multimedia. ACM, 2013, pp. 773-776.
20. Caifeng Shan, Shaogang Gong, and Peter W McOwan, "Beyond facial expressions: Learning human emotion from body gestures.," in BMVC, 2007, pp. 1-10.
21. Nicolle M Correa, Yi-Ou Li, Tülay Adali, and Vince D Calhoun, "Fusion of fmri, smri, and eeg data using canonical correlation analysis," in Acoustics, Speech and Signal Processing, 2009. ICASSP 2009. IEEE International Conference on. IEEE, 2009, pp. 385-388.
22. Gary McKeown et al., "The semaine database: Annotated multimodal records of emotionally colored conversations between a person and a limited agent," IEEE TAC, 2012.
23. Mihalis A. Nicolaou, Vladimir Pavlovic, and Maja Pantic, "Dynamic Probabilistic CCA for Analysis of Affective Behaviour," in Proceedings of the 12th European Conference on Computer Vision, ECCV 2012., Florence, Italy, October 2012, pp. 98-111.
24. Soroosh Mariooryad and Carlos Busso, "Analysis and compensation of the reaction lag of evaluators in continuous emotional annotations," in Affective Computing and Intelligent Interaction (ACII), 2013 Humaine Association Conference on. IEEE, 2013, pp. 85-90.
25. J. Orozco et al., "Hierarchical on-line appearance-based tracking for 3d head pose, eyebrows, lips, eyelids and irises," Image and Vision Computing, February 2013.
26. Zhihong Zeng, M. Pantic, G.I. Roisman, and T.S. Huang, "A survey of affect recognition methods: Audio, visual, and spontaneous expressions," IEEE TPAMI, 2009.
27. M. E. Tipping, "Sparse bayesian learning and the relevance vector machine," JMLR, vol. 1, pp. 211-244, 2001.
28. L. Vandenberghe and S. Boyd, "Semidefinite programming," SIAM Review, vol. 38, no. 1, pp. 49-95, 1996.
29. B. K. Natarajan, "Sparse approximate solutions to linear systems," SIAM J. Comput., vol. 24, no. 2, pp. 227-234, 1995.
30. D. Donoho, "For most large underdetermined systems of equations, the minimal l1-norm near-solution approximates the sparsest nearsolution," Communications on Pure and Applied Mathematics, vol. 59, no. 7, pp. 907-934, 2006.
31. M. Fazel, Matrix Rank Minimization with Applications, Ph.D. thesis, Dept. Electrical Engineering, Stanford University, CA, USA, 2002.
32. Z. Lin, R. Liu, and Z. Su, "Linearized alternating direction method with adaptive penalty for low-rank representation," in Proc. 2011 Neural Information Processing Systems Conf., Granada, Spain, 2011, pp. 612-620.
33. D. P. Bertsekas, Constrained Optimization and Lagrange Multiplier Methods, Athena Scientific, Belmont, MA, 2nd edition, 1996.
34. J. F. Cai, E. J. Candes, and Z. Shen, "A singular value thresholding algorithm for matrix completion," SIAM Journal Optimization, vol. 2, no. 2, pp. 569-592, 2009.
35. E. J. Candes, X. Li, Y. Ma, and J. Wright, "Robust principal component analysis," Journal of ACM, vol. 58, no. 3, pp. 1-37, 2011.