Output-associative RVM regression for dimensional and continuous emotion prediction

Image and Vision Computing

Volumn 30, Issue 3, 2012, Pages 186-196

  Nicolaou, Mihalis A ^a   Gunes, Hatice ^b   Pantic, Maja ^a,c  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

^c UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

Audio cues; Dimensional and continuous emotion prediction; Facial expressions; Output associative RVM regression; Shoulder movements

Indexed keywords

COMPUTER VISION; FORECASTING; LEARNING ALGORITHMS; MATHEMATICAL MODELS; RATING;

AUDIO CUES; CONVERSATIONAL INTERACTION; CORRELATION COEFFICIENT; FACIAL EXPRESSIONS; INPUT AND OUTPUTS; INPUT FEATURES; INPUT PATTERNS; INPUT-OUTPUT; INTRINSIC MOTIVATION; OUTPUT VECTORS; OUTPUT-ASSOCIATIVE RVM REGRESSION; PREDICTION MODEL; PROBABILISTIC FRAMEWORK; PROOF OF CONCEPT; RELEVANCE VECTOR MACHINE; ROOT MEAN SQUARED ERRORS; SHOULDER MOVEMENTS; TEMPORAL WINDOWS; TRAINING DATA;

REGRESSION ANALYSIS;

EID: 84859852803     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2011.12.005     Document Type: Conference Paper

References (48)

1. H. Gunes, and M. Pantic Automatic, dimensional and continuous emotion recognition Int. J. Synth. Emotions 1 1 2010 68 99
2. Z. Zeng, M. Pantic, G.I. Roisman, and T.S. Huang A survey of affect recognition methods: audio, visual, and spontaneous expressions IEEE Trans. Pattern Anal. Mach. Intell. 31 1 2009 39 58
3. J.A. Russell A circumplex model of affect J. Personal. Soc. Psychol. 39 1980 1161 1178
4. R. Lane, and L. Nadel Cognitive Neuroscience of Emotion 2000 Oxford Univ. Press
5. A. Mehrabian, and J. Russell An Approach to Environmental Psychology, Cambridge, New York 1974
6. A.M. Oliveira, M.P. Teixeira, I.B. Fonseca, and M. Oliveira Joint model-parameter validation of self-estimates of valence and arousal: probing a differential-weighting model of affective intensity Proc. of Annual Meeting of the Int. Society for Psychophysics 2006 245 250
7. N. Alvarado Arousal and valence in the direct scaling of emotional response to film clips Motiv. Emot. 21 1997 323 348
8. P.A. Lewis Neural correlates of processing valence and arousal in affective words Cereb. Cortex 17 3 2007 742 748 http://dx.doi.org/10.1093/ cercor/bhk024 10.1093/cercor/bhk024
9. J.P. Weston, O. Chapelle, A. Elisseeff, B. Scholkopf, and V. Vapnik Kernel Dependency Estimation, Tech. Rep. 98, Germany August 2002
10. C. Cortes, M. Mohri, and J. Weston A general regression technique for learning transductions Proc. of Int. Conf. on Machine Learning, ACM, New York, NY, USA 2005 153 160
11. L. Bo, and C. Sminchisescu Structured output-associative regression Proc. of IEEE Conf. on Computer Vision and Pattern Recognition 2009 2403 2410
12. L. Bo, and C. Sminchisescu Twin Gaussian processes for structured prediction Int. J. Comput. Vision 87 2010 28 52
13. K. Mitra, A. Veeraraghavan, and R. Chellappa Robust RVM regression using sparse outlier model Proc. of IEEE Conf. on Computer Vision and Pattern Recognition 2010 1887 1894
14. A. Thayananthan, R. Navaratnam, B. Stenger, P.H.S. Torr, and R. Cipolla Multivariate relevance vector machines for tracking Proc. of European Conference on Computer Vision 2006 124 138
15. H. Gunes, B. Schuller, M. Pantic, and R. Cowie Emotion representation, analysis and synthesis in continuous space: a survey Proc. of IEEE Int. Conf. on Automatic Face and Gesture Recognition 2011 827 834
16. M.A. Nicolaou, H. Gunes, and M. Pantic Audio-visual classification and fusion of spontaneous affective data in likelihood space Proc. of Int. Conf. on Pattern Recognition 2010 3695 3699
17. D. McDuff, R. El Kaliouby, K. Kassam, and R. Picard Affect valence inference from facial action unit spectrograms Proc. IEEE Conf. on Computer Vision and Pattern Recognition Workshops 2010 17 24
18. D. Glowinski, A. Camurri, G. Volpe, N. Dael, and K. Scherer Technique for automatic emotion recognition by body gesture analysis Proc. IEEE Conf. on Computer Vision and Pattern Recognition Workshops 2008 1 6
19. S. Ioannou, A. Raouzaiou, V. Tzouvaras, T. Mailis, K. Karpouzis, and S. Kollias Emotion recognition through facial expression analysis based on a neurofuzzy method J. Neural Networks 18 2005 423 435
20. H. Gunes, and M. Pantic Dimensional emotion prediction from spontaneous head gestures for interaction with sensitive artificial listeners Proc. Int. Conf. on Intelligent Virtual Agents 2010 371 377
21. M.A. Nicolaou, H. Gunes, and M. Pantic Output-associative RVM regression for dimensional and continuous emotion prediction Proc. of IEEE Int. Conf. on Automatic Face and Gesture Recognition 2011 16 23
22. B. Schuller, B. Vlasenko, F. Eyben, G. Rigoll, and A. Wendemuth Acoustic emotion recognition: a benchmark comparison of performances Proc. of IEEE Workshop on Automatic Speech Recognition and Understanding 2009 552 557
23. M. Wöllmer, B. Schuller, F. Eyben, and G. Rigoll Combining long short-term memory and dynamic bayesian networks for incremental emotion-sensitive artificial listening IEEE J. Sel. Top. Sign. Proces. 4 5 2010 867 881
24. M. Wollmer, F. Eyben, S. Reiter, B. Schuller, C. Cox, E. Douglas-Cowie, and R. Cowie Abandoning emotion classes - towards continuous emotion recognition with modelling of long-range dependencies Proc. of INTERSPEECH Conference 2008 597 600
25. M. Grimm, and K. Kroschel Emotion estimation in speech using a 3d emotion space concept Proc. IEEE Automatic Speech Recognition and Understanding Workshop 2005 381 385
26. M. Grimm, K. Kroschel, and S. Narayanan The Vera am Mittag German audio-visual emotional speech database Proc. of IEEE Int. Conf. on Multimedia & Expo 2008 865 868
27. H. Espinosa, C. Garcia, and L. Pineda Features selection for primitives estimation on emotional speech Proc. IEEE Int. Conf. on Acoustics Speech and Signal Processing 2010 5138 5141
28. G. Caridakis, L. Malatesta, L. Kessous, N. Amir, A. Raouzaiou, and K. Karpouzis Modeling naturalistic affective states via facial and vocal expressions recognition Proc. of ACM Int. Conf. on Multimodal Interaction 2006 146 154
29. I. Kanluan, M. Grimm, K. Kroschel, Audio-visual emotion recognition using an emotion recognition space concept, Proc. of European Signal Processing Conference, 2008.
30. M. Wöllmer, A. Metallinou, F.E. Schuller, and S. Narayanan Context-sensitive multimodal emotion recognition from speech and facial expression using bidirectional lstm modeling Proc. of INTERSPEECH Conference 2010 2362 2365
31. F. Eyben, M. Wollmer, M.F. Valstar, H. Gunes, B. Schuller, and M. Pantic String-based audiovisual fusion of behavioural events for the assessment of dimensional affect Proc. of IEEE Int. Conf. on Automatic Face and Gesture Recognition 2011 322 329
32. A. Metallinou, A. Katsamanis, Y. Wang, and S. Narayanan Tracking changes in continuous emotion states using body language and prosodic cues Proc. of IEEE Int. Conf. on Acoustics Speech and Signal Processing 2011 2288 2291
33. S. Gilroy, M. Cavazza, M. Niiranen, E. Andre, T. Vogt, J. Urbain, M. Benayoun, H. Seichter, and M. Billinghurst Pad-based multimodal affective fusion Proc. of Int. Conf. on Affective Computing and Intelligent Interaction Workshops 2009 1 8
34. M.A. Nicolaou, H. Gunes, and M. Pantic Continuous prediction of spontaneous affect from multiple cues and modalities in valence-arousal space IEEE Trans. Affect. Comput. 2 2 2011 92 105
35. H. Gunes, M.A. Nicolaou, and M. Pantic Computer analysis of human behavior Ch. Continuous Analysis of Affect from Voice and Face 2011 Springer-Verlag 255 291
36. M.E. Tipping Sparse Bayesian learning and the relevance vector machine J. Mach. Learn. Res. 1 2001 211 244
37. M.E. Tipping, and A. Faul Fast marginal likelihood maximisation for sparse Bayesian models Proc. of Int. Workshop on Artificial Intelligence and Statistics 2003 3 6
38. D.H. Wolpert Stacked generalization Neural Networks 5 1992 241 259
39. L. Breiman Stacked regressions Mach. Learn. 24 1996 49 64 http://dx.doi.org/10.1007/BF00117832 10.1007/BF00117832 URL
40. E. Douglas-Cowie, R. Cowie, I. Sneddon, C. Cox, O. Lowry, M. McRorie, J.-C. Martin, L. Devillers, S. Abrilian, A. Batliner, N. Amir, and K. Karpouzis The humane database: addressing the needs of the affective computing community Proc. of Int. Conf. on Affective Computing and Intelligent Interaction 2007 488 500
41. M.A. Nicolaou, H. Gunes, and M. Pantic Automatic segmentation of spontaneous data using dimensional labels from multiple coders Proc. of LREC Int. Workshop on Multimodal Corpora: Advances in Capturing, Coding and Analyzing Multimodality 2010 43 48
42. I. Patras, and M. Pantic Particle filtering with factorized likelihoods for tracking facial features Proc. of IEEE Int. Conf. on Automatic Face and Gesture Recognition 2004 97 102
43. M.K. Pitt, and N. Shephard Filtering via simulation: auxiliary particle filters J. Am. Stat. Assoc. 94 446 1999 590 616
44. D. Jurafsky, and J.H. Martin Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics and Speech Recognition 2nd Edition 2008 Prentice Hall
45. B. Paul Accurate short-term analysis of the fundamental frequency and the harmonics-to-noise ratio of a sampled sound Proc. of the Institute of Phonetic Sciences 1993 97 110
46. S. Petridis, H. Gunes, S. Kaltwang, and M. Pantic Static vs. dynamic modeling of human nonverbal behavior from multiple cues and modalities Proc. of ACM Int. Conf. on Multimodal Interfaces 2009 23 30
47. K.P. Truong, D.A. Leeuwen van, M.A. Neerincx, and F.M. Jong de Arousal and valence prediction in spontaneous emotional speech: felt versus perceived emotion Proc. of INTERSPEECH Conference 2009 2027 2030
48. A.M. Kring, and A.H. Gordon Sex differences in emotion: expression, experience, and physiology J. Personal. Soc. Psychol. 74 3 1998 686 703