Ensemble CCA for continuous emotion prediction

AVEC 2014 - Proceedings of the 4th International Workshop on Audio/Visual Emotion Challenge, Workshop of MM 2014

Volumn , Issue , 2014, Pages 19-26

  Kaya, Heysem ^a   Çilli, Fazilet ^a   Salah, Albert Ali ^a  

^a BOGAZICI UNIVERSITY   (Turkey)

Author keywords

Audio visual emotion corpus; Canonical correlation analysis; Depression prediction; Emotion prediction; Ensemble learning

Indexed keywords

CORRELATION METHODS; MEAN SQUARE ERROR;

CANONICAL CORRELATION ANALYSIS; EMOTION CORPORA; EMOTION PREDICTIONS; ENSEMBLE LEARNING; LOCAL GABOR BINARY PATTERNS; LOCAL PHASE QUANTIZATIONS; MOORE-PENROSE GENERALIZED INVERSE; PEARSON'S CORRELATION COEFFICIENTS;

FORECASTING;

EID: 84910637811     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2661806.2661814     Document Type: Conference Paper

References (40)

1. T. R. Almaev and M. F. Valstar. Local gabor binary patterns from three orthogonal planes for automatic facial expression recognition. In Afiective Computing and Intelligent Interaction (ACII), 2013 Humaine Association Conference on, pages 356-361, 2013.
2. E. Alpaydin. Introduction to Machine Learning. The MIT Press, 2nd edition, 2010.
3. G. Andrew, R. Arora, J. Bilmes, and K. Livescu. Deep canonical correlation analysis. In Proc. of the 30th Intl. Conference on Machine Learning, pages 1247-1255, Atlanta, Georgia, USA, 2013.
4. M. S. Bartlett. Further aspects of the theory of multiple regression. In Proc. of the Cambridge Philosophical Society, volume 34, pages 33-40, 1938.
5. P. L. Bartlett. The sample complexity of pattern classification with neural networks: The size of the weights is more important than the size of the network. Information Theory, IEEE Transactions on, 44(2):525-536, 1998.
6. A. Beck, R. Steer, R. Ball, and W. Ranieri. Comparison of beck depression inventories -ia and -ii in psychiatric outpatients. Journal of Personality Assessment, 67(3):588-597, 1996.
7. E. Cambria, G.-B. Huang, L. L. C. Kasun, H. Zhou, C.-M. Vong, J. Lin, J. Yin, Z. Cai, Q. Liu, K. Li, et al. Extreme learning machines. IEEE Intelligent Systems, 28(6):30-59, 2013.
8. R. Cowie, N. Sussman, and A. Ben-Ze'ev. In Petta, P. and Pelechaud, C. and Cowie, R. (eds) Emotion-Oriented Systems: The Humaine Handbook, chapter Emotion: Concepts and Definitions, pages 9-32. Springer, 2011.
9. F. Eyben, F. Weninger, S. Squartini, and B. Schuller. Real-life voice activity detection with lstm recurrent neural networks and an application to hollywood movies. In Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on, pages 483-487, May 2013.
10. F. Eyben, M. Wöllmer, and B. Schuller. Opensmile: The munich versatile and fast open-source audio feature extractor. In Proc. of the intl. conf. on Multimedia, pages 1459-1462. ACM, 2010.
11. R. A. Fisher. The use of multiple measurements in taxonomic problems. Annals of Eugenics, 7(2):179-188, 1936.
12. D. R. Hardoon, S. Szedmak, and J. Shawe-Taylor. Canonical correlation analysis: An overview with application to learning methods. Neural Computation, 16(12):2639-2664, 2004.
13. H. Hotelling. Relations between two sets of variates. Biometrika, 28(3/4):321-377, 1936.
14. G.-B. Huang, D. H. Wang, and Y. Lan. Extreme learning machines: A survey. International Journal of Machine Learning and Cybernetics, 2(2):107-122, 2011.
15. G.-B. Huang, H. Zhou, X. Ding, and R. Zhang. Extreme learning machine for regression and multiclass classification. Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, 42(2):513-529, 2012.
16. G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew. Extreme learning machine: A new learning scheme of feedforward neural networks. In Neural Networks, 2004. Proceedings. 2004 IEEE International Joint Conference on, volume 2, pages 985-990. IEEE, 2004.
17. G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew. Extreme learning machine: Theory and applications. Neurocomputing, 70(1):489-501, 2006.
18. B. Jiang, M. F. Valstar, and M. Pantic. Action unit detection using sparse appearance descriptors in space-time video volumes. In Automatic Face & Gesture Recognition and Workshops (FG 2011), 2011 IEEE International Conference on, pages 314-321. IEEE, 2011.
19. H. Kaya, F. Eyben, A. A. Salah, and B. W. Schuller. CCA Based Feature Selection with Application to Continuous Depression Recognition from Acoustic Speech Features. In IEEE Intl. Conference on Acoustics, Speech, and Signal Processing (ICASSP 2014), pages 3757-3761, 2014.
20. H. Kaya and A. A. Salah. Eyes whisper depression: A cca based multimodal approach. In Proc. of the 22nd Intl. Conf. on Multimedia, ACM MM '14, Orlando, Florida, USA, 2014. ACM.
21. H. Kaya, T. Özkaptan, A. A. Salah, and S. F. Gürgen. Canonical Correlation Analysis and Local Fisher Discriminant Analysis based Multi-View Acoustic Feature Reduction for Physical Load Prediction. In Proc. INTERSPEECH 2014, Singapore, Sep 2014. ISCA, ISCA.
22. M. Kim and V. Pavlovic. Central subspace dimensionality reduction using covariance operators. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 33(4):657-670, 2011.
23. M. A. Nicolaou, S. Zafeiriou, and M. Pantic. Correlated-spaces regression for learning continuous emotion dimensions. In Proceedings of the 21st ACM international conference on Multimedia, pages 773-776. ACM, 2013.
24. T. Ojala, M. Pietikainen, and T. Maenpaa. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 24(7):971-987, 2002.
25. C. R. Rao and S. K. Mitra. Generalized inverse of matrices and its applications, volume 7. Wiley New York, 1971.
26. C. O. Sakar. Multi-View Feature Extraction based on Canonical Correlation Analysis. PhD thesis, Institute for Graduate Studies in Science and Engineering, Bogazici University, Jan 2014.
27. C. O. Sakar, O. Kursun, and F. Gürgen. A feature selection method based on kernel canonical correlation analysis and the minimum redundancy maximum relevance filter method. Expert Systems with Applications, 39(3):3432-3437, 2012.
28. C. O. Sakar, O. Kursun, and S. F. Gurgen. Ensemble canonical correlation analysis. Applied intelligence, 40(2):291-304, 2014.
29. E. Sanchez-Lozano, P. Lopez-Otero, L. Docio-Fernandez, E. Argones-Rua, and J. L. Alba-Castro. Audiovisual three-level fusion for continuous estimation of russell's emotion circumplex. pages 31-40. ACM, 2013.
30. B. Schuller, S. Steidl, and A. Batliner. The Interspeech 2009 Emotion Challenge. In Proc. INTERSPEECH 2009, 10th Annual Conference of the Intl. Speech Communication Association, pages 312-315, Brighton, UK, September 2009. ISCA, ISCA.
31. B. Schuller, S. Steidl, A. Batliner, J. Epps, F. Eyben, F. Ringeval, E. Marchi, and Y. Zhang. The INTERSPEECH 2014 Computational Paralinguistics Challenge: Cognitive & Physical Load. In Proc. INTERSPEECH 2014, Singapore, Singapore, September 2014. ISCA, ISCA.
32. B. Schuller, S. Steidl, A. Batliner, E. Nöth, A. Vinciarelli, F. Burkhardt, R. van Son, F. Weninger, F. Eyben, T. Bocklet, G. Mohammadi, and B. Weiss. The INTERSPEECH 2012 Speaker Trait Challenge. In Proc. INTERSPEECH 2012, Portland, OR, USA, September 2012. ISCA.
33. B. Schuller, S. Steidl, A. Batliner, A. Vinciarelli, K. Scherer, F. Ringeval, M. Chetouani, F. Weninger, F. Eyben, E. Marchi, M. Mortillaro, H. Salamin, A. Polychroniou, F. Valente, and S. Kim. The INTERSPEECH 2013 Computational Paralinguistics Challenge: Social Signals, Conict, Emotion, Autism. In Proc. INTERSPEECH 2013, pages 148-152, Lyon, France, August 2013. ISCA, ISCA.
34. B. Schuller, M. Valstar, F. Eyben, R. Cowie, and M. Pantic. AVEC 2012 - The Continuous Audio/Visual Emotion Challenge. In L.-P. Morency, D. Bohus, H. K. Aghajan, J. Cassell, A. Nijholt, and J. Epps, editors, Proc. of the 14th ACM Intl. Conference on Multimodal Interaction, ICMI, pages 449-456, Santa Monica, CA, October 2012. ACM.
35. C. Shan, S. Gong, and P. W. McOwan. Beyond facial expressions: Learning human emotion from body gestures. In BMVC, pages 1-10, 2007.
36. C. Shan, S. Gong, and P. W. McOwan. Capturing correlations among facial parts for facial expression analysis. In BMVC, pages 1-10, 2007.
37. J. A. Suykens and J. Vandewalle. Least squares support vector machine classifiers. Neural processing letters, 9(3):293-300, 1999.
38. M. Valstar, B. Schuller, K. Smith, T. Almaev, F. Eyben, J. Krajewski, R. Cowie, and M. Pantic. AVEC 2014-3D Dimensional Affect and Depression Recognition Challenge. In Proc. of the 4rd ACM Intl. Workshop on Audio/Visual Emotion Challenge, AVEC '14, 2014.
39. M. Valstar, B. Schuller, K. Smith, F. Eyben, B. Jiang, S. Bilakhia, S. Schnieder, R. Cowie, and M. Pantic. AVEC 2013-The Continuous Audio/Visual Emotion and Depression Recognition Challenge. In Proc. of the 3rd ACM Intl. Workshop on Audio/Visual Emotion Challenge, AVEC '13, pages 3-10, 2013.
40. X. Xiong and F. De la Torre. Supervised Descent Method and Its Application to Face Alignment. In Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, CVPR '13, 2013.