Speaker trait characterization in web videos: Uniting speech, language, and facial features

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2013, Pages 3647-3651

  Weninger, Felix ^a   Wagner, Claudia ^b   Wollmer, Martin ^a,c   Schuller, Bjorn ^a,b   Morency, Louis Philippe ^d  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b Institute of Information Systems and Information Management   (Austria)

^c BMW GROUP   (Germany)

^d University of Southern California ^*  (United States)

Author keywords

computational paralinguistics; multi modal fusion; speaker classification

Indexed keywords

AUTOMATIC FEATURE EXTRACTION; AUTOMATIC SPEECH RECOGNITION; LINGUISTIC FEATURES; MULTI-MODAL APPROACH; MULTI-MODAL FUSION; PARALINGUISTICS; RACE CLASSIFICATION; SPEAKER CLASSIFICATION;

EYE PROTECTION; FACE RECOGNITION; LINGUISTICS; SIGNAL PROCESSING; SPEECH RECOGNITION; VIDEO STREAMING;

CLASSIFICATION (OF INFORMATION);

EID: 84890532851     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2013.6638338     Document Type: Conference Paper

References (26)

1. F. Metze, J. Ajmera, R. Englert, U. Bub, F. Burkhardt, J. Stegmann, C. Muller, R. Huber, B. Andrassy, J. G. Bauer, and B. Littel, "Comparison of four approaches to age and gender recognition for telephone applications," in Proc. of ICASSP, Honolulu, Hawaii, 2007, pp. 1089-1092.
2. I. Mporas and T. Ganchev, "Estimation of unknown speakers height from speech," International Journal of Speech Technology, vol. 12, no. 4, pp. 149-160, 2009.
3. B. Schuller, M. Wollmer, F. Eyben, G. Rigoll, and D. Arsic, "Semantic Speech Tagging: Towards Combined Analysis of Speaker Traits," in Proceedings AES 42nd International Conference, K. Brandenburg and M. Sandler, Eds., Ilmenau, Germany, 2011, pp. 89-97, Audio Engineering Society.
4. B. Schuller, "The Computational Paralinguistics Challenge," IEEE Signal Processing Magazine, vol. 29, no. 4, pp. 97-101, July 2012.
5. F. Weninger, J. Krajewski, A. Batliner, and B. Schuller, "The Voice of Leadership: Models and Performances of Automatic Analysis in On-Line Speeches," IEEE Transactions on Affective Computing, 2012, http://doi.ieeecomputersociety.org/10.1109/T-AFFC.2012.15.
6. M. H. Bahari, M. McLaren, H. Van hamme, and D. Van Leeuwen, "Age Estimation from Telephone Speech using ivectors," in Proc. of INTERSPEECH, Portland, OR, USA, 2012, no pagination.
7. B. Schuller, S. Steidl, A. Batliner, F. Burkhardt, L. Devillers, C. Muller, and S. Narayanan, "Paralinguistics in Speech and Language-State-of-The-Art and the Challenge," Computer Speech and Language, Special Issue on Paralinguistics in Naturalistic Speech and Language, vol. 27, no. 1, pp. 4-39, January 2013.
8. J. Bekios-Calfa, J. M. Buenaposada, and L. Baumela, "Revisiting Linear Discriminant Techniques in Gender Recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 4, pp. 858-864, 2011.
9. A. Hadid and M. Pietikainen, "Combining motion and appearance for gender classification from video sequences," in Proc. 19th International Conference on Pattern Recognition (ICPR 2008), Tampa, FL, USA, 2008, IEEE, no pagination.
10. M. Demirkus, K. Garg, and S. Guler, "Automated person categorization for video surveillance using soft biometrics," in Biometric Technology for Human Identification VII, SPIE. 2010.
11. M. Demirkus, D. Precup, J. Clark, and T. Arbel, "Soft Biometric Trait Classification from Real-world Face Videos Conditioned on Head Pose Estimation," in Proc. IEEE Computer Society Workshop on Biometrics in association with IEEE CVPR, 2012, pp. 130-137.
12. A. Hadid, "Analyzing facial behavioral features from videos," in Human Behavior Understanding, A. A. Salah and B. Lepri, Eds., vol. 7065 of Lecture Notes in Computer Science, pp. 52-61. Springer Berlin Heidelberg, 2011.
13. S. Nowson and J. Oberlander, "The identity of bloggers: Openness and gender in personal weblogs," in In Proceedings of the AAAI Spring Symposia on Computational Approaches to Analyzing Weblogs, 2006.
14. C. M. Bell, P. M. McCarthy, and D. S. McNamara, "Using LIWC and Coh-Metrix to Investigate Gender Differences in Linguistic Styles," in Applied Natural Language Processing: Identification, Investigation and Resolution, P. McCarthy and C. Boonthum-Denecke, Eds., pp. 545-556. IGI Global, 2012, doi:10.4018/978-1-60960-741-8.ch032.
15. D. Gillick, "Can conversational word usage be used to predict speaker demographics?," in Proc. of Interspeech, Makuhari, Japan, 2010, pp. 1381-1384.
16. M. Liu, X. Xu, and T. S. Huang, "Audio-visual gender recognition," in MIPPR 2007: Pattern Recognition and Computer Vision, vol. 6788 of SPIE, pp. 678803-678803-5. 2007.
17. M. Pronobis and M. Magimai-Doss, "Integrating audio and vision for robust automatic gender recognition.," Tech. Rep. Idiap-RR-73-2008, Idiap, November 2008.
18. M. Wollmer, F. Weninger, T. Knaup, B. Schuller, C. Sun, K. Sagae, and L.-P. Morency, "YouTube Movie Reviews: In, Cross, and Open-Domain Sentiment Analysis in an Audiovisual Context," IEEE Intelligent Systems Magazine, Special Issue on Concept-Level Opinion and Sentiment Analysis, 2013, to appear.
19. S. J. Young, G. Evermann, M. J. F. Gales, D. Kershaw, G. Moore, J. J. Odell, D. G. Ollason, D. Povey, V. Valtchev, and P. C. Woodland, The HTK book version 3.4, Cambridge University Engineering Department, Cambridge, UK, 2006.
20. F. Eyben, M. Wollmer, and B. Schuller, "openSMILE\-The Munich versatile and fast open-source audio feature extractor," in Proc. of ACM Multimedia, Florence, Italy, October 2010, pp. 1459-1462, ACM.
21. J.W. Pennebaker, M. R. Mehl, and K. G. Niederhoffer, "Psychological aspects of natural language use: Our words, our selves," Annual Review of Psychology, vol. 54, no. 1, pp. 547-577, 2003.
22. Y. R. Tausczik and J. W. Pennebaker, "The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods," Journal of Language and Social Psychology, vol. 29, no. 1, pp. 24-54, 2010.
23. M. F. Porter, "An algorithm for suffix stripping," Program, vol. 3, no. 14, pp. 130-137, October 1980.
24. M. Wollmer, M. Kaiser, F. Eyben, B. Schuller, and G. Rigoll, "LSTM-modeling of continuous emotions in an audiovisual affect recognition framework," Image and Vision Computing, 2012.
25. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten, "The WEKA data mining software: an update," ACM SIGKDD Explorations Newsletter, vol. 11, no. 1, pp. 10-18, 2009.
26. S. A. Xue and J. G. Hao, "Normative standards for vocal tract dimensions by race as measured by acoustic pharyngometry," Journal of Voice, vol. 20, no. 3, pp. 391-400, 2006.