Audiovisual laughter detection based on temporal features

ICMI'08: Proceedings of the 10th International Conference on Multimodal Interfaces

Volumn , Issue , 2008, Pages 37-44

  Petridis, Stavros ^a   Pantic, Maja ^a,b  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

Audiovisual data processing; Laughter detection; Non linguistic information processing

Indexed keywords

ADABOOST; AUDIO AND VIDEOS; AUDIO VISUALS; AUDIO-BASED; AUDIOVISUAL DATA PROCESSING; LAUGHTER DETECTION; NON-LINGUISTIC INFORMATION PROCESSING; PERSON INDEPENDENTS; SINGLE MODALS; STATIC FEATURES; STATIC INFORMATIONS; STATISTICAL MEASURES; TEMPORAL EVOLUTIONS; TEMPORAL FEATURES; TEMPORAL INFORMATIONS; TEMPORAL WINDOWS;

INTERACTIVE COMPUTER SYSTEMS; LINGUISTICS; WINDOWS;

DATA PROCESSING;

EID: 63449114517     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1452392.1452402     Document Type: Conference Paper

References (28)

1. R. Cai, L. Lu, H.-J. Zhang, and L.-H. Cai. Highlight sound effects detection in audio stream. In ICME, volume 3, pages 37-40, 2003.
2. N. Campbell, H. Kashioka, and R. Ohara. No laughing matter. In European Conf. on Speech Comm. And Technology, pages 465-468, 2005.
3. J. F. Cohn and K. L. Schmidt. The timing of facial motion in posed and spontaneous smiles. Intern. Journal of Wavelets Multire solution and Information Processing, 2:121-132, 2005.
4. T. F. Cootes, C. J. Taylor, D. H. Cooper, and J. Graham. Active shape models - their training and application. Computer Vision and Image Understanding, 61(1):38, 1995.
5. G. Furnas, T. Landauer, G. L., and S. Dumais. The vocabulary problem in human-system communication. Commun. of the ACM, 30(11):964{972, 1987.
6. D. Gonzalez-Jimenez and J. L. Alba-Castro. Toward pose-invariant 2-d face recognition through point distribution models and facial symmetry. IEEE Trans. Inform. Forensics and Security, 2(3):413{429, 2007.
7. H. Hermansky. Perceptual linear predictive (plp) analysis of speech. Journal of the Acoustical Society of America, 87(4):1738-1752, 1990.
8. A. Ito, W. Xinyue, M. Suzuki, and S. Makino. Smile and laughter recognition using speech processing and face recognition from conversation video. In Intern. Conf. on Cyberworlds, 2005, pages 8-15, 2005.
9. L. Kennedy and D. Ellis. Laughter detection in meetings. In NIST ICASSP 2004 Meeting Recognition Workshop, 2004.
10. K. Laskowski and S. Burger. Analysis of the occurrence of laughter in meetings. In 10th ISCA Intern. Conf. on Spoken Language Processing, INTERSPEECH, pages 1258{1261, 2007.
11. A. Lockerd and F. Mueller. Lafcam: Leveraging affective feedback camcorder. In CHI, Human factors in computing systems, pages 574-575, 2002.
12. I. McCowan, J. Carletta, W. Kraaij, S. Ashby, S. Bourban, M. Flynn, M. Guillemot, T. Hain, J. Kadlec, and V. Karaiskos. The ami meeting corpus. In Int'l. Conf. on Methods and Techniques in Behavioral Research, pages 137-140, 2005.
13. [13] M. Pantic, A. Pentland, A. Nijholt, and T. Huang. Human computing and machine understanding of human behavior: A survey. In ICMI, pages 239-248, 2006.
14. I. Patras and M. Pantic. Particle filtering with factorized likelihoods for tracking facial features. In Int'l Conf. on Automatic Face and Gesture Recognition, pages 97-104, 2004.
15. S. Petridis and M. Pantic. Audiovisual discrimination between laughter and speech. In ICASSP, pages 5117-5120, 2008.
16. S. Petridis and M. Pantic. Fusion of audio and visual cues for laughter detection. In ACM Intern. Conf. on Image and Video Retrieval, pages 329-337, 2008.
17. G. Potamianos, C. Neti, G. Gravier, A. Garg, and A. W. Senior. Recent advances in the automatic recognition of audiovisual speech. Proc. of the IEEE, 91(9):1306-1326, 2003.
18. B. Reuderink, M. Poel, K. Truong, R. Poppe, and M. Pantic. Decision-level fusion for audio-visual laughter detection. In Joint Workshop on Machine Learning and Multimodal Interaction, 2008.
19. J. A. Russell, J. A. Bachorowski, and J. M. Fernandez-Dols. Facial and vocal expressions of emotion. Annual Review of Psychology, 54:329-349, 2003.
20. K. Scherer. Affect bursts. In S. van Goozen, N. van de Poll, and J. Sergeant, editors, Emotions: Essays on emotion theory, pages 161-193. 1994.
21. M. Schroder, D. Heylen, and I. Poggi. Perception of non-verbal emotional listener feedback. In Speech prosody, pages 1-4, 2006.
22. B. Schuller, A. Batliner, D. Seppi, S. Steidl, T. Vogt, J. Wagner, L. Devillers, L. Vidrascu, N. Amir, L. Kessous, and V. Aharonson. The relevance of feature type for the automatic classification of emotional user states: Low level descriptors and functionals. In INTERSPEECH, pages 2253-2256, 2007.
23. M. Slaney and M. Covell. FaceSync: A Linear Operator for Measuring Synchronization of Video Facial Images and Audio Tracks. NIPS, pages 814-820, 2000.
24. K. P. Truong and D. A. van Leeuwen. Automatic discrimination between laughter and speech. Speech Communication, 49(2):144-158, 2007.
25. M. Valstar and M. Pantic. Combined support vector machines and hidden markov models for modeling facial action temporal dynamics. In IEEE Int'l Workshop on HCI, LNCS, pages 118-127, 2007.
26. M. F. Valstar, H. Gunes, and M. Pantic. How to distinguish posed from spontaneous smiles using geometric features. In ACM ICMI, pages 38-45, 2007.
27. P. Viola and M. Jones. Rapid object detection using a boosted cascade of simple features. CVPR, 1:511-518, 2001.
28. Z. Zeng, M. Pantic, G. Roisman, and T. Huang. A survey of affect recognition methods: Audio, visual and spontaneous expressions. IEEE PAMI, accepted for publication, 2008.