Fusion of audio and visual cues for laughter detection

CIVR 2008 - Proceedings of the International Conference on Content-based Image and Video Retrieval

Volumn , Issue , 2008, Pages 329-337

  Petridis, Stavros ^a   Pantic, Maja ^b  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

Audiovisual data processing; Laughter detection; Non linguistic information processing

Indexed keywords

CONTENT BASED RETRIEVAL; INFORMATION RETRIEVAL;

AUDIO AND VISUAL CUES; AUDIO-VISUAL DATA; AUDIO-VISUAL FUSION; DECISION LEVEL FUSION; FACIAL EXPRESSIONS; LINGUISTIC INFORMATION PROCESSING; PERSON-INDEPENDENT; PROSODIC FEATURES;

DATA HANDLING;

EID: 57549094671     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1386352.1386396     Document Type: Conference Paper

References (24)

1. J. A. Bachorowski, M. J. Smoski, and M. J. Owren. The acoustic features of human laughter. Journal- Acoustical Society of America, 110(1):1581-1597, 2001.
2. P. Boersma and D. Weenink. Praat: doing phonetics by computer (version 4.3.01) (www.praat.org)). Technical report, 2005.
3. R. Cai, L. Lu, H.-J. Zhang, and L.-H. Cai. Highlight sound effects detection in audio stream. In Multimedia and Expo. 2003. International Conference on, volume 3, pages III-37-40 vol.3, 2003.
4. N. Campbell, H. Kashioka, and R. Ohara. No laughing matter. In European conference on speech communciation and technology:; Interspeech, pages 465-468, 2005.
5. T. F. Cootes, C. J. Taylor, D. H. Cooper, and J. Graham. Active shape models - their training and application. Computer Vision and Image Understanding, 61(1):38, 1995.
6. S. Dupont and J. Luettin. Audio-visual speech modeling for continuous speech recognition. Ieee Transactions on Multimedia, 2(3):141-151, 2000.
7. G. Furnas, T. Landauer, G. L., and S. Dumais. The vocabulary problem in human-system communication. Communications of the ACM, 30(11):964-972, 1987.
8. D. Gonzalez-Jimenez and J. L. Alba-Castro. Toward pose-invariant 2-d face recognition through point distribution models and facial symmetry. IEEE Transactions on Information Forensics and Security, 2(3):413-429, 2007.
9. H. Hermansky. Perceptual linear predictive (plp) analysis of speech. Journal of the Acoustical Society of America, 87(4): 1738-1752, 1990.
10. A. Ito, W. Xinyue, M. Suzuki, and S. Makino. Smile and laughter recognition using speech processing and face recognition from conversation video. In International Conference on Cyberworlds, 2005, page 8 pp., 2005.
11. L. Kennedy and D. Ellis. Laughter detection in meetings. In NIST ICASSP 2004 Meeting Recognition Workshop, 2004.
12. A. Lockerd and F. Mueller. Lafcam: Leveraging affective feedback camcorder. In CHI'02 extended abstracts on Human factors in computing systems, pages 574-575, 2002.
13. I. McCowan, J. Carletta, W. Kraaij, S. Ashby, S. Bourban, M. Flynn, M. Guillemot, T. Hain, J. Kadlec, and V. Karaiskos. The ami meeting corpus. In International conference on methods and techniques in behavioral research; Proceedings of measuring behaviour 2005, pages 137-140, 2005.
14. M. Pantic, A. Pentland, A. Nijholt, and T. Huang. Human computing and machine understanding of human behavior: A survey. In Multimodal interfaces; ICMI'06, pages 239-248, 2006.
15. I. Patras and M. Pantic. Particle filtering with factorized likelihoods for tracking facial features. In International conference on automatic face and gesture recognition, pages 97-104, 2004.
16. S. Petridis and M. Pantic. Audiovisual discrimination between laughter and speech. In International Conference on Acoustics Speech and Signal Processing, pages 5117-5120, 2008.
17. G. Potamianos, C. Neti, G. Gravier, A. Garg, and A. W. Senior. Recent advances in the automatic recognition of audiovisual speech. Proceedings of the Ieee, 91(9):1306-1326, 2003.
18. B. Reuderink. Fusion for audio-visual laughter detection. MS Thesis, University of Twente, the Netherlands, 2007.
19. J. A. Russell, J. A. Bachorowski, and J. M. Fernandez-Dols. Facial and vocal expressions of emotion. Annual Review of Psychology, 54:329-349, 2003.
20. K. Scherer. Affect bursts. In S. van Goozen, N. van de Poll, and J. Sergeant, editors, Emotions: Essays on emotion theory, pages 161-193. 1994.
21. M. Schroder, D. Heylen, and I. Poggi. Perception of non-verbal emotional listener feedback. In R. Hoffmann and H. Mixdorff, editors, Speech prosody, pages 1-4, 2006.
22. K. P. Truong and D. A. van Leeuwen. Automatic discrimination between laughter and speech. Speech Communication, 49(2):144-158, 2007.
23. M. F. Valstar, H. Gunes, and M. Pantic. How to distinguish posed from spontaneous smiles using geometric features. In Proc. of the ACM Int. Conf. on Multimodal Interfaces, pages 38-45, 2007.
24. Z. Zeng, M. Pantic, G. Roisman, and T. Huang. A survey of affect recognition methods: Audio, visual and spontaneous expressions. IEEE Trans. Pattern Analysis and Machine Intelligence, accepted, for publication, 30, 2008.