Affective multimodal mirror: Sensing and eliciting laughter

Proceedings of the ACM International Multimedia Conference and Exhibition

Volumn , Issue , 2007, Pages 31-39

  Melder, Willem A ^a   Truong, Khiet P ^a   Den Uyl, Marten ^b   Van Leeuwen, David A ^a   Neerincx, Mark A ^a,c   Loos, Lodewijk R ^d   Plum, B Stock ^e  

^a TNO   (Netherlands)

^b VicarVision   (Netherlands)

^c DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^d Waag Society   (Netherlands)

^e V2   (Netherlands)

Author keywords

Affective mirror; Face voice expression emotion; Multi modal laughter recognition

Indexed keywords

AFFECTIVE MIRRORS; FACE VOICE EXPRESSION EMOTION; MULTI MODAL LAUGHTER RECOGNITION;

FEEDBACK; INTELLIGENT SYSTEMS; MATHEMATICAL MODELS; MODAL ANALYSIS; USER INTERFACES;

FACE RECOGNITION;

EID: 37849046169     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1290128.1290134     Document Type: Conference Paper

References (45)

1. Aarts, E. Ambient intelligence: a multimedia perspective. IEEE Multimedia 11 (1), 2004, 12-19.
2. Andrés del Valle, A.C. and Opalach, A. The Persuasive Mirror. In Proceedings of Persuasive, 2006.
3. Bachorowski, J.A., amd Owren, M.J. (2001). Not all laugs are alike: Voiced but not unvoiced laughter readily elicits positive affect. Psychological Science, Vol. 12(3), 252-257.
4. Bradley, M.M. and Lang, P.J. Affective norms for English words (ANEW). Gainesville, FL. The NIMH Center for the Study of Emotion and Attention, University of Florida.
5. Brendsted, T., Nielsen, T.D., and Ortega, S. Affective multimodal interaction with a 3d agent. In Proceedings of the 8th international workshop on the cognitive science of natural language processing, 1999, 102-109.
6. Clavel, C., Ehrette, T., and Richard, G. Events detection for an audio-based surveillance system. In Proceedings of IEEE International Conference on Multimedia and Expo (ICME 2005), 2005, 1306-1309.
7. Collobert, R., Bengio, S., and Mariéthoz, J. Torch: a modular machine learning software library. Technical Report IDIAP-RR 02-46, IDIAP, 2002.
8. Darnell, T., Gordon, G., Woodfill, J., and Harville, M. A virtual mirror interface using real-time robust face tracking. In Proceedings of the 3th International Conference on Face and Gesture Recognition, 1998.
9. Den Uyl, M.J. and Van Kuilenburg, H. The FaceReader: online facial expression recognition. In Proceedings of Measuring Behavior, 2005.
10. Duric, Z., Gray, W.D., Heishman, R., Li, F., Rosenfeld, A., Schoelles, M.J., Schunn, C., and Wechsler, H. Integrating perceptual and cognitive modeling for adaptive and intelligent human-computer interaction. In Proceedings of the IEEE, Vol.90 (7), 2002, 1272-1289.
11. Ex'ovision EyeCatcher: http://www.exovision.nl/download/EyeCatcher- leaflet.pdf
12. Grootjen, M., Neerincx, M.A., Weert, J.C.M., and Truong, K.P. Measuring cognitive task load on a naval ship: implications of a real world environment. In Proceedings of International Conference on Human-Computer Interaction (HCII'07), 2007.
13. Hauptmann, A.G. Speech and gestures for graphic image manipulation. In Proceedings of ACM conference on Human Factors in Computing Systems (CHI'89), 1989, 241-245.
14. Janin, A., Baron, D., Edwards, J., Ellis, D., Gelbart, D., Morgan, N., Peskin, B., Pfau, T., Shriberg, E., Stoicke, A., and Wooters, C. The ICSI meeting corpus. In Proceedings of IEEE International conference on acoustics, speech and signal processing (ICASSP'03), 2003, 364-367.
15. th annual ACM International Conference on Multimedia, 2005, 677-682.
16. Kim, J., André, E., Rehm, M., Vogt, T., and Wagner, J. Integrating information from speech and physiological signals to achieve emotional sensitivity. In Proceedings of Interspeech, 2005.
17. Leatherby, J.H., and Pausch, R. Voice input as a replacement for keyboard accelerators in a mouse-based graphical editor: an empirical study. In Journal of the American Voice Input/Output Society 11 (2), 1992.
18. Lisetti, C.L. and Nasoz, F. MAUI: a multimodal affective user interface. In Proceedings of ACM Multimedia Interaction Conference 2002, 161-170.
19. Litman, D.J. and Forbes-Riley, K. Recognizing student emotions and attitudes on the basis of utterances in spoken tutoring dialogues with both human and computer tutors. Speech Communication 48 (5), 2006, 559-590.
20. Lundqvist, D., Flykt, A., and Öhman, A. The Karolinska Directed Emotional Faces - KDEF, Department of Clinical Neuroscience, Psychology section, Karolinska Institute.
21. Maat, L. and Pantic, M. Gaze-X: adaptive affective multimodal interface for single-user office scenarios. In Artificial Intelligence for Human Computing, Vol.4451, 2007, 251-271.
22. Merkx, P.A.B., Truong, K.P. and Neerincx, M.A. (2007). Inducing and measuring emotion through a multiplayer firstperson shooter computer game. In: H.J. van den Herik, J.W.H.M. Uiterwijk, M.H.M. Winands, and M.P.D. Schadd (Eds.). Proceedings of the Computer Games Workshop 2007, Amsterdam, The Netherlands.
23. Neerincx, M.A. and Lindenberg, J. Situated cognitive engineering for complex task environments. In: Schraagen, J.M. (Ed.), Natural Decision Making & Macro cognition. Ashley.
24. st Summer Workshop on Multimodal Interfaces, 2005, 13-20.
25. Oviatt, S. User-centered modeling and evaluation of multimodal interfaces. In Proceedings of the IEEE, Vol.91 (9), 2003, 1457-1468.
26. Pantic, M. and Rothkrantz, L. J.M. Towards an affect-sensitive multimodal human-computer interaction. In Proceedings of the IEEE, Vol.91, 2003.
27. th annual ACM international conference on multimedia, 2006.
28. Pellom, B., SONIC: The university of Colorado Continuous Speech Recognizer, University of Colorado, tech report#TR-CSLR-2001-01, Boulder, Colorado, March, 2001.
29. Picard, R.W. Affective computing. MIT Press, Cambridge, MA, 1997.
30. th International Workshop (IVA '03), 2003.
31. Sebe, N., Cohen, I., Gevers, T., and Huang, T. Emotion recognition based on joint visual and audio cues. In Proceedings of the International Conference on Pattern Recognition (ICPR 2006), 2006, 1136-1139.
32. SPRACHcore. http://www.icsi.berkeley.edu/~dpwe/projects/sprach/
33. Sung, K.K. and Poggio, T. Example-based learning for view-based human face detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 20 (1), 1998, 39-51.
34. Truong, K.P. and Van Leeuwen, D.A. Automatic discrimination between laughter and speech, Speech Communication 49 (2), 2007, 144-158.
35. Truong, K.P, van Leeuwen, D.A., and Neerincx, M.A. (in press). Unobtrusive Multimodal Emotion Detection in Adaptive Interfaces: Speech and Facial Expressions. In: D.D. Schmorrow & L.M. Reeves (Eds), Foundations of Augmented Cognition, 3rd Edition, LNAI 4565 proceedings (10 pages), ISBN 978-3-540-73215-0.
36. V2_ institute for the unstable media, MUSH device v3: http://multimedian.v2.nl/mush/mushv3_documentation.pdf
37. Van Kuilenburg, H., Wiering, Marco, Den Uyl, M. A model based method for automatic facial expression recognition. In Proceedings of the European Conference on Machine Learning (ECML ' 05), 2005, 194-205.
38. Vidrascu, L., and Devillers, L. Detection of real-life emotions in dialogs recorded in a call center. In Proceedings of Interspeech, 2005, 1841-1844.
39. Vogt, T. and André, E. Comparing feature sets for acted and spontaneous speech in view of automatic emotion recognition. In Proceedings of IEEE International Conference on Multimedia & Expo (ICME'05), 2005.
40. Waag Society, KeyWorx: http://www.keyworx.org, Realizer: http://kwlive.dev.waag.org/realizer/doc/doxygen/html/
41. Wilting, J., Krahmer, E., and Swerts, M. Real vs. acted emotional speech. In Proceedings of Interspeech, 2006.
42. Yacoub, S., Simske, S.,Lin, X., and Burns, J. Recognition of emotions in interactive voice response systems. In Proceedings of Eurospeech, 2003, 729-732.
43. Yang, G., Lin, Y., and Bhattacharya, P. A driver fatigue recognition model using fusion of multiple features. In IEEE SMC, Vol.2, 2005, 1777-1784.
44. th International Conference on Multimodal Interfaces (ICMI '06), 2006, 139-145.
45. Zhai, J. and Barreto, A. Stress recognition using noninvasive technology. In Proceedings of FLAIRS Conference, 2006, 395-401.