MAUI avatars: Mirroring the user's sensed emotions via expressive multi-ethnic facial avatars

Journal of Visual Languages and Computing

Volumn 17, Issue 5, 2006, Pages 430-444

  Nasoz, Fatma ^a   Lisetti, Christine L ^b  

^a University of Central Florida   (United States)

^b EURECOM   (France)

Author keywords

Affective intelligent user interfaces; Emotion recognition

Indexed keywords

EID: 33748077460     PISSN: 1045926X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jvlc.2006.05.001     Document Type: Article

References (38)

1. A. Takeuchi, K. Nagao, Communicative facial displays as a new conversational modality, in: Proceedings of ACM/IFIP INTERCHI'93: Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, 1993, pp. 187-193.
2. Ekman P. The argument and evidence about universals in facial expressions of emotion. In: Wagner H., and Manstead A. (Eds). Handbook of Social Psychophysiology (1999), Wiley, Chichester 143-164
3. Walker J.H., Sproull L., and Subramani R. Using a human face in an interface. In: Adelson B., Dumais S., and Olson J. (Eds). Proceedings of ACM Conference on Human Factors in Computing Systems CHI'94 (1994), ACM Press, New York 85-91
4. C.L. Lisetti, F. Nasoz, MAUI: a multimodal affective user interface, in: Proceedings of the ACM Multimedia Conference 2002, Juan les Pins, France, December 2002.
5. Allen A., Roman L., Cox R., and Cardwell B. Home health visits using a cable television network: user satisfaction. Journal of Telemedicine and Telecare 2 (1996) 92-94
6. Crist T.M., Kaufman S.B., and Crampton K.R. Home telemedicine: a home health care agency strategy for maximizing resources. Home Health Care Manage Practice 8 (1996) 1-9
7. Darkins A.W., and Carey M.A. Telemedicine and Telehealth: Principles, Policies Performance and Pitfalls (2000), Springer Publishing Company Inc., New York, NY
8. Warner I. Telemedicine applications for home health care. Journal of Telemedicine and Telecare 3 (1997) 65-66
9. Damasio A.R. Descartes' Error (1994), Avon Books, New York
10. Lisetti C.L., Nasoz F., Lerouge C., Ozyer O., and Alvarez K. Developing multimodal intelligent affective Interfaces for Tele-Home Health Care. International Journal of Human-Computer Studies-Special Issue on Applications of Affective Computing in Human-Computer Interaction 59 1-2 (2003) 245-255
11. Goleman D. Emotional Intelligence (1995), Bantam Books, New York
12. Rozell E.J., and Gardner W.L. Cognitive. motivation, and affective processes associated with computer-related performance: a path analysis, Computers in Human Behavior 16 (2000) 199-222
13. Lewis V.E., and Williams R.N. Mood-congruent vs. mood-state-dependent learning: implications for a view of emotion. Special Issue of the Journal of Social Behavior and Personality 4 (1989) 157-171
14. Reber A.S. The Penguin Dictionary of Psychology (1985), Penguin Books, London, UK
15. Hara N., and Kling R. A case study of students' frustrations with a web-based distance education course. Information Communication and Society 3 4 (2000) 557-579
16. Jonassen D.H., and Grabowski B.L. Handbook of Individual Differences, Learning, and Instruction (1993), Lawrence Erlbaum Associates, Hillsdale, NJ
17. Martocchio J.J. Effects of conceptions of ability on anxiety. self-efficacy, and learning in training, Journal of Applied Psychology 79 (1994) 819-825
18. Warr P., and Bunce D. Trainee characteristics and the outcomes of open learning. Personnel Psychology 48 (1995) 347-375
19. Colquitt J.A., LePine J.A., and Noe R.A. Toward an integrative theory of training motivation: a meta-analytic path analysis of 20 years of research. Journal of Applied Psychology 85 (2000) 678-707
20. Collet C., Vernet-Maury E., Delhomme G., and Dittmar A. Autonomic nervous system response patterns specificity to basic emotions. Journal of the Autonomic Nervous System 62 1-2 (1997) 45-57
21. Ekman P., Levenson R.W., and Friesen W.V. Autonomic nervous system activity distinguishes between emotions. Science 221 4616 (1983) 1208-1210
22. Gross J.J., and Levenson R.W. Hiding feelings: the acute effects of inhibiting negative and positive emotions. Journal of Abnormal Psychology 106 1 (1997) 95-103
23. J. Healey, R.W. Picard, SmartCar: detecting driver stress, in: Proceedings of International Conference on Pattern Recognition (ICPR'00), Barcelona, Spain, 2000.
24. Picard R.W., Healey J., and Vyzas E. Toward machine emotional intelligence analysis of affective physiological state. IEEE Transactions on Pattern Analysis and Machine Intelligence 23 10 (2001) 1175-1191
25. Lisetti C.L., and Nasoz F. Using non-invasive wearable computers to recognize human emotions from physiological signals. EURASIP Journal on Applied Signal Processing-Special Issue on Multimedia Human-Computer Interface 11 (2004) 1672-1687
26. Gross J.J., and Levenson R.W. Emotion elicitation using films. Cognition and Emotion 9 (1995) 87-108
27. Mitchell T.M. Machine Learning (1997), McGraw-Hill Companies Inc., New York
28. Nicol A.A., and Pexman P.M. Presenting Your Findings: A Practical Guide for Creating Tables (1999), American Physiological Association, Washington, DC
29. Hagan M.T., and Menhaj M.B. Training feedforward networks with the Marquardt algorithm. IEEE Transactions on Neural Networks 5 6 (1994) 989-993
30. Feldman Barrett L., Gross J.J., Christensen T.C., and Benvenuto M. Knowing what you're feeling and knowing what to do about it: mapping the relation between emotion differentiation and emotion regulation. Cognition and Emotion 15 (2001) 713-724
31. Lisetti C.L., Brown S., Alvarez K., and Marpaung A. A social informatics approach to human-robot interaction with an office service robot. IEEE Transactions on Systems, Man and Cybernetics-Special Issue on Human-Robot Interaction 34 2 (2004) 195-209
32. Haptek PeoplePutty: www.haptek.com.
33. Zhang Y., Prakash E., and Sung E. Face alive. Journal of Visual Languages and Computing 15 (2004) 125-160
34. de Rosis F., Pelachaud C., Poggi I., Carofiglio V., and de Carolis B. From Greta's mind to her face: modelling the dynamics of affective states in a conversational embodied agent. International Journal of Human-Computer Studies-Special Issue on Applications of Affective Computing in HCI 59 (2003)
35. S. Pasquariello, C. Pelachaud, Greta: a simple facial animation engine, in: Proceedings of the Sixth Online World Conference on Soft Computing in Industrial Applications (WSC6), World Wide Web, September 2001.
36. Pelachaud C., and Bilvi M. Computational model of believable conversational agents. In: Huget M.P. (Ed). Communication in Multi Agent Systems: Background, Current Trends and Future (2003), Springer, Berlin 300-317
37. Prendinger H., Descamps S., and Ishizuka M. MPML: a markup language for controlling the behavior of lifelike characters. Journal of Visual Languages and Computing 15 (2004) 183-203
38. Norcio A.F., and Stanley J. Adaptive human interfaces: a literature survey and perspective. IEEE Transactions on Systems, Man, and Cybernetics 19 2 (1989) 399-408