Informing intelligent user interfaces by inferring affective states from body postures in ubiquitous computing environments

International Conference on Intelligent User Interfaces, Proceedings IUI

Volumn , Issue , 2013, Pages 235-245

  Tan, Chiew Seng Sean ^a   Schöning, Johannes ^a   Luyten, Kris ^a   Coninx, Karin ^a  

^a HASSELT UNIVERSITY   (Belgium)

Author keywords

Affective computing; Emotion recognition; Intelligent user interfaces; Posture tracking detection; Social behavior; Ubicomp

Indexed keywords

AFFECTIVE COMPUTING; EMOTION RECOGNITION; INTELLIGENT USER INTERFACES; POSTURE TRACKING; SOCIAL BEHAVIOR; UBICOMP;

ASSOCIATION RULES; SENSORS;

UBIQUITOUS COMPUTING;

EID: 84875855849     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2449396.2449427     Document Type: Conference Paper

References (36)

1. Abowd, G.D. What next, ubicomp? celebrating an intellectual disappearing act. In Proc. Ubicomp 2012, ACM Press (2012), 31-40.
2. Abraham, A. Rule Based Expert Systems. In Handbook for Measurement Systems Design, Sydenham, P. and Thorn, R. (Eds.), John Wiley and Sons, London, UK, 2005, 920-931.
3. Argyle, M. Bodily Communication, Taylor and Francis, Abington, UK, 1988.
4. Ball, G. and Breese, J. Relating Personality and Behavior: Posture and Gestures, Affective Interactions, Paiva A.M (Ed.), LNAI 1814 (2000), 196-204.
5. Bolls, P.D., Lang, A. and Potter, R.F. The Effects of Message Valence and Listener Arousal on Attention, Memory, and Facial Muscular Responses to Radio Advertisements. Communication Research 28, 5 (2001), 627-651.
6. Breazeal, C. and Scassellati, B. A Context-Dependent Attention System for a Social Robot. In Proc. IJCAI 1999, Morgan Kaufmann Publishers (1999), 1146-1153.
7. Burgoon, J.K., Buller, D.B., Hale, J.L. and de Turck, M.A. Relational messages associated with nonverbal behaviors. Human Communication Research 10, 3 (1984), 351-378.
8. Clore, G.L., Wiggins, N.H. and Itkin, S. Gain and loss in attraction: Attributions from nonverbal behavior. Journal of Personality and Social Psychology 31, 4 (1975), 706-713.
9. Comaniciu, D., Ramesh, V. and Meer, P. Kernel-Based Object Tracking. IEEE Trans. Pattern Anal. Mach. Intell. 25, 5 (2003), 564-575.
10. Csikszentmihalyi, M. Flow: The Psychology of Optimal Experience, Harper Perennial, New York, USA, 1991.
11. Davidson, J. and Ekman, P. The Nature of Emotion: Fundamental Questions, Oxford University Press, New York, USA, 1994.
12. Dey, A.K. Understanding and Using Context. Personal Ubiquitous Comput. 5, 1 (2001), 4-7.
13. Fujiyoshi, H. and Lipton, A.J. Real-time Human Motion Analysis by Image Skeletonization, In Proc. WACV'98, IEEE Computer Society (1998), 15-21.
14. Gilroy, S.W., Cavazza, M.O. and Vervondel, V. Evaluating multimodal affective fusion using physiological signals. In Proc. IUI 2011, ACM Press (2011), 53-62.
15. Gunes, H., Schuller, B., Pantic, M. and Cowie, R., Emotion Representation, Analysis and Synthesis in Continuous Space: A Survey. In Proc. FG'11, Workshop on EmoSPACE 2011, 827-834.
16. Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P. and Witten, I.H. The WEKA data mining software: an update. SIGKDD Explor. Newsl. 11, 1 (2009), 10-18.
17. Isen, A.M. Positive Affect and Decision Making. Lewis, M. and Haviland-Jones, J.M. (Eds.) Handbook of Emotions, New York, USA, 2000.
18. Kapoor, A., Burleson, W. and Picard, R.W. Automatic prediction of frustration. Int. J. Hum.-Comput. Stud. 65, 8 (2008), 724-736.
19. Kleinsmith, A. and Bianchi-Berthouze, N. Recognizing Affective Dimensions from Body Posture. In Proc. ACII 2007, Springer-Verlag (2007), 48-58.
20. Lance, B. and Marsella, S.C. Emotionally Expressive Head and Body Movement During Gaze Shifts. In Proc. IVA 2007, Springer-Verlag (2007), 72-85.
21. Legaspi, R., Fukui, K., Moriyama, K., Kurihara, S., Numao, M. and Suarez, M. Addressing the problems of data-centric physiology-affect relations modeling. In Proc. IUI 2010, ACM Press (2010), 21-30.
22. Mandryk, R.L. and Atkins, S. A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies. Int. J. Hum.-Comput. Stud. 65, 4 (2007), 329-347.
23. McDuff, D., Karlson, A., Kapoor, A., Roseway, A. and Czerwinski, M. AffectAura: an intelligent system for emotional memory. In Proc. CHI 2012, ACM Press (2012), 849-858.
24. Mehrabian, A. Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in Temperament. Current Psychology 14, 4 (1996), 261-292.
25. Petty, R.E. and Cacioppo, J.T. Attitudes and persuasion: Classic and contemporary approaches, Westview Press, Colorado, USA, 1996.
26. Picard, R.W. Affective Computing. The MIT Press, Cambridge, Massachusetts, 1997, Ch. 5, 6, and 7.
27. Quinlan, J.R. C4.5: programs for machine learning. Morgan Kaufmann Publishers Inc., California, USA, 1993.
28. Rogers, Y. The Changing Face of Human-Computer Interaction in the Age of Ubiquitous Computing. Usability for e-Inclusion, LNCS 5889 (2009), 1-19.
29. Russell, J.A., Weiss, A. and Mendelsohn, G.A. Affect Grid: A single-item scale of pleasure and arousal. Journal of Personality and Social Psychology 57, 3 (1989), 493-502.
30. Scheflen, A.E. and Scheflen, A. Body Language and the Social Order: Communication As Behavioral Control. Prentice-Hall, New Jersey, USA, 1972.
31. Scherer, K.R., Wallbott, H.G. and Summerfield, A.B. Experiencing Emotion: A Cross-Cultural Study, Cambridge University Press, New York, USA, 1986.
32. Tan, S., Schöning, J., Schneider Barnes, J., Luyten K. and Coninx, K. Bro-cam: Improving game experience with empathic feedback using posture tracking. In Proc. of the 8th International Conference on Persuasive Technology, (2013)
33. Timmermans, D. The impact of task complexity on information use in multi-attribute decision making. Journ. Behavioral Decision Making 6, 2 (1993), 95-111.
34. Wagner, J., Andre, E., Lingenfelser, F. and Kim, J. Exploring Fusion Methods for Multimodal Emotion Recognition with Missing Data. IEEE Trans. Affect. Comput. 2, 4 (2011), 206-218.
35. Weiser, M. The computer for the 21st century. Scientific American, 1991, 94-104.
36. Aviezer, H., Trope, Y., and Todorov, A. Body cues, not facial expressions, discriminate between intense positive and negative emotions. Science 338, 6111 (2012), 1225-1229.