The impact of a character posture model on the communication of affect in an immersive virtual environment

IEEE Transactions on Visualization and Computer Graphics

Volumn 14, Issue 5, 2008, Pages 965-981

  Vinayagamoorthy, Vinoba ^b   Steed, Anthony ^a,c   Slater, Mel ^c,d  

^a IEEE

^b BBC RESEARCH AND DEVELOPMENT   (United Kingdom)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

^d UNIVERSITAT POLITÈCNICA DE CATALUNYA   (Spain)

Author keywords

Evaluation; Facial expression presence; Nonverbal behavior; Physiology; Posture; Virtual characters; Virtual reality

Indexed keywords

REAL TIME SYSTEMS; VIRTUAL REALITY;

DATA COLLECTIONS; EXPERIMENTAL APPROACHES; FULL BODY; HOLISTIC MANNER; IMMERSIVE; IMMERSIVE VIRTUAL ENVIRONMENT (IVE); PSYCHOLOGICAL STATES; QUALITATIVE METHODS; SOCIAL CONTEXTS; VIRTUAL CHARACTERS; VIRTUAL ENVIRONMENT (VE);

QUALITY CONTROL;

AFFECT; ARTICLE; ASSOCIATION; BODY POSTURE; COMPUTER GRAPHICS; COMPUTER INTERFACE; FACIAL EXPRESSION; HUMAN; INTERPERSONAL COMMUNICATION; PHYSIOLOGY; TASK PERFORMANCE; VISION;

AFFECT; COMMUNICATION; COMPUTER GRAPHICS; CUES; FACIAL EXPRESSION; HUMANS; POSTURE; TASK PERFORMANCE AND ANALYSIS; USER-COMPUTER INTERFACE; VISUAL PERCEPTION;

EID: 47649121003     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2008.62     Document Type: Article

References (53)

1. E. Arts, The Sims Online, http://thesims.ea.com/, Jan. 2005.
2. K. Johnsen, R. Dickerson, A. Raij, B. Lok, J. Jackson, M. Shin, J. Hernandez, A. Stevens, and D.S. Lind, "Experiences in Using Immersive Virtual Characters to Educate Medical Communication Skills," Proc. IEEE Virtual Reality Conf. (VR '05), vol. 324, pp. 179-186, 2005.
3. D.-P. Pertaub, M. Slater, and C. Barker, "An Experiment on Public Speaking Anxiety in Response to Three Different Types of Virtual Audience," Presence: Teleoperators and Virtual Environments, vol. 11, no. 1, pp. 68-78, Feb. 2002.
4. M. Coulson, "Attributing Emotion to Static Body Postures: Recognition Accuracy, Confusions, and Viewpoint Dependence," J. Nonverbal Behavior, vol. 28, no. 2, pp. 117-139, 2004.
5. B. de Gelder, "Towards the Neurobiology of Emotional Body Language," Nature Rev. Neuroscience, vol. 7, pp. 242-249, 2006.
6. V. Vinayagamoorthy, M. Gillies, A. Steed, E. Tanguy, X. Pan, C. Loscos, and M. Slater, "Building Expression into Virtual Characters," Proc. Eurographics '06, State of the Art Report (STAR), pp. 21-61, Sept. 2006.
7. V. Vinayagamoorthy, M. Garau, A. Steed, and M. Slater, "An Eye Gaze Model for Dyadic Interaction in an Immersive Virtual Environment: Practice and Experience," Computer Graphics Forum, vol. 23, no. 1, pp. 1-11, Mar. 2004.
8. V. Vinayagamoorthy, A. Brogni, A. Steed, and M. Slater, "The Influence of a Virtual Character Posture Model on Reported Presence in an Immersive Virtual Environment," Proc. ACM SIGGRAPH Int'l Conf. Virtual Reality Continuum and Its Applications (VRCIA '06), pp. 229-236, June 2006.
9. M.V. Sanchez-Vives and M. Slater, "From Presence to Consciousness through Virtual Reality," Nature Rev. Neuroscience, vol. 6, no. 4, pp. 332-339, 2005.
10. J. Blascovich, J. Loomis, A.C. Beall, K. Swinth, C. Hoyt, and J.N. Bailenson, "Immersive Virtual Environment Technology as a Methodological Tool for Social Psychology," Psychology Inquiry, vol. 13, pp. 103-124, 2002.
11. J. Gratch and S. Marsella, "A Domain Independent Framework for Modeling Emotion," J. Cognitive Systems Research, vol. 5, no. 4, pp. 269-306, 2004.
12. E.A.R. Tanguy, "Emotions: The Art of Communication Applied to Virtual Actors," PhD dissertation, June 2006.
13. S. Planalp, V.L. DeFrancisco, and D. Rutherford, "Varieties of Cues to Emotion in Naturally Occurring Situations," Cognition and Emotion, vol. 10, no. 2, pp. 137-153, 1996.
14. R. Schroeder, The Social Life of Avatars; Presence and Interaction in Shared Virtual Environments. Springer-Verlag New York, Inc., 2002.
15. M. Argyle, Social Interaction. Tavistock Publications, 1969.
16. P. Ekman, "Facial Expressions of Emotion: New Findings, New Questions," Psychological Science, vol. 3, no. 1, pp. 34-38, 1992.
17. S. Kshirsagar and N. Magnenat-Thalmann, "A Multilayer Personality Model," Proc. Second Int'l Symp. Smart Graphics, pp. 107-115, June 2002.
18. I. Albrecht, M. Schröder, J. Haber, and H.-P. Seidel, "Mixed Feelings: Expression of Non-Basic Emotions in a Muscle-Based Talking Head," Special Issue of J. Virtual Reality on Language, Speech and Gesture, vol. 8, pp. 201-212, 2005.
19. P. Ekman and V.W. Friesen, "Head and Body Cues in the Judgement of Emotion: A Reformulation," Perceptual and Motor Skills, vol. 24, pp. 711-724, 1967.
20. M. Argyle, Bodily Communication, second ed. Methuen, 1998.
21. P.E. Bull, Posture and Gesture, ser. Int'l Series in Experimental Social Psychology, vol. 16, Pergamon Press, 1987.
22. K.L. Walters and R.D. Walk, "Perception of Emotion from Body Posture," Bull. Psychonomic Soc., vol. 24, no. 5, p. 329, 1986.
23. A.T. Dittmann, M.B. Parloff, and D.S. Boomer, "Facial and Bodily Expression: A Study of Receptivity of Emotional Cues," Psychiatry, vol. 28, pp. 239-244, 1965.
24. A.E. Scheflen, "The Significance of Posture in Communication Systems," Psychiatry, vol. 27, pp. 316-331, 1964.
25. K.L. Walters and R.D. Walk, "Perception of Emotion from Moving Body Cues in Photographs," Bull. Psychonomic Soc., vol. 26, no. 2, pp. 112-114, 1988.
26. W.T. James, "A Study of the Expression of Bodily Posture," J. General Psychology, vol. 42, pp. 90-94, 1932.
27. H.G. Wallbott, "Bodily Expression of Emotion," European J. Social Psychology, vol. 28, no. 6, pp. 879-896, 1998.
28. P.R. De Silva and N. Bianchi-Berthouze, "Modeling Human Affective Postures: An Information Theoretic Characterization of Posture Features: Research Articles," Computer Animation and Virtual Worlds, vol. 15, no. 3-4, pp. 269-276, 2004.
29. A. Kelsmith, R.P. De Silva, and N. Bianchi-Berthouze, "Grounding Affective Dimensions into Posture Features," Proc. First Int'l Conf Affective Computing and Intelligent Interaction (ACII '05), ser. Lecture Notes in Computer Science, J. Tao, T. Tan, and R.W. Picard, eds., vol. 3784, pp. 263-270, Oct. 2005.
30. M. Slater, "How Colourful Was Your Day?: Why Questionnaires Cannot Assess Presence in Virtual Environments," Presence: Teleoperators and Virtual Environments, vol. 13, no. 4, pp. 484-493, 2004.
31. J.N. Bailenson, J. Blascovich, and A.C. Beall, "Equilibrium Theory Revisited: Mutual Gaze and Personal Space in Virtual Environments," Presence: Teleoperators and Virtual Environments, vol. 10, no. 6, pp. 583-598, 2001.
32. M. Meehan, B. Insko, M.C. Whitton, and F.P. Brooks, "Physiological Measures of Presence in Stressful Virtual Environments," Proc. ACM SIGGRAPH '02, vol. 21, pp. 645-653, 2002.
33. M. Slater, C. Guger, G. Edlinger, R. Leeb, G. Pfurtscheller, A. Antley, M. Garau, A. Brogni, A. Steed, and D. Friedman, "Analysis of Physiological Responses to a Social Situation in an Immersive Virtual Environment," Presence: Teleoperators and Virtual Environments, vol. 15, no. 5, Oct. 2006.
34. E.T. Hall, The Hidden Dimension: Man's Use of Space in Public and Private. Bodley Head, 1969.
35. M.J. Green, L.M. Williams, and D. Davidson, "In the Face of Danger: Specific Viewing Strategies for Facial Expressions of Threat," Cognition and Emotion, vol. 17, no. 5, pp. 779-786, 2003.
36. C. Cruz-Neira, D.J. Sandin, and T.A. DeFanti, "Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the Cave," Proc. ACM SIGGRAPH '93, pp. 135-142, 1993.
37. A. Steed, J. Mortensen, and E. Frécon, "Spelunking: Experiences Using the Dive System on Cave-Like Platform," Immersive Projection Technologies and Virtual Environments, pp. 153-164, 2001.
38. R.M. Taylor II, T.C. Hudson, A. Seeger, H. Weber, J. Juliano, and A.T. Heiser, "VRPN: A Device-Independent, Network-Transparent VR Peripheral System," Proc. ACM Symp. Virtual Reality Software and Technology (VRST '01), pp. 55-61, 2001.
39. M. Gillies, V. Vinayagamoorthy, D. Robertson, and A. Steed, "A Platform Independent Architecture for Virtual Characters and Avatars," Proc. Third Int'l Workshop Intelligent Virtual Agents (IVA '05), T. Panayiotopoulos, J. Gratch, R. Aylett, D. Ballin, P. Olivier, and T. Rist, eds., vol. 3661, Sept. 2005.
40. M.P. Johnson, "Exploiting Quaternions to Support Expressive Interactive Character Motion," PhD dissertation, Feb. 2003.
41. P. Ekman, Emotion in the Human Face, vol. 2, Cambridge Univ. Press, 1982.
42. M. Garau, M. Slater, V. Vinayagamoorthy, A. Brogni, A. Steed, and A.M. Sasse, "The Impact of Avatar Realism and Eye Gaze Control on the Perceived Quality of Communication in a Shared Immersive Virtual Environment," Proc. SICCHI Conf. Human Factors in Computing Systems (CHI '03), pp. 529-536, Apr. 2003.
43. M. Slater and A. Steed, "A Virtual Presence Counter," Presence: Teleoperators and Virtual Environments, vol. 9, no. 2, pp. 214-217, 2000.
44. D. Watson and R. Friend, "Social Avoidance and Distress Scale [SAD] (1969)," Measures for Clinical Practice: A Sourcebook, K. Corcoran and J. Fischer, eds., Free Press, 1987.
45. C.D. Spielberger, R.L. Gorsuch, R. Lushene, P.R. Vagg, and G.A. Jacobs, Manual for the State-Trait Anxiety Inventory. Consulting Psychologists Press, 1983.
46. T. Gilbert and M. Coulson, "The Role of Emotional Perception in Attentional Bias for Threat," Proc. British Psychological Soc., vol. 10, no. 2, p. 68, 2002.
47. W. Doherty, "The Emotional Contagion Scale: A Measure of Individual Differences," J. Nonverbal Behaviour, vol. 21, no. 2, pp. 131-154, 1997.
48. P. McCullagh and J.A. Nelder, Generalized Linear Models, second ed. Chapman and Hall, 1989.
49. Generalised Linear Interactive Model (GLIM), T.N.A.G. NAG, http://www.nag.co.uk/stats/gdge_soft.asp/, July 2005.
50. A. Tashakkori and C. Teddlie, Mixed Methodology: Combining Qualitative and Quantitative Approaches, ser. Applied Social Research Methods Series, vol. 46, Sage Publications, 1998.
51. Atlas.ti - The Knowledge Workbench, ATLAS.ti, http://www.atlasti. com/index.php, Mar. 2006.
52. J.L. Andreassi, Psychophysiology: Human Behavior and Physiological Response. Lawrence Erlbaum Assoc., 1995.
53. H.M. Paterson, F.E. Pollick, and A.J. Sanford, "The Role of Velocity in Affect Discrimination," Proc 23rd Ann. Conf. Cognitive Science Soc. (CSS '01), J. D. Moore and K. Stenning, eds., pp. 756-761, Aug. 2001.