Ballistocardiographic Responses to Dynamic Facial Displays of Emotion While Sitting on the EMFi Chair

Journal of Media Psychology

Volumn 21, Issue 2, 2009, Pages 69-84

  Anttonen, Jenni ^a   Surakka, Veikko ^a   Koivuluoma, Mikko ^a  

^a TAMPERE UNIVERSITY OF TECHNOLOGY   (Finland)

Author keywords

dynamic facial expressions; emotion; heart rate; perceptual technologies; physiology; video stimuli

Indexed keywords

EID: 67650104800     PISSN: 18641105     EISSN: None     Source Type: Journal    
DOI: 10.1027/1864-1105.21.2.69     Document Type: Article

References (93)

1. Adolphs R. Recognizing emotion from facial expressions: Psychological and neurological mechanisms. Behavioral and Cognitive Neuroscience Reviews 1 1 (2002) 21-62
2. Ambadar Z., Schooler J.W., and Cohn J.F. Deciphering the enigmatic face: The importance of facial dynamics in interpreting subtle facial expressions. Psychological Science 16 (2005) 403-410
3. Anttonen J., and Surakka V. Emotions and heart rate while sitting on a chair. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI 2005 (2005) 491-499
4. Anttonen J., and Surakka V. Music, heart rate, and emotions in the context of stimulating technologies. Springer Lecture Notes on Computer Science 4738 (2007) 290-301
5. Aula A., and Surakka V. Auditory emotional feedback facilitates human-computer interaction. Proceedings of HCI 2002 (2002), Springer, London 337-349
6. Bailenson J.N., Pontikakis E.D., Mauss I.B., Gross J.J., Jabon M.E., Hutcherson C.A., et al. Real-time classification of evoked emotions using facial feature tracking and physiological responses. International Journal of Human-Computer Studies 66 (2008) 303-317
7. Biele C., and Grabowska A. Sex differences in perception of emotion intensity in dynamic and static facial expressions. Experimental Brain Research 171 (2006) 1-6
8. Bradley M.M., Codispoti M., Cuthbert B.N., and Lang P.J. Emotion and motivation I: Defensive and appetitive reactions in picture processing. Emotion 1 (2001) 276-298
9. Bradley M.M., Codispoti M., Sabatinelli D., and Lang P.J. Emotion and motivation II: Sex differences in picture processing. Emotion 1 (2001) 300-319
10. Bradley M.M., Cuthbert B.N., and Lang P.J. Picture media and emotion: Effects of a sustained affective content. Psychophysiology 33 (1996) 662-670
11. Bradley M.M., and Lang P.J. Measuring emotion: The self-assessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry 25 (1994) 49-59
12. Bradley M.M., and Lang P.J. International affective digitized sounds (IADS): Stimuli, instruction manual, and affective ratings. Technical Report, B-2 (1999), University of Florida, The Center for Research in Psychophysiology, Gainesville, FL
13. Bradley M.M., and Lang P.J. Affective reactions to acoustic stimuli. Psychophysiology 37 (2000) 204-215
14. Campbell R., Elgar K., Kuntsi J., Akers R., Terstegge J., Coleman M., et al. The classification of "fear" from faces is associated with face recognition skill in women. Neuropsychologia 40 (2002) 575-584
15. Christie I.C., and Friedman B.H. Autonomic specificity of discrete emotion and dimensions of affective space: A multivariate approach. International Journal of Psychophysiology 51 (2004) 143-153
16. Coles M.G.H. Heart rate and attention: The intake-rejection hypothesis and beyond. In: Coles M.G.H., Jennings J.R., and Stern J.A. (Eds). Psychophysiological perspectives: Festschrift for Beatrice and John Lacey (1984), Van Nostrand Reinhold, New York 276-294
17. Critchley H.D., Corfield D.R., Chandler M.P., Mathias C.J., and Dolan R.J. Cerebral correlates of autonomic cardiovascular arousal: A functional neuroimaging investigation in humans. Journal of Physiology 523 (2000) 259-270
18. Critchley H.D., Rotshtein P., Nagai Y., O'Doherty J., Mathias C.J., and Dolan R.J. Activity in the human brain predicting differential heart rate responses to emotional facial expressions. NeuroImage 24 (2005) 751-762
19. Detenber B.H., and Simons R.F. Roll' em!: The effects of picture motion on emotional responses. Journal of Broadcasting and Electronic Media 42 1 (1998) 113-128
20. De Wied M., van Boxtel A., Zaalberg R., Goudena P.P., and Matthys W. Facial EMG responses to dynamic emotional facial expressions in boys with disruptive behavior disorders. Journal of Psychiatric Research 40 (2006) 112-121
21. Dimberg U. Facial reactions to facial expressions. Psychophysiology 19 (1982) 643-647
22. Dimberg U., Fredrikson M., and Lundquist O. Autonomic reactions to social and neutral stimuli in subjects high and low in public speaking fear. Biological Psychology 23 (1986) 223-233
23. Dimberg U., Thunberg M., and Elmehed K. Unconscious facial reactions to emotional facial expressions. Psychological Science 11 (2000) 86-89
24. Eisenberg N., Fabes R.A., Bustamante D., Mathy R.M., Miller P.A., and Lindholm E. Differentiation of vicariously induced emotional reactions in children. Developmental Psychology 24 (1988) 237-246
25. Ekman P. An argument for basic emotions. Cognition and Emotion 6 (1992) 169-200
26. Ekman P., and Friesen W. Facial action coding system: A technique for the measurement of facial movement (1978), Consulting Psychologists Press, Palo Alto, CA
27. Ekman P., Levenson R.W., and Friesen W.V. Autonomic nervous system activity distinguishes among emotions. Science 221 (1983) 1208-1209
28. Ellis R.J., and Simons R.F. The impact of music on subjective and physiological measures of emotion while viewing films. Psychomusicology 19 (2005) 15-40
29. Erwin R.J., Gur R.C., Gur R.E., Skolnick B., Mawhinney-Hee M., and Smailis J. Facial emotion discrimination: I. Task construction and behavioral findings in normal subjects. Psychiatry Research 42 (1992) 231-240
30. Frazier T.W., Strauss M.E., and Steinhauer S.R. Respiratory sinus arrhythmia as an index of emotional response in young adults. Psychophysiology 41 (2004) 75-83
31. Fredrickson B.L., Manusco R.A., Branigan C., and Tugade M.M. The undoing effect of positive emotions. Motivation and Emotion 24 (2000) 237-258
32. Fridlund A. Human facial expression: An evolutionary view (1994), Academic Press, San Diego, CA
33. Frijda N.H. The understanding of facial expression of emotion. Acta Psychologica 9 (1953) 294-362
34. Frijda N.H. The emotions (1986), Cambridge University Press, Cambridge, MA
35. Gomez P., and Danuser B. Affective and physiological responses to environmental noises and music. International Journal of Psychophysiology 53 (2004) 91-103
36. Gross J.J., and Levenson R.W. Emotion elicitation using films. Cognition and Emotion 9 1 (1995) 87-108
37. Gross J.J., and Levenson R.W. Hiding feelings: The acute effects of inhibiting negative and positive emotion. Journal of Abnormal Psychology 10 1 (1997) 95-103
38. Hall G.B.C., Witelson S.F., Szechtman H., and Nahmias C. Sex differences in functional activation patterns revealed by increased emotion processing demands. NeuroReport 15 (2004) 219-223
39. Hall J.A. Gender effects in decoding nonverbal cues. Psychological Bulletin 85 (1978) 845-857
40. Hare R., Wood K., Britain S., and Shadman J. Autonomic responses to affective visual stimulation. Psychophysiology 7 (1971) 408-417
41. Hariri A.R., Tessitore A., Mattay V.S., Fera F., and Weinberger D.R. The amygdala response to emotional stimuli: A comparison of faces and scenes. NeuroImage 17 (2002) 317-323
42. Harwood N.K., Hall L.J., and Shinkfield A.J. Recognition of facial emotional expressions from moving and static displays by individuals with mental retardation. American Journal of Mental Retardation 104 (1999) 270-278
43. Hatfield E., Cacioppo J.T., and Rapson R.L. Emotional contagion (1994), Cambridge University Press, Cambridge, MA
44. Hubert W., and de Jong-Meyer R. Autonomic, neuroendocrine, and subjective responses to emotion-inducing film stimuli. International Journal of Psychophysiology 11 (1991) 131-140
45. Humphreys G.W., Donnelly N., and Riddoch M.J. Expression is computed separately for moving and static faces: Neuropsychological evidence. Neuropsychologia 31 (1993) 173-181
46. Isen A.M. The influence of positive and negative affect on cognitive organization: Some implications for development. In: Stein N., Leventhal B., and Trabasso T. (Eds). Psychological and biological approaches to emotion (1990), Erlbaum, Hillsdale, NJ 75-94
47. Johnsen B.H., Thayer J.F., and Hugdahl K. Affective judgment of the Ekman faces: A dimensional approach. Journal of Psychophysiology 9 (1995) 193-202
48. Kamachi M., Bruce V., Mukaida S., Gyoba J., Yoshikawa S., and Akamatsu S. Dynamic properties influence the perception of facial expressions. Perception 30 (2001) 875-887
49. Kilts C.D., Egan G., Gideon D.A., Ely T.D., and Hoffman J.M. Dissociable neural pathways are involved in the recognition of emotion in static and dynamic facial expressions. NeuroImage 18 (2003) 156-168
50. Kim K.H., Bang S.W., and Kim S.R. Emotion recognition system using short-term monitoring of physiological signals. Medical and Biological Engineering and Computing 42 (2004) 419-427
51. Kreibig S.D., Wilhelm F.H., Roth W.T., and Gross J.J. Cardiovascular, electrodermal, and respiratory response patterns to fear- and sadness-inducing films. Psychophysiology 44 (2007) 787-806
52. Kuniecki M., Urbanik A., Sobiecka B., Kozub J., and Binder M. Central control of heart rate changes during visual affective processing as revealed by fMRI. Acta Neurobiologiae Experimentalis 63 (2003) 39-48
53. Kunzmann U., and Grühn D. Age differences in emotional reactivity: The sample case of sadness. Psychology and Aging 20 (2005) 47-59
54. Kätsyri J. Human recognition of basic emotions from posed and animated dynamic facial expressions (2006) A Dissertation from Helsinki University of Technology Laboratory of Computational Engineering, Report B59
55. LaBar K.S., Crupain M.J., Voyvodic J.T., and McCarthy G. Dynamic perception of facial affect and identity in the human brain. Cerebral Cortex 13 (2003) 1023-1033
56. Lacey B.C., and Lacey J.I. Studies of heart rate and other bodily processes in sensorimotor behavior. In: Obrist P., Black A.H., Brener J., and DiCara L. (Eds). Cardiovascular psychophysiology: Current issues in response mechanisms, biofeedback, and methodology (1974), Aldine, Chicago 538-564
57. Lang P.J., Bradley M.M., and Cuthbert B.N. Emotion, attention, and the startle reflex. Psychological Review 97 (1990) 377-395
58. Lang P.J., Bradley M.M., and Cuthbert B.N. A motivational analysis of emotion: Reflex-cortex connections. Psychological Science 3 1 (1992) 44-49
59. Lang P.J., Bradley M.M., and Cuthbert B.N. Motivated attention: Affect, activation, and action. In: Lang P.J., Simons R.F., and Balaban M. (Eds). Attention and orienting - Sensory and motivational processes (1997), Erlbaum, Mahwah, NJ 97-135
60. Lang P.J., Bradley M.M., and Cuthbert B.N. International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Technical Report A-6 (2005), University of Florida, Gainesville, FL
61. Lang P.J., Greenwald M.K., Bradley M.M., and Hamm A.O. Looking at pictures: Affective, facial, visceral, and behavioral reactions. Psychophysiology 30 (1993) 261-273
62. Lee T.M.C., Liu H., Hoosain R., Liao W., Wu C., Yuen K.S.L., et al. Gender differences in neural correlates of recognition of happy and sad faces in humans assessed by functional magnetic resonance imaging. Neuroscience Letters 333 (2002) 13-16
63. Levenson R.W. Emotion and the autonomic nervous system: A prospectus for research on autonomic specificity. In: Wagner H.L. (Ed). Social psychophysiology and emotion: Theory and clinical applications (1988), Wiley, New York 17-42
64. Levenson R.W., Ekman P., and Friesen W.V. Voluntary facial action generates emotion-specific autonomic nervous system activity. Psychophysiology 27 (1990) 363-384
65. McClure E.B. A meta-analytic review of sex differences in facial expression processing and their development in infants, children, and adolescents. Psychological Bulletin 126 (2000) 424-453
66. Montagne B., Kesseks R.P.C., Frigerio E., de Haan E.H.F., and Perrett D.I. Sex differences in the perception of affective facial expressions: Do men really lack emotional sensitivity. Cognitive Processing 6 (2005) 136-141
67. Nasoz F., Alvarez K., Lisetti C.L., and Finkelstein N. Emotion recognition from physiological signals using wireless sensors for presence technologies. Cognition, Technology, and Work 6 1 (2004) 4-14
68. Natale M., Gur R.E., and Gur R.C. Hemispheric asymmetries in processing emotional expressions. Neuropsychologia 21 (1983) 555-565
69. Paajanen M., Lekkala J., and Kirjavainen K. Electromechanical Film (EMFi) - A new multipurpose electret material. Sensors and Actuators 84 (2000) 95-102
70. Palomba D., Sarlo M., Angrilli A., Mini A., and Stegagno L. Cardiac responses associated with affective processing of unpleasant film stimuli. International Journal of Psychophysiology 36 (2000) 45-57
71. Palomba D., and Stegagno L. Physiology, perceived emotion, and memory: Responding to film sequences. In: Birbaumer N., and Öhman A. (Eds). The structure of emotions (1993), Hogrefe & Huber, Toronto 156-168
72. Partala T., and Surakka V. The effects of affective interventions in human-computer interaction. Interacting with Computers 16 (2004) 295-309
73. Partala T., Surakka V., and Vanhala T. Real-time estimation of emotional experiences from facial expressions. Interacting with Computers 18 (2006) 208-226
74. Picard R. Affective computing (1997), MIT Press, Cambridge, MA
75. Picard R.W., Vyzas E., and Healey J. Toward machine emotional intelligence: Analysis of affective physiological state. IEEE Transactions on Pattern Analysis and Machine Intelligence 23 (2001) 1175-1190
76. Rahman Q., Wilson G.D., and Abrahams S. Sex, sexual orientation, and identification of positive and negative facial affect. Brain and Cognition 54 (2004) 179-185
77. Reeves B., and Nass C. The media equation: How people treat computers, television, and new media like real people and places (1996), Cambridge University Press, New York
78. Rotter N.G., and Rotter G.S. Sex differences in the encoding and decoding of negative facial emotions. Journal of Nonverbal Behavior 12 (1988) 139-148
79. Sato W., Kochiyama T., Yoshikawa S., Naito E., and Matsumura M. Enhanced neural activity in response to dynamic facial expressions of emotion: An fMRI study. Cognitive Brain Research 20 (2004) 81-91
80. Sato W., and Yoshikawa S. Enhanced experience of emotional arousal in response to dynamic facial expressions. Journal of Nonverbal Behavior 31 (2007) 119-135
81. Simons R.F., Detenber B.H., Redema T.M., and Reiss J.E. Emotion processing in three systems: The medium and the message. Psychophysiology 36 (1999) 619-627
82. Simons R.F., Detenber B.H., Reiss J.E., and Shults C.W. Image motion and context: A between- and within-subjects comparison. Psychophysiology 37 (2000) 706-710
83. Sloan D.M. Emotion regulation in action: Emotional reactivity in experimental avoidance. Behavior Research and Therapy 42 (2004) 1257-1270
84. Surakka V., and Hietanen J. Facial and emotional reactions to Duchenne and non-Duchenne smiles. International Journal of Psychophysiology 29 (1998) 23-33
85. Tsai J.L., Levenson R.W., and Carstensen L.L. Autonomic, subjective, and expressive responses to emotional films in older and younger Chinese Americans and European Americans. Psychology and Aging 15 (2000) 684-693
86. Turk M., and Robertson G. Perceptual user interfaces (introduction). Communications of the ACM 43 (2000) 32-34
87. Vrana S.R., and Gross D. Reactions to facial expressions: Effects of social context and speech anxiety on responses to neutral, anger, and joy expressions. Biological Psychology 66 (2004) 63-78
88. Waldstein S., Kop W., Schmidt L., Haufler A., Krantz D., and Fox N. Frontal electrocortical and cardiovascular reactivity during happiness and anger. Biological Psychology 55 (2000) 3-23
89. Wehrle T., Kaiser S., Schmidt S., and Scherer K.R. Studying the dynamics of emotional expression using synthesized facial muscle movements. Journal of Personality and Social Psychology 78 (2000) 105-119
90. Weyers P., Muhlberger A., Hefele C., and Pauli P. Electromyographic responses to static and dynamic avatar emotional facial expressions. Psychophysiology 43 (2006) 450-453
91. Wild B., Erb M., and Bartels M. Are emotions contagious? Evoked emotions while viewing emotionally expressive faces: Quality, quantity, time course, and gender differences. Psychiatry Research 102 (2001) 109-124
92. Winton W.M., Putnam L.E., and Krauss R.M. Facial and autonomic manifestations of the dimensional structure of emotion. Journal of Experimental Social Psychology 20 (1984) 195-216
93. Witvliet C., and Vrana S.R. Psychophysiological responses as indices of affective dimensions. Psychophysiology 32 (1995) 436-443