The body action coding system II: Muscle activations during the perception and expression of emotion

Frontiers in Behavioral Neuroscience

Volumn 8, Issue , 2014, Pages

  Huis In‘t Veld, Elisabeth M J ^a   van Boxtel, Geert J M ^a   de Gelder, Beatrice ^a,b  

^a TILBURG UNIVERSITY   (Netherlands)

^b MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

Body; Coding; Emotion; Expression; Movement; Muscles; Perception; Surface EMG

Indexed keywords

ADULT; ANGER; ARTICLE; BACK; BODY ACTION CODING SYSTEM II; BODY MOVEMENT; CONTROLLED STUDY; ELECTROMYOGRAPHY; EMOTION; ERECTOR SPINAE LONGISSIMUS MUSCLE; EXTENSOR CARPI ULNARIS MUSCLE; FEAR; FEMALE; FOREARM; GESTURE; HUMAN; HUMAN EXPERIMENT; MALE; MUSCLE CONTRACTION; MUSCULOSKELETAL SYSTEM PARAMETERS; NECK; NORMAL HUMAN; PERONEUS LONGUS MUSCLE; SKELETAL MUSCLE; UPPER TRAPEZIUS DESCENDENS MUSCLE;

EID: 84907286896     PISSN: 16625153     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnbeh.2014.00330     Document Type: Article

References (78)

1. Aung, M. S. H., Romera-Paredes, B., Singh, A., Lim, S., Kanakam, N., De Williams, A. C., et al. (2013). “Getting RID of pain-related behaviour to improve social and self perception: a technology-based perspective,” in 14th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS) (Paris: IEEE), 1-4. doi: 10.1109/WIAMIS.2013.6616167
2. Azevedo, T. M., Volchan, E., Imbiriba, L. A., Rodrigues, E. C., Oliveira, J. M., Oliveira, L. F., et al. (2005). A freezing-like posture to pictures of mutilation. Psychophysiology 42, 255-260. doi: 10.1111/j.1469-8986.2005.00287.x
3. Bagiella, E., Sloan, R. P., and Heitjan, D. F. (2000). Mixed-effects models in psychophysiology. Psychophysiology 37, 13-20. doi: 10.1111/1469-8986.3710013
4. Bien, N., Roebroeck, A., Goebel, R., and Sack, A. T. (2009). The brain’s intention to imitate: the neurobiology of intentional versus automatic imitation. Cereb. Cortex 19, 2338-2351. doi: 10.1093/cercor/bhn251
5. Bons, D., Van Den Broek, E., Scheepers, F., Herpers, P., Rommelse, N., and Buitelaaar, J. K. (2013). Motor, emotional, and cognitive empathy in children and adolescents with autism spectrum disorder and conduct disorder. J. Abnorm. Child Psychol. 41, 425-443. doi: 10.1007/s10802-012-9689-5
6. Borgomaneri, S., Gazzola, V., and Avenanti, A. (2012). Motor mapping of implied actions during perception of emotional body language. Brain Stimul. 5, 70-76. doi: 10.1016/j.brs.2012.03.011
7. Bosco, G. (2010). Principal component analysis of electromyographic signals: an overview. Open Rehabil. J. 3, 127-131. doi: 10.2174/1874943701003010127
8. Bradley, M. M., and Lang, P. J. (2000). Affective reactions to acoustic stimuli. Psychophysiology 37, 204-215. doi: 10.1111/1469-8986.3720204
9. Calvo, R. A., and D’mello, S. (2010). Affect detection: an interdisciplinary review of models, methods, and their applications. IEEE Trans. Affect. Comput. 1, 18-37. doi: 10.1109/T-AFFC.2010.1
10. Castellano, G., Leite, I., Pereira, A., Martinho, C., Paiva, A., and McOwan, P. W. (2013). Multimodal affect modeling and recognition for empathic robot companions. Int. J. Hum. Robot. 10:1350010. doi: 10.1142/S0219843613500102
11. Chen, M., and Bargh, J. A. (1999). Consequences of automatic evaluation: immediate behavioral predispositions to approach or avoid the stimulus. Pers. Soc. Psychol. B 25, 215-224. doi: 10.1177/0146167299025002007
12. Coombes, S. A., Cauraugh, J. H., and Janelle, C. M. (2006). Emotion and movement: activation of defensive circuitry alters the magnitude of a sustained muscle contraction. Neurosci. Lett. 396, 192-196. doi: 10.1016/j.neulet.2005.11.048
13. Coombes, S. A., Tandonnet, C., Fujiyama, H., Janelle, C. M., Cauraugh, J. H., and Summers, J. J. (2009). Emotion and motor preparation: a transcranial magnetic stimulation study of corticospinal motor tract excitability. Cogn. Affect. Behav. Neurosci. 9, 380-388. doi: 10.3758/CABN.9.4.380
14. Coulson, M. (2004). Attributing emotion to static body postures: recognition accuracy, confusions, and viewpoint dependence. J. Nonverbal Behav. 28, 117-139. doi: 10.1023/B:JONB.0000023655.25550.be
15. Dael, N., Mortillaro, M., and Scherer, K. R. (2012a). The body action and posture coding system (BAP): development and reliability. J. Nonverbal Behav. 36, 97-121. doi: 10.1007/s10919-012-0130-0
16. Dael, N., Mortillaro, M., and Scherer, K. R. (2012b). Emotion expression in body action and posture. Emotion 12, 1085-1101. doi: 10.1037/a0025737
17. de Gelder, B. (2009). Why bodies? Twelve reasons for including bodily expressions in affective neuroscience. Philos. Trans. R. Soc. Lond. B Biol. Sci. 364, 3475-3484. doi: 10.1098/rstb.2009.0190
18. de Gelder, B. (2013). “From body perception to action preparation: a distributed neural system for viewing bodily expressions of emotion,” in People Watching: Social, Perceptual, and Neurophysiological Studies of Body Perception, eds M. Shiffrar and K. Johnson (New York, NY: Oxford University Press), 350-368.
19. de Gelder, B., Snyder, J., Greve, D., Gerard, G., and Hadjikhani, N. (2004). Fear fosters flight: a mechanism for fear contagion when perceiving emotion expressed by a whole body. Proc. Natl. Acad. Sci. U.S.A. 101, 16701-16706. doi: 10.1073/pnas.0407042101
20. De Meijer, M. (1989). The contribution of general features of body movement to the attribution of emotions. J. Nonverbal Behav. 13, 247-268. doi:10.1007/BF00990296
21. Deschamps, P., Munsters, N., Kenemans, L., Schutter, D., and Matthys, W. (2014). Facial mimicry in 6-7 year old children with disruptive behavior disorder and ADHD. PLoS ONE 9:e84965. doi: 10.1371/journal.pone.0084965
22. Dimberg, U. (1982). Facial reactions to facial expressions. Psychophysiology 19, 643-647. doi: 10.1111/j.1469-8986.1982.tb02516.x
23. Dimberg, U. (1990). Facial electromyography and emotional reactions. Psychophysiology 27, 481-494. doi: 10.1111/j.1469-8986.1990.tb01962.x
24. Eerland, A., Guadalupe, T. M., Franken, I. H. A., and Zwaan, R. A. (2012). Posture as index for approach-avoidance behavior. PLoS ONE 7:e31291. doi:10.1371/journal.pone.0031291
25. Ekman, P., and Friesen, W. V. (1978). Facial Action Coding System (FACS): A Technique for the Measurement of Facial Action. Palo Alto, CA: Consulting Psychologists Press.
26. Facchinetti, L. D., Imbiriba, L. A., Azevedo, T. M., Vargas, C. D., and Volchan, E. (2006). Postural modulation induced by pictures depicting prosocial or dangerous contexts. Neurosci. Lett. 410, 52-56. doi: 10.1016/j.neulet.2006.09.063
27. Fadiga, L., Craighero, L., and Olivier, E. (2005). Human motor cortex excitability during the perception of others’ action. Curr. Opin. Neurobiol. 15, 213-218. doi:10.1016/j.conb.2005.03.013
28. Frijda, N. H. (2010). Impulsive action and motivation. Biol. Psychol. 84, 570-579. doi: 10.1016/j.biopsycho.2010.01.005
29. Gao, Y., Bianchi-Berthouze, N., and Meng, H. Y. (2012). What does touch tell us about emotions in touchscreen-based gameplay? ACM Trans. Comput. Hum. Int. 19:31. doi: 10.1145/2395131.2395138
30. Geisser, M. E., Haig, A. J., Wallbom, A. S., and Wiggert, E. A. (2004). Painrelated fear, lumbar flexion, and dynamic EMG among persons with chronic musculoskeletal low back pain. Clin. J. Pain 20, 61-69. doi: 10.1097/00002508-200403000-00001
31. Grezes, J., Philip, L., Chadwick, M., Dezecache, G., Soussignan, R., and Conty, L. (2013). Self-relevance appraisal influences facial reactions to emotional body expressions. PLoS ONE 8:e55885. doi: 10.1371/journal.pone.0055885
32. Grezes, J., Pichon, S., and de Gelder, B. (2007). Perceiving fear in dynamic body expressions. Neuroimage 35, 959-967. doi: 10.1016/j.neuroimage.2006.11.030
33. Hermens, H. J., and Freriks, B. (eds.). (1997). The State of the Art on Sensors and Sensor Placement Procedures for Surface Electromyography: A Proposal for Sensor Placement Procedures. Enschede: Roessingh Research and Development.
34. Hess, U., and Fischer, A. (2013). Emotional mimicry as social regulation. Pers. Soc. Psychol. Rev. 17, 142-157. doi: 10.1177/1088868312472607
35. Hietanen, J. K., Surakka, V., and Linnankoski, I. (1998). Facial electromyographic responses to vocal affect expressions. Psychophysiology 35, 530-536. doi: 10.1017/S0048577298970445
36. Horslen, B. C., and Carpenter, M. G. (2011). Arousal, valence and their relative effects on postural control. Exp. Brain Res. 215, 27-34. doi: 10.1007/s00221-011-2867-9
37. Huis In‘t Veld, Van Boxtel, G. J. M., and de Gelder, B. (2014). The body action coding system I: muscle activations during the perception and expression of emotion. Soc. Neurosci. 9, 249-264. doi: 10.1080/17470919.2014.890668
38. Jack, R. E., Garrod, O. G. B., Yu, H., Caldara, R., and Schyns, P. G. (2012). Facial expressions of emotions are not culturally universal. Proc. Natl. Acad. Sci. U.S.A. 109, 7241-7244. doi: 10.1073/pnas.1200155109
39. Karg, M., Samadani, A. A., Gorbet, R., Kuhnlenz, K., Hoey, J., and Kulic, D. (2013). Body movements for affective expression: a survey of automatic recognition and generation. IEEE Trans. Affect. Comput. 4, 341-U157. doi: 10.1109/TAFFC.2013.29
40. Kellis, E., Arabatzi, F., and Papadopoulos, C. (2003). Muscle co-activation around the knee in drop jumping using the co-contraction index. J. Electromyogr. Kinesiol. 13, 229-238. doi: 10.1016/S1050-6411(03)00020-8
41. Kessous, L., Castellano, G., and Caridakis, G. (2010). Multimodal emotion recognition in speech-based interaction using facial expression, body gesture and acoustic analysis. J. Multimodal User Inerface 3, 33-48. doi: 10.1007/s12193-009-0025-5
42. Kleinsmith, A., and Bianchi-Berthouze, N. (2013). Affective body expression perception and recognition: a survey. IEEE Trans. Affect. Comput. 4, 15-33. doi: 10.1109/T-AFFC.2012.16
43. Kleinsmith, A., Bianchi-Berthouze, N., and Steed, A. (2011). Automatic recognition of non-acted affective postures. IEEE Trans. Syst. Man Cybern. B Cybern. 41, 1027-1038. doi: 10.1109/TSMCB.2010.2103557
44. Kleinsmith, A., De Silva, P. R., and Bianchi-Berthouze, N. (2006). Cross-cultural differences in recognizing affect from body posture. Interact. Comput. 18, 1371-1389. doi: 10.1016/j.intcom.2006.04.003
45. Kraskov, A., Dancause, N., Quallo, M. M., Shepherd, S., and Lemon, R. N. (2009). Corticospinal neurons in macaque ventral premotor cortex with mirror properties: a potential mechanism for action suppression? Neuron 64, 922-930. doi: 10.1016/j.neuron.2009.12.010
46. Kret, M. E., Pichon, S., Grezes, J., and de Gelder, B. (2011). Similarities and differences in perceiving threat from dynamic faces and bodies. An fMRI study. Neuroimage 54, 1755-1762. doi: 10.1016/j.neuroimage.2010.08.012
47. Kret, M. E., Stekelenburg, J., Roelofs, K., and de Gelder, B. (2013). Perception of face and body expressions using electromyography, pupillometry and gaze measures. Front. Psychol. 4:28. doi: 10.3389/fpsyg.2013.00028
48. Lelard, T., Montalan, B., Morel, M. F., Krystkowiak, P., Ahmaidi, S., Godefroy, O., et al. (2013). Postural correlates with painful situations. Front. Hum. Neurosci. 7:4. doi: 10.3389/fnhum.2013.00004
49. Magnee, M. J. C. M., Stekelenburg, J. J., Kemner, C., and de Gelder, B. (2007). Similar facial electromyographic responses to faces, voices, and body expressions. Neuroreport 18, 369-372. doi: 10.1097/WNR.0b013e32801776e6
50. Mak, J. N., Hu, Y., and Luk, K. D. (2010). An automated ECG-artifact removal method for trunk muscle surface EMG recordings. Med. Eng. Phys. 32, 840-848. doi: 10.1016/j.medengphy.2010.05.007
51. Marsh, A. A., Ambady, N., and Kleck, R. E. (2005). The effects of fear and anger facial expressions on approachand avoidance-related behaviors. Emotion 5, 119-124. doi: 10.1037/1528-3542.5.1.119
52. Matzke, B., Herpertz, S. C., Berger, C., Fleischer, M., and Domes, G. (2014). Facial reactions during emotion recognition in borderline personality disorder: a facial electromyography study. Psychopathology 47, 101-110. doi: 10.1159/000351122
53. Mayer, R. E., and Dapra, C. S. (2012). An embodiment effect in computer-based learning with animated pedagogical agents. J. Exp. Psychol. Appl. 18, 239-252. doi: 10.1037/a0028616
54. Mccoll, D., and Nejat, G. (2014). Recognizing rmotional body language displayed by a human-like social robot. Int. J. Soc. Robot. 6, 261-280. doi: 10.1007/s12369-013-0226-7
55. Mukamel, R., Ekstrom, A. D., Kaplan, J., Iacoboni, M., and Fried, I. (2010). Singleneuron responses in humans during execution and observation of actions. Curr. Biol. 20, 750-756. doi: 10.1016/j.cub.2010.02.045
56. Nguyen, A., Chen, W., and Rauterberg, G. W. M. (2013). “Online feedback system for public speakers,” in IEEE Symposium on E-Learning, E-Management and E-Services (IS3e): Piscataway, NY: IEEE Service Center, 1-5.
57. Pichon, S., de Gelder, B., and Grezes, J. (2008). Emotional modulation of visual and motor areas by dynamic body expressions of anger. Soc. Neurosci. 3, 199-212. doi: 10.1080/17470910701394368
58. Pichon, S., de Gelder, B., and Grezes, J. (2009). Two different faces of threat. Comparing the neural systems for recognizing fear and anger in dynamic body expressions. Neuroimage 47, 1873-1883. doi: 10.1016/j.neuroimage.2009.03.084
59. Pichon, S., de Gelder, B., and Grezes, J. (2012). Threat prompts defensive brain responses independently of attentional control. Cereb. Cortex 22, 274-285. doi: 10.1093/cercor/bhr060
60. Roelofs, K., Hagenaars, M. A., and Stins, J. (2010). Facing freeze: social threat induces bodily freeze in humans. Psychol. Sci. 21, 1575-1581. doi: 10.1177/0956797610384746
61. Rozga, A., King, T. Z., Vuduc, R. W., and Robins, D. L. (2013). Undifferentiated facial electromyography responses to dynamic, audio-visual emotion displays in individuals with autism spectrum disorders. Dev. Sci. 16, 499-514. doi: 10.1111/desc.12062
62. Savva, N., and Bianchi-Berthouze, N. (2012). “Automatic recognition of affective body movement in a video game scenario,” in International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN), eds A. Camurri, C. Costa, and G. Volpe (Genoa: Springer), 149-158.
63. Sawada, M., Suda, K., and Ishii, M. (2003). Expression of emotions in dance: relation between arm movement characteristics and emotion. Percept. Mot. Skills 97, 697-708. doi: 10.2466/pms.2003.97.3.697
64. Schutter, D. J., Hofman, D., and van Honk, J. (2008). Fearful faces selectively increase corticospinal motor tract excitability: a transcranial magnetic stimulation study. Psychophysiology 45, 345-348. doi: 10.1111/j.1469-8986.2007.00635.x
65. Sestito, M., Umilta, M. A., De Paola, G., Fortunati, R., Raballo, A., Leuci, E., et al. (2013). Facial reactions in response to dynamic emotional stimuli indifferent modalities in patients suffering from schizophrenia: a behavioral and EMG study. Front. Hum. Neurosci. 7:368. doi: 10.3389/fnhum.2013.00368
66. Stamos, A. V., Savaki, H. E., and Raos, V. (2010). The spinal substrate of the suppression of action during action observation. J. Neurosci. 30, 11605-11611. doi:10.1523/JNEUROSCI.2067-10.2010
67. Stins, J. F., Roelofs, K., Villan, J., Kooijman, K., Hagenaars, M. A., and Beek, P. J. (2011). Walk to me when I smile, step back when I’m angry: emotional faces modulate whole-body approach-avoidance behaviors. Exp. Brain Res. 212, 603-611. doi: 10.1007/s00221-011-2767-z
68. Taelman, J., Mijovic, B., Van Huffel, S., Devuyst, S., and Dutoit, T. (2011). “ECG artifact removal from surface EMG signals by combining empirical mode decomposition and independent component analysis,” in International Conference on Bio-inspired Systems and Signal Processing (Rome), 421-424.
69. Tamietto, M., Castelli, L., Vighetti, S., Perozzo, P., Geminiani, G., Weiskrantz, L., et al. (2009). Unseen facial and bodily expressions trigger fast emotional reactions. Proc. Natl. Acad. Sci. U.S.A. 106, 17661-17666. doi: 10.1073/pnas.0908994106
70. Tamietto, M., Geminiani, G., Genero, R., and de Gelder, B. (2007). Seeing fearful body language overcomes attentional deficits in patients with neglect. J. Cogn. Neurosci. 19, 445-454. doi: 10.1162/jocn.2007.19.3.445
71. van der Hulst, M., Vollenbroek-Hutton, M. M., Reitman, J. S., Schaake, L., Groothuis-Oudshoorn, K. G., and Hermens, H. J. (2010). Back muscle activation patterns in chronic low back pain during walking: a “guarding” hypothesis. Clin. J. Pain 26, 30-37. doi: 10.1097/AJP.0b013e3181b40eca
72. Velloso, E., Bulling, A., and Gellersen, H. (2013). “AutoBAP: automatic coding of body action and posture units from wearable sensors,” in Humaine Association Conference on Affective Computing and Intelligent Interaction: IEEE Computer Society (Los Alamitos, CA), 135-140.
73. Vigneswaran, G., Philipp, R., Lemon, R. N., and Kraskov, A. (2013). M1 corticospinal mirror neurons and theirole in movement suppression during action observation. Curr. Biol. 23, 236-243. doi: 10.1016/j.cub.2012.12.006
74. Wallbott, H. G. (1998). Bodily expressions of emotion. Eur. J. Soc. Psychol. 28, 879-896.
75. Watson, P. J., Booker, C. K., and Main, C. J. (1997). Evidence for the role of psychological factors in abnormal paraspinal activity in patients with chronic low back pain. J. Musculoskelet. Pain 5, 41-56. doi: 10.1300/J094v05n04_05
76. Wieser, M. J., and Brosch, T. (2012). Faces in context: a review and systematization of contextual influences on affective face processing. Front. Psychol. 3:471. doi:10.3389/fpsyg.2012.00471
77. Zacharatos, H. (2013). “Affect recognition during active game playing based on posture skeleton data,” in 8th International Conference on Computer Graphicsb Theory and Applications (Barcelona).
78. Zeng, Z., Pantic, M., Roisman, G. I., and Huang, T. S. (2009). A survey of affect recognition methods: audio, visual, and spontaneous expressions. IEEE Trans. Pattern Anal. Mach. Intell. 31, 39-58. doi: 10.1109/TPAMI.2008.52