The Body Action Coding System I: Muscle activations during the perception and expression of emotion

Social Neuroscience

Volumn 9, Issue 3, 2014, Pages 249-264

  Huis in 't Veld, Elisabeth M J ^a   Van Boxtel, Geert J M ^a   de Gelder, Beatrice ^a,b  

^a TILBURG UNIVERSITY   (Netherlands)

^b MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

Body; Emotion; Expression; Muscles; Perception; Surface EMG

Indexed keywords

ADOLESCENT; ADULT; ANGER; ARM; ARTICLE; BODY POSTURE; EMOTION; FEAR; FEMALE; HUMAN; IMITATION; MALE; PATTERN RECOGNITION; PHOTOSTIMULATION; PHYSIOLOGY; SHOULDER; SKELETAL MUSCLE; YOUNG ADULT;

ADOLESCENT; ADULT; ANGER; ARM; EMOTIONS; FEAR; FEMALE; HUMANS; IMITATIVE BEHAVIOR; MALE; MUSCLE, SKELETAL; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; POSTURE; SHOULDER; YOUNG ADULT;

EID: 84897031138     PISSN: 17470919     EISSN: 17470927     Source Type: Journal    
DOI: 10.1080/17470919.2014.890668     Document Type: Article

References (88)

1. Akaike, N., Ohno, T., & Tsubokawa, H. (1989). EMG activities of neck muscles underlying lateral flexion of the neck during head turning induced by electrical stimulation of the caudate nucleus in cats. Neuroscience Research, 6, 397-410. doi:10.1016/0168-0102(89)90002-3
2. Avenanti, A., Minio-Paluello, I., Sforza, A., & Aglioti, S. M. (2009). Freezing or escaping? Opposite modulations of empathic reactivity to the pain of others. Cortex, 45, 1072-1077. doi:10.1016/j.cortex.2008.10.004
3. Azevedo, T. M., Volchan, E., Imbiriba, L. A., Rodrigues, E. C., Oliveira, J. M., Oliveira, L. F., Vargas C. D. (2005). A freezing-like posture to pictures of mutilation. Psychophysiology, 42, 255-260. doi:10.1111/j.1469-8986.2005.00287.x
4. Bagiella, E., Sloan, R. P., & Heitjan, D. F. (2000). Mixed-effects models in psychophysiology. Psychophysiology, 37, 13-20. doi:10.1111/1469-8986.3710013
5. Bakker, M. J., Tijssen, M. A. J., van der Meer, J. N., Koelman, J. H. T. M., & Boer, F. (2009). Increased whole-body auditory startle reflex and autonomic reactivity in children with anxiety disorders. Journal of Psychiatry & Neuroscience, 34, 314-322.
6. Baumgartner, T., Willi, M., & Jancke, L. (2007). Modulation of corticospinal activity by strong emotions evoked by pictures and classical music: A transcranial magnetic stimulation study. NeuroReport, 18, 261-265. doi:10.1097/WNR.0b013e328012272e
7. Bonnet, M., Bradley, M. M., Lang, P. J., & Requin, J. (1995). Modulation of spinal reflexes: Arousal, pleasure, action. Psychophysiology, 32, 367-372. doi:10.1111/j.1469-8986.1995.tb01219.x
8. Borgomaneri, S., Gazzola, V., & Avenanti, A. (2012). Motor mapping of implied actions during perception of emotional body language. Brain Stimulation, 5, 70-76. doi:10.1016/j.brs.2012.03.011
9. Borgomaneri, S., Gazzola, V., & Avenanti, A. (2013). Temporal dynamics of motor cortex excitability during perception of natural emotional scenes. Social Cognitive and Affective Neuroscience. doi:10.1093/scan/nst139
10. Both, S., Van Boxtel, G., Stekelenburg, J., Everaerd, W., & Laan, E. (2005). Modulation of spinal reflexes by sexual films of increasing intensity. Psychophysiology, 42, 726-731. doi:10.1111/j.1469-8986.2005.00364.x
11. Bradley, M. M., & Lang, P. J. (2000). Affective reactions to acoustic stimuli. Psychophysiology, 37, 204-215. doi:10.1111/1469-8986.3720204
12. Cacioppo, J. T., Priester, J. R., & Berntson, G. G. (1993). Rudimentary determinants of attitudes: II. Arm flexion and extension have differential effects on attitudes. Journal of Personality and Social Psychology, 65, 5-17. doi:10.1037/0022-3514.65.1.5
13. Carr, L., Iacoboni, M., Dubeau, M. C., Mazziotta, J. C., & Lenzi, G. L. (2003). Neural mechanisms of empathy in humans: A relay from neural systems for imitation to limbic areas. Proceedings of the National Academy of Sciences USA, 100, 5497-5502. doi:10.1073/pnas.0935845100
14. Chen, M., & Bargh, J. A. (1999). Consequences of automatic evaluation: Immediate behavioral predispositions to approach or avoid the stimulus. Personality and Social Psychology Bulletin, 25, 215-224. doi:10.1177/0146167299025002007
15. Coelho, C. M., Lipp, O. V., Marinovic, W., Wallis, G., & Riek, S. (2010). Increased corticospinal excitability induced by unpleasant visual stimuli. Neuroscience Letters, 481, 135-138. doi:10.1016/j.neulet.2010.03.027
16. Coombes, S. A., Cauraugh, J. H., & Janelle, C. M. (2006). Emotion and movement: Activation of defensive circuitry alters the magnitude of a sustained muscle contraction. Neuroscience Letters, 396, 192-196. doi:10.1016/j.neulet.2005.11.048
17. Coombes, S. A., Tandonnet, C., Fujiyama, H., Janelle, C. M., Cauraugh, J. H., & Summers, J. J. (2009). Emotion and motor preparation: A transcranial magnetic stimulation study of corticospinal motor tract excitability. Cognitive, Affective, & Behavioral Neuroscience, 9, 380-388. doi:10.3758/CABN.9.4.380
18. Corneil, B. D., Olivier, E., & Munoz, D. P. (2002). Neck muscle responses to stimulation of monkey superior colliculus. I. Topography and manipulation of stimulation parameters. Journal of Neurophysiology, 88, 1980-1999.
19. Dael, N., Mortillaro, M., & Scherer, K. R. (2012). The Body Action and Posture coding system (BAP): Development and reliability. Journal of Nonverbal Behavior, 36, 97-121. doi:10.1007/s10919-012-0130-0
20. Darwin, C. (1965). The expression of the emotions in man and animals. Chicago, IL: University of Chicago Press. (Original work published 1872.)
21. de Gelder, B. (2006). Towards the neurobiology of emotional body language. Nature Reviews Neuroscience, 7, 242-249. doi:10.1038/nrn1872
22. de Gelder, B. (2009). Why bodies? Twelve reasons for including bodily expressions in affective neuroscience. Philosophical Transactions of the Royal Society B: Biological Sciences, 364, 3475-3484. doi:10.1098/rstb.2009.0190
23. de Sèze, M. P., Rezzouk, J., de Sèze, M., Uzel, M., Lavignolle, B., Midy, D., & Durandeau, A. (2004). Does the motor branch of the long head of the triceps brachii arise from the radial nerve? An anatomic and electromyographic study. Surgical and Radiologic Anatomy, 26, 459-461. doi:10.1007/s00276-004-0253-z
24. de Wied, M., van Boxtel, A., Matthys, W., & Meeus, W. (2012). Verbal, facial and autonomic responses to empathy-eliciting film clips by disruptive male adolescents with high versus low callous-unemotional traits. Journal of Abnormal Child Psychology, 40, 211-223. doi:10.1007/s10802-011-9557-8
25. Dezecache, G., Conty, L., Chadwick, M., Philip, L., Soussignan, R., Sperber, D., & Grèzes, J. (2013). Evidence for unintentional emotional contagion beyond dyads. Plos One, 8, e67371. doi:10.1371/journal.pone.0067371
26. Dimberg, U., & Thunberg, M. (1998). Rapid facial reactions to emotional facial expressions. Scandinavian Journal of Psychology, 39, 39-45. doi:10.1111/1467-9450.00054
27. Dimberg, U., Thunberg, M., & Elmehed, K. (2000). Unconscious facial reactions to emotional facial expressions. Psychological Science, 11, 86-89. doi:10.1111/1467-9280.00221
28. Eerland, A., Guadalupe, T. M., Franken, I. H. A., & Zwaan, R. A. (2012). Posture as index for approach-avoidance behavior. Plos One, 7, e31291. doi:10.1371/journal.pone.0031291
29. Ekman, P., & Friesen, W. V. (1978). Facial Action Coding System (FACS): A technique for the measurement of facial action. Palo Alto, CA: Consulting Psychologists Press.
30. Enticott, P. G., Harrison, B. A., Arnold, S. L., Nibaldi, K., Segrave, R. A., Fitzgibbon, B. M., Fitzgerald P. B. (2012). Emotional valence modulates putative mirror neuron activity. Neuroscience Letters, 508, 56-59. doi:10.1016/j.neulet.2011.12.018
31. Facchinetti, L. D., Imbiriba, L. A., Azevedo, T. M., Vargas, C. D., & Volchan, E. (2006). Postural modulation induced by pictures depicting prosocial or dangerous contexts. Neuroscience Letters, 410, 52-56. doi:10.1016/j.neulet.2006.09.063
32. Fadiga, L., Craighero, L., & Olivier, E. (2005). Human motor cortex excitability during the perception of others' action. Current Opinion in Neurobiology, 15, 213-218. doi:10.1016/j.conb.2005.03.013
33. Giovannelli, F., Banfi, C., Borgheresi, A., Fiori, E., Innocenti, I., Rossi, S., Cincotta M. (2013). The effect of music on corticospinal excitability is related to the perceived emotion: A transcranial magnetic stimulation study. Cortex, 49, 702-710. doi:10.1016/j.cortex.2012.01.013
34. Grèzes, J., Philip, L., Chadwick, M., Dezecache, G., Soussignan, R., & Conty, L. (2013). Self-relevance appraisal influences facial reactions to emotional body expressions. Plos One, 8, e55885. doi:10.1371/journal.pone.0055885
35. Grèzes, J., Pichon, S., & de Gelder, B. (2007). Perceiving fear in dynamic body expressions. NeuroImage, 35, 959-967. doi:10.1016/j.neuroimage.2006.11.030
36. Hajcak, G., Molnar, C., George, M. S., Bolger, K., Koola, J., & Nahas, Z. (2007). Emotion facilitates action: A transcranial magnetic stimulation study of motor cortex excitability during picture viewing. Psychophysiology, 44, 91-97. doi:10.1111/j.1469-8986.2006.00487.x
37. Hardwick, R. M., McAllister, C. J., Holmes, P. S., & Edwards, M. G. (2012). Transcranial magnetic stimulation reveals modulation of corticospinal excitability when observing actions with the intention to imitate. European Journal of Neuroscience, 35, 1475-1480. doi:10.1111/j.1460-9568.2012.08046.x
38. Hennenlotter, A., Schroeder, U., Erhard, P., Castrop, F., Haslinger, B., Stoecker, D., Ceballos-Baumann A. (2005). A common neural basis for receptive and expressive communication of pleasant facial affect. NeuroImage, 26, 581-591. doi:10.1016/j.neuroimage.2005.01.057
39. Hermens, H. J., & Freriks, B. (1997). The state of the art on sensors and sensor placement procedures for surface electromyography: A proposal for sensor placement procedures. Deliverable of the SENIAM Project 1997. Enschede: Roessingh Research and Development.
40. Hietanen, J. K., Surakka, V., & Linnankoski, I. (1998). Facial electromyographic responses to vocal affect expressions. Psychophysiology, 35, 530-536. doi:10.1017/S0048577298970445
41. Hillman, C. H., Rosengren, K. S., & Smith, D. P. (2004). Emotion and motivated behavior: Postural adjustments to affective picture viewing. Biological Psychology, 66, 51-62. doi:10.1016/j.biopsycho.2003.07.005
42. Horslen, B. C., & Carpenter, M. G. (2011). Arousal, valence and their relative effects on postural control. Experimental Brain Research, 215, 27-34. doi:10.1007/s00221-011-2867-9
43. Johnson, G., Bogduk, N., Nowitzke, A., & House, D. (1994). Anatomy and actions of the trapezius muscle. Clinical Biomechanics, 9, 44-50. doi:10.1016/0268-0033(94)90057-4
44. Kleinsmith, A., & Bianchi-Berthouze, N. (2007). Recognizing affective dimensions from body posture. In A. R. Paiva, R. Prada, & R. Picard (Eds.), Affective computing and intelligent interaction (Vol. 4738, pp. 48-58). Berlin: Springer. doi:10.1007/978-3-540-74889-2_5
45. Kleinsmith, A., & Bianchi-Berthouze, N. (2013). Affective body expression perception and recognition: A survey. IEEE Transactions on Affective Computing, 4, 15-33. doi:10.1109/T-AFFC.2012.16
46. Komeilipoor, N., Pizzolato, F., Daffertshofer, A., & Cesari, P. (2013). Excitability of motor cortices as a function of emotional sounds. Plos One, 8, e63060. doi:10.1371/journal.pone.0063060
47. Krantz, G., Forsman, M., & Lundberg, U. (2004). Consistency in physiological stress responses and electromyographic activity during induced stress exposure in women and men. Integrative Physiological and Behavioral Science, 39, 105-118. doi:10.1007/BF02734276
48. Kret, M. E., Stekelenburg, J., Roelofs, K., & De Gelder, B. (2013). Perception of face and body expressions using electromyography, pupillometry and gaze measures. Frontiers in Psychology, 4, Article 28. doi:10.3389/fpsyg.2013.00028
49. Lee, T. W., Josephs, O., Dolan, R. J., & Critchley, H. D. (2006). Imitating expressions: Emotion-specific neural substrates in facial mimicry. Social Cognitive and Affective Neuroscience, 1, 122-135. doi:10.1093/scan/nsl012
50. Lelard, T., Montalan, B., Morel, M. F., Krystkowiak, P., Ahmaidi, S., Godefroy, O., & Mouras, H. (2013). Postural correlates with painful situations. Frontiers in Human Neuroscience, 7, Artn 4. doi:10.3389/fnhum.2013.00004
51. Leslie, K. R., Johnson-Frey, S. H., & Grafton, S. T. (2004). Functional imaging of face and hand imitation: Towards a motor theory of empathy. NeuroImage, 21, 601-607. doi:10.1016/j.neuroimage.2003.09.038
52. Liddell, B. J., Brown, K. J., Kemp, A. H., Barton, M. J., Das, P., Peduto, A., Williams L. M. (2005). A direct brainstem-amygdala-cortical "alarm" system for subliminal signals of fear. NeuroImage, 24, 235-243. doi:10.1016/j.neuroimage.2004.08.016
53. Likowski, K. U., Mühlberger, A., Gerdes, A. B. M., Wieser, M. J., Pauli, P., & Weyers, P. (2012). Facial mimicry and the mirror neuron system: Simultaneous acquisition of facial electromyography and functional magnetic resonance imaging. Frontiers in Human Neuroscience, 6. doi:10.3389/fnhum.2012.00214
54. Lundberg, U., Forsman, M., Zachau, G., Eklöf, M., Palmerud, G., Melin, B., & Kadefors, R. (2002). Effects of experimentally induced mental and physical stress on motor unit recruitment in the trapezius muscle. Work and Stress, 16, 166-178. doi:10.1080/02678370210136699
55. Magnée, M. J. C. M., de Gelder, B., van Engeland, H., & Kemner, C. (2007). Facial electromyographic responses to emotional information from faces and voices in individuals with pervasive developmental disorder. Journal of Child Psychology and Psychiatry, 48, 1122-1130. doi:10.1111/j.1469-7610.2007.01779.x
56. Magnée, M. J. C. M., Stekelenburg, J. J., Kemner, C., & de Gelder, B. (2007). Similar facial electromyographic responses to faces, voices, and body expressions. NeuroReport, 18, 369-372. doi:10.1097/WNR.0b013e32801776e6
57. Marsh, A. A., Ambady, N., & Kleck, R. E. (2005). The effects of fear and anger facial expressions on approach- and avoidance-related behaviors. Emotion, 5, 119-124. doi:10.1037/1528-3542.5.1.119
58. McIver, T. A., Kornelsen, J., & Smith, S. D. (2013). Limb-specific emotional modulation of cervical spinal cord neurons. Cognitive, Affective, & Behavioral Neuroscience, 13, 464-472. doi:10.3758/s13415-013-0154-x
59. Morecraft, R. J., Mcneal, D. W., Stilwell-Morecraft, K. S., Gedney, M., Ge, J., Schroeder, C. M., & Van Hoesen, G. W. (2007). Amygdala interconnections with the cingulate motor cortex in the rhesus monkey. The Journal of Comparative Neurology, 500, 134-165. doi:10.1002/cne.21165
60. Oberman, L. M., Winkielman, P., & Ramachandran, V. S. (2009). Slow echo: Facial EMG evidence for the delay of spontaneous, but not voluntary, emotional mimicry in children with autism spectrum disorders. Developmental Science, 12, 510-520. doi:10.1111/j.1467-7687.2008.00796.x
61. Oliveri, M., Babiloni, C., Filippi, M. M., Caltagirone, C., Babiloni, F., Cicinelli, P., Rossini, P. M. (2003). Influence of the supplementary motor area on primary motor cortex excitability during movements triggered by neutral or emotionally unpleasant visual cues. Experimental Brain Research, 149, 214-221. doi:10.1007/s00221-002-1346-8.
62. Pichon, S., de Gelder, B., & Grèzes, J. (2008). Emotional modulation of visual and motor areas by dynamic body expressions of anger. Social Neuroscience, 3, 199-212. doi:10.1080/17470910701394368
63. Pichon, S., de Gelder, B., & Grèzes, J. (2009). Two different faces of threat. Comparing the neural systems for recognizing fear and anger in dynamic body expressions. NeuroImage, 47, 1873-1883. doi:10.1016/j.neuroimage.2009.03.084
64. Pichon, S., de Gelder, B., & Grèzes, J. (2012). Threat prompts defensive brain responses independently of attentional control. Cerebral Cortex, 22, 274-285. doi:10.1093/cercor/bhr060
65. Roelofs, K., Hagenaars, M. A., & Stins, J. (2010). Facing freeze: Social threat induces bodily freeze in humans. Psychological Science, 21, 1575-1581. doi:10.1177/0956797610384746
66. Roman-Liu, D., Grabarek, I., Bartuzi, P., & Choromański, W. (2013). The influence of mental load on muscle tension. Ergonomics, 56, 1125-1133. doi:10.1080/00140139.2013.798429
67. Romani, M., Cesari, P., Urgesi, C., Facchini, S., & Aglioti, S. M. (2005). Motor facilitation of the human cortico-spinal system during observation of bio-mechanically impossible movements. NeuroImage, 26, 755-763. doi:10.1016/j.neuroimage.2005.02.027
68. Rotteveel, M., & Phaf, R. H. (2004). Automatic affective evaluation does not automatically predispose for arm flexion and extension. Emotion, 4, 156-172. doi:10.1037/1528-3542.4.2.156
69. Sagaspe, P., Schwartz, S., & Vuilleumier, P. (2011). Fear and stop: A role for the amygdala in motor inhibition by emotional signals. NeuroImage, 55, 1825-1835. doi:10.1016/j.neuroimage.2011.01.027
70. Schilbach, L., Timmermans, B., Reddy, V., Costall, A., Bente, G., Schlicht, T., & Vogeley, K. (2013). Toward a second-person neuroscience. Behavioral and Brain Sciences, 36, 393-414. doi:10.1017/S0140525X12000660
71. Schünke, M., Schulte, E., Schumacher, U., Ross, L. M., & Lamperti, E. D. (2006). Thieme atlas of anatomy: General anatomy and musculoskeletal system. Stuttgart: Thieme.
72. Schutter, D. J., Hofman, D., & Van Honk, J. (2008). Fearful faces selectively increase corticospinal motor tract excitability: A transcranial magnetic stimulation study. Psychophysiology, 45, 345-348. doi:10.1111/j.1469-8986.2007.00635.x
73. Smith, S. D., & Kornelsen, J. (2011). Emotion-dependent responses in spinal cord neurons: A spinal fMRI study. NeuroImage, 58, 269-274. doi:10.1016/j.neuroimage.2011.06.004
74. Stekelenburg, J. J., & Van Boxtel, A. (2001). Inhibition of pericranial muscle activity, respiration, and heart rate enhances auditory sensitivity. Psychophysiology, 38, 629-641. doi:10.1111/1469-8986.3840629
75. Stekelenburg, J. J., & Van Boxtel, A. (2002). Pericranial muscular, respiratory, and heart rate components of the orienting response. Psychophysiology, 39, 707-722. doi:10.1111/1469-8986.3960707
76. Stins, J. F., Roelofs, K., Villan, J., Kooijman, K., Hagenaars, M. A., & Beek, P. J. (2011). Walk to me when I smile, step back when I'm angry: Emotional faces modulate whole-body approach-avoidance behaviors. Experimental Brain Research, 212, 603-611. doi:10.1007/s00221-011-2767-z
77. Takakusaki, K., Saitoh, K., Harada, H., & Kashiwayanagi, M. (2004). Role of basal ganglia-brainstem pathways in the control of motor behaviors. Neuroscience Research, 50, 137-151. doi:10.1016/j.neures.2004.06.015
78. Tamietto, M., Castelli, L., Vighetti, S., Perozzo, P., Geminiani, G., Weiskrantz, L., & de Gelder, B. (2009). Unseen facial and bodily expressions trigger fast emotional reactions. Proceedings of the National Academy of Sciences USA, 106, 17661-17666. doi:10.1073/pnas.0908994106
79. Tamietto, M., & de Gelder, B. (2010). Neural bases of the non-conscious perception of emotional signals. Nature Reviews Neuroscience, 11, 697-709. doi:10.1038/nrn2889
80. Thibodeau, R. (2011). Approach and withdrawal actions modulate the startle reflex independent of affective valence and muscular effort. Psychophysiology, 48, 1011-1014. doi:10.1111/j.1469-8986.2010.01159.x
81. Urgesi, C., Candidi, M., Fabbro, F., Romani, M., & Aglioti, S. M. (2006). Motor facilitation during action observation: Topographic mapping of the target muscle and influence of the onlooker's posture. European Journal of Neuroscience, 23, 2522-2530. doi:10.1111/j.1460-9568.2006.04772.x
82. Van Boxtel, A., Damen, E. J., & Brunia, C. H. (1996). Anticipatory EMG responses of pericranial muscles in relation to heart rate during a warned simple reaction time task. Psychophysiology, 33, 576-583. doi:10.1111/j.1469-8986.1996.tb02434.x
83. van den Broek, E. L. (2012). On the bodily expressions of emotion, be aware: More than a century of research!: A commentary on Affective Computing by Kristina Höök. The Interaction-Design.org Encyclopedia of Human-Computer Interaction. Aarhus: The Interaction-Design.org Foundation.
84. van Loon, A. M., van den Wildenberg, W. P., van Stegeren, A. H., Ridderinkhof, K. R., & Hajcak, G. (2010). Emotional stimuli modulate readiness for action: A transcranial magnetic stimulation study. Cognitive, Affective, & Behavioral Neuroscience, 10, 174-181. doi:10.3758/CABN.10.2.174
85. Velloso, E., Bulling, A., & Gellersen, H. (2013, September). AutoBAP: Automatic coding of body action and posture units from wearable sensors. Paper presented at the 5th international conference on Affective Computing and Intelligent Interaction (ACII 2013), Geneva.
86. Walker, H. K. (1990). Cranial nerve XI: The spinal accessory nerve. In H. K. Walker, W. D. Hall, & J. W. Hurst (Eds.), Clinical methods: The history, physical, and laboratory examinations. Boston, MA: Butterworths.
87. Wijsman, J., Grundlehner, B., Penders, J., & Hermens, H. (2013). Trapezius muscle EMG as predictor of mental stress. ACM Transactions on Embedded Computing Systems, 12, 99:1-99:20. doi:10.1145/2485984.2485987
88. Willmann, M., & Bolmont, B. (2012). The trapezius muscle uniquely lacks adaptive process in response to a repeated moderate cognitive stressor. Neuroscience Letters, 506, 166-169. doi:10.1016/j.neulet.2011.10.073