In the face of emotions: Event-related potentials in supraliminal and subliminal facial expression recognition

Genetic, Social, and General Psychology Monographs

Volumn 131, Issue 1, 2005, Pages 41-69

  Balconi, Michela ^a   Lucchiari, Claudio ^b  

^a UNIVERSITÀ CATTOLICA DEL SACRO CUORE   (Italy)

^b Department of Neurology   (Italy)

Author keywords

Emotion; Event related potentials; Facial expressions; Subliminal stimulation

Indexed keywords

ADULT; AFFECT; ARTICLE; CONSCIOUSNESS; DEFENSE MECHANISM; EVOKED RESPONSE; FACIAL EXPRESSION; FEMALE; HUMAN; MALE; RECOGNITION; VISION;

ADULT; AFFECT; CONSCIOUSNESS; EVOKED POTENTIALS; FACIAL EXPRESSION; FEMALE; HUMANS; MALE; RECOGNITION (PSYCHOLOGY); SUBLIMATION; VISUAL PERCEPTION;

EID: 32944464046     PISSN: 87567547     EISSN: None     Source Type: Journal    
DOI: 10.3200/MONO.131.1.41-69     Document Type: Article

References (107)

1. Adolphs, R., Tranel, D., & Damasio, A. R. (1998). The human amygdala in social judgment. Nature 393, 470-474.
2. Balconi, M. (2003). Conscious and unconscious in emotional face processing. Journal of the International Neuropsychological Society, 2, 304-305.
3. Balconi, M., & Lucchiari, C. (2005). Consciousness, emotion and face: An event-related potentials (ERP) study. In R. D. Ellis & N. Newton (Eds.), Consciousness and emotion. Agency, conscious choice, and selective perception (pp. 121-137). Amsterdam: John Benjamins.
4. Balconi, M., & Pozzoli, U. (2003a). ERPs (event-related potentials), semantic attribution, and facial expressions of emotions. Consciousness and Emotion, 4, 63-80.
5. Balconi, M., & Pozzoli, U. (2003b). Face-selective processing and the effect of pleasant and unpleasant emotional expressions on ERP correlates. International Journal of Psychophysiology, 49, 67-74.
6. Batty, M., & Taylor, M. J. (2003). Early processing of the six basic facial emotional expressions. Cognitive Brain Research, 17, 613-620.
7. Bentin, S., Allison, T., Puce, A., Perez, E., & McCarthy, G. (1996). Electrophysiological studies of face perception in humans. Journal of Cognitive Neuroscience, 5, 551-565.
8. Bentin, S., & Deouell, L. Y. (2000). Structural encoding and identification in face processing: ERP evidence for separate mechanisms. Cognitive Neuropsychology, 17, 35-54.
9. Bentin, S., Deouell, L. Y., & Soroker, N. (1999). Selective visual streaming in face recognition: Evidence from developmental prosopagnosia. Neuroreport, 10, 823-827.
10. Bernat, E., Bunce, S., & Shevrin, H. (2001). Event-related brain potentials differentiate positive and negative mood adjectives during both supraliminal and subliminal visual processing. International Journal of Psychophysiology, 42, 11-34.
11. Bernstein, L. J., Beig, S., Siegenthaler, A. L., & Grady, C. L. (2002). The effect of encoding strategy of the neural correlates of memory for faces. Neuropsychologia, 40, 86-98.
12. Boetzel, K., & Grusser, O. J. (1989). Electric brain potentials evoked by pictures of faces and non-faces: A search for "face- specific" EEG potentials. Experimental Brain Research, 77, 349-360.
13. Borod, J. C., Cicero, B. A., Obler, L. K., Welkowitz, J., Erhan, H. M., Santschi, C., et al. (1998). Right hemisphere emotional perception: Evidence across multiple channels. Neuropsychology, 12, 446-458.
14. Bradley, M. M., Lang, P. J., & Cuthbert, B. N. (1993). Emotion, novelty, and the startle reflex: Habituation in human. Behavioral Neuroscience, 107, 970-980.
15. Brázdil, M., Rektor, I., Daniel, P., Dufek, M., & Jurák, P. (2001). Intracerebral event-related potentials to subthreshold target stimuli. Clinical Neurophysiology, 112, 650-661.
16. Brázdil, M., Rektor, I., Dufek, M., Jurák, P., & Daniel, P. (1998). Effect of subthreshold stimuli on event-related potentials. Electrophysiology and Clinical Neurophysiology, 107, 64-68.
17. Bruce, V., & Young, A. W. (1986). Understanding face recognition. British Journal of Psychology, 77, 305-327.
18. Bruce, V., & Young, A. W. (1998). A theoretical perspective for understanding brain recognition. In A.W. Young (Ed.), Face and mind (pp. 96-130). Oxford, England: Oxford University Press.
19. Bunce, S., Bernat, E., Wong, P. S., & Shevrin, H. (1999). Further evidence for unconscious learning: Preliminary support for the conditioning of facial EMG to subliminal stimuli. Journal of Psychiatry Research, 33, 341-347.
20. Cacioppo, J. T., Crites, S. L., & Gardner, W. L. (1996). Attitudes to the right: Evaluative processing is associated with lateralized late positive event-related brain potentials. Personality and Social Psychology Bulletin, 22, 1205-1219.
21. Caldara, R., Thut, G., Servoir, P., Michel, C. M., Bovet, P., & Renault, B. (2003). Face versus non-face object perception and the "other-race" effect: A spatio-temporal event-related potential study. Clinical Neurophysiology, 114, 515-528.
22. Carretié, L., & Iglesias, J. (1995). An ERP study on the specificity of facial expression processing. International Journal of Psychophysiology, 19, 183-192.
23. Chapman, R. M., McCrary, J. W., Chapman, J. A., & Martin, J. K. (1980). Behavioral and neural analysis of connotative meaning: Word classes and rating scales. Brain and Language, 11, 319-339.
24. Damasio, A. R., Grabowski, T. J., Bechara, A., Damasio, H., Ponto, L. L., & Parvizi, J. (2000). Subcortical and cortical brain activity during the feeling of self-generated emotions. Nature Neuroscience 3, 1049-1056.
25. Davidson, R. J. (1993). Cerebral asymmetry and emotion: Conceptual and methodological conundrums. Cognition and Emotion, 7, 115-138.
26. Davidson, R. J. (1995). Cerebral asymmetry, emotion, and affective style. In R. J. Davidson & K. Hugdahl (Eds.), Brain asymmetry (pp. 361-387). Cambridge: Massachusetts Institute of Technology.
27. Davidson, R. J. (2001). The neural circuitry of emotion and affective style: Prefrontal cortex and amygdala contribution. Social Science Information, 40, 11-39.
28. Davidson, R. J., Jackson, D. C., & Kalin, N. H. (2000). Emotion, plasticity, context, and regulation: Perspectives from affective neuroscience. Psychological Bulletin, 126, 890-909.
29. de Gelder, B., Frissen, I., Barton, J., & Hadjikhani, N. (2003). A modulatory role for facial expressions in prosopagnosia. Proceedings of National Academy of Sciences, 100, 13105-13110.
30. De Renzi, E., Perani, D., Carlesimo, G. A., Silveri, M. C., & Fazio, F. (1994). Prosopagnosia can be associated with damage confined to the right hemisphere. An MRI and PET study and a review of the literature. Neuropsychologia, 32, 893-902.
31. Dimberg, U. (1997). Facial reactions: Rapidly evoked emotional responses. Journal of Psychophysiology, 11, 115-123.
32. Dimberg, U., Elmehed, K., & Thunberg, M. (2000). Unconscious facial reactions to emotional facial expressions. Psychological Sciences, 11, 86-89.
33. Eimer, M. (2000). Event-related brain potentials distinguish processing stages involved in face perception and recognition. Clinical Neurophysiology, 111, 694-705.
34. Eimer, M., & McCarthy, R. A. (1999). Prosopagnosia and structural encoding of face: Ev idence from event-related potentials. Neuroreport, 10, 255-259.
35. Ekman, P. (1993). Facial expression and emotion. American Psychologist, 48, 384-392.
36. Ekman, P., & Friesen, W. V. (1976). Pictures of facial affect. Palo Alto, CA: Consulting Psychologist Press.
37. Ellsworth, P. C., & Scherer, K. R. (2003). Appraisal processes in emotion. In R. J. Davidson, K. R. Scherer, & H. H. Goldsmith (Eds.), Handbook of affective sciences (pp. 572-596). Oxford, England: Oxford University Press.
38. Epstein, S. (1994). Integration of the cognitive and the psychodynamic unconscious. American Psychologist, 49, 709-724.
39. Esteves, F., Parra, C., Dimberg, U., & Öhman, A. (1994). Nonconscious associative learning: Pavlovian conditioning of skin conductance responses to masked fear-relevant stimuli. Psychophysiology, 31, 375-385.
40. Frijda, N. H. (1986). The emotions. Cambridge, England: Cambridge University Press.
41. Frijda, N. H. (1994). Emotions are functional, most of the time. In P. Ekman & R. J. Davidson (Eds.), The nature of emotion: Fundamental questions (pp. 112-122). New York: Oxford University Press.
42. Gazzaniga, M. S. (1993). Brain mechanisms and conscious experience. Experimental and theoretical studies of consciousness (CIBA Foundation Symposium 174). Chichester, England: Wiley.
43. Gorno-Tempini, M. L., Pradelli, S., Serafini, M., Baraldi, P., & Porro, C. (2001). Explicit and incidental facial expression processing: An fMRI study. Neuroimage, 14, 465-473.
44. Grelotti, D. J., Gauthier, I., & Schultz, R. T. (2002). Social interest and the development of cortical face specialization: What autism teaches us about face processing. Developmental Psychobiology, 40, 213-225.
45. Gur, R. C., Schroeder, T., Turner, T., McGrath, R. M., & Chan, L. I. (2002). Brain activation during facial emotion processing. Neuroimage, 16, 651-662.
46. Hamm, A. O., Schupp, H. T., & Weike, A. I. (2003). Motivational organization of emotions: Autonomic change cortical responses, and reflex modulation. In R. J. Davidson, K. R. Scherer, & H. H. Goldsmith (Eds.), Handbook of affective sciences (pp. 187-212). Oxford, England: Oxford University Press.
47. Haxby, J. V., Hoffman, E. A., & Gobbini, I. M. (2000). The distributed human neural system for face perception. Trends in Cognitive Science, 4, 223-233.
48. Henke, K., Landis, T., & Markowitsch, H. J. (1993). Subliminal perception of pictures in the right hemisphere. Consciousness and Cognition, 2, 225-236.
49. Herrmann, M. J., Aranda, D., Ellgring, H., Mueller, T. J., Strik, W. K., Heidrich, A., et al. (2002). Face-specific event-related potential in humans is independent from facial expression. International Journal of Psychophysiology, 45, 241-244.
50. Holmes, A., Vuilleumier, P., & Eimer, M. (2003). The processing of emotional facial expressions is gated by spatial attention: Evidence from event-related brain potentials. Cognitive Brain Research, 16, 174-184.
51. Iragui, V. J., Kutas, M., Mitchiner, M. R., & Hillyard, S. A. (1993). Effect of aging on event-related brain potentials and reaction times in an auditory oddball task. Psychophysiology, 30, 10-22.
52. Jasper, H. H. (1958). The ten-twenty electrode system of the International Federation. Electroencephalography and Clinical Neurophysiology, 10, 371-375.
53. Johnston, V. S., Miller, D. R., & Burleson, M. H. (1986). Multiple P3s to emotional stimuli and their theoretical significance. Psychophysiology, 23, 684-693.
54. Jung, T. P., Makeig, S., Humphries, C., Lee, T. W., McKeown, M. J., Iragui, V., et al. (2000). Removing electroencephalographic artifacts by blind source separation. Psychophysiology, 37, 163-178.
55. Junghöfer, M., Bradley, M. M., Elbert, T. R., & Lang, P. J. (2001). Fleeting images: A new look at early emotion discrimination. Psychophysiology, 38, 175-178.
56. Kanwisher, N., McDermott, J., & Chun, M. M. (1997). The fusiform face area: A module in human extrastriate cortex specialized for face perception. Journal of Neuroscience, 77, 4302-4311.
57. Kayser, J., Tenke, C., Nordby, H., Hammerborg, D., Hugdahl, K., & Erdmann, G. (1997). Event-related potential (ERP) asymmetries to emotional stimuli in a visual half-field paradigm. Psychophysiology, 34, 414-426.
58. Keil, A., Bradley, M. M., Hauk, O., Rockstroh, B., Elbert, T., & Lang, P. J. (2002). Largescale neural correlates of affective picture processing. Psychophysiology, 39, 641-649.
59. Keil, A., Müller, M. M., Gruber, T., Stolarova, M., Wienbruch, C., & Elbert, T. (2001). Effects of emotional arousal in the cerebral hemispheres: A study of oscillatory brain activity and event-related potentials. Clinical Neurophysiology, 112, 2057-2068.
60. Kihlstrom, J. F., Barnhardt, T. M., & Tataryn, D. J. (1992). Implicit perception. In R. F. Bornstein & T. F. Pittam (Eds.), Perception without awareness; Cognitive, clinical, and social perspectives (pp. 17-54). New York: Guilford.
61. Krolak-Salmon, P., Fischer, C., Vighetto, A., & Mauguière, F. (2001). Processing of facial emotional expression: Spatio-temporal data as assessed by scalp event-related potentials. European Journal of Neuroscience, 13, 987-994.
62. Kunst-Wilson, W., & Zajonc, R. (1980). Affective discrimination of stimuli that cannot be recognized. Science, 207, 557-558.
63. Lane, R. D., Chua, P. M. L., & Dolan, R. J. (1998). Common effects of emotional valence, arousal and attention on neural activation during visual processing of pictures. Neuropsychologia, 37, 989-997.
64. Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (1997). Motivated attention: Affect, activation, and action. In P. J. Lang, R. F. Simons, & M. Balaban (Eds.), Attention and orienting: Sensory and motivational processes (pp. 97-135). Mahwah, NJ: Erlbaum.
65. Lang, P. J., Greenwald, M. K., Bradley, M. M., & Hamm, A. O. (1993). Looking at pictures: Affective, facial, visceral and behavioral reactions. Psychophysiology, 30, 261-273.
66. Lang, S. F., Nelson, C. A., & Collins, P. F. (1990). Event-related potentials to emotional and neutral stimuli. Journal of Clinical Experimental Neuropsychology, 12, 946-958.
67. Lazarus, R. S. (1991). Cognition and motivation in emotion. American Psychologist, 46, 352-367.
68. Lazarus, R. S. (1999). Appraisal, relational meaning, and emotion. In T. Dalgleish & M. Power (Eds.), Handbook of cognition and emotion (pp. 3-19). Chichester, England: Wiley.
69. LeDoux, J. E. (1990). Fear pathways in the brain: Implications for a theory of the emotional brain. In P. F. Brain, S. Parmigiani, R. J. Balnchard, & D. Mainardi (Eds.), Fear and defence, (pp. 163-167). London: Harwood.
70. LeDoux, J. E. (1996). The emotional brain: The mysterious underpinning of emotional life. New York: Simon and Schuster.
71. Linkenkaer Hansen, K., Palva, J. M., Sams, M., Hietanen, J. K., Aronen, H. J., & Ilmoniemi, R. J. (1998). Face-selective processing in human extrastriate cortex around 120 ms after stimulus onset revealed by magneto- and electroencephalography. Neuroscience Letters, 253, 147-150.
72. Macmillan, N. (1986). The psychophysics of subliminal perception. Behavioral and Brain Sciences, 9, 38-39.
73. Marinkovic, K., & Halgren, E. (1998). Human brain potentials related to the emotional expression, repetition, and gender of faces. Psychobiology, 26, 348-356.
74. Maurer, D., Le Grand, R., & Mondloch, C. J. (2002). The many faces of configural processing. Trends in Cognitive Neuroscience, 6, 255-260.
75. Miller, G. A. (1996). How we think about cognition, emotion, and biology in psychopathology. Psychophysiology, 33, 615-628.
76. Moffat, D. C., & Frijda, N. H. (2000). Functional models of emotion. In G. Hatano, N. Okada, & H. Tanabe (Eds.), Affective minds (pp. 23-56). Amsterdam: Elsevier.
77. Mogg, K., & Bradley, B. P. (1999). Orienting of attention to threatening facial expressions presented under conditions of restricted awareness. Cognition and Emotion, 13, 713-740.
78. Monta, Y., Monta, K., Masashi, Y., Waseda, Y., & Maeda, H. (2001). Effects of facial affect recognition on the auditory P300 in healthy subjects. Neuroscience Research, 41, 89-95.
79. Morrison, J. S., Öhman, A., & Dolan, R. J. (1998). Conscious and unconscious emotional learning in the human amygdala. Nature, 393, 467-470.
80. Öhman, A. (1999). Distinguishing unconscious from conscious emotional processes: Methodological considerations and theoretical implications. In T. Dalgleish & M. J. Power (Eds.), Handbook of cognition and emotion (pp. 96-130). Chichester, England: Wiley.
81. Öhman, A., & Soares, J. J. F. (1998). Emotional conditioning to masked stimuli: Expectancies for aversive outcomes following nonrecognized fear-relevant stimuli. Journal of Experimental Psychology: General, 127, 69-82.
82. Palomba, D., Angrilli, A., & Mini, A. (1997). Visual evoked potentials, heart rate responses and memory to emotional pictorial stimuli. International Journal of Psychophysiology, 27, 55-67.
83. Pizzagalli, D., Koenig, T., Regard, M., & Lehmann, D. (1999). Affective attitudes to face images associated with intracerebral EEG source location before face viewing. Cognitive Brain Research, 7, 371-377.
84. Polich, J., & Kok, A. (1995). Cognitive and biological determinants of P300: An integra-tive review. Biological Psychology, 41, 103-146.
85. Posamentier, M. T., & Abdi, H. (2003). Processing faces and facial expressions. Neuropsychology Review, 13, 113-143.
86. Posner, M. I. (1978). Chronometric explorations of mind. Hillsdale, NJ: Erlbaum.
87. Regan, M., & Howard, R. (1995). Fear conditioning, preparedness, and the contingent negative variation. Psychophysiology, 32, 208-214.
88. Rugg, M. D., & Coles, M. G. H. (1995). Electrophysiology of mind. Oxford, England: Oxford University Press.
89. Sato, W., Takanori, K., Sakiko, Y., & Michikazu, M. (2000). Emotional expression boosts early visual processing of the face: ERP recording and its decomposition by independent component analysis. Neuroreport, 12, 709-714.
90. Scherer, K. R. (2001). The nature and study of appraisal: A review of the issues. In K. R. Scherer, A. Schorr, & T. Johnstone (Eds.), Appraisal processes in emotion: Theory, methods, research (pp. 369-391). New York: Oxford University Press.
91. Schorr, A. (2001). Appraisal: The evolution of an idea. In K. R. Scherer, A. Schorr, & T. Johnstone (Eds.), Appraisal processes in emotion: Theory, methods, research (pp. 20-34). New York: Oxford University Press.
92. Schupp, H. T., Cuthbert, B. N., Bradley, M. M., Cacioppo, J. T., Ito, T., & Lang, P. J. (2000). Affective picture processing: The late positive potential is modulated by motivational relevance. Psychophysiology, 37, 257-261.
93. Scott, S. K., Young, A. W., Calder, A. J., Hellawell, D. J., Aggleton, J. P., & Johnson, M. (1997). Impaired auditory recognition of fear and anger following bilateral amygdala lesions. Nature, 385, 254-257.
94. Shevrin, H. (2001). Event-related markers of unconscious processes. International Journal of Psychophysiology, 42, 209-218.
95. Shevrin, H., Bond, J. A., Brakel, L. A. W., Hertel, R. K., & Williams, W. J. (1996). Conscious and unconscious processes: Psychodynamic, cognitive, and neurophysiological convergences. New York: Guilford.
96. Shevrin, H., & Fritzler, D. (1968). Visual-evoked response correlates of unconscious mental processes. Science, 161, 295-298.
97. Shiffrin, R. M., & Schneider, W. (1977). Controlled and automatic human information processing II. Perceptual learning, automatic attending, and a general theory. Psychological Review, 84, 127-190.
98. Skrandies, W., & Weber, P. (1996). Dimensionality of semantic meaning and segments of evoked potential field. In C. Ogura, Y. Koga, & M. Shimokochi (Eds.), Recent advances in event-related brain potential research: Proceedings of the 11th international conference on event-related potentials (EPIC) (pp. 125-162). New York: Elsevier.
99. Smith, C. A., & Ellsworth, P. C. (1985). Patterns of cognitive appraisal in emotion. Journal of Personality and Social Psychology, 48, 813-838.
100. Snodgrass, J. M. (2000). Unconscious perception: Theory, method, and evidence. Amsterdam: John Benjamins.
101. Streit, M., Wölwer, W., Brinkmeyer, J., Ihl, R., & Gaebel, W. (2000). Electrophysiological correlates of emotional and structural face processing in humans. Neuroscience Letters, 278, 13-16.
102. Tranel, D., & Damasio, A. R. (1985). Knowledge without awareness: An autonomic index of facial recognition. Science, 228, 1453-1454.
103. Vanderploeg, R. D., Brown, W. S., & Marsh, J. T. (1987). Judgments of emotion in words and faces: ERP correlates. International Journal of Psychophysiology, 5, 193-205.
104. Wild, B., Erb, M., & Bartels, M. (2001). Are emotions contagious? Evoked emotions while viewing emotionally expressive faces: Quality, quantity, time course and gender differences. Psychiatry Research, 102, 109-124.
105. Wong, P. S., Shevrin, H., & Williams, W. J. (1994). Conscious and nonconscious processes: An ERP index of an anticipatory response in a conditioning paradigm using visual masked stimuli. Psychophysiology, 31, 87-101.
106. Yee, C. M., & Miller, C. M. (1987). Affective valence and information processing. In R. Johnson, Jr., J. W. Rohrbaugh, & R. Parasuraman (Eds.), Current trends in event-related potential research (EEG Supplement 40) (pp. 300-307). Amsterdam: Elsevier.
107. Young, A. W., Hellawell, D. J., Van de Wal, C., & Johnson, M. (1996). Facial expression processing after amygdalotomy. Neuropsychologia, 34, 31-39.