Event-related potentials to unattended changes in facial expressions: Detection of regularity violations or encoding of emotions?

Frontiers in Human Neuroscience

Volumn , Issue SEP, 2013, Pages

  Astikainen, Piia ^a   Cong, Fengyu ^a   Ristaniemi, Tapani ^a   Hietanen, Jari K ^b  

^a UNIVERSITY OF JYVÄSKYLÄ   (Finland)

^b TAMPERE UNIVERSITY OF TECHNOLOGY   (Finland)

Author keywords

Equiprobable condition; Facial expressions; Independent component analysis; Oddball condition; Visual mismatch negativity

Indexed keywords

EID: 84933679528     PISSN: 16625161     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnhum.2013.00557     Document Type: Article

References (57)

1. Adolphs, R. (2002). Recognizing emotion from facial expressions: psychological and neurological mechanisms. Behav. Cogn. Neurosci. Rev. 1, 21-62. doi: 10.1177/1534582302001001003
2. Ashley, V., Vuilleumier, P., and Swick, D. (2004). Time course and specificity of event-related potentials to emotional expressions. Neuroreport 15, 211-216. doi: 10.1097/00001756-200401190-00041
3. Astikainen, P., and Hietanen, J. K. (2009). Event-related potentials to task-irrelevant changes in facial expressions. Behav. Brain Funct. 5, 30. doi: 10.1186/1744-9081-5-30
4. Astikainen, P., Lillstrang, E., and Ruusuvirta, T. (2008). Visual mismatch negativity for changes in orientation-a sensory memory-dependent response. Eur. J. Neurosci. 28, 2319-2324. doi: 10.1111/j.1460-9568.2008.06510.x
5. Batty, M., and Taylor, M. J. (2003). Early processing of the six basic facial emotional expressions. Brain Res. Cogn. Brain Res. 17, 613-620. doi: 10.1016/S0926-6410(03)00174-5
6. Bentin, S., Allison, T., Puce, A., Perez, E., and McCarthy, G. (1996). Electrophysiological studies of face perception in humans. J. Cogn. Neurosci. 8, 551-565. doi: 10.1162/jocn.1996.8.6.551
7. Blau, V. C., Maurer, U., Tottenham, N., and McCandliss, B. D. (2007). The face-specific N170 component is modulated by emotional facial expression. Behav. Brain Funct. 3, 7. doi: 10.1186/1744-9081-3-7
8. Caharel, S., Courtay, N., Bernard, C., Lalonde, R., and Rebai, M. (2005). Familiarity and emotional expression influence an early stage of face processing: an electrophysiological study. Brain Cogn. 59, 96-100. doi: 10.1016/j.bandc.2005.05.005
9. Chang, Y., Xu, J., Shi, N., Zhang, B., and Zhao, L. (2010). Dysfunction of processing task-irrelevant emotional faces in major depressive disorder patients revealed by expression-related visual MMN. Neurosci. Lett. 472, 33-37. doi: 10.1016/j.neulet.2010.01.050
10. Cong, F., Huang, Y., Kalyakin, I., Li, H., Huttunen-Scott, T., Lyytinen, H., et al. (2012). Frequency response based wavelet decomposition to extract children's mismatch negativity elicited by uninterrupted sound. J. Med. Biol. Eng. 32, 205-214. doi: 10.5405/jmbe.908
11. Cong, F., Kalyakin, I., Li, H., Huttunen-Scott, T., Huang, Y., Lyytinen, H., et al. (2011a). Answering six questions in extracting children's mismatch negativity through combining wavelet decomposition and independent component analysis. Cogn. Neurodyn. 5, 343-359. doi: 10.1007/s11571-011-9161-1
12. Cong, F., Leppänen, P. H., Astikainen, P., Hämäläinen, J., Hietanen, J. K., and Ristaniemi, T. (2011b). Dimension reduction: additional benefit of an optimal filter for independent component analysis to extract event-related potentials. J. Neurosci. Methods 201, 269-280. doi: 10.1016/j.jneumeth.2011.07.015
13. Czigler, I., Balazs, L., and Winkler, I. (2002). Memory-based detection of task-irrelevant visual changes. Psychophysiology 39, 869-873. doi: 10.1111/1469-8986.3960869
14. Desjardins, J. A., and Segalowitz, S. J. (2013). Deconstructing the early visual electrocortical responses to face and house stimuli. J. Vis. 13, 22. doi: 10.1167/13.5.22
15. Eger, E., Jedynak, A., Iwaki, T., and Skrandies, W. (2003). Rapid extraction of emotional expression: evidence from evoked potential fields during brief presentation of face stimuli. Neuropsychologia 41, 808-817. doi: 10.1016/S0028-3932(02)00287-7
16. Eimer, M., and Holmes, A. (2002). An ERP study on the time course of emotional face processing. Neuroreport 13, 427-431. doi: 10.1097/00001756-200203250-00013
17. Eimer, M., Holmes, A., and McGlone, F. P. (2003). The role of spatial attention in the processing of facial expression: an ERP study of rapid brain responses to six basic emotions. Cogn. Affect. Behav. Neurosci. 3, 97-110. doi: 10.3758/CABN.3.2.97
18. Ekman, P., and Friesen, W. V. (1976). Pictures of Facial Affect. Palo Alto, CA: Consulting Psychologists Press.
19. Friston, K. (2005). A theory of cortical responses. Philos. Trans. R. Soc. Lond. B Biol. Sci. 360, 815-836. doi: 10.1098/rstb.2005.1622
20. Himberg, J., Hyvärinen, A., and Esposito, F. (2004). Validating the independent components of neuroimaging time series via clustering and visualization. Neuroimage 22, 1214-1222. doi: 10.1016/j.neuroimage.2004.03.027
21. Holmes, A., Vuilleumier, P., and Eimer, M. (2003). The processing of emotional facial expression is gated by spatial attention: evidence from event-related brain potentials. Brain Res. Cogn. Brain Res. 16, 174-184. doi: 10.1016/S0926-6410(02)00268-9
22. Holmes, A., Winston, J. S., and Eimer, M. (2005). The role of spatial frequency information for ERP components sensitive to faces and emotional facial expression. Brain Res. Cogn. Brain Res. 25, 508-520. doi: 10.1016/j.cogbrainres.2005.08.003
23. Hyvärinen, A. (1999). Fast and robust fixed-point algorithms for independent component analysis. IEEE Trans. Neural Netw. 10, 626-634. doi: 10.1109/72.761722
24. Japee, S., Crocker, L., Carver, F., Pessoa, L., and Ungerleider, L. G. (2009). Individual differences in valence modulation of face-selective M170 response. Emotion 9, 59-69. doi: 10.1037/a0014487
25. Joyce, C., and Rossion, B. (2005). The face-sensitive N170 and VPP components manifest the same brain processes: the effect of reference electrode site. Clin. Neurophysiol. 116, 2613-2631. doi: 10.1016/j.clinph.2005.07.005
26. Kalyakin, I., González, N., Ivannikov, I., and Lyytinen, H. (2009). Extraction of the mismatch negativity elicited by sound duration decrements: a comparison of three procedures. Data Knowl. Eng. 68, 1411-1426. doi: 10.1016/j.datak.2009.07.004
27. Kalyakin, I., González, N., Kärkkainen, T., and Lyytinen, H. (2008). Independent component analysis on the mismatch negativity in an uninterrupted sound paradigm. J. Neurosci. Methods 174, 301-312. doi: 10.1016/j.jneumeth.2008.07.012
28. Keltner, D., Ekman, P., Gonzaga, G. C., and Beer, J. (2003). "Facial expression of emotion, " In Handbook of Affective Sciences, eds R. J. Davidson, K. R. Scherer, and H. H. Goldsmith (New York, NY: Oxford University Press), 415-432.
29. Kimura, M. (2012). Visual mismatch negativity and unintentional temporal-context-based prediction in vision. Int. J. Psychophy. 83, 144-155. doi: 10.1016/j.ijpsycho.2011.11.010
30. Kimura, M., Katayama, J., Ohira, H., and Schröger, E. (2009). Visual mismatch negativity: new evidence from the equiprobable paradigm. Psychophysiology 46, 402-409. doi: 10.1111/j.1469-8986.2008.00767.x
31. Kimura, M., Kondo, H., Ohira, H., and Schröger, E. (2011). Unintentional temporal context-based prediction of emotional faces: an electrophysiological study. Cereb. Cortex 22, 1774-1785. doi: 10.1093/cercor/bhr244
32. Kimura, M., Schröger, E., Czigler, I., and Ohira, H. (2010). Human visual system automatically encodes sequential regularities of discrete events. J. Cogn. Neurosci. 22, 1124-1139. doi: 10.1162/jocn.2009.21299
33. Kiss, M., and Eimer, M. (2008). ERPs reveal subliminal processing of fearful faces. Psychophysiology 45, 318-326. doi: 10.1111/j.1469-8986.2007.00634.x
34. Leppänen, J. M., Kauppinen, P., Peltola, M. J., and Hietanen, J. K. (2007). Differential electrocortical responses to increasing intensities of fearful and happy emotional expressions. Brain Res. 1166, 103-109. doi: 10.1016/j.brainres.2007.06.060
35. Li, X., Lu, Y., Sun, G., Gao, L., and Zhao, L. (2012). Visual mismatch negativity elicited by facial expressions: new evidence from the equiprobable paradigm. Behav. Brain Funct. 8, 7. doi: 10.1186/1744-9081-8-7
36. Makeig, S., Jung, T. P., Bell, A. J., Ghahremani, D., and Sejnowski, T. J. (1997). Blind separation of auditory event-related brain responses into independent components. Proc. Natl. Acad. Sci. U.S.A. 94, 10979-10984. doi: 10.1073/pnas.94.20.10979
37. Makeig, S., Westerfield, M., Jung, T. P., Covington, J., Townsend, J., Sejnowski, T. J., et al. (1999). Functionally independent components of the late positive event-related potential during visual spatial attention. J. Neurosci. 19, 2665-2680.
38. Näätänen, R. (1990). The role of attention in auditory information processing as revealed by event-related potentials and other brain measures of cognitive function. Behav. Brain Sci. 13, 201-288. doi: 10.1017/S0140525X00078407
39. Näätänen, R., Astikainen, P., Ruusuvirta, T., and Huotilainen, M. (2010). Automatic auditory intelligence: an expression of the sensory-cognitive core of cognitive processes. Brain Res. Rev. 63, 123-136. doi: 10.1016/j.brainresrev.2010.03.001
40. Näätänen, R., Gaillard, A. W., and Mäntysalo, S. (1978). Early selective-attention effect on evoked potential reinterpreted. Acta Psychol. (Amst.) 42, 313-329. doi: 10.1016/0001-6918(78)90006-9
41. Palermo, R., and Rhodes, G. (2007). Are you always on my mind. A review of how face perception and attention interact. Neuropsychologia 45, 75-92. doi: 10.1016/j.neuropsychologia.2006.04.025
42. Rellecke, J., Sommer, W., and Schacht, A. (2013). Emotion effects on the N170: a question of reference. Brain Topogr. 26, 62-71. doi: 10.1007/s10548-012-0261-y
43. Santesso, D. L., Meuret, A. E., Hofmann, S. G., Mueller, E. M., Ratner, K. G., Roesch, E. B., et al. (2008). Electrophysiological correlates of spatial orienting towards angry faces: a source localization study. Neuropsychologia 46, 1338-1348. doi: 10.1016/j.neuropsychologia.2007.12.013
44. Schyns, P. G., Gosselin, F., and Smith, M. L. (2009). Information processing algorithms in the brain. Trends Cogn. Sci. 13, 20-26. doi: 10.1016/j.tics.2008.09.008
45. Schyns, P. G., Petro, L. S., and Smith, L. M. (2007). Dynamics of visual information integration in the brain to categorize facial expressions. Curr. Biol. 17, 1580-1585. doi: 10.1016/j.cub.2007.08.048
46. Smith, M. L., Fries, P., Gosselin, F., Goebel, R., and Schyns, P. G. (2009). Inverse mapping the neuronal substrates of face categorizations. Cereb. Cortex 19, 2428-2438. doi: 10.1093/cercor/bhn257
47. Stefanics, G., and Czigler, I. (2012). Automatic prediction error responses to hands with unexpected laterality: an electrophysiological study. Neuroimage 63, 253-261. doi: 10.1016/j.neuroimage.2012.06.068
48. Stefanics, G., Csukly, G., Komlósi, S., Czobor, P., and Czigler, I. (2012). Processing of unattended facial emotions: a visual mismatch negativity study. Neuroimage 59, 3042-3049. doi: 10.1016/j.neuroimage.2011.10.041
49. Stefanics, G., Kimura, M., and Czigler, I. (2011). Visual mismatch negativity reveals automatic detection of sequential regularity violation. Front. Hum. Neurosci. 5:46. doi: 10.3389/fnhum.2011.00046
50. Susac, A., Ilmoniemi, R. J., Pihko, E., Ranken, D., and Supek, S. (2010). Early cortical responses are sensitive to changes in face stimuli. Brain Res. 1346, 155-164. doi: 10.1016/j.brainres.2010.05.049
51. Susac, A., Ilmoniemi, R. J., Pihko, E., and Supek, S. (2004). Neurodynamic studies on emotional and inverted faces in an oddball paradigm. Brain Topogr. 16, 265-268. doi: 10.1023/B:BRAT.0000032863.39907.cb
52. Vigario, R., and Oja, E. (2008). BSS and ICA in neuroinformatics: from current practices to open challenges. IEEE Rev. Biomed. Eng. 1, 50-61. doi: 10.1109/RBME.2008.2008244
53. Vlamings, P. H. J. M., Goffaux, V., and Kemner, C. (2009). Is the early modulation of brain activity by fearful facial expressions primarily mediated by coarse low spatial frequency information. J. Vis. 9, 1-13. doi: 10.1167/9.5.12
54. Williams, L. M., Palmer, D., Liddell, B. J., Song, L., and Gordon, E. (2006). The 'when' and 'where' of perceiving signals of threat versus non-threat. Neuroimage 31, 458-467. doi: 10.1016/j.neuroimage.2005.12.009
55. Winkler, I., and Czigler, I. (2012). Evidence from auditory and visual event-related potential (ERP) studies of deviance detection (MMN and vMMN) linking predictive coding theories and perceptual object representations. Int. J. Psychol. 83, 132-143. doi: 10.1016/j.ijpsycho.2011.10.001
56. Wronka, R., and Walentowska, W. (2011). Attention modulates emotional expression processing. Psychophysiology 4, 1047-1056. doi: 10.1111/j.1469-8986.2011.01180.x
57. Zhao, L., and Li, J. (2006). Visual mismatch negativity elicited by facial expressions under non-attentional condition. Neurosci. Lett. 410, 126-131. doi: 10.1016/j.neulet.2006.09.081