Advancing emotion theory with multivariate pattern classification

Emotion Review

Volumn 6, Issue 2, 2014, Pages 160-174

  Kragel, Philip A ^a   Labar, Kevin S ^a  

^a DUKE UNIVERSITY   (United States)

Author keywords

Autonomic nervous system; Central nervous system; Emotion specificity; Model comparison; Multivariate pattern classification

Indexed keywords

EID: 84897767017     PISSN: 17540739     EISSN: None     Source Type: Journal    
DOI: 10.1177/1754073913512519     Document Type: Review

References (90)

1. Adolphs R.. Recognizing emotion from facial expressions: Psychological and neurological mechanisms. Behavioral and Cognitive Neuroscience Reviews. 2002 ; 1 (1). 21-62
2. Anders S., Lotze M., Erb M., Grodd W., Birbaumer N.. Brain activity underlying emotional valence and arousal: A response-related fMRI study. Human Brain Mapping. 2004 ; 23 (4). 200-209
3. Anderson A. K., Christoff K., Stappen I., Panitz D., Ghahremani D. G., Glover G.,... Sobel N.. Dissociated neural representations of intensity and valence in human olfaction. Nature Neuroscience. 2003 ; 6 (2). 196-202
4. Arnold M. B. Emotion and personality. New York, NY: Columbia University Press ; 1960 :
5. Ashby F. G., Isen A. M., Turken A. U.. A neuropsychological theory of positive affect and its influence on cognition. Psychological Review. 1999 ; 106 (3). 529-550
6. Barrett L. F.. Are emotions natural kinds?. Perspectives on Psychological Science. 2006a ; 1 (1). 28-58
7. Barrett L. F.. Solving the emotion paradox: Categorization and the experience of emotion. Personality and Social Psychology Review. 2006b ; 10 (1). 20-46
8. Barrett L. F., Wager T. D.. The structure of emotion: Evidence from neuroimaging studies. Current Directions in Psychological Science. 2006 ; 15 (2). 79-83
9. Bartels A., Logothetis N. K., Moutoussis K.. fMRI and its interpretations: An illustration on directional selectivity in area V5/MT. Trends in Neurosciences. 2008 ; 31 (9). 444-453
10. Baucom L. B., Wedell D. H., Wang J., Blitzer D. N., Shinkareva S. V.. Decoding the neural representation of affective states. Neuroimage. 2012 ; 59 (1). 718-727
11. Berntson G. G., Cacioppo J. T., Quigley K. S., Fabro V. T.. Autonomic space and psychophysiological response. Psychophysiology. 1994 ; 31 (1). 44-61
12. Brouwer G. J., Heeger D. J.. Decoding and reconstructing color from responses in human visual cortex. The Journal of Neuroscience. 2009 ; 29 (44). 13992-14003
13. Christie I. C., Friedman B. H.. Autonomic specificity of discrete emotion and dimensions of affective space: A multivariate approach. International Journal of Psychophysiology. 2004 ; 51 (2). 143-153
14. Colibazzi T., Posner J., Wang Z., Gorman D., Gerber A., Yu S.,... Peterson B. S.. Neural systems subserving valence and arousal during the experience of induced emotions. Emotion. 2010 ; 10 (3). 377-389
15. Damasio A. R., Grabowski T. J., Bechara A., Damasio H., Ponto L. L., Parvizi J., Hichwa R. D.. Subcortical and cortical brain activity during the feeling of self-generated emotions. Nature Neuroscience. 2000 ; 3 (10). 1049-1056
16. Davis M., Whalen P. J.. The amygdala: Vigilance and emotion. Molecular Psychiatry. 2001 ; 6 (1). 13-34
17. Duda R. O., Hart P. E., Stork D. G. Pattern classification. 2001 ). Pattern classification (2nd ed.). New York, NY: Wiley. New York, NY: Wiley ; 2001 :
18. Ekman P.. An argument for basic emotions. Cognition & Emotion. 1992 ; 6 (3-4). 169-200
19. Ekman P., Cordaro D.. What is meant by calling emotions basic. Emotion Review. 2011 ; 3 (4). 364-370
20. Ethofer T., van De Ville D., Scherer K., Vuilleumier P.. Decoding of emotional information in voice-sensitive cortices. Current Biology. 2009 ; 19 (12). 1028-1033
21. Fehr B., Russell J. A.. Concept of emotion viewed from a prototype perspective. Journal of Experimental Psychology: General. 1984 ; 113 (3). 464-486
22. Formisano E., De Martino F., Bonte M., Goebel R.. "Who" is saying "what"?: Brain-based decoding of human voice and speech. Science. 2008 ; 322 (5903). 970-973
23. Freeman J., Brouwer G. J., Heeger D. J., Merriam E. P.. Orientation decoding depends on maps, not columns. Journal of Neuroscience. 2011 ; 31 (13). 4792-4804
24. Friedman B. H.. Feelings and the body: The Jamesian perspective on autonomic specificity of emotion. Biological Psychology. 2010 ; 84 (3). 383-393
25. Frijda N. H.. Emotion, cognitive structure, and action tendency. Cognition & Emotion. 1987 ; 1 (2). 115-143
26. Frith C. D., Frith U.. The neural basis of mentalizing. Neuron. 2006 ; 50 (4). 531-534
27. Gardner J. L.. Is cortical vasculature functionally organized?. Neuroimage. 2010 ; 49 (3). 1953-1956
28. Gerber A. J., Posner J., Gorman D., Colibazzi T., Yu S., Wang Z.,... Peterson B. S.. An affective circumplex model of neural systems subserving valence, arousal, and cognitive overlay during the appraisal of emotional faces. Neuropsychologia. 2008 ; 46 (8). 2129-2139
29. Goldin P. R., McRae K., Ramel W., Gross J. J.. The neural bases of emotion regulation: Reappraisal and suppression of negative emotion. Biological Psychiatry. 2008 ; 63 (6). 577-586
30. Hamann S.. Mapping discrete and dimensional emotions onto the brain: Controversies and consensus. Trends in Cognitive Sciences. 2012 ; 16 (9). 458-466
31. Hanson S. J., Matsuka T., Haxby J. V.. Combinatorial codes in ventral temporal lobe for object recognition: Haxby (2001) revisited: Is there a "face" area?. Neuroimage. 2004 ; 23 (1). 156-166
32. Harrison S. A., Tong F.. Decoding reveals the contents of visual working memory in early visual areas. Nature. 2009 ; 458 (7238). 632-635
33. Haxby J. V., Gobbini M. I., Furey M. L., Ishai A., Schouten J. L., Pietrini P.. Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science. 2001 ; 293 (5539). 2425-2430
34. Haynes J. D., Rees G.. Decoding mental states from brain activity in humans. Nature Reviews Neuroscience. 2006 ; 7 (7). 523-534
35. Hughes G.. On the mean accuracy of statistical pattern recognizers. IEEE Transactions on Information Theory. 1968 ; 14 (1). 55-63
36. Jain A. K., Duin R. P. W., Mao J. C.. Statistical pattern recognition: A review. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2000 ; 22 (1). 4-37
37. Kalisch R., Wiech K., Critchley H. D., Dolan R. J.. Levels of appraisal: A medial prefrontal role in high-level appraisal of emotional material. Neuroimage. 2006 ; 30 (4). 1458-1466
38. Kamitani Y., Tong F.. Decoding the visual and subjective contents of the human brain. Nature Neuroscience. 2005 ; 8 (5). 679-685
39. Kamitani Y., Tong F.. Decoding seen and attended motion directions from activity in the human visual cortex. Current Biology. 2006 ; 16 (11). 1096-1102
40. Kanwisher N., McDermott J., Chun M. M.. The fusiform face area: A module in human extrastriate cortex specialized for face perception. The Journal of Neuroscience. 1997 ; 17 (11). 4302-4311
41. Kassam K. S., Markey A. R., Cherkassky V. L., Loewenstein G., Just M. A.. Identifying emotions on the basis of neural activation. PLoS One. 2013 ; 8 (6). e66032
42. Kay K. N., Naselaris T., Prenger R. J., Gallant J. L.. Identifying natural images from human brain activity. Nature. 2008 ; 452 (7185). 352-355
43. Kober H., Barrett L. F., Joseph J., Bliss-Moreau E., Lindquist K., Wager T. D.. Functional grouping and cortical-subcortical interactions in emotion: A meta-analysis of neuroimaging studies. Neuroimage. 2008 ; 42 (2). 998-1031
44. Kolodyazhniy V., Kreibig S. D., Gross J. J., Roth W. T., Wilhelm F. H.. An affective computing approach to physiological emotion specificity: Toward subject-independent and stimulus-independent classification of film-induced emotions. Psychophysiology. 2011 ; 48 (7). 908-922
45. Kotz S. A., Kalberlah C., Bahlmann J., Friederici A. D., Haynes J. D.. Predicting vocal emotion expressions from the human brain. Human Brain Mapping. 2012 ; 34 (8). 1971-1981
46. Kragel P. A., LaBar K. S.. Multivariate pattern classification reveals autonomic and experiential representations of discrete emotions. Emotion. 2013 ; 13 (4). 681-690
47. Kreibig S. D., Wilhelm F. H., Roth W. T., Gross J. J.. Cardiovascular, electrodermal, and respiratory response patterns to fear- and sadness-inducing films. Psychophysiology. 2007 ; 44 (5). 787-806
48. Kriegeskorte N., Goebel R., Bandettini P.. Information-based functional brain mapping. Proceedings of the National Academy of Sciences, USA. 2006 ; 103 (10). 3863-3868
49. Kriegeskorte N., Mur M., Bandettini P.. Representational similarity analysis: Connecting the branches of systems neuroscience. Frontiers in System Neuroscience. 2008 ; 2: 4
50. Kriegeskorte N., Simmons W. K., Bellgowan P. S., Baker C. I.. Circular analysis in systems neuroscience: The dangers of double dipping. Nature Neuroscience. 2009 ; 12 (5). 535-540
51. Liberzon I., Phan K. L., Decker L. R., Taylor S. F.. Extended amygdala and emotional salience: A PET activation study of positive and negative affect. Neuropsychopharmacology. 2003 ; 28 (4). 726-733
52. Lindquist K. A., Barrett L. F.. A functional architecture of the human brain: Emerging insights from the science of emotion. Trends in Cognitive Sciences. 2012 ; 16 (11). 533-540
53. Lindquist K. A., Wager T. D., Kober H., Bliss-Moreau E., Barrett L. F.. The brain basis of emotion: A meta-analytic review. Behavioral and Brain Sciences. 2012 ; 35 (3). 121-143
54. Martin A., Chao L. L.. Semantic memory and the brain: Structure and processes. Current Opinion in Neurobiology. 2001 ; 11 (2). 194-201
55. Misaki M., Kim Y., Bandettini P. A., Kriegeskorte N.. Comparison of multivariate classifiers and response normalizations for pattern-information fMRI. Neuroimage. 2010 ; 53 (1). 103-118
56. Nelson S. M., Dosenbach N. U., Cohen A. L., Wheeler M. E., Schlaggar B. L., Petersen S. E.. Role of the anterior insula in task-level control and focal attention. Brain Structure and Function. 2010 ; 214 (5-6). 669-680
57. Norman K. A., Polyn S. M., Detre G. J., Haxby J. V.. Beyond mind-reading: Multi-voxel pattern analysis of fMRI data. Trends in Cognitive Sciences. 2006 ; 10 (9). 424-430
58. Nyklicek I., Thayer J. F., van Doornen L. J. P.. Cardiorespiratory differentiation of musically-induced emotions. Journal of Psychophysiology. 1997 ; 11 (4). 304-321
59. Ochsner K. N.. Current directions in social cognitive neuroscience. Current Opinion in Neurobiology. 2004 ; 14 (2). 254-258
60. Ochsner K. N., Gross J. J.. The cognitive control of emotion. Trends in Cognitive Sciences. 2005 ; 9 (5). 242-249
61. Ochsner K. N., Knierim K., Ludlow D. H., Hanelin J., Ramachandran T., Glover G., Mackey S. C.. Reflecting upon feelings: An fMRI study of neural systems supporting the attribution of emotion to self and other. Journal of Cognitive Neuroscience. 2004 ; 16 (10). 1746-1772
62. Op de Beeck H. P.. Against hyperacuity in brain reading: Spatial smoothing does not hurt multivariate fMRI analyses?. Neuroimage. 2010 ; 49 (3). 1943-1948
63. Panksepp J.. Toward a general psycho-biological theory of emotions. Behavioral and Brain Sciences. 1982 ; 5 (3). 407-422
64. Panksepp J. Affective neuroscience: The foundations of human and animal emotions. New York, NY: Oxford University Press ; 1998 :
65. Paton J. J., Belova M. A., Morrison S. E., Salzman C. D.. The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature. 2006 ; 439 (7078). 865-870
66. Pessoa L., Padmala S.. Quantitative prediction of perceptual decisions during near-threshold fear detection. Proceedings of the National Academy Science, USA. 2005 ; 102 (15). 5612-5617
67. Pessoa L., Padmala S.. Decoding near-threshold perception of fear from distributed single-trial brain activation. Cerebral Cortex. 2007 ; 17 (3). 691-701
68. Phan K. L., Taylor S. F., Welsh R. C., Decker L. R., Noll D. C., Nichols T. E.,... Liberzon I.. Activation of the medial prefrontal cortex and extended amygdala by individual ratings of emotional arousal: A fMRI study. Biological Psychiatry. 2003 ; 53 (3). 211-215
69. Phan K. L., Wager T., Taylor S. F., Liberzon I.. Functional neuroanatomy of emotion: A meta-analysis of emotion activation studies in PET and fMRI. Neuroimage. 2002 ; 16 (2). 331-348
70. Phillips A. G., Ahn S., Howland J. G.. Amygdalar control of the mesocorticolimbic dopamine system: Parallel pathways to motivated behavior. Neuroscience and Biobehavioral Reviews. 2003 ; 27 (6). 543-554
71. Poldrack R. A.. Can cognitive processes be inferred from neuroimaging data?. Trends in Cognitive Sciences. 2006 ; 10 (2). 59-63
72. Poldrack R. A., Halchenko Y. O., Hanson S. J.. Decoding the large-scale structure of brain function by classifying mental states across individuals. Psychological Science. 2009 ; 20 (11). 1364-1372
73. Posner J., Russell J. A., Gerber A., Gorman D., Colibazzi T., Yu S.,... Peterson B. S.. The neurophysiological bases of emotion: An fMRI study of the affective circumplex using emotion-denoting words. Human Brain Mapping. 2009 ; 30 (3). 883-895
74. Rainville P., Bechara A., Naqvi N., Damasio A. R.. Basic emotions are associated with distinct patterns of cardiorespiratory activity. International Journal of Psychophysiology. 2006 ; 61 (1). 5-18
75. Rolls E. T.. A theory of emotion, and its application to understanding the neural basis of emotion. Cognition & Emotion. 1990 ; 4 (3). 161-190
76. Rolls E. T., Grabenhorst F., Franco L.. Prediction of subjective affective state from brain activations. Journal of Neurophysiology. 2009 ; 101 (3). 1294-1308
77. Russell J. A.. A circumplex model of affect. Journal of Personality and Social Psychology. 1980 ; 39 (6). 1161-1178
78. Said C. P., Moore C. D., Engell A. D., Todorov A., Haxby J. V.. Distributed representations of dynamic facial expressions in the superior temporal sulcus. Journal of Vision. 2010 ; 10 ( 5 ):
79. Scherer K. R. Approaches to emotion. Scherer K. R. Ekman P., ed. Hillsdale, NJ: L. Erlbaum Associates ; 1984: 293-317.
80. Schwartz G. E., Weinberger D. A., Singer J. A.. Cardiovascular differentiation of happiness, sadness, anger, and fear following imagery and exercise. Psychosomatic Medicine. 1981 ; 43 (4). 343-364
81. Sinha R., Parsons O. A.. Multivariate response patterning of fear and anger. Cognition & Emotion. 1996 ; 10 (2). 173-198
82. Sitaram R., Lee S., Ruiz S., Rana M., Veit R., Birbaumer N.. Real-time support vector classification and feedback of multiple emotional brain states. Neuroimage. 2011 ; 56 (2). 753-765
83. Smith C. A., Ellsworth P. C.. Patterns of cognitive appraisal in emotion. Journal of Personality and Social Psychology. 1985 ; 48 (4). 813-838
84. Stephens C. L., Christie I. C., Friedman B. H.. Autonomic specificity of basic emotions: Evidence from pattern classification and cluster analysis. Biological Psychology. 2010 ; 84 (3). 463-473
85. Todd M. T., Nystrom L. E., Cohen J. D.. Confounds in multivariate pattern analysis: Theory and rule representation case study. Neuroimage, 77. 2013 ;: 157-165
86. Tomkins S. S. Affect, imagery, consciousness. New York, NY: Springer ; 1962 :
87. Tong F., Pratte M. S.. Decoding patterns of human brain activity. Annual Review of Psychology, 63. 2012 ;: 483-509
88. Wager T., Barrett L. F., Bliss-Moreau E., Lindquist K., Duncan S., Kober H.,... Mize J. Handbook of emotions. 2008 ). The neuroimaging of emotion. In LewisM.Haviland-JonesJ. M.BarrettL. F. (Eds.), Handbook of emotions (3rd ed., pp. 249-267). New York, NY: Guilford Press. Lewis M. Haviland-Jones J. M. Barrett L. F., ed. New York, NY: Guilford Press ; 2008: 249-267.
89. Winston J. S., O'Doherty J., Dolan R. J.. Common and distinct neural responses during direct and incidental processing of multiple facial emotions. Neuroimage. 2003 ; 20 (1). 84-97
90. Yarkoni T., Poldrack R. A., Nichols T. E., van Essen D. C., Wager T. D.. Large-scale automated synthesis of human functional neuroimaging data. Nature Methods. 2011 ; 8 (8). 665-670