Representations of modality-specific affective processing for visual and auditory stimuli derived from functional magnetic resonance imaging data

Human Brain Mapping

Volumn 35, Issue 7, 2014, Pages 3558-3568

  Shinkareva, Svetlana V ^a   Wang, Jing ^a   Kim, Jongwan ^a   Facciani, Matthew J ^a   Baucom, Laura B ^a   Wedell, Douglas H ^a  

^a UNIVERSITY OF SOUTH CAROLINA   (United States)

Author keywords

FMRI; Modality; Multivariate pattern analysis; STATIS; Valence

Indexed keywords

ADULT; AFFECT; ARTICLE; AUDITORY STIMULATION; BRAIN LEVEL; EMOTION; EXAMINATION; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; PRIORITY JOURNAL; PROCESSING; STIMULUS RESPONSE; VISUAL STIMULATION; AGED; ANALYSIS OF VARIANCE; BLOOD; BRAIN; BRAIN MAPPING; FEMALE; IMAGE PROCESSING; MIDDLE AGED; NUCLEAR MAGNETIC RESONANCE IMAGING; PHOTOSTIMULATION; PHYSIOLOGY; VASCULARIZATION;

OXYGEN;

ACOUSTIC STIMULATION; ADULT; AFFECT; AGED; ANALYSIS OF VARIANCE; BRAIN; BRAIN MAPPING; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; OXYGEN; PHOTIC STIMULATION;

EID: 84902184091     PISSN: 10659471     EISSN: 10970193     Source Type: Journal    
DOI: 10.1002/hbm.22421     Document Type: Article

References (46)

1. Abdi H, Dunlop JP, Williams LJ (2009): How to compute reliability estimates and display confidence and tolerance intervals for pattern classifiers using the Bootstrap and 3-way multidimensional scaling (DISTATIS). Neuroimage 45:89-95.
2. Abdi H, Williams LJ, Valentin D, Bennani-Dosse M (2012): STATIS and DISTATIS: Optimum multitable principal component analysis and three way metric multidimensional scaling. Wiley Interdiscip Rev Comput Stat 4:124-167.
3. Barrett LF, Bliss-Moreau E (2009): Affect as a psychological primitive. Adv Exp Soc Psychol 41, 167-218.
4. Baucom LB, Wedell DH, Wang J, Blitzer DN, Shinkareva SV (2012): Decoding the neural representation of affective states. Neuroimage 59:718-727.
5. Bishop CM (2006): Pattern Recognition and Machine Learning. New York: Springer.
6. Bradley MM, Lang PJ (2000): Affective reactions to acoustic stimuli. Psychophysiology 37:204-215.
7. Churchill NW, Oder A, Abdi H, Tam F, Lee W, Thomas C, Ween JE, Graham SJ, Strother S (2012): Optimizing preprocessing and analysis pipelines for single-subject FMRI. I. Standard temporal motion and physiological noise correction methods. Hum Brain Mapp 33:609-627.
8. Codispoti M, Mazzetti M, Bradley MM (2009): Unmasking emotion: Exposure duration and emotional engagement. Psychophysiology 46:731-738.
9. Connolly AC, Guntupalli JS, Gors J, Hanke M, Halchenko YO, Wu Y-C, Abdi H, Haxby JV (2012): The representation of biological classes in the human brain. J Neurosci 32:2608-2618.
10. Dan-Glauser ES, Scherer KR (2011): The Geneva affective picture database (GAPED): A new 730-picture database focusing on valence and normative significance. Behav Res Methods 43:468-477.
11. Edelman S, Grill-Spector K, Kushnir T, Malach R (1998): Toward direct visualization of the internal shape representation space by fMRI. Psychobiology 26:309-321.
12. Ethofer T, Van De Ville D, Scherer K, Vuilleumier P (2009): Decoding of emotional information in voice-sensitive cortices. Curr Biol 19:1028-1033.
13. Fecteau S, Belin P, Joanette Y, Armony JL (2007): Amygdala responses to nonlinguistic emotional vocalizations. Neuroimage 36:480-487.
14. Formisano E, De Martino F, Bonte M, Goebel R (2008): "Who" is saying "what"? Brain-based decoding of human voice and speech. Science 322:970-973.
15. Jimura K, Poldrack RA (2012): Analyses of regional-average activation and multivoxel pattern information tell complementary stories. Neuropsychologia 50:544-552.
16. Junghofer M, Bradley MM, Elbert TR, Lang PJ (2001): Fleeting images: A new look at early emotion discrimination. Psychophysiology 38:175-178.
17. Junghofer M, Sabatinelli D, Bradley MM, Schupp HT, Elbert TR, Lang PJ (2006): Fleeting images: Rapid affect discrimination in the visual cortex. Neuroreport 17:225-229.
18. Kassam KS, Markey AR, Cherkassky VL, Loewenstein G, Just MA (2013): Identifying emotions on the basis of neural activation. PLoS One 8:e66032.
19. Kherif F, Poline JB, Meriaux S, Benali H, Flandin G, Brett M (2003): Group analysis in functional neuroimaging: Selecting subjects using similarity measures. Neuroimage 20:2197-2208.
20. Kotz SA, Kalberlah C, Bahlmann J, Friederici AD, Haynes JD (2013): Predicting vocal emotion expressions from the human brain. Hum Brain Mapp 34:1971-1981.
21. Kriegeskorte N, Mur M, Bandettini P (2008a): Representational similarity analysis-Connecting the branches of systems neuroscience. Front Syst Neurosci 2:1-28.
22. Kriegeskorte N, Mur M, Ruff DA, Kiani R, Bodurka J, Esteky H, Tanaka K, Bandettini PA (2008b): Matching categorical object representations in inferior temporal cortex of man and monkey. Neuron 60:1126-1141.
23. Lakens D, Fockenberg DA, Lemmens KPH, Ham J, Midden CJH (2013): Brightness differences influence the evaluation of affective pictures. Cogn Emot 27:1225-1246.
24. Lang PJ, Bradley MM, Cuthbert BN (2008): International Affective Picture System (IAPS): Affective Ratings of Pictures and Instruction Manual. Gainesville, FL: University of Florida.
25. Lang PJ, Bradley MM, Fitzsimmons JR, Cuthbert BN, Scott JD, Moulder B, Nangia V (1998): Emotional arousal and activation of the visual cortex: An fMRI analysis. Psychophysiology 35:199-210.
26. Lavit C, Escoufier Y, Sabatier R, Traissac P (1994): The ACT (STATIS method). Comput Stat Data Anal 18:97-119.
27. Misaki M, Kim Y, Bandettini PA, Kriegeskorte N (2010): Comparison of multivariate classifiers and response normalizations for pattern-information fMRI. Neuroimage 53:103-118.
28. Mourao-Miranda J, Volchan E, Moll J, de Oliveira-Souza R, Oliveira L, Bramati I, Gattass R, Pessoa L (2003): Contributions of stimulus valence and arousal to visual activation during emotional perception. Neuroimage 20:1955-1963.
29. Mühl C, van den Broek EL, Brouwer A-M, Nijboer F, van Wouwe N, Heylen D (2011): Affective brain-computer interfaces. In: D'Mello S, Graesser A, Schuller B, Martin J-C, editors. Affective Computing and Intelligent Interaction. Memphis, TN: Springer. pp 235-245.
30. O'Toole AJ, Jiang F, Abdi H, Penard N, Dunlop JP, Parent MA (2007): Theoretical, statistical, and practical perspectives on pattern-based classification approaches to the analysis of functional neuroimaging data. J Cognitive Neurosci 19:1735-1752.
31. Peelen MV, Atkinson AP, Vuilleumier P (2010): Supramodal representations of perceived emotions in the human brain. J Neurosci 30:10127-10134.
32. Pereira F, Mitchell T, Botvinick M (2009): Machine learning classifiers and fMRI: A tutorial overview. Neuroimage 45:S199-S209.
33. Pessoa L, Padmala S (2007): Decoding near-threshold perception of fear from distributed single-trial brain activation. Cereb Cortex 17:691-701.
34. Plichta MM, Gerdes ABM, Alpers GW, Harnisch W, Brill S, Wieser MJ, Fallgatter AJ (2011): Auditory cortex activation is modulated by emotion: A functional near-infrared spectroscopy (fNIRS) study. Neuroimage 55:1200-1207.
35. Robert P, Escoufier Y (1976): A unifying tool for linear multivariate statistical methods: The RV-coefficient. Appl Stat 25:257-265.
36. Russell J (2003): Core affect and the psychological construction of emotion. Psychol Rev 110:145-172.
37. Russell J, Barrett LF (1999): Core affect, prototypical emotional episodes, and other things called emotion: Dissecting the elephant. J Pers Soc Psychol 76:805-819.
38. Said CP, Moore CD, Engell AD, Todorov A, Haxby JV (2010): Distributed representations of dynamic facial expressions in the superior temporal sulcus. J Vis 10:1-12.
39. Shinkareva SV, Malave VL, Just MA, Mitchell TM (2012): Exploring commonalities across participants in the neural representation of objects. Hum Brain Mapp 33:1375-1383.
40. Shinkareva SV, Malave VL, Mason RA, Mitchell TM, Just MA (2011): Commonality of neural representations of words and pictures. Neuroimage 54:2418-2425.
41. Shinkareva SV, Mason RA, Malave VL, Wang W, Mitchell TM, Just MA (2008): Using fMRI brain activation to identify cognitive states associated with perception of tools and dwellings. PLoS One 3:e1394.
42. Shinkareva SV, Wang J, Wedell DH (2013): Examining similarity structure: Multidimensional scaling and related approaches in neuroimaging. Comput Math Methods Med 2013:796183.
43. Sitaram R, Lee S, Ruiz S, Rana M, Veit R, Birbaumer N (2011): Real-time support vector classification and feedback of multiple emotional brain states. Neuroimage 56:753-765.
44. Viinikainen M, Kätsyri J, Sams M (2012): Representation of perceived sound valence in the human brain. Hum Brain Mapp 33:2295-2305.
45. Wang J, Baucom L, Shinkareva SV (2013): Decoding abstract and concrete concept representations based on single-trial fMRI data. Hum Brain Mapp 34:1133-1147.
46. Yuen KSL, Johnston SJ, De Martino F, Sorger B, Formisano E, Linden DEJ, Goebel R (2012): Pattern classification predicts individuals' responses to affective stimuli. Transl Neurosci 3:278-287.