Decoding visual object categories in early somatosensory cortex

Cerebral Cortex

Volumn 25, Issue 4, 2015, Pages 1020-1031

  Smith, Fraser W ^a,b   Goodale, Melvyn A ^b  

^a UNIVERSITY OF EAST ANGLIA   (United Kingdom)

^b UNIVERSITY OF WESTERN ONTARIO   (Canada)

Author keywords

multisensory; multivoxel pattern analysis; posterior parietal cortex; S1; S2

Indexed keywords

ARTICLE; DECODING; EXPERIENCE; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUNCTIONAL NEUROIMAGING; HUMAN; HUMAN EXPERIMENT; INFORMATION; MALE; MENTAL FUNCTION; NORMAL HUMAN; POSTCENTRAL GYRUS; PRIORITY JOURNAL; RETINA IMAGE; SENSATION; SOMATOSENSORY CORTEX; VISION; VISUAL OBJECT CATEGORY; BRAIN MAPPING; MULTIVARIATE ANALYSIS; NEUROPSYCHOLOGICAL TEST; NUCLEAR MAGNETIC RESONANCE IMAGING; PATTERN RECOGNITION; PERCEPTIVE DISCRIMINATION; PHYSIOLOGY; PROCEDURES; SIGNAL PROCESSING;

BRAIN MAPPING; DISCRIMINATION (PSYCHOLOGY); FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MULTIVARIATE ANALYSIS; NEUROPSYCHOLOGICAL TESTS; PATTERN RECOGNITION, VISUAL; SIGNAL PROCESSING, COMPUTER-ASSISTED; SOMATOSENSORY CORTEX;

EID: 84926633531     PISSN: 10473211     EISSN: 14602199     Source Type: Journal    
DOI: 10.1093/cercor/bht292     Document Type: Article

References (52)

1. Amunts K, Malikovic A, Mohlberg H, Schormann T, Zilles K. (2000). Broadmann's areas 17 and 18 brought into stereotaxic space-where and how variable? Neuroimage. 11: 66-84
2. Baler B, Kleinschmidt A, Muller NG. (2006). Cross-modal processing in early visual and auditory cortices depends on expected statistical relationship of multisensory information. J Neurosci. 26: 12260-12265
3. Calvert GA, Bullmore ET, Brammer MJ, Campbell R, Williams SCR, McQuire PK, Woodruff PWR, Iversen SD, David AS. (1997). Activation of auditory cortex during silent lipreading. Science. 276: 593-596
4. Chang CC, Lin CJ (2011). LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol. 2: 27
5. Chen Y, Namburi P, Elliott LT, Heinzle J, Soon CS, Chee MW, Haynes JD. (2011). Cortical surface-based searchlight decoding. Neuroimage. 56: 582-592
6. Clark A. (2013). Whatever next? Predictive brains, situated agents and the future of cognitive science. Behav Brain Sci. 36: 181-204
7. Coutanche MN, Thompson-Schill SL. (2012). The advantage of brief fMRI acquisition runs for multi-voxel pattern detection across runs. Neuroimage. 57: 1113-1119
8. Damasio AR. (1989). Time-locked multiregional retroactivation: a systems-level proposal for the neural substrates of recall and recognition. Cognition. 33: 25-62
9. Driver J, Noesselt T. (2008). Multisensory interplay reveals cross-modal influences on 'sensory-specific' brain regions, neural responses and judgements. Neuron. 57: 11-23
10. Duda RO, Hart PE, Stork DG. (2001). Pattern classification. New York: Wiley
11. Eickhoff SB, Amunts K, Mohlberg H, Zilles K. 2006B. The human parietal operculum. II. Stereotaxic maps and correlation with functional imaging results. Cereb Cortex. 16: 268-279
12. Eickhoff SB, Schleicher A, Zilles K, Amunts K. 2006A. The human parietal operculum. 1. Cytoarchitectonic mapping of subdivisions. Cereb Cortex. 16: 254-267
13. Eickhoff SB, Stephan KE, Mohlberg H, Grefkes C, Fink GR, Amunts K, Zilles K. (2005). A new SPM toolbox for combining probabilistic maps and functional imaging data. Neuroimage. 25: 1325-1335
14. Ethofer T, Van De Ville D, Scherer K, Vuilleumier P. (2009). Decoding of emotional information in voice-sensitive cortices. Curr Biol. 19: 1028-1033
15. Etzel JA, Gazzola V, Keysers C. (2008). Testing simulation theory with cross-modal multivariate classification of fMRI data. PLOS One. 3 (11): e3690
16. Gallivan JP, McClean DA, Flanagan JR, Culham JC. (2013). Where one hand meets the other: limb-specific and action-dependent movement plans decoded from preparatory signals in single human frontoparietal brain areas. J Neurosci. 33: 1991-2008
17. Gallivan JP, McClean DA, Smith FW, Culham JC. 2011b. Decoding effectordependent and effector-independent movement intentions from human parieto-frontal brain networks. J Neurosci. 31: 17149-17168
18. Gallivan JP, McClean DA, Valyear KF, Pettypiece CE, Culham JC. 2011a. Decoding action intentions from preparatory brain activity in human parieto-frontal networks. J Neurosci. 31: 9599-9610
19. Geyer S. (2003). The microstructural border between the motor and the cognitive domain in the human cerebral cortex. 1st ed. Wien: Springer
20. Geyer S, Ledberg A, Schleicher A, Kinomura S, Schormann T, Burgel U, Klingberg T, Larsson J, Zilles K, Roland PE. (2009). Two different areas within the primary motor cortex of man. Nature. 382: 805-807
21. Harrison SA, Tong F. (2009). Decoding reveals the contents of visual working memory in early visual areas. Nature. 458: 632-635
22. Hsiao S. (2008). Central mechanisms of tactile shape perception. Curr Opin Neurobiol. 18: 418-424
23. Huang RS, Sereno MI. (2007). Dodecapus: An MR-compatible system for somatosensory stimulation. Neuroimage. 34: 1060-1073
24. Kamitani Y, Tong F. (2005). Decoding the visual and subjective contents of the human brain. Nat Neurosci. 8: 679-685
25. Keysers C, Kaas JH, Gazzola V. (2010). Somatosensation in social perception. Nat Rev Neurosci. 11: 417-428
26. Kriegeskorte N, Goebel R, Bandettini P. (2006). Information-based functional brain mapping. Proc Natl Acad Sci USA. 103: 3863-3868
27. Kosslyn SM, Ganis G, Thompson WL. (2000). Neural foundations of imagery. Nat Rev Neurosci. 2: 635-642
28. Lancaster JL, Tordesillas D, Martinez M, Salinas F, Evans E, Zilles K, Mazziota JC, Fox PT. (2007). Bias between MNI and Talairach coordinates analysed using the ICBM-152 brain template. Hum Brain Mapp. 28: 1194-1205
29. McIntosh AR, Cabeza RE, Lobaugh NJ. (1998). Analysis of neural interactions explains the activation of occipital cortex by an auditory stimulus. J Neurophysiol. 80: 2790-2796
30. Meyer K, Damasio A. (2009). Convergence and divergence in a neural architecture for recognition and memory. Trends Neurosci. 32: 376-382
31. Meyer K, Kaplan JT, Essex R, Webber C, Damasio H, Damasio A. (2010). Predicting visual stimuli on the basis of activity in auditory cortices. Nat Neurosci. 13: 667-668
32. Meyer K, Kaplan JT, Essex R, Damasio H, Damasio AR. (2011). Seeing touch is correlated with content-specific activity in primary somatosensory cortex. Cereb Cortex. 21: 2113-2121
33. Milner AD, Goodale MA. (2006). The visual brain in action, 2nd ed. Oxford: Oxford University Press
34. Misaki M, Kim Y, Bandettini PA, Kriegeskorte N. (2010). Comparison of multivariate classifiers and response normalizations for patterninformation fMRI. Neuroimage. 53: 103-118
35. Morrison I, Tipper SP, Fenton-Adams WL, Bach P. (2013). Feeling Others' painful actions: the sensorimotor integration of pain and action information. Human Brain Map. 34: 1982-1998
36. Muckli L, Petro LS, Smith FW. (2013). Backwards is the way forward: feedback in the cortical hierarchy predicts the expected future. Behav Brain Sci. 36: 221
37. Nelson AJ, Chen R. (2008). Digit somatotopy within cortical areas of the postcentral gyrus in humans. Cereb Cortex. 18: 2341-2351
38. Nestor A, Plaut DC, Behrmann M. (2011). Unraveling the distributed neural code of facial identity through spatiotemporal pattern analysis. Proc Natl Acad Sci USA. 108: 9998-10003
39. Op De Beeck HP, Torfs K, Wagemans J. (2008). Perceived shape similarity among unfamiliar objects and the organization of the human object vision pathway. J Neurosci. 28: 10111-10123
40. Pereira F, Botvinick M. (2011). Information mapping with pattern classifiers: a comparative study. Neuroimage. 56: 476-496
41. Rorden C, Karnath HO, Bonilla L. (2007). Improving lesion-symptom mapping. J Cogn Neurosci. 19: 1081-1088
42. Rossit S, McAdam T, Mclean DA, Goodale MA, Culham JC. (2013). fMRI reveals a lower visual field preference for hand actions in human superior-parietal occipital cortex and precuneus. Cortex. 49: 2525-2541
43. Ruben J, Schwiemann J, Deuchert M, Meyer R, Krause T, Curio G, Villringer K, Kurth R, Villringer A. (2001). Somatotopic organization of human secondary somatosensory cortex. Cereb Cortex. 11: 463-473
44. Sakata H, Tatra M, Kusunoki M, Murata A, Tanaka Y. (1997). The parietal association cortex in depth perception and visual control of hand action. Trends Neurosci. 20: 350-357
45. Smith FW, Muckli L. (2010). Non-stimulated early visual areas carry information about surrounding context. Proc Natl Acad Sci USA. 107: 20099-20103
46. Stokes M, Thompson R, Cusack R, Duncan J. (2009). Top-down activation of shape-specific population codes in visual cortex during mental imagery. J Neurosci. 29: 1565-1572
47. VanWesten D, Fransson P, Olsrud J, Rosen B, Lundborg G, Larsson E. (2004). Finger somatotopy in area 3b: an fMRI-study. BMC Neurosci. 5: 28
48. Vetter P, Smith FW, Muckli L. (2011). Decoding natural sounds in early visual cortex. J Vis. 11: 779
49. Walther DB, Caddigan E, Fei-Fei L, Beck DM. (2009). Natural scene categories revealed in distributed patterns of activity in the human brain. J. Neurosci. 29: 10573-10581
50. Walther DB, Chai B, Caddigan E, Beck DM, Fei-Fei L. (2011). Simple line drawings suffice for functional MRI decoding of natural scene categories. Proc Natl Acad Sci USA. 23: 9661-9666
51. Zangenehpour S, Zatorre RJ. (2010). Crossmodal recruitment of primary visual cortex following brief exposure to bimodal audiovisual stimuli. Neuropsychologia. 48: 591-600
52. Zhou Y, Fuster JM. (2000). Visuo-Tactile cross-modal associations in cortical somatosensory cells. Proc Natl Acad Sci USA. 97: 9777-9782