Reading the mind's eye: Decoding category information during mental imagery

NeuroImage

Volumn 50, Issue 2, 2010, Pages 818-825

  Reddy, Leila ^a,b   Tsuchiya, Naotsugu ^b,c   Serre, Thomas ^d,e  

^a Brain and Cognition Research Center in Toulouse   (France)

^b CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^c TAMAGAWA UNIVERSITY   (Japan)

^d MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^e BROWN UNIVERSITY   (United States)

Author keywords

fMRI; Imagery; Multi voxel pattern analysis; Object recognition; Occipito temporal cortex; Perception

Indexed keywords

ARTICLE; BRAIN FUNCTION; CONTROLLED STUDY; EVOKED VISUAL RESPONSE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; IMAGE ANALYSIS; IMAGERY; MENTAL IMAGERY; MENTAL PERFORMANCE; NEUROIMAGING; NORMAL HUMAN; PATTERN RECOGNITION; PRIORITY JOURNAL; TEMPORAL CORTEX; VISUAL DISCRIMINATION; VISUAL MEMORY; VISUAL STIMULATION; BRAIN; BRAIN MAPPING; COMPUTER ASSISTED DIAGNOSIS; IMAGINATION; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY;

BRAIN; BRAIN MAPPING; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGINATION; MAGNETIC RESONANCE IMAGING; PATTERN RECOGNITION, VISUAL;

EID: 77950792245     PISSN: 10538119     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2009.11.084     Document Type: Article

References (39)

1. Amedi, A., Malach, R., Pascual-Leone, A., 2005. Negative BOLD differentiates visual imagery and perception. Neuron 48, 859-872.
2. Carlson, T.A., Schrater, P., He, S., 2003. Patterns of activity in the categorical representations of objects. J. Cogn. Neurosci. 15, 704-717.
3. Cox, D.D., Savoy, R.L., 2003. Functional magnetic resonance imaging (fMRI) "brain reading": detecting and classifying distributed patterns of fMRI activity in human visual cortex. Neuroimage 19, 261-270.
4. Cui, X., Jeter, C.B., Yang, D., Montague, P.R., Eagleman, D.M., 2007. Vividness of mental imagery: individual variability can be measured objectively. Vision Res. 47, 474-478.
5. D'Esposito, M., Detre, J.A., Aguirre, G.K., Stallcup, M., Alsop, D.C., Tippet, L.J., Farah, M.J., 1997. A functional MRI study of mental image generation. Neuropsychologia 35, 725-730.
6. Finke, R.A., 1985. Theories relating mental imagery to perception. Psychol. Bull. 98, 236-259.
7. Fischl, B., Sereno, M.I., Tootell, R.B., Dale, A.M., 1999. High-resolution intersubject averaging and a coordinate system for the cortical surface. Hum. Brain Mapp. 8, 272-284.
8. Formisano, E., Linden, D.E., Di Salle, F., Trojano, L., Esposito, F., Sack, A.T., Grossi, D., Zanella, F.E., Goebel, R., 2002. Tracking the mind's image in the brain I: time-resolved fMRI during visuospatial mental imagery. Neuron 35, 185-194.
9. Ganis, G., Thompson, W.L., Kosslyn, S.M., 2004. Brain areas underlying visual mental imagery and visual perception: an fMRI study. Brain Res. Cogn. Brain Res. 20, 226-241.
10. Goebel, R., Khorram-Sefat, D., Muckli, L., Hacker, H., Singer, W., 1998. The constructive nature of vision: direct evidence from functional magnetic resonance imaging studies of apparent motion and motion imagery. Eur. J. Neurosci. 10, 1563-1573.
11. Harrison, S.A., Tong, F., 2009. Decoding reveals the contents of visual working memory in early visual areas. Nature 458, 632-635.
12. Haxby, J.V., Gobbini, M.I., Furey, M.L., Ishai, A., Schouten, J.L., Pietrini, P., 2001. Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 293, 2425-2430.
13. Haynes, J.D., Rees, G., 2005. Predicting the orientation of invisible stimuli from activity in human primary visual cortex. Nat. Neurosci. 8, 686-691.
14. Ishai, A., Sagi, D., 1995. Common mechanisms of visual imagery and perception. Science 268, 1772-1774.
15. Ishai, A., Haxby, J.V., Ungerleider, L.G., 2002. Visual imagery of famous faces: effects of memory and attention revealed by fMRI. Neuroimage 17, 1729-1741.
16. Ishai, A., Ungerleider, L.G., Haxby, J.V., 2000. Distributed neural systems for the generation of visual images. Neuron 28, 979-990.
17. Kamitani, Y., Tong, F., 2005. Decoding the visual and subjective contents of the human brain. Nat. Neurosci. 8, 679-685.
18. Kay, K.N., Naselaris, T., Prenger, R.J., Gallant, J.L., 2008. Identifying natural images from human brain activity. Nature 452, 352-355.
19. Knauff, M., Kassubek, J., Mulack, T., Greenlee, M.W., 2000. Cortical activation evoked by visual mental imagery as measured by fMRI. Neuroreport 11, 3957-3962.
20. Koch, C., Poggio, T., 1999. Predicting the visual world: silence is golden. Nat. Neurosci. 2, 9-10.
21. Kosslyn, S.M., Thompson, W.L., 2003. When is early visual cortex activated during visual mental imagery? Psychol. Bull. 129, 723-746.
22. Kosslyn, S.M., Thompson, W.L., Kim, I.J., Alpert, N.M., 1995. Topographical representations of mental images in primary visual cortex. Nature 378, 496-498.
23. Kosslyn, S.M., Pascual-Leone, A., Felician, O., Camposano, S., Keenan, J.P., Thompson, W.L., Ganis, G., Sukel, K.E., Alpert, N.M., 1999. The role of area 17 in visual imagery: convergent evidence from PET and rTMS. Science 284, 167-170.
24. Kreiman, G., Koch, C., Fried, I., 2000. Imagery neurons in the human brain. Nature 408, 357-361.
25. Lamme, V.A., Super, H., Spekreijse, H., 1998. Feedforward, horizontal, and feedback processing in the visual cortex. Curr. Opin. Neurobiol. 8, 529-535.
26. Mechelli, A., Price, C.J., Friston, K.J., Ishai, A., 2004. Where bottom-up meets top-down: neuronal interactions during perception and imagery. Cereb. Cortex 14, 1256-1265.
27. Murray, S.O., Kersten, D., Olshausen, B.A., Schrater, P., Woods, D.L., 2002. Shape perception reduces activity in human primary visual cortex. Proc. Natl. Acad. Sci. U.S.A. 99, 15164-15169.
28. Norman, K.A., Polyn, S.M., Detre, G.J., Haxby, J.V., 2006. Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn. Sci. 10, 424-430.
29. O'Craven, K.M., Kanwisher, N., 2000. Mental imagery of faces and places activates corresponding stiimulus-specific brain regions. J. Cogn. Neurosci. 12, 1013-1023.
30. Rao, R.P., Ballard, D.H., 1999. Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat. Neurosci. 2, 79-87.
31. Reddy, L., Kanwisher, N., 2007. Category selectivity in the ventral visual pathway confers robustness to clutter and diverted attention. Curr. Biol. 17, 2067-2072.
32. Serences, J.T., Boynton, G.M., 2007. Feature-based attentional modulations in the absence of direct visual stimulation. Neuron 55, 301-312.
33. Serre, T., 2006. Learning a Dictionary of Shape-Components in Visual Cortex: Comparison with Neurons, Humans and Machines. Brain and Cognitive Sciences. Massachusetts Institute of Technology, Cambrdige, MA.
34. Slotnick, S.D., Thompson, W.L., Kosslyn, S.M., 2005. Visual mental imagery induces retinotopically organized activation of early visual areas. Cereb. Cortex 15, 1570-1583.
35. Spiridon, M., Kanwisher, N., 2002. How distributed is visual category information in human occipito-temporal cortex? An fMRI study. Neuron 35, 1157-1165.
36. Stokes, M., Thompson, R., Cusack, R., Duncan, J., 2009. Top-down activation of shape-specific population codes in visual cortex during mental imagery. J. Neurosci. 29, 1565-1572.
37. Trojano, L., Grossi, D., Linden, D.E., Formisano, E., Hacker, H., Zanella, F.E., Goebel, R., Di Salle, F., 2000. Matching two imagined clocks: the functional anatomy of spatial analysis in the absence of visual stimulation. Cereb. Cortex 10, 473-481.
38. Wheeler, M.E., Petersen, S.E., Buckner, R.L., 2000. Memory's echo: vivid remembering reactivates sensory-specificcortex.Proc.Natl.Acad.Sci.U.S.A. 97, 11125-11129.
39. Williams, M.A., Baker, C.I., Op de Beeck, H.P., Shim, W.M., Dang, S., Triantafyllou, C., Kanwisher, N., 2008. Feedback of visual object information to foveal retinotopic cortex. Nat. Neurosci. 11, 1439-1445.