Decoding individual natural scene representations during perception and imagery

Frontiers in Human Neuroscience

Volumn 8, Issue 1 FEB, 2014, Pages

  Johnson, Matthew R ^a   Johnson, Marcia K ^a  

^a YALE UNIVERSITY   (United States)

Author keywords

Classification; Decoding; fMRI; MVPA; PPA; Scene; Visual imagery; Visual perception

Indexed keywords

ADULT; ANALYTIC METHOD; AREA UNDER THE CURVE; ARTICLE; BRAIN FUNCTION; BRAIN REGION; CONTROLLED STUDY; DECODING; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUSIFORM FACE AREA; HUMAN; HUMAN EXPERIMENT; IMAGERY; INTRAPARIETAL SULCUS; MALE; MENTAL TASK; MULTIVOXEL PATTERN ANALYSIS; NEUROIMAGING; NORMAL HUMAN; OCCIPITAL PLACE AREA; PARAHIPPOCAMPAL PLACE AREA; PERCEPTION; PRECUNEUS; RECEIVER OPERATING CHARACTERISTIC; RETROSPLENIAL CORTEX; SUPPORT VECTOR MACHINE; TASK PERFORMANCE; VISUAL CORTEX; WORKING MEMORY;

EID: 84894047912     PISSN: 16625161     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnhum.2014.00059     Document Type: Article

References (55)

1. Bonnici, H. M., Kumaran, D., Chadwick, M. J., Weiskopf, N., Hassabis, D., and Maguire, E. A. (2012). Decoding representations of scenes in the medial temporal lobes. Hippocampus 22, 1143-1153. doi: 10.1002/hipo. 20960
2. Cichy, R. M., Heinzle, J., and Haynes, J.-D. (2012). Imagery and perception share cortical representations of content and location. Cereb. Cortex 22, 372-380. doi: 10.1093/cercor/bhr106
3. Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences, 2nd Edn. Hillsdale, NJ: Erlbaum.
4. Coutanche, M. N. (2013). Distinguishing multi-voxel patterns and mean activation: why, how, and what does it tell us? Cogn. Affect. Behav. Neurosci. 13, 667-673. doi: 10.3758/s13415-013-0186-2
5. Cox, D. D., and Savoy, R. L. (2003). Functional magnetic resonance imaging (fMRI) "brain reading": detecting and classifying distributed patterns of fMRI activity in human visual cortex. Neuroimage 19, 261-270. doi: 10.1016/S10538119(03)00049-1
6. Curtis, C. E., and D'Esposito, M. (2003). Persistent activity in the prefrontal cortex during working memory. Trends Cogn. Sci. 7, 415-423. doi: 10.1016/S13646613(03)00197-9
7. Dilks, D. D., Julian, J. B., Paunov, A. M., and Kanwisher, N. (2013). The occipital place area is causally and selectively involved in scene perception. J. Neurosci. 33, 1331-1336. doi: 10.1523/JNEUROSCI.4081-12.2013
8. Druzgal, T. J., and D'Esposito, M. (2003). Dissecting contributions of prefrontal cortex and fusiform face area to face working memory. J. Cogn. Neurosci. 15, 771-784. doi: 10.1162/089892903322370708
9. Duchaine, B., and Yovel, G. (2008). "Face recognition," in The Senses: A Comprehensive Reference, Vol. 2, Vision II, eds A. I. Basbaum, A. Kaneko, G. M. Shepherd, and G. Westheimer (San Diego, CA: Academic Press), 329-357.
10. Eger, E., Ashburner, J., Haynes, J.-D., Dolan, R. J., and Rees, G. (2008). fMRI activity patterns in human LOC carry information about object exemplars within category. J. Cogn. Neurosci. 20, 356-370. doi: 10.1162/jocn.2008.20019
11. Epstein, R. A. (2008). Parahippocampal and retrosplenial contributions to human spatial navigation. Trends Cogn. Sci. 12, 388-396. doi: 10.1016/j.tics.2008.07.004
12. Epstein, R. A., and Kanwisher, N. (1998). A cortical representation of the local visual environment. Nature 392, 598-601. doi: 10.1038/33402
13. Epstein, R. A., and Morgan, L. K. (2012). Neural responses to visual scenes reveals inconsistencies between fMRI adaptation and multivoxel pattern analysis. Neuropsychologia 50, 530-543. doi: 10.1016/j.neuropsychologia.2011.09.042
14. Fisher, R. A. (1925). Statistical Methods for Research Workers. Edinburgh: Oliver and Boyd.
15. Gauthier, I., Skudlarski, P., Gore, J. C., and Anderson, A. W. (2000). Expertise for cars and birds recruits brain areas involved in face recognition. Nat. Neurosci. 3, 191-197. doi: 10.1038/72140
16. Grill-Spector, K. (2003). The neural basis of object perception. Curr. Opin. Neurobiol. 13, 1-8. doi: 10.1016/S0959-4388(03)00040-0
17. Han, X., Berg, A. C., Oh, H., Samaras, D., and Leung, H.-C. (2013). Multivoxel pattern analysis of selective representation of visual working memory in ventral temporal and occipital regions. Neuroimage 73, 8-15. doi: 10.1016/j.neuroimage.2013.01.055
18. Harrison, S. A., and Tong, F. (2009). Decoding reveals the contents of visual working memory in early visual areas. Nature 458, 632-635. doi: 10.1038/nature07832
19. Haxby, J. V., Gobbini, M. I., Furey, M. L., Ishai, A., Schouten, J. L., and Pietrini, P. (2001). Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 293, 2425-2430. doi: 10.1126/science. 1063736
20. Johnson, M. R., and Johnson, M. K. (2009). Top-down enhancement and suppression of activity in category-selective extrastriate cortex from an act of reflective attention. J. Cogn. Neurosci. 21, 2320-2327. doi: 10.1162/jocn.2008. 21183
21. Johnson, M. R., Mitchell, K. J., Raye, C. L., D'Esposito, M., and Johnson, M. K. (2007). A brief thought can modulate activity in extrastriate visual areas: top-down effects of refreshing just-seen visual stimuli. Neuroimage 37, 290-299. doi: 10.1016/j.neuroimage.2007.05.017
22. Kanwisher, N., McDermott, J., and Chun, M. M. (1997). The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 17, 4302-4311.
23. Kanwisher, N., Stanley, D., and Harris, A. (1999). The fusiform face area is selective for faces not animals. Neuroreport 10, 183-187. doi: 10.1097/00001756199901180-00035
24. Kay, K. N., Naselaris, T., Prenger, R. J., and Gallant, J. L. (2008). Identifying natural images from human brain activity. Nature 452, 352-355. doi: 10.1038/nature06713
25. Kimmel, H. D. (1957). Three criteria for the use of one-tailed tests. Psychol. Bull. 54, 351-353. doi: 10.1037/h0046737
26. Kosslyn, S. M., Ganis, G., and Thompson, W. L. (2001). Neural foundations of imagery. Nat. Rev. Neurosci. 2, 635-642. doi: 10.1038/35090055
27. Kriegeskorte, N., Formisano, E., Sorger, B., and Goebel, R. (2007). Individual faces elicit distinct response patterns in human anterior temporal cortex. Proc. Natl. Acad. Sci. U.S.A. 104, 20600-20605. doi: 10.1073/pnas.0705654104
28. Lee, S.-H., Kravitz, D. J., and Baker, C. I. (2012). Disentangling visual imagery and perception of real-world objects. Neuroimage 59, 4064-4073. doi: 10.1016/j.neuroimage.2011.10.055
29. Lepsien, J., and Nobre, A. C. (2007). Attentional modulation of object representations in working memory. Cereb. Cortex 17, 2072-2083. doi: 10.1093/cercor/bhl116
30. MacEvoy, S. P., and Epstein, R. A. (2007). Position selectivity in scene-and object-responsive occipitotemporal regions. J. Neurophysiol. 98, 2089-2098. doi: 10.1152/jn.00438.2007
31. McCarthy, G., Puce, A., Gore, J. C., and Allison, T. (1997). Face-specific processing in the human fusiform gyrus. J. Cogn. Neurosci. 9, 605-610. doi: 10.1162/jocn.1997.9.5.605
32. Miyawaki, Y., Uchida, H., Yamashita, O., Sato, M., Morito, Y., Tanabe, H., et al. (2008). Visual image reconstruction from human brain activity using a combination of multiscale local image decoders. Neuron 60, 915-929. doi: 10.1016/j.neuron.2008.11.004
33. Norman, K. A., Polyn, S. M., Detre, G. J., and Haxby, J. V. (2006). Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn. Sci. 10, 424-430. doi: 10.1016/j.tics.2006.07.005
34. O'Craven, K. M., and Kanwisher, N. (2000). Mental imagery of faces and places activates corresponding stimulus-specific brain regions. J. Cogn. Neurosci. 12, 1013-1023. doi: 10.1162/08989290051137549
35. Oliva, A., and Torralba, A. (2006). Building the gist of a scene: the role of global image features in recognition. Prog. Brain Res. 155, 23-36. doi: 10.1016/S00796123(06)55002-2
36. Park, S., Brady, T. F., Greene, M. R., and Oliva, A. (2011). Disentangling scene content from spatial boundary: complementary roles for the parahippocampal place area and lateral occipital complex in representing real-world scenes. J. Neurosci. 31, 1333-1340. doi: 10.1523/JNEUROSCI.388510.2011
37. Park, S., and Chun, M. M. (2009). Different roles of the parahippocampal place area (PPA) and retrosplenial cortex (RSC) in panoramic scene perception. Neuroimage 47, 1747-1756. doi: 10.1016/j.neuroimage.2009.04.058
38. Park, S., Chun, M. M., and Johnson, M. K. (2010). Refreshing and integrating visual scenes in scene-selective cortex. J. Cogn. Neurosci. 22, 2813-2822. doi: 10.1162/jocn.2009.21406
39. Pasternak, T., and Greenlee, M. W. (2005). Working memory in primate sensory systems. Nat. Rev. Neurosci. 6, 97-107. doi: 10.1038/nrn1603
40. Petrides, M. (1994). "Frontal lobes and working memory: evidence from investigations of the effects of cortical excisions in nonhuman primates," in Handbook of Neuropsychology, Vol. 9, eds F. Boller and J. Grafman (Amsterdam: Elsevier Science), 59-82.
41. Postle, B. R., Druzgal, T. J., and D'Esposito, M. (2003). Seeking the neural substrates of visual working memory storage. Cortex 39, 927-946. doi: 10.1016/S00109452(08)70871-2
42. Puri, A. M., Wojciulik, E., and Ranganath, C. (2009). Category expectation modulates baseline and stimulus-evoked activity in human inferotemporal cortex. Brain Res. 1301, 89-99. doi: 10.1016/j.brainres.2009.08.085
43. Ranganath, C., DeGutis, J., and D'Esposito, M. (2004). Category-specific modulation of inferior temporal activity during working memory encoding and maintenance. Brain Res. Cogn. Brain Res. 20, 37-45. doi: 10.1016/j.cogbrainres.2003.11.017
44. Ranganath, C., and D'Esposito, M. (2005). Directing the mind's eye: prefrontal, inferior and medial temporal mechanisms for visual working memory. Curr. Opin. Neurobiol. 15, 175-182. doi: 10.1016/j.conb.2005. 03.017
45. Reddy, L., Tsuchiya, N., and Serre, T. (2010). Reading the mind's eye: decoding category information during mental imagery. Neuroimage 50, 818-825. doi: 10.1016/j.neuroimage.2009.11.084
46. Ruchkin, D. S., Grafman, J., Cameron, K., and Berndt, R. S. (2003). Working memory retention systems: a state of activated long-term memory. Behav. Brain Sci. 26, 709-728. doi: 10.1017/S0140525X03000165
47. Serences, J. T., Ester, E. F., Vogel, E. K., and Awh, E. (2009). Stimulus-specific delay activity in human primary visual cortex. Psychol. Sci. 20, 207-214. doi: 10.1111/j.1467-9280.2009.02276.x
48. Stokes, M., Thompson, R., Cusack, R., and Duncan, J. (2009). Top-down activation of shape-specific population codes in visual cortex during mental imagery. J. Neurosci. 29, 1565-1572. doi: 10.1523/JNEUROSCI.465708.2009
49. Thirion, B., Duchesnay, E., Hubbard, E., Dubois, J., Poline, J.-B., Lebihan, D., et al. (2006). Inverse retinotopy: inferring the visual content of images from brain activation patterns. Neuroimage 33, 1104-1116. doi: 10.1016/j.neuroimage.2006.06.062
50. Tong, F., Nakayama, K., Moscovitch, M., Weinrib, O., and Kanwisher, N. (2000). Response properties of the human fusiform face area. Cogn. Neuropsychol. 17, 257-279. doi: 10.1080/026432900380607
51. Walther, D. B., Caddigan, E., Fei-Fei, L., and Beck, D. M. (2009). Natural scene categories revealed in distributed patterns of activity in the human brain. J. Neurosci. 29, 10573-10581. doi: 10.1523/JNEUROSCI.0559-09.2009
52. Wojciulik, E., Kanwisher, N., and Driver, J. (1998). Covert visual attention modulates face-specific activity in the human fusiform gyrus: fMRI study. J. Neurophysiol. 79, 1574-1578.
53. Xing, Y., Ledgeway, T., McGraw, P. V., and Schluppeck, D. (2013). Decoding working memory of stimulus contrast in early visual cortex. J. Neurosci. 33, 10301-10311. doi: 10.1523/JNEUROSCI.375412.2013
54. Yi, D.-J., and Chun, M. M. (2005). Attentional modulation of learning-related repetition attenuation effects in human parahippocampal cortex. J. Neurosci. 25, 3593-3600. doi: 10.1523/JNEUROSCI.4677-04.2005
55. Yovel, G., and Kanwisher, N. (2004). Face perception: domain specific, not process specific. Neuron 44, 889-898. doi: 10.1016/j.neuron.2004.11.018