Decoding face categories in diagnostic subregions of primary visual cortex

European Journal of Neuroscience

Volumn 37, Issue 7, 2013, Pages 1130-1139

  Petro, Lucy S ^a   Smith, Fraser W ^a   Schyns, Philippe G ^a   Muckli, Lars ^a  

^a UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

Diagnostic information; FMRI; Multivariate pattern classification; V1

Indexed keywords

ACCURACY; AMYGDALOID NUCLEUS; ARTICLE; BOLD SIGNAL; BRAIN FUNCTION; BRAIN REGION; FACIAL EXPRESSION; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; PRIORITY JOURNAL; RESPONSE TIME; STRIATE CORTEX; TASK PERFORMANCE; VISUAL DISCRIMINATION; VISUAL STIMULATION;

ADULT; BRAIN MAPPING; EYE; FACIAL EXPRESSION; FEMALE; FORM PERCEPTION; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MODELS, NEUROLOGICAL; MOUTH; VISUAL CORTEX;

EID: 84875664667     PISSN: 0953816X     EISSN: 14609568     Source Type: Journal    
DOI: 10.1111/ejn.12129     Document Type: Article

References (75)

1. Ahissar, M. & Hochstein, S. (2002) View from the top: hierarchies and reverse hierarchies in the visual system. Neuron, 36, 791-804.
2. Angelucci, A., Levitt, J.B., Walton, E.J., Hupe, J.M., Bullier, J. & Lund, J.S. (2002) Circuits for local and global signal integration in primary visual cortex. J. Neurosci., 22, 8633-8646.
3. Ayzenshtat, I., Gilad, A., Zweig, S. & Slovin, H. (2012) Populations' response to natural images in the primary visual cortex encodes basic attributes and perceptual processing. J. Neurosci., 3, 13971-13986.
4. Bar, M. (2007) The proactive brain: using analogies and associations to generate predictions. Trends. Cogn. Sci., 11, 280-289.
5. Bullier, J. (2001) Integrated model of visual processing. Brain Res. Rev., 36, 96-107.
6. Cardoso, M.M., Sirotin, Y.B., Lima, B., Glushenkova, E. & Das, A. (2012) The neuroimaging signal is a linear sum of neurally distinct stimulus- and task-related components. Nat. Neurosci., 15, 1298-1306.
7. Cavanaugh, J.R., Bair, W. & Movshon, J.A. (2002) Selectivity and spatial distribution of signals from the receptive field surround in macaque V1 neurons. J. Neurophysiol., 88, 2547-2556.
8. Chang, C.C. & Lin, C.J. (2001) LIBSVM: a library for support vector machines. Available http://www.csie.ntu.edu.tw/.
9. Chiu, Y.-C., Esterman, M., Han, Y., Rosen, H. & Yantis, S. (2011) Decoding task-based attentional modulation during face categorization. J. Cognitive Neurosci., 23, 1198-1204.
10. Clark, A. (2012) Whatever next? Predictive brains, situated agents and the future. Behav. Brain Sci., in press.
11. Clavagnier, S., Falschier, A. & Kennedy, H. (2004) Long-distance feedback projections to area V1: Implications for multisensory integration, spatial awareness, and visual consciousness. Cogn. Affect. Behav. Neurosci., 4, 117-126.
12. Ekman, P. & Friesen, W.V. (1978) Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto, CA.
13. Engström, M., Ragnehed, M. & Lundberg, P. (2005) Projection screen or video goggles as stimulus modality in functional magnetic resonance imaging. Magn. Reson. Imaging, 23, 695-699.
14. Felleman, D.J. & Van Essen, D.C. (1991) Distributed hierarchical processing in the primate cerebral cortex. Cereb. Cortex, 1, 1-47.
15. Freese, J.L. & Amaral, D.G. (2005) The organization of projections from the amygdala to visual cortical areas TE and V1 in the macaque monkey. J. Comp. Neurol., 13, 295-317.
16. Gauthier, I., Tarr, M.J., Moylan, J., Skudlarski, P., Gore, J.C. & Anderson, A.W. (2000) The fusiform 'face area' is part of a network that processes faces at the individual level. J. Cognitive Neurosci., 12, 495-504.
17. Gosselin, F. & Schyns, P.G. (2001) Bubbles: a technique to reveal the use of information in recognition tasks. Vision Res., 41, 2261-2271.
18. de Graaf, T.A., Goebel, R. & Sack, A.T. (2012) Feedforward and quick recurrent processes in early visual cortex revealed by TMS? Neuroimage, 61, 651-659.
19. Gschwind, M., Pourtois, G., Schwartz, S., Van De Ville, D. & Vuilleumier, P. (2012) White-matter connectivity between face-responsive regions in the human brain. Cereb. Cortex, 22, 1564-1576.
20. Harrison, S.A. & Tong, F. (2009) Decoding reveals the contents of visual working memory in early visual areas. Nature, 458, 632-635.
21. Harrison, L.M., Stephan, K.E., Rees, G. & Friston, K.J. (2007) Extra-classical receptive field effects measured in striate cortex with fMRI. Neuroimage, 34, 1199-1208.
22. Haxby, J.V., Hoffman, E.A. & Gobbini, M.I. (2000) The distributed human neural system for face perception. Trends. Cogn. Sci., 4, 223-233.
23. Haynes, J.D. & Rees, G. (2005) Predicting the orientation of invisible stimuli from activity in human primary visual cortex. Nat. Neurosci., 8, 686-691.
24. Hohwy, J. (2012) Attention and conscious perception in the hypothesis testing brain. Front. Psychol., 3, 96.
25. Kaas, A., Weigelt, S., Roebroeck, A., Kohler, A. & Muckli, L. (2010) Imagery of a moving object: the role of the occipital cortex and human MT/V5+. Neuroimage, 49, 794-804.
26. Kamitani, Y. & Tong, F. (2005) Decoding the visual and subjective contents of the human brain. Nat. Neurosci., 8, 679-685.
27. Kamitani, Y. & Tong, F. (2006) Decoding seen and attended motion directions from activity in the human visual cortex. Curr. Biol., 16, 1096-1102.
28. Kanwisher, N. & Wojciulik, E. (2000) Visual attention: insights from brain imaging. Nat. Rev. Neurosci., 1, 91-100.
29. Kastner, S., Pinsk, M.A., De Weerd, P., Desimone, R. & Ungerleider, L.G. (1999) Increased activity in human visual cortex during directed attention in the absence of visual stimulation. Neuron, 22, 751-761.
30. Kaul, C., Rees, G. & Ishai, A. (2011) The gender of face stimuli is represented in multiple regions in the human brain. Front. Hum. Neurosci., 4, 1-12.
31. Kay, K.N., Naselaris, T., Prenger, R.J. & Gallant, J.L. (2008) Identifying natural images from human brain activity. Nature, 452, 352-355.
32. Kietzmann, T.C., Swisher, J., König, P. & Tong, F. (2012) Prevalence of selectivity for mirror-symmetric views of faces in the ventral and dorsal visual pathways. J. Neurosci., 32, 11763-11772.
33. Kok, P., Jehee, J.F. & de Lange, F.P. (2012) Less is more: expectation sharpens representations in the primary visual cortex. Neuron, 75, 265-270.
34. Kriegeskorte, N. & Goebel, R. (2001) An efficient algorithm for topographically correct segmentation of the cortical sheet in anatomical mr volumes. Neuroimage, 14, 329-346.
35. Kriegeskorte, N., Mur, M., Ruff, D.A., Kiani, R., Bodurka, J., Esteky, H., Tanaka, K. & Bandettini, P.A. (2008) Matching categorical object representations in inferior temporal cortex of man and monkey. Neuron, 60, 1126-1141.
36. Maior, R.S., Hori, E., Tomaz, C., Ono, T. & Nishijo, H. (2010) The monkey pulvinar neurons differentially respond to emotional expressions of human faces. Behav. Brain Res., 215, 129-135.
37. Meyer, K. (2012) Another remembered present. Science, 335, 415-416.
38. Miellet, S., Caldara, R. & Schyns, P.G. (2011) Local Jekyll and global Hyde: the dual identity of face identification. Psych. Sci., 22, 1518-1526.
39. Miyawaki, Y., Uchida, H., Yamashita, O., Sato, M., Morito, Y., Tanabe, H.C., Sadato, N. & Kamitani, Y. (2008) Visual image reconstruction from human brain activity using a combination of multiscale local image decoders. Neuron, 60, 915-929.
40. Muckli, L. (2010) What are we missing here? Brain imaging evidence for higher cognitive functions in primary visual cortex V1. Int. J. Imag. Syst. Tech., 20, 131-139.
41. Muckli, L. & Petro, L.S. (2013) Network interactions: non-geniculate input to V1. Curr. Opin. Neurobiol., in press.
42. Muckli, L., Kohler, A., Kriegeskorte, N. & Singer, W. (2005) Primary visual cortex activity along the apparent-motion trace reflects illusory perception. PLoS Biol., 3, 1501-1510.
43. Muckli, L., Naumer, M.J. & Singer, W. (2009) Bilateral visual field maps in a patient with only one hemisphere. Proc. Natl. Acad. Sci. USA, 106, 13034-13039.
44. Muckli, L., Petro, L.S. & Smith, F.W. (2013) Backwards is the way forward. Behav. Brain Sci., in press.
45. Peelen, M.V., Fei-Fei, L. & Kastner, S. (2009) Neural mechanisms of rapid natural scene categorization in human visual cortex. Nature, 460, 9497.
46. Pessoa, L. & Adolphs, R. (2011) Emotion and the brain: multiple roads are better than one. Nat. Rev. Neurosci., 12, 425.
47. Purushothaman, G., Marion, R., Li, K. & Casagrande, V.A. (2012) Gating and control of primary visual cortex by pulvinar. Nat. Neurosci., 15, 905-912.
48. Ress, D. & Heeger, D.J. (2003) Neuronal correlates of perception in early visual cortex. Nat. Neurosci., 6, 414-420.
49. Rockland, K.S. & Van Hoesen, G.W. (1994) Direct temporal-occipital feedback connections to striate cortex (V1) in the macaque monkey. Cereb. Cortex, 4, 300-313.
50. Rossion, B. (2008) Constraining the cortical face network by neuroimaging studies of acquired prosopagnosia. Neuroimage, 40, 423-426.
51. Rossion, B., Caldara, R., Seighier, M., Schuller, A.M., Lazeyras, F. & Mayer, E. (2003) A network of occipito-temporal face sensitive areas besides the right middle fusiform gyrus is necessary for normal face processing. Brain, 116, 2381-2395.
52. Rutishauser, U., Tudusciuc, O., Neumann, D., Mamelak, A., Heller, C., Ross, I., Philpott, L., Sutherling, W. & Adolphs, R. (2011) Single-unit responses selective for whole faces in the human amygdala. Curr. Biol., 21, 1654-1660.
53. Salin, P.A. & Bullier, J. (1995) Corticocortical connections in the visual system: structure and function. Physiol. Rev., 75, 107-154.
54. Schmidt, K.E., Lomber, S.G., Payne, B.R. & Galuske, R.A. (2011) Pattern motion representation in primary visual cortex is mediated by transcortical feedback. Neuroimage, 54, 474-484.
55. Schyns, P.G., Jentzsch, I., Johnson, M., Schweinberger, S.R. & Gosselin, F. (2003) A principled method for determining the functionality of ERP components. NeuroReport, 14, 1665-1669.
56. Schyns, P.G., Petro, L.S. & Smith, M.L. (2007) Dynamics of visual information integration in the brain for categorizing facial expressions. Curr. Biol., 17, 1580-1585.
57. Schyns, P.G., Petro, L.S. & Smith, M.L. (2009) Transmission of facial expressions of emotion co-evolved with their efficient decoding in the brain: behavioural and brain evidence. PLoS ONE, 4, e5625.
58. Self, M.W., Kooijmans, R.N., Supèr, H., Lamme, V.A. & Roelfsema, P.R. (2012) Different glutamate receptors convey feedforward and recurrent processing in macaque V1. Proc. Natl. Acad. Sci. USA, 109, 11031-11036.
59. Sereno, M.I., Dale, A.M., Reppas, J.B., Kwong, K.K., Belliveau, J.W., Brady, T.J., Rosen, B.R. & Tootell, R.B.H. (1995) Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. Science, 268, 889-893.
60. Shushruth, S., Nurminen, L., Bijanzadeh, M., Ichida, J.M., Vanni, S. & Angelucci, A. (2013) Different orientation tuning of near- and far-surround suppression in macaque primary visual cortex mirrors their tuning in human perception. J. Neurosci., 33, 106-119.
61. Slotnick, S.D., Thompson, W.L. & Kosslyn, S.M. (2005) Visual mental imagery induces retinotopically organized activation of early visual areas. Cereb. Cortex, 15, 1570-1583.
62. Smith, F.W. & Muckli, L. (2010) Nonstimulated early visual areas carry information about surrounding context. Proc. Natl. Acad. Sci. USA, 16, 20099-20103.
63. Smith, F.W., Muckli, L., Brennan, D., Pernet, C., Smith, M.L., Belin, P., Gosselin, F., Hadley, D.M., Cavanagh, J. & Schyns, P.G. (2008) Classification images reveal the information sensitivity of brain voxels in fMRI. Neuroimage, 40, 1643-1654.
64. Smith, M.L., Gosselin, F. & Schyns, P.G. (2004) Receptive fields for flexible face categorizations. Psychol. Sci., 15, 753-761.
65. Smith, M.L., Cottrell, G.W., Gosselin, F. & Schyns, P.G. (2005) Transmitting and decoding facial expressions. Psychol. Sci., 16, 184-189.
66. Smith, M.L., Fries, P., Gosselin, F., Goebel, R. & Schyns, P.G. (2009) Inverse mapping the neuronal substrates of face categorizations. Cereb. Cortex, 19, 2428-2438.
67. Smith, M.L., Gosselin, F. & Schyns, P.G. (2012) Measuring internal representations from behavioral and brain data. Curr. Biol., 22, 191-196.
68. Talairach, J. & Tournoux, P. (1988) Co-Planar Stereotaxic Atlas of the Human Brain. Thieme, Stuttgart.
69. Thiele, A., Pooresmaeili, A., Delicato, L.S., Herrero, J.L. & Roelfsema, P.R. (2009) Additive effects of attention and stimulus contrast in primary visual cortex. Cereb. Cortex, 19, 2970-2981.
70. Vuilleumier, P., Richardson, M.P., Armony, J.L., Driver, J. & Dolan, R.J. (2004) Distant influences of amygdala lesion on visual cortical activation during emotional face processing. Nat. Neurosci., 7, 1271-1278.
71. Walther, D.B., Caddigan, E., Fei-Fei, L. & Beck, D.M. (2009) Natural scene categories revealed in distributed patterns of activity in the human brain. J. Neurosci., 29, 10573-11058.
72. Wandell, B.A. & Smirnakis, S.M. (2009) Plasticity and stability of visual field maps in adult primary visual cortex. Nat. Rev. Neurosci., 10, 873-884.
73. Watanabe, M., Cheng, K., Murayama, Y., Ueno, K., Asamizuya, T., Tanaka, K. & Logothetis, N. (2011) Attention but not awareness modulates the BOLD signal in the human V1 during binocular suppression. Science, 334, 829-831.
74. Weigelt, S., Kourtzi, Z., Kohler, A., Singer, W. & Muckli, L. (2007) The cortical representation of objects rotating in depth. J. Neurosci., 27, 3864-3874.
75. Williams, M.A., Baker, C.I., Op de Beeck, H.P., Shim, W.M., Dang, S., Triantafyllou, C. & Kanwisher, N. (2008) Feedback of visual object information to foveal retinotopic cortex. Nat. Neurosci., 11, 1439-1445.