Early recurrent feedback facilitates visual object recognition under challenging conditions

Frontiers in Psychology

Volumn 5, Issue JUL, 2014, Pages

  Wyatte, Dean ^a   Jilk, David J ^b   O'Reilly, Randall C ^a  

^a UNIVERSITY OF COLORADO   (United States)

^b eCortex Inc   (United States)

Author keywords

Amodal completion; Feedback; Illusory contours; Object recognition; Top down attention

Indexed keywords

EID: 84904875362     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2014.00674     Document Type: Article

References (89)

1. Akrami, A., Liu, Y., Treves, A., and Jagadeesh, B. (2009). Converging neuronal activity in inferior temporal cortex during the classification of morphed stimuli. Cereb. Cortex 19, 760-776. doi: 10.1093/cercor/bhn125
2. Arieli, A., Sterkin, A., Grinvald, A., and Aertsen, A. (1996). Dynamics of ongoing activity: explanation of the large variability in evoked cortical responses. Science 273, 1868-1871. doi: 10.1126/science.273.5283.1868
3. Bar, M., Kassam, K., Ghuman, A., Boshyan, J., and Schmidt, A. (2006). Top-down facilitation of visual recognition. Proc. Natl. Acad. Sci. U.S.A. 103, 449-454. doi: 10.1073/pnas.0507062103
4. Boehler, C. N., Schoenfeld, M. A., Heinze, H. J., and Hopf, J. M. (2008). Rapid recurrent processing gates awareness in primary visual cortex. Proc. Natl. Acad. Sci. U.S.A. 105, 8742-8747. doi: 10.1073/pnas.0801999105
5. Breitmeyer, B. G., and Ganz, L. (1976). Implications of sustained and transient channels for theories of visual pattern masking, saccadic suppression, and information processing. Psychol. Rev. 83, 1-36. doi: 10.1037/0033-295X.83.1.1
6. Bressler, S. L., Tang, W., Sylvester, C. M., Shulman, G. L., and Corbetta, M. (2008). Top-down control of human visual cortex by frontal and parietal cortex in anticipatory visual spatial attention. J. Neurosci. 28, 10056-10061. doi: 10.1523/JNEUROSCI.1776-08.2008
7. Buffalo, E. A., Fries, P., Landman, R., Liang, H., and Desimone, R. (2010). A backward progression of attentional effects in the ventral stream. Proc. Natl. Acad. Sci. U.S.A. 107, 361-365. doi: 10.1073/pnas.0907658106
8. Bullier, J. (2001). Feedback connections and conscious vision. Trends Cogn. Sci. 5, 369-370. doi: 10.1016/S1364-6613(00)01730-7
9. Camprodon, J. A., Zohary, E., Brodbeck, V., and Pascual-Leone, A. (2010). Two phases of v1 activity for visual recognition of natural images. J. Cogn. Neurosci. 22, 1262-1269. doi: 10.1162/jocn.2009.21253
10. Cadieu, C. F., Hong, H., Yamins, D., Pinto, N., Majaj, N. J., and DiCarlo, J. J. (2013). "The neural representation benchmark and its evaluation on brain and machine," in International Conference on Learning Representations (ICLR) (Scottsdale, AZ).
11. Chen, J., Liu, B., Chen, B., and Fang, F. (2009). Time course of amodal completion in face perception. Vision Res. 49, 752-758. doi: 10.1016/j.visres.2009.02.005
12. Chen, M., Yan, Y., Gong, X., Gilbert, C., Liang, H., and Li, W. (2014). Incremental integration of global contours through interplay between visual cortical areas. Neuron 82, 682-694. doi: 10.1016/j.neuron.2014.03.023
13. Corthout, E., Uttl, B., Walsh, V., Hallett, M., and Cowey, A. (1999a). Timing of activity in early visual cortex as revealed by transcranial magnetic stimulation. Neuroreport 10, 2631-2634. doi: 10.1097/00001756-199908200-00035
14. Corthout, E., Uttl, B., Ziemann, U., Cowey, A., and Hallett, M. (1999b). Two periods of processing in the (circum)striate visual cortex as revealed by transcranial magnetic stimulation. Neuropsychologia 37, 137-145. doi: 10.1016/S0028-3932(98)00088-8
15. Daelli, V., and Treves, A. (2010). Neural attractor dynamics in object recognition. Exp. Brain Res. 203, 241-248. doi: 10.1007/s00221-010-2243-1
16. Dehaene, S., Changeux, J. P., Naccache, L., Sackur, J., and Sergent, C. (2006). Conscious preconscious and subliminal processing: a testable taxonomy. Trends Cogn. Sci. 10, 204-211. doi: 10.1016/j.tics.2006.03.007
17. Dehaene, S., Naccache, L., Cohen, L., Le Bihan, D., Mangin, J. F., Poline, J. B., et al. (2001). Cerebral mechanisms of work masking and unconscious repetition priming. Nat. Neurosci. 4, 752-758. doi: 10.1038/89551
18. Deisseroth, K. (2011). Optogenetics. Nat. Methods 8, 26-29. doi: 10.1038/nmeth.f.324
19. DiCarlo, J. J., Zoccolan, D., and Rust, N. C. (2012). How does the brain solve visual object recognition? Neuron 73, 415-434. doi: 10.1016/j.neuron.2012.01.010
20. Doniger, G. M., Foxe, J. J., Murray, M. M., Higgins, B. A., Snodgrass, J. G., Schroeder, C. E., et al. (2000). Activation timecourse of ventral visual stream object-recognition areas: high density electrical mapping of perceptual closure processes. J. Cogn. Neurosci. 12, 615-621. doi: 10.1162/089892900562372
21. Emmanouil, T. A., and Ro, T. (2014). Amodal completion of unconsciously presented objects. Psychon. Bull. Rev. doi: 10.3758/s13423-014-0590-9. [Epub ahead of print].
22. Enns, J. T., and Di Lollo, V. (2000). What's new in visual masking? Trends Cogn. Sci. 4, 345-352. doi: 10.1016/S1364-6613(00)01520-5
23. Fahrenfort, J. J., Scholte, H. S., and Lamme, V. A. F. (2007). Masking disrupts reentrant processing in human visual cortex. J. Cogn. Neurosci. 19, 1488-1497. doi: 10.1162/jocn.2007.19.9.1488
24. Fahrenfort, J. J., Scholte, H. S., and Lamme, V. A. F. (2008). The spatiotemporal profile of cortical processing leading up to visual perception. J. Vision 8, 12.1-12.12. doi: 10.1167/8.1.12
25. Felleman, D. J., and Van Essen, D. C. (1991). Distributed hierarchical processing in the primate cerebral cortex. Cereb. Cortex 1, 1-47. doi: 10.1093/cercor/1.1.1
26. Galuske, R. A. W., Schmidt, K. E., Goebel, R., Lomber, S. G., and Payne, B. R. (2002). The role of feedback in shaping neural representations in cat visual cortex. Proc. Natl. Acad. Sci. U.S.A. 99, 17083-17088. doi: 10.1073/pnas.242399199
27. Grill-Spector, K., Kourtzi, Z., and Kanwisher, N. (2001). The lateral occipital complex and its role in object recognition. Vision Res. 41, 1409-1422. doi: 10.1016/S0042-6989(01)00073-6
28. Haynes, J. D., Driver, J., and Rees, G. (2005). Visibility reflects dynamic changes of effective connectivity between v1 and fusiform cortex. Neuron 46, 811-821. doi: 10.1016/j.neuron.2005.05.012
29. Hillyard, S. A., and Anllo-Vento, L. (1998). Event-related brain potentials in the study of visual selective attention. Proc. Natl. Acad. Sci.U.S.A. 95, 781-787. doi: 10.1073/pnas.95.3.781
30. Hochstein, S., and Ahissar, M. (2002). View from the top: hierarchies and reverse hierarchies in the visual system. Neuron 36, 791-804. doi: 10.1016/S0896-6273(02)01091-7
31. Hung, C. P., Kreiman, G., Poggio, T., and DiCarlo, J. J. (2005). Fast readout of object identity from macaque inferotemporal cortex. Science 310, 863-866. doi: 10.1126/science.1117593
32. Hupé, J. M., James, A. C., Girard, P., and Bullier, J. (2001). Response modulations by static texture surround in area v1 of the macaque monkey do not depend on feedback connections from v2. J. Neurophysiol. 85, 146-163.
33. Hupé, J. M., James, A. C., Payne, B. R., Lomber, S. G., Girard, P., and Bullier, J. (1998). Cortical feedback improves discrimination between figure and background by v1 v2 and v3 neurons. Nature 394, 784-787. doi: 10.1038/29537
34. Johnson, J. S., and Olshausen, B. A. (2005). The recognition of partially visible natural objects in the presence and absence of their occluders. Vision Res. 45, 3262-3276. doi: 10.1016/j.visres.2005.06.007
35. Kanizsa, G. (1979). Organization in Vision: Essays on Gestalt Perception. Westport, CT: Praeger Publishers.
36. Koivisto, M., Railo, H., Revonsuo, A., Vanni, S., and Salminen-Vaparanta, N. (2011). Recurrent processing in v1/v2 contributes to categorization of natural scenes. J. Neurosci. 31, 2488-2492. doi: 10.1523/JNEUROSCI.3074-10.2011
37. Kourtzi, Z., and Kanwisher, N. (2001). Representation of perceived object shape by the human lateral occipital complex. Science 293, 1506-1509. doi: 10.1126/science.1061133
38. Kovacs, G., Vogels, R., and Orban, G. A. (1995). Selectivity of macaque inferior temporal neurons for partially occluded shapes. J. Neurosci. 15, 1984-1997.
39. Kriegeskorte, N., Mur, M., and Bandettini, P. (2008a). Representational similarity analysis - connecting the branches of systems neuroscience. Front. Syst. Neurosci. 2:4. doi: 10.3389/neuro.06.004.2008
40. Kriegeskorte, N., Mur, M., Ruff, D. A., Kiani, R., Bodurka, J., Esteky, H., et al. (2008b). Matching categorical object representations in inferior temporal cortex of man and monkey. Neuron 60, 1126-1141. doi: 10.1016/j.neuron.2008.10.043
41. Kveraga, K., Ghuman, A., and Bar, M. (2007). Top-down predictions in the cognitive brain. Brain Cogn. 65, 145-168. doi: 10.1016/j.bandc.2007.06.007
42. Lamme, V., and Roelfsema, P. (2000). The distinct modes of vision offered by feedforward and recurrent processing. Trends Neurosci. 23, 571-579. doi: 10.1016/S0166-2236(00)01657-X
43. Lamme, V., Super, H., and Spekreijse, H. (1998). Feedforward, horizontal, and feedback processing in the visual cortex. Curr. Opin. Neurobiol. 8, 529-535. doi: 10.1016/S0959-4388(98)80042-1
44. Lamme, V. A. (2003). Why visual attention and awareness are different. Trends Cogn. Sci. 7, 12-18. doi: 10.1016/S1364-6613(02)00013-X
45. Lamme, V. A. F. (2006). Towards a true neural stance on consciousness. Trends Cogn. Sci. 10, 494-501. doi: 10.1016/j.tics.2006.09.001
46. Lee, T. S. (2003). Computations in the early visual cortex. J. Physiol. 97, 121-139. doi: 10.1016/j.jphysparis.2003.09.015
47. Lee, T. S., and Nguyen, M. (2001). Dynamics of subjective contour formation in the early visual cortex. Proc. Natl. Acad. Sci. U.S.A. 98, 1907-1911. doi: 10.1073/pnas.98.4.1907
48. Lerner, Y., Hendler, T., and Malach, R. (2002). Object-completion effects in the human lateral occipital cortex. Cereb. Cortex 12, 163-177. doi: 10.1093/cercor/12.2.163
49. Luck, S. J., Heinze, H. J., Mangun, G. R., and Hillyard, S. A. (1990a). Visual event-related potentials index focused attention within bilateral stimulus arrays. I. Evidence for early selection. Electroencephalogr. Clin. Neurophysiol. 75, 511-527. doi: 10.1016/0013-4694(90)90139-B
50. Luck, S. J., Heinze, H. J., Mangun, G. R., and Hillyard, S. A. (1990b). Visual event-related potentials index focused attention within bilateral stimulus arrays. II. Functional dissociation of P1 and N1 components. Electroencephalogr. Clin. Neurophysiol. 75, 528-542. doi: 10.1016/0013-4694(90)90139-B
51. Macknik, S. L., and Livingstone, M. S. (1998). Neuronal correlates of visibility and invisibility in the primate visual system. Nat. Neurosci. 1, 144-149. doi: 10.1038/393
52. Martinez, A., Di Russo, F., Anllo-Vento, L., Sereno, M. I., Buxton, R. B., and Hillyard, S. A. (2001). Putting spatial attention on the map: timing and localization of stimulus selection processes in striate and extrastriate visual areas. Vision Res. 41, 1437-1457. doi: 10.1016/S0042-6989(00)00267-4
53. Mehta, A. D., Ulbert, I., and Schroeder, C. E. (2000a). Intermodal selective attention in monkeys. I: distribution and timing of effects across visual areas. Cereb. Cortex 10, 343-358. doi: 10.1093/cercor/10.4.343
54. Mehta, A. D., Ulbert, I., and Schroeder, C. E. (2000b). Intermodal selective attention in monkeys. II: physiological mechanisms of modulation. Cereb. Cortex 10, 359-370. doi: 10.1093/cercor/10.4.359
55. Mignard, M., and Malpeli, J. G. (1991). Paths of information flow through visual cortex. Science 251, 1249-1251. doi: 10.1126/science.1848727
56. Missal, M., Vogels, R., and Orban, G. A. (1997). Responses of macaque inferior temporal neurons to overlapping shapes. Cereb. Cortex 7, 758-767. doi: 10.1093/cercor/7.8.758
57. Nielsen, K. J., Logothetis, N. K., and Rainer, G. (2006). Dissociation between local field potentials and spiking activity in macaque inferior temporal cortex reveals diagnosticity-based encoding of complex objects. J. Neurosci. 26, 9639-9645. doi: 10.1523/JNEUROSCI.2273-06.2006
58. Noesselt, T., Hillyard, S. A., Woldorff, M. G., Schoenfeld, A., Hagner, T., Jncke, L., et al. (2002). Delayed striate cortical activation during spatial attention. Neuron 35, 575-587. doi: 10.1016/S0896-6273(02)00781-X
59. Nowak, L., and Bullier, J. (1997). "The timing of information transfer in the visual system," in Cerebral Cortex Vol. 12: Extrastriate Cortex in Primates, eds K. S. Rockland, J. H. Kaas, and A. Peters (New York, NY: Plenum), 205-241.
60. Orban, G. A., Van Essen, D., and Vanduffel, W. (2004). Comparative mapping of higher visual areas in monkeys and humans. Trends Cogn. Sci. 8, 315-324. doi: 10.1016/j.tics.2004.05.009
61. O'Reilly, R., Wyatte, D., Herd, S., Mingus, B., and Jilk, D. (2013). Recurrent processing during object recognition. Front. Psychol. 4:124. doi: 10.3389/fpsyg.2013.00124
62. Pascual-Leone, A., and Walsh, V. (2001). Fast backprojections from the motion to the primary visual area necessary for visual awareness. Science 292, 510-512. doi: 10.1126/science.1057099
63. Poort, J., Raudies, F., Wannig, A., Lamme, V. A. F., Neumann, H., and Roelfsema, P. R. (2012). The role of attention in figure-ground segregation in areas v1 and v4 of the visual cortex. Neuron 75, 143-156. doi: 10.1016/j.neuron.2012.04.032
64. Rauschenberger, R., Liu, T., Slotnick, S. D., and Yantis, S. (2006). Temporally unfolding neural representation of pictorial occlusion. Psychol. Sci. 17, 358-364. doi: 10.1111/j.1467-9280.2006.01711.x
65. Reynolds, J., Pasternak, T., and Desimone, R. (2000). Attention increases sensitivity of v4 neurons. Neuron 26, 703-714. doi: 10.1016/S0896-6273(00)81206-4
66. Reynolds, J. H., and Heeger, D. J. (2009). The normalization model of attention. Neuron 61, 168-185. doi: 10.1016/j.neuron.2009.01.002
67. Riesenhuber, M., and Poggio, T. (1999). Hierarchical models of object recognition in cortex. Nat. Neurosci. 2, 1019-1025. doi: 10.1038/14819
68. Roland, P. (2010). Six principles of visual cortical dynamics. Front. Syst. Neurosci. 4:28. doi: 10.3389/fnsys.2010.00028
69. Roland, P. E., Hanazawa, A., Undeman, C., Eriksson, D., Tompa, T., Nakamura, H., et al. (2006). Cortical feedback depolarization waves: a mechanism of top-down influence on early visual areas. Proc. Natl. Acad. Sci. U.S.A. 103, 12586-12591. doi: 10.1073/pnas.0604925103
70. Sandell, J. H., and Schiller, P. H. (1982). Effect of cooling area 18 on striate cortex cells in the squirrel monkey. J. Neurophysiol. 48, 38-48.
71. Sclar, G., Maunsell, J. H., and Lennie, P. (1990). Coding of image contrast in central visual pathways of the macaque monkey. Vision Res. 30, 1-10. doi: 10.1016/0042-6989(90)90123-3
72. Seghier, M. L., and Vuilleumier, P. (2006). Functional neuroimaging findings on the human perception of illusory contours. Neurosci. Biobehav. Rev. 30, 595-612. doi: 10.1016/j.neubiorev.2005.11.002
73. Sehatpour, P., Molholm, S., Javitt, D. C., and Foxe, J. J. (2006). Spatiotemporal dynamics of human object recognition processing: an integrated high-density electrical mapping and functional imaging study of "closure" processes. Neuroimage 29, 605-618. doi: 10.1016/j.neuroimage.2005.07.049
74. Sehatpour, P., Molholm, S., Schwartz, T. H., Mahoney, J. R., Mehta, A. D., Javitt, D. C., et al. (2008). A human intracranial study of long-range oscillatory coherence across a frontal-occipital-hippocampal brain network during visual object processing. Proc. Natl. Acad. Sci. U.S.A. 105, 4399-4404. doi: 10.1073/pnas.0708418105
75. Serre, T., Kreiman, G., Kouh, M., Cadieu, C., Knoblich, U., and Poggio, T. (2007). A quantitative theory of immediate visual recognition. Prog. Brain Res. 165, 33-56. doi: 10.1016/S0079-6123(06)65004-8
76. Spivey, M. J. (2008). The Continuity of Mind. New York, NY: Oxford University Press.
77. Sporns, O., and Zwi, J. D. (2004). The small world of the cerebral cortex. Neuroinformatics 2, 145-162. doi: 10.1385/NI:2:2:145
78. Tang, H., Buia, C., Madhavan, R., Madsen, J., Anderson, W., Crone, N., et al. (in press). Spatiotemporal dynamics underlying object completion in human ventral visual cortex. Neuron.
79. Thompson, K. G., Biscoe, K. L., and Sato, T. R. (2005). Neuronal basis of covert spatial attention in the frontal eye field. J. Neurosci. 25, 9479-9487. doi: 10.1523/JNEUROSCI.0741-05.2005
80. Tsodyks, M., Kenet, T., Grinvald, A., and Arieli, A. (1999). Linking spontaneous activity of single cortical neurons and the underlying functional architecture. Science 286, 1943-1946. doi: 10.1126/science.286.5446.1943
81. VanRullen, R. (2007). The power of the feed-forward sweep. Adv. Cogn. Psychol. 3, 167-176. doi: 10.2478/v10053-008-0022-3
82. VanRullen, R., and Thorpe, S. J. (2001). Rate coding versus temporal order coding: what the retinal ganglion cells tell the visual cortex. Neural Comput. 13, 1255-1284. doi: 10.1162/08997660152002852
83. VanRullen, R., and Thorpe, S. J. (2002). Surfing a spike wave down the ventral stream. Vision Res. 42, 2593-2615. doi: 10.1016/S0042-6989(02)00298-5
84. Weigelt, S., Singer, W., and Muckli, L. (2007). Separate cortical stages in amodal completion revealed by functional magnetic resonance adaptation. BMC Neurosci. 8:70. doi: 10.1186/1471-2202-8-70
85. Williford, T., and Maunsell, J. H. R. (2006). Effects of spatial attention on contrast response functions in macaque area v4. J. Neurophysiol. 96, 40-54. doi: 10.1152/jn.01207.2005
86. Wyatte, D., Curran, T., and O'Reilly, R. (2012a). The limits of feedforward vision: recurrent processing promotes robust object recognition when objects are degraded. J. Cogn. Neurosci. 24, 2248-2261. doi: 10.1162/jocn_a_00282
87. Wyatte, D., Herd, S., Mingus, B., and O'Reilly, R. (2012b). Competitive inhibition and top-down feedback in binding during object recognition. Front. Psychol. 3:182. doi: 10.3389/fpsyg.2012.00182
88. Zipser, K., Lamme, V. A. F., and Schiller, P. H. (1996). Contextual modulation in primary visual cortex. J. Neurosci. 16, 7376-7373.
89. Zoccolan, D., Cox, D. D., and DiCarlo, J. J. (2005). Multiple object response normalization in monkey inferotemporal cortex. J. Neurosci. 25, 8150-8164. doi: 10.1523/JNEUROSCI.2058-05.2005