Crowding: a cortical constraint on object recognition

Current Opinion in Neurobiology

Volumn 18, Issue 4, 2008, Pages 445-451

  Pelli, Denis G ^a  

^a NEW YORK UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANISOTROPY; BRAIN CELL; BRAIN MAPPING; BRAIN SIZE; CROWDING; MATHEMATICAL COMPUTING; PRIORITY JOURNAL; RECOGNITION; REVIEW; VISION; VISUAL CORTEX; VISUAL FIELD;

ANIMALS; BRAIN MAPPING; CEREBRAL CORTEX; DISCRIMINATION (PSYCHOLOGY); HUMANS; NEURONS; PSYCHOPHYSICS; SPACE PERCEPTION; VISUAL CORTEX; VISUAL PERCEPTION;

EID: 55249083263     PISSN: 09594388     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.conb.2008.09.008     Document Type: Review

References (64)

1. Bouma H. Interaction effects in parafoveal letter recognition. Nature 226 (1970) 177-178. In two pages, Bouma introduced the idea of critical spacing, presented measurements as a function of eccentricity, and noted that it is roughly half the eccentricity. This was a breakthrough, counter to firmly established ideas that visibility depends on size (acuity), not spacing.
2. Larsson J., and Heeger D.J. Two retinotopic visual areas in human lateral occipital cortex. J Neurosci 26 (2006) 13128-13142. They present beautiful fMRI measurements of retinotopy in six visual areas. Their exponential fit of eccentricity versus cortical distance, φ = exp[β(d + α)], is equivalent to a logarithmic fit of cortical distance versus eccentricity, d = (log φ)/β - α, which is our Eqn (2) above.
3. Toet A., and Levi D.M. The two-dimensional shape of spatial interaction zones in the parafovea. Vision Res 32 (1992) 1349-1357. This classic paper shows the importance of measuring thoroughly and systematically, not just a few points. Before this paper, one would have expected maps of critical spacing to be regular and symmetric, as in [63]. The Toet and Levi maps reveal unexpected variations and asymmetries in critical spacing, within and across observers. The variations in critical spacing remain unexplained, but suggest an organic rather than a crystalline process.
4. Ullman S. High-level Vision: Object Recognition and Visual Cognition (2000), MIT Press, Cambridge, Mass
5. Duda R.O., Hart P.E., and Stork D.G. Pattern Classification. edn 2 (2001), Wiley, New York
6. Strasburger H., and Rentschler I. Pattern recognition in direct and indirect view. In: Osaka N., Rentschler I., and Biederman I. (Eds). Object Recognition, Attention, and Action (2007), Springer 41-54
7. Snellen H. Test-types for the Determination of the Acuteness of Vision (1866), Norgate and Williams, London
8. Korte W. Uber die Gestaltauffassung im indirekten Sehen. Zeitschrift für Psychologie 93 (1923) 17-82
9. Levi DM, Song S, Pelli DG: Amblyopic reading is crowded. J Vis 2007, 7(2)21: 1-17 http://journalofvision.org/7/2/21/.
10. d. Indianapolis: Hackett Publishing Co.; 1992.
11. Huey E.B. The Psychology and Pedagogy of Reading (1908), Macmillan, New York
12. Legge G.E. Psychophysics of Reading in Normal and Low Vision (2007), Erlbaum, Mahwah, NJ. This excellent book puts together all the literature on the psychophysics of reading, a substantial part of which is Legge's own contributions.
13. Woodworth R.S. Experimental Psychology (1938), Holt, New York p. 720. This classic textbook presents demos to measure the reader's visual span, showing that it is limited by letter spacing (crowding), not by size (acuity).
14. Pelli DG, Tillman KA, Freeman J, Su M, Berger TD, Majaj NJ: Crowding and eccentricity determine reading rate. J Vis 2007, 7(2)20:1-36 http://journalofvision.org/7/2/20/. This paper joins together the contributions of Bouma (crowding) and Legge (visual span), working out the geometrical calculations in detail and presenting a great deal of empirical data showing that crowding does indeed determine the visual span and thus reading rate.
15. Pelli D.G. Close encounters - an artist shows that size affects shape. Science 285 (1999) 844-846
16. Majaj N.J., Pelli D.G., Kurshan P., and Palomares M. The role of spatial frequency channels in letter identification. Vision Res 42 (2002) 1165-1184
17. Levi D.M. Crowding - an essential bottleneck for object recognition: a mini-review. Vision Res 48 (2008) 635-654. This is a broad review of the current work and ideas in crowding.
18. Pelli D.G., Cavanagh P., Desimone R., Tjan B.S., and Treisman A.M. Crowding: including illusory conjunctions, surround suppression, and attention. J Vis 7(2)i (2007) 1. http://journalofvision.org/7/2/i/
19. Pelli D.G., and Tillman K.A. The uncrowded window of object recognition. Nat Neurosci 11 (2008) 1129-1135. This review, complementing Levi's, focuses on the generality of Bouma's critical spacing, and sketches the V1 argument.
20. Strasburger H., Harvey Jr. L.O., and Rentschler I. Contrast thresholds for identification of numeric characters in direct and eccentric view. Percept Psychophys 49 (1991) 495-508
21. Levi DM, Hariharan S, Klein SA: Suppressive and facilitatory spatial interactions in peripheral vision: peripheral crowding is neither size invariant nor simple contrast masking. J Vis 2002, 2(2)3: 167-177 http://journalofvision.org/2/2/3/. This thoughtful piece has lots of data and presents the idea of crowding as pooling of features over large distances.
22. Tripathy S.P., and Cavanagh P. The extent of crowding in peripheral vision does not scale with target size. Vision Res 42 (2002) 2357-2369
23. Pelli DG, Palomares M, Majaj NJ: Crowding is unlike ordinary masking: distinguishing feature integration from detection. J Vis 2004, 4(12)12:1136-1169 http://journalofvision.org/4/12/12/. This article helped create a wider awareness of crowding as a basic visual phenomenon. It proposed empirical tests to distinguish crowding from other kinds of masking. It reviewed the phenomenology of crowding, both in the literature and in a series of empirical studies of many relevant parameters. It showed that most of the papers on illusory conjunction were studying crowding.
24. Andriessen J.J., and Bouma H. Eccentric vision: adverse interactions between line segments. Vision Res 16 (1976) 71-78
25. Wilkinson F., Wilson H.R., and Ellemberg D. Lateral interactions in peripherally viewed texture arrays. J Opt Soc Am A 14 (1997) 2057-2068
26. Talbot S.A., and Marshall W.H. Physiological studies on neural mechanisms of visual localization and discrimination. Am J Ophthal 24 (1941) 1255-1264
27. Daniel P.M., and Whitteridge D. The representation of the visual field on the cerebral cortex in monkeys. J Physiol 159 (1961) 203-221
28. Hubel D.H., and Wiesel T.N. Uniformity of monkey striate cortex: a parallel relationship between field size, scatter, and magnification factor. J Comp Neurol 158 (1974) 295-305
29. Van Essen D.C., Newsome W.T., Maunsell J.H.R., and Bixby J.L. The projections from striate cortex (V1) to areas V2 and V3 in the macaque monkey: asymmetries, areal boundaries, and patchy connections. J Comp Neurol 244 (1986) 451-480
30. Adams D.L., and Horton J.C. A precise retinotopic map of primate striate cortex generated from the representation of angioscotomas. J Neurosci 23 (2003) 3771-3789
31. Inouye T. Die Sehstörungen bei Schussverletzungen der kortikalen Sehsphäre nach Beobachtungen an Verwundeten der letzten japanischen Kriege (1909), Engelmann, Leipzig
32. Holmes G., and Lister W.T. Disturbances of vision from cerebral lesions with special reference to the cortical representation of the macula. Brain 39 (1916) 34-73
33. Penfield W., Jaspers H., and McNaughton F. Epilepsy and the Functional Anatomy of the Human Brain (1954), Little, Brown, Boston
34. Cowey A., and Rolls E.T. Human cortical magnification factor and its relation to visual acuity. Exp Brain Res 21 (1974) 447-454
35. Fox P.T., Miezin F.M., Allman J.M., Van Essen D.C., and Raichle M.E. Retinotopic organization of human visual cortex mapped with positron-emission tomography. J Neurosci 7 (1987) 913-922
36. Sereno M.I., Dale A.M., Reppas J.B., Kwong K.K., Belliveau J.W., Brady T.J., Rosen B.R., and Tootell R.B. Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. Science 268 (1995) 889-893
37. DeYoe E.A., Carman G.J., Bandettini P., Glickman S., Wieser J., Cox R., Miller D., and Neitz J. Mapping striate and extrastriate visual areas in human cerebral cortex. Proc Natl Acad Sci U S A 93 (1996) 2382-2386
38. Engel S.A., Glover G.H., and Wandell B.A. Retinotopic organization in human visual cortex and the spatial precision of functional MRI. Cereb Cortex 7 (1997) 181-192
39. Duncan R.O., and Boynton G.M. Cortical magnification within human primary visual cortex correlates with acuity thresholds. Neuron 38 (2003) 659-671
40. Schira M.M., Wade A.R., and Tyler C.W. Two-dimensional mapping of the central and parafoveal visual field to human visual cortex. J Neurophysiol 97 (2007) 4284-4295
41. Schwartz E.L. Computational anatomy and functional architecture of striate cortex: a spatial mapping approach to perceptual coding. Vision Res 20 (1980) 645-669
42. Levi D.M., Klein S.A., and Aitsebaomo A.P. Vernier acuity, crowding and cortical magnification. Vision Res 25 (1985) 963-977. They measured crowding for Vernier acuity and used estimates of the cortical magnification factor to conclude that "spatial interference occurred when the interline distance was less than a cortical distance of about 1 mm." The spacing was horizontal in the lower visual field, so the 1 mm critical spacing was circumferential, consistent with what we find here.
43. Motter BC, Simoni DA: The roles of cortical image separation and size in active visual search performance. J Vis 2007, 7(2)6:1-15 http://journalofvision.org/7/2/6/. They measured eye position during visual search and found that search performance depends on distance, in cortical space, from target to nearest neighbor.
44. Tripathy S.P., and Levi D.M. Long-range dichoptic interactions in the human visual cortex in the region corresponding to the blind spot. Vision Res 34 (1994) 1127-1138
45. Yang Z., Heeger D.J., and Seidemann E. Rapid and precise retinotopic mapping of the visual cortex obtained by voltage-sensitive dye imaging in the behaving monkey. J Neurophysiol 98 (2007) 1002-1014
46. Tootell R.B., Switkes E., Silverman M.S., and Hamilton S.L. Functional anatomy of macaque striate cortex. II. Retinotopic organization. J Neurosci 8 (1988) 1531-1568
47. Miller E.K., Gochin P.M., and Gross C.G. Suppression of visual responses of neurons in inferior temporal cortex of the awake macaque by addition of a second stimulus. Brain Res 616 (1993) 25-29
48. Logothetis N.K., and Sheinberg D.L. Visual object recognition. Annu Rev Neurosci 19 (1996) 577-621
49. Luck S.J., Chelazzi L., Hillyard S.A., and Desimone R. Neural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex. J Neurophysiol 77 (1997) 24-42
50. Gallant J.L., Connor C.E., and Van Essen D.C. Neural activity in areas V1, V2 and V4 during free viewing of natural scenes compared to controlled viewing. Neuroreport 9 (1998) 2153-2158
51. Motter B.C. Crowding and object integration within the receptive field of V4 neurons. J Vis 2 7 (2002) 274. http://journalofvision.org/2/7/274/
52. Rolls E.T., Aggelopoulos N.C., and Zheng F. The receptive fields of inferior temporal cortex neurons in natural scenes. J Neurosci 23 (2003) 339-348
53. Zoccolan D., Cox D.D., and DiCarlo J.J. Multiple object response normalization in monkey inferotemporal cortex. J Neurosci 25 (2005) 8150-8164
54. Rollenhagen J.E., and Olson C.R. Low-frequency oscillations arising from competitive interactions between visual stimuli in macaque inferotemporal cortex. J Neurophysiol 94 (2005) 3368-3387
55. Fallah M., Stoner G.R., and Reynolds J.H. Stimulus-specific competitive selection in macaque extrastriate visual area V4. Proc Natl Acad Sci U S A 104 (2007) 4165-4169
56. Vinberg J., and Grill-Spector K. Representation of shapes, edges, and surfaces across multiple cues in the human visual cortex. J Neurophysiol 99 (2008) 1380-1393
57. Field D.J., Hayes A., and Hess R.F. Contour integration by the human visual system: evidence for a local 'association field'. Vision Res 33 (1993) 173-193
58. Rockel A.J., Hiorns R.W., and Powell T.P. The basic uniformity in structure of the neocortex. Brain 103 (1980) 221-244
59. Braitenberg V., and Schüz A. Cortex: Statistics and Geometry of Neuronal Connectivity. edn 2 (1998), Springer Verlag, Heidelberg, Germany
60. Durbin R., and Mitchison G. A dimension reduction framework for understanding cortical maps. Nature 343 (1990) 644-647
61. Swindale N.V. How different feature spaces may be represented in cortical maps. Network 15 (2004) 217-242
62. Chung S.T.L., Levi D.M., and Legge G.E. Spatial-frequency and contrast properties of crowding. Vision Res 41 (2001) 1833-1850
63. AIGA: Symbol signs. The complete study of passenger/pedestrian symbols developed by the American Institute of Graphic Arts for the U.S. Department of Transportation. edn 2 (1993), AIGA, New York
64. Bouma H. Visual search and reading: eye movements and functional visual field: a tutorial review. In: Requin J. (Ed). Attention and Performance, VII (1978), Lawrence Erlbaum Associates 115-147