Classification images: A review

Journal of Vision

Volumn 11, Issue 5, 2011, Pages 1-25

  Murray, Richard F ^a  

^a YORK UNIVERSITY   (Canada)

Author keywords

Categorization; Computational modeling; Receptive fields; Spatial vision

Indexed keywords

BIOLOGICAL MODEL; DEPTH PERCEPTION; HUMAN; METHODOLOGY; PHOTOSTIMULATION; PHYSIOLOGY; PSYCHOPHYSICS; REVIEW; VISUAL FIELD;

HUMANS; MODELS, NEUROLOGICAL; PHOTIC STIMULATION; PSYCHOPHYSICS; SPACE PERCEPTION; VISUAL FIELDS;

EID: 80051741407     PISSN: None     EISSN: 15347362     Source Type: Journal    
DOI: 10.1167/11.5.1     Document Type: Review

References (120)

1. Abbey, C. K., & Eckstein, M. P. (2001). Maximumlikelihood and maximum-a-posteriori estimates of human observer templates. Proceedings of SPIE, 4324, 114-122.
2. Abbey, C. K., & Eckstein, M. P. (2002a). Classification image analysis: Estimation and statistical inference for two-alternative forced-choice experiments. Journal of Vision, 2(1):5, 66-78, http://www.journalofvision.org/content/2/1/5, doi:10.1167/2.1.5.
3. Abbey, C. K., & Eckstein, M. P. (2002b). Optimal shifted estimates of human-observer templates in two-alternative forced-choice experiments. IEEE Transactions on Medical Imaging, 21, 429-440.
4. Abbey, C. K., & Eckstein, M. P. (2007). Classification images for simple detection and discrimination tasks in correlated noise. Journal of the Optical Society of America A, 24, B110-B124.
5. Abbey, C. K., & Eckstein, M. P. (2009). Frequency tuning of perceptual templates changes with noise magnitude. Journal of the Optical Society of America A, 26, B72-B83.
6. Abbey, C. K., Eckstein, M. P., & Bochud, F. O. (1999). Estimation of human-observer templates in twoalternative forced-choice experiments. Proceedings of SPIE, 3663, 284-295.
7. Abel, L. A., & Quick, R. F., Jr. (1978). Wiener analysis of grating contrast judgments. Vision Research, 18, 1031-1039.
8. Ahumada, A. J., Jr. (1996). Perceptual classification images from Vernier acuity masked by noise [Abstract]. Perception, 25, ECVP Abstract Supplement.
9. Ahumada, A. J., Jr. (2002). Classification image weights and internal noise level estimation. Journal of Vision, 2(1):8, 121-131, http://www.journalofvision.org/content/2/1/8, doi:10.1167/2.1.8.
10. Ahumada, A. J., Jr., & Beard, B. L. (1999). Classification images for detection [Abstract]. Investigative Ophthalmology and Visual Science, 40, S572.
11. Ahumada, A. J., Jr., & Lovell, J. (1971). Stimulus features in signal detection. Journal of the Acoustical Society of America, 49, 1751-1756.
12. Ahumada, A. J., Jr., Marken, R., & Sandusky, A. (1975). Time and frequency analyses of auditory signal detection. Journal of the Acoustical Society of America, 57, 385-390.
13. Alexander, J. M., & Lutfi, R. A. (2004). Informational masking in hearing-impaired and normal-hearing listeners: Sensation level and decision weights. Journal of the Acoustical Society of America, 116, 2234-2247.
14. Banks, M. S., Sekuler, A. B., & Anderson, S. J. (1991). Peripheral spatial vision: Limits imposed by optics, photoreceptors, and receptor pooling. Journal of the Optical Society of America A, 8, 1775-1787.
15. Beard, B. L., & Ahumada, A. J., Jr. (1997). Relevant image features for Vernier acuity [Abstract]. Perception, 26, ECVP Abstract Supplement.
16. Beard, B. L., & Ahumada, A. J., Jr. (1998). A technique to extract relevant image features for visual tasks. Proceedings of SPIE, 3299, 79-85.
17. Bennett, P. J., & Banks, M. S. (1987). Sensitivity loss in odd-symmetric mechanisms and phase anomalies in peripheral vision. Nature, 326, 873-876.
18. Berg, B. G. (1990). Observer efficiency and weights in a multiple observation task. Journal of the Acoustical Society of America, 88, 149-158.
19. Bishop, C. M. (2006). Pattern recognition and machine learning. New York: Springer.
20. Burgess, A. E. (1999). Visual detection with twocomponent noise: Low-pass spectrum effects. Journal of the Optical Society of America A, 694-704.
21. Burgess, A. E., & Colborne, B. (1988). Visual signal detection: IV. Observer inconsistency. Journal of the Optical Society of America A, 5, 617-627.
22. Burgess, A. E., Wagner, R. F., Jennings, R. J., & Barlow, H. B. (1981). Efficiency of human signal discrimination. Science, 214, 93-94.
23. Burt, P. J., & Adelson, E. H. (1983). The Laplacian Pyramid as a compact image code. IEEE Transactions on Communications, 31, 532-540.
24. Caspi, A., Beutter, B. R., & Eckstein, M. P. (2004). The time course of visual information accrual guiding eye movement decisions. Proceedings of the National Academy of Sciences of the United States of America, 101, 13086-13090.
25. Chauvin, A., Worsley, K. J., Schyns, P. G., Arguin, M., & Gosselin, F. (2005). Accurate statistical tests for smooth classification images. Journal of Vision, 5(9):1, 659-667, http://www.journalofvision.org/content/5/9/1, doi:10.1167/5.9.1.
26. Chichilnisky, E. J. (2001). A simple white noise analysis of neuronal light responses. Network, 12, 199-213.
27. Cohen, A. L., Shiffrin, R. M., Gold, J. M., Ross, D. A., & Ross, M. G. (2007). Inducing features from visual noise. Journal of Vision, 7(8):15, 1-14, http://www.journalofvision.org/content/7/8/15, doi:10.1167/7.8.15.
28. Conrey, B., & Gold, J. M. (2009). Pattern recognition in correlated and uncorrelated noise. Journal of the Optical Society of America A, 26, B94-B109.
29. Dai, H., & Micheyl, C. (2010). Psychophysical reverse correlation with multiple response alternatives. Journal of Experimental Psychology: Human Perception and Performance, 36, 976-993.
30. David, S. V., Vinje, W. E., & Gallant, J. L. (2004). Natural stimulus statistics alter the receptive field structure of V1 neurons. Journal of Neuroscience, 24, 6991-7006.
31. de Boer, E., & Kuyper, P. (1968). Triggered correlation. IEEE Transactions on Biomedical Engineering, 15, 169-179.
32. DeCarlo, L. T. (1998). Signal detection theory and generalized linear models. Psychological Methods, 3, 186-205.
33. Dobres, J., & Seitz, A. R. (2010). Perceptual learning of oriented gratings as revealed by classification images. Journal of Vision, 10(13):8, 1-11, http://www.journalofvision.org/content/10/13/8, doi:10.1167/10.13.8.
34. Dobson, A. J., & Barnett, A. G. (2008). An introduction to generalized linear models (3rd ed.). Boca Raton, FL: Chapman and Hall/CRC.
35. Duda, R. O., Hart, P. E., & Stork, D. G. (2000). Pattern classification (2nd ed.). New York: John Wiley & Sons.
36. Eckstein, M. P., Beutter, B. R., Pham, B. T., Shimozaki, S. S., & Stone, L. S. (2007). Similar neural representations of the target for saccades and perception during search. The Journal of Neuroscience, 27, 1266-1270.
37. Egan, J. P., Schulman, A. I., & Greenberg, G. Z. (1959). Operating characteristics determined by binary decisions and by ratings. Journal of the Acoustical Society of America, 31, 768-773.
38. Elder, J. H., & Goldberg, R. M. (2002). Ecological statistics of Gestalt laws for the perceptual organization of contours. Journal of Vision, 2(4):5, 324-353, http://www.journalofvision.org/content/2/4/5, doi:10.1167/2.4.5.
39. Field, D. J., Hayes, A., & Hess, R. F. (1993). Contour integration by the human visual system: Evidence for a local "association field". Vision Research, 33, 173-193.
40. Fisher, R. A. (1936). The use of multiple measurements in taxonomic problems. Annals of Eugenics, 7, 179-188.
41. Geisler, W. S. (1989). Sequential ideal-observer analysis of visual discriminations. Psychological Review, 96, 267-314.
42. Geisler, W. S., Perry, J. S., Super, B. J., & Gallogly, D. P. (2001). Edge co-occurrence in natural images predicts contour grouping performance. Vision Research, 41, 711-724.
43. Gold, J. M., Cohen, A. L., & Shiffrin, R. (2006). Visual noise reveals category representations. Psychonomic Bulletin & Review, 13, 649-655.
44. Gold, J. M., Murray, R. F., Bennett, P. J., & Sekuler, A. B. (2000). Deriving behavioural receptive fields for visually completed contours. Current Biology, 10, 663-666.
45. Gold, J. M., & Shubel, E. (2006). The spatiotemporal properties of visual completion measured by response classification. Journal of Vision, 6(4):5, 356-365, http://www.journalofvision.org/content/6/4/5, doi:10.1167/6.4.5.
46. Gosselin, F., & Schyns, P. G. (2001). Bubbles: A technique to reveal the use of information in recognition tasks. Vision Research, 41, 2261-2271.
47. Gosselin, F., & Schyns, P. G. (2002). RAP: A new framework for visual categorization. Trends in Cognitive Sciences, 6, 70-77.
48. Gosselin, F., & Schyns, P. G. (2004). No troubles with bubbles: A reply to Murray and Gold. Vision Research, 44, 471-477.
49. Green, D. M., & Swets, J. A. (1974). Signal detection theory and psychophysics. Huntington, NY: R. E. Krieger Publishing. (Original work published 1966).
50. Hastie, T., Tibshirani, R., & Friedman, J. (2001). The elements of statistical learning: Data mining, inference, and prediction. New York: Springer.
51. Horwitz, G. D., Chichilnisky, E. J., & Albright, T. A. (2007). Cone inputs to simple and complex cells in V1 of awake macaque. Journal of Neurophysiology, 97, 3070-3081.
52. Itti, L., Koch, C., & Braun, J. (2000). Revisiting spatial vision: Toward a unifying model. Journal of the Optical Society of America A, 17, 1899-1917.
53. Jolliffe, I. T. (2010). Principal component analysis (2nd ed.). New York: Springer.
54. Keane, B. P., Lu, H., & Kellman, P. J. (2007). Classification images reveal spatiotemporal contour interpolation. Vision Research, 47, 3460-3475.
55. Knoblauch, K., & Maloney, L. T. (2008). Estimating classification images with generalized linear and additive models. Journal of Vision, 8(16):10, 1-19, http://www.journalofvision.org/content/8/16/10, doi:10.1167/8.16.10.
56. Lasley, D. J., & Cohn, T. E. (1981). Why luminance discrimination may be better than detection. Vision Research, 21, 273-278.
57. Lee, Y. W., & Schetzen, M. (1965). Measurement of the Wiener kernels of a non-linear system by crosscorrelation. International Journal of Control, 2, 237-254.
58. Levi, D. M., & Klein, S. A. (2002). Classification images for detection and position discrimination in the fovea and parafovea. Journal of Vision, 2(1):4, 46-65, http://www.journalofvision.org/content/2/1/4, doi:10.1167/2.1.4.
59. Li, R. W., Klein, S. A., & Levi, D. M. (2006). The receptive field and internal noise for position acuity change with feature separation. Journal of Vision, 6(4):2, 311-321, http://www.journalofvision.org/content/6/4/2, doi:10.1167/6.4.2.
60. Ljung, L. (1999). System identification: Theory for the user (2nd ed.). Upper Saddle River, NJ: Prentice Hall.
61. Logvinenko, A. D. (1990). Nonlinear analysis of spatial vision using first- and second-order Volterra transfer functions measurement. Vision Research, 30, 2031-2057.
62. Ludwig, C. J. H., Eckstein, M. P., & Beutter, B. R. (2007). Limited flexibility in the filter underlying saccadic targeting. Vision Research, 47, 280-288.
63. Ludwig, C. J. H., Gilchrist, I. D., McSorley, E., & Baddeley, R. J. (2005). The temporal impulse response underlying saccadic decisions. The Journal of Neuroscience, 25, 9907-9912.
64. Macmillan, N. A., & Creelman, C. D. (2005). Detection theory: A user's guide (2nd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.
65. Mareschal, I., Dakin, S. C., & Bex, P. J. (2006). Dynamic properties of orientation discrimination assessed by using classification images. Proceedings of the National Academy of Sciences of the United States of America, 103, 5131-5136.
66. Marmarelis, P. Z., & Marmarelis, V. Z. (1977). Analysis of physiological systems: The white-noise approach. New York: Plenum Press.
67. Marmarelis, P. Z., & Naka, K.-I. (1972). White-noise analysis of a neuron chain: An application of the Wiener theory. Science, 175, 1276-1278.
68. McCullagh, P., & Nelder, J. (1989). Generalized linear models (2nd ed.). Boca Raton, FL: Chapman and Hall/CRC.
69. Michel, M., & Geisler, W. S. (2011). Intrinsic position uncertainty explains detection and localization performance in the periphery. Journal of Vision, 11(1):18, 1-18, http://www.journalofvision.org/content/11/1/18, doi:10.1167/11.1.18.
70. Mineault, P. J., Barthelmé, S., & Pack, C. C. (2009). Improved classification images with sparse priors in a smooth basis. Journal of Vision, 9(10):17, 1-24, http://www.journalofvision.org/content/9/10/17, doi:10.1167/9.10.17.
71. Murray, R. F. (2002). Perceptual organization and the efficiency of shape discrimination. Ph.D. thesis, University of Toronto.
72. Murray, R. F., Bennett, P. J., & Sekuler, A. B. (2002). Optimal methods for calculating classification images: Weighted sums. Journal of Vision, 2(1):6, 79-104, http://www.journalofvision.org/content/2/1/6, doi:10.1167/2.1.6.
73. Murray, R. F., Bennett, P. J., & Sekuler, A. B. (2005). Classification images predict absolute efficiency. Journal of Vision, 5(2):5, 139-149, http://www.journalofvision.org/content/5/2/5, doi:10.1167/5.2.5.
74. Murray, R. F., & Gold, J. M. (2004a). Reply to Gosselin and Schyns. Vision Research, 44, 479-482.
75. Murray, R. F., & Gold, J. M. (2004b). Troubles with bubbles. Vision Research, 44, 461-470.
76. Nagai, M., Bennett, P. J., & Sekuler, A. B. (2008). Exploration of vertical bias in perceptual completion of illusory contours: Threshold measures and response classification. Journal of Vision, 8(7):25, 1-17, http://www.journalofvision.org/content/8/7/25, doi:10.1167/8.7.25.
77. Nandy, A. S., & Tjan, B. S. (2007). The nature of letter crowding as revealed by first- and second-order classification images. Journal of Vision, 7(2):5, 1-26, http://www.journalofvision.org/content/7/2/5, doi:10.1167/7.2.5.
78. Neri, P. (2004). Estimation of nonlinear psychophysical kernels. Journal of Vision, 4(2):2, 82-91, http://www.journalofvision.org/content/4/2/2, doi:10.1167/4.2.2.
79. Neri, P. (2009). Nonlinear characterization of a simple process in human vision. Journal of Vision, 9(12):1, 1-29, http://www.journalofvision.org/content/9/12/1, doi:10.1167/9.12.1.
80. Neri, P. (2010a). How inherently noisy is human sensory processing? Psychonomic Bulletin & Review, 17, 802-808.
81. Neri, P. (2010b). Stochastic characterization of smallscale algorithms for human sensory processing. Chaos, 20, 1-19.
82. Neri, P. (2010c). Visual detection under uncertainty operates via an early static, not late dynamic, nonlinearity. Frontiers in Computational Neuroscience, 4, 1-17.
83. Neri, P., & Heeger, D. J. (2002). Spatiotemporal mechanisms for detecting and identifying image features in human vision. Nature Neuroscience, 5, 812-816.
84. Neri, P., & Levi, D. M. (2006). Receptive versus perceptive fields from the reverse-correlation viewpoint. Vision Research, 46, 2465-2474.
85. Neri, P., & Parker, A. J. (1999). Probing the human stereoscopic system with reverse correlation. Nature, 401, 695-698.
86. Pelli, D. G. (1985). Uncertainty explains many aspects of visual contrast detection and discrimination. Journal of the Optical Society of America A, 2, 1508-1532.
87. Pelli, D. G., Burns, C. W., Farell, B., & Moore-Page, D. C. (2006). Feature detection and letter identification. Vision Research, 46, 4646-4674.
88. Pelli, D. G., & Farell, B. (1999). Why use noise? Journal of the Optical Society of America A, 16, 647-653.
89. Pelli, D. G., & Tillman, K. A. (2008). The uncrowded window of object recognition. Nature Neuroscience, 11, 1129-1135.
90. Peterson, W. W., Birdsall, T. G., & Fox, W. C. (1954). The theory of signal detectability. Transactions of the IRE Professional Group on Information Theory, 4, 171-212.
91. Pinter, R. B., & Nabet, B. (1992). Nonlinear vision: Determination of neural receptive fields, function, and networks. Boca Raton, FL: CRC Press.
92. Prenger, R., Wu, M. C.-K., David, S. V., & Gallant, J. L. (2004). Nonlinear V1 responses to natural scenes revealed by neural network analysis. Neural Networks, 17, 663-679.
93. R Development Core Team (2010). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing.
94. Rajashekar, U., Bovik, A. C., & Cormack, L. K. (2006). Visual search in noise: Revealing the influence of structural cues by gaze-contingent classification image analysis. Journal of Vision, 6(4):7, 379-386, http://www.journalofvision.org/content/6/4/7, doi:10.1167/6.4.7.
95. Rajashekar, U., Cormack, L. K., & Bovik, A. C. (2002). Visual search: Structure from noise. In A. T. Duchowski (Ed.), Proceedings of the 2002 Symposium on Eye Tracking Research and Applications (pp. 119-123). New York: Association for Computing Machinery.
96. Richards, V. M., & Zhu, S. (1994). Relative estimates of combination weights, decision criteria, and internal noise based on correlation coefficients. Journal of the Acoustical Society of America, 95, 423-434.
97. Rieke, F., Warland, D., de Ruyter van Steveninck, R., & Bialek, W. (1997). Spikes: Exploring the neural code. Cambridge, MA: The MIT Press.
98. Ringach, D. L., Hawken, M. J., & Shapley, R. (2003). Dynamics of orientation tuning in macaque V1: The role of global and tuned suppression. Journal of Neurophysiology, 90, 342-352.
99. Ringach, D. L., & Shapley, R. (1996). Spatial and temporal properties of illusory contours and amodal boundary completion. Vision Research, 36, 3037-3050.
100. Sakai, H. M. (1992). White-noise analysis in neurophysiology. Physiological Reviews, 72, 491-505.
101. Schetzen, M. (1980). The Volterra and Wiener theories of nonlinear systems. New York: John Wiley & Sons.
102. Solomon, J. A. (2002). Noise reveals visual mechanisms of detection and discrimination. Journal of Vision, 2(1):7, 105-120, http://www.journalofvision.org/content/2/1/7, doi:10.1167/2.1.7.
103. Solomon, J. A., & Pelli, D. G. (1994). The visual filter mediating letter identification. Nature, 369, 395-397.
104. Stark, L. (1969). The pupillary control system: Its nonlinear adaptive and stochastic engineering design characteristics. Automatica, 5, 655-676.
105. Sutter, E. E. (1987). A practical non-stochastic approach to nonlinear time-domain analysis. In V. Z. Marmarelis (Ed.), Advanced methods of physiological systems modeling (vol. 1, pp. 303-315). Los Angeles: Biomedical Simulations Resource.
106. Tang, Z., & Richards, V. M. (2005). Comparing linear regression models applied to psychophysical data [Abstract]. Journal of the Acoustical Society of America, 117, 2597.
107. Tanner, W. P., Jr. (1961). Physiological implications of psychophysical data. Annals of the New York Academy of Sciences, 89, 752-765.
108. Tavassoli, A., van der Linde, I., Bovik, A. C., & Cormack, L. K. (2007). An efficient technique for revealing visual search strategies with classification images. Perception & Psychophysics, 69, 103-112.
109. Taylor, C. P., Bennett, P. J., & Sekuler, A. B. (2009). Spatial frequency summation in noise. Journal of the Optical Society of America A, 26, B84-B93.
110. Tjan, B. S., & Nandy, A. S. (2006). Classification images with uncertainty. Journal of Vision, 6(4):8, 387-413, http://www.journalofvision.org/content/6/4/8, doi:10.1167/6.4.8.
111. Van Trees, H. L. (2001). Detection, estimation, and modulation theory: Part I. New York: John Wiley & Sons. (Original work published 1968).
112. Victor, J. D. (1992). Nonlinear systems analysis in vision: Overview of kernel methods. In R. B. Pinter & B. Nabet (Eds.), Nonlinear vision: Determination of neural receptive fields, function, and networks (pp. 1-37). Boca Raton, FL: CRC Press.
113. Victor, J. D. (2005). Analyzing receptive fields, classification images and functional images: Challenges with opportunities for synergy. Nature Neuroscience, 8, 1651-1656.
114. Volterra, V. (1930). Theory of functionals and of integral and integrodifferential equations. London: Blakie.
115. Watson, A. B. (1998). Multi-category classification: Template models and classification images [Abstract]. Investigative Ophthalmology and Visual Science, 39, S912.
116. Westheimer, G. (1979). The spatial sense of the eye. Investigative Ophthalmology and Visual Science, 18, 893-912.
117. Wiener, N. (1958). Nonlinear problems in random theory. New York: John Wiley & Sons.
118. Wu, M. C.-K., David, S. V., & Gallant, J. L. (2006). Complete functional characterization of sensory neurons by system identification. Annual Review of Neuroscience, 29, 477-505.
119. Yamashita, O., Sato, M., Yoshioka, T., Tong, F., & Kamitani, Y. (2008). Sparse estimation automatically selects voxels relevant for the decoding of fMRI activity patterns. NeuroImage, 42,1414-1429.
120. Zeevi, Y. Y., & Mangoubi, S. S. (1984). Vernier acuity with noisy lines: Estimation of relative position uncertainty. Biological Cybernetics, 50, 371-376.