First- and second-order information in natural images: A filter-based approach to image statistics

Journal of the Optical Society of America A: Optics and Image Science, and Vision

Volumn 21, Issue 6, 2004, Pages 913-925

  Johnson, Aaron P ^a   Baker Jr, Curtis L ^a  

^a MCGILL UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

COLOR; COLOR IMAGE PROCESSING; COMPUTER SIMULATION; CONVOLUTION; DIFFRACTION GRATINGS; FOURIER OPTICS; FRACTALS; IMAGE ENHANCEMENT; OPTICAL CORRELATION; OPTICAL FILTERS; OPTICAL PROPERTIES; STATISTICAL METHODS;

BIOLOGICALLY MOTIVATED FILTERS; FOURIER POWER SPECTRA; IMAGE STATISTICS; NATURAL IMAGES;

IMAGE ANALYSIS;

ALGORITHM; ANIMAL; ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; BIOMIMETICS; COMPARATIVE STUDY; COMPUTER ASSISTED DIAGNOSIS; COMPUTER SIMULATION; EVALUATION; HUMAN; IMAGE ENHANCEMENT; INFORMATION RETRIEVAL; METHODOLOGY; NERVE CELL; NERVE CELL NETWORK; PATTERN RECOGNITION; PHYSIOLOGY; SIGNAL PROCESSING; STATISTICAL MODEL; VISION; VISUAL CORTEX;

ALGORITHMS; ANIMALS; BIOMIMETICS; COMPUTER SIMULATION; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; INFORMATION STORAGE AND RETRIEVAL; MODELS, BIOLOGICAL; MODELS, STATISTICAL; NERVE NET; NEURAL NETWORKS (COMPUTER); NEURONS; PATTERN RECOGNITION, VISUAL; SIGNAL PROCESSING, COMPUTER-ASSISTED; VISUAL CORTEX; VISUAL PERCEPTION;

EID: 3042529776     PISSN: 10847529     EISSN: None     Source Type: Journal    
DOI: 10.1364/JOSAA.21.000913     Document Type: Article

References (76)

1. D. J. Field, "Relations between the statistics of natural images and the response profiles of cortical cells," J. Opt. Soc. Am. A 4, 2379-2394 (1987).
2. D. J. Tolhurst, Y. Tadmor, and T. Chao, "Amplitude spectra of natural images," Ophthalmic Physiol. Opt. 12, 229-232 (1992).
3. A. van der Schaaf and J. H. van Hateren, "Modelling the power spectra of natural images: statistics and information," Vision Res. 36, 2759-2770 (1996).
4. D. J. Field and N. Brady, "Visual sensitivity, blur and the sources of variability in the amplitude spectra of natural scenes," Vision Res. 37, 3367-3384 (1997).
5. D. J. Field, "What is the goal of sensory coding," Neural Comput. 6, 559-601 (1994).
6. R. J. Baddeley, "Searching for filters with 'interesting' output distributions: an uninteresting direction to explore?" Network 7, 409-421 (1996).
7. A. J. Schofield, "What does second-order vision see in an image?" Perception 29, 1071-1086 (2000). An additional figure is available at http://www.pereeptionweb.com/perc0900/ schofield.html.
8. O. Schwartz and E. P. Simoncelli, "Natural signal statistics and sensory gain control," Nat. Neurosci. 4, 819-825 (2001).
9. D. L. Ringach, "Spatial structure and symmetry of simple-cell receptive fields in macaque primary visual cortex," J. Neurophysiol. 88, 455-463 (2002).
10. E. P. Simoncelli and B. A. Olshausen, "Natural image statistics and neural representation," Annu. Rev. Neurosci. 24, 113-1216 (2001).
11. A. Pentland, "Fractal-based description of natural scenes," IEEE Trans. Pattern Anal. Mach. Intell. PAMI-6, 661-674 (1984).
12. D. L. Ruderman, "Origins of scaling in natural images," Vision Res. 37, 3385-3398 (1997).
13. M. G. A. Thomsom, "Beats, kurtosis and visual coding," Network 12, 271-287 (2001).
14. D. L. Ruderman, "The statistics of natural images," Network 5, 517-548 (1994).
15. A. J. Bell and T. J. Sejnowski, "The 'independent components' of natural scenes are edge filters," Vision Res. 37, 3327-3338 (1997).
16. B. A. Olshausen and D. J. Field, "Emergence of simple-cell receptive field properties by learning a sparse code for natural images," Nature (London) 381, 607-609 (1996).
17. J. H. van Hateren and D. L. Ruderman, "Independent component analysis of natural image sequences yields spatio-temporal filters similar to simple cells in primary visual cortex," Proc. R. Soc. London Ser. B 265, 2315-2320 (1998).
18. A. Hyvärinen and P. O. Hoyer, "A two-layer sparse coding model learns simple and complex cell receptive fields and topography from natural images," Vision Res. 41, 2413-2423 (2001).
19. B. A. Olshausen and D. J. Field, "Sparse coding with an overcomplete basis set: a strategy employed by V1?" Vision Res. 37, 3311-3325 (1996).
20. D. H. Hubel and T. N. Wiesel, "Receptive fields, binocular interaction and functional architecture in the cat's visual cortex," J. Physiol. (London) 160, 106-154 (1962).
21. F. W. Campbell, G. F. Cooper, and C. Enroth-Cugell, "The spatial selectivity of the visual cells of the cat," J. Physiol. (London) 203, 223-235 (1969).
22. R. L. De Valois, D. G. Albrecht, and L. G. Thorell, "Spatial frequency selectivity of cells in macaque visual cortex," Vision Res. 22, 545-559 (1982).
23. L. A. Palmer and T. L. Davis, "Receptive-field structure in cat striate cortex," J. Neurophysiol. 46, 260-276 (1981).
24. D. L. Ringach, M. J. Hawkin, and R. Shapley, "Dynamics of orientation tuning in primary visual cortex," Nature (London) 387, 281-284 (1997).
25. F. W. Campbell and J. G. Robson, "Application of Fourier analysis to the visibility of gratings," J. Physiol. (London) 197, 551-566 (1968).
26. C. Blakemore and F. W. Campbell, "On the existence of neurones in the human visual system selectively sensitive to the orientation and size of retinal images," J. Physiol. (London) 203, 237-260 (1969).
27. J. G. Daugman, "Uncertainty relations for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters," J. Opt. Soc. Am. A 2, 1160-1169 (1985).
28. D. J. Field and D. J. Tolhurst, "The structure and symmetry of simple cell receptive-field profiles in the cat's visual cortex," Proc. R. Soc. London Ser. B 228, 379-400 (1986).
29. C. Chubb and G. Sperling, "Drift-balanced random stimuli: a general basis for studying non-Fourier motion perception," J. Opt. Soc. Am. A 5, 1986-2007 (1988).
30. P. Cavanagh and G. Mather, "Motion: the long and short of it," Spatial Vision 4, 103-129 (1989).
31. A. M. Derrington and O. I. Ukkonen, "Second-order motion discrimination by feature tracking," Vision Res. 39, 1465-1475 (1999).
32. T. Ledgeway and A. T. Smith, "Evidence for separate motion-detecting mechanisms for first- and second-order motion in human vision," Vision Res. 34, 2727-2740 (1994).
33. A. Sutter, G. Sperling, and C. Chubb, "Measuring the spatial frequency selectivity of second-order texture mechanisms," Vision Res. 35, 915-924 (1995).
34. A. T. Smith and T. Ledgeway, "Separate detection of moving luminance and contrast modulations: fact or artifact?" Vision Res. 37, 45-62 (1997).
35. A. J. Schofield and M. A. Georgeson, "Sensitivity to modulations of luminance and contrast in visual white noise: separate mechanisms with similar behaviour," Vision Res. 39, 2697-2716 (1999).
36. L. M. Vaina, A. Cowey, and D. K. Kennedy, "Perception of first- and second-order motion: separable neurological mechanisms?" Hum. Brain Mapp. 7, 67-77 (1999).
37. A. T. Smith, R. F. Hess, and C. L. Baker, Jr., "Direction identification thresholds for second-order motion in central and peripheral vision," J. Opt. Soc. Am. A 11, 506-514 (1994).
38. S. O. Dumoulin, C. L. Baker, Jr., R. F. Hess, and A. C. Evans, "Cortical specialization for processing first- and second-order motion," Cereb. Cortex 13, 1375-1385 (2003).
39. T. D. Albright, "Form-cue invariant motion processing in primate visual cortex," Science 255, 1141-1143 (1992).
40. A. Chaudhuri and T. D. Albright, "Neuronal responses to edges defined by luminance vs. temporal texture in macaque area V1," Visual Neurosci. 14, 949-962 (1997).
41. C. L. Baker, Jr., "Central neural mechanisms for detecting second-order motion," Curr. Opin. Neurobiol. 9, 461-466 (1999).
42. C. Chubb and M. S. Landy, "Orthogonal distribution analysis: a new approach to the study of texture perception," in Computational Models of Visual Processing, M. S. Landy and J. A. Movshon, eds. (MIT Press, Cambridge, Mass., 1991), pp. 291-301.
43. H. R. Wilson, V. P. Ferrera, and C. Yo, "A psychophysically motivated model for two-dimensional motion perception," Visual Neurosci. 9, 79-97 (1992).
44. M. S. Landy and J. R. Bergen, "Texture segregation and orientation gradient," Vision Res. 31, 679-691 (1991).
45. M. S. Landy and N. Graham, "Visual perception of texture," in The Visual Neurosciences, L. M. Chalupa and J. S. Werner, eds. (MIT Press, Cambridge, Mass., 2003), pp. 1106-1118.
46. N. Prins and F. A. A. Kingdom, "Detection and discrimination of texture modulations defined by orientation, spatial frequency, and contrast," J. Opt. Soc. Am. A 20, 401-410 (2003).
47. C. L. Baker, Jr. and I. Mareschal, "Processing of second-order stimuli in the visual cortex," in Vision: From Neurons to Cognition, Progress in Brain Research, C. Casanova and M. Ptito, eds. (Elsevier Science, Amsterdam, 2001), Vol. 134, Chap. 12.
48. N. Graham, A. Sutter, and C. Venkatesan, "Spatial-frequency- and orientation-selectivity of simple and complex channels in region segregation," Vision Res. 33, 1893-1911 (1993).
49. F. A. A. Kingdom and D. R. T. Keeble, "On the mechanism for scale invariance in orientation-defined textures," Vision Res. 39, 1477-1489 (1999).
50. N. Graham and S. Wolfson, "A note about preferred orientations at the first and second stages of complex (second-order) texture channels," J. Opt. Soc. Am. A 18, 2273-2281 (2001).
51. S. C. Dakin and I. Mareschal, "Sensitivity to contrast modulation depends on carrier spatial frequency and orientation," Vision Res. 40, 311-329 (2000).
52. J. A. Solomon and G. Sperling, "Full-wave and half-wave rectification in second-order motion perception," Vision Res. 34, 2239-2257 (1994).
53. N. Graham and A. Sutter, "Spatial summation in simple (Fourier) and complex (non-Fourier) channels in texture segregation," Vision Res. 38, 231-257 (1998).
54. Y-X. Zhou and C. L. Baker, Jr., "Spatial properties of envelope responses in Area 17 and 18 of the cat," J. Neurophysiol. 75, 1038-1050 (1996).
55. R. C. Gonzalez and R. E. Woods, Digital Image Processing, 2nd ed. (Prentice-Hall, Englewood Cliffs, N.J., 2001), pp. 199-205.
56. I. Mareschal and C. L. Baker, Jr., "Cortical processing of second order motion," Visual Neurosci. 16, 527-540 (1999).
57. K. V. Marida, Statistics of Directional Data (Academic, London, 1972).
58. I. Mareschal and C. L. Baker, Jr., "Temporal and spatial response to second-order stimuli in cat A18," J. Neurophysiol. 80, 2811-2823 (1998).
59. D. C. Knill, D. J. Field, and D. Kersten, "Human discrimination of fractal images," J. Opt. Soc. Am. A 7, 1113-1123 (1990).
60. Y Tadmor and D. J. Tolhurst, "Discrimination of changes in the 2nd-order statistics of natural and synthetic-images," Vision Res. 34, 541-554 (1994).
61. S. J. M. Rainville and F. A. A. Kingdom, "Spatial-scale contribution to the detection of mirror symmetry in fractal noise," J. Opt. Soc. Am. A 16, 2112-2122 (1999).
62. R. J. Baddeley and P. J. B. Hancock, "A statistical analysis of natural images matches psychophysically derived orientation tuning curves," Proc. R. Soc. London Ser. B 246, 219-223 (1991).
63. E. A. Essock, J. K. DeFord, B. C. Hansen, and M. J. Sinai, "Oblique stimuli are seen best (not worst!) in naturalistic broad-band stimuli: a horizontal effect," Vision Res. 43, 1329-1335 (2003).
64. C. S. Furmanski and S. A. Engel, "An oblique effect in human primary visual cortex," Nat. Neurosci. 3, 535-536 (2000).
65. D. Schluppeck and S. A. Engel, "Oblique effect in human MT+ follows pattern rather than component motion," J. Vision 3, Abstract 282, p. 282a (2003).
66. B. W. Li, M. R. Peterson, and R. D. Freeman, "The oblique effect: a neural basis in the visual cortex," J. Neurophysiol. 90, 204-217 (2003).
67. H. B. Barlow and D. J. Tolhurst, "Why do you have edge detectors?" in OSA Annual Meeting, Vol. 23 of 1992 OSA Technical Digest Series (Optical Society of America, Washington, D.C., 1992), p. 172.
68. J. P. Jones and L. A. Palmer, "An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex," J. Neurophysiol. 58, 1233-1258 (1987).
69. J. P. Jones and L. A. Palmer, "The two-dimensional spatial structure of simple receptive fields in cat striate cortex," J. Neurophysiol. 58, 1187-1211 (1987).
70. D. J. Tolhurst and L D. Thompson, "On the variety of spatial frequency selectivity shown by neurons in area 17 of the cat," Proc. R. Soc. London Ser. B 213, 183-199 (1981).
71. D. B. Hamilton, D. G. Albrecht, and W. S. Geisler, "Visual cortical receptive fields in monkey and cat: spatial and temporal phase transfer function," Vision Res. 29, 1285-1308 (1989).
72. Z.-L. Lu and G. Sperling, "The functional architecture of human visual motion perception," Vision Res. 35, 2697-2722 (1995).
73. N. Graham and A. Sutter, "Normalization: contrast-gain control in simple (Fourier) and complex (non-Fourier) path-ways of pattern vision," Vision Res. 40, 2737-2761 (2000).
74. D. J. Heeger, "Normalization of cell responses in cat striate cortex," Visual Neurosci. 9, 271-294 (1992).
75. A. G. Leventhal, Y. Wang, M. T. Schmolesky, and Y. Zhou, "Neural correlates of boundary perception," Visual Neurosci. 15, 1107-1118 (1998).
76. I. Mareschal and C. L. Baker, Jr., "A cortical locus for the processing of contrast-defined contours," Nat. Neurosci. 1, 150-154