Spatio-temporal adaptation in the unsupervised development of networked visual neurons

IEEE Transactions on Neural Networks

Volumn 20, Issue 6, 2009, Pages 992-1008

  Chen, Dongyue ^a,b   Zhang, Liming ^a   Weng, Juyang ^c  

^a FUDAN UNIVERSITY   (China)

^b NORTHEASTERN UNIVERSITY   (China)

^c Michigan State University   (United States)

Author keywords

Attention selection; Developmental algorithm; Hebbian learning rule; Lateral inhibition; Receptive fields (RFs)

Indexed keywords

ATTENTION SELECTION; DEVELOPMENTAL ALGORITHM; HEBBIAN LEARNING RULE; LATERAL INHIBITION; RECEPTIVE FIELDS (RFS);

EDUCATION;

LEARNING ALGORITHMS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; BIOMIMETICS; COMPUTER SIMULATION; METHODOLOGY; NERVE CELL NETWORK; THEORETICAL MODEL; VISION;

ALGORITHMS; BIOMIMETICS; COMPUTER SIMULATION; MODELS, THEORETICAL; NERVE NET; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED; VISUAL PERCEPTION;

EID: 67649342220     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2009.2015082     Document Type: Article

References (57)

1. H. K. Hartline, "The response of single optic nerve fibers of the vertebrate eye to illumination of the retina," Amer. J. Physiol., vol. 121, no. 22, pp. 400-415, 1938.
2. D. H. Hubel and T. N. Wiesel, "Receptive fields, binocular interaction and functional architecture in the cat's visual cortex," J. Physiol. vol. 160, no. 1, pp. 106-154, 1962.
3. S. Marcelja, "Mathematical description of the response of simple cortical cells," J. Opt. Soc. Amer., vol. 70, no. 11, pp. 1297-1300, 1980.
4. J. G. Daugman, "Tow-dimensional spectral analysis of cortical receptive field profiles," Vis. Res., vol. 20, no. 5, pp. 847-856, 1980.
5. D. J. Heeger, "Modeling simple-cell direction selectivity with normalized, half-squared, linear operators," J. Neurophysiol., vol. 70, no. 5, pp. 1885-1898, 1993.
6. C. Rasche, "Neuromorphic excitable maps for visual processing" IEEE Trans. Neural Netw., vol. 18, no. 2, pp. 520-529, Mar. 2007.
7. J. K. Stevens and G. L. Gerstein, "Spatiotemporal organization of cat lateral geniculate receptive fields," J. Neurophysiol., vol. 39, no. 22, pp. 213-238, 1976.
8. G. C. DeAngelis, I. Ohzawa, and R. D. Freeman, "Receptive field dynamics in the central visual pathway," J. Neurophysiol., vol. 18, no. 10, pp. 451-458, 1995.
9. E. H. Adelson and J. R. Bergen, "Spatiotemporal energy models for the perception of motion," J. Opt. Soc. Amer., vol. A2, no. 2, pp. 284-299, 1985.
10. Y. J. Wang, X. L. Qi, J. Xing, and D. S. Yu, "Extended Gabor function model and simulation of some characteristic curves of receptive fields," Scientia Sinica Seriess B, vol. 31, no. 1, pp. 1185-1994, 1988.
11. Y. J. Wang, X. L. Qi, J. Xing, and Y. Z. Chen, "Simulation of RF dynamics," Trends Neurosci., vol. 19, no. 1, pp. 385-386, 1996.
12. C. Blakemore and G. Cooper, "Development of the brain depends on the visual environment," Nature, vol. 228, no. 5270, pp. 471-478, 1970.
13. T. Hosoya, S. A. Baccus, and M. Meister, "Dynamic predictive coding by the retina," Nature, vol. 436, no. 7047, pp. 71-77, 2005.
14. S. L. Pallas, L. von Melchner, and M. sur, "Visual behavior mediated by retinal projections directed to the auditory pathway," Nature, vol. 404, no. 6780, pp. 871-876, 2000.
15. T. D. Sanger, "Optimal unsupervised learning in a single-layer linear feedforward neural network," Neural Netw., vol. 2, no. 6, pp. 459-473, 1989.
16. R. Linsker, "From basic network principles to neural architecture: Emergence of spatial-opponent cells," Proc. Nat. Acad. Sci. USA, vol. 83, no. 19, pp. 7508-7512, 1986.
17. P. Foldiak, "Adaptive network for optimal linear feature extraction," in Proc. IEEE/INNS Int. Joint Conf. Neural Netw., 1989, pp. 401-405.
18. E. Oja, "A simplified neuron model as a principal component analyze," J. Math. Biol., vol. 15, no. 1, pp. 267-273, 1982.
19. H. G. Barrow, "Learning receptive fields," in Proc. IEEE 1st Int. Conf. Neural Netw., 1987, vol. 4, no. 1, pp. 115-121.
20. J. Weng and N. Zhang, "Optimal in-place learning and lobe component analysis," in Proc. Int. Joint Conf. Neural Netw., Jul. 16-21, 2006, pp. 3887-3894, 2006.
21. T. Kohonen, "The adaptive-subspace SOM (ASSOM) and its use for the implementation of invariant feature detection," in Proc. Int. Conf. Artif. Neural Netw., Paris, France, 1995, pp. 3-10.
22. H. C. Zheng, G. Lefebvre, and C. Laurent, "Fast-learning adaptive-subspace self-organizing map: An application to saliency-based invariant image feature construction," IEEE Trans. Neural Netw., vol. 19, no. 5, pp. 746-757, Sep. 2008.
23. T. Kohonen, Self-Organizing Map, 2nd ed. New York: Wiley, 2001.
24. D. O. Hebb, The Organization of Behavior: A Neuropsychological Theory 1st ed. New York: Wiley, 1949.
25. D. J. Field "What is the goal of sensory coding?," Neural Comput. vol. 6, no. 1, pp. 559-601, 1994.
26. B. A. Olshausen and D. J. Field, "Emergence of simple-cell receptive field properties by learning a sparse code for nature images," Nature, vol. 381, no. 6583, pp. 607-609, 1996.
27. A. J. Bell and T. J. Sejnowski, "The "independent components" of natural scenes are edge filters," Vis. Res., vol. 37, no. 23, pp. 3327-3338, 1997.
28. R. Linsker, "A local learning rule that enables information maximization for arbitrary input distributions," Neural Comput., vol. 9, no. 8, pp. 1661-1665, 1997.
29. M. D. Plumbley and E. Oja, "The "nonnegative PCA" algorithm for independent component analysis," IEEE Trans. Neural Netw., vol. 15, no. 1, pp. 66-76, Jan. 2004.
30. M. S. Falconbridge, R. L. Stamps, and D. R. Badcock, "A simple hebbian/anti-Hebbian network learns the sparse independent components of natural images," Neural Comput., vol. 18, no. 1, pp. 415-429, 2006.
31. J. Karhunen and S. Malaroiu, "Locally linear independent component analysis," in Proc. Int. Joint Conf. Neural Netw., 1999, pp. 882-887.
32. J. Weng, T. Luwang, H. Lu, and X. Xue, "Multilayer in-place learning networks for modeling functional layers in the laminar cortex," Neural Netw., vol. 21, no. 1, pp. 150-159, 2008.
33. A. Hyvärinen, P. O. Hoyer, and M. Inki, "Topographic independent component analysis," Neural Comput., vol. 13, no. 7, pp. 1527-1558, 2001.
34. L. Ma and L. Zhang, "A hierarchical generative model for overcomplete topographic representations in natural images," in Proc. Int. Joint Conf. Neural Netw., Orlando, FL, Aug. 12-17, 2007, pp. 1198-1203, 2007.
35. J. H. Hateren and D. L. Ruderman, "Independent component analysis of natural image sequences yields spatio-temporal filters similar to simple cells in primary visual cortex," Proc. R. Soc. Lond. B., pp. 2315-2320, 1998.
36. C. Koch and S. Ullman, "Shifts in selective visual attention: Towards the underlying neural circuitry," Human Neurobiol., vol. 4, no. 4, pp. 219-227, 1985.
37. J. K. Tsotsos, S. M. Culhane, W. Y. Kei Wai, Y. Lai, N. Davis, and F. Nuflo, "Modeling visual attention via selective tuning," Artif. Intell., vol. 78, no. 1, pp. 507-545, 1995.
38. L. Itti and C. Koch, "A saliency-based search mechanism for overt and covert shifts of visual attention," Vis. Res., vol. 40, no. 10, pp. 1489-1506, 2000.
39. L. Itti, "Quantitative modeling of perceptual salience at human eye position," Vis. Cogn., vol. 14, no. 4, pp. 959-984, 2006.
40. W. S. McCulloch and W. H. Pitts, "A logical calculus of ideas immanent in neural nets," Bull Math Biophys., vol. 5, no. 1, pp. 115-133, 1943.
41. C. Enroth-Cugell and L. Pinto, "Algebraic summation of centre and surround inputs to retinal ganglion cells of the cat," Nature, vol. 226, no. 5244, pp. 458-459, 1970.
42. J. A. Movshon, I. D. Thompson, and D. J. Tolhurst, "Spatial summation in the receptive fields of simple cells in the cat's striate cortex," J. Neurophysiol., vol. 283, no. 1, pp. 53-57, 1978.
43. P. Z. Marmarelis and V. Z. Marmarelis, Analysis of Physiological Systems: The White-Noise Approach, 2nd ed. New York: Plenum, 1978.
44. J. J. Hopfield and D. W. Tank, "Computing with neural circuits: A model," Science, vol. 233, no. 4764, pp. 625-633, 1986.
45. P. Dayan and L. F. Abbott, Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems, 1st ed. Cambridge, MA: MIT Press, 2001.
46. Z. H. Mao and S. G. Massaquoi, "Dynamics of winner-take-all competition in recurrent neural networks with lateral inhibition," IEEE Trans. Neural Netw., vol. 18, no. 1, pp. 55-69, Jan. 2007.
47. T. Yamada, "Control of tissue specificity: The pattern of cellular synthetic activities in tissue transformation," Amer. Zoologist, vol. 6, no. 1, pp. 21-31, 1966.
48. T. S. Okada, Transdifferentiation, 1st ed. New York: Oxford Univ. Press, 1991.
49. Z. Li, "A neural model of contour integration in the primary visual cortex," Neural Comput., vol. 19, no. 4, pp. 480-498, 1999.
50. F. Gabbini, W. Metzner, R. Wessel, and C. Koch, "From stimulus encoding to feature extraction in weakly electric fish," Nature, vol. 384, no. 6609, pp. 564-567, 1996.
51. Y. Sun and R. Fisher, "Object-based visual attention for computer vision," Artif. Intell., vol. 146, no. 1, pp. 77-123, 2003.
52. S. Frintrop, Vocus: A Visual Attention System for Object Detection and Goal-Directed Search, ser. Lecture Notes in Computer Science, 1st ed. Berlin, Germany: Springer-Verlag, 2006, vol. 3889.
53. H. K. Hartline, H. G. Wagner, and F. Ratliff, "Inhibition in the eye of limulus," J. Gen. Physiol., vol. 39, no. 5, pp. 651-673, 1956.
54. A. M. Treisman and S. Gormican, "Feature analysis in early vision: Evidence from search asymmetries," Psychol. Rev., vol. 95, no. 1, pp. 15-48, 1988.
55. H. E. Egeth and S. Yantis, "Visual attention: Control, representation, and time course," Annu. Rev. Psychol., vol. 48, no. 1, pp. 269-297, 1997.
56. J. Theeuwes, "Top-down search strategies cannot override attentional capture," Psychonom. Bull. Rev., vol. 11, no. 1, pp. 65-70, 2004.
57. Z. Ji, J. Weng, and D. Prokhorov, "Where-what network 1: "Where" and "what" assist each other through top-down connections," in Proc. IEEE Int. Conf. Develop. Learn., Monterey, CA, Aug. 9-12, 2008, pp. 61-66, 2008.