Dynamics of a winner-take-all neural network

Neural Networks

Volumn 9, Issue 7, 1996, Pages 1141-1154

  Fang, Yuguang ^b   Cohen, Michael A ^b   Kincaid, Thomas G ^a  

^a Boston University   (United States)

^b NONE

Author keywords

Competition; Lateral inhibition; MOSFET; Nonlinear dynamics; Shunting inhibition; VLSI neural networks; Winnter take all

Indexed keywords

CONVERGENCE OF NUMERICAL METHODS; DECISION MAKING; ELECTRIC CURRENTS; MATHEMATICAL MODELS; MOSFET DEVICES; VLSI CIRCUITS;

LATERAL INHIBITION; SHUNTING INHIBITION; WINNER TAKE ALL;

NEURAL NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; CONTROLLED STUDY; PRIORITY JOURNAL;

EID: 0030273368     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/0893-6080(96)00019-6     Document Type: Article

References (37)

1. Andreaou A.G.et al. Current-mode subthreshold MOS circuits for analog VLSI neural networks. IEEE Transactions on Neural Networks. 2(2):1991;205-213.
2. Choi J., Sheu B.J. A high-precision VLSI winner-take-all circuit for self-organizing neural networks. IEEE Journal of Solid-State Circuits. 28(5):1993;576-594.
3. Cohen, M. A., & Grossberg, S. (1983). Absolute stability of global pattern formation and parallel pattern formation by competitive neural networks. IEEE Transactions on Systems, Man and Cybernetics, SMC-13, 815-826.
4. Ermentrout B. Complex dynamics in winner-take-all neural nets with slow inhibition. Neural Networks. 5:1992;415-431.
5. Fang W.C., Sheu B.J., Chen O.T.C., Choi J. A VLSI neural processor for image data compression using self-organizing neural network. IEEE Transactions on Neural Networks. 3(3):1992;506-518.
6. Feldman J.A., Ballard D.H. Connectionist models and their properties. Cognitive Science. 6:1982;205-254.
7. Grossberg S. Contour enhancement, short term memory, and constancies in reverberating neural networks. Studies in Applied Mathematics. 52:1973;213-257.
8. Grossberg S. Competition, decision, and consensus. Journal of Mathematical Analysis and Applications. 66:1978;470-493.
9. Grossberg S. Nonlinear neural networks: principles, mechanisms, and architectures. Neural Networks. 1:1988;17-61.
10. Haykin, S. (1994). Neural networks; a comprehensive foundation. New York: Macmillan College Publishing Company.
11. Hirsch M.W. Systems of differential equations which are competitive or cooperative. I: Limit sets SIAM Journal of Mathematical Analysis. 13:1982;167-179.
12. Hirsch M.W. Convergent activation dynamics in continuous time networks. Neural Networks. 2:1989;331-349.
13. Hopfield J.J. Neurons with graded responses have collective computational properties like those of two-state neurons. Proceedings of the National Academy of Sciences USA. 81:1984;3088-3092.
14. Horenstein, M. N. (1990). Microelectronic circuits and devices. Englewood Cliffs, NJ: Prentice-Hall.
15. Kane, J. S., & Kincaid, T. G. (1995). Optoelectric winner-take-all VLSI shunting neural networks. IEEE Transactions on Circuits and Systems II, to appear.
16. Kaski S., Kohonen T. Winner-take-all networks for physiological models of competitive learning. Neural Networks. 7:1994;973-984.
17. Kohonen T. Physiological interpretation of the self-organizing map algorithm. Neural Networks. 6:1993;895-905.
18. Lakshmikantham, V., & Leela, S. (1969). Differential and integral inequalities: theory and applications, Vol. 1: ordinary differential equations. New York: Academic Press.
19. Lazzaro, J., Ryckebusch, S., Mahowald, M. A., & Mead, C. A. (1989). Winner-take-all networks of O(N) complexity. In D. S. Touretzky (Ed.), Advances in neural information processing systems I (pp. 703-711). San Mateo, CA: Morgan Kaufmann.
20. Lee, J. C., & Sheu, B. J. (1991). Analog neuroprocessors for early vision processing. In H. S. Moscovitz, K. Yao & R. Jain (Eds) (pp. 319-328). VLSI signal processing IV. New York: The IEEE Press.
21. Lemmon M., Kumar B.V.K.V. Emulating the dynamics for a class of laterally inhibited neural networks. Neural Networks. 2:1989;193-214.
22. Lippman R.P. An introduction to computing with neural nets. IEEE ASSP Magazine. 4:1987;4-22.
23. Mahowald, M. A., & Delbruck, T. (1989). Cooperative stereo matching using static and dynamic image features. In C. Mead and M. Ismail, Analog VLSI implementation of neural systems. (Eds), Norwell, MA: Kluwer Academic.
24. Majani, E., Erlanson, R., & Abu-Mostafa, Y. (1989). On the K-winners-take-all network. In D. S. Touretzky (Ed.), Advances in neural information procesing systems I (pp. 634-642). San Mateo, CA: Morgan Kaufmann.
25. Mead C.A., Arreguit X., Lazzaro J. Analog VLSI model of binaural hearing. IEEE Transactions on Neural Networks. 2(2):1991;230-236.
26. Nabet, B., Darling, R. B., & Pinter, R. B. (1989). Analog implementation of shunting neural networks. In D. S. Touretzky (Ed.), Advances in neural information processing systems I (pp. 695-702). San Mateo, CA: Morgan Kaufmann.
27. Nabet, B., & Pinter, R. B. (1991). Sensory neural networks: lateral inhibition. Boston, MA: CRC Press.
28. Robinson M.E., Yoneda H., Sanchez-Sinencio E. A modular CMOS design of a Hamming network. IEEE Transactions on Neural Networks. 3(3):1992;444-456.
29. Sedra, A. S., & Smith, K. C. (1991). Micro-electronic circuits, 3rd edn. New York: HRW.
30. Serrano T., Linares-Barranco B. A modular current-mode high-precision winner-take-all circuit. IEEE Transactions on Circuits and Systems-II: Analog and Digital Processing. 42(2):1995;132-134.
31. Sheu, B. J., Choi, J., & Chang, C. F. (1992). An analog neural network processor for self-organizing mapping. In ISSCC digital technology papers (pp. 136-137). San Francisco. CA.
32. Simpson, P. K. (1990). Artificial neural networks: foundations, paradigms, applications, and implementations. New York: Pergamon Press.
33. Smedley S., Taylor J., Wilby M. A scalable high-speed current-mode winner-take-all network for VLSI neural applications. IEEE Transactions on Circuits and Systems-I: Fundamental Theory and Applications. 42(5):1995;289-291.
34. Starzyk J.A., Fang X. CMOS current mode winner-take-all circuit with both excitatory and inhibitory feedback. Electronics Letters. 29(10):1993;908-910.
35. Yang J.F., Chen C.M., Wang W.C., Lee J.Y. A general mean-based iterative winner-take-all neural network. IEEE Transactions on Neural Networks. 6:1995;14-24.
36. Yen J.C., Chang F.J., Chang S. A new winner-take-all architecture in artificial neural networks. IEEE Transactions on Neural Networks. 5:1994;838-843.
37. Yuille, A. L., & Geiger, D. (1995). Winner-take-all mechanism. In: M. A. Arbib (Ed.), The handbook of brain theory and neural networks (pp. 1056-1060). Cambridge, MA: The MIT Press.