Another K-winners-take-all analog neural network

IEEE Transactions on Neural Networks

Volumn 11, Issue 4, 2000, Pages 829-838

  Calvert, Bruce D ^b   Marinov, Corneliu A ^a,c  

^a IEEE   (Romania)

^b UNIVERSITY OF AUCKLAND   (New Zealand)

^c UNIVERSITY POLITEHNICA OF BUCHAREST   (Romania)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL METHODS; CONVERGENCE OF NUMERICAL METHODS; DIFFERENTIAL EQUATIONS; ELECTRIC POTENTIAL; MATHEMATICAL MODELS; MATRIX ALGEBRA; VECTORS;

ANALOG NEURAL NETWORK; HOPFIELD NEURAL NETWORK; K-WINNERS TAKE ALL NETWORK; WEIGHT MATRIX;

NEURAL NETWORKS;

EID: 0034225378     PISSN: 10459227     EISSN: None     Source Type: None    
DOI: 10.1109/72.857764     Document Type: Article

References (40)

1. R. P. Lippmann, "An introduction to computing with neural nets," IEEE Acoust., Speech, Signal Processing Mag., pp. 4-22, Apr. 1987.
2. J. Choi and B. J. Sheu, "A high precision VLSI winner-take-all circuit for self organizing neural networks," IEEE J. Solid-State Circuits, vol. 28, pp. 576-594, May 1993.
3. K. Urahama and T. Nagao, "K-winners-take-all circuit with O(N) complexity," IEEE Trans. Neural Networks, vol. 6, pp. 776-778, 1995.
4. S. Haykin, Neural Networks: A Comprehensive Foundation. New York: Macmillan, 1994.
5. J. C. Yen, J. I. Guo, and H.-C. Chen, "A new k-winners-take all neural network and its array architecture," IEEE Trans. Neural Networks, vol. 9, pp. 901-912, Sept. 1998.
6. M. Lemmon and B. V. K. Vijayakumar, "Competitive learning with generalized winner-take-all activation," IEEE Trans. Neural Networks, vol. 3, pp. 167-175, 1992.
7. S. Kaski and T. Kohonen, "Winner-take-all networks for physiological models of competitive learning," Neural Networks, vol. 7, pp. 973-984, 1994.
8. T. M. Kwon and M. Zervakis, "A parallel sorting network without comparators: A neural-network approach," in Proc. Int. Joint Conf. Neural Networks, vol. 1, Baltimore, MD, 1992, pp. 701-706.
9. J. Wang, "Analysis and design of an analog sorting network," IEEE Trans. Neural Networks, vol. 6, pp. 962-971, July 1995.
10. Y. Takefuji and K.-C. Lee, "A super-parallel sorting algorithm based on neural networks," IEEE Trans. Circuits Syst. I, vol. 37, pp. 1425-1429, Nov. 1990.
11. L. N. Binh and H. C. Chong, "A neural-network contention controller for packet switching networks," IEEE Trans. Neural Networks, vol. 6, pp. 1402-1410, Nov. 1995.
12. T. X. Brown, "Neural networks for switching," IEEE Commun. Mag., pp. 72-81, Nov. 1989.
13. T. X. Brown and K. H. Liu, "Neural-network design of a Banyan network controller," IEEE J. Select. Areas Commun., vol. 8, pp. 1428-1473, 1990.
14. T. X. Brown, "Neural network design for switching network control," Ph.D. dissertation, California Inst. Technol., Pasadena, 1990.
15. _, "Neural networks for switching," in Neural Networks in Telecommunications, B. Yuhas and N. Ansari, Eds. Boston, MA: Kluwer, 1994.
16. J. J. Hopfield, "Neurons with graded response have collective computational properties like those of two state neurons," Proc. Nat. Acad. Sci. USA, vol. 81, pp. 3088-3092, 1984.
17. J. J. Hopfield and D. W. Tank, "Computing with neural circuits: A model," Science, vol. 233, pp. 625-633, Aug. 1986.
18. B. Ermentrout, "Complex dynamics in winner-take-all neural nets with slow inhibition," Neural Networks, vol. 5, pp. 415-431, 1992.
19. M. Lemmon and B. V. K. Vijayakumar, "Emulating the dynamics for a class of laterally inhibited neural networks," Neural Networks, vol. 2, pp. 193-214, 1989.
20. E. Majani, R. Erlanson, and Y. Abu-Mostafa, "On the K-winners-take-all network," in Advances in Neural Information Processing Systems, D. S. Touretzky, Ed. San Mateo, CA: Morgan Kaufmann, 1989, vol. 1, pp. 634-642.
21. R. Erlanson and Y. Abu-Mostafa, "Analog neural network as decoders," in Advances in Neural Information Processing Systems, D. S. Touretzky, Ed. Los Altos, CA: Morgan Kaufmann, 1991, vol. 3, pp. 585-588.
22. J. Lazzaro, S. Ryckebusch, M. A. Mahowald, and C. A. Mead, "Winner-take-all networks of O(N) complexity," in Advances in Neural Information Processing Systems, D. S. Touretzky, Ed. San Mateo, CA: Morgan Kaufmann, 1989, vol. 1, pp. 703-711.
23. S. Grossberg, "Competition, decision, and consensus," J. Math. Anal. Applicat., vol. 66, pp. 470-493, 1978.
24. M. W. Hirsch, "Convergent activation dynamics in continuous time networks," Neural Networks, vol. 2, pp. 331-349, 1989.
25. S. Smedley, J. Taylor, and M. Wilby, "A scalable high-speed current-mode winner take all network for VLSI neural applications," IEEE Trans. Circuits Syst. I, vol. 42, pp. 289-291, May 1995.
26. R. W. Brockett, "Dynamical systems that sort lists, diagonalize matrices, and solve linear programming problems," Lin. Algeb. Applicat., vol. 146, pp. 79-91, 1991.
27. J.-H. Li, A. N. Michel, and W. Porod, "Analysis and synthesis of a class of neural networks: Linear systems operating on a closed hypercube," IEEE Trans. Circuits Syt. I, vol. 36, pp. 1405-1422, Nov. 1989.
28. M. Vidyasagar, "Location and stabilitiy of the high-gain equilibria of nonlinear neural networks," IEEE Trans. Neural Networks, vol. 4, pp. 660-672, July 1993.
29. _, "Minimum-seeking properties of analog neural networks with multilinear objective functions," IEEE Trans. Automat. Contr., vol. 40, pp. 1359-1375, Aug. 1995.
30. B. D. Calvert, "Linear systems in a saturated mode and convergence as gain becomes large of asymptotically stable equilibrium points of neural nets," Circuits Syst. Signal Processing, vol. 18, no. 3, pp. 241-267, 1999.
31. J. P. F. Sum, C. S. Leung, P. K. S. Tam, G. H. Young, W. K. Kan, and L. W. Chan, "Analysis for a class of winner-take-all model," IEEE Trans. Neural Networks, vol. 10, pp. 64-71, Jan. 1999.
32. H. Yang and T. S. Dillon, "Exponential stability and oscillation of Hopfield graded response neural network," IEEE Trans. Neural Networks, vol. 5, pp. 719-729, Sept. 1994.
33. Y. Fang and T. Kincaid, "Stability analysis of dynamical neural networks," IEEE Trans. Neural Networks, vol. 7, pp. 996-1005, July 1996.
34. Y. Fang, M. A. Cohen, and T. G. Kincaid, "Dynamics of a winner-take-all neural network," Neural Networks, vol. 9, pp. 1141-1154, 1996.
35. J. P. Lasalle and Z. Artstein, The Stability of Dynamical Systems. Philadelphia, PA: SIAM, 1976.
36. R. K. Miller and A. N. Michel, Ordinary Differential Equations. New York: Academic, 1982.
37. T. Kohonen, "An introduction to neural computing," Neural Networks, vol. 1, no. 1, pp. 3-16, 1988.
38. C. A. Marinov and P. Neittaanmaki, Mathematical Models in Electrical Circuits: Theory and Applications. Boston, MA: Kluwer, 1991.
39. M. W. Hirsch and S. Smale, Differential Equations, Dynamical Systems, and Linear Algebra. New York: Academic, 1974.
40. N. H. Pavel, Differential Equations, Flow Invariance and Applications. Boston, MA: Pittman, 1984.