Qualitative Limitations Incurred in Implementations of Recurrent Neural Networks

IEEE Control Systems

Volumn 15, Issue 3, 1995, Pages 52-65

  Ye, Hui ^a  

^a UNIVERSITY OF NOTRE DAME   (United States)

^b WAYNE STATE UNIVERSITY   (United States)

^c GENERAL MOTORS CORPORATION   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

INTERCONNECTION CONSTRAINTS; PARAMETER PERTURBATIONS; QUALITATIVE LIMITATIONS; RECURRENT NEURAL NETWORKS; TRANSMISSION DELAYS;

ASSOCIATIVE STORAGE; CONSTRAINT THEORY; FEEDBACK CONTROL; MATHEMATICAL MODELS; PARAMETER ESTIMATION; SYSTEMS ANALYSIS;

NEURAL NETWORKS;

EID: 0029327984     PISSN: 1066033X     EISSN: None     Source Type: Journal    
DOI: 10.1109/37.387618     Document Type: Article

References (32)

1. T.A. Burton, “Averaged Neural Networks,” Neural Networks, vol. 6, pp. 677-680, 1993.
2. G.A. Carpenter, M.A. Cohen, and S. Grossberg, “Computing with Neural Networks,” Science, vol. 235, pp. 1226-1227, 1987.
3. L.O. Chua and L. Yang, “Cellular Neural Networks: Theory,” IEEE Transactions on Circuits and Systems, vol. 35, pp. 1257-1272, 1988.
4. P.P. Civalleri, M. Gilli, and L. Pandolfi, “On Stability of Cellular Neural Networks with Delay,” IEEE Trans. Circuits Systems, vol. 40, pp. 157-165, 1993.
5. M.A. Cohen and S. Grossberg, “Absolute Stability of Global Pattern Formation and Parallel Memory Storage by Competitive Neural Networks,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 13, pp. 815-826, Sept./Oct. 1983.
6. S.R. Das, “On the Synthesis of Nonlinear Continuous Neural Networks,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 21, pp. 413-418, March/April 1991.
7. J.A. Farrell and A.N. Michel, “A Synthesis Procedure for Hopfield's Continuous-Time Associative Memory,” IEEE Transactions on Circuits and Systems, vol. 37, pp. 877-884, July 1990.
8. J. Hale, Theory of Functional Differential Equations, Springer-Verlag, 1977.
9. U. an der Heiden, Analysis of Neural Networks, Springer-Verlag, New York, 1980.
10. J.J. Hopfield, “Neural Networks and Physical Systems with Emergent Collective Computational Abilities,” Proc. Nat. Acad. Sci. USA, vol. 79, pp. 2554-2558, Apr. 1982.
11. J.J. Hopfield, “Neurons with Graded Response Have Collective Computational Properties Like Those of Two-State Neurons,” Proc. Vat. Acad. Sci. USA, vol. 81, pp. 3088-3092, May 1984.
12. B. Kosko, Neural Networks and Fuzzy Systems, Englewood Cliffs, NJ: Prentice-Hall, 1992.
13. J.-H. Li, A.N. Michel, and W. Porod, “Qualitative Analysis and Synthesis of a Class of Neural Networks,” IEEE Trans. on Circuits and Systems, vol. 35, pp. 976-986, Aug. 1988.
14. J.-H. Li, A.N. Michel, and W. Porod, “Analysis and Synthesis of a Class of Neural Networks: Linear Systems Operating on a Closed Hypercube,” IEEE Trans. on Circuits and Systems, vol. 36, pp. 1405-1422, Nov. 1989.
15. D. Liu and A.N. Michel, “Sparsely Interconnected Neural Networks for Associative Memories with Applications to Cellular Neural Networks,” IEEE Trans. on Circuits and Systems-II: Analog and Digital Signal Processing, vol. 41, pp. 295-309, Apr. 1994.
16. D. Liu and A.N. Michel, Dynamical Systems with Saturation Nonlinearities: Analysis and Design, London: Springer-Verlag, 1994.
17. C.M. Marcus and R.M. Westervelt, “Stability of Analog Neural Networks with Delay,” Physical Review A, 39, pp. 347-359, 1989.
18. C.M. Marcus and R.M. Westervelt, “Dynamics of Iterated-Map Neural Networks,” Physical Review A, vol. 40, pp. 501-504, July 1989.
19. C. Mead, Analog VLSI and Neural Systems, New York: Addison-Wesley Publishing Co., 1989.
20. A.N. Michel and J.A. Farrell, “Associative Memories via Artificial Neural Networks,” IEEE Control Systems Magazine, vol. 10, pp. 6-17, Apr. 1990.
21. A.N. Michel, J.A. Farrell, and W. Porod, “Qualitative Analysis of Neural Networks,” IEEE Trans. on Circuits and Systems, vol. 36, pp. 229-243, Feb. 1989.
22. A.N. Niches and K. Wang, Qualitative Theory of Dynamical Systems, Marcel Dekker Inc., New York, 1995.
23. R.K. Miller and A.N. Michel, Ordinary Differential Equations, Academic Press, New York, 1982.
24. R. Perfetti, “A Neural Network to Design Neural Networks,” IEEE Transactions on Circuits and Systems, vol. 38, pp. 1099-1103, Sept. 1991.
25. L. Personnaz, I. Guyon, and G. Dreyfus, “Information Storage and Retrieval in Spin-Glass Like Neural Networks,” J. Physique Lett., vol. 46, pp. L359-365, Apr. 1985.
26. L. Personnaz, I. Guyon, and G. Dreyfus, “Collective Computational Properties of Neural Networks: New Learning Mechanisms,” Physical Review A, vol. 34, pp. 4217-4228, Nov. 1986.
27. F.M.X. Salam, Y. Wang and M.-R. Choi, “On the Analysis of Dynamic Feedback Neural Nets,” IEEE Transactions on Circuits and Systems, vol. 38, pp. 196-201, Feb. 1991.
28. M.J. Todd, The Computation of Fixed Points and Applications, Springer-Verlag, New York, 1976.
29. K. Mang and A.N. Michel, “Robustness and Perturbation Analysis of a Class of Neural Networks,” Neural Networks, vol. 7, pp. 251-260, 1994.
30. H. Ye, A.N. Michel, and K. Wang, “Global Stability and Local Stability of Hopfield Neural Networks with Delays,” Physical Review E, vol. 50, no. 5, pp. 4206-4213, Nov. 1994.
31. H. Ye, A.N. Michel, and K. Wang, “Qualitative Analysis of Cohen-Grossberg Neural Networks with Multiple Delays,” to appear in Physical Review E.
32. G. Yen and A.N. Michel, “A Learning and Forgetting Algorithm in Associative Memories: The Eigenstructure Method,” IEEE Transactions on Circuits and Systems-II: Analog and Digital Signal Processing, vol. 39, pp. 212-225, Apr. 1992.