Dynamical analysis of continuous higher-order hopfield networks for combinatorial optimization

Neural Computation

Volumn 17, Issue 8, 2005, Pages 1802-1819

  Atencia, Miguel ^a   Joya, Gonzalo ^a   Sandoval, Francisco ^a  

^a UNIVERSITY OF MÁLAGA   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL; ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; COMPARATIVE STUDY; HUMAN; NONLINEAR SYSTEM;

ANIMALS; HUMANS; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS;

EID: 20744439867     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/0899766054026620     Document Type: Article

References (36)

1. Abe, S. (1989). Theories on the Hopfield neural networks. In Proc. IEE International Joint Conference on Neural Networks (Vol. 1, pp. 557-564). Washington, DC: IEEE.
2. Abe, S. (1993). Global convergence and suppression of spurious states of the Hopfield neural networks. IEEE Trans, on Circuits and Systems-I, 40(4), 246-257.
3. Abe, S. (1996). Convergence acceleration of the Hopfield neural network by optimizing integration step sizes. IEEE Trans, on Systems, Man and Cybernetics B, 26(1), 194-201.
4. Abe, S., & Gee, A. H. (1995). Global convergence of the Hopfield neural network with nonzero diagonal elements. IEEE Trans. on Circuits and Systems-II, 42(1), 39-45.
5. Algaba, A., Merino, M., Freire, E., Gamero, E., & Rodriguez-Luis, A. (2003). Some results on Chua's equation near a triple-zero linear degeneracy. International Journal of Bifurcation and Chaos, 13(3), 583-608.
6. Atencia, M. A., Joya, G., & Sandoval, F. (2003a). Hopfield neural networks for parametric identification of a robotic system. In Proc. Engineering Application of Neural Networks Conference (EANN 2003), Málaga (Spain) (pp. 311-318). Málaga, Spain: Departamento de Ingeniería de Sistemas y Automática, Universidad de Málaga.
7. Atencia, M. A., Joya, G., & Sandoval, F. (2003b). Spurious minima and basins of attraction in higher-order Hopfield networks. In J. Mira & J. R. Álvarez, (Eds.), Computational methods in neural modeling. Berlin: Springer.
8. Bharitkar, S., Tsuchiya, K., & Takefuji, Y. (1999). Microcode optimization with neural networks. IEEE Trans, on Neural Networks, 10(3), 698-703.
9. Bronshtein, I., Semendyayev, K., Musiol, G., & Muehlig, H. (2004). Handbook of mathematics. Berlin: Springer.
10. Chen, T., & Amari, S.-I. (2001). New theorems on global convergence of some dynamical systems. Neural Networks, 14, 251-255.
11. Ciarlet, P., & Lions, J. (2002). Handbook of numerical analysis. Amsterdam: Elsevier.
12. Demmel, J. (2000). Hermitian eigenproblems. In Z. Bai, J. Demmel, J. Dongarra, A. Ruhe, & H. van der Vorst (Eds.), Templates for the solution of algebraic eigenvalue problems: A practical guide (pp. 11-14). Philadelphia: SIAM.
13. Feng, J., & Brown, D. (1998). Fixed-point attractor analysis for a class of neurodynamics. Neural Computation, 10(1), 189-213.
14. Golub, G. H., & van Loan, C. F. (1996). Matrix computations. Baltimore, MD: Johns Hopkins University Press.
15. Guckenheimer, J., & Holmes, P. (1997). Nonlinear oscillations, dynamical systems, and bifurcations of vector fields. Berlin: Springer.
16. Hirsch, M. W., & Smale, S. (1974). Differential equations, dynamical systems, and linear algebra. Orlando, FL: Academic Press.
17. Hopfield, J. (1984). Neurons with graded response have collective computational properties like those of two-state neurons. Proc. Natl. Acad. Sci. USA, 81, 3088-3092.
18. Horn, R. A., & Johnson, C. R. (1985). Matrix analysis. Cambridge: Cambridge University Press.
19. Joya, G., Atencia, M. A., & Sandoval, F. (1997). Associating arbitrary-order energy functions to an artificial neural network: Implications concerning the resolution of optimization problems. Neurocomputing, 14, 139-156.
20. Joya, G., Atencia, M. A., & Sandoval, F. (2002). Hopfield neural networks for optimization: Study of the different dynamics. Neurocomputing, 43(1-4), 219-237.
21. Juang, J.-C. (1999). Stability analysis of Hopfield-type neural networks. IEEE Trans. on Neural Networks, 20(6), 1366-1374.
22. Matsuda, S. (1998). Optimal Hopfield network for combinatorial optimization with linear cost function. IEEE Trans. on Neural Networks, 9(6), 1319-1330.
23. Matsuda, S. (2002). "Optimal" neural representation of higher order for traveling salesman problems. Electronics and Communications in Japan, Part 2, 85(9), 32-42.
24. Pardalos, P. M., & Resende, M. G. (2002). Handbook of applied optimization. New York: Oxford University Press.
25. Riaza, R., & Zufiria, P. J. (2002). Discretization of implicit ODEs for singular root-finding problems. Journal of Computational and Applied Mathematics, 140, 695-712.
26. Samad, T., & Harper, P. (1990). High-order Hopfield and Tank optimization networks. Parallel Computing, 16, 287-292.
27. Schropp, J. (1995). Using dynamical systems methods to solve minimization problems. Applied Numerical Mathematics, 18, 321-335.
28. Schropp, J. (2000). One-step and multistep procedures for constrained minimization problems. IMA Journal of Numerical Analysis, 20(1), 135-152.
29. Sejnowski, T. J. (1986). Higher-order Boltzmann machines. In J. S. Denker (Ed.), Neural networks for computing (pp. 398-403). College Park, MD: American Institute of Physics.
30. Smith, K. A. (1999). Neural networks for combinatorial optimization: A review of more than a decade of research. INFORMS Journal on Computing, 11(1), 15-34.
31. Stuart, A., & Humphries, A. (1996). Dynamical systems and numerical analysis. Cambridge: Cambridge University Press.
32. Takefuji, Y., & Lee, K. C. (1991). Artificial neural networks for four-coloring map problems and K-colorability problems. IEEE Trans. on Circuits and Systems, 38(3), 326-333.
33. Tank, D., & Hopfield, J. (1985). "Neural" computation of decisions in optimization problems. Biological Cybernetics, 52, 141-152.
34. Tiňo, P., Home, B., & Giles, C. (2001). Attractive periodic sets in discrete-time recurrent networks (with emphasis on fixed-point stability and bifurcations in two-neuron networks). Neural Computation, 13(6), 1379-1414.
35. Vidyasagar, M. (1995). Minimum-seeking properties of analog neural networks with multilinear objective functions. IEEE Trans. on Automatic Control, 40(8), 1359-1375.
36. Wilson, G., & Pawley, G. (1988). On the stability of the travelling salesman problem algorithm of Hopfield and Tank. Biological Cybernetics, 58(1), 63-70.