Simultaneous recurrent neural network trained with non-recurrent backpropagation algorithm for static optimisation

Neural Computing and Applications

Volumn 12, Issue 1, 2003, Pages 1-9

  Serpen, Gursel ^a   Xu, Yifeng ^a  

^a The University of Toledo   (United States)

Author keywords

Artificial neural network; Backpropagation; Computational complexity; Optimisation; Recurrent network; Traveling salesman

Indexed keywords

ALGORITHMS; BACKPROPAGATION; COMPUTATIONAL COMPLEXITY; COMPUTER SIMULATION; GRADIENT METHODS; OPTIMIZATION; TRAVELING SALESMAN PROBLEM;

BOLTZMANN MACHINE; CONJUGATE GRADIENT DESCENT; MEAN FIELD ANNEALING NETWORK;

RECURRENT NEURAL NETWORKS;

EID: 0141904590     PISSN: 09410643     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00521-003-0365-0     Document Type: Article

References (14)

1. Almeida LB (1987) A learning rule for asynchronous perceptrons with feedback in a combinatorial environment, Proceeding of IEEE 1st International Conference on Neural Networks, San Diego, CA, June 21-24, pp 609-618
2. Battiti R (1989) Accelerated back-propagation learning: Two Optimization Methods. Complex Systems, 3: 331-342
3. Cichocki A, Unbehauen R (1993) Neural network for optimisation and signal processing, Wiley
4. Hopfield JJ (1984) Neurons with graded response have collective computational properties like those of two-state neurons. In: Proceedings of the National Academy of Science, USA, 81: 3088-3092
5. Hopfield JJ, Tank DW (1985) Neural computation of decision in optimisation problems, Bio. Cyber. 52: 141-152
6. Johansson EM, Dowla FU, Goodman DM (1991) Backpropagation learning for multi-layer feed-forward neural networks using the conjugate gradient method. Inter. J. Neural Sys. 2(4): 291-301
7. Kinsella JA (1992) Comparison and evaluation of variants of the conjugate gradient method for efficient learning in feed-forward neural networks with backward error propagation. Network 3: 27-35
8. Pineda FJ (1987) Generalization of back-propagation to recurrent neural networks. Physical Rev. Lett. 59: 2229-2232
9. Reinelt G (1994) The traveling salesman, computational solutions for tsp applications, vol. 840 of Lecture Notes in Computer Science, Springer, Berlin Heidelberg New York
10. Serpen G, Patwardhan A, Geib J (2001) The simultaneous recurrent neural network addressing the scaling problem in static optimisation. Inter. J. Neu. Sys. 11(5): 477-487
11. Serpen G, Livingston DL (2000) Determination of weights for relaxation recurrent neural networks. Neurocomput. 34: 145-168
12. Werbos PJ (1988) Generalization of backpropagation with application to a recurrent gas market model. Neu. Networks, 1(4): 234-242
13. Werbos PJ, Pang X (1998) Neural network design for j function approximation in dynamic programming, technical report available online at http://www.isr.umd.edu/TechReports/CSHCN/1998/CSHCN_M S_98-1/CSHCN_MS_98-1.pdf
14. Werbos PJ (1974) Beyond regression: new tools for prediction and analysis in the behavioral sciences, Ph. D. Thesis, Harvard University