A tabu search algorithm for the training of neural networks

Journal of the Operational Research Society

Volumn 60, Issue 2, 2009, Pages 282-291

  Dengiz, B ^a   Alabas Uslu, C ^b   Dengiz, O ^c  

^a BASKENT UNIVERSITY   (Turkey)

^b MALTEPE UNIVERSITY   (Turkey)

^c AUBURN UNIVERSITY   (United States)

Author keywords

Genetic algorithms; Heuristics; Neural networks; Simulated annealing; Supervised training; Tabu search

Indexed keywords

GENETIC ALGORITHMS; NEURAL NETWORKS; SIMULATED ANNEALING; TABU SEARCH;

COMPUTATIONAL EFFORT; HEURISTICS; INTENSIFICATION AND DIVERSIFICATIONS; META-HEURISTIC SEARCH TECHNIQUES; META-HEURISTIC TECHNIQUES; NEURAL NETWORKS (NNS); SUPERVISED TRAININGS; TABU SEARCH ALGORITHMS;

BACKPROPAGATION ALGORITHMS;

EID: 58449100709     PISSN: 01605682     EISSN: 14769360     Source Type: Journal    
DOI: 10.1057/palgrave.jors.2602535     Document Type: Article

References (29)

1. Barnard E (1992). Optimization for training neural nets. IEEE Trans Neural Networks 3: 232-240.
2. Battiti R (1992). First- and second-order methods for learning between steepest descent and Newton's method. Neural Comput 4:141-166.
3. Battiti R and Tecchiolli G (1995). Training neural nets with the reactive tabu search. IEEE Trans Neural Networks 6: 1185-1200.
4. Cho SB and Shimohara K (1998). Evolutionary learning of modular neural networks with genetic programming. Appl Intell 9: 191-200.
5. Eglese RW (1990). Simulated annealing: a tool for operational research. Eur J Opl Res 46: 271-281.
6. Fogel DB, Fogel LJ and Porto VW (1990). Evolving neural networks. Biol Cybernet 63: 487-493.
7. Fukuoka Y, Matsuki H, Minamitani H and Ishida A (1998). A modified back propagation method to avoid false local minima. Neural Networks 11: 1059-1072.
8. Glover F (1986). Future paths for integer programming and links to artificial intelligence. Comput Opns Res 5: 533-549.
9. Glover F (1989). Tabu search-Part I. ORSA J Comput 1: 190-206.
10. Glover F (1990). Tabu search-Part II. ORSA J Comput 2: 4-32.
11. Gupta JND and Sexton RS (1999). Comparing backpropagation with a genetic algorithm for neural network training. Omega 27:679-684.
12. Hagan MT and Menhaj MB (1994). Training feedforward networks with the Marquardt algorithm. IEEE Trans Neural Networks 5: 989-993.
13. Hansen P (1986). The steepest ascent mildest descent heuristic for combinatorial programming. Congress on Numerical Methods in Combinatorial Optimization, Capri, Italy.
14. Hush DR (1999). Training a sigmoidal node is hard. Neural Comput 11: 1249-1260.
15. Jacobs RA (1988). Increased rates of convergence through learning rate adaptation. Neural Networks 1: 295-308.
16. Kelly JP, Rangaswamy B and Xu J (1996). A scatter-search-based learning algorithm for neural network training. J Heuristics 2:129-146.
17. Kirkpatrick S, Gelatt Jr CD and Vecchi MP (1983). Optimization by simulated annealing. Science 220: 671-680.
18. Liao TW and Chen LJ (1998). Manufacturing process modeling and optimization based on multilayer perceptron network. J Manuf Sci Eng 120: 109-119.
19. Møller MF (1993). A scaled conjugate gradient algorithm for fast supervised learning. Neural Networks 6: 525-533.
20. Montgomery DC (1997). Design and Analysis of Experiments. John Wiley & Sons Inc.: New York.
21. Pham DT and Karaboga D (1999). Training Elman and Jordan networks for system identification using genetic algorithms. Artif Intell Eng 13: 107-117.
22. Rigler AK, Irvine JM and Vogl TP (1991). Rescaling of variables in back propagation learning. Neural Networks 4: 225-229.
23. Rumelhart DE, Hinton GE and Williams RJ (1986). Learning representations by backpropagation errors. Nature 323: 533-536.
24. Sexton RS and Gupta JND (2000). Comparative evaluation of genetic algorithm and backpropagation for training neural networks. Inform Sci 129(1-4): 45-59.
25. Sexton RS, Alidaee B, Dorsey RE and Johnson JD (1998a). Global optimization for artificial neural networks: A tabu search application. Eur J Opl Res 106: 570-584.
26. Sexton RS, Dorsey RE and Johnson JD (1998b), Toward global optimization of neural networks: A comparison of the genetic algorithm and backpropagation. Decis Supp Syst 22: 171-185.
27. Sexton RS, Dorsey RE and Johnson JD (1999). Optimization of neural networks: A comparative analysis of the genetic algorithm and simulated annealing. Eur J Opl Res 114: 589-601.
28. Tollenaere T (1990). SuperSAB: Fast adaptive back propagation with good scaling properties. Neural Networks 3: 561-573.
29. Treadgold NK and Gedeon TD (1998). Simulated annealing and weight decay in adaptive learning: The SARPROP algorithm. IEEE Trans Neural Networks 9: 662-668.