Neural network learning With global heuristic search

IEEE Transactions on Neural Networks

Volumn 18, Issue 3, 2007, Pages 937-942

  Jordanov, Ivan ^a   Georgieva, Antoniya ^a  

^a UNIVERSITY OF PORTSMOUTH   (United Kingdom)

Author keywords

Global optimization (GO); Heuristic methods; Low discrepancy sequences; Neural network (NN) learning; Simplex search

Indexed keywords

ALGORITHMS; FEEDFORWARD NEURAL NETWORKS; FUNCTIONS; GLOBAL OPTIMIZATION; HEURISTIC METHODS; PROBLEM SOLVING;

GLOBAL HEURISTIC SEARCH; LOW-DISCREPANCY SEQUENCES; MEAN SQUARE ERROR FUNCTION; MULTIMODAL MATHEMATICAL FUNCTIONS; NEURAL NETWORK (NN) LEARNING;

SUPERVISED LEARNING;

ALGORITHM; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; DECISION SUPPORT SYSTEM; INFORMATION RETRIEVAL; LETTER; METHODOLOGY; STATISTICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; DECISION SUPPORT TECHNIQUES; INFORMATION STORAGE AND RETRIEVAL; MODELS, STATISTICAL; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED;

EID: 34248656519     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2007.891633     Document Type: Article

References (21)

1. D. Rumelhart, G. Hinton, and R. Williams, "Learning internal representation by error propagation," in Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Cambridge, MA:MIT Press, 1986, pp. 318-362.
2. M. Bianchini and M. Gori, "Optimal learning in artificial neural networks: A review of theoretical results," Neurocomput., vol. 13, pp. 313-346, 1996.
3. C. Bishop, Neural Networks for Pattern Recognition. Oxford, U.K.: Clarendon, 1995.
4. R. Battiti and G. Tecchiolli, "Training neural nets with the reactive tabu search," IEEE Trans. Neural Netw., vol. 6, no. 5, pp. 1185-1200, Sep. 1995.
5. J.-T. Tsai, J.-H. Chou, and T.-K. Liu, "Tuning the structure and parameters of a neural network by using hybrid Taguchi-genetic algorithm," IEEE Trans. Neural Netw., vol. 17, no. 1, pp. 69-80, Jan. 2006.
6. M. Rocha, P. Cortez, and J. Neves, "Evolutionary neural network learning," in Lecture Notes in Artificial Intelligence 2902. Berlin, Germany: Springer-Verlag, 2003, pp. 740-741.
7. R. Chelouah and R. Siarry, "Tabu search applied to global optimization," Eur. J. Oper. Res., vol. 123, pp. 256-270, 2000.
8. R. T. Zheng, N. Q. Ngo, P. Shum, and S. C. Tjin, "A staged continuous tabu search algorithm for global optimization and its applications to the design of fiber Bragg gratings," Comput. Optim. Appl., vol. 30, pp. 319-335, 2005.
9. I. Sobol', Uniformly Distributed Points in a Multidimensional Cub (in Russian), ser. Mathematics and Cybernetics. Moscow, Russia: Znanie, 1985.
10. H. Niederreiter, Random Number Generation and Quasi-Monte Carlo Methods. Philadelphia, PA: SIAM, 1992.
11. J. A. Nelder and R. Mead, "A simplex method for function minimization," Computer J., vol. 7, pp. 308-313, 1965.
12. H. Niederreiter, "Low-discrepancy and low-dispersion sequences," J. Number Theory, vol. 30, pp. 51-70, 1988.
13. I. Sobol', "On the systematic search in a hypercube," SIAM J. Numer. Anal., vol. 16, pp. 790-793, 1985.
14. P. Bratley, B. Fox, and H. Niederreiter, "Implementation and tests of low-discrepancy sequences," ACM Trans. Model. Comput. Simul., vol. 2, pp. 195-213, 1992.
15. A. Georgieva and I. Jordanov, "A Hybrid method for stochastic global optimization using low-discrepancy sequences of points," J. Global Optim., 2007, submitted for publication.
16. R. Chelouah and R. Siarry, "Genetic and Nelder-Mead algorithms hybridized for a more accurate global optimization of continuous multidimensional functions," Eur. J. Oper. Res., vol. 148, pp. 335-348, 2003.
17. A. Bortoletti, C. Fiore, S. Fanelli, and P. Zellini, "A new class of quasi-Newtonian methods for optimal learning in MLP-networks," IEEE Trans. Neural Netw., vol. 14, no. 2, pp. 263-273, Mar. 2003.
18. J. R. Quinlan, "Combining instance-based and model-based learning," in Proc. Int. Mach. Learn. Conf. (ML), P. E. Utgoff, Ed., San Mateo, CA, 1993, pp. 236-243.
19. X. Wang, Z. Tang, H. Tamura, M. Ishii, and W. Sun, "An improved backpropagation algorithm to avoid the local minima problem," Neurocomput., vol. 56, pp. 455-460, 2004.
20. K. Price and R. Storn, "Differential evolution algorithm," [Online]. Available: http://www.icsi.berkeley.edu/~storn/code.html
21. G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew, "Real-time learning capability of neural networks," IEEE Trans. Neural Netw., vol. 17, no. 4, pp. 863-878, Jul. 2006.