Global optimization methods for designing and training neural networks

Proceedings - Brazilian Symposium on Neural Networks, SBRN

Volumn 2002-January, Issue , 2002, Pages 136-141

  Yamazaki, A ^a   Ludermir, T B ^a   De Souto, M C P ^a  

^a FEDERAL UNIVERSITY OF PERNAMBUCO   (Brazil)

Author keywords

Artificial neural networks; Backpropagation; Costs; Design methodology; Informatics; Information processing; Neural networks; Nose; Optimization methods; Simulated annealing

Indexed keywords

BACKPROPAGATION; COSTS; DATA PROCESSING; GLOBAL OPTIMIZATION; INFORMATION SCIENCE; NEURAL NETWORKS; SIMULATED ANNEALING; TABU SEARCH;

DESIGN METHODOLOGY; GENERALIZATION PERFORMANCE; GLOBAL OPTIMIZATION METHOD; INFORMATICS; MEAN CLASSIFICATION; NOSE; ODOR RECOGNITION; OPTIMIZATION METHOD;

COMPLEX NETWORKS;

EID: 84948957794     PISSN: 15224899     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SBRN.2002.1181455     Document Type: Conference Paper

References (23)

1. R. Battiti and G. Tecchiolli. Training neural nets with the reactive tabu search. IEEE Transactions on Neural Networks, 6:1185-1200, 1995.
2. S. Chalup and F. Maire. A study on hill climbing algorithms for neural network training. Proceedings of the 1999 Congress on Evolutionary Computation (CEC'99), 3:2014-2021, July 1999.
3. M. A. Craven, J. W. Gardner, and P. N. Bartlett. Electronic noses - development and future prospects. Trends in Analytical Chemistry, 5(9), 1996.
4. J. W. Gardner and E. L. Hines. Pattern analysis techniques. Handbook of Biosensors and Electronic Noses: Medicine, Food and the Environment (Edited by E. Kress-Rogers), CRC Press, pages 633-652, 1997.
5. F. Glover. Future paths for integer programming and links to artificial intelligence. Computers and Operation Research, 13:533-549, 1986.
6. P. Hansen. The steepest ascent mildest descent heuristic for combinatorial programming. Conf. on Numerical Methods in Combinatorial Optimisation, Capri, Italy, 1986.
7. A. Hertz, E. Taillard, and D. de Werra. A tutorial on tabu search. Proc. of Giornate di Lavoro AIRO'95 (Enterprise Systems: Management of Technological and Organizational Changes), Italy, pages 13-24, 1995.
8. D. Karaboga and A. Kalinli. Training recurrent neural networks for dynamic system identification using parallel tabu search algorithm. 12th IEEE Int. Symp. on Intelligent Control, Istanbul, Turkey, pages 113-118, 1997.
9. S. Kirkpatrick, C. D. Gellat Jr., and M. P. Vecchi. Optimization by simulated annealing. Science, 220:671-680, 1983.
10. K. J. Lang and G. E. Hinton. The development of the time-delay neural network architecture for speech recognition. Technical Report CMU-CS-88-152, Carnegie-Mellon University, Pittsburgh, PA, 1988.
11. N. Metropolis, A. W. Rosenbluth, M. N. Rosenbluth, A. H. Teller, and E. Teller. Equation of state calculations by fast computing machines. J. of Chem. Phys., 21(6):1087-1092, 1953.
12. I. H. Osman. Metastrategy simulated annealing and tabu search algorithms for combinatorial optimisation problems. PhD Thesis, University of London, Imperial College, UK, 1991.
13. K. C. Persaud and P. J. Travers. Arrays of broad specificity films for sensing volatile chemicals. Handbook of Biosensors and Electronic Noses: Medicine, Food and the Environment (Edited by E. Kress-Rogers), CRC Press, pages 563-592, 1997.
14. D. T. Pham and D. Karaboga. Introduction. Intelligent Optimisation Techniques (Edited by D.T. Pham and D. Karaboga), Springer-Verlag, pages 1-50, 2000.
15. L. Prechelt. Proben1 - a set of neural network benchmark problems and benchmarking rules. Technical Report 21/94, Fakultat fur Informatik, Universitat Karlsruhe, Germany, September 1994.
16. D. E. Rumelhart, G. E. Hinton, and R. J. Williams. Learning internal representations by error propagation. Parallel Distributed Processing (Edited by D.E. Rumelhart and J.L. McClelland), Cambridge, MIT Press, 1:318-362, 1986.
17. R. S. Sexton, B. Alidaee, R. E. Dorsey, and J. D. Johnson. Global optimization for artificial neural networks: a tabu search application. Eur. J. Operational Research, 106(2-3):570-584, 1998.
18. A. Yamazaki, M. C. P. de Souto, and T. B. Ludermir. Optimization of neural network weights and architectures for odor recognition using simulated annealing. 2002 International Joint Conference on Neural Networks (IJCNN'02), Honolulu, Hawaii, pages 547-552, May 2002.
19. A. Yamazaki and T. B. Ludermir. Classification of vintages of wine by an artificial nose with neural networks. Proceedings of 8th International Conference on Neural Information Processing (ICONIP'2001), Shanghai, China, 1:184-187, 2001.
20. A. Yamazaki, T. B. Ludermir, and M. C. P. de Souto. Classification of vintages of wine by an artificial nose using time delay neural networks. IEE Electronics Letters, 22nd November 2001, 37(24):1466-1467, 2001.
21. A. Yamazaki, T. B. Ludermir, and M. C. P. de Souto. Simulated annealing and tabu search for optimization of neural networks. 26th Annual Conference of the Gesellschaft fr Klassifikation (GfKl), University of Mannheim, Germany, July 2002 (to be published).
22. X. Yao. Evolving artificial neural networks. Proceedings of the IEEE, 87(9):1423-1447, September 1999.
23. X. Yao and Y. Liu. A new evolutionary system for evolving artificial neural networks. IEEE Transactions on Neural Networks, 8(3):694-713, 1997.