Multi-objective algorithms for neural networks learning

Studies in Computational Intelligence

Volumn 16, Issue , 2006, Pages 151-171

  Braga, Antônio Pádua ^a   Takahashi, Ricardo H C ^a   Costa, Marcelo Azevedo ^a   Teixeira, Roselito de Albuquerque ^b  

^a FEDERAL UNIVERSITY OF MINAS GERAIS   (Brazil)

^b University Center of Eastern Minas Gerais   (Brazil)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 33845312352     PISSN: 1860949X     EISSN: None     Source Type: Book Series    
DOI: 10.1007/11399346_7     Document Type: Article

References (27)

1. B. Boser, I. Guyon, and V. Vapnik. A training algorithm for optimal margin classifiers. Fifth Annual Workshop on Computational Learning Theory, pages 144-152, 1992.
2. V. Chankong and Y. Y. Haimes. Multiobjective Decision Making: Theory and Methodology, volume 8. North-Holland (Elsevier), New York, 1983. 151, 152, 153, 154
3. C. Cortes and V. Vapnik. Support vector networks. Machine Learning, 20:273-279, 1995. 160
4. Yann Le Cun, John S. Denker, and Sara A. Solla. Optimal brain damage. In Advances in Neural Information Processing Systems 2, pages 598-605, 1990. 152
5. S. E. Fahlman. Faster-learning variations on back-propagation: An empirical study. In D. Touretzky, G. Hinton, and T. Sejnowski, editors, Proceedings of the 1988 Connectionist Models Summer School, Pittsburg, pages 38-51, San Mateo, CA, 1988. Morgan Kaufmann. 151
6. S. R. Gunn. Support vector machines for classification and regression. Technical report, Image Speech and Intelligent Systems Research Group, University of Southampton, 1997.
7. S. Haykin. Neural Networks: A Comprehensive Foundation. Prentice Hall, 1999.
8. Ehud D. Karnin. A simple procedure for pruning back-propagation trained neural networks. IEEE Transactions on Neural Networks, 1(2):239-242, 1990. 152
9. M. C. Mozer and P. Smolensky. Skeletonization: A technique for trimming the fat from a network via relevance assessment. Advances in Neural Information Processing, vol. 1, pages 107-115, 1989. 152
10. Gustavo G. Parma, Antonio P. Braga, and Benjamim R. Menezes. Sliding mode algorithm for training multi-layer neural networks. IEE Electronics Letters, 38(1):97-98, January 1998. 151
11. Martin Riedmiller and Heinrich Braun. A direct adaptive method for faster backpropagation learning: The RPROP algorithm. In Proc. of the IEEE Intl. Conf. on Neural Networks, pages 586-591, San Francisco, CA, April 1993. 151
12. D. E. Rumelhart, G. E. Hinton, and R. J. Williams. Learning representations by back-propagating errors. Nature, 323:533-536, 1986. 151, 153
13. N. Z. Shor. Cut-off method with space extension in convex programming problems. Cybernetics, 12:94-96, 1977. 155
14. R. H. C. Takahashi, P. L. D. Peres, and P. A. V. Ferreira. H2/h-infinity multiobjective pid design. IEEE Control Systems Magazine, 17(5):37-47, June 1997. 153, 154
15. V. Vapnik. The Nature of Statistical Learning Theory. Springer-Verlag, 1995.
16. R. A. Teixeira, A. P. Braga, R. H. C. Takahashi, and R. R. Saldanha. Improving generalization of mlps with multi-objective optimization. Neurocomputing, 35(1-4):189-194, 2000. 151, 152, 156, 157
17. G. A. Hinton. Connectionist learning procedures. Artificial Intelligence, 40:185-234, 1989. 152
18. V. Pareto. Cours D'Economie Politique. Rouse, Lausanne, 1896. vols. I and II. 163
19. R. A. Teixeira, A. P. Braga, R. H. C. Takahashi, and R. R. Saldanha. Utilização de seção áurea no cálculo de soluções eficientes para treinamento de redes neurais artificiais através de otimização multi-objetivo. 8th Brazilian Symposium on Neural Networks, November 2004. 156
20. U. Itkis. Control Systems of Variable Structure. Keter Publishing House Jerusalem LTD, 1976.
21. M. A. Costa, A. P. Braga, B. R. de Menezes, G. G. Parma, and R. A. Teixeira. Training neural networks with a multi-objective sliding mode control algorithm. Neurocomputing, 51:467-473, 2003.
22. M. A. Costa, A. P. Braga and B. R. de Menezes. Improving neural networks generalization with new constructive and pruning methods. Journal of Intelligent & Fuzzy Systems, 10:1-9, 2003. 158
23. C.L. Blake and C.J. Merz. {UCI} Repository of machine learning databases. University of California, Irvine, Dept. of Information and Computer Sciences, http://www.ics.uci.edu/~mlearn/MLRepository.html, 1998. 167
24. S. E. Fahlman and C. Lebiere, The cascade-correlation learning architecture, Morgan Kaufmann, In Advances in Neural Information Processing Systems 2 (D. S. Touretzky, Editor), 1990 152
25. Jean-Pierre Nadal, Study of a growth algorithm for a feedforward network, International Journal of Neural Systems, 1(1):55-59, 1989. 152
26. Ron Kohavi, A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection, http://citeseer.ist.psu.edu/105046.html, 1995. 152
27. S. Geman and E. Bienenstock and R. Doursat. Neural Networks and the Bias/ Variance Dilemma, Neural Computation, 4(1):1-58, 1992. 152