A multi-objective optimization approach for training artificial neural networks

Proceedings - Brazilian Symposium on Neural Networks, SBRN

Volumn 2000-January, Issue , 2000, Pages 168-172

  Teixeira, Roselito de A ^a   Braga, Antônio de P ^a   Takahashi, Ricardo H C ^a   Saldanha, Rodney R ^a  

^a FEDERAL UNIVERSITY OF MINAS GERAIS   (Brazil)

Author keywords

Artificial neural networks; Automatic control; Backpropagation algorithms; Constraint optimization; Error correction; Multilayer perceptrons; Neural networks; Support vector machine classification; Support vector machines; Training data

Indexed keywords

ALGORITHMS; AUTOMATION; BACKPROPAGATION; BACKPROPAGATION ALGORITHMS; CLASSIFICATION (OF INFORMATION); CONSTRAINED OPTIMIZATION; CONTROL; CYBERNETICS; ECONOMIC AND SOCIAL EFFECTS; ERROR CORRECTION; HEURISTIC METHODS; MULTILAYER NEURAL NETWORKS; MULTILAYERS; NEURAL NETWORKS; OPTIMIZATION; SUPPORT VECTOR MACHINES; VECTORS;

CONSTRAINT OPTIMIZATIONS; GENERALIZATION ABILITY; HEURISTIC PARAMETERS; MULTI-LAYER PERCEPTRONS (MLPS); REGRESSION PROBLEM; SUPPORT VECTOR MACHINE CLASSIFICATION; TRAINING ALGORITHMS; TRAINING DATA;

MULTIOBJECTIVE OPTIMIZATION;

EID: 77957916064     PISSN: 15224899     EISSN: None     Source Type: Journal    
DOI: 10.1109/SBRN.2000.889733     Document Type: Article

References (20)

1. B. Boser, I. Guyon, and V. Vapnik. A training algorithm for optimal margin classifiers. Fifth Annual Workshop on Computational Learning Theory, pages 144-152, 1992.
2. C. Burges. A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery, 2(2), 1998.
3. V. Chankong and Y. Y. Haimes. Multiobjective Decision Making: Theory and Methodology, volume 8. North-Holland (Elsevier), New York, 1983.
4. C. Cortes and V. Vapnik. Support vector networks. Machine Learning, 20:273-279, 1995.
5. Y. L. Cun, J. S. Denker, and S. A. Solla. Optimal brain damage. In Advances in Neural Information Processing Systems 2, pages 598-605, 1990.
6. S. E. Fahlman. Faster-learning variations on backpropagation: an empirical study. In D. Touretzky, G. Hinton, and T. Sejnowski, editors, Proceedings of the 1988 Connectionist Models Summer School, Pittsburg, pages 38-51, San Mateo, CA, 1988. Morgan Kaufmann.
7. W. Finnoff, F. Hergert, and H. G. Zimmermann. Improving model selection by nonconvergent methods. Neural Networks, 6:771-783, 1993.
8. G. H. Golub, M. Heath, and G. Wahba. Generalised cross-validation as a method for choosing a good ridge parameter. Technometrics, 2(21):215-223, 1979.
9. E. D. Kamin. A simple procedure for pruning backpropagation trained neural networks. IEEE Trans. Neural Networks, 1(2):239-242, 1990.
10. A. Krogh and J. A. Hertz. A simple weight decay can improve generalization. In J. E. Moody, S. J. Hanson, and R. P. Lippmann, editors, Advances in Neural Information Processing Systems, volume 4, pages 950-957. Morgan Kaufmann, San Mateo, CA, 1992.
11. M. C. Mozer and P. Smolensky. Skeletonization: A technique for trimming the fat from a network via relevance assessment. Advances in Neural Information Processing (1), pages 107-115, 1989.
12. E. Osuna, R. Freund, and F. Girosi. An improved training algorithm for support vector machines. Neural Networks for Signal Processing VII, Proceedings of the 1997 IEEE Workshop, pages 276-285, 1997.
13. E. Osuna, R. Freund, and F. Girosi. Support vector machines: training and aplications. MIT AI Memo 1602, March 1997.
14. G. G. Parma, B. R. Menezes, and A. P. Braga. Sliding mode algorithm for training multi-layer neural networks. IEE Electronics Letters, 38(1):97-98, Jan. 1998.
15. L. Prechelt. Automatic early stopping using cross validation: quantifying the criteria. Neural Networks, 11(4):761-767, 1998.
16. M. Riedmiller and H. Braun. A direct adaptive method for faster backpropagation learning: The RPROP algorithm. In Proc. of the IEEE Intl. Conf. on Neural Networks, pages 586-591, San Francisco, CA, Apr. 1993.
17. D. E. Rumelhart. G. E. Hinton, and R. J. Williams. Learning representations by back-propagating errors. Nature, 323:533-536, 1986.
18. J. Shao. Linear model selection by cross-validation. J. of the American Statistical Association, 88:486-494, 1993.
19. N. Z. Shor. Cut-off method with space extension in convex programming problems. Cybernetics, 12:94-96, 1977.
20. R. H. C. Takahashi, P. L. D. Peres, and P. A. V. Ferreira. H2/h-infinity multiobjective pid design. IEEE Control Systems Magazine, 17(5):37-47, June 1997.