A genetic algorithm for designing neural network ensembles

GECCO'12 - Proceedings of the 14th International Conference on Genetic and Evolutionary Computation

Volumn , Issue , 2012, Pages 681-688

  Soares, Symone ^a   Antunes, Carlos ^b   Araújo, Rui ^a  

^a UNIVERSITY OF COIMBRA   (Portugal)

^b UNIVERSITY OF COIMBRA   (Portugal)

Author keywords

ensemble methods; genetic algorithms; neural networks

Indexed keywords

ACTIVATION FUNCTIONS; DATA SETS; DEGREE OF DIVERSITY; ENSEMBLE METHODS; GENERALIZATION CAPABILITY; HIDDEN NEURONS; NEURAL NETWORK ENSEMBLES; OPTIMAL COMBINATION; TRAINING DATA SETS; UNIFIED PROCEDURES;

FACE RECOGNITION; GENETIC ALGORITHMS; LEARNING ALGORITHMS; OPTIMIZATION;

NEURAL NETWORKS;

EID: 84864680335     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2330163.2330259     Document Type: Conference Paper

References (27)

1. D. A. Belsley, E. Kuh, and R. E. Welsch. Regression Diagnostics: Identifying Influential Data and Sources of Collinearity. Wiley, 1980.
2. L. Breiman. Bagging predictors. Machine Learning, 24(2):123-140, August 1996.
3. G. Brown, J. Wyatt, R. Harris, and X. Yao. Diversity creation methods: A survey and categorisation. Information Fusion, 6(1):5-20, 2005.
4. P. A. D. Castro and F. J. V. Zuben. Learning ensembles of neural networks by means of a bayesian artificial immune system. IEEE Transactions on Neural Networks, 22(2):304-316, February 2011.
5. A. Chandra, H. Chen, and X. Yao. Trade-off between diversity and accuracy in ensemble generation. In Y. Jin, editor, Multi-Objective Machine Learning, volume 16 of Studies in Computational Intelligence, pages 429-464. Springer Berlin / Heidelberg, 2006.
6. A. L. V. Coelho and D. S. C. Nascimento. On the evolutionary design of heterogeneous bagging models. Neurocomputing, 73(16-18):3319-3322, 2010.
7. T. G. Dietterich. Ensemble methods in machine learning. In J. Kittler and F. Roli, editors, Proceedings of the First International Workshop on (MCS 2000) Multiple Classifier Systems, volume 1857, pages 1-15. Springer-Verlag, 2000.
8. S. Dondeti, K. Kannan, and R. Manavalan. Genetic algorithm optimized neural networks ensemble for estimation of mefenamic acid and paracetamol in tablets. Acta Chimica Slovenica, 52:440-449, 2005.
9. B. Efron and R. J. Tibshirani. An Introduction to the Bootstrap. Chapman & Hall, New York, 1993.
10. L. Fortuna, S. Graziani, and M. G. Xibilia. Comparison of soft-sensor design methods for industrial plants using small data sets. IEEE Transactions on Instrumentation and Measurement, 58(8):2444-2451, August 2009.
11. Y. Freund and R. Schapire. A short introduction to boosting. Japanese Society for Artificial Intelligence, 14(5):771-780, 1999.
12. J. H. Friedman. Multivariate adaptive regression splines. The Annals of Statistics, 19(1):1-67, 1991.
13. M. T. Hagan, H. B. Demuth, and M. Beale. Neural Network Design. PWS Publishing, Boston, MA, USA, 1996.
14. R. L. H. S. E. Haupt. Practical Genetic Algorithms. Wiley-Interscience, 2 edition, 2004.
15. Y. Jia and T. B. Culver. Bootstrapped artificial neural networks for synthetic flow generation with a small data sample. Journal of Hydrology, 331(3-4):580-590, 2006.
16. K. N. Kasabov. Foundations of Neural Networks, Fuzzy Systems, and Knowledge Engineering. MIT Press, Cambridge, MA, USA, 1st edition, 1996.
17. S. Khakabimamaghani, F. Barzinpour, and M. R. Gholamian. A high diversity hybrid ensemble of classifiers. In 2010 2nd International Conference on Software Engineering and Data Mining (SEDM), pages 461-466, June 2010.
18. Y. Liu and X. Yao. Ensemble learning via negative correlation. Neural Networks, 12:1399-1404, 1999.
19. Y. Liu, X. Yao, and T. Higuchi. Evolutionary ensembles with negative correlation learning. IEEE Transactions on Evolutionary Computation, 4(4):380-387, November 2000.
20. D. Nguyen and B. Widrow. Improving the learning speed of 2-layer neural networks by choosing initial values of the adaptive weights. In IJCNN International Joint Conference on Neural Networks 1990, volume 3, pages 21-26, June 1990.
21. M. Re and G. Valentini. Ensemble methods: A review. In Data Mining and Machine Learning for Astronomical Applications, pages 1-40. Chapman & Hall, 2011. (in press).
22. M. Ries, O. Nemethova, and M. Rupp. Performance evaluation of mobile video quality estimators. In Proceedings of the 15th European Signal Processing Conference, pages 159-163, September 2007.
23. L. Torgo. Regression Datasets. Laboratory of Artificial Intelligence and Decision Support (LIAAD), University of Porto, 2011. http://www.liaad.up.pt/ ~ltorgo/Regression/DataSets.html.
24. J. Torres-Sospedra, M. Fernandez-Redondo, and C. Hernandez-Espinosa. A research on combination methods for ensembles of multilayer feedforward. In IEEE International Joint Conference on Neural Networks, 2005. IJCNN '05. Proceedings 2005, volume 2, pages 1125-1130, July-August 2005.
25. J. Škutová. Weights initialization methods for mlp neural networks. Transactions of the VŠB - Technical University of Ostrova, Mechanical Series, LIV(2):147-152, 2008.
26. T. Yu-Bo and X. Zhi-Bin. Particle-swarm-optimization-based selective neural network ensemble and its application to modeling resonant frequency of microstrip antenna. In Microstrip Antennas, pages 69-82. InTech, April 2011.
27. Z.-H. Zhou, J. Wu, and W. Tang. Ensembling neural networks: Many could be better than all. Artificial Intelligence, 137(1-2):239-263, 2002.