Evolution of neural networks for classification and regression

Neurocomputing

Volumn 70, Issue 16-18, 2007, Pages 2809-2816

  Rocha, Miguel ^a   Cortez, Paulo ^a   Neves, José ^a  

^a UNIVERSITY OF MINHO   (Portugal)

Author keywords

Evolutionary algorithms; Lamarckian optimization; Multilayer perceptrons; Neural network ensembles; Supervised learning

Indexed keywords

DATA MINING; EVOLUTIONARY ALGORITHMS; HEURISTIC METHODS; MATHEMATICAL MODELS; SHAPE OPTIMIZATION; SUPERVISED LEARNING;

LAMARCKIAN OPTIMIZATION; NEURAL TOPOLOGIES;

NEURAL NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; CONTROLLED STUDY; DATA MINING; EVOLUTIONARY ALGORITHM; LEARNING ALGORITHM; MATHEMATICAL COMPUTING; PRIORITY JOURNAL; REGRESSION ANALYSIS; STATISTICAL MODEL; SUPPORT VECTOR MACHINE;

EID: 34548180859     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2006.05.023     Document Type: Article

References (26)

1. Abraham A. Meta learning evolutionary artificial neural networks. Neurocomputing 56 (2004) 1-38
2. D.H. Ackley, M.L. Littman, A case for Lamarckian Evolution, Addison-Wesley, Reading, MA, 1994, pp. 3-10.
3. Cortez P., Rocha M., and Neves J. A Lamarckian approach for neural network training. Neural Process. Lett. 15 2 (2002) 105-116
4. Dietterich T. Machine learning research: four current directions. AI Mag. 18 4 (1997) 97-136
5. T. Dietterich, Ensemble methods in machine learning, in: J. Kittler, F. Roli (Eds.), Multiple Classifier Systems, Lecture Notes in Computer Science, vol. 1857, Springer, Berlin, 2001, pp. 1-15.
6. A. Flexer, Statistical evaluation of neural networks experiments: Minimum requirements and current practice, in: Proceedings of the 13th European Meeting on Cybernetics and Systems Research, vol. 2, Vienna, Austria, 1996, pp. 1005-1008.
7. Hastie T., Tibshirani R., and Friedman J. The Elements of Statistical Learning: Data Mining Inference and Prediction (2001), Springer, NY, USA
8. Haykin S. Neural Networks-A Compreensive Foundation, second ed. (1999), Prentice-Hall, New Jersey
9. R. Kohavi, A study of cross-validation and bootstrap for accuracy estimation and model selection, in: Proceedings of the International Joint Conference on Artificial Intelligence, Montreal, Quebec, Canada, August 1995, Morgan Kaufmann, Los Altos, CA, pp. 1137-1143.
10. Ku K., Mak M., and Siu W.-C. A study of the Lamarckian evolution of recurrent neural networks. IEEE Trans. Evol. Comput. 4 1 (2000) 31-42
11. Kwok T., and Yeung D. Constructive algorithms for structure learning in feedforward neural networks for regression problems: a survey. IEEE Trans. Neural Networks 8 3 (1999) 630-645
12. Y. Liu, X. Yao, Evolving modular neural networks which generalize well, in: Proceedings of the 1997 IEEE International Conference on Evolutionary Computation, Indianapolis, New York, 1997, IEEE Press, New York, pp. 670-675.
13. Liu Y., Yao X., and Higuchi T. Evolutionary ensembles with negative correlation learning. IEEE Trans. Evol. Comput. 4 4 (2000) 380-387
14. Mitchell T. Machine Learning (1997), McGraw Hill, New York
15. Mitra S., Pal S., and Mitra P. Data mining in soft computing framework: a survey. IEEE Trans. Neural Networks 13 1 (2002) 3-14
16. Moriarty D., Schultz A., and Grefenstette J. Evolutionary algorithms for reinforcement learning. J. Artif. Intell. 11 (1999) 199-299
17. Riedmiller M. Advanced supervised learning in multilayer perceptrons-from backpropagation to adaptive learning algorithms. Int. J. Comput. Stand. Interfaces 16 (1994) 265-278
18. M. Rocha, P. Cortez, J. Neves, Evolutionary Neural Network Learning, in: F. Pires, S. Abreu, (Eds.), Progress in Artificial Intelligence, EPIA 2003 Proceedings, Lecture Notes in Artificial Intelligence, vol. 2902, Beja, Portugal, December 2003. Springer Berlin, pp. 24-28.
19. M. Rocha, P. Cortez, J. Neves, Ensembles of artificial neural networks with heterogeneous topologies, in: Proceedings of the Fourth Symposium on Engineering of Intelligent Systems (EIS2004), CD-ROM edition, ICSC Academic Press, March 2004.
20. M. Rocha, J. Neves, I. Rocha, E. Ferreira, Evolutionary algorithms for optimal control in fed-batch fermentation processes, in: G. Raidl et al., (Eds.), Proceedings of the Workshop on Evolutionary Bioinformatics-EvoWorkshops 2004, Lecture Notes in Computer Science, vol. 3005, Springer, Berlin, 2004, pp. 84-93.
21. C. Soares, Is the UCI repository useful for data mining?, in: F. Pires, S. Abreu, (Eds.), Progress in Artificial Intelligence, EPIA 2003 Proceedings, Lecture Notes in Artificial Intelligence, vol. 2902, Beja, Portugal, 2003, Springer, Berlin, pp. 209-223.
22. G. Thimm, E. Fiesler, Evaluating pruning methods, in: Proceedings of the International Symposium on Artificial Neural Networks, Taiwan, December 1995, pp. 20-25.
23. Werbos P. Backpropagation through time: what it does and how to do it. Proc. IEEE 78 10 (1990) 1550-1560
24. Witten I., and Frank E. Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations (2000), Morgan Kaufmann, USA
25. Yao X. Evolving Artificial Neural Networks. Proc. IEEE 87 9 (1999) 1423-1447
26. Yao X., and Liu Y. A new evolutionary system for evolving artificial neural networks. IEEE Trans. Neural Networks 8 3 (1997) 694-713