Pareto neuro-evolution: Constructing ensemble of neural networks using multi-objective optimization

2003 Congress on Evolutionary Computation, CEC 2003 - Proceedings

Volumn 3, Issue , 2003, Pages 2074-2080

  Abbass, Hussien A ^a  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

EVOLUTIONARY ALGORITHMS; NEURAL NETWORKS;

CONTINUOUS OPTIMIZATION; DIFFERENTIAL EVOLUTION; MULTI-OBJECTIVE FORMULATION; NEURO EVOLUTIONS; NONOVERLAPPING; PARETO FRONTIERS; TRAINING ERRORS; TRAINING SETS;

MULTIOBJECTIVE OPTIMIZATION;

EID: 84901459245     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CEC.2003.1299928     Document Type: Conference Paper

References (29)

1. H.A. Abbass. A memetic pareto evolutionary approach to artificial neural networks. In M. Stumptner, D. Corbett, and M. Brooks, editors, Proceedings of the 14th Australian Joint Cotlference on Artificial Intelligence (AI'OI), pages 1-12, Berlin, 2001. Springer- Verlag.
2. H.A. Abbass. An evolutionary artificial neural network approach for breast cancer diagnosis. Artificial Intelligence in Medicine, 25(3):265-281, 2002.
3. H.A. Abbass. The self-adaptive pareto differential evolution algorithm. In Proceedings of the IEEE Congress on Evolutions? Coniputation (CECZOOZ), volume 1, pages 831-836, Piscataway, NJ, 2002. IEEE Press.
4. H.A. Abbass. Speeding up back-propagation using multiobjective evolutionary algorithms. Neural Coniputation, to appear, 2003.
5. H.A. Abbass, R.A. Sarker, and C.S. Newton. PDE: A pareto-frontier differential evolution approach for multi-objective optimization problems. In Proceedings of the IEEE Congress on Evdutiorlnn Computation (CECZOOI), volume 2, pages 971-978, Piscataway, NJ, 2001. IEEE Press.
6. C.L. Blake and C.J. Merz. UCI repository of machine learning databases, http://www.ics.uci.edu/-mlearnlmlrepository.html. Universin of California, Imine, Dept. of Information and Computer Sciences, 1998.
7. G. Brown, X. Yao, I. Wyatt, H. Wersing, and B. Sendhoff. Exploiting ensemble diversity for automatic feature extraction. In L. Wang, J.C. Rajapakse, K. Fukushima, S.Y. Lee, and X. Yao. editors. Proceedings of the 9th International Conference on Neural Information Proceeding (ICONIP'OZ), pages 1786- 1790, 2002.
8. C.A. Coello, D.A. Van Veldhuizen and G.B. Lamont. Evolutionary Algorithms for Solvirig Multi-Objective Problems. Kluwer Academic. New York. 2002.
9. K. Deb. Multi-objective optimization using evolutionary algorithms. John Wiley & Sons, New York. 2001.
10. C.M. Fonseca and P.J. Fleming. Genetic algorithms for multiobjective optimization: Formulation. discussion and generalization. Proceedings of the Fifth International Conference on Generic Algorithms. San, Mateo. California, pages 416-423, 1993.
11. P. Hajela and C.Y. Lin. Genetic search strategies in multicriterion optimal design. Structurnl Optiniization, 4:99-107, 1992.
12. S. Haykin. Neural networks - A comprehensive foundation. Printice Hall, USA, 2 edition, 1999.
13. J. Horn, N. Nafpliotis, and D.E. Goldherg. A niched pareto genetic algorithm for multiobjective optimization. Proceedings of the First IEEE Conference on Evolutionan Conipumrion, 1 :82-87, 1994.
14. H. Ishibuchi and T. Yamamoto. Evolutionary multiobjective optimization for generating an ensemble of fuzzy rule-based classifiers. In Proceedings of the Genetic arid Evolutionary Computation Conference (GECCO-2003), Lecture Notes in Computer Science (LNCS), pages 1077-1088, Chicago, IL, 2003. Springer-Verlag.
15. J. Knowles and D. Come. The pareto archived evolution strategy: A new baseline algorithm for multiobjective optimization. In 1999 Congress on Evollrtiorian Computation, Washington D.C., IEEE Service Centre, pages 98-105, 1999.
16. J. Knowles and D. Come. Approximating the nondominated front using the pareto archived evolution strategy. Evolutionary Computation, 8(2): 149-112, 2000.
17. Anders Krogh and Jesper Vedelsby. Neural network ensembles, cross validation, and active learning. In G. Tesauro, D.S. Touretzky, and T.K. Leen, editors. Advances in Neural lnjormarion Processing Systems. Volume 7, pages 231-238. MIT Press, 1995.
18. Y. Liu and X. Yao. Ensemble learning via negative correlation. Neural Networks, 12(10):1399-1404, 1999.
19. Y. Liu and X. Yao. Simultaneous training of negatively correlated neural networks in an ensemble. IEEE Transaction on systems, Man. and Cybernetics. Part B: Cybernetics . 29(6):716-725, 1999.
20. Y. Liu, X. Yao, and T. Higuchi. Evolutionary ensembles with negative correlation learning. IEEE Transaction on Evolutionary Computation, 4(4):380-387, 2000.
21. R. McKay and H.A. Abbass. Anti-correlation: A diversity promoting mechanisms in ensemble learning. The Australian Journal of Intelligent Information Processing System (AJIIPS), 7(3/4):139-149, 2001.
22. D. Michie, D.J. Spiegelhalter, . and C.C. Taylor. Machine learning neural and statistical classification. Ellis Horwood, 1994.
23. D.E. Rumelhart, G.E. Hinton. and R.J. Williams. Learning internal representations by error propagation. In J.L. McClelland D.E. Rumelhart and the PDP Research Group Eds. editors, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Foundarions; 1, 318, . MIT Press Cambridge, 1986.
24. Y. Sawaraxi, H. Nakayama, and T. Tanino. Theory of multiobjective optimization, volume 176 of Mathematics in science and engineering. Academic Press Inc. Harcourt Brace Jovanovich, 1985.
25. J.D. Schaffer. Multiple objective optimization with vector evaluated genetic algorithms. Generic Algorithms and their Applications: Proceedings of the First International Conference on Genetic Algorithms, pages 93-100, 1985.
26. A.J.C. Sharkey. On combining artificial neural nets. Connection Science, 8:299-313. 1996.
27. N. Srinivas and K. Dev. Multiohjective optimization using nondominated sorting in genetic algorithms. Evolutionary Computation, 2(3):221-248. 1994.
28. R. Storn and K. Price. Differential evolution: A simple and efficient adaptive scheme for global optimization over continuous spaces. Technical Report TR-95- 012, International Computer Science Institute, Berkeley, 1995.
29. E. Zitzler and L. Thiele. Multiobjective evolutionary algorithms: A comparative case study and the strength pareto approach. IEEE Transactions 011 Evolutionary Computation, 3(4):257-271, 1999.