Speeding Up Backpropagation Using Multiobjective Evolutionary Algorithms

Neural Computation

Volumn 15, Issue 11, 2003, Pages 2705-2726

  Abbass, Hussein A ^a  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; EVOLUTION;

ALGORITHMS; EVOLUTION; NEURAL NETWORKS (COMPUTER);

EID: 0141542628     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/089976603322385126     Document Type: Article

References (39)

1. Abbass, H. A. (2002). The self-adaptive Pareto differential evolution algorithm. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC2002) (Vol. 1, pp. 831-836). Piscataway, NJ: IEEE Press.
2. Abbass, H. A., & Deb, K.(2003). Searching under multi-evolutionary pressures. In Proceedings of the 2003 Evolutionary Multiobjective Optimization Conference (EMO03), LNCS-2632 (pp. 391-404). Berlin: Springer-Verlag.
3. Abbass, H. A., & Sarker, R. (2002). The Pareto differential evolution algorithm. International Journal on Artificial Intelligence Tools, 11(4), 531-552.
4. Abbass, H. A., Towsey, M., & Finn, G. (2001). C-net: A method for generating non-deterministic and dynamic multivariate decision trees. Knowledge and Information Systems, 3, 184-197.
5. Blake, C., & Merz, C. (1998). UCI repository of machine learning databases. University of California, Irvine, Department of Information and Computer Sciences. Available on-line: http://www.ics.uci.edu/̃mlearn/mlrepository.html.
6. Coello, C. (1999). A comprehensive survey of evolutionary-based multiobjective optimization techniques. Knowledge and Information Systems, 1(3), 269-308.
7. Coello, C., Van Veldhuizen, D., & Lamont, G. (2002). Evolutionary algorithms for solving multi-objective problems. Norwell, MA: Kluwer.
8. Deb, K. (2001). Multi-objective optimization using evolutionary algorithms. New York: Wiley.
9. Fogel, D., Wasson, E., & Boughton, E. (1995). Evolving neural networks for detecting breast cancer. Cancer Letters, 96(1), 49-53.
10. Fogel, D., Wasson, E., & Porto, V. (1997). A step toward computer-assisted mammography using evolutionary programming and neural networks. Cancer Letters, 119(1), 93.
11. Fonseca, C., & Fleming, P. (1993). Genetic algorithms for multiobjective optimization: Formulation, discussion and generalization. In Proceedings of the Fifth International Conference on Genetic Algorithms (pp. 416-423). San Mateo, CA: Morgan Kaufmann
12. Hajela, P., & Lin, C. (1992). Genetic search strategies in multicriterion optimal design. Structural Optimization, 4, 99-107.
13. Haykin, S. (1999). Neural networks - a comprehensive foundation (2nd ed.). Englewood Cliffs, NJ: Prentice Hall.
14. Horn, J., Nafpliotis, N., & Goldberg, D. (1994). A niched Pareto genetic algorithm for multiobjective optimization. In Proceedings of the First IEEE Conference on Evolutionary Computation, Vol. 1, 82-87. Piscataway, NJ: IEEE.
15. Kitano, H. (1990). Designing neural networks using genetic algorithms with graph generation system. Complex Systems, 4(4), 461-476.
16. Knowles, J., & Corne, D. (1999). The Pareto archived evolution strategy: A new baseline algorithm for multiobjective optimization. In 1999 Congress on Evolutionary Computation (pp. 98-105). Washington, DC: IEEE Service Center.
17. Knowles, J., & Corne, D. (2000). Approximating the nondominated front using the Pareto archived evolution strategy. Evolutionary Computation, 8(2), 149172.
18. Maniezzo, V. (1994). Genetic evolution of the topology and weight distribution of neural networks. IEEE Transactions on Neural Networks, 5(1), 39-53.
19. Michie, D., Spiegelhalter, D., & Taylor, C. (1994). Machine learning, neural and statistical classification. Hemel Hempstead, Hertfordshire, England: Eills Horwood.
20. Moscato, P. (1999). Memetic algorithms: A short introduction. In D. Corne, M. Dorigo, & F. Glover (Eds.), New ideas in optimization (pp. 219-234). New York: McGraw-Hill.
21. Pareto, V. (1896). Cours d'économie politique professé á l'université de Lausanne. Lausanne: F. Rouge.
22. Pujol, J., & Poli, R. (1998). Evolving the topology and the weights of neural networks using a dual representation. Applied Intelligence, 8(1), 73-84.
23. Rumelhart, D., Hinton, G., & Williams, R. (1986). Learning internal representations by error propagation. In J.M. McClelland, D. E. Rumelhart, and the PDF Research Group (Eds.), Parallel distributed processing: Explorations in the microstructure of Cognition, foundations (Vol. 1, pp. 318-362). Cambridge, MA: MIT Press.
24. Sawaragi, Y., Nakayama, H., & Tanino, T. (1985). Theory of multiobjective optimization. Orlando, FL: Academic Press.
25. Schaffer, J. (1985). Multiple objective optimization with vector evaluated genetic algorithms. In Genetic algorithms and their applications: Proceedings of the First International Conference on Genetic Algorithms (pp. 93-100). Mahwah, NJ: Erlbaum.
26. Schwefel, H. (1981). Numerical optimization of computer models. New York: Wiley.
27. Srinivas, N., & Dev, K. (1994). Multiobjective optimization using nondominated sorting in genetic algorithms. Evolutionary Computation, 2(3), 221-248.
28. Stanley, K., & Miikkulainen, R. (2002). Evolving neural networks through augmenting topologies. Evolutionary Computation, 10(2), 99-127.
29. Storn, R., & Price, K. (1995). Differential evolution: A simple and efficient adaptive scheme for global optimization over continuous spaces (Tech. Rep. No. TR-95-012). Berkeley: International Computer Science Institute.
30. Teo, J., & Abbass, H. A. (2002a). Coordination and synchronization of locomotion in a virtual robot. In L. Wang, J. Rajapakse, K. Fukushima, S. Lee, & X. Yao (Eds.), Proceedings of the 9th International Conference on Neural Information Processing (ICONIP'02) (Vol. 4, pp. 1931-1935). Hermiankatu, Finland: SuviSoft Oy.
31. Teo, J., & Abbass, H. A. (2002b). Multi-objectivity for brain-behavior evolution of a physically-embodied organism. In R. Standish, M. Bedau, & H. Abbass (Eds.), Artificial Life VIII: The 8th International Conference on Artificial Life (pp. 313-318). Cambridge, MA: MIT Press.
32. Werbos, P. (1974). Beyond regression: New tools for prediction and analysis in the behavioral sciences. Unpublished doctoral dissertation, Harvard University.
33. Wolberg, W. H., & Mangasarian, O. L. (1990). Multisurface method of pattern separation for medical diagnosis applied to breast cytology. Proceedings of the National Academy of Sciences, 87, 9193-9196.
34. Yan, W., Zhu, Z. & Hu, R. (1997). Hybrid genetic/BP algorithm and its application for radar target classification. In Proceedings of the 1997 IEEE National Aerospace and Electronics Conference, NAECON, IEEE Press, USA (pp. 981-984). Piscataway, NJ: IEEE.
35. Yao, X. (1999). Evolving artificial neural networks. Proceedings of the IEEE, IEEE Press, USA, 87(9), 1423-1447.
36. Yao, X., & Liu, Y. (1998a). Making use of population information in evolutionary artificial neural networks. IEEE Trans. on Systems, Man, and Cybernetics, Part B: Cybernetics, 28(3), 417-425.
37. Yao, X., & Liu, Y (1998b). Towards designing artificial neural networks by evolution. Applied Mathematics and Computation, 91(1), 83-90.
38. Zeleny, M. (1998). Multiple criteria decision making: Eight concepts of optimality. Human Systems Management, 17, 97-107.
39. Zitzler, E., & Thiele, L. (1999). Multiobjective evolutionary algorithms: A comparative case study and the strength Pareto approach. IEEE Transactions on Evolutionary Computation, 3(4), 257-271.