Multi-objective evolutionary recurrent neural network ensemble for prediction of computational fluid dynamic simulations

Proceedings of the 2014 IEEE Congress on Evolutionary Computation, CEC 2014

Volumn , Issue , 2014, Pages 2609-2616

  Smith, Christopher ^a   Doherty, John ^a   Jin, Yaochu ^a  

^a UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL FLUID DYNAMICS; EVOLUTIONARY ALGORITHMS; FORECASTING; PREDICTIVE ANALYTICS;

COMPUTATIONAL COSTS; INDIVIDUAL PREDICTION; LONG-TERM PREDICTION; MULTI OBJECTIVE EVOLUTIONARY ALGORITHMS; MULTI-OBJECTIVE EVOLUTIONARY; OPTIMIZATION TASK; SELECTION METHODS; SURROGATE MODEL;

RECURRENT NEURAL NETWORKS;

EID: 84908584310     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CEC.2014.6900552     Document Type: Conference Paper

References (35)

1. B. Massey, Mechanics of Fluids, 7th ed. Stanley Thornes (Publishers) Ltd, 1998.
2. H. Versteeg and W. Malalasekera, An Introduction to Computational Fluid Dynamics: The Finite Volume Method. Pearson Education Limited, 2007.
3. Y. Jin, "Surrogate-assisted evolutionary computation: Recent advances and future challenges," Swarm and Evolutionary Computation, vol. 1, no. 2, pp. 61-70, 2011.
4. D. Gorissen, I. Couckuyt, P. Demeester, T. Dhaene, and K. Crombecq, "A surrogate modeling and adaptive sampling toolbox for computer based design," Journal of Machine Learning Research, vol. 11, pp. 2051-2055, 2010.
5. A. Ribeiro, A. Awruch, and H. Gomes, "An airfoil optimization technique for wind turbines," Applied Mathematical Modelling, vol. 36, no. 10, pp. 4898-4907, 2012.
6. R. M. Greenman and K. R. Roth, "Minimizing computational data requirements for multi-element airfoils using neural networks," Journal of Aircraft, vol. 36, no. 5, pp. 777-784, 1999.
7. Y. Cao, Y. Jin, M. Kowalczykiewicz, and B. Sendhoff, "Prediction of convergence dynamics of design performance using differential recurrent neural networks," in IEEE International Joint Conference on Neural Networks (IJCNN), World Congress on Computational Intelligence, June 2008, pp. 528-533.
8. C. Smith, J. Doherty, and Y. Jin, "Recurrent neural network ensembles for convergence prediction in surrogate-assisted evolutionary optimization," in IEEE Computational Intelligence in Dynamic and Uncertain Environments (CIDUE), Symposium Series on Computational Intelligence, 2013, pp. 9-16.
9. A. Forrester, N. Bressloff, and A. Keane, "Optimization using surrogate models and partially converged computational fluid dynamics simulations," in Proceedings of the Royal Society A, 2006, pp. 2177-2204.
10. A. P. Engelbrecht, Computational Intelligence: An Introduction, 2nd ed. Wiley Publishing, 2007.
11. L. K. Hansen and P. Salamon, "Neural network ensembles," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 10, pp. 993-1001, October 1990.
12. Z.-H. Zhou, J. Wu, and W. Tang, "Ensembling neural networks: Many could be better than all," Artificial Intelligence, vol. 137, pp. 239-263, November 2002.
13. Z.-H. Zhou, Ensemble Methods: Foundations and Algorithms, ser. Chapman & Hall/CRC Data Mining and Knowledge Discovery Serie. Taylor & Francis, 2012.
14. X. Yao and M. M. Islam, "Evolving artificial neural network ensembles," IEEE Computational Intelligence Magazine, vol. 3, no. 1, pp. 31-42, February 2008.
15. G. Brown, J. Wyatt, R. Harris, and X. Yao, "Diversity creation methods: A survey and categorisation," Journal of Information Fusion, vol. 6, no. 1, pp. 1-28, 2005.
16. A. Krogh and J. Vedelsby, "Neural network ensembles, cross validation, and active learning," in Advances in Neural Information Processing Systems. MIT Press, 1995, pp. 231-238.
17. D. W. Opitz and J. W. Shavlik, "Generating accurate and diverse members of a neural-network ensemble," in Advances in Neural Information Processing Systems. MIT Press, 1996, pp. 535-541.
18. A. Chandra and X. Yao, "DIVACE: Diverse and accurate ensemble learning algorithm," in IDEAL, ser. Lecture Notes in Computer Science, Z. Yang, H. Yin, and R. Everson, Eds. Springer Berlin Heidelberg, 2004, vol. 3177, pp. 619-625.
19. Y. Jin, T. Okabe, and B. Sendhoff, "Neural network regularization and ensembling using multi-objective evolutionary algorithms," in IEEE Congress on Evolutionary Computation, vol. 1, June 2004, pp. 1-8.
20. H. A. Abbass and R. Sarker, "Simultaneous evolution of architectures and connection weights in ANNs," Proceedings of Artificial Neural Networks and Expert System Conference, pp. 16-21, 2001.
21. H. Abbass, "Pareto neuro-evolution: Constructing ensemble of neural networks using multi-objective optimization," in IEEE Congress on Evolutionary Computation, vol. 3, 2003, pp. 2074-2080.
22. Y. Jin and B. Sendhoff, "Pareto-based multiobjective machine learning: An overview and case studies," IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, vol. 38, pp. 397-445, 2008.
23. X. Yao, "Evolving artificial neural networks," Proceedings of the IEEE, vol. 87, no. 9, pp. 1423-1447, 1999.
24. G. Jones, "Genetic and evolutionary algorithms," 1990.
25. R. Salomon, "Evolutionary algorithms and gradient search: Similarities and differences," IEEE Trans. Evolutionary Computation, vol. 2, no. 2, pp. 45-55, July 1998.
26. K. Deb, Multi-Objective Optimization using Evolutionary Algorithms. John Wiley and Sons, Ltd, 2001.
27. K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, "A fast and elitist multiobjective genetic algorithm: NSGA-II," IEEE Transactions on Evolutionary Computation, vol. 6, no. 2, pp. 182-197, April 2002.
28. M. Husken and P. Stagge, "Recurrent neural networks for time series classification," Neurocomputing, vol. 50, pp. 223-235, 2003.
29. C. Igel, V. Heidrich-Meisner, and T. Glasmachers, "Shark," Journal of Machine Learning Research, vol. 9, pp. 993-996, 2008.
30. C. Igel and M. Husken, "Empirical evaluation of the improved Rprop learning algorithms," Neurocomputing, vol. 50, pp. 105-123, 2003.
31. T. A. El-Mihoub, A. A. Hopgood, L. Nolle, and A. Battersby, "Hybrid genetic algorithms: A review," Engineering Letters, vol. 13, no. 2, pp. 124-137, 2006.
32. K. W. Ku and M.-W. Mak, "Exploring the effects of lamarckian and baldwinian learning in evolving recurrent neural networks," in IEEE International Conference on Evolutionary Computation, 1997, pp. 617-621.
33. L. Rachmawati and D. Srinivasan, "A multi-objective evolutionary algorithm with weighted-sum niching for convergence on knee regions," in Genetic and Evolutionary Computation Conference. New York, NY, USA: ACM, 2006, pp. 749-750.
34. Y. Jin, M. Husken, and B. Sendhoff, "Quality measures for approximate models in evolutionary computation," in GECCO 2003: Proceedings of the Bird of a Feather Workshop, Genetic and Evolutionary Computation Conference. AAAI, 2003, pp. 170-173.
35. M. Husken, Y. Jin, and B. Sendhoff, "Structure optimization of neural networks for evolutionary design optimization," Soft Comput., vol. 9, no. 1, pp. 21-28, 2005.