A data mining approach to evolutionary optimisation of noisy multi-objective problems

International Journal of Systems Science

Volumn 43, Issue 7, 2012, Pages 1217-1247

  Chia, J Y ^a   Goh, C K ^b   Shim, V A ^a   Tan, K C ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b ROLLS ROYCE SINGAPORE PTE LTD   (Singapore)

Author keywords

data mining; evolutionary computations; multi objective optimisation; noise

Indexed keywords

AGGREGATED INFORMATION; CROSSOVER OPERATOR; DECISION SPACE; EVOLUTIONARY OPTIMISATION; EVOLUTIONARY OPTIMISERS; FASTER CONVERGENCE; MULTI-MODALITY; MULTI-OBJECTIVE PROBLEM; NOISE; NOISE-TOLERANT; NONCONVEXITY; OBJECTIVE FUNCTIONS; OPTIMAL REGIONS; OPTIMISATIONS; PARETO FRONT; PARETO SET;

ALGORITHMS; EVOLUTIONARY ALGORITHMS; MULTIOBJECTIVE OPTIMIZATION;

DATA MINING;

EID: 84861827632     PISSN: 00207721     EISSN: 14645319     Source Type: Journal    
DOI: 10.1080/00207721.2011.618645     Document Type: Article

References (74)

1. Agrawal, R., Imielinski, T., and Swarmi. A. (1993), 'Mining Association Rules Between Sets of Items in Large Databases', in Proceedings of the ACM SIGMOD International Conference on Management of Data, 25-28 May, Washington, DC, USA, pp. 207-216.
2. Agawal, R., and Srikant, R. (1994), 'Fast Algorithms for Mining Association Rules', in Proceedings of the 20th International Conference on Very Large Data Bases, 12-15 September, Santiago, Chile, pp. 487-499.
3. Aizawa, A.N., and Wah, B.W. (1993), 'Dynamic Control of Genetic Algorithms in a Noisy Environment', in Proceedings of the Conference on Genetic Algorithm, San Mateo, CA, pp. 48-55.
4. Aizawa, A.N., and Wah, B.W. (1994), 'Scheduling of Genetic Algorithms in a Noisy Environment', Evolutionary Computation, 2, 97-122.
5. Arnold, D.V., and Beger, H.G. (2003), 'On the Effects of Outliers on Evolutionary Optimization', in Intelligent Data Engineering and Automated Learning, Ser. LNCS, eds. J. Liu, Y. Cheung, and H. Yin, Berlin, Germany: Springer-Verlag, pp. 151-160. (Pubitemid 36996084)
6. Arnold, D.V., and Beyer, H.G. (2006), 'A General Noise Model and its Effects on Evolution Strategy Performance', IEEE Transactions on Evolutionary Computation, 10, 380-391. (Pubitemid 44251373)
7. Babbar, M., Lakshmikantha, A., and Goldberg, D.E. (2003), 'A Modified NSGA-II to Solve Noisy Multi Objective Problems', in Proceedings of the GECCO 2003, 12-16 July, Chicago, IL, Late Breaking Papers, pp. 21-27.
8. Back, T., and Hammel, U. (1994), 'Evolution Strategies Applied to Perturbed Objective Functions', in Proceedings of the 1st IEEE Conference Evolutionary Computation, 27-29 June, Orlando, FL, Vol. 1, pp. 40-45.
9. Basseur, M., and Zitzler, E. (2006), 'Handling Uncertainty in Indicator Based Multi Objective Optimization', International Journal of Computational Intelligence Research, 2, 255-272.
10. Beielstein, T., and Markon, S. (1994), 'Threshold Selection, Hypothesis Tests and DOE Methods', in Proceedings of the 1st IEEE Conference Evolutionary Computation, 27-29 June, Orlando, FL, Vol. 1, pp. 40-45.
11. Beyer, H.G. (2000), 'Evolutionary Algorithms in Noisy Environments: Theoretical Issues and Guidelines for Practice', Computer Methods in Applied Mechanics and Engineering, 186, 239-267.
12. Branke, J., and Schmidt, C. (2003), 'Selection in the Presence of Noise', in Proceedings of the Genetic Evolutionary Computation Conference, 12-16 July, Chicago, IL, ed. E. Cantu-Paz, Lecture Notes in Computer Science, pp. 766-777.
13. Branke, J., Schmidt, C., and Schmeck, H. (2001), 'Efficient Fitness Estimation in Noisy Environments', in Proceedings of the Genetic Evolutionary Computation Conference, 7-11 July, San Francisco, CA, pp. 243-250.
14. Buche, D., Stoll, P., Dornberger, R., and Koumoutsakos, P. (2002), 'Multi Objective Evolutionary Algorithms for the Optimization of Noisy Combustion Processes', IEEE Transactions on Systems, Man, and Cybernetics Part C: Applications and Reviews, 32, 460-473.
15. Bui, L.T., Abbass, H.A., and Essam, D. (2005), 'Fitness Inheritance for Noisy Evolutionary Multi Objective Optimization', in Proceedings of the GECCO 2005, 25-29 June, Washington, DC, pp. 779-785. (Pubitemid 43226375)
16. Bui, L.T., Abbass, H.A., and Essam, D. (2009), 'Localization for Solving Noisy Multi Objective Optimization Problems', Evolutionary Computation, 17, 379-409.
17. Bui, L.T., Essam, D., Abbass, H.A., and Green. D. (2004), 'Performance Analysis of Evolutionary Multi Objective Optimization Methods in Noisy Environments', in Proceedings of the 8th Asia Pacific Symposium on Intelligent and Evolutionary Systems, 6-7 December, Melbourne Australia, pp. 29-39.
18. Cantu-Paz, E. (2004), 'Adaptive Sampling for Noisy Problems', in Proceedings of the Genetic Evolutionary Computation Conference 2004, 26-30 June, Seattle, WA, pp. 947-958. (Pubitemid 39747287)
19. Carvalho, D.R., and Freitas, A.A. (2002), 'A Genetic Algorithm for Discovering Small Disjunct Rules in Data Mining', Applied Soft Computing, 2, 75-88. (Pubitemid 40421590)
20. Carvalho, D.R., and Freitas, A.A. (2004), 'A Hybrid Decision Tree/Genetic Algorithm Method for Data Mining', Information Science, 163, 13-35.
21. Deb, K. (1999), 'Multi Objective Genetic Algorithms: Problems Difficulties and Construction of Test Problems', Evolutionary Computation, 7, 205-230.
22. Deb, K., Agrawal, S., Pratap, A., and Meyarivan, T. (2002), 'A Fast Elitist Multi Objective Genetic Algorithm: NSGAII', IEEE Transactions on Evolutionary Computation, 6, 182-197. (Pubitemid 34555372)
23. Deb, K., and Srinivasan, A. (2006), 'Innovization: Innovative Design Principles Through Optimization', in Proceedings of the Genetic and Evolutionary Computation Conference (GECCCO), 8-12 July, Seattle WA, pp. 1629-1636. (Pubitemid 44611527)
24. Di Pietro, A., White, L., and Barone, L. (2004), 'Applying Evolutionary Algorithms to Problems With Noisy, Time Consuming Fitness Functions', in Proceedings of the Congress on Evolutionary Computations, Portland, OR, pp. 1254-1261.
25. Eskandari, H., and Geiger, C.D. (1999), 'Evolutionary Multi Objective Optimization in Noisy Problem Environments', Journal of Heuristics, 15, 559-595.
26. Eskandari, H., and Geiger, C.D. (2008), 'A Fast Pareto Genetic Algorithm Approach for Solving Expensive Multi Objective Optimization Problems', Journal of Heuristics, 14, 203-241. (Pubitemid 351534263)
27. Fieldsend J.E., and Everson, R.M. (2005), 'Multi Objective Optimization in the Presence of Uncertainty', in Proceedings of the 2005 Congress on Evolutionary Computation, 2-4 September, Edinburgh, pp. 243-250. (Pubitemid 41495862)
28. Fitzpatrick, J.M., and Grefenstette, J.I. (1988), 'Genetic Algorithms in Noisy Environment', Machine Learning, 3, 101-120.
29. Fonseca, C.M., and Flemming, P.J. (1993), 'Genetic Algorithms for Multi Objective Optimization: Formulation, Discussion and Generalization', in Proceedings of the 5th International Conference on Genetic Algorithms, San Mateo, CA, pp. 416-423.
30. Goethals, B. (2003), 'Survey on Frequent Pattern Mining', Technical Report, Helsinki Institute for Information Technology.
31. Goh, C.K., and Tan, K.C. (2006), 'Noisy Handling in Evolutionary Multi objective optimization', in Proceedings of the IEEE Congress on Evolutionary Computation, 16-21 July, Vancouver, BC, Canada, pp. 1354-1361. (Pubitemid 47130655)
32. Goh, C.K., and Tan, K.C. (2007), 'An Investigation on Noisy Environment in Evolutionary Multi Objective Optimization', IEEE Transactions on Evolutionary Computation, 11, 354-381. (Pubitemid 46895413)
33. Hammel, U., and Back, T. (1994), 'Evolution Strategies on Noisy Functions How to Improve Convergence Properties', in Parallel Problem Solving from Nature (Vol. 866), Ser. LNCS, eds. Y. Davidor, H.P. Schwefel, and R. Manner, Berlin, Germany: Springer-Verlag, pp. 159-168.
34. Hipp, J., Guntzer, U., and Nakhaeizadeh, G. (2000), 'Algorithm for Association Rule Mining-A General Survey and Comparison', ACM/SKIGKDD Explorations, 2, 58-64.
35. Hughes, E.J. (2001a), 'Constraint Handling with Uncertain and Noisy Multi Objective Evolution', in Proceedings of the Congress on Evolutionary Computation, 27-30 May, Coex, Seoul, Korea, Vol. 2, pp. 963-970. (Pubitemid 32806245)
36. Hughes, E.J. (2001b), 'Evolutionary Multi Objective Ranking with Uncertainty and Noise', in Proceedings of the 1st Conference Evolutionary Multi Criterion Optimization 2001, 7-9 March, Zurich, Switzerland, pp. 329-343. (Pubitemid 33241397)
37. Jin, Y., and Branke, J. (2005), 'Evolutionary Optimization in Uncertain Environments-A Survey', IEEE Transactions on Evolutionary Computation, 9, 303-317. (Pubitemid 40871134)
38. Kamrani, A., Wang, R., and Gonzalez, R. (2001), 'A Genetic Algorithm Methodology for Data Mining and Intelligent Knowledge Acquisition', Computers and Industrial Engineering, 40, 361-377. (Pubitemid 32820883)
39. Koonce, D.A., and Tsai, S.C. (2000), 'Using Data Mining to Find Patterns in Genetic Algorithm Solutions to a Job Shop Schedule', Computer and Industrial Engineering, 38, 361-374. (Pubitemid 32022410)
40. Kumar, S., and Rao, C.S.P. (2009), 'Application of Ant Colony, Genetic Algorithm and Data Mining-based Techniques for Scheduling', Robotics and Computer-Integrated Manufacturing, 25, 901-908.
41. Le, M.N., and Ong, Y.S. (2008), 'A Frequent Pattern Mining Algorithm for Understanding Genetic Algorithms', in Proceedings of the International Conference on Intelligent Computing, 15-18 September, Shanghai, China, Lecture Notes in Artificial Intelligence, Vol. 5277, pp. 131-139.
42. Le, M.N., Ong, Y.S., and Nguyen, Q.H. (2008), 'Optinformatics for Schema Analysis of Binary Genetic Algorithms', in Proceedings of the Genetic and Evolutionary Computation Conference (GECCCO), 12-16 June, Atlanta, GA, pp. 1121-1122.
43. Li, H., and Zhang, Q. (2009), 'Multi Objective Optimization Problems with Complicated Pareto Set, MOEA/D and NSGA-II', IEEE Transactions on Evolutionary Computation, 13, 284-302.
44. Liefooghe, A., Basseur, M., Jourdan, L., and Talbi, E. (2007), 'Combinatorial Optimization of Stochastic Multi Objectives Problems: An Application to the Flow Shop Scheduling Problem', in Proceedings of the EMO 2006, pp. 457-471. (Pubitemid 350270904)
45. Limbourg, P. (2005), 'Multi Objective Optimization of Problems with Epistemic Uncertainty', in Proceedings of the EMO 2005, LNCS, eds. C.A. Coello Coello, A.H. Aguirre, and E. Zitzler, Heidelberg: Springer, pp. 413-427. (Pubitemid 41251780)
46. Markon, S., Arnold, D., Back, T., Beielstein, T., and Beyer, H.G. (2001), 'Thresholding-A Selection Operator for Noisy ES', in Proceedings of the Congress on Evolutionary Computation, 27-30 May, Coex, Seoul, Korea, pp. 465-472.
47. Miller, B.L. (1997), 'Noise Sampling and Efficient Genetic Algorithms', TR 97001, Ph.D. dissertation, Department of Computational Science, University of Illinois of Urbana Champaign, Urbana, IL.
48. Miller, B.L., and Goldberg, D.E. (1996), 'Genetic Algorithms, Selection Schemes, and the Varying Effects of Noise', Evolutionary Computation, 4, 113-131. (Pubitemid 126706153)
49. Nakama, T. (2009), 'A Markov Chain that Models Genetic Algorithms in Noisy Environments', Nonlinear Analysis: Theory Methods and Applications, 71, 991-998.
50. Poles, S. (2003), 'MOGA-II: An Improved Multi Objective Genetic Algorithm', Technical Report 2003-2006, Esteco, Trieste.
51. Poles, S., Rigoni, E., and Robic, T. (2004), 'MOGA-II Performance on Noisy Optimization Problems', in International Conference on Bioinspired Optimization Methods and Their Applications, BIOMA 2004, 11-12 October, Ljubljana, Slovena, pp. 51-62.
52. Poloni, C., and Pediroda, V. (1997), 'GA Coupled with Computationally Expensive Simulations: Tools to Improve Efficiency', in Genetic Algorithm and Evolution Strategies in Engineering and Computer Science, eds. D. Quagliarella, J. Periaux, C. Poloni, and G. Winter, England: John Wiley and sons, pp. 267-288.
53. Rana, S., Whitney, D., and Cogswell, R. (1996), 'Searching in the Presence of Noise', in Proceedings of the 4th International Conference Parallel Problem Solving from Nature (PPSN IV), 22-26 September, Berlin, Germany, pp. 198-207. (Pubitemid 126128308)
54. Rattray, L.M., and Shapiro, J. (1997), 'Noisy Fitness Evaluation in Genetic Algorithm and Dynamics of Learning', in Foundations of Genetic Algorithms (Vol. 4), eds. R.K. Belew, and M.D. Vose, San Mateo, CA: Morgan Kaufmann, pp. 117-139.
55. Rudolph, G. (1998), 'Evolutionary Search for Minimal Elements in Partially Ordered Fitness Sets', in Proceedings of the 7th Annual Conference on Evolutionary Programming, 25-27 March, San Diego, CA, pp. 345-353.
56. Rudolph, G. (2001), 'A Partial Order Approach to Noisy Fitness Functions', in Proceedings of the Congress on Evolutionary Computation, 27-30 May, Coex, Seoul, Korea, Vol. 1, pp. 318-325. (Pubitemid 32806355)
57. Salazar Aponte, D.E., Rocco, C.M., and Galvan, B. (2009), 'On Uncertainty and Robustness in Evolutionary Optimization Based MCDM', in Proceedings of the EMO 2009, LNCS, eds. M. Ehrgott, V. Barichard, X. Gandibleux, and V. T'Kindt, Berlin: Springer, 467, pp 51-65.
58. Sano, Y., and Kita, H. (2000), 'Optimization of Noisy Fitness Functions by Means of Genetic Algorithms using History of Search', in Parallel Problem Solving from Nature (Vol. 1917), Ser. LNCS, eds. M. Schoenauer, K. Deb, G. Rudolph, X. Yao, E. Lutton, J.J.M. Guervó s, and H.-P. Schwefel, Berlin, Germany: Springer-Verlag, pp. 571-580.
59. Sano, Y., and Kita, H. (2002), 'Optimization of Noisy Fitness Functions by Means of Genetic Algorithms using History of Search with Test of Estimation', in Proceedings of the Congress on Evolutionary Computation, 12-17 May, Honolulu, HI, Vol. 1, pp. 360-365.
60. Santos, H.G., Ochi, L.S., Marinho, E.H., and Drummond, L.M.A. (2006), 'Combining an Evolutionary Algorithm with Data Mining to Solve a Single-vehicle Routing Problem', Neurocomputing, 70, 70-77. (Pubitemid 44615808)
61. Savasere, A., Omiecinski, E., and Navathe, S. (1995), 'An Efficient Algorithm for Mining Association Rules in Large Databases', in Proceedings of the 21st Conference on Very Large Databases (VLDB 1995), 11-15 September, Zurich, Switzerland, pp. 432-444.
62. Scott, J.R. (1995), 'Fault Tolerant Design Using Single and Multi-criteria Genetic Algorithms', Master's thesis, Department of Aeronautics and Astronautics, Massachusetts Institute of Technology.
63. Singh, A. (2003), 'Uncertainty Based Multi Objectives Optimization of Ground Water Remediation Design', M.S. thesis, University of Illinois at Urbana-Champaign, Urbana, IL.
64. Sorensen, K., and Janssens, G.K. (2003), 'Data Mining with Genetic Algorithms on Binary Trees', European Journal of Operational Research, 151, 253-264.
65. Stroud, P.D. (2001), 'Kalman Extended Genetic Algorithms for Search in Non Stationary Environments with Noisy Fitness Evaluations', IEEE Transactions on Evolutionary Computation, 5, 66-77. (Pubitemid 32330498)
66. Syberfeld, A. (2009), 'A Multi Objective Evolutionary Approach to Simulation Based Optimization of Real World Problems', Ph.D. dissertation, De Monfort University.
67. Syberfeldt, A., Ng, A., John, R.I., and Moore, P. (2010), 'Evolutionary Optimization of Noisy Multi Objective Problems Using Confidence Based Dynamic Resampling', European Journal of Operational Research, 204, 533-544.
68. Tan, K.C., Goh, C.K., Mamum, A.A., and Ei, E.Z. (2008), 'An Evolutionary Artificial Immune System for Multi Objective Optimization', European Journal of Operational Research, 187, 371-392. (Pubitemid 350102850)
69. Teich, J. (2001), 'Pareto Front Exploration with Uncertain Objectives', in Evolutionary Multi Criterion Optimization, Ser. LNCS, eds. E. Zitzler, K. Deb, L. Thiele, C.A. Coello Coello, and D. Corne, Berlin, Germany: Springer-Verlag, pp. 314-328. (Pubitemid 33241396)
70. Zaki, M.J., Parthasarathy, S., Ogihara, M., and Li, W. (1997), 'New Algorithms for Fast Discovery of Association Rules', in Proceeding of the 3rd International Conference on KDD and Data Mining, 14-17 August, Newport Beach, CA, pp. 283-286.
71. Zhai, W., Kelly, P., and Gong, W.B. (1996), 'Genetic Algorithms with Noisy Fitness', Mathematical Computational Modeling, 23, 131-142. (Pubitemid 27084424)
72. Zitzler, E., Deb, K., and Thiele, L. (2000), 'Comparison of Multi Objective Evolutionary Algorithms: Empirical Results', Evolutionary Computation, 8, 173-195.
73. Zitzler, E., Laumanns, M., and Thiele, L. (2001), 'SPEA2: Improving the Strength Pareto Evolutionary Algorithm', Technical Report 103, Computer Engineering and Networks Lab. (TIK), Swiss Federal Institute of Technology (ETH), Zurich, Switzerland.
74. Zitzler, E., and Thiele, L. (1999), 'Multi Objective Evolutionary Algorithms: A Comparative Case Study and the Strength Pareto Approach', IEEE Transactions on Evolutionary Computation, 3, 257-271. (Pubitemid 30544879)