A survey of multiobjective evolutionary algorithms for data mining: Part i

IEEE Transactions on Evolutionary Computation

Volumn 18, Issue 1, 2014, Pages 4-19

  Mukhopadhyay, Anirban ^a   Maulik, Ujjwal ^b   Bandyopadhyay, Sanghamitra ^c   Coello, Carlos Artemio Coello ^d  

^a UNIVERSITY OF KALYANI   (India)

^b JADAVPUR UNIVERSITY   (India)

^c INDIAN STATISTICAL INSTITUTE   (India)

^d DEPARTAMENTO DE FÍSICA   (Mexico)

Author keywords

Classification; feature selection; multiobjective evolutionary algorithms; Pareto optimality

Indexed keywords

AUTOMATIC PROCESSING; DATA MINING PROBLEMS; FEATURE SELECTION AND CLASSIFICATION; MEASURES OF PERFORMANCE; MULTI OBJECTIVE EVOLUTIONARY ALGORITHMS; MULTI-OBJECTIVE EVOLUTIONARY; OPTIMAL PARAMETER SETTINGS; PARETO-OPTIMALITY;

CLASSIFICATION (OF INFORMATION); EVOLUTIONARY ALGORITHMS; FEATURE EXTRACTION; MULTIOBJECTIVE OPTIMIZATION; SURVEYS;

DATA MINING;

EID: 84893833215     PISSN: 1089778X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TEVC.2013.2290086     Document Type: Article

References (78)

1. A. Mukhopadhyay, U. Maulik, S. Bandyopadhyay, and C. A. Coello Coello, "A survey of multiobjective evolutionary algorithms for data mining: Part II," IEEE Trans. Evolut. Comput., to be published.
2. U. Maulik, S. Bandyopadhyay, and A. Mukhopadhyay, Multiobjective Genetic Algorithms for Clustering-Applications in Data Mining and Bioinformatics. Berlin, Germany: Springer, 2011.
3. J. Han and M. Kamber, Data Mining: Concepts and Techniques. San Francisco, CA, USA: Morgan Kaufmann, 2000.
4. D. E. Goldberg, Genetic Algorithms in Search, Optimization and Machine Learning. New York, NY, USA: Addison-Wesley, 1989.
5. K. Deb, Multi-Objective Optimization Using Evolutionary Algorithms. London, U.K.: Wiley, 2001.
6. C. A. Coello Coello, G. B. Lamont, and D. A. van Veldhuizen, Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation), 2nd ed. Berlin/Heidelberg, Germany: Springer, 2007.
7. J. D. Schaffer, "Multiple objective optimization with vector evaluated genetic algorithms," in Proc. 1st Int. Conf. Genet. Algorithms Their Appl., 1985, pp. 93-100.
8. C. M. Fonseca and P. J. Fleming, "Genetic algorithms for multiobjective optimization: Formulation, discussion and generalization," in Proc. 5th Int. Conf. Genet. Algorithms, 1993, pp. 416-423.
9. J. Horn and N. Nafpliotis, "Multiobjective optimization using the niched Pareto genetic algorithm," Univ. Illinois at Urbana-Champaign, Urbana, IL, USA, Tech. Rep. IlliGAl Rep. 93005, 1993.
10. N. Srinivas and K. Deb, "Multiobjective optimization using nondominated sorting in genetic algorithms," Evol. Comput., vol. 2, no. 3, pp. 221-248, 1994.
11. E. Zitzler and L. Thiele, "Multiobjective evolutionary algorithms: A comparative case study and the strength Pareto approach," IEEE Trans. Evol. Comput., vol. 3, no. 4, pp. 257-271, Nov. 1999. (Pubitemid 30544879)
12. E. Zitzler, M. Laumanns, and L. Thiele, "SPEA2: Improving the strength Pareto evolutionary algorithm," in Proc. EUROGEN, 2001, pp. 95-100.
13. J. D. Knowles and D. W. Corne, "The Pareto archived evolution strategy: A new baseline algorithm for Pareto multiobjective optimisation," in Proc. IEEE Cong. Evol. Comput., 1999, pp. 98-105.
14. D. W. Corne, J. D. Knowles, and M. J. Oates, "The Pareto envelopebased selection algorithm for multiobjective optimization," in Proc. Conf. PPSN-VI, 2000, pp. 839-848.
15. D. W. Corne, N. R. Jerram, J. D. Knowles, and M. J. Oates, "PESA-II: Region-based selection in evolutionary multiobjective optimization," in Proc. GECCO, 2001, pp. 283-290.
16. K. Deb, A. Pratap, S. Agrawal, and T. Meyarivan, "A fast and elitist multiobjective genetic algorithm: NSGA-II," IEEE Trans. Evol. Comput., vol. 6, no. 2, pp. 182-197, Apr. 2002. (Pubitemid 34555372)
17. E. Zitzler and S. K̈unzli, "Indicator-based selection in multiobjective search," in Proc. PPSN VIII, vol. 3242. Sep. 2004, pp. 832-842. (Pubitemid 39750284)
18. N. Beume, B. Naujoks, and M. Emmerich, "SMS-EMOA: Multiobjective selection based on dominated hypervolume," Eur. J. Operat. Res., vol. 181, no. 3, pp. 1653-1669, Sep. 2007. (Pubitemid 46498552)
19. E. Zitzler, "Evolutionary algorithms for multiobjective optimization: Methods and applications," Ph.D. dissertation, Comput. Eng. Networks Lab., (TIK), Swiss Federal Instit. Technol. (ETH), Zurich, Switzerland, Nov. 1999.
20. U. M. Fayyad, G. Piatetsky-Shapiro, P. Smyth, and R. Uthurusamy, Eds., Advances in Knowledge Discovery and Data Mining. Menlo Park, CA, USA: MIT Press, 1996.
21. S. Bandyopadhyay, U. Maulik, L. B. Holder, and D. J. Cook, Advanced Methods for Knowledge Discovery From Complex Data (Advanced Information and Knowledge Processing). London, U.K.: Springer-Verlag, 2005.
22. S. Bandyopadhyay and S. K. Pal, Classification and Learning Using Genetic Algorithms: Applications in Bioinformatics and Web Intelligence (Natural Computing Series). Berlin, Germany: Springer, 2007.
23. V. Vapnik, Statistical Learning Theory. New York, NY, USA: Wiley, 1998.
24. A. K. Jain and R. C. Dubes, Algorithms for Clustering Data. Englewood Cliffs, NJ, USA: Prentice-Hall, 1988.
25. U. Maulik and S. Bandyopadhyay, "Genetic algorithm based clustering technique," Pattern Recognit., vol. 33, no. 9, pp. 1455-1465, Sep. 2000.
26. R. Agrawal, T. Imielinski, and A. N. Swami, "Mining association rules between sets of items in large databases," in Proc. ACM SIGMOD Int. Conf. Manage. Data, 1993, pp. 207-216.
27. R. Agrawal and R. Srikant, "Fast algorithms for mining association rules in large databases," in Proc. 20th VLDB, 1994, pp. 487-499.
28. P.-N. Tan, V. Kumar, and J. Srivastava, "Selecting the right interestingness measure for association patterns," in Proc. 8th KDD, 2002, pp. 32-41.
29. U. Maulik, A. Mukhopadhyay, and S. Bandyopadhyay, "Combining Pareto-optimal clusters using supervised learning for identifying coexpressed genes," BMC Bioinform., vol. 10, no. 27, doi: 10.1186/1471-2105-10-27, 2009
30. P. A. Castillo, M. G. Arenas, J. J. Merelo, V. M. Rivas, and G. Romero, "Multiobjective optimization of ensembles of multilayer perceptrons for pattern classification," in Proc. 9th PPSN, 2006, pp. 453-462. (Pubitemid 44609421)
31. A. Ghosh and B. Nath, "Multi-objective rule mining using genetic algorithms," Inf. Sci., vol. 163, nos. 1-3, pp. 123-133, Jun. 2004.
32. S. Mitra and H. Banka, "Multiobjective evolutionary biclustering of gene expression data," Patt. Recogn., vol. 39, no. 12, pp. 2464-2477, 2006. (Pubitemid 44344744)
33. L. Tseng and S. Yang, "Genetic algorithms for clustering, feature selection, and classification," in Proc. IEEE Int. Conf. Neural Netw., 1997, pp. 1612-1616.
34. M. Karzynski, A. Mateos, J. Herrero, and J. Dopazo, "Using a genetic algorithm and a perceptron for feature selection and supervised class learning in DNA microarray data," Artif. Intell. Rev., vol. 20, nos. 1-2, pp. 39-51, 2003.
35. C. Emmanouilidis, A. Hunter, and J. MacIntyre, "A multiobjective evolutionary setting for feature selection and a commonality-based crossover operator," in Proc. IEEE CEC, 2000, pp. 309-316.
36. C. Emmanouilidis, A. Hunter, J. Macintype, and C. Cox, "A multiobjective genetic algorithm approach to feature selection in neural and fuzzy modeling," Evol. Optimiz., vol. 3, no. 1, pp. 1-26, 2001.
37. C. Emmanouilidis, Evolutionary Multi-Objective Feature Selection and ROC Analysis With Application to Industrial Machinery Fault Diagnosis (Evolutionary Methods for Optimization, Design and Control). Barcelona, Spain: CIMNE, 2002.
38. L. E. S. de Oliveira, R. Sabourin, F. Bortolozzi, and C. Y. Suen, "A methodology for feature selection using multiobjective genetic algorithms for handwritten digit string recognition," Int. J. Pattern Recognit. Artif. Intell., vol. 17, no. 6, pp. 903-929, 2003.
39. M. Morita, R. Sabourin, F. Bortolozzi, and C. Suen, "Unsupervised feature selection using multi-objective genetic algorithm for handwritten word recognition," in Proc. ICDAR, Aug. 2003, pp. 666-670.
40. L. Oliveira, R. Sabourin, F. Bortolozzi, and C. Suen, "Feature selection for ensembles: A hierarchical multi-objective genetic algorithm approach," in Proc. 7th Int. Conf. Document Anal. Recognit., Aug. 2003, pp. 676-680.
41. L. S. Oliveira, M. Morita, and R. Sabourin, "Feature selection for ensembles using the multi-objective optimization approach," in Multiobjective Machine Learning, Y. Jin, Ed. Berlin, Germany: Springer, Stud. Comput. Intell., vol. 16, pp. 49-74, 2006. (Pubitemid 44869071)
42. C.-M. Wang and Y.-F. Huang, "Evolutionary-based feature selection approaches with new criteria for data mining: A case study of credit approval data," Expert Syst. Appl., vol. 36, no. 3, pp. 5900-5908, Apr. 2009.
43. M. Venkatadri and K. Srinivasa Rao, "A multiobjective genetic algorithm for feature selection in data mining," Int. J. Comput. Sci. Inform. Technol., vol. 1, no. 5, pp. 443-448, 2010.
44. I. Mierswa and M. Wurst, "Information preserving multi-objective feature selection for unsupervised learning," in Proc. GECCO, 2006, vol. 2. Jul. 2006, pp. 1545-1552. (Pubitemid 44611511)
45. A. Gaspar-Cunha, "Feature selection using multi-objective evolutionary algorithms: Application to cardiac SPECT diagnosis," in IWPACBB (Advances in Soft Computing, vol. 74), M. P. Rocha, F. F. Riverola, H. Shatkay, and J. M. Corchado, Eds. Berlin, Germany: Springer, 2010, pp. 85-92.
46. A. Gaspar-Cunha, "RPSGAe-reduced Pareto set genetic algorithm: Application to polymer extrusion," in Metaheuristics for Multiobjective Optimisation. Berlin, Germany: Springer, 2004, pp. 221-249. (Pubitemid 38203483)
47. K. Kim, R. B. McKay, and B.-R. Moon, "Multiobjective evolutionary algorithms for dynamic social network clustering," in Proc. 12th GECCO, 2010, pp. 1179-1186.
48. Y.-S. Kim, W. N. Street, and F. Menczer, "An evolutionary multiobjective local selection algorithm for customer targeting," in Proc. CEC, 2001, pp. 759-766. (Pubitemid 32806219)
49. J. Handl and J. D. Knowles, "Feature subset selection in unsupervised learning via multiobjective optimization," Int. J. Comput. Intell. Res., vol. 2, no. 3, pp. 217-238, 2006.
50. J. Liu and H. Iba, "Selecting informative genes using a multiobjective evolutionary algorithm," in Proc. CEC, 2002, pp. 297-302.
51. Y. Kim, N. W. Street, and F. Menczer, "Evolutionary model selection in unsupervised learning," Intell. Data Anal., vol. 6, no. 6, pp. 531-556, Dec. 2002.
52. T. R. Golub, D. K. Slonim, P. Tamayo, C. Huard, M. Gaasenbeek, J. P. Mesirov, et al., "Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring," Science, vol. 286, no. 5439, pp. 531-537, Oct. 1999.
53. D. K. Slonim, P. Tamayo, J. P. Mesirov, T. R. Golub, and E. S. Lander, "Class prediction and discovery using gene expression data," in Proc. 4th RECOMB, 2000, pp. 263-272.
54. G. L. Pappa, A. A. Freitas, and C. A. A. Kaestner, "A multiobjective genetic algorithm for attribute selection," in Proc. 4th RASC, pp. 116-121, Dec. 2002.
55. A. Gaspar-Cunha, F. Mendes, J. Duarte, A. Vieira, B. Ribeiro, A. Ribeiro, et al., "Feature selection for bankruptcy prediction: A multiobjective optimization approach," Int. J. Natural Comput. Res., vol. 1, no. 2, pp. 71-91, 2010.
56. U. Maulik and S. Bandyopadhyay, "Performance evaluation of some clustering algorithms and validity indices," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 12, pp. 1650-1654, Dec. 2002.
57. D. L. Davies and D. W. Bouldin, "A cluster separation measure," IEEE Trans. Pattern Anal. Mach. Intell., vol. 1, no. 2, pp. 224-227, Apr. 1979.
58. H. Ishibuchi and Y. Nojima, "Multiobjective formulations of fuzzy rulebased classification system design," in Proc. EUSFLAT Conf., 2005, pp. 285-290.
59. H. Ishibuchi and Y. Nojima, "Comparison between fuzzy and interval partitions in evolutionary multiobjective design of rule-based classification systems," in Proc. 14th FUZZ-IEEE, May 2005, pp. 430-435. (Pubitemid 41189545)
60. K. Narukawa, Y. Nojima, and H. Ishibuchi, "Modification of evolutionary multiobjective optimization algorithms for multiobjective design of fuzzy rule-based classification systems," in Proc. 14th Fuzz-IEEE, May 2005, pp. 809-814. (Pubitemid 41189611)
61. R. Alcala, Y. Nojima, F. Herrera, and H. Ishibuchi, "Generating single granularity-based fuzzy classification rules for multiobjective genetic fuzzy rule selection," in Proc. FUZZ-IEEE, Aug. 2009, pp. 1718-1723.
62. R. Alcaĺa, Y. Nojima, F. Herrera, and H. Ishibuchi, "Multiobjective genetic fuzzy rule selection of single granularity-based fuzzy classification rules and its interaction with the lateral tuning of membership functions," Soft Comput., vol. 15, no. 12, pp. 2303-2318, 2011.
63. P. Pulkkinen and H. Koivisto, "Fuzzy classifier identification using decision tree and multiobjective evolutionary algorithms," Int. J. Approx. Reasoning, vol. 48, no. 2, pp. 526-543, Jun. 2008. (Pubitemid 351602157)
64. P. Ducange, B. Lazzerini, and F. Marcelloni, "Multi-objective genetic fuzzy classifiers for imbalanced and cost-sensitive datasets," Soft Comput., vol. 14, no. 7, pp. 713-728, May 2010.
65. P. Villar, A. Fernandez, and F. Herrera, "Studying the behavior of a multiobjective genetic algorithm to design fuzzy rule-based classification systems for imbalanced data-sets," in Proc. FUZZ-IEEE, Jun. 2011, pp. 1239-1246.
66. S. Dehuri, S. Patnaik, A. Ghosh, and R. Mall, "Application of elitist multi-objective genetic algorithm for classification rule generation," Appl. Soft Comput., vol. 8, no. 1, pp. 477-487, Jan. 2008. (Pubitemid 47374580)
67. M. Antonelli, P. Ducange, and F. Marcelloni, "Multi-objective evolutionary rule and condition selection for designing fuzzy rule-based classifiers," in Proc. FUZZ-IEEE, Jun. 2012, pp. 1-7.
68. S. Srinivasan and S. Ramakrishnan, "Evolutionary multiobjective optimization for rule mining: A review," Artif. Intell. Rev., vol. 36, no. 3, pp. 205-248, Oct. 2011.
69. H. Ishibuchi and Y. Shibata, "An empirical study on the effect of mating restriction on the search ability of emo algorithms," in Proc. 2nd EMO, 2003, pp. 433-447.
70. K. Deb and R. B. Agrawal, "Simulated binary crossover for continuous search space," Complex Syst., vol. 9, no. 2, pp. 115-148, 1995. (Pubitemid 126034016)
71. L. J. Eshelman and J. D. Schaffer, "Real-coded genetic algorithms and interval-schemata," in Foundation of Genetic Algorithms 2, D. L. Whitley, Ed. San Mateo, CA, USA: Morgan Kaufmann, 1993, pp. 187-202.
72. S. Bandyopadhyay, S. Pal, and B. Aruna, "Multiobjective GAs, quantitative indices, and pattern classification," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 5, pp. 2088-2099, Oct. 2004.
73. T. Suttorp and C. Igel, Multi-Objective Optimization of Support Vector Machines (Multi-Objective Machine Learning Studies in Computational Intelligence, vol. 16). Berlin, Germany: Springer-Verlag, 2006, pp. 199-220.
74. I. Mierswa, "Controlling overfitting with multi-objective support vector machines," in Proc. 9th GECCO, 2007, pp. 1830-1837. (Pubitemid 47291809)
75. M. P. Cúellar, M. Delgado, and M. C. Pegalajar, "Topology optimization and training of recurrent neural networks with Pareto-based multiobjective algorithms: A experimental study," in Proc. 9th IWANN, 2007, pp. 359-366.
76. D. Lahoz and P. Mateo, "Neural network ensembles for classification problems using multiobjective genetic algorithms," in Proc. 18th ICANN, 2008, pp. 443-451.
77. J. M. Pangilinan and G. K. Janssens, "Pareto-optimality of oblique decision trees from evolutionary algorithms," J. Global Optimization, vol. 51, no. 2, pp. 301-311, Oct. 2011.
78. A. H. Wright, "Genetic algorithms for real parameter optimization," in Foundations of Genetic Algorithms, G. J. Rawlins, Ed. San Mateo, CA, USA: Morgan Kaufmann, 1991, pp. 205-218.