Multi-objective evolutionary optimization for generating ensembles of classifiers in the ROC space

GECCO'12 - Proceedings of the 14th International Conference on Genetic and Evolutionary Computation

Volumn , Issue , 2012, Pages 879-886

  Lévesque, Julien Charles ^a   Durand, Audrey ^a   Gagné, Christian ^a   Sabourin, Robert ^b  

^a UNIVERSITÉ LAVAL   (Canada)

^b ÉCOLE DE TECHNOLOGIE SUPÉRIEURE   (Canada)

Author keywords

ensembles of classifiers; genetic programming; machine learning; multi objective evolutionary algorithms; roc curve

Indexed keywords

BOOLEAN COMBINATIONS; CLASSIFIER ENSEMBLES; DECISION LEVELS; ENSEMBLES OF CLASSIFIERS; EVOLUTIONARY OPTIMIZATIONS; MULTI OBJECTIVE; MULTI OBJECTIVE EVOLUTIONARY ALGORITHMS; MULTI OBJECTIVE OPTIMIZATIONS (MOO); NSGA-II; OPERATING CONDITION; ROC CURVES;

EVOLUTIONARY ALGORITHMS; GENETIC PROGRAMMING; LEARNING SYSTEMS; MULTIOBJECTIVE OPTIMIZATION;

CURVE FITTING;

EID: 84864702496     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2330163.2330285     Document Type: Conference Paper

References (26)

1. U. Bhowan, M. Johnston, and M. Zhang. Evolving ensembles in multi-objective genetic programming for classification with unbalanced data. In Proceedings of the 13th annual conference on Genetic and evolutionary computation (GECCO), pages 1331-1338. ACM, 2011.
2. U. Bhowan, M. Zhang, and M. Johnston. AUC analysis of the pareto-front using multi-objective GP for classification with unbalanced data. In Proceedings of the 12th annual conference on Genetic and evolutionary computation (GECCO), pages 845-852. ACM, 2010.
3. H. Boström. Maximizing the area under the ROC curve using incremental reduced error pruning. In Proceedings of the International Conference on Machine Learning 2005 workshop on ROC analysis in machine learning, 2005.
4. C. Chatelain, S. Adam, Y. Lecourtier, L. Heutte, and T. Paquet. A multi-model selection framework for unknown and/or evolutive misclassification cost problems. Pattern Recognition, 43(3):815-823, 2010.
5. C. Cortes and M. Mohri. AUC optimization vs. error rate minimization. Advances in Neural Information Processing Systems (NIPS), 16:313-320, 2004.
6. F.-M. De Rainville, F.-A. Fortin, M.-A. Gardner, M. Parizeau, and C. Gagné. Distributed Evolutionary Algorithms in Python (DEAP). http://deap.googlecode.com.
7. K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation, 6(2):182-197, 2002.
8. E. M. Dos Santos, R. Sabourin, and P. Maupin. Overfitting cautious selection of classifier ensembles with genetic algorithms. Information Fusion, 10(2):150-162, Apr. 2009.
9. R. M. Everson and J. E. Fieldsend. Multi-class ROC analysis from a multi-objective optimisation perspective. Pattern Recognition Letters, 27(8):918-927, June 2006.
10. T. Fawcett. An introduction to ROC analysis. Pattern Recognition Letters, 27(8):861-874, June 2006.
11. C. Ferri, P. Flach, and J. Hernández-Orallo. Learning decision trees using the area under the ROC curve. In Proceedings of the International Conference on Machine Learning (ICML), pages 139-146, 2002.
12. A. Frank and A. Asuncion. UCI Machine Learning Repository. http://archive.ics.uci.edu/ml, 2010.
13. S. Gao, C. Lee, and J. Lim. An ensemble classifier learning approach to ROC optimization. In Proceedings of the 18th International Conference on Pattern Recognition (ICPR), volume 2, pages 679-682. IEEE, 2006.
14. E. Granger, W. Khreich, R. Sabourin, and D. Gorodnichy. Fusion Of Biometric Systems Using Boolean Combination: An Application to Iris-Based Authentification. International Journal of Biometrics (IJBM), 2011.
15. T. Ho. The random subspace method for constructing decision forests. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(8):832-844, 1998.
16. W. Khreich, E. Granger, A. Miri, and R. Sabourin. Iterative Boolean combination of classifiers in the ROC space: An application to anomaly detection with HMMs. Pattern Recognition, 43(8):2732-2752, 2010.
17. W. Khreich, E. Granger, A. Miri, and R. Sabourin. Adaptive ROC-based ensembles of HMMs applied to anomaly detection. Pattern Recognition, 45:208-230, July 2012.
18. A. Kumar, V. Kanhangad, and D. Zhang. A new framework for adaptive multimodal biometrics management. IEEE Transactions on Information Forensics and Security, 5(1):92-102, 2010.
19. L. Kuncheva. Combining pattern classifiers: methods and algorithms. Wiler-Interscience, 2004.
20. C. Marrocco, M. Molinara, and F. Tortorella. On linear combinations of dichotomizers for maximizing the area under the ROC curve. IEEE Transactions on Systems, Man, and Cybernetics. Part B: Cybernetics, 41(3):610-20, June 2011.
21. F. Provost and T. Fawcett. Robust classification for imprecise environments. Machine Learning, 42(3):203-231, 2001.
22. A. Rakotomamonjy. Optimizing AUC with support vector machine. In Proceedings of the European Conference on Artificial Intelligence Workshop on ROC Curve and AI, 2004.
23. M. Sebag, J. Azé, and N. Lucas. ROC-based evolutionary learning: Application to medical data mining. In Artificial Evolution, pages 384-396. Springer, 2004.
24. Q. Tao and R. Veldhuis. Threshold-optimized decision-level fusion and its application to biometrics. Pattern Recognition, 42(5):823-836, 2009.
25. S. Wu and P. Flach. A scored AUC metric for classifier evaluation and selection. In Proceedings of the International Conference on Machine Learning 2005 workshop on ROC analysis in machine learning, 2005.
26. E. Zitzler, M. Laumanns, and L. Thiele. SPEA2: Improving the strength Pareto evolutionary algorithm. In Proceedings of the EUROGEN 2001. Evolutionary Methods for Design, Optimization and Control With Applications to Industrial Problems, 2001.