Solution over-fit control in evolutionary multiobjective optimization of pattern classification systems

International Journal of Pattern Recognition and Artificial Intelligence

Volumn 23, Issue 6, 2009, Pages 1107-1127

  Radtke, Paulo V W ^a,b   Wong, Tony ^a   Sabourin, Robert ^a  

^a ÉCOLE DE TECHNOLOGIE SUPÉRIEURE   (Canada)

^b FEDERAL UNIVERSITY OF PARANÁ   (Brazil)

Author keywords

Classifier design; Feature selection; Multiobjective optimization; Over fit control; Pattern classification system

Indexed keywords

CANDIDATE SOLUTION; CLASSIFICATION SYSTEM; CLASSIFIER DESIGN; CONTROL STRATEGIES; DATA SETS; DOMINANCE RELATION; ENGINEERING SYSTEMS; EVOLUTIONARY MULTIOBJECTIVE OPTIMIZATION; EVOLUTIONARY PROCESS; EXPERIMENTAL ANALYSIS; FEATURE SELECTION; GENERALIZATION ABILITY; MEMETIC ALGORITHMS; MULTI OBJECTIVE; MULTIOBJECTIVE EVOLUTIONARY OPTIMIZATION; OVER-FIT CONTROL; PATTERN CLASSIFICATION; PATTERN CLASSIFICATION SYSTEM; PATTERN CLASSIFIER; POTENTIAL SOLUTIONS;

CLASSIFIERS; GENETIC ENGINEERING; LEARNING SYSTEMS; PATTERN RECOGNITION SYSTEMS;

MULTIOBJECTIVE OPTIMIZATION;

EID: 70349274353     PISSN: 02180014     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0218001409007466     Document Type: Article

References (32)

1. S. Bandyopadhyay, S. K. Pal and B. Aruna, Multiobjective GAs, quantitative indices, and pattern classification, IEEE Trans. Syst. Man, Cybern. - Part B: Cybern. 34(5) (2004) 2088-2099.
2. E. Bernad́o i Mansilla, X. Llor̀a and I. Traus, Multiobjective learning classifier systems, Studies in Comput. Intell. 16 (2006) 1261-1288.
3. R. O. Day and G. B. Lamont, Extended multi-objective fast messy genetic algorithm solving deception problems, Proc. Third Int. Conf. Evolutionary Multi-Criterion Optimization (EMO 2005), (2005), pp. 296-310.
4. K. Deb, S. Agrawal, A. Pratab and T. Meyarivan, A fast elitist non-dominated sorting genetic algorithm for multi-objective optimization: NSGA-II, Proc. Parallel Problem Solving from Nature VI Conf. (2000), pp. 849-858.
5. K. Deb, Multi-Objective Optimization using Evolutionary Algorithms (John Wiley, 2001).
6. T. G. Dietterich, Ensemble learning, The Handbook of Brain Theory and Neural Networks, 2nd Edition, ed. M. A. Arbib (MIT Press, 2002).
7. A. E. Eiben, R. Hinterdind and Z. Michalewicz, Parameter control in evolutionary algorithms, IEEE Trans. Evolut. Comput. 3(2) (1999) 124-141.
8. C. Emmanouilidis, A. Hunter and J. MacIntyre, A multiobjective evolutionary setting for feature selection and a commonality-based crossover operator, Proc. 2000 Congress on Evolutionary Computation (2000), pp. 309-316.
9. P. J. Grother, NIST Special Database 19 - Handprinted forms and characters database, National Institute of Standards and Technoloy - NIST (Database CD documentation) (1995).
10. T. K. Ho, Nearest neighbors in random subspaces, Proc. 2nd Int. Workshop on Statistical Techniques in Pattern Recognition (1998), pp. 640-648.
11. A. Jaszkiewicz, Do multiple-objective metaheuristics deliver on their promise? A computational experiment on the set-covering problem," IEEE Trans. Evolut. Comput. 7 (2) (2003) 133-143.
12. F. Kimura, K. Takashina, S. Tsuruoka and Y. Miyake, Modified quadratic discrim-inant functions and the application to Chinese character recognition, IEEE Trans. Patt. Anal. Mach. Intell. 9(1) (1987) 149-152.
13. F. Kimura, S. Inoue, T. Wakabayashi, S. Tsuruoka and Y. Miyake, Handwritten numeral recognition using autoassociative neural networks, Proc. Int. Conf. Pattern Recognition (1998), pp. 152-155.
14. J. Kittler, M. Hatef, R. P. W. Duin and J. Matas, On combining classifiers, IEEE Trans. Patt. Anal. Mach. Intell. 20(3) (1998) 226-239.
15. J. D. Knowles and D. Corne, Memetic algorithms for multiobjective optimization: issues, methods and prospects, Recent Advances in Memetic Algorithms, eds. N. Krasnogor, J. E. Smith and W. E. Hart (Springer Verlag, 2004), pp. 313-352.
16. J. B. Kollat and P. M. Reed, The value of online adaptative search: a performance comparison of NSGA-II, e-NSGA-II and e-MOEA, Proc. Third Int. Conf. Evolutionary Multi-Criterion Optimization (EMO 2005) (2005), pp. 296-310.
17. N. Krasnogor and J. Smith, A tutorial for competent memetic algorithms: model, taxonomy, and design issues, IEEE Trans. Evolut. Comput. 9(5) (2005) 474-488.
18. M. Kudo and J. Sklansky, Comparison of algorithms that select features for pattern classifiers, Patt. Recogn. 33(1) (2000) 25-41.
19. L. I. Kuncheva and L. C. Jain, Design classifier fusion systems by genetic algorithms, IEEE Trans. Evolut. Comput. 4(4) (2000) 327-336.
20. V. di Lecce, G. Dimauro, A. Guerriero, S. Impedovo, G. Pirlo and A. Salzo, Zoning design for hand-written numeral recognition, Proc. Seventh Int. Workshop on Frontiers in Handwriting Recognition - IWFHR-7 (2000), pp. 583-588.
21. X. Llor̀a, D. E. Goldberg, I. Traus and E. Bernad́o i Mansilla, Accuracy, parsimony, and generality in evolutionary learning systems via multiobjective selection, Int. Workshop in Learning Classifier Systems (2002), pp. 118-142.
22. J. Loughrey and P. Cunningham, Overfitting in wrapper-based feature subset selection: the harder you try the worse it gets, Proc. Int. Conf. Innovative Techniques and Applications of Artificial Intelligence (2004), pp. 33-43.
23. J. Loughrey and P. Cunningham, "Using early-stopping to avoid overfitting in wrapper-based feature subset selection employing stochastic search, TCD-CS-2005-2037 , Department of Computer Science, Trinity College (2005).
24. L. S. Oliveira, N. Benahmed, R. Sabourin, F. Bortolozzi and C. Y. Suen, Feature subset selection using genetic algorithms for handwritten digit recognition, Proc. 14th Brazilian Symp. Computer Graphics and Image Processing (2001), pp. 362-369.
25. L. S. Oliveira, R. Sabourin, F. Bortolozzi and C. Y. Suen, A methodology for feature selection using multi-objective genetic algorithms for handwritten digit string recognition," Int. J. Patt. Recogn. Artif. Intell. 17(6) (2003).
26. G. L. Pappa, A. A. Freitas and C. A. A. Kaestner, Multi-objective algorithms for attribute selection in data mining, Applications of Multi-Objective Evolutionary Algorithms, eds. C. A. Coello Coello and G. B. Lamont (World Scientific, 2004), pp. 603-626.
27. J. Reunanen, Overfitting in making comparisons between variable selection methods, J. Mach. Learn. Res. 3 (2003) 1371-1382.
28. D. Ruta and B. Gabrys, Classifier selection for majority voting, Inform. Fus. 6 (2005) 63-81.
29. P. V. W. Radtke, T. Wong and R. Sabourin, A multi-objective memetic algorithm for intelligent feature extraction, Proc. Third Int. Conf. Evolutionary Multi-Criterion Optimization (2005), pp. 767-781. (Pubitemid 41251804)
30. P. V.W. Radtke, R. Sabourin and T.Wong, Intelligent feature extraction for ensemble of classifiers, Proc. 8th Int. Conf. Document Analysis and Recognition (ICDAR 2005) (2005), pp. 866-870. (Pubitemid 46442448)
31. P. V. W. Radtke, Classification systems optimization with multi-objective evolutionary algorithms, Ph.D. dissertation, ́Ecole de technologie suṕerieure - ́ETS - Universit́e du Qúebec, Montŕeal, Qúebec, Canada (2006).
32. F. Schlotmann, A. Mitschele and D. Seese, A multi-objective approach to integrated risk management, Proc. Third Int. Conf. Evolutionary Multi-Criterion Optimization, (2005), pp. 692-706.