Developing new fitness functions in genetic programming for classification with unbalanced data

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 42, Issue 2, 2012, Pages 406-421

  Bhowan, Urvesh ^a   Johnston, Mark ^a   Zhang, Mengjie ^a  

^a VICTORIA UNIVERSITY OF WELLINGTON   (New Zealand)

Author keywords

Classification; fitness function; genetic programming (GP); unbalanced data

Indexed keywords

BINARY CLASSIFICATION; CLASS IMBALANCE; DATA SETS; FITNESS FUNCTIONS; LEARNING PROCESS; TRAINING DATA; TRAINING EXAMPLE; UNBALANCED DATA;

CLASSIFICATION (OF INFORMATION); GENETIC PROGRAMMING; LEARNING ALGORITHMS; LEARNING SYSTEMS;

HEALTH;

EID: 84859001991     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2011.2167144     Document Type: Article

References (64)

1. L. Breiman, J. Friedman, R. Olshen, and C. Stone, Classification and Regression Trees. Monterey, CA: Wadsworth and Brooks, 1984.
2. J. R. Koza, Genetic Programming: On the Programming of Computers by Means of Natural Selection. Cambridge, MA: MIT Press, 1992.
3. J. Eggermont, J. N. Kok, and W. A. Kosters, "Genetic programming for data classification: Partitioning the search space," in Proc. ACM SAC, 2004, pp. 1001-1005.
4. S. Winkler, M. Affenzeller, and S. Wagner, "Advanced genetic programming based machine learning," J. Math. Model. Algorithms, vol. 6, no. 3, pp. 455-480, Sep. 2007.
5. M. Zhang and W. Smart, "Multiclass object classification using genetic programming," in Proc. Appl. Evol. Comput., vol. 3005, LNCS, 2004, pp. 369-378.
6. T. Loveard and V. Ciesielski, "Representing classification problems in genetic programming," in Proc. Congr. Evol. Comput., 2001, vol. 12, pp. 1070-1077.
7. N. V. Chawla, N. Japkowicz, and A. Kolcz, "Editorial: Special Issue on learning from imbalanced data sets," ACM SIGKDD Explor. Newslett., vol. 6, no. 1, pp. 1-6, Jun. 2004.
8. D. Howard, S. Roberts, and R. Brankin, "Target detection of SAR imagery by genetic programming," Adv. Eng. Softw., vol. 30, no. 5, pp. 303-311, May 1999.
9. K.-K. Sung, "Learning and example selection for object and pattern recognition," Ph.D. dissertation, AI Lab. and Center Biol. Comput. Learn.,MIT, Cambridge, MA, 1996.
10. E. Pednault, B. Rosen, and C. Apte, "Handling imbalanced data sets in insurance riskmodeling," in Proc.Workshops 17th Nat. Conf. Artif. Intell., Learn. From Imbalanced Data Sets, 2005, pp. 58-63.
11. D. Song, M. Heywood, and A. Zincir-Heywood, "Training genetic programming on half a million patterns: An example from anomaly detection," IEEE Trans. Evol. Comput., vol. 9, no. 3, pp. 225-239, Jun. 2005.
12. T. Fawcett and F. Provost, "Adaptive fraud detection," Data Mining Knowl. Discov., vol. 1, no. 3, pp. 291-316, Sep. 1997.
13. S. J. Stolfo, D.W. Fan,W. Lee, A. L. Prodromidis, and P. K. Chan, "Credit card fraud detection using meta-learning: Issues and initial results," in Proc. AAAI Workshop AI Approaches Fraud Detection Risk Manage., 1997, pp. 83-90.
14. M. C. Monard and G. Batista, "Learning with skewed class distributions," in Proc. Adv. Logic, Artif. Intell. Robot., 2002, pp. 173-180.
15. R. Barandela, J. S. Sanchez, V. Garcia, and E. Rangel, "Strategies for learning in class imbalance problems," Pattern Recognit., vol. 36, no. 3, pp. 849-851, Mar. 2003.
16. M. Kubat and S. Matwin, "Addressing the curse of imbalanced training sets: One-sided selection," in Proc. 14th Int. Conf. Mach. Learn., 1997, pp. 179-186.
17. L. Breiman, "Bagging predictors," Mach. Learn., vol. 24, no. 2, pp. 123-140, Aug. 1996.
18. A. P. Bradley, "The use of the area under the ROC curve in the evaluation of machine learning algorithms," Pattern Recognit., vol. 30, no. 7, pp. 1145-1159, Jul. 1997.
19. J. Eggermont, A. Eiben, and J. van Hemert, "Adapting the fitness function in GP for data mining," in Proc. 2nd Eur. Workshop Genetic Program., vol. 1598, LNCS, 1999, pp. 193-202.
20. R. Caruana, "Data mining in metric space: An empirical analysis of supervised learning performance criteria," in Proc. ROC Anal. AI Workshop (ECAI), 2004, pp. 69-78.
21. J. H. Holmes, "Differential negative reinforcement improves classifier system learning rate in two-class problems with unequal base rates," in Proc. 3rd Annu. Conf. Genetic Program., J. R. Roza, W. Banzhaf, K. Chellapilla, K. Deb, M. Dorigo, D. B. Fogel, M. H. Garzon, D. E. Goldberg, H. Iba, and R. Riolo, Eds., 1998, pp. 635-644.
22. M. Pazzani, C. Merz, P. Murphy, K. Ali, T. Hume, and C. Brunk, "Reducing misclassification costs," in Proc. 11th Int. Conf. Mach. Learn., 1994, pp. 217-225.
23. H. Gray and R.Maxwell, "Genetic programming for classification of brain tumours from nuclear magnetic resonance biopsy spectra," in Proc. 1st Annu. Conf. Genetic Program., 1996, pp. 424-430.
24. S. M. Winkler, M. Affenzeller, W. Jacak, and H. Stekel, "Classification of tumor marker values using heuristic data mining methods," in Proc. 12th Annu. GECCO, 2010, pp. 1915-1922.
25. S. Mutter, B. Pfahringer, and G. Holmes, "The positive effects of negative information: Extending one-class classification models in binary proteomic sequence classification," in Proc. 22nd Australasian Joint Conf. AI, vol. 5866, LNAI, 2009, pp. 260-269.
26. E. Alfaro-Cid, K. Sharman, and A. Esparcia-Alcazar, "A genetic programming approach for bankruptcy prediction using a highly unbalanced database," in Proc. Appl. Evol. Comput., vol. 4448, LNCS, M. Giacobini, Ed., 2007, pp. 169-178.
27. T. Suttorp and C. Igel, "Multi objective support vector machines," in Multi-Objective Machine Learning, Y. Jin, Ed. New York: Springer-Verlag, 2006, ch. 9, pp. 199-220.
28. J. Doucette and M. I. Heywood, "GP classification under imbalanced data sets: Active sub-sampling and AUC approximation," in Proc. 11th EuroGP, 2008, pp. 266-277.
29. A. Orriols and E. Bernado-Mansilla, "Class imbalance problem in UCS classifier system: Fitness adaptation," in Proc. IEEE Congr. Evol. Comput., Sep. 2005, vol. 1, pp. 604-611.
30. G. M. Weiss and F. Provost, "Learning when training data are costly: The effect of class distribution on tree induction," J. Artif. Intell. Res., vol. 19, pp. 315-354, 2003.
31. N. Japcowicz and S. Stephen, "The class imbalance problem: A systematic study," Intell. Data Anal., vol. 6, no. 5, pp. 429-450, Nov. 2002.
32. R. C. Prati, G. Batista, and M. C. Monard, "Class imbalances versus class overlapping: An analysis of a learning system behavior," in Proc. 3rd Mexican Int. Conf. Artif. Intell.-Advances in Artificial Intelligence, vol. 2972, LNCS, 2004, pp. 312-321.
33. X.-Y. Liu, J. Wu, and Z.-H. Zhou, "Exploratory undersampling for classimbalance learning," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 39, no. 2, pp. 539-550, Apr. 2009.
34. J.-X. Chen, T.-H. Cheng, A. L. F. Chan, and H.-Y. Wang, "An application of classification analysis for skewed class distribution in therapeutic drug monitoring-The case of vancomycin," in Proc. IDEAS Workshop Med. Inf. Syst.: Digital Hospital, 2004, pp. 35-39.
35. K. McCarthy, B. Zabar, and G. Weiss, "Does cost-sensitive learning beat sampling for classifying rare classes," in Proc. 1st Int. Workshop Utility-Based Data Mining, 2005, pp. 69-77.
36. G. Batista, R. C. Prati, and M. C. Monard, "Balancing strategies and class overlapping," in Proc. 6th Int. Symp. IDA-Advances in Intelligent Data Analysis VI, vol. 3646, LNCS, A. F. Famili, J. N. Kok, J. M. Peña, A. Siebes, and A. J. Feelders, Eds., 2005, pp. 24-35.
37. R. Alejo, V. Garcia, J. M. Sotoca, R. Mollineda, and J. S. Sanchez, "Improving the classification accuracy of RBF and MLP neural networks trained with imbalanced samples," in Proc. 7th Int. Conf. IDEAL, Sep. 2006, pp. 467-471.
38. J. V. Hulse, T. M. Khoshgoftaar, and A. Napolitano, "Experiment perspectives in learning from imbalanced data," in Proc. 24th Int. Conf. Mach. Learn., 2007, pp. 435-492.
39. R. Curry, P. Lichodzijewski, and M. Heywood, "Scaling genetic programming to large datasets using hierarchical dynamic subset selection," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 37, no. 4, pp. 1065-1073, Aug. 2007.
40. C. Gathercole and P. Ross, "Dynamic training subset selection for supervised learning in genetic programming," in Proc. PPSN III, vol. 866, LNCS, Y. Davidor, H.-P. Schwefel, and R. Manner, Eds., 1994, pp. 312-321.
41. V. Nikulin, G. McLachlan, and S. K. Ng, "Ensemble approach for the classification of imbalanced data," in Proc. 22nd Australasian Joint Conf. AI, vol. 5866, LNAI, 2009, pp. 260-269.
42. Y. Tang, Y.-Q. Zhang, N. Chawla, and S. Krasser, "SVM modeling for highly imbalanced classification," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 39, no. 1, pp. 281-288, Feb. 2009.
43. S. Lawrence, I. Burns, A. D. Back, A. C. Tsoi, and L. C. Giles, "Neural network classification and prior class probabilities," in Neural Networks: Tricks of the Trade. New York: Springer-Verlag, 1998, pp. 299-313.
44. J. A. Hanley and B. J. McNeil, "The meaning and use of the area under a receiver operating characteristic (ROC) curve," Radiology, vol. 143, no. 1, pp. 29-36, Apr. 1982.
45. S. Rosset, "Model selection via the AUC," in Proc. 21st Int. Conf. Mach. Learn., Banff, AB, Canada, 2004, pp. 89-97.
46. J. Huang and C. X. Ling, "Constructing new and better evaluation measures for machine learning," in Proc. 20th IJCAI, 2007, pp. 859-864.
47. L. Yan, R. Dodier, M. C. Mozer, and R. Wolniewicz, "Optimizing classifier performance via the Wilcoxon-Mann-Whitney statistic," in Proc. 20th ICML, 2003, pp. 848-855.
48. C. Ferri, J. Hernández-Orallo, and R. Modroiu, "An experimental comparison of performance measures for classification," Pattern Recognit. Lett., vol. 30, no. 1, pp. 27-38, Jan. 2009.
49. G. Patterson and M. Zhang, "Fitness functions in genetic programming for classification with unbalanced data," in Proc. 20th Australian Joint Conf. Artif. Intell., vol. 4830, LNCS, 2007, pp. 769-775.
50. A. Asuncion and D. Newman, UCI Machine Learning Repository, Irvine, CA. [Online]. Available: http://www.ics.uci.edu/~mlearn/MLRepository. html
51. U. Bhowan, M. Zhang, and M. Johnston, "Evolving ensembles in multiobjective genetic programming for classification with unbalanced data," in Proc. Genetic Evol. Comput. Conf., 2011, pp. 1331-1339.
52. A. McIntyre and M. Heywood, "Multi-objective competitive coevolution for efficient GP classifier problem decomposition," in Proc. IEEE Int. Conf. Syst., Man, Cybern., 2007, pp. 1930-1937.
53. S. Munder and D. Gavrila, "An experimental study on pedestrian classification," IEEE Trans. Pattern Anal.Mach. Intell., vol. 28, no. 11, pp. 1863-1868, Nov. 2006.
54. M. Zhang and W. Smart, "Using Gaussian distribution to construct fitness functions in genetic programming for multiclass object classification," Pattern Recognit. Lett., vol. 27, no. 11, pp. 1266-1274, Aug. 2006.
55. U. Bhowan, M. Johnston, and M. Zhang, "A comparison of classification strategies in genetic programming with unbalanced data," in Proc. 23rd Australasian Joint Conf. Artif. Intell., vol. 6464, LNCS, J. Li, Ed., 2010, pp. 243-252.
56. U. Bhowan, M. Johnston, and M. Zhang, "Differentiating between individual class performance in genetic programming fitness for classification with unbalanced data," in Proc. IEEE CEC, 2009, pp. 2802-2809.
57. S. M. Winkler, M. Affenzeller, and S. Wagner, "Using enhanced genetic programming techniques for evolving classifiers in the context of medical diagnosis," Genetic Program. Evolvable Mach., vol. 10, no. 2, pp. 111-140, Jun. 2009.
58. W. B. Langdon and B. Buxton, "Genetic programming for improved receiver operating characteristics," in Proc. Multiple Classifier Syst., vol. 2096, LNCS, J. Kittler and F. Roli, Eds., 2001, pp. 68-77.
59. G. Weiss and F. Provost, "The effect of class distribution on classifier learning: An empirical study," Dept. Comput. Sci., Rutgers Univ., New Brunswick, NJ, Tech. Rep. ML-TR-44, 2001.
60. F. Provost and P. Domingos, "Tree induction for probability-based rankings," Mach. Learn., vol. 52, no. 3, pp. 199-215, Sep. 2003.
61. I. H.Witten and E. Frank, Data Mining: PracticalMachine Learning Tools and Techniques, 2nd ed. San Mateo, CA: Morgan Kaufmann, Jun. 2005.
62. R. A. Fisher, Statistical Methods for Research Workers, 14th ed. Edinburgh, U.K.: Oliver & Boyd, 1970.
63. D. C. Hoaglin, F. Mosteller, and J. W. Tukey, Fundamentals of Exploratory Analysis of Variance. Hoboken, NJ: Wiley, 1991.
64. J. W. Tukey, "Components in regression," Biometrics, vol. 7, no. 1, pp. 33-69, Mar. 1951.