Decision tree classifiers sensitive to heterogeneous costs

Journal of Systems and Software

Volumn 85, Issue 4, 2012, Pages 771-779

  Zhang, Shichao ^a,b  

^a GUANGXI NORMAL UNIVERSITY   (China)

^b INSTITUTE OF COMPUTING TECHNOLOGY   (China)

Author keywords

Cost sensitive learning; Decision tree classification; Heterogeneous attributes; Heterogeneous costs; Split attribute selection

Indexed keywords

ATTRIBUTE INFORMATION; ATTRIBUTE SELECTION; COST-SENSITIVE; COST-SENSITIVE LEARNING; DATA SETS; DECISION TREE CLASSIFICATION; DECISION TREE CLASSIFIERS; HETEROGENEOUS ATTRIBUTES; OVERFITTING; TRANSFORMATION FUNCTIONS;

DATA PROCESSING; DECISION TREES; LEARNING ALGORITHMS;

COSTS;

EID: 84857357329     PISSN: 01641212     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jss.2011.10.007     Document Type: Article

References (52)

1. N. Abe, B. Zadrozny, and J. Langford An iterative method for multi-class cost-sensitive learning Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 2004 3 11 (Pubitemid 40114910)
2. A.S. Abrahams, A. Becker, D. Fleder, and I.C. MacMillan Handling generalized cost functions in the partitioning optimization problem through sequential binary programming Proceedings of the 5th IEEE International Conference on Data Mining 2005 3 9 (Pubitemid 47385670)
3. C.L. Blake, and C.J. Merz UCI Repository of Machine Learning Databases 1998 (http://www.ics.uci.edu/∼mlearn/MLRepository.html)
4. J.P. Bradford, C. Kunz, R. Kohavi, C. Brunk, and C.E. Brodley In pruning decision trees with misclassification costs Proceedings of 10th European Conference on Machine Learning 1998 131 136 (Pubitemid 128067177)
5. L. Breiman, J. Friedman, R. Olshen, and C. Stone Classification and Regression Trees 1984 Wadsworth International Group
6. N.V. Chawla C4.5 and imbalanced data sets: investigating the effect of sampling method, probabilistic estimate, and decision tree structure Workshop on Learning from Imbalanced Data Sets II 2003
7. J.V. Davis, J. Ha, C.J. Rossbach, H.E. Ramadan, and E. Witchel Cost-sensitive decision tree learning for forensic classification Proceedings of the 17th European Conference on Machine Learning (ECML) 2006 622 629 (Pubitemid 44618870)
8. P. Domingos MetaCost: a general method for making classifiers cost-sensitive Knowledge Discovery and Data Mining 1999 155 164
9. C. Drummond, and R.C. Holte C4 why under-sampling beats over-sampling Workshop on Learning from Imbalanced Data Sets II 5, Class Imbalance, and Cost Sensitivity 2003
10. Du, J.; Cai, Z.; Ling, C.X.; 2007. Cost-sensitive decision trees with pre-pruning. Advances in Artificial Intelligence, Lecture Notes in Computer Science, vol. 4509/2007, pp. 171-179. (Pubitemid 350269926)
11. C. Elkan The foundations of cost-sensitive learning Proceeding of the Seventeenth International Joint Conference of Artificial Intelligence Morgan Kaufmann, Seattle, August 4-10, 2001 2001 973 978
12. W. Fan, S.J. Stolfo, J. Zhang, and P.K. Chan AdaCost: misclassification cost-sensitive boosting Proceedings of the Sixteenth International Conference on Machine Learning 1999 97 105
13. U.M. Fayyad, and K.B. Irani Multi-interval discretization of continuous-valued attributes for classification learning Proceedings of the 13th International Joint Conference on Artificial Intelligence 1993 1022 1027
14. A. Freitas, A. Costa-Pereira, and P. Brazdil Cost-sensitive decision trees applied to medical data Proceedings of DaWak-2007, LNCS 4654 2007 303 312
15. J. Gama A cost-sensitive iterative Bayes Workshop on Cost-Sensitive Learning at the Seventeenth International Conference on Machine Learning (WCSL at ICML-2000) 2000
16. N. Japkowicz The class imbalance problem: significance and strategies Proceedings of the 2000 International Conference on Artificial Intelligence (ICAI'2000) 2000 111 117
17. M. Kubat, and S. Matwin Addressing the curse of imbalanced training sets: one-sided selection Proceedings of the Fourteenth International Conference on Machine Learning 1997 179 186
18. M. Kukar, and I. Kononenko Cost-sensitive learning with neural networks Proceedings of the 13th European Conference on Artificial Intelligence (ECAI-98) 1998 445 449
19. C.X. Ling Decision trees with minimal costs Proceedings of 21st International Conference on Machine Learning Banff, Alberta, Canada, July 4-8, 2004 2004
20. C.X. Ling, S. Sheng, and Q. Yang Test strategies for cost-sensitive decision trees IEEE Transactions on Knowledge and Data Engineering 18 8 2006 1055 1067 (Pubitemid 44109535)
21. M. Maloof Learning when data sets are imbalanced and when costs are unequal and unknown Proceedings of the ICML'03 Workshop on Learning from Imbalanced Data Sets 2003 2003
22. H. Masnadi-Shirazi, and N. Vasconcelos Asymmetric boosting Proceedings of the 24th International Conference on Machine Learning 2007 609 619 (Pubitemid 47275116)
23. M. Mehta, R. Agrawal, and J. Rissanen MDL-based decision tree pruning Proceedings of the International Conference on Knowledge Discovery in Databases and Data Mining (KDD-95) Montreal, Canada 1995
24. T.M. Mitchell Machine Learning 1997 McGraw Hill
25. A.L. Ni, X.F. Zhu, and C.Q. Zhang Any-cost discovery: learning optimal classification rules Proceedings of the 18th Australian Joint Conference on Artificial Intelligence (AI 2005) 2005 123 132
26. S.W. Norton Generating better decision trees Proceedings of the Eleventh International Conference on Artificial Intelligence 1989 800 805
27. M. Nunez The use of background knowledge in decision tree induction Machine Learning 6 1991 231 250 (Pubitemid 21737707)
28. M. Pazzani, C. Merz, P. Murphy, K. Ali, T. Hume, and C. Brunk Reducing misclassification costs Proceedings of the Eleventh International Conference on Machine Learning 1994 217 225
29. Provost, F.; Domingos, P.; 2000. Well-trained PETs: improving probability estimation trees. CDER Working Paper #00-04-IS, Stern School of Business, New York University, NY, NY 10012.
30. Y.S. Qin Semi-parametric optimization for missing data imputation Applied Intelligence 27 1 2007 79 88
31. Z.X. Qin, C.Q. Zhang, and S.C. Zhang In cost-sensitive decision trees with multiple cost scales Proceedings of the 17th Australian Joint Conference on Artificial Intelligence (AI 2004) Cairns, Queensland, Australia, December 6-10, 2004 2004
32. Z.X. Qin, C.Q. Zhang, X. Xie, and S.C. Zhang Dynamic test-sensitive decision trees with multiple cost scales Proceedings of FSKD 2005 2005 402 405 (Pubitemid 41480280)
33. Z.X. Qin, C.Q. Zhang, and S.C. Zhang Missing or absent? A question in cost-sensitive decision tree Proceedings of the Fourth International Conference on Active Media Technology (AMT006), June 2006
34. J.R. Quinlan Unknown attribute values in induction Proceedings of the Sixth International Workshop on Machine Learning 1989 164 168
35. J.R. Quinlan C4.5: Programs for Machine Learning 1993 Morgan Kaufmann Publishers
36. V.S. Sheng, and C.X. Ling Feature value acquisition in testing: a sequential batch test algorithm ICML 2006 2006 809 816
37. V.S. Sheng, C.X. Ling, A.L. Ni, and S.C. Zhang Cost-sensitive test strategies Proceedings of the Twenty-first National Conference on Artificial Intelligence (AAAI-06) 2006
38. M. Tan, and J. Schimmer Cost-sensitive concept learning of sensor use in approach and recognition Proceedings of the 6th International Workshop on Machine Learning Ithaca, New York 1989 392 395
39. M. Tan Cost-sensitive learning of classification knowledge and its applications in robotics Machine Learning 13 1993 7 33
40. K.M. Ting An instance-weighting method to induce cost-sensitive trees IEEE Transactions on Knowledge and Data Engineering 14 3 2002 659 665 (Pubitemid 34669622)
41. K. Ting, and Z. Zheng Boosting Trees for Cost-Sensitive Classifications Machine Learning: ECML-98: 10th European Conf on Machine Learning 1998 190 195 (Pubitemid 128067184)
42. P.D. Turney Cost-sensitive classification: empirical evaluation of a hybrid genetic decision tree induction algorithm Journal of Artificial Intelligence Research 2 1995 369 409
43. P.D. Turney Types of cost in inductive concept learning Workshop on Cost-Sensitive Learning at the Seventeenth International Conference on Machine Learning Stanford University, California 2000
44. T. Wang, Z.X. Qin, Z. Jin, and S.C. Zhang Handling over-fitting in test cost-sensitive decision tree learning by feature selection, smoothing and pruning Journal of Systems and Software 83 2010 1137 1147
45. B. Zadrozny, and C. Elkan Obtaining calibrated probability estimates from decision trees and naive Bayesian classifiers Proceedings of the 18th International Conference on Machine Learning 2001 609 616
46. B. Zadrozny, and C. Elkan Learning and making decisions when costs and probabilities are both unknown Proceedings of the seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining ACM Press, San Francisco, CA 2001 204 213
47. B. Zadrozny, J. Langford, and N. Abe Cost-sensitive learning by cost-proportionate example weighting Third IEEE International Conference on Data Mining (ICDM 2003) 2003 435 442
48. S.C. Zhang Cost-sensitive classification with respect to waiting cost Knowledge-Based Systems 23 2010 369 378
49. S.C. Zhang KNN-CF approach: incorporating certainty factor to kNN classification IEEE Intelligent Informatics Bulletin 11 1 2010 25 34
50. S.C. Zhang, Z. Jin, and X.F. Zhu Missing Data Imputation by Utilizing Information within Incomplete Instances Journal of Systems & Software 84 2011 452 459
51. S.C. Zhang, L. Liu, X.F. Zhu, and C. Zhang A strategy for attributes selection in cost-sensitive decision trees induction IEEE 8th International Conference on Computer and Information Technology 2008 8 13
52. S.C. Zhang, Z.X. Qin, C.X. Ling, and S.L. Sheng Missing is useful: missing values in cost-sensitive decision trees IEEE Transactions on Knowledge and Data Engineering 17 12 2005 1689 1693 (Pubitemid 43060418)