A weighted rough set based method developed for class imbalance learning

Information Sciences

Volumn 178, Issue 4, 2008, Pages 1235-1256

  Liu, Jinfu ^a   Hu, Qinghua ^a   Yu, Daren ^a  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

Author keywords

Class imbalance learning; Rough sets; Rule extraction; Sample weighting; Weighted entropy

Indexed keywords

ALGORITHMS; DECISION MAKING; PROBLEM SOLVING; SUPPORT VECTOR MACHINES; SYSTEMS ANALYSIS;

CLASS IMBALANCE LEARNING; SAMPLE WEIGHTING; WEIGHTED ENTROPY;

SET THEORY;

EID: 36549024482     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2007.10.002     Document Type: Article

References (61)

1. Batista G., Prati R.C., and Monard M.C. A study of the behavior of several methods for balancing machine learning training data. SIGKDD Explorations 6 1 (2004) 20-29
2. Bazan J. A comparison of dynamic and non-dynamic rough set methods for extracting laws from decision tables. In: Polkowski L., and Skowron A. (Eds). Rough Sets in Knowledge Discovery (1998), Phisica-Verlag, Heidelberg 321-365
3. Beynon M. Reducts within the variable precision rough sets model: a further investigation. European Journal of Operational Research 134 (2001) 592-605
4. C. Blake, E. Keogh, C.J. Merz, UCI Repository of Machine Learning Databases, Dept. of Information and Computer Science, Univ. of California, Irvine, 1998. Available from: .
5. U. Brefeld, P. Geibel, F. Wysotzki, Support vector machines with example dependent costs, in: N. Lavrac, D. Gamberger, L. Todorovski, H. Blockeel (Eds.), Proc. 14th European Conf. Machine Learning, ECML'03, Cavtat, Croatia, 2003, pp. 23-34.
6. N. Chawla, N. Japkowicz, A. Kolcz (Eds.), Proc. ICML'03 Workshop on Learning from Imbalanced Data Sets (II), Washington DC, USA, 2003. Available from: .
7. In: Chawla N., Japkowicz N., and Kolcz A. (Eds). Special Issues on Learning from Imbalanced Data Sets. SIGKDD Explorations 6 1 (2004) 1-6
8. Cristianini N., and Shawe-Taylor J. An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods (2000), Cambridge University Press, Cambridge
9. C. Drummond, R.C. Holte, C4.5, class imbalance, and cost sensitivity: why under-sampling beats over-sampling, in: N. Chawla, N. Japkowicz, A. Kolcz (Eds.), Proc. ICML'03 Workshop on Learning from Imbalanced Data Sets (II), Washington DC, USA, 2003. Available from: .
10. Duntsch I., and Gediga G. Uncertainty measures of rough set prediction. Artificial Intelligence 106 1 (1998) 109-137
11. Fawcett R.E., and Provost F. Adaptive fraud detection. Data Mining and Knowledge Discovery 3 1 (1997) 291-316
12. Fawcett T. An introduction to ROC analysis. Pattern Recognition Letters 27 (2006) 861-874
13. U.M. Fayyad, K.B. Irani, Multi-interval discretization of continuous-valued attributes for classification learning, in: R. Bajcsy (Eds.), Proc. 13th Int. Joint Conf. Artificial Intelligence, IJCAI'93, Chambery, France, 1993, pp. 1022-1027.
14. Greco S., Matarazzo B., and Slowinski R. Rough set theory for multicriteria decision analysis. European Journal of Operational Research 129 (2001) 1-47
15. Guiasu S. Information Theory with Applications (1977), McGraw-Hill, International Book Company, New York
16. Grzymala-Busse J.W. LERS - a system for learning from examples based on rough sets. In: Slowinski R. (Ed). Intelligent Decision Support: Handbook of Applications and Advances of the Rough Sets Theory (1992), Kluwer Academic Publishers, Dordrecht 3-18
17. Hand D.J. Construction and Assessment of Classification Rules (1997), John Wiley and Sons, New York
18. Hand D.J., and Till R.J. A simple generalization of the area under the ROC curve to multiple class classification problems. Machine Learning 45 2 (2001) 171-186
19. Hu X.-H., and Cercone N. Data mining via discretization, generalization and rough set feature selection. Knowledge and Information Systems 1 1 (1999) 33-60
20. Hu Q.-H., Li X.-D., and Yu D.-R. Analysis on classification performance of rough set based reducts. In: Yang Q., and Webb G. (Eds). Proc. 9th Pacific Rim Int. Conf. Artificial Intelligence, PRICAI'06, LNAI 4099 (2006), Springer-Verlag, Heidelberg 423-433
21. Hu Q.-H., and Yu D.-R. Entropies of fuzzy indiscernibility relation and its operations. International Journal of Uncertainty Fuzziness and Knowledge-Based Systems 12 5 (2004) 575-589
22. Hu Q.-H., Yu D.-R., and Xie Z.-X. Information-preserving hybrid data reduction based on fuzzy-rough techniques. Pattern Recognition Letters 27 5 (2006) 414-423
23. Hu Q.-H., Yu D.-R., Xie Z.-X., and Liu J.-F. Fuzzy probabilistic approximation spaces and their information measures. IEEE Transactions on Fuzzy Systems 14 2 (2006) 191-201
24. N. Japkowicz, Learning from imbalanced data sets: a comparison of various strategies, in: N. Japkowicz (Eds.), Proc. AAAI'00 Workshop on Learning from Imbalanced Data Sets, Technical Report WS-00-05, AAAI Press, Menlo Park, CA, 2000, pp. 10-15.
25. N. Japkowicz (Eds.), Proc. AAAI'00 Workshop on Learning from Imbalanced Data Sets, Technical Report WS-00-05, AAAI Press, Menlo Park, CA, 2000.
26. Japkowicz N., and Stephen S. The class imbalance problem: A systematic study. Intelligent Data Analysis 6 5 (2002) 429-450
27. Kryszkiewicz M. Rules in incomplete information systems. Information Sciences 113 3-4 (1999) 271-292
28. Kryszkiewicz M. Comparative study of alternative type of knowledge reduction in inconsistent systems. International Journal of Intelligent Systems 16 (2001) 105-120
29. Liang J.Y., and Xu Z.B. The algorithm on knowledge reduction in incomplete information systems. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems 10 (2002) 95-103
30. Liu H., Hussain F., Tan C.L., and Dash M. Discretization: an enabling technique. Data Mining and Knowledge Discovery 6 (2002) 393-423
31. T.-H. Ma, M.-L. Tang, Weighted rough set model, in: Y. Chen, A. Abraham (Eds.), Proc. 6th Int. Conf. Intelligent Systems Design and Applications, ISDA'06, Jinan, Shandong, China, 2006, pp. 481-485.
32. M.A. Maloof, Learning when data sets are imbalanced and when costs are unequal and unknown, in: N. Chawla, N. Japkowicz, A. Kolcz (Eds.), Proc. ICML'03 Workshop on Learning from Imbalanced Data Sets (II), Washington DC, USA, 2003. Available from: .
33. Mi J.-S., Wu W.-Z., and Zhang W.-X. Approaches to knowledge reduction based on variable precision rough set model. Information Sciences 159 (2004) 255-272
34. Michalski R.S. A theory and methodology of inductive learning. In: Michalski R.S., Carbonell J.G., and Mitchell T.M. (Eds). Machine Learning: an Artificial Intelligence Approach (1983), Morgan Kaufmann, San Mateo, CA 83-134
35. Pawlak Z. Rough sets. International Journal of Computer and Information Sciences 11 (1982) 341-356
36. Pawlak Z. Rough Sets: Theoretical Aspects of Reasoning About Data (1991), Kluwer Academic Publishers, Dordrecht
37. Pawlak Z. Rough sets and intelligent data analysis. Information Sciences 147 (2002) 1-12
38. Pawlak Z., Grzymala-Busse J.W., Slowinski R., and Ziarko W. Rough sets. Comm. ACM 38 11 (1995) 89-95
39. Pawlak Z., and Skowron A. Rough sets: some extensions. Information Sciences 177 1 (2007) 28-40
40. Pawlak Z., and Skowron A. Rudiments of rough sets. Information Sciences 177 1 (2007) 3-27
41. Pawlak Z., and Skowron A. Rough sets and boolean reasoning. Information Sciences 177 1 (2007) 41-73
42. Prati R.C., Batista G.E.A.P.A., and Monard M.C. Class imbalances versus class overlapping: an analysis of a learning system behavior. In: Monroy R., Arroyo G., Sucar L.E., and Sossa H. (Eds). Proc. 3rd Mexican Int. Conf. Artificial Intelligence, MICAI'04, LNAI 2972 (2004), Springer-Verlag, Heidelberg 312-321
43. Provost F.J., and Fawcett T. Analysis and visualization of classifier performance: comparison under imprecise class and cost distributions. In: Heckerman D., Mannila H., and Pregibon D. (Eds). Proc. 3rd Int. Conf. Knowledge Discovery and Data Mining, KDD'97 (1997), AAAI Press, Menlo Park, CA 43-48
44. Quinlan J.R. C4.5 Programs for Machine Learning (1993), Morgan Kaufman, San Mateo, CA
45. Sakkis G., Androutsopoulos I., Paliouras G., Karkaletsis V., Spyropoulos C., and atamatopoulos P. Stacking classifiers for anti-spam filtering of E-mail. In: Lee L., and Harman D. (Eds). Proc. 6th Conf. Empirical Methods in Natural Language Processing, EMNLP'01 (2001), Carnegie Mellon University, Pittsburgh, PA, USA 44-50
46. Shen Q., and Chouchoulas A. A rough-fuzzy approach for generating classification rules. Pattern Recognition 35 11 (2002) 2425-2438
47. D. Slezak, Approximate reducts in decision tables, in: B. Bouchon-Meunier, M. Delgado, J.L. Verdegay, M.A. Vila, R.R. Yager (Eds.), Proc. 6th Int. Conf. Information Processing and Management of Uncertainty in Knowledge-based System, IPMU'96, Granada, Spain, 1996, pp. 1159-1164.
48. Slezak D. Approximate entropy reducts. Fundamenta Informaticae 53 3-4 (2002) 365-390
49. Stefanowski J. On rough set based approaches to induction of decision rules. In: Polkowski L., and Skowron A. (Eds). Rough Sets in Knowledge Discovery (1998), Physica-Verlag, Heidelberg 501-529
50. Stefanowski J., and Wilk S. Rough sets for handling imbalanced data: combining filtering and rule-based classifiers. Fundamenta Informaticae 72 1 (2006) 379-391
51. Tao Q., Wu G.-W., Wang F.-Y., and Wang J. Posterior probability support vector machines for unbalanced data. IEEE Transactions on Neural Networks 16 6 (2005) 1561-1573
52. Ting K.M. An instance-weighting method to induce cost-sensitive trees. IEEE Transactions on Knowledge and Data Engineering 14 3 (2002) 659-665
53. Tsumoto S. Automated extraction of medical expert system rules from clinical databases based on rough set theory. Information Sciences 112 1-4 (1998) 67-84
54. Tsumoto S. Mining diagnostic rules from clinical databases using rough sets and medical diagnostic model. Information Sciences 162 2 (2004) 65-80
55. Wang G.Y. Rough reduction: in algebra view and information view. International Journal of Intelligent Systems 18 6 (2003) 679-688
56. Wang G.Y., Zhao J., An J.J., et al. A comparative study of algebra viewpoint and information viewpoint in attribute reduction. Fundamenta Informaticae 68 3 (2005) 289-301
57. Weiss G.M. Mining with rarity: problems and solutions: a unifying framework. SIGKDD Explorations 6 1 (2004) 7-19
58. G.M. Weiss, F. Provost, The effect of class distribution on classifier learning: an empirical study, Technical Report ML-TR-44, Dept. of Computer Science, Rutgers University, New Brunswick, NJ, 2001.
59. B. Zadrozny, C. Elkan, Learning and making decisions when costs and probabilities are both unknown, in: F. Provost, R. Srikant (Eds.), Proc. 7th ACM SIGKDD Int. Conf. Knowledge Discovery and Data Mining, KDD'01, San Francisco, CA, USA, 2001, pp. 204-213.
60. Zhou Z.-H., and Liu X.-Y. Training cost-sensitive neural networks with methods addressing the class imbalance problem. IEEE Transaction on Knowledge and Data Engineering 18 1 (2006) 63-77
61. Ziarko W. Variable precision rough set model. Journal of Computer and System Sciences 46 (1993) 39-59