Feature selection with test cost constraint

International Journal of Approximate Reasoning

Volumn 55, Issue 1 PART 2, 2014, Pages 167-179

  Min, Fan ^a   Hu, Qinghua ^b   Zhu, William ^a  

^a MINNAN NORMAL UNIVERSITY   (China)

^b TIANJIN UNIVERSITY   (China)

Author keywords

Backtracking algorithm; Constraint satisfaction problem; Cost sensitive learning; Decision theoretic rough sets; Feature selection; Heuristic algorithm

Indexed keywords

CLASSIFICATION (OF INFORMATION); CONSTRAINT THEORY; COSTS; DATA MINING; FEATURE EXTRACTION; HEURISTIC ALGORITHMS; LEARNING SYSTEMS; PROBLEM SOLVING; ROUGH SET THEORY;

BACKTRACKING ALGORITHM; COST-SENSITIVE LEARNING; DECISION-THEORETIC ROUGH SETS; FEATURE SELECTION PROBLEM; FEATURE SUBSET; LARGE DATASETS; OPTIMAL SOLUTIONS; PRE-PROCESSING STEP;

CONSTRAINT SATISFACTION PROBLEMS;

EID: 84888054977     PISSN: 0888613X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ijar.2013.04.003     Document Type: Article

References (87)

1. N. Azam, J.T. Yao, Multiple criteria decision analysis with game-theoretic rough sets, in: Proceedings of Rough Sets and Current Trends in Computing, LNCS, vol. 7414, Springer,Berlin/Heidelberg, 2012, pp. 399-408.
2. N. Azam, J.T. Yao, Analyzing uncertainties of probabilistic rough set regions with game-theoretic rough sets, International Journal of Approximate Reasoning, this issue.
3. J.G. Bazan, A. Skowron, Dynamic reducts as a tool for extracting laws from decision tables, in: Proceedings of the 8th International Symposium on Methodologies for Intelligent Systems, Springer,Berlin/Heidelberg, 1994, pp. 346-355.
4. C.L. Blake, C.J. Merz, UCI repository of machine learning databases, 1998. .
5. Y. Chen, D. Miao, R. Wang, and K. Wu A rough set approach to feature selection based on power set tree Knowledge-Based System 24 2011 275 281
6. C. Cortes, and V. Vapnik Support-vector networks Machine Learning 20 1995 273 297
7. J. Dai, W. Wang, Q. Xua, and H. Tian Uncertainty measurement for interval-valued decision systems based on extended conditional entropy Knowledge-Based Systems 27 2012 443 450
8. J. Dai, and Q. Xu Approximations and uncertainty measures in incomplete information systems Information Sciences 198 2012 62 80
9. D. Deng, Parallel reduct and its properties, in: Proceedings of IEEE Granular Computing, 2009, pp. 121-125.
10. R. Gilad-Bachrach, A. Navot, N. Tishby, Margin based feature selection - theory and algorithms, in: Proceedings of the 21st International Conference on Machine Learning, ICML, ACM, 2004, pp. 43-50.
11. Z. Gong, B. Sun, and D.G. Chen Rough set theory for the interval-valued fuzzy information systems Information Sciences 178 8 2008 1968 1985
12. B. Gorzafczary Interval-valued fuzzy controller based on verbal modal of object Fuzzy Sets and Systems 28 1988 45 53
13. J.W. Grzymala-Busse, P.G. Clark, M. Kuehnhausen, Generalized probabilistic approximations of incomplete data, International Journal of Approximate Reasoning, this issue.
14. I. Guyon, and A. Elisseeff An introduction to variable and feature selection Journal of Machine Learning Research 3 2003 1157 1182
15. I. Guyon, S. Gunn, M. Nikravesh, and L.A. Zadeh Feature Extraction: Foundations and Applications (Studies in Fuzziness and Soft Computing) 2006 Springer-Verlag New York, Inc.
16. H.P. He, F. Min, Accumulated cost based test-cost-sensitive attribute reduction, in: Proceedings of the 13th International Conference on Rough Sets, Fuzzy Sets, Data Mining and Granular Computing, LNAI, vol. 6743, Springer,Berlin/Heidelberg, 2011, pp. 244-247.
17. H.P. He, F. Min, W. Zhu, Attribute reduction in test-cost-sensitive decision systems with common-test-costs, in: Proceedings of the 3rd International Conference on Machine Learning and Computing, v1, IEEE, 2011, pp. 432-436.
18. J.P. Herbert, and J.T. Yao Game-theoretic Rough sets Fundamenta Informaticae 108 2011 267 286
19. Q.H. Hu, J.F. Liu, and D.R. Yu Mixed feature selection based on granulation and approximation Knowledge-Based Systems 21 2008 294 304
20. Q.H. Hu, W. Pedrycz, D.R. Yu, and J. Lang Selecting discrete and continuous features based on neighborhood decision error minimization IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics 40 1 2010 37 50
21. Q.H. Hu, D.R. Yu, J.F. Liu, and C. Wu Neighborhood rough set based heterogeneous feature subset selection Information Sciences 178 18 2008 3577 3594
22. Q.H. Hu, D.R. Yu, and Z. Xie Numerical attribute reduction based on neighborhood granulation and rough approximation Journal of Software 19 3 2008 640 649 (in Chinese)
23. A. Jain, and D. Zongker Feature selection: evaluation, application, and small sample performance IEEE Transactions on Pattern Analysis and Machine Intelligence 19 2 1979 153 158
24. R. Jensen, Q. Shen, A. Tuson, Finding rough set reducts with SAT, in: Proceedings of the 10th International Conference on Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing, LNAI, vol. 3641, Springer,Berlin/Heidelberg, 2005, pp. 194-203.
25. X.Y. Jia, W.W. Li, L. Shang, J.J. Chen, An optimization viewpoint of decision-theoretic Rough set model, in: Proceedings of Rough Sets and Knowledge Technology, LNAI, vol. 6954, Springer,Berlin/Heidelberg, 2011, pp. 457-465.
26. X.Y. Jia, Z.M. Tang, W.H. Liao, L. Shang, On an optimization representation of decision-theoretic rough set model, International Journal of Approximate Reasoning. .
27. K. Kira, L.A. Rendell, The feature selection problem: traditional methods and a new algorithm, in: Proceedings of the Tenth National Conference on Artificial Intelligence, AAAI, JohnWiley & Sons Ltd, 1992, pp. 129-134.
28. D.L.T.R. Li, D.C. Liang, Incorporating logistic regression to decision-theoretic rough sets for classifications, International Journal of Approximate Reasoning. .
29. H.X. Li, Y.Y. Yao, X.Z. Zhou, and B. Huang A two-phase model for learning rules from incomplete data Fundamenta Informaticae 94 2009 219 232
30. H.X. Li, and X.Z. Zhou Risk decision making based on decision-theoretic rough set: a three-way view decision model International Journal of Computational Intelligence Systems 4 1 2011 1 11
31. H.X. Li, X.Z. Zhou, J.B. Zhao, D. Liu, Attribute reduction in decision-theoretic rough set model: a further investigation, in: Proceedings of Rough Sets and Knowledge Technology, LNCS, vol. 6954, Springer,Berlin/ Heidelberg, 2011, pp. 466-475.
32. T.J. Li, X.P. Yang, An axiomatic characterization of probabilistic rough sets, International Journal of Approximate Reasoning. .
33. J.Y. Liang, F. Wang, C.Y. Dang, and Y.H. Qian An efficient rough feature selection algorithm with a multi-granulation view International Journal of Approximate Reasoning 53 2012 912 926
34. D. Liu, T.R. Li, and H.X. Li A multiple-category classification approach with decision-theoretic Rough sets Fundamenta Informaticae 155 2-3 2012 173 188
35. D. Liu, T.R. Li, and D. Ruan Probabilistic model criteria with decision-theoretic Rough sets Information Sciences 181 2011 3709 3722
36. Q.H. Liu, F. Li, F. Min, M. Ye, and G.W. Yang An efficient reduction algorithm based on new conditional information entropy Control and Decision 20 8 2005 878 882 (in Chinese)
37. P. Maji, and S. Paul Rough set based maximum relevance-maximum significance criterion and gene selection from microarray data International Journal of Approximate Reasoning 52 2011 408 426
38. J.S. Mi, W.Z. Wu, and W.X. Zhang Approaches to knowledge reduction based on variable precision rough set model Information Sciences 159 3-4 2004 255 272
39. D.Q. Miao, Y. Zhao, Y.Y. Yao, H.X. Li, and F.F. Xu Relative reducts in consistent and inconsistent decision tables of the pawlak rough set model Information Sciences 179 24 2009 4140 4150
40. F. Min, X.H. Du, H. Qiu, Q.H. Liu, Minimal attribute space bias for attribute reduction, in: Proceedings of Rough Set and Knowledge Technology, LNCS, vol. 4481, Springer,Berlin/Heidelberg, 2007, pp. 379-386.
41. F. Min, H.P. He, Y.H. Qian, and W. Zhu Test-cost-sensitive attribute reduction Information Sciences 181 2011 4928 4942
42. F. Min, and Q.H. Liu A hierarchical model for test-cost-sensitive decision systems Information Sciences 179 2009 2442 2452
43. F. Min, Q.H. Liu, and C.L. Fang Rough sets approach to symbolic value partition International Journal of Approximate Reasoning 49 2008 689 700
44. F. Min, Q.H. Liu, H. Tan, L.T. Chen, The M-relative reduct problem, in: Proceedings of Rough Set and Knowledge Technology, LNAI, vol. 4062, Springer,Berlin/Heidelberg, 2006, pp. 170-175.
45. F. Min, W. Zhu, Minimal cost attribute reduction through backtracking, in: Proceedings of International Conference on Database Theory and Application, FGIT-DTA/BSBT, vol. 258, CCIS, Springer,Berlin/Heidelberg, 2011, pp. 100-107.
46. F. Min, W. Zhu, Optimal sub-reducts with test cost constraint, in: Proceedings of Rough Set and Knowledge Technology, LNAI, vol. 6954, Springer,Berlin/Heidelberg, 2011, pp. 57-62.
47. F. Min, and W. Zhu Attribute reduction of data with error ranges and test costs Information Sciences 211 2012 48 67
48. F. Min, W. Zhu, H. Zhao, G.Y. Pan, J.B. Liu, Z.L. Xu, Coser: cost-senstive rough sets, Springer,Berlin/Heidelberg, 2012. .
49. H.S. Nguyen, Discretization problem for rough sets methods, in: Rough Sets and Current Trends in Computing, LNCS, vol. 1424, Springer,Berlin/ Heidelberg, 1998, pp. 545-552.
50. G.Y. Pan, F. Min, W. Zhu, A genetic algorithm to the minimal test cost reduct problem, in: Proceedings of IEEE International Conference on Granular Computing, 2011, pp. 539-544.
51. Z. Pawlak Rough sets International Journal of Computer and Information Sciences 11 1982 341 356
52. Z. Pawlak Rough Sets: Theoretical Aspects of Reasoning About Data 1991 Kluwer Academic Publishers Boston
53. J. Qian, D. Miao, Z. Zhang, and W. Li Hybrid approaches to attribute reduction based on indiscernibility and discernibility relation International Journal of Approximate Reasoning 52 2 2011 212 230
54. Y.H. Qian, H. Zhang, Y.L. Sang, J.Y. Liang, Multigranulation decision-theoretic rough sets, International Journal of Approximate Reasoning. .
55. J.R. Quinlan Induction of decision trees Machine Learning 1 1986 81 106
56. A. Skowron, C. Rauszer, The discernibility matrices and functions in information systems, in: Intelligent Decision Support, 1992, pp. 331-362.
57. D. Ślȩzak Approximate entropy reducts Fundamenta Informaticae 53 3-4 2002 365 390
58. D. Ślȩzak, and W. Ziarko The investigation of the bayesian rough set model International Journal of Approximate Reasoning 40 2006 81 91
59. R. Slowinski, and D. Vanderpooten A generalized definition of rough approximations based on similarity IEEE Transactions on Knowledge and Data Engineering 12 2 2000 331 336
60. R. Susmaga Computation of minimal cost reducts Z. Ras, A. Skowron, Foundations of Intelligent Systems LNCS vol. 1609 1999 Springer Berlin/Heidelberg 448 456
61. D. Tian, X. jun Zeng, and J. Keane Core-generating approximate minimum entropy discretization for rough set feature selection in pattern classification International Journal of Approximate Reasoning 52 2011 863 880
62. P.D. Turney Cost-sensitive classification: empirical evaluation of a hybrid genetic decision tree induction algorithm Journal of Artificial Intelligence Research 2 1995 369 409
63. G. Wang, Attribute core of decision table, in: Proceedings of Rough Sets and Current Trends in Computing, LNCS, vol. 2475, Springer,Berlin/Heidelberg, 2002, pp. 213-217.
64. G. Wang, H. Yu, and D. Yang Decision table reduction based on conditional information entropy Chinese Journal of Computers 2 7 2002 759 766
65. J. Wang, and J. Wang Reduction algorithms based on discernibility matrix: the ordered attributes method Journal of Computer Science and Technology 16 6 2001 489 504
66. T. Yang, and Q.G. Li Reduction about approximation spaces of covering generalized rough sets International Journal of Approximate Reasoning 51 3 2010 335 345
67. X.P. Yang, and J.T. Yao Modelling multi-agent three-way decisions with decision-theoretic Rough sets Fundamental Informaticae 115 2-3 2012 157 171
68. J.T. Yao, M. Zhang, Feature selection with adjustable criteria, in: Proceedings of the 10th International Conference on Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing, LNAI, vol. 3641, Springer,Berlin/Heidelberg, 2005, pp. 204-213.
69. Y.Y. Yao A partition model of granular computing Transactions on Rough Sets I 3100 2004 232 253
70. Y.Y. Yao Probabilistic rough set approximations International Journal of Approximate Reasoning 49 2 2008 255 271
71. Y.Y. Yao, and S. Wong A decision theoretic framework for approximating concepts International Journal of Man-machine Studies 37 1992 793 809
72. Y.Y. Yao, and Y. Zhao Attribute reduction in decision-theoretic rough set models Information Sciences 178 17 2008 3356 3373
73. Y.Y. Yao, Y. Zhao, and J. Wang On reduct construction algorithms Transactions on Computational Science 2 2008 100 117
74. Y.Y. Yao, Y. Zhao, J. Wang, and S.Q. Han A model of user-oriented reduct construction for machine learning Transactions on Rough Sets IV 5084 2008 332 351
75. D.Y. Ye, and Z.J. Chen A new discernibility matrix and the computation of a core Acta Electronica Sinica 7 2002 1086 1088
76. H. Yu, Z.G. Liu, G.Y. Wang, An automatic method to determine the number of clusters using decision-theoretic rough set, International Journal of Approximate Reasoning, this issue.
77. H. Yu, G.Y. Wang, and F.K. Lan Solving the attribute reduction problem with ant colony optimization Transactions on Rough Sets XIII 6499 2011 240 259
78. S.C. Zhang Cost-sensitive classification with respect to waiting cost Knowledge-Based Systems 23 5 2010 369 378
79. H. Zhao, F. Min, W. Zhu, Test-cost-sensitive attribute reduction based on neighborhood rough set, in: Proceedings of the 2011 IEEE International Conference on Granular Computing, 2011, pp. 802-806.
80. Y. Zhao, F. Lou, S. Wong, Y.Y. Yao, A general definition of an attribute reduct, in: Proceedings of Rough Sets and Knowledge Technology, LNAI, vol. 4481, Springer,Berlin/Heidelberg, 2007, pp. 101-108.
81. N. Zhong, J.Z. Dong, and S. Ohsuga Using rough sets with heuristics to feature selection Journal of Intelligent Information Systems 16 3 2001 199 214
82. B. Zhou, A comparison study of cost-sensitive classifier evaluations, in: Proceedings of the International Conference on Brain Informatics, LNCS, vol. 7670, Springer,Berlin/Heidelberg, 2012, pp. 360-371.
83. Z. Zhou, and X. Liu Training cost-sensitive neural networks with methods addressing the class imbalance problem IEEE Transactions on Knowledge and Data Engineering 18 1 2006 63 77
84. W. Zhu Topological approaches to covering rough sets Information Sciences 177 6 2007 1499 1508
85. W. Zhu, and F. Wang Reduction and axiomization of covering generalized rough sets Information Sciences 152 1 2003 217 230
86. W. Zhu, and F. Wang On three types of covering rough sets IEEE Transactions on Knowledge and Data Engineering 19 8 2007 1131 1144
87. W. Ziarko Variable precision rough set model Journal of Computer and System Sciences 46 1 1993 39 59