Parameter determination and feature selection for C4.5 algorithm using scatter search approach

Soft Computing

Volumn 16, Issue 1, 2012, Pages 63-75

  Lin, Shih Wei ^a   Chen, Shih Chieh ^a,b  

^a CHANG GUNG UNIVERSITY   (Taiwan)

^b NATIONAL TAIWAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Taiwan)

Author keywords

C4.5; Decision tree; Feature selection; Optimization; Scatter search

Indexed keywords

C4.5; C4.5 ALGORITHM; CLASSIFICATION ACCURACY; CLASSIFICATION RESULTS; DATA SETS; MACHINE LEARNING REPOSITORY; OPTIMAL PARAMETER SETTINGS; PARAMETER DETERMINATION; PARAMETER SETTING; SCATTER SEARCH; SEARCH-BASED; UNIVERSITY OF CALIFORNIA;

ALGORITHMS; CLASSIFICATION (OF INFORMATION); DATA PROCESSING; DECISION TREES; FORESTRY; OPTIMIZATION;

FEATURE EXTRACTION;

ALGORITHMS; CLASSIFICATION; DATA PROCESSING; FORESTRY; OPTIMIZATION; PROBLEM SOLVING;

EID: 84855493529     PISSN: 14327643     EISSN: 14337479     Source Type: Journal    
DOI: 10.1007/s00500-011-0734-z     Document Type: Article

References (30)

1. Abe N, Kudo M (2005) Non-parametric classifier-independent feature selection. Pattern Recognit 39: 737-746. doi: 10. 1016/j. patcog. 2005. 11. 007.
2. Aitkenhead MJ (2008) A co-evolving decision tree classification method. Expert Syst Appl 34: 18-25. doi: 10. 1016/j. eswa. 2006. 08. 008.
3. Berry MJA, Linoff G (2001) Data mining techniques: for marking, sales and customer support. Wiley, London.
4. Carvalho DR, Freitas AA (2002) A genetic-algorithm for discovering small-disjunct rules in data mining. Appl Soft Comput 2: 75-88. doi: 10. 1016/S1568-4946(02)00031-5.
5. Freitas AA (1998) Data mining: and knowledge discovery with evolutionary algorithm. Springer, Berlin.
6. Glover F (1977) Heuristics for integer programming using surrogate constraints. Decis Sci 8: 156-166. doi: 10. 1111/j. 1540-5915. 1977. tb01074. x.
7. Glover F (1998) A template for scatter search and path relinking. In: Hao JK, Lutton E, Ronald E, Schoenauer M, Snyers D (eds) Artificial evolution, Lecture notes in computer science, vol 1363, Springer, Berlin, pp 13-54.
8. Gray JB, Fan G (2008) Classification tree analysis using TARGET. Comput Stat Data Anal 52: 1362-1372. doi: 10. 1016/j. csda. 2007. 03. 014.
9. Han J, Kamber M (2006) Data mining: concepts and techniques. Morgan Kaufmann, San Francisco.
10. Hettich S, Blake CL, Merz CJ (1998) UCI repository of machine learning databases. Available via DIALOG. http://www. ics. uci. edu/~mlearn/MLRepository. html.
11. John GH (1994) Cross-validated C4. 5: using error estimation for automatic parameter selection, Technical Report, Computer Science Department, Stanford University. Available via DIALOG. http://citeseerx. ist. psu. edu/viewdoc/summary?doi=10. 1. 1. 56. 5518.
12. Kim H, Koehler GJ (1995) Theory and practice of decision tree induction. Omega 23: 637-652. doi: 10. 1016/0305-0483(95)00036-4.
13. Kohavi R, John G (1995) Automatic parameter selection by minimizing estimated error. In: Prieditis A, Russell S (eds) Machine learning: Proceedings of the twelfth international conference, Morgan Kaufmann.
14. Laguna M, Martí R (2003) Scatter search: methodology and implementations in C. Kluwer Academic Publishers, Boston.
15. Last M, Kandel A, Maimon O (2001) Information-theoretic algorithm for feature selection. Pattern Recognit Lett 22: 799-811. doi: 10. 1016/S0167-8655(01)00019-8.
16. Liu H, Motoda H (1998) Feature selection for knowledge discovery and data mining. Kluwer Academic, Boston.
17. López FG, Torres GM, Batista BM (2006) Solving feature subset selection problem by parallel scatter search. Eur J Oper Res 169: 477-489. doi: 10. 1016/j. ejor. 2004. 08. 010.
18. Martí R (2006) Scatter search-wellsprings and challenges. Eur J Oper Res 169: 351-358. doi: 10. 1016/j. ejor. 2004. 08. 003.
19. Orsenigo C, Vercellis C (2004) Discrete support vector decision trees via tabu search. Comput Stat Data Anal 47: 311-322. doi: 10. 1016/j. csda. 2003. 11. 005.
20. Osei-Bryson KM (2007) Post-pruning in decision tree induction using multiple performance measures. Comput Oper Res 34: 3331-3345. doi: 10. 1016/j. cor. 2005. 12. 009.
21. Perner P, Apte C (2004) Empirical evaluation of feature subset selection based on a real-world data set. Eng Appl Artif Intell 17: 285-288. doi: 10. 1016/j. engappai. 2004. 03. 005.
22. Quinlan JR (1986) Introduction of decision trees. Mach Learn 1: 81-106.
23. Quinlan JR (1987) Simplifying decision trees. Int J Man Mach Stud 27: 221-234. doi: 10. 1016/S0020-7373(87)80053-6.
24. Quinlan JR (1993) C4. 5: programs for machine learning. Morgan Kaufmann, Menlo Park.
25. Rasha SAW, Monmarché N, Slimane M, Moaid AF, Saleh HH (2006) A scatter search algorithm for the automatic clustering problem. Lect Notes Comput Sci 4065: 350-364. doi: 10. 1007/11790853_28.
26. Salzberg SL (1997) On comparing classifiers: pitfalls to avoid and a recommended approach. Data Min Knowl Discov 1: 317-327. doi: 10. 1023/A: 1009752403260.
27. Smith M, Bull L (2005) GAP: constructing and selection features with evolutionary computing. In: Jain LC, Ghosh A (eds) Evolutionary computation in data mining. Springer, Berlin.
28. Su CT, Shiue YR (2003) Intelligent scheduling controller for shop floor control systems: a hybrid genetic algorithm/decision tree learning approach. Int J Prod Res 41(12): 2619-2641. doi: 10. 1080/0020754031000090612.
29. Su C-T, Chen M-C, Chan H-L (2005) Applying neural network and scatter search to optimize parameter design with dynamic characteristics. J Oper Res Soc 56: 1132-1140. doi: 10. 1057/palgrave. jors. 2601888.
30. Sun W, Chen J, Li J (2007) Decision tree and PCA-based fault diagnosis of rotating machinery. Mech Syst Signal Process 21: 1300-1317. doi: 10. 1016/j. ymssp. 2006. 06. 010.