Iterative feature construction for improving inductive learning algorithms

Expert Systems with Applications

Volumn 36, Issue 2 PART 2, 2009, Pages 3401-3406

  Piramuthu, Selwyn ^a   Sikora, Riyaz T ^b  

^a UNIVERSITY OF FLORIDA   (United States)

^b UNIVERSITY OF TEXAS AT ARLINGTON   (United States)

Author keywords

Feature construction; Machine learning

Indexed keywords

DATA REDUCTION; GENETIC ALGORITHMS; ITERATIVE METHODS; LEARNING SYSTEMS; NEONATAL MONITORING;

DATA COMPLEXITY; DIFFICULT CONCEPTS; FEATURE CONSTRUCTION; INDUCTIVE LEARNING; ITERATIVE ALGORITHM; LAZY LEARNERS; LEARNING METHODS; PRE-PROCESSING STEP;

LEARNING ALGORITHMS;

EID: 56749132927     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2008.02.010     Document Type: Article

References (24)

1. Aha D. Lazy learning. Artificial Intelligence Review 11 (1997) 7-10
2. Bloedorn E., and Michalski R.S. Data-driven constructive induction. IEEE Intelligent Systems (1998) 30-37
3. *: An instance-based learner using an entropic distance measure. Proceedings of the 12th International Conference on Machine Learning (1995) 108-114
4. Droste S., Thomas J., and Ingo W. Optimization with randomized search heuristics - The (A)NFL theorem, realistic scenarios, and difficult functions. Theoretical Computer Science 287 (2002) 131-144
5. Flach P.A., and Lachiche N. Confirmation-guided discovery of first-order rules with tertius. Machine Learning 42 (2001) 61-95
6. Flach, Peter A., & Lavrac, Nada. (2000). The role of feature construction in inductive rule learning. In Proceedings of the international conference on machine learning 2000 workshop on attribute-value and relational learning: Crossing the boundaries (pp. 1-11).
7. Forman G. An extensive empirical study of feature selection metrics for text classification. Journal of Machine Learning Research 3 (2003) 1289-1305
8. Goldberg D. Genetic algorithms in search. Optimization and Machine Learning (1989), Addison-Wesley Publishing Co., Inc, Reading, MA
9. Igel C., and Toussaint Marc. On classes of functions for which no free lunch results hold. Information Processing Letters 80 6 (2003) 317-321
10. Klösgen W. Explora: A multipattern and multistrategy discovery assistant. In: Fayyad U.M., Piatetsky-Shapiro G., Smyth P., and Uthurusamy R. (Eds). Advances in knowledge discovery and data mining (1996), AAAI Press, Menlo Park CA 249-271
11. Langley P., Zytkow J.M., Simon H.A., and Bradshaw G.L. The search for regularity: Four aspects of scientific discovery (1986), Morgan Kaufman, Machine learning
12. Matheus C.J., and Rendell L. "Constructive induction in decision trees. Proceedings of the Eleventh IJCAI (1989) 645-650
13. Pagallo G. "Learning DNF by decision trees. Proceedings of the Eleventh IJCAI (1989) 639-644
14. Piramuthu, Selwyn (2007). Feature selection, feature construction, and the no free lunch theorems, working paper, information systems and operations management. University of Florida.
15. Quinlan J.R. Induction of decision trees. Machine Learning 1 1 (1986) 81-106
16. Quinlan J.R. C4.5. Programs for Machine Learning (1993), Morgan Kaufman
17. Smith M.G., and Bull L. Genetic programming with a genetic algorithm for feature construction and selection. Genetic Programming and Evolvable Machines 6 3 (2005) 265-281
18. Streeter M.J. Two broad classes of functions for which a no free lunch result does not hold. Proceedings of the genetic and evolutionary computation conference (GECCO) (2003) 1418-1430
19. Utgoff P.E. Feature construction for game playing. In: Fuerenkranz J., and Kubat M. (Eds). Machines that learn to play games (2001), Nova Science Publishers 131-152
20. Vilalta, Ricardo, & Larry, Rendell (1997). Integrating feature construction with multiple classifiers in decision tree induction. In Proceedings of international conference on machine learning (394-402). Morgan-Kaufman.
21. Wolpert D.H., and Macready W.G. No free lunch theorems for optimization. IEEE Transactions on Evolutionary Computation 1 1 (1997) 67-82
22. Woodward J.R., and Neil J.R. No Free Lunch, Program Induction and Combinatorial Problems. In: Ryan C., Soule T., Keijzer M., Tsang E., Poli R., and Costa E. (Eds). Genetic Programming, Proceedings of EuroGP'2003 Vol. 2610 (2003), Springer-Verlag 475-484
23. Wrobel, S. (1997). An algorithm for multi-relational discovery of subgroups. In Proceedings of the first European symposium on principles of data mining and knowledge discovery. Berlin: Springer.
24. Yang D.-S., Larry R., and Gunnar B. A scheme for feature construction and a comparison of empirical methods. Proceedings of the Twelfth IJCAI (1991) 699-704