Evolving model trees for mining data sets with continuous-valued classes

Expert Systems with Applications

Volumn 35, Issue 4, 2008, Pages 1513-1532

  Potgieter, Gavin ^a   Engelbrecht, Andries P ^a  

^a UNIVERSITY OF PRETORIA   (South Africa)

Author keywords

Continuous valued classes; Data mining; Genetic programming; Model trees

Indexed keywords

ALGORITHMS; BIOELECTRIC PHENOMENA; CHLORINE COMPOUNDS; COMPUTER PROGRAMMING; CONTROL SYSTEM ANALYSIS; CONTROL THEORY; DIESEL ENGINES; GENETIC ALGORITHMS; MATHEMATICAL MODELS; MATHEMATICAL OPERATORS; PARAMETER ESTIMATION; PERSONNEL TRAINING; SET THEORY; STRUCTURAL DESIGN; STRUCTURAL OPTIMIZATION;

APPLIED MATHEMATICS; CONTINUOUS-VALUED CLASSES; CONTROL PARAMETERS; CROSSOVER OPERATORS; DATA MINING; DATA SETS; GENETIC ALGORITHM (GA); GENETIC PROGRAMMING; GENETIC PROGRAMMING (GP); K-MEANS CLUSTERING; MODEL TREES; NON-LINEAR MODELING; POLYNOMIAL EXPRESSIONS; STRATIFIED SAMPLING; STRUCTURAL OPTIMISATION; TERMINAL NODES; TRAINING DATA;

TREES (MATHEMATICS);

EID: 48749127627     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2007.08.060     Document Type: Article

References (36)

1. In: Abass H., Saker R., and Newton C. (Eds). Data mining: A heuristic approach (2002), Idea Publishing Group
2. In: Bäck T., Fogel D., and Michalewicz T. (Eds). Evolutionary computation 1: Advanced algorithms and operators (2000), IOP Press
3. In: Bäck T., Fogel D., and Michalewicz T. (Eds). Evolutionary computation 1: Basic algorithms and operators (2000), IOP Press
4. Bishop C. Neural networks for pattern recognition (1992), Oxford University Press
5. Blake, C., Keogh, E., & Merz, C. (1998). UCI repository of machine learning databases. Department of Information and Computer Science, University of California Irvine. http://www.ics.uci.edu/~mlearnMLRepository.
6. Burden R., and Faires J. Numerical analysis. 6th ed. (1997), Brooks/Cole Publishing Company
7. Clark P., and Boswell R. Rule induction with CN2: Some recent improvements. Proceedings of the fifth European working session on learning (1991), Springer, Berlin 151-163
8. Clark P., and Niblitt T. The CN2 induction algorithm. Machine Learning 3 (1989) 261-283
9. Dennis Jr. J., and Schnabel R. Numerical methods for unconstrained optimization and nonlinear equations (1983), Prentice-Hall, Englewood Cliffs, NJ
10. Eggermont J., Eiben A., and van Hemert J. Adapting the fitness function in GP for data mining. In: Poli R., Nordin P., Langdon W., and Fogarty T. (Eds). Genetic programming. Proceedings of EuroGP'99, 26-27 1999 Vol. 1598 (1999), Springer-Verlag, Goteborg, Sweden 193-202. [Online]. Available from citeseer.nj.nec.com/eggermont99adapting.html
11. Engelbrecht A., and Brits R. Supervised training using an unsupervised approach to active learning. Neural processing letters (2002), Kluwer Academic Publishers, Netherlands 247-269
12. Engelbrecht A., Schoeman L., and Rouwhorst S. A building-block approach to genetic programming for rule discovery. In: Abbass C.N.H.A., and Sarker R.A. (Eds). Data mining: A heuristic approach (2001), Idea Group Publishing 174-190
13. Forgy E. Cluster analysis of multivariate data: Efficiency versus interpretability of classification. Biometrics 21 (1965) 768-769
14. Freitas A. A genetic programming framework for two data mining tasks: Classification and generalized rule induction. In: Koza J., Deb K., Dorigo M., Fogel D., Garzon M., Iba H., and Riolo R. (Eds). Genetic programming 1997: Proceedings of the second annual conference, Stanford University, 13-16 1997 (1997), Morgan Kaufmann 96-101. [Online]. Available from citeseer.nj.nec.com/43454.html
15. Fu L. Rule generation from neural networks. IEEE Transactions on Systems, Man and Cybernetics 24 8 (1994) 1114-1124
16. Geman S., Bienenstock E., and Doursat R. Neural networks and the bias/variance dilemma. Neural Computation 4 (1992) 1-58
17. Geom Y. Genetic recursive regression for modelling and forecasting real-world chaotic time series. Advances in Genetic Programming 3 (1999) 401-423
18. Goldberg G., and Deb K. A comparitive analysis of selection schemes used in genetic algorithms. In: Rawlins G. (Ed). Foundations of genetic algorithms (1991), Morgan-Kaufman 69-93
19. Kaboudan M. Genetic evolution of regression models for business and economic forecasting. Proceedings of the congress on evolutionary computation vol. 2 (1999), IEEE Press 1260-1268
20. Koza J. Genetic programming: On the programming of computers by means of natural selection (1992), MIT Press
21. Marmelstein R., and Lamont G. Pattern classification using a hybrid genetic program-decision tree approach. In: Koza J. (Ed). Genetic programming 98: Proceedings of the third international conference (1998), Morgan Kaufman 223-231
22. Poli R., and Langdon W. Foundations of genetic programming (2002), Springer-Verlag
23. Potgieter, G. (2003). Mining continuous classes using evolutionary computing. Master's thesis. Department of Computer Science, University of Pretoria.
24. Potgieter, G., & Engelbrecht, A. (2002). Structural optimization of learned polynomial expressions using genetic algorithms. In Proceedings of the 4th Asia-Pacific conference on simulated evolution and learning.
25. Potgieter G., and Engelbrecht A. Genetic algorithms for the structural optimisation of learned polynomial expressions. Applied Mathematics and Computation 186 (2007) 1441-1466
26. Quinlan J. Learning efficient classification procedures and their application to chess endgames. In: Michalski R., Carbonell J., and Mitchell T. (Eds). Machine learning: An artificial intelligence approach vol. 1 (1983), Tioga Press, Palo Alto 463-482
27. Quinlan J. Learning with continuous classes. In: Adams, and Sterling (Eds). Proceedings of artificial intelligence'92 (1992), World Scientific, Singapore 343-348
28. Quinlan J. C4.5: Programs for machine learning (1993), Morgan Kaufman, San Mateo
29. Salomon D. Data compression. 2nd ed. (2000), Springer
30. Setiono R. Generating linear regression rules from neural networks using local least squares approximation. In: Mira J., and Prieto A. (Eds). Connectionist model of neurons, learning processes, and artificial intelligence, Proceedings of the 6th international work-conference on artificial and natural neural Networks, June Vol. 1 (2001), Springer, Granada, Spain 277-284
31. Setiono R., and Hui L. Use of quasi-Newton method in a feedforward neural network construction algorithm. IEEE Transactions on Neural Networks 6 1 (1995) 273-277
32. Setiono R., and Leow W. Pruned neural networks for regression. In: Mizoguchi R., and Staney J. (Eds). Proceedings of the 6th Pacific Rim conference on artificial intelligence, PRICAI 2000. Lecture Notes in AI Vol. 1886 (2000), Springer, Melbourne, Australia 500-509
33. Setiono R., Leow W., and Zurada J. Extraction of rules from artificial neural networks for nonlinear regression. IEEE Transactions on Neural Networks 13 3 (2002) 564-577
34. Towell C., and Shavlik J. Refining symbolic knowledge using neural networks. Machine Learning 12 (1994) 321-331
35. Viktor, H., Engelbrecht, A., & Cloete, I. (1995). Reduction of symbolic rules from neural networks using sensitivity analysis. In Proceedings of the IEEE international joint conference on neural networks, Perth, Australia (pp. 1022-1026).
36. Zurada J.M. Introduction to artificial neural systems (1992), PWS Publishing Company