A connectionist approach to generating oblique decision trees

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 29, Issue 3, 1999, Pages 440-444

  Setiono, Rudy ^a   Liu, Huan ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Decision trees; Network pruning; Neural networks; Oblique decision rules

Indexed keywords

ALGORITHMS; FEEDFORWARD NEURAL NETWORKS; PATTERN RECOGNITION; TREES (MATHEMATICS);

NETWORK PRUNING; OBLIQUE DECISION TREES;

DECISION THEORY;

EID: 0032627597     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/3477.764880     Document Type: Article

References (20)

1. R. Sun, "Hybrid connectionist-symbolic models, a report from the IJCAI 95 workshop on connectionist-symbolic integration," AI Mag., pp. 99-103, Summer 1996.
2. L. Breiman, J. H. Friedman, R. A. Olshen, and C. J. Stone, Classification and Regression Trees. Belmont, CA: Wadsworth, 1984.
3. J. R. Quinlan, "Induction of decision trees," Mach. Learn., vol. 6, no. 1, pp. 81-106, 1986.
4. C. E. Brodley and P. E. Utgoff, "Multivariate decision trees," Mach. Learn., vol. 19, pp. 45-77, 1995.
5. D. Heath, S. Kasif, and S. Salzberg, "Learning oblique decision trees," in Proc. 13th Int. Joint Conf. Artificial Intelligence, 1993, pp. 1002-1007.
6. S. Murthy, S. Kasif, S. Salzberg, and R. Beigel, "Oc1: Randomized induction of oblique decision trees," in Proc. AAAI Conf., 1993, pp. 322-327.
7. O. L. Mangasarian, R. Setiono, and W. Wolberg, "Pattern recognition via linear programming: Theory and application to medical diagnosis," in Large-Scale Numerical Optimization, T. F. Coleman and Y. Li, Eds. Philadelphia, PA: SIAM, 1989, pp. 22-30.
8. H. Guo and S. B. Gelfland, "Classification trees with neural network feature extraction," IEEE Trans. Neural Networks, vol. 3, no. 6, pp. 924-933, 1992.
9. J. R. Quinlan, C4.5: Programs for Machine Learning. San Mateo, CA: Morgan Kaufmann, 1993.
10. T. Ash, "Dynamic node creation in backpropagation networks," Connect. Sci., vol. 1, no. 4, pp. 365-375, 1989.
11. R. Setiono, "A neural network construction algorithm which maximizes the likelihood function," Connect. Sci., vol. 7, no. 2, pp. 147-166, 1995.
12. Y. Le Cun, J. S. Denker, and S. A. Solla, "Optimal brain damage," in Adv. Neural Inf. Process. Syst., vol. 2, pp. 598-605, 1990.
13. B. Hassibi and D. G. Stork, "Second order derivatives for network pruning: Optimal brain surgeon," in Adv. Neural Inf. Process. Syst., vol. 5, pp. 164-171, 1993.
14. R. Setiono, "A penalty function approach for pruning feedforward neural networks," Neural Comput., vol. 9, no. 1, pp. 185-204, 1997.
15. E. D. Karnin, "A simple procedure for pruning back-propagation trained neural network," IEEE Trans. Neural Networks, vol. 1, no. 2, pp. 239-242, 1990.
16. J. R. Quinlan, "Learning efficient classification procedures and their application to chess end games," in Machine Learning: An Artificial Intelligence Approach, R. S. Michalski, J. G. Carbonnel, and T. M. Mitchell, Eds. Los Altos, CA: Morgan Kaufmann, 1983.
17. K. J. Cios and N. Liu, "A machine learning method for generation of a neural network architecture: A continuous ID3 algorithm," IEEE Trans. Neural Networks, vol. 3, no. 2, pp. 280-291, 1992.
18. C. Merz and P. Murphy, UCI repository of machine learning databases, 1996. Available online from ftp://ftp.ics.uci.edu/pub/machine-learning-databases.
19. J. Shavlik, R. Mooney, and G. Towell, "Symbolic and neural learning algorithms: An experimental comparison," Mach. Learn., vol. 6, no. 2, pp. 111-143, 1991.
20. R. Setiono and L. C. K. Hui, "Use of quasi-Newton method in a feedforward neural network construction algorithm," IEEE Trans. Neural Networks, vol. 6, no. 1, pp. 273-277, 1995.