Classification Trees with Neural Network Feature Extraction

IEEE Transactions on Neural Networks

Volumn 3, Issue 6, 1992, Pages 923-933

  Guo, Heng ^a   Gelfand, Saul B ^a  

^a PURDUE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); DECISION THEORY; TREES (MATHEMATICS);

BINARY CLASSIFICATION TREES; FEATURE EXTRACTION;

NEURAL NETWORKS;

EID: 0026953218     PISSN: 10459227     EISSN: 19410093     Source Type: Journal    
DOI: 10.1109/72.165594     Document Type: Article

References (24)

1. L. Brieman, J. H. Friedman, R. A. Olshen, and C. J. Stone, Classification and Regression Trees. Belmont, CA: Wadsworth, 1984
2. L. Atlas et al., “A performance comparison of trained multilayer perceptrons and trained classification trees,” Proc. IEEE, vol. 78, pp. 1614-1619, 1990.
3. I. K. Sethi, “Entropy nets: From decision trees to neural networks,” Proc. IEEE, vol. 78, pp. 1605-1613, 1990.
4. T. D. Sanger, “A tree-structured adaptive network for function approximation in high dimensional spaces,” IEEE Trans. Neural Networks, vol. 2, pp. 285-293, 1991.
5. J. H. Friedman, “A recursive partitioning decision rule for nonparametric classification,” IEEE Trans. Comput., vol. C-26, pp. 404-408, 1973.
6. E. M. Rounds, “A combined nonparametric approach to feature selection and binary decision tree design,” Pattern Recognition, vol. 12, pp. 313-317, 1980.
7. I. K. Sethi and G. P. R. Sarvarayudu, “Hierarchical classifier design using mutual information,” IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-4, pp. 441-445, 1982.
8. J. Sklansky and L. Michelotti, “Locally trained piecewise linear classifiers,” IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-2, pp. 101-111, 1980.
9. Y. Park and J. Sklansky, “Automated design of linear tree classifiers,” Pattern Recognition, vol. 23, pp. 1393-1412, 1990.
10. S. L. Crawford, “Extensions to the CART algorithm,” Int. J. Man-Machine Studies, vol. 31, pp. 197-217, 1989.
11. R. P. Lippman, “An introduction to computing with neural nets,” IEEE ASSP Magazine, pp. 4-22, Apr. 1987.
12. D. E. Rumelhart, G. E. Hinton and R. J. Williams, “Learning internal representations by error propagation,” in Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. 1, Foundations. Cambridge, MA: MIT Press, 1986.
13. H. Guo, “Learning algorithms for multilayer neural networks with application to classification tree design,” Ph.D. thesis, School of Electrical Engineering, Purdue University, West Lafayette, IN, May 1991.
14. P. Werbos, “Beyond regression: New tools for prediction and analysis in the behavior sciences,” Ph.D. thesis, Committee on Applied Mathematics, Harvard University, Cambridge, MA, Nov. 1975.
15. H. Guo and S. B. Gelfand, “Analysis of gradient descent learning algorithms for multilayer feedforward neural networks,” IEEE Trans. Circuits Syst., vol. 38, pp. 883-894, 1991.
16. C. M. Kuan and K. Hornik, “Convergence of learning algorithms with constant learning rates,” IEEE Trans. Neural Networks, vol. 2, pp. 484-489, 1991.
17. M. M. Polycarpou and P. A. Ioannou, “Learning and convergence analysis of neural-type structured networks,” IEEE Trans. Neural Networks, vol. 3, pp. 39-50, Jan. 1992.
18. S. B. Gelfand and S. K. Mitter, “Recursive stochastic algorithms for global optimization in SIAM J. Control and Optimization, vol. 29, pp. 999-1018, 1991.
19. S. B. Gelfand and S. K. Mitter, “Metropolis-type annealing algorithms for global optimization in IRd,” SIAM J. Control and Optimization, to be published.
20. R. L. Watrous, “Learning algorithms for connectionist networks: applied gradient methods for nonlinear optimization,” in Proc. First IEEE Int. Conf. Neural Networks (San Diego, CA) 1987, pp. 619-627.
21. S. Kollias and D. Anastassiou, “An adaptive least squares algorithm for the efficient training of artificial neural networks,” IEEE Trans. Circuits Syst., vol. 36, pp. 1092-1101, 1989.
22. S. B. Gelfand, C. S. Ravishankar, and E. j. Delp, “An iterative growing and pruning algorithm for classification tree design,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 13, pp. 163-174, 1991.
23. S. B. Gelfand and E. j. Delp, “On tree classifiers,” in Artificial Neural Networks and Statistical Pattern Recognition: Old and New Connections. New York: NortHHolland, 1991.
24. R. J. Light and B. H. Margolin, “An analysis of variance for categorical data,” 7. Amer. Statist. Assoc., vol. 66, pp. 534-544, 1971.