Entropy Nets: From Decision Trees to Neural Networks

Proceedings of the IEEE

Volumn 78, Issue 10, 1990, Pages 1605-1613

  Sethi, Ishwar K ^a  

^a WAYNE STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DECISION THEORY AND ANALYSIS; LEARNING SYSTEMS; MATHEMATICAL TECHNIQUES--TREES;

DECISION TREES; ENTROPY NETS; LAYERED NEURAL NETWORKS;

NEURAL NETWORKS;

EID: 0025508354     PISSN: 00189219     EISSN: 15582256     Source Type: Journal    
DOI: 10.1109/5.58346     Document Type: Article

References (28)

1. D. J. Burr, "Experiments on neural net recognition of spoken and written text," IEEE Trans. Acoust, Speech, Signal Processing, vol. 36, pp. 1162–1168, July 1988.
2. R. P. Lippmann, "An introduction to computing with neural nets," IEEE ASSP Mag., pp. 4–22, Apr. 1987.
3. A. Wieland and R. Leighton, "Geometric analysis of neural network capabilities," in Proc. IEEE Int. Conf. Neural Networks, Vol. III, San Diego, CA, June 1987, pp. 385–392.
4. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning internal representation by error propagation," in D. E. Rumelhart and J. L. McClelland, Eds., Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Vol. 1: Foundations. Cambridge, MA: M.I.T. Press, 1986.
5. D. H. Ackley, G. E. Hinton, and T. J. Sejnowski, "A learning algorithm for Boltzmann machines," Cognitive Sci., vol. 9, pp. 147–169, 1985.
6. R. Hecht-Nielsen, "Counterpropagation networks," Appl. Opt, vol. 26, pp. 4979–4984, Dec. 1987.
7. B. Widrow, R. G. Winter, and R. A. Baxter, "Layered neural nets for pattern recognition," IEEE Trans. Acoust., Speech, Signal Processing, vol. 36, pp. 1109–1118, July 1988.
8. W. Y. Huang and R. P. Lippmann, "Comparison between neural net and conventional classifers," in Proc. IEEE 1st Int. Conf. Neural Networks, Vol. IV, San Diego, CA, June 1987, pp. 485–493.
9. L. N. Kanal, "Problem-solving models and search strategies for pattern recognition," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-1, pp. 194–201, Apr. 1979.
10. H. J. Payne and W. S. Meisel, "An algorithm for constructing optimal binary decision trees," IEEE Trans. Comput., vol. C-25, pp. 905–916, Sept. 1977.
11. L. A. Akers, M. R. Walker, D. K. Ferry, and R. O. Grodin, "Limited interConnectivity in synthetic neural systems," in R. Eckmiller and C. v. d. Malsburg, Eds., Neural Computers. New York: Springer-Verlag, 1988.
12. C. R. P. Hartmann, P. K. Varshney, K. G. Mehrotra, and C. L. Gerberich, "Application of information theory to the construction of efficient decision trees," IEEE Trans. Inform. Theory, vol. IT-28, pp. 565–577, July 1982.
13. I. K. Sethi and B. Chaterjee, "Efficient decision tree design for discrete variable pattern recognition problems," Pattern Recognition, vol. 9, pp. 197–206, 1978.
14. —, "A learning classifier scheme for discrete variable pattern recognition problems," IEEE Trans. Syst., Man, Cybern., vol. SMC-8, pp. 49–52, Jan. 1978.
15. J. C. Stoffel, "A classifer design technique for discrete variable pattern recognition problems," IEEE Trans. Comput., vol. C-23, pp. 428–441, 1974.
16. E. G. Henrichon and K. S. Fu, "A nonparametric partitioning procedure for pattern classification," IEEE Trans. Comput., vol. C-18, pp. 614–624, July 1962.
17. I. K. Sethi and G. P. R. Sarvarayudu, "Hierarchical classifier design using mutual information," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-4, pp. 441–445, July 1982.
18. J. L. Talmon, "A multiclass nonparametric partitioning algorithm," in E. S. Gelsema and L. N. Kanal, Eds., Pattern Recognition in Practice II. Amsterdam: Elsevier Science Pub. B. V. (North-Holland), 1986.
19. L. Breiman, J. Friedman, R. Olshen, and C. J. Stone, Classification and Regression Trees. Belmont, CA: Wadsworth Int. Group, 1984.
20. L. Hyafil and R. L. Rivest, "Constructing optimal binary decision trees is NP-complete," Inform. Processing Lett., vol. 5, pp. 15–17, 1976.
21. R. M. Fano, Transmission of Information. New York: Wiley, 1963.
22. R. M. Goodman and P. Smyth, "Decision tree design from a communication theory standpoint," IEEE Trans. Inform. Theory, vol. 34, pp. 979–994, Sept. 1988.
23. J. R. Quinlan, "Induction of decision trees," Machine Learning, vol. 1, pp. 81–106, 1986.
24. T. Kohonen, Self-Organization and Associative Memory. Berlin: Springer-Verlag, 1984.
25. C.J. Matheus and W. E. Hohensee, "Learning in artifical neural systems," Univ. of lllnois,Urbana, Tech. Rep. TR-87-1394,1987.
26. B. Widrow and M. E. Hoff, "Adaptive switching circuits," in 1960 IRE WESCON Conv. Rec, part 4, 1960, pp. 96–104.
27. J. L. McClelland and D. E. Rumelhart, Explorations in Parallel Distributed Processing. Cambridge, MA: M.I.T. Press, 1988.
28. R. O. Duda and P. E. Hart, Pattern Classification and Scene Analysis. New York: Wiley, 1973.