Online adaptive decision trees

Neural Computation

Volumn 16, Issue 9, 2004, Pages 1959-1981

  Basak, Jayanta ^a  

^a INDIAN INSTITUTE OF TECHNOLOGY DELHI   (India)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; COMPARATIVE STUDY; COMPUTER SIMULATION; DECISION SUPPORT SYSTEM; DECISION TREE; DISCRIMINANT ANALYSIS; HUMAN; LEARNING; NONPARAMETRIC TEST; ONLINE SYSTEM; PHYSIOLOGY; SIGNAL PROCESSING;

COMPUTER SIMULATION; DECISION MAKING, COMPUTER-ASSISTED; DECISION TREES; DISCRIMINANT ANALYSIS; HUMANS; LEARNING; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); ONLINE SYSTEMS; SIGNAL PROCESSING, COMPUTER-ASSISTED; STATISTICS, NONPARAMETRIC;

EID: 3142665996     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/0899766041336396     Document Type: Article

References (44)

1. Albers, S. (1996). Competitive online algorithms (Tech. Rep. No. BRIGS Lecture Series LS-96-2). Aarhus, Denmark: University of Aarhus.
2. Amari, S. I. (1998). Natural gradient works efficiently in learning. Neural Computation, 10(2), 251-276.
3. Amari, S. I., Park, H., & Fukumizu, K. (2000). Adaptive method of realizing natural gradient learning for multilayer perceptrons. Neural Computation, 12(6), 1399-1409.
4. Barron, A. R. (1993). Universal approximation bounds for superposition of a sigmoidal function. IEEE Transactions on Information Theory, 39, 930-945.
5. Basak, J. (2001). Learning Hough transform: A neural network model. Neural Computation, 13, 651-676.
6. Bennett, K. P., Wu, D., & Auslender, L. (1998). On support vector decision trees for database marketing (Tech. Rep. No. RPI Math Report 98-100). Troy, NY: Rensselaer Polytechnic Institute.
7. Boz, O. (2000). Converting a trained neural network to a decision tree DecText - decision tree extractor. Unpublished doctoral dissertation, Lehigh University.
8. Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1983). Classification and regression trees. New York: Chapman & Hall.
9. Brodley, C. E., & Utgoff, P. E. (1995). Multivariate decision trees. Machine Learning, 19, 45-77.
10. Chien, J., Huang, C., & Chen, S. (2002). Compact decision trees with cluster validity for speech recognition. In IEEE Int. Conf. Acoustics, Speech, and Signal Processing (pp. 873-876). Orlando, FL: IEEE Signal Processing Society.
11. Cho, Y. H., Kim, J. K., & Kim, S. H. (2002). A personalized recommender system based on web usage mining and decision tree induction. Expert Systems with Applications, 23, 329-342.
12. Duda, R., & Hart, P. (1973). Pattern classification and scene analysis. New York: Wiley.
13. Duda, R., Hart, P., & Stork, D. (2001). Pattern classification (2nd ed). New York: Wiley.
14. Durkin, J. (1992). Induction via ID3. AI Expert, 7, 48-53.
15. Fayyad, U. M., & Irani, K. B. (1992). On the handling of continuous-values attributes in decision tree generation. Machine Learning, 8, 87-102.
16. Friedman, J. H. (1991). Multivariate adaptive regression splines. Annals of Statistics, 19, 1-141.
17. Friedman, J. H., Kohavi, R., & Yun, Y. (1996). Lazy decision trees. In H. Shrobe & T. Senator (Eds.), Proceedings of the Thirteenth National Conference on Artificial Intelligence and the Eighth Innovative Applications of Artificial Intelligence Conference (pp.S 717-724). Menlo Park, CA: AAAI Press.
18. Garner, S. (1995). Weka: The Waikato environment for knowledge analysis. In Proc. of the New Zealand Computer Science Research Students Conference (pp. 57-64). Hamilton, New Zealand: University of Waikato.
19. Golea, M., & Marchand, M. (1990). A growth algorithm for neural network decision trees. Europhysics Letters, 12, 105-110.
20. Haykin, S. (1999). Neural networks: A comprehensive foundation. Upper Saddle River, NJ: Prentice Hall.
21. Hohil, M. E., Liu, D., & Smith, S. H. (1999). Solving the N-bit parity problem using neural networks. Neural Networks, 12, 1321-1323.
22. Jain, A. K., Duin, R. P. W., & Mao, J. (2000). Statistical pattern recognition: A review. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22, 4-37.
23. Jordan, M. (1995). Why the logistic function? A tutorial discussion on probabilities and neural networks. Available online at: http://citeseer.nj.nec. com/jordan95why.html.
24. Jordan, M. I., & Jacobs, R. A. (1993). Hierarchical mixtures of experts and the EM algorithm (Tech. Rep. No. AI Memo 1440). Cambridge, MA: MIT.
25. Jordan, M. I., & Jacobs, R. A. (1994). Hierarchical mixtures of experts and the EM algorithm. Neural Computation, 6, 181-214.
26. Kalai, A., & Vempala, S. (n.d.). Efficient algorithms for online decision. Available online at: http://citeseer.nj.nec.com/585165.html.
27. Lavretsky, E. (2000). On the exact solution of the parity-N problem using ordered neural networks. Neural Networks, 13, 643-649.
28. Lee, S.-J., Jone, M.-T., & Tsai, H.-L. (1995). Construction of neural networks from decision trees. Journal of Information Science and Engineering, 11, 391-415.
29. Ljung, L., & Söderström, T. (1986). Theory and practice of recursive identification. Cambridge, MA: MIT Press.
30. Martin, D. (n.d.). Hierarchical mixture of experts. Available online at: http://www.cs.berkeley.edu/~dmartin/software/.
31. Mehta, M., Agrawal, R., & Rissanen, J. (1996). SLIQ: A fast scalable classifier for data mining. In P. M. G. Apers, M. Bouzeghoub, & G. Gardarin (Eds.), Advances in database technology - EDBT'96 (pp. 18-32). Avington, France.
32. Merz, C. J., & Murphy, P. M. (1996). UCI repository of machine learning databases (Tech. Rep.). Irvine: University of California at Irvine.
33. Murphy, K. (2001). The Bayes net toolbox for Matlab. Computing Science and Statistics, 33, 1-20.
34. Murphy, K. (2003). Bayes net toolbox for Matlab. Available online at: http://www.ai.mit.edu/~murphyk/software/index.html.
35. Murthy, S. K., Kasif, S., & Salzberg, S. (1994). A system for induction of oblique decision trees. Journal of Artificial Intelligence Research, 2, 1-32.
36. Quinlan, J. R. (1993). Programs for machine learning. San Francisco: Morgan Kaufmann.
37. Quinlan, J. R. (1996). Improved use of continuous attributes in C4.5. Journal of Artificial Intelligence, 4, 77-90.
38. Riley, M. D. (1989). Some applications of tree based modeling to speech and language indexing. In Proc. DARPA Speech and Natural Language Workshop (pp. 339-352). San Francisco: Morgan Kaufmann.
39. Salzberg, S., Delcher, A. L., Fasman, K. H., & Henderson, J. (1998). A decision tree system for finding genes in DNA. Journal of Computational Biology, 5, 667-680.
40. Strömberg, J. E., Zrida, J., & Isaksson, A. (1991). Neural trees - using neural nets in a tree classifier structure. In Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (pp. 137-140). Toronto: IEEE Signal Processing Society.
41. Utgoff, P. E., Berkman, N. C., & Clouse, J. A. (1997). Decision tree induction based on efficient tree restructuring. Machine Learning, 29(1), 5-44.
42. Witten, I. H., & Frank, E. (2000). Data mining: Practical machine learning tools and techniques with Java implementations. San Francisco: Morgan Kaufmann.
43. Yang, Y., & Pedersen, J. O. (1997). A comparatative study on feature selection in text categorization. In D. H. Fisher (Ed.), Fourteenth Int. Conference on Machine Learning (ICMl97) (pp. 412-420). San Francisco: Morgan Kaufmann.
44. Zamir, O., & Etzioni, O. (1998). Web document clustering: A feasibility demonstration. SGIR '98: Proceedings of the 21st Annual International Conference on Research and Development in Information Retrieval (pp. 46-54). New York: ACM.