Oblique multicategory decision trees using nonlinear programming

INFORMS Journal on Computing

Volumn 17, Issue 1, 2005, Pages 25-31

  Street, W Nick ^a  

^a UNIVERSITY OF IOWA   (United States)

Author keywords

Applications; Artificial intelligence; Decision trees; Machine learning; Nonlinear; Programming

Indexed keywords

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; DATA MINING; DECISION MAKING; LEARNING SYSTEMS; MATHEMATICAL MODELS; OPTIMIZATION; PARAMETER ESTIMATION; TREES (MATHEMATICS);

DECISION BOUNDARIES; DECISION TREES; SUPPORT-VECTOR MACHINES; TREE-INDUCTION ALGORITHMS;

NONLINEAR PROGRAMMING;

EID: 14644390203     PISSN: 10919856     EISSN: 15265528     Source Type: Journal    
DOI: 10.1287/ijoc.1030.0047     Document Type: Article

References (28)

1. Bennett, K. P. 1992. Decision tree construction via linear programming. M. Evans, ed. Proc. 4th Midwest Artificial Intelligence and Cognitive Sci. Soc. Conf., Midwest Artificial Intelligence and Cognitive Science Society, Utica, IL, 97-101.
2. Bennett, K. P., E. J. Bredensteiner. 1997. A parametric optimization method for machine learning. INFORMS J. Comput. 9 311-318.
3. Bennett, K. P., E. J. Bredensteiner. 2000. Geometry in learning. C. Gorini, ed. Geometry at Work, Mathematical Association of America, Washington, DC, 132-145.
4. Bennett, K. P., O. L. Mangasarian. 1992. Robust linear programming discrimination of two linearly inseparable sets. Optim. Methods Software 1 23-34.
5. Biggs, M. C. 1975. Constrained minimization using recursive quadratic programming. L. C. W. Dixon, G. P. Szergo, eds. Toward Global Optimization. North-Holland, Amsterdam, The Netherlands, 341-349.
6. Blake, C. L., C. J. Merz. 1998. UCI repository of machine learning databases. Department of Information and Computer Sciences. University of California, Irvine, CA. http://www.ics.uci.edu/~mlearn/MLRepository.html.
7. Bradley, P. S., U. M. Fayyad, O. L. Mangasarian. 1999. Mathematical programming for data mining: Formulations and challenges. INFORMS J. Comput. 11 217-238.
8. Bradley, P. S., O. L. Mangasarian, W. N. Street. 1998. Feature selection via mathematical programming. INFORMS J. Comput. 10 209-217.
9. Breiman, L., J. Friedman, R. Olshen, C. Stone. 1984. Classification and Regression Trees. Wadsworth, Inc., Pacific Grove, CA.
10. Brodley, C. E. 1995. Automatic selection of split criterion during tree growing based on node location. A. Prieditis, S. Russell, eds. Proc. 12th Internat. Conf. Machine Learning, Morgan Kaufmann, San Francisco, CA, 73-80.
11. Chen, C., O. L. Mangasarian. 1995. Smoothing methods for convex inequalities and linear complementarity problems. Math. Programming 71 51-69.
12. Chen, C., O. L. Mangasarian. 1996. Hybrid misclassification minimization. Adv. Comput. Math. 5 127-136.
13. Coleman, T., M. A. Branch, A. Grace. 1999. Optimization Toolbox for Use with MATLAB. The MathWorks, Inc., Natick, MA.
14. Fayyad, U. M. 1991. On the induction of decision trees for multiple concept learning. Ph.D. thesis, Electrical Engineering and Computer Science Department, The University of Michigan, Ann Arbor, MI.
15. Fayyad, U. M., K. Irani. 1992. The attribute selection problem in decision tree generation. Proc. 11th National Conf. Artificial Intelligence, MIT Press, San Jose, CA, 322-327.
16. Fayyad, U. M., G. Piatetsky-Shapiro, P. Smyth, R. Uthurusamy, eds. 1996. Adv. Knowledge Discovery Data Mining. AAAI Press/The MIT Press, Cambridge, MA.
17. Glover, F. 1990. Improved linear programming models for discriminant analysis. Decision Sci. 21 771-785.
18. Hertz, J., A. Krogh, R. G. Palmer. 1991. Introduction to the Theory of Neural Computation. The Advanced Book Program, Addison-Wesley, Redwood City, CA.
19. Mangasarian, O. L. 1965. Linear and nonlinear separation of patterns by linear programming. Oper. Res. 13 444-452.
20. Mangasarian, O. L. 1968. Multi-surface method of pattern separation. IEEE Trans. Inform. Theory IT-14 801-807.
21. Mangasarian, O. L. 1993. Mathematical programming in neural networks. ORSA J. Comput. 5 349-360.
22. Mangasarian, O. L. 1994. Misclassification minimization. J. Global Optim. 5 309-323.
23. Mooney, R., J. Shavlik, G. Towell, A. Gove. 1989. An experimental comparison of symbolic and connectionist learning algorithms. Proc. 11th Internat. Joint Conf. Artificial Intelligence, Detroit, MI, 775-780.
24. Murthy, S. K., S. Kasif, S. Salzberg. 1994. A system for induction of oblique decision trees. J. Artificial Intelligence Res. 2 1-33.
25. Quinlan, J. R. 1986. Induction of decision trees. Machine Learning 1 81-106.
26. Quinlan, J. R. 1993. C4.5: Programs for Machine Learning. Morgan Kaufmann, San Mateo, CA.
27. Stone, M. 1974. Cross-validatory choice and assessment of statistical predictions. J. Roy. Statist. Soc. Ser. B 36 111-147.
28. Vapnik, V. N. 1995. The Nature of Statistical Learning Theory. Springer-Verlag, New York.