Feature minimization within decision trees

Computational Optimization and Applications

Volumn 10, Issue 2, 1998, Pages 111-126

  Bredensteiner, Erin J ^a   Bennett, Kristin P ^a  

^a RENSSELAER POLYTECHNIC INSTITUTE   (United States)

Author keywords

Bilinear programming; Data mining; Decision trees; Feature minimization; Machine learning

Indexed keywords

BILINEAR PROGRAMMING; FEATURE MINIMIZATION; SEQUENTIAL BACKWARD ELIMINATION (SBE); SEQUENTIAL FORWARD ELIMINATION (SFE);

ALGORITHMS; DATA MINING; FEATURE EXTRACTION; LEARNING SYSTEMS; LINEAR PROGRAMMING; PARAMETER ESTIMATION; COMPUTATIONAL COMPLEXITY; TREES (MATHEMATICS);

DECISION THEORY;

BILINEAR PROGRAMMING; DATA MINING; DECISION TREES; FEATURE MINIMIZATION;

EID: 0032071865     PISSN: 09266003     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (29)

1. K.P. Bennett, "Decision tree construction via linear programming," in Proc. of the 4th Midwest Artificial Intelligence and Cognitive Science Society Conf. M. Evans (Ed.), Utica: Illinois, 1992, pp. 97-101.
2. K.P. Bennett and O.L. Mangasarian, "Neural network training via linear programming," in Advances in Optimization and Parallel Computing, P.M. Pardalos (Ed.), North Holland: Amsterdam, 1992, pp. 56-67.
3. K.P. Bennett and O.L. Mangasarian, "Bilinear separation of two sets in n-space," Computational Optimization and Applications, vol. 2, pp. 207-227, 1993.
4. K.P. Bennett and E.J. Bredensteiner, "A parametric optimization method for machine learning," INFORMS Journal on Computing, vol. 9, No. 3, pp. 311-318, 1997.
5. K.P. Bennett and E.J. Bredensteiner, "Geometry in learning," in Geometry at Work, C. Gorini, E. Hart, W. Meyer, and T. Phillips (Eds.), Mathematical Association of America: Washington, D.C., 1997. To appear.
6. L. Breiman, J. Friedman, R. Olshen, and C. Stone, Classification and Regression Trees, Wadsworth International: California, 1984.
7. C.E. Brodley and P.E. Utgoff, "Multivariate decision trees," Machine Learning, vol. 19, no. 1, pp. 45-77, 1995.
8. C. Cortes and V.N. Vapnik, "Support vector networks," Machine Learning, vol. 20, pp. 273-297, 1995.
9. Using the CPLEX Callable Library, CPLEX Optimization Inc: Incline Village, Nevada, 1994.
10. M. Frank and P. Wolfe, "An algorithm for quadratic programming," Naval Research Logistics Quarterly, vol. 3, pp. 95-110, 1956.
11. M.R. Garey and D.S. Johnson, Computers and Intractability, A Guide to the Theory of NP-Completeness, W.H. Freeman and Company: San Francisco, 1979.
12. F. Glover, "Improved linear programming models for discriminant analysis," Decision Sciences, vol. 21, pp. 771-785, 1990.
13. R.P. Gorman and T.J. Sejnowski, "Analysis of hidden units in a layered network trained to classify sonar targets," Neural Networks, vol. 1, pp. 75-89, 1988.
14. J.D. Jobson, Applied Multivariate Data Analysis Volume II: Categorical and Multivariate Methods, Springer Verlag: New York, 1992.
15. R. Kohavi and D. Sommerfield, "Feature subset selection using the wrapper method: Overfitting and dynamic search space topology," in Proceedings of the First International Conference on Knowledge Discovery and Data Mining, 1995.
16. R. Kohavi and G.H. John, "Wrappers for feature subset selection," Journal of Artificial Intelligence, 1996. To appear.
17. Z.Q. Luo, J.S. Pang, and D. Ralph, Mathematical Programs with Equilibrium Constraints, Cambridge University Press: Cambridge, England, 1996.
18. O.L. Mangasarian, "Misclassification minimization," Journal of Global Optimization, vol. 5, pp. 309-332, 1994.
19. O.L. Mangasarian, "Mathematical programming in machine learning," Nonlinear Optimization and Applications, G.D. Pillo and F. Giannessi (eds.), Proceedings of Nonlinear Optimization and Applications Workshop, Erice, June 1995, Plenum Press, New York, pp. 283-295, 1996.
20. O.L. Mangasarian, "Machine learning via polyhedral concave minimization," in Applied Mathematics and Parallel Computing - Festschrift for Klaus Ritter, S. Schaeffler, H. Fischer, B. Riedmueller (Eds.), pp. 175-188, Physica-Verlag: Germany, 1996. Technical Report 95-20, Computer Sciences Department, University of Wisconsin, Madison, Wisconsin, November 1995.
21. O.L. Mangasarian, "Machine learning via polyhedral concave minimization," in Applied Mathematics and Parallel Computing - Festschrift for Klaus Ritter, S. Schaeffler, H. Fischer, B. Riedmueller (Eds.), pp. 175-188, Physica-Verlag: Germany, 1996. Technical Report 95-20, Computer Sciences Department, University of Wisconsin, Madison, Wisconsin, November 1995.
22. O.L. Mangasarian, P.S. Bradley, and W.N. Street, "Feature selection via mathematical programming," Technical Report 95-21, Computer Sciences Department, University of Wisconsin, Madison, Wisconsin, 1995. Submitted to INFORMS Journal on Computing.
23. P.M. Murphy and D.W. Aha, "UCI repository of machine learning databases," Department of Information and Computer Science, University of California, Irvine, California, 1992.
24. S. Odewahn, E. Stockwell, R. Pennington, R. Humphreys, and W. Zumach, "Automated star/galaxy discrimination with neural networks," Astronomical Journal, vol. 103, no. 1, pp. 318-331, 1992.
25. J.R. Quinlan, C4.5: Programs for Machine Learning, Morgan Kaufmann, 1993.
26. A. Roy, L.S. Kim, and S. Mukhopadhyay, "A polynomial time algorithm for the construction and training of a class of multilayer perceptrons," Neural Networks, vol. 6, pp. 535-545, 1993.
27. M. Stone, "Cross-validatory choice and assessment of statistical predictions," Journal of the Royal Statistical Society, vol. 36, pp. 111-147, 1974.
28. W.N. Street, "Cancer diagnosis and prognosis via linear-programming-based machine learning," Technical Report 94-14 (Ph.D. thesis), Computer Sciences Department, University of Wisconsin, Madison, Wisconsin, August 1994.
29. W.H. Wolberg, W.N. Street, and O.L. Mangasarian, "Image analysis and machine learning applied to breast cancer diagnosis and prognosis," Quantitative Cytology and Histology, vol. 17, no. 2, pp. 77-87, 1995.