Polyhedral separability through successive LP

Journal of Optimization Theory and Applications

Volumn 112, Issue 2, 2002, Pages 265-293

  Astorino, A ^a   Gaudioso, M ^b  

^a CNR   (Italy)

^b UNIVERSITY OF CALABRIA   (Italy)

Author keywords

Classification; machine learning; separability

Indexed keywords

GEOMETRY; LEARNING SYSTEMS;

CONVEX HULL; CONVEX POLYHEDRONS; ERROR-FUNCTION; FINITE POINT SETS; ITERATIVE SOLUTIONS; MACHINE-LEARNING; N-DIMENSIONAL SPACE; PIECEWISE LINEAR; PIECEWISE-LINEAR; SEPARABILITY;

PIECEWISE LINEAR TECHNIQUES;

EID: 0036117125     PISSN: 00223239     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1013649822153     Document Type: Article

References (43)

1. ELDER, J., IV, and PREGIBON, D., A Statistical Perspective on Knowledge Discovery in Databases, Advances in Knowledge Discovery and Data Mining, Edited by U. M. Fayyad, G. Piatetsky-Shapiro, P. Smyth, and R. Uthurusamy, AAAI/MIT Press, pp. 83-115, 1996.
2. STREET, W. N., and MANGASARIAN, O. L., Improved Generalization via Tolerant Training, Journal of Optimization Theory and Applications, Vol. 96, pp. 259-279, 1998.
3. SRINIVASAN, V., and KIM, Y. H., Credit Granting: A Comparative Analysis of Classification Procedures, Journal of Finance, Vol. 42, pp. 665-683, 1987.
4. CHARNES, A., COOPER, W. W., and RHODES, E., Evaluating Program and Managerial Efficiency: An Application of Data Envelopment Analysis to Program Follow Through, Management Science, Vol. 27, pp. 668-687, 1981.
5. MANGASARIAN, O. L., SETIONO, R., and WOLBERG, W. H., Pattern Recognition via Linear Programming: Theory and Application to Medical Diagnosis, Large-Scale Numerical Optimization, Edited by T. F. Coleman and Y. Li, SIAM, Philadelphia, Pennsylvania, pp. 22-31, 1990.
6. MANGASARIAN, O. L., and WOLBERG, W. H., Cancer Diagnosis via Linear Programming, SIAM News, Vol. 23, pp. 1-18, 1990.
7. MANGASARIAN, O. L., STREET, W. N., and WOLBERG, W. H., Breast Cancer Diagnosis and Prognosis via Linear Programming, Operations Research, Vol. 43, pp. 570-577, 1995.
8. JURS, P. C., Pattern Recognition Used to Investigate Multivariate Data in Analytical Chemistry, Science, Vol. 232, pp. 1219-1224, 1986.
9. MANGASARIAN, O. L., Linear and Nonlinear Separation of Patterns by Linear Programming, Operations Research, Vol. 13, pp. 444-452, 1965.
10. BENNETT, K. P., and MANGASARIAN, O. L., Robust Linear Programming Discrimination of Two Linearly Inseparable Sets, Optimization Methods and Software, Vol. 1, pp. 23-34, 1992.
11. MANGASARIAN, O. L., Arbitrary-Norm Separating Plane, Operations Research Letters, Vol. 24, pp. 15-23, 1999.
12. GLOVER, F., Improved Linear Programming Models for Discriminant Analysis, Decision Sciences, Vol. 21, pp. 771-785, 1990.
13. GRINOLD, R. C., Mathematical Programming Methods of Pattern Classification, Management Science, Vol. 19, pp. 272-289, 1972.
14. BENNETT, K. P., and MANGASARIAN, O. L., Neural Network Training via Linear Programming, Advances in Optimization and Parallel Computing, Edited by P. M. Pardalos, North Holland, Amsterdam, Holland, pp. 56-67, 1992.
15. FIESLER, E., and BEALE, R., Handbook of Neural Computation, Institute of Physics Publishing and Oxford University Press, Oxford, England, 1997.
16. HAYKIN, S., Neural Networks: A Comprehensive Foundation, Macmillan Publishing Company, 1994.
17. HERTZ, J., KROGH, A., and PALMER, R. G., Introduction to the Theory of Neural Computation, Addison-Wesley, Redwood City, California, 1991.
18. MANGASARIAN, O. L., Mathematical Programming in Neural Networks, ORSA Journal on Computing, Vol. 5, pp. 349-360, 1995.
19. RIPLEY, B. D., Pattern Recognition and Neural Network, Cambridge University Press, Cambridge, Massachussets, 1996.
20. BENNETT, K. P., On Mathematical Programming Methods and Support Vector Machines, Advances in Kernel Methods: Support Vector Machines, Edited by A. Schoelkopf, C. Burges, and A. Smola, MIT Press, Cambridge, Massachusetts, 1999.
21. BRADLEY, P. S., and MANGASARIAN, O. L., Feature Selection via Concave Minimization and Support Vector Machines, Machine Learning, Proceedings of the 15th International Conference (ICML '98), Edited by J. Shavlik, Morgan Kaufmann, San Francisco, California, pp. 82-90, 1998.
22. BRADLEY, P. S., and MANGASARIAN, O. L., Massive Data Discrimination via Linear Support Vector Machines, Optimization Methods and Software, Vol. 13, pp. 1-10, 2000.
23. BURGES, C. J. C., A Tutorial on Support Vector Machines for Pattern Recognition, Data Mining and Knowledge Discovery, Vol. 2, pp. 121-167, 1998.
24. JOACHIMS, T., Making Large-Scale SVM Learning Practical, Advances in Kernel Methods: Support Vector Learning, Edited by B. Schoelkopf, C. Burges, and A. Smola, MIT Press, Cambridge, Massachusetts, 1999.
25. MANGASARIAN, O. L., and MUSICANT, D. R., Successive Overrelaxation for Support Vector Machines, IEEE Transactions on Neural Networks, Vol. 10, pp. 1032-1037, 1999.
26. MANGASARIAN, O. L., and MUSICANT, D. R., Data Discrimination via Nonlinear Generalized Support Vector Machines, Applications and Algorithms of Complementarity, Edited by M. C. Ferris, O. L. Mangasarian, and J. S. Pang, Kluwer Academic Publishers, Dordrecht, Holland, 2000.
27. OSUNA, E., FREUND, R., and GIROSI, F., Support Vector Machines: Training and Applications, Memorandum, MIT Artificial Intelligence Laboratory, 1996.
28. OSUNA, E., FREUND, R., and GIROSI, F., An Improved Training Algorithm for Support Vector Machines, Proceedings of IEEE NNSP'97, Amelia Island, Florida, pp. 24-26, 1997.
29. PLATT, J., Sequential Minimal Optimization: A Fast Algorithm for Training Support Vector Machines, Advances in Kernel Methods: Support Vector Learning, Edited by B. Schoelkopf, C. Burges, and A. Smola, MIT Press, Cambridge, Massachusetts, pp. 185-208, 1999.
30. VAPNIK, V. N., The Nature of Statistical Learning Theory, Springer, New York, NY, 1995.
31. BENNETT, K. P., Decision Tree Construction via Linear Programming, Proceedings of the 4th Midwest Artificial Intelligence and Cognitive Science Society Conference, Utica, Illinois, pp. 97-101, 1992.
32. BENNETT, K. P., and MANGASARIAN, O. L., Bilinear Separation of Two Sets in n-Space, Computational Optimization and Applications, Vol. 2, pp. 207-227, 1993.
33. BENNETT, K. P., Global Tree Optimization: A Nongreedy Decision-Tree Algorithm, Computing Science and Statistics, Vol. 26, pp. 156-160, 1994.
34. BENNETT, K. P., and BLUE, J., Optimal Decision Trees, Mathematics Report 96-214, Rensselaer Polytechnic Institute, Troy, NY, 1996.
35. BENNETT, K. P., and BLUE, J., A Support Vector Machine Approach to Decision Trees, Mathematics Reports 97-100, Rensselaer Polytechnic Institute, Troy, NY, 1997.
36. BENNETT, K. P., and BREDENSTEINER, E., Feature Minimization within Decision Trees, Computational Optimization and Applications, Vol. 10, pp. 111-126, 1998.
37. MANGASARIAN, O. L., Multisurface Method of Pattern Separation, IEEE Transactions on Information Theory, Vol. 14, pp. 801-807, 1968.
38. BENNETT, K. P., and MANGASARIAN, O. L., Bilinear Separation of Two Sets in n-Space, Computational Optimization and Applications, Vol. 2, pp. 207-227, 1993.
39. MEGIDDO, N., On the Complexity of Polyhedral Separability, Discrete and Computational Geometry, Vol. 3, pp. 325-337, 1988.
40. TARDELLA, F., Piecewise Concavity and Discrete Approaches to Continuous Minmax Problems, Approximation and Complexity in Numerical Optimization: Continuous and Discrete Problems, Edited by P. M. Pardalos, Kluwer Academic Publishers, Dordrecht, Holland, 1999.
41. CHEN, C., and MANGASARIAN, O. L., Hybrid Misclassification Minimization, Advances in Computational Mathematics, Vol. 5, pp. 127-136, 1996.
42. BENNETT, K. P., and BREDENSTEINER, E. J., A Parametric Optimization Method for Machine Learning, INFORMS Journal on Computing, Vol. 9, pp. 311-318, 1997.
43. MANGASARIAN, O. L., Misclassification Minimization, Journal of Global Optimization, Vol. 5, pp. 309-323, 1994.