Dimensionality reduction via sparse support vector machines

Journal of Machine Learning Research

Volumn 3, Issue , 2003, Pages 1229-1243

  Bi, Jinbo ^a   Bennett, Kristin P ^a   Embrechts, Mark ^a   Breneman, Curt M ^b   Song, Minghu ^b  

^a RENSSELAER POLYTECHNIC INSTITUTE   (United States)

^b Research Rensselaer Polytechnic Institute   (United States)

Author keywords

Bootstrap Aggregation; Dimensionality Reduction; Model Visualization; Pattern Search; Regression; Support Vector Machines; Variable Selection

Indexed keywords

DIMENSIONALITY REDUCTION; MODEL VISUALIZATION; PATTERN SEARCH; REGRESSION; VARIABLE SELECTION;

MATHEMATICAL MODELS;

SUPPORT VECTOR MACHINES;

EID: 1542365112     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (32)

1. K. P. Bennett. Combining support vector and mathematical programming methods for classification. In B. Schölkopf, C. Burges, and A. Smola, editors, Advances in Kernel Methods - Support Vector Machines, pages 307-326, Cambridge, MA, 1999. MIT Press.
2. K. P. Bennett and E. J. Bredensteiner. Geometry in learning. In C. Gorini, E. Hart, W. Meyer, and T. Phillips, editors, Geometry at Work, Washington, D.C., 1997. Mathematical Association of America. www.rpi.edu/-bennek/geometry2.ps.
3. B. E. Boser, I. M. Guyon, and V. N. Vapnik. A training algorithm for optimal margin classifiers. In D. Haussler, editor, Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory, pages 144-152, Pittsburgh, PA, July 1992. ACM Press.
4. P. Bradley, O. Mangasarian, and J. Rosen. Parsimonious least norm approximation. Computational Optimization and Applications, 11(1):5-21, 1998.
5. L. Breiman. Bagging predictors. Machine Learning, 24(2):123-140, 1996.
6. L. Breiman. Prediction games and arcing algorithms. Neural Computation, 11(7):1493-1517, 1999.
7. C. Breneman, K. Bennett, M. Embrechts, S. Cramer, M. Song, and J. Bi. Descriptor generation, selection and model building in quantitative structure-property analysis. In Experimental Design for Combinatorial and High Throughput Materials Development, pages 203-238, 2002.
8. C. Campbell and K. P. Bennett. A linear programming approach to novelty detection. In Neural Information Processing Systems, volume 13, pages 395-401, 2000.
9. S. Chen, D. Donoho, and M. Saunders. Atomic decomposition by basis pursuit. Technical Report 479, Department of Statistics, Stanford University, May 1995.
10. J. Dennis and V. Torczon. Derivative-free pattern search methods for multidisciplinary design problems. In The Fifth AIAA/USAF/NASA/ISSMO Symposium on Multidisciplinary Analysis and Optimization, pages 922-932, American Institute of Aeronautics and Astronautics, Reston, VA, 1994.
11. M. J. Embrechts, F. A. Arciniegas, M. Ozdemir, C. M. Breneman, and K. P. Bennett. Bagging neural network sensitivity analysis for feature reduction in QSAR problems. In Proceedings of 2001 INNS - IEEE International Joint Conference on Neural Networks, volume 4, pages 2478- 2482, Washington D. C., 2001. IEEE Press.
12. U. Fayyad, G. Grinstein, and A. Wierse. Information Visualization in Data Mining and Knowledge Discovery. Morgan Kaufmann, 2001.
13. I. Guyon, J. Weston, S. Barnhill, and V. Vapnik. Gene selection for cancer classification using support vector machines. Machine Learning, 46:389-422, 2002.
14. D. Harrison and D. L. Rubinfeld. Hedonic prices and the demand for clean air. Journal of Environ. Economics and Management, 5:81-102, 1978.
15. ILOG. ILOG CPLEX 6.5 Reference Manual. ILOG CPLEX Division, Incline Village, NV, 1999.
16. I. Inza, M. Merino, P. Larranaga, J. Quiroga, B. Sierra, and M. Girala. Feature subset selection by population-based incremental learning. Technical Report no. EHU-KZAA-IK-1/99, University of the Basque Country, Spain, 1999.
17. J. Kittler. Feature selection and extraction. In T. Y. Young and K.-S. Fu, editors, Handbook of Pattern Recognition and Image Processing. Academic Press, New York, 1986.
18. R. Kohavi and G. H. John. Wrappers for feature subset selection. Artificial Intelligence, 1997(1 - 2): 273 - 323, 1997.
19. M. Kudo, P. Somol, P. Pudil, M. Shimbo, and J. Sklansky. Comparison of classifier-specific feature selection algorithms. In SSPR/SPR, pages 677-686, 2000.
20. P. McCullagh and J. A. Nelder. Generalized Linear Models. Chapman and Hall, London, 1983.
21. A. J. Miller. Subset selection in regression. In Monographs on Statistics and Applied Probability 40. London: Chapman and Hall, 1990.
22. M. Momma and K. P. Bennett. A pattern search method for model selection of support vector regression. In Proceedings of the SIAM International Conference on Data Mining, Philadelphia, Pennsylvania, 2002. SIAM.
23. B. Schölkopf, A. Smola, R. C. Williamson, and P. L. Bartlett. New support vector algorithms. Neural Computation, 12:1207-1245, 2000.
24. A. J. Smola. Learning with Kernels. Ph.D. thesis, Technische Universität Berlin, 1998.
25. A.J. Smola, B. Schölkopf, and G. Rätsch. Linear programs for automatic accuracy control in regression. In Proceedings ICANN'99, Int. Conf. on Artificial Neural Networks, Berlin, 1999. Springer.
26. M. Song, C. Breneman, J. Bi, N. Sukumar, K. Bennett, S. Cramer, and N. Tugcu. Prediction of protein retention times in anion-exchange chromatography systems using support vector machines. Journal of Chemical Information and Computer Science, 42(6):1347-1357, 2002.
27. H. Stoppiglia and G. Dreyfus. Ranking a random feature for variable and feature selection. Journal of Machine Learning Research, Special Issue on Variable/Feature Selection, 2003. In this issue.
28. R. Tibshirani. Regression selection and shrinkage via the lasso. Journal of the Royal Statistical Society Series B, 58(1):267-288, 1996.
29. V. N. Vapnik. The Nature of Statistical Learning Theory. Springer, New York, 1995.
30. W. N. Venables and B. D. Ripley. Modern Applied Statistics with S-Plus. Springer, New York, 1994.
31. J. Weston, S. Mukherjee, O. Chapelle, M. Pontil, T. Poggio, and V. Vapnik. Feature selection for SVMs. In Neural Information Processing Systems, volume 13, pages 668-674, 2000.
32. J. Yang and V. Honavar. Feature subset selection using a genetic algorithm. In J. Koza et al., editor, Genetic Programming 1997: Proceedings of the Second Annual Conference, page 380, Stanford University, CA, USA, 1997. Morgan Kaufmann.