Use of the zero-norm with linear models and kernel methods

Journal of Machine Learning Research

Volumn 3, Issue , 2003, Pages 1439-1461

  Weston, Jason ^a,b   Elisseeff, André ^a,b   Schölkopf, Bernhard ^a,b   Tipping, Mike ^c  

^a BIOwulf Technologies   (United States)

^b MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

^c MICROSOFT RESEARCH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

KERNEL METHODS; MICROARRAY DATA; MULTI-CATEGORY CLASSIFICATION; PRACTICAL METHOD; SIMPLE MODIFICATIONS; TRAINING DATA; TRAINING ERRORS; VARIABLE AND FEATURE SELECTION;

ARTIFICIAL INTELLIGENCE; SOFTWARE ENGINEERING;

ITERATIVE METHODS;

EID: 84890520049     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (32)

1. M. Aizerman, E. Braverman, and L. Rozonoer. Theoretical foundations of the potential function method in pattern recognition learning. Automation and Remote Control, 25:821 - 837, 1964.
2. A.A. Alizadeh. Distinct types of diffues large b-cell lymphoma identified by gene expression profiling. Nature, 403:503-511, 2000.
3. U. Alon, N. Barkai, D. Notterman, K. Gish, S. Ybarra, D. Mack, and A. Levine. Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon cancer tissues probed by oligonucleotide arrays. Cell Biology, 96:6745-6750, 1999.
4. E. Amaldi and V. Kann. On the approximability of minimizing non zero variables or unsatisfied relations in linear systems. Theoretical Computer Science, 209:237-260, 1998.
5. K. P. Bennett and O. L. Mangasarian. Robust linear programming discrimination of two linearly inseparable sets. Optimization Methods and Software, 1:23-34, 1992.
6. A. Blum and P. Langley. Selection of relevant features and examples in machine learning. Artificial Intelligence, 97:245-271, 1997.
7. B. Boser, I. Guyon, and V. Vapnik. A training algorithm for optimal margin classifiers. In Fifth Annual Workshop on Computational Learning Theory, pages 144-152, Pittsburgh, 1992. ACM.
8. P. S. Bradley and O. L. Mangasarian. Feature selection via concave minimization and support vector machines. In Proc. 13th ICML, pages 82-90, San Francisco, CA, 1998.
9. P. S. Bradley and O. L. Mangasarian. Massive data discrimination via linear support vector machines. Optimization Methods and Software, 13(1):1-10, 2000. URL citeseer.nj.nec.com/bradley98massive.html.
10. P. S. Bradley, O. L. Mangasarian, and W. N. Street. Feature selection via mathematical programming. Technical Report 95-21, Computer Sciences Department, University ofWisconsin, Madison,Wisconsin, 1995. To appear in INFORMS Journal on Computing 10, 1998.
11. C. Cortes and V. Vapnik. Support vector networks. Machine Learning, 20:273 - 297, 1995.
12. R. Courant and D. Hilbert. Methods of Mathematical Physics, volume 1. Interscience Publishers, Inc, New York, 1953.
13. M. Franke and P. Wolfe. An algorithm for quadratic programming. Naval Research Logistics Quarterly 3, pages 95-110, 1956.
14. Y. Freund and R. Schapire. Large margin classification using the perceptron algorithm. In COLT, 1998.
15. G. Fung, O. L. Mangasarian, and A. J. Smola. Minimal kernel classifiers. Technical Report DMI-00-08, Data Mining Institute, University of Wisconsin, Madison, 2000. Submitted to IEEE Transactions on Pattern Analysis and Machine Intelligence.
16. I. Guyon, J. Weston, S. Barnhill, and V. Vapnik. Gene selection for cancer classification using support vector machines. Machine Learning, 2001.
17. O.L. Mangasarian. Linear and nonlinear separation of patterns by linear programming. Operations Research, 13:444-452, 1965.
18. C. Nadeau and Y. Bengio. Inference for the generalization error. Machine Learning, 2001.
19. R. M. Neal. Assessing relevance determination methods using delve. Neural Networks and Machine Learning, pages 97-129, 1998.
20. E. Osuna, R. Freund, and F. Girosi. An improved training algorithm for support vector machines. In Neural Networks for Signal Processing VII - Proceedings of the 1997 IEEEWorkshop, pages 276-285, New-York, 1997a. IEEE.
21. E. Osuna, R. Freund, and F. Girosi. Training support vector machines: An application to face detection. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Los Alamos, 1997b. Computer Society.
22. F. Pérez-Cruz, A. Navia-Vázquez, A. R. Figueiras-Vidal, and A. Artés-Rodríguez. Empirical risk minimization for support vector machines. IEEE Transaction on Neural Networks, 2002. Submitted for publication.
23. F. Rosenblatt. The perceptron: A probabilistic model for information storage and organization in the brain. Psychological Review, 65(6):386-408, 1958.
24. B. Schölkopf and A. J. Smola. Learning with Kernels. MIT Press, Cambridge,MA, 2002.
25. E. Takimoto and M. Warmuth. Series parallel kernels and an application to multiplicative updates. NIPS 2000 Workshop on New perspectives in Kernel based methods, 2000.
26. M. E Tipping. Sparse Bayesian learning and the relevance vector machine. Journal of Machine Learning Research, 1:211-244, 2001.
27. V. Vapnik. Estimation of Dependences Based on Empirical Data [in Russian]. Nauka, Moscow, 1979. (English translation: Springer Verlag, New York, 1982).
28. V. Vapnik. The Nature of Statistical Learning Theory. Springer Verlag, New York, 1995.
29. V. Vapnik. Statistical Learning Theory. JohnWiley and Sons, New York, 1998.
30. J. Weston, A. Elisseeff, and B. Schölkopf. Use of the ℓ0-norm with linear models and kernel methods. Technical report, 2001a. http://www.kyb.tuebingen.mpg.de/bs/people/weston/l0.
31. J. Weston, S. Mukherjee, O. Chapelle, M. Pontil, T. Poggio, and V. Vapnik. Feature selection for svms. In Neural Information Processing Systems, Cambridge,MA, 2001b. MIT Press.
32. J. Weston and C. Watkins. Multi-class support vector machines. InM. Verleysen, editor, Proceedings ESANN, Brussels, 1999. D Facto.