Comparing support vector machines with gaussian kernels to radial basis function classifiers

IEEE Transactions on Signal Processing

Volumn 45, Issue 11, 1997, Pages 2758-2765

  Schölkopf, Bernhard ^a   Sung, Kah Kay ^a   Burges, Chris J C ^a   Girosi, Federico ^a   Niyogi, Partha ^a   Poggio, Tomaso ^a   Vapnik, Vladimir ^a  

^a MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

Author keywords

Clustering; Pattern recognition; Prototypes; Radial basis function networks; Support vector machines

Indexed keywords

ALGORITHMS; BACKPROPAGATION; DATABASE SYSTEMS; LEARNING SYSTEMS; MATHEMATICAL MODELS; NEURAL NETWORKS; OPTIMIZATION; STATISTICAL METHODS;

RADIAL BASIS FUNCTION (RBF) CLASSIFIERS; SUPPORT VECTOR (SV) MACHINES;

PATTERN RECOGNITION SYSTEMS;

EID: 0031272926     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/78.650102     Document Type: Article

References (27)

1. M. Aizerman, E. Braverman, and L. Rozonoer, "Theoretical foundations of the potential function method in pattern recognition learning," Automat. Remote Contr.. vol. 25, pp. 821-837, 1964.
2. A. Barron, "Predicted squared error: A criterion for automatic model selection," in Self-Organizing Methods in Modeling, S. Farlow, Ed. New York: Marcel Dekker, 1984.
3. B. E. Böser, I. M. Guyon, and V. Vapnik, "A training algorithm for optimal margin classifiers," in Fifth Anna. Workshop Comput. Learning Theory, Pittsburgh, PA, 1992, pp. 144-152.
4. C. J. C. Burges, "Simplified support vector decision rules," in Proc. 13th Int. Conf. Machine Learning, L. Saitta, Ed. San Mateo, CA: Morgan Kaufmann, 1996.
5. C. J. C. Burges and B. Schölkopf, "Improving the accuracy and speed of support vector machines," in Advances in Neural Information Processing Systems 9, M. Mozer, M. Jordan, and T. Petsche, Eds. Cambridge, MA: MIT Press, 1997.
6. E. I. Chang and R. L. Lippmann, "A boundary hunting radial basis function classifier which allocates centers constructively," in Advances in Neural Information Processing Systems 5, S. J. Hanson, J. D. Cowan, and C. L. Giles, Eds. San Mateo, CA: Morgan Kaufmann, 1993.
7. C. Cortes and V. Vapnik, "Support vector networks," Machine Learning, vol. 20, pp. 273-297, 1995.
8. R. O. Duda and P. E. Hart, Pattern Classification and Scene Analysis. New York: Wiley, 1973.
9. J. B. Hampshire and A. Waibel, "A novel objective function for improved phoneme recognition using time-delay neural networks," IEEE Trans. Neural Networks, vol. 1, pp. 216-228, 1990.
10. Y. Le Cun et al., "Backpropagation applied to handwritten zip code recognition," Neural Comput., vol. 1, pp. 541-551, 1989.
11. S. P. Lloyd, "Least squares quantization in PCM," IEEE Trans. Inform. Theory, vol. IT-28, pp. 129-137, 1982.
12. S. Mukherjee, E. Osuna, and F. Girosi, "Nonlinear prediction of chaotic time series using a support vector machine," in Proc NNSP, 1997.
13. K.-R. Müller, A. Smola, G. Ratsch, B. Schölkopf, J. Kohlmorgen, and V. Vapnik, "Predicting time series with support vector machines," in Proc. ICANN, 1997.
14. E. Osuna, R. Freund, and F. Girosi, "Improved training algorithm for support vector machines," in Proc NNSP, 1997.
15. T. Poggio and F. Girosi, "Networks for approximation and learning," Proc. IEEE, vol. 78, pp. 1481-1497, 1990.
16. D. Reilly, L. N. Cooper, and C. Elbaum, "A neural model for category learning," Biol. Cybern., vol. 45, pp. 3511, 1982.
17. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning repre-sentations by back-propagating errors," Nature, vol. 323, pp. 533-536, 1986.
18. B. Schölkopf, C. Burges, and V. Vapnik, "Extracting support data for a given task," in Proc. First Int. Conf. Knowledge Discovery Data Mining, U. M. Fayyad and R. Uthurusamy, Eds. Menlo Park, CA: AAAI, 1995.
19. ___, "Incorporating invariances in support vector learning machines," in Proc. Artificial Neural Networks-ICANN, C. von der Malsburg, W. von Seelen, J. C. Vorbrüggen, and B. Sendhoff, Eds. Berlin, Germany: Springer, 1996, vol. 1112, pp. 47-52.
20. B. Schölkopf, A. Smola, and K.-R. Müller, "Nonlinear component analysis as a kernel eigenvalue problem," Tech. Rep. 44, Max-Planck-Institut für biologische Kybernetik, Tübingen, Germany, 1996.
21. P. Simard, Y. Le Cun, and J. Denker, "Efficient pattern recognition using a new transformation distance," in Advances in Neural Information Processing Systems 5, J. E. Moody, S. J. Hanson, and R. P. Lippmann, Eds. San Mateo, CA: Morgan Kaufmann, 1993.
22. A. Smola and B. Schölkopf, "On a kernel-based method for pattern recognition, regression, approximation and operator inversion," Tech. Rep. 1064, GMD, Berlin, 1997.
23. K. Sung, "Learning and example selection for object and pattern detection," Ph.D. thesis, Mass. Inst. Technol., Cambridge, 1995.
24. V. Vapnik, Estimation of Dependences Based on Empirical Data. Moscow: Nauka, 1979, in Russian; English translation: New York: Springer-Verlag, 1982.
25. -, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
26. V. Vapnik and A. Chervonenkis, Theory of Pattern Recognition. Moscow, Russia: Nauka, 1974, in Russian. German translation: W. Wapnik and A. Tscherwonenkis, Theorie der Zeichenerkennung. Berlin, Germany: Akademie-Verlag, 1979.
27. V. Vapnik, S. Golowich, and A. Smola, "Support vector method for function approximation, regression estimation, and signal processing," in Advances in Neural Information Processing Systems 9, M. Mozer, M. Jordan, and T. Petsche, Eds. Cambridge, MA: MIT Press, 1997.