Getting to grips with support vector machines: Theory

South African Statistical Journal

Volumn 38, Issue 2, 2004, Pages 93-114

  Kroon, Steve ^a   Ondin, Christian W ^b  

^a STELLENBOSCH UNIVERSITY   (South Africa)

^b UNIVERSITY OF THE SOUTH PACIFIC   (Fiji)

Author keywords

Classification; Kernel methods; Primer; SVM

Indexed keywords

EID: 18444415431     PISSN: 0038271X     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (38)

1. BERTSEKAS, D.P. (1982). Constrained optimization and Lagrange multiplier methods. Computer Science and Applied Mathematics. A Series of Monographs and Textbooks. Academic Press, Inc., New York.
2. BOSER, B.E., GUYON, I.M. & VAPNIK, V.N. (1992). A training algorithm for optimal margin classifiers. D. Haussler (editor). Proceedings of the Fifth Annual Workshop on Computational Learning Theory, pp. 144-152. ACM Press, Pittsburg, PA.
3. BROWN, M.P.S., GRUNDY, W.N., LIN, D., CRISTIANINI, N., SUGNET, C., MANUEL ARES, Jr. & HAUSSLER, D. (1999). Support vector machine classification of microarray gene expression data. UCSC-CRL 99-09, University of California, Santa Cruz, Santa Cruz, CA.
4. BURGES, C.J.C. (1998). A tutorial on support vector machines for pattern recognition. Knowledge Discovery and Data Mining, 2(2), 121-167.
5. CAMPBELL, C. (2000). Kernel methods: A survey of current techniques. Draft of a tutorial submission appearing in Neurocomputing, volume 48, pages 63-84.
6. CAMPBELL, C. & CRISTIANINI, N. (1998). Simple learning algorithms for training support vector machines. Tech. rep., Department of Engineering Mathematics, University of Bristol, Bristol.
7. CORTES, C. & VAPNIK, V. (1995). Support-Vector networks. Machine Learning, 20(3), 273-297.
8. CRAMMER, K. & SINGER, Y. (2001). On the algorithmic implementation of multiclass kernel-based vector machines. Journal of Machine Learning Research, pp. 265-292.
9. EFRON, B. (1982). The Jackknife, the Bootstrap and other resampling plans. CBMS-NSF Regional Conference Series in Applied Mathematics. Society for Industrial and Applied Mathematics, Philadelphia, Pennsylvania.
10. EVGENIOU, T., PONTIL, M. & POGGIO, T. (2000). A unified framework for regularization networks and support vector machines. Tech. Rep. A.I. Memo No. 1654/C.B.C.L. Paper No. 171, Massachusetts Institute of Technology: Artificial Intelligence Laboratory/ Center for Biological and Computational Learning (Department of Brain and Cognitive Sciences), Cambridge, Mass. Also appeared as 'Regularization Networks and Support Vector Machines' in 'Advances in Large-Margin Classifiers (Neural Information Processing) (Alexander Johannes Smola, Peter L. Bartlett, Bernhard Schölkopf, and D. Schuurmans, eds.), ch. 10, MIT Press, 2000'.
11. FERNÁNDEZ, R. (1999). Predicting time series with a local support vector regression machine. Proceedings of ACAI'99.
12. GIROSI, F., JONES, M. & POGGIO, T. (1995). Regularization theory and neural networks architectures. Neural Computation, 7(2), 219-269.
13. GUERMEUR, Y., ELISSEEFF, A. & PAUGAM-MOISY, H. (2000). A new multi-class SVM based on a uniform convergence result. S.-I. Amari, C.L. Giles, M. Gori and V. Piuri (editors). Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks (IJCNN 2000).
14. GUYON, I., BOSER, B.E. & VAPNIK, V.N. (1993). Automatic capacity tuning of very large VC-dimension classifiers. Advances in Neural Information Processing Systems 5 (NIPS'92), pp. 147-155. Morgan Kaufmann, San Mateo, CA.
15. HASTIE, T., TIBSHIRANI, R. & FRIEDMAN, J. (2001). The elements of Statistical learning: Data mining, inference and prediction. Springer Series in Statistics. Springer.
16. HAYKIN, S. (1999). Neural network: A comprehensive foundation. Prentice Hall, New Jersey, second ed. ISBN: 0-13-273350-1.
17. KOO, D. (1977). Elements of optimization. Heidelberg Science Library. Springer-Verlag.
18. KROON, R.S. (2003). Support vector machines, generalization bounds and transduction. Master's thesis, Department of Computer Science, University of Stellenbosch.
19. LEE, Y., LIN, Y. & WAHBA, G. (2001). Multicategory support vector machines. Tech. Rep. TR 1043, Department of Statistics, University of Wisconsin-Madison. To appear, Proceedings of the 33rd Symposium on the Interface.
20. MUKHERJEE, S., OSUNA, E. & GIROSI, F. (1997). Nonlinear prediction of chaotic time series using support vector machines. J. Principe, L. Gile, N. Morgan & E. Wilson (editors). Neural networks for signal processing VII - Proceedings of the 1997 IEEE Workshop, pp. 511-520. IEEE, New York.
21. MÜLLER, K.-R., SMOLA, A.J., RÄTSCH, G. SCHÖLKOPF, B., KOHLMORGEN, J. & VAPNIK, V.N. (1997). Predicting time series with support vector machines. W. Gerstner, A. Germond, M. Hasler & J.-D. Nicoud (editors). Artificial Neural Networks - ICANN '97, vol. 1327 of Lecture Notes in Computer Science, pp. 999-1004. ICANN, Springer, Berlin. ISBN 3-540-63631-5.
22. Also in 'Advances in Kernel Methods - Support Vector Learning, pages 243-253. MIT Press, Cambridge, MA, 1999' as 'Using Support Vector Machines for Time Series Prediction'.
23. PANIK, M.J. (1976). Classical optimization: Foundations and extensions. vol. 16 of Studies in Mathematical and Managerial Economics. North-Holland/American Elsevier.
24. PLATT, J.C., CRISTIANINI, N. & SHAWE-TAYLOR, J. (2000). Large margin DAGs for multiclass classification. S. Solla, T. Leen & K. Müller (editors). Advances in Neural Information Processing Systems 12. MIT Press.
25. SCHÖLKOPF, B. (1999). Support vector learning. Available on the web. Lecture notes and slides. http://www.rst.gmd.de/~bs.
26. SCHÖLKOPF, B. (2000). Statistical learning and kernel methods. Tech. Rep. MSR-TR-2000-23, Microsoft Research, Microsoft Corporation, One Microsoft Way, Redmond, WA 98052. Course notes of the Interdisciplinary College, Günne, Germany, in March 2000. http://research.microsoft.com/~bsc.
27. SCHÖLKOPF, B., SMOLA, A.J., WILLIAMSON, R.C. & BARTLETT, P.L. New support vector algorithms. Technical Report NC-TR-98-031, NeuroCOLT, UK.
28. Also appeared in Neural Computation, vol. 12, pp. 1207-1245, 2000.
29. SCHÖLKOPF, B., SUNG, K.-K., BURGES, C.J., GIROSI, F., NIYOGI, P., POGGIO, T. & VAPNIK, V.N. (1997). Comparing support vector machines with Gaussian kernels to radial basis function classifiers. IEEE Transactions on Signal Processing, 45(11), 2758-2765.
30. SMOLA, A.J. & SCHÖLKOPF, B. (1997). On a kernel-based method for pattern recognition, regression, approximation and operator inversion. Technical Report 1064, GMD FIRST.
31. Also appeared in Algorithmica, 22:211-231, 1998.
32. SMOLA, A.J. & SCHÖLKOPF, B. (1998). A tutorial on support vector regression. Tech. Rep. NC2-TR-1998-030, NeuroCOLT, Royal Holloway College, University of London.
33. Also published in Statistics and Computing 2001. http://www.neurocolt. com.
34. VAPNIK, V.N. (1982). Estimation of dependences based on empirical data. Springer Series in Statistics. Springer-Verlag. ISBN 0-387-90733-5. Translated by Samuel Kotz.
35. VAPNIK, V.N. (1995). The nature of Statistical learning theory. Springer-Verlag.
36. VAPNIK, V.N., GOLOWICH, S.E. & SMOLA, A.J. (1997). Support vector method for function approximation, regression estimation, and signal processing. M. Mozer, M.I. Jordan & T. Petsche (editors). Advances in Neural Information Processing Systems 9, pp. 281-287. MIT Press, Cambridge, MA.
37. WESTON, J.A.E. (1999). Extensions to the support vector method. Ph.D. thesis, Department of Computer Science, Royal Holloway, University of London, Egham, Surrey.
38. WESTON, J.A.E. & WATKINS, C. (1998). Multi-class support vector machines. Tech. Rep. CSD-TR-98-04, Department of Computer Science, Royal Holloway, University of London, Egham, Surrey TW20 0EX, England.