A Scatter-Based Prototype Framework and Multi-Class Extension of Support Vector Machines

PLoS ONE

Volumn 7, Issue 10, 2012, Pages

  Jenssen, Robert ^a   Kloft, Marius ^b   Zien, Alexander ^c   Sonnenburg, Sören ^d   Müller, Klaus Robert ^b,e  

^a UNIVERSITY OF TROMSØ   (Norway)

^b TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

^c Molecular Health GmbH   (Germany)

^d TomTom Research ^*  (Germany)

^e Korea University   (South Korea)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CLASSIFICATION ALGORITHM; DATA ANALYSIS; MATHEMATICAL ANALYSIS; MATHEMATICAL COMPUTING; MATHEMATICAL VARIABLE; SENSITIVITY ANALYSIS; SUPPORT VECTOR MACHINE;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; DATA INTERPRETATION, STATISTICAL; HUMANS; MODELS, THEORETICAL; PATTERN RECOGNITION, AUTOMATED; SUPPORT VECTOR MACHINES;

EID: 84868100924     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0042947     Document Type: Article

References (43)

1. Cortes C, Vapnik VN, (1995) Support vector networks. Machine Learning 20: 273-297.
2. Schölkopf B, Smola AJ, Müller KR, (1998) Nonlinear Component Analysis as a Kernel Eigenvalue Problem. Neural Computation 10: 1299-1319.
3. Müller KR, Mika S, Rätsch G, Tsuda K, Schölkopf B, (2001) An Introduction to Kernel-Based Learning Algorithms. IEEE Neural Networks 12: 181-201.
4. Bennett KP, Bredensteiner EJ (2000) Duality and Geometry in SVM Classifiers. In: ICML '00: Proceedings of the Seventeenth International Conference on Machine Learning. San Francisco, CAUSA: Morgan Kaufmann Publishers Inc., pp. 57-64.
5. Mavroforakis ME, Sdralis M, Theodoridis S, (2006) A Novel SVM Geometric Algorithm Based on Reduced Convex Hulls. Pattern Recognition, International Conference on 2: 564-568.
6. Keerthi SS, Shevade SK, Bhattacharyya C, Murthy KRK, (2000) A Fast Iterative Nearest Point Algorithm for Support Vector Machine Classifier Design. IEEE Transactions on Neural Networks 11: 124-136.
7. Bordes A, Bottou L (2005) The huller: A simple and efficient online SVM. In: Machine Learning: ECML 2005. Lecture Notes in Artificial Intelligence, LNAI 3720. Heidelberg: Springer Verlag. pp. 505-512. Available: http://leon.bottou.org/papers/bordes-bottou-2005. Accessed 2012 Oct 5.
8. Nanculef R, Concha C, Allende H, Candel D, Moraga C, (2009) AD-SVMs: A Light Extension of SVMs for Multicategory Classification. Int J Hybrid Intell Syst 6: 69-79.
9. Jenssen R, Kloft M, Sonnenburg S, Zien A, Müller KR (2011) A New Scatter-Based Multi-Class Support Vector Machine. In: Proceedings of IEEE Workshop on Machine Learning for Signal Processing. Beijing, China, September 18-21.
10. Crisp DJ, Burges CJC (1999) A Geometric Interpretation of ν-SVM Classifiers. In: Advances in Neural Information Processing Systems, 11. Cambridge, MA: MIT Press. pp. 244-250.
11. Graf ABA, Bousquet O, Rätsch G, Schölkopf B, (2009) Prototype Classification: Insights from Machine Learning. Neural Computation 21: 272-300.
12. Bredensteiner EJ, Bennett KP, (1999) Multicategory Classification by Support Vector Machines. Comput Optim Appl 12: 53-79.
13. Weston J, Watkins C (1999) Support Vector Machines for Multi Class Pattern Recognition. In: Proceedings of European Symposium on Artificial Neural Networks. Bruges, Belgium, April 21-23.
14. Vapnik VN (1998) Statistical Learning Theory. New York: John Wiley and Sons.
15. Lee Y, Lin Y, Wahba G, (2004) Multicategory Support Vector Machines: Theory and Application to the Classification of Microarray Data and Satellite Radiance Data. Journal of the American Statistical Association 99: 67-81.
16. Crammer K, Singer Y, (2001) On the Algorithmic Implementation of Multiclass Kernel-based Vector Machines. Journal of Machine Learning Research 2: 265-292.
17. Bengio S, Weston J, Grangier D (2010) Label Embedding Trees for Large Multi-Class Tasks. In: Lafferty J, Williams CKI, Shawe-Taylor J, Zemel RS, Culotta A, editors. Advances in Neural Information Processing Systems. Available: http://books.nips.cc/nips23.html. Accessed 2012 Oct 5.
18. Kressel HGU, (1999) Pairwise Classification and Support Vector Machines. Advances in kernel methods: support vector learning pp. 255-268.
19. Bottou L, Cortes C, Denker JS, Drucker H, Guyon I, et al. (1994) Comparison of Classifier Methods: a Case Study in Handwritten Digit Recognition. In: ICPR94. pp. 77-82.
20. Rasmussen PM, Madsen KH, Lund TE, Hansen LK, (2011) Visualization of Nonlinear Kernel Models in Neuroimaging by Sensitivity Maps. Neuro Image 55: 1120-1131.
21. Burges CJC, (1998) A Tutorial on Support Vector Machines for Pattern Recognition. Knowledge Discovery and Data Mining 2: 121-167.
22. Mavroforakis M, Theodoridis S, (2006) A Geometric Approach to Support Vector Machine (SVM) Classification. IEEE Transactions on Neural Networks 17: 671-682.
23. Duda RO, Hart PE, Stork DG (2001) Pattern Classification, 2nd edition. New York: John Wiley and Sons.
24. Theodoridis S, Koutroumbas K (1999) Pattern Recognition. San Diego: Academic Press.
25. Platt JC (1999) Fast Training of Support Vector Machines using Sequential Minimal Optimization. In: Schölkopf B, Burges C, Smola A, editors, Advances in Kernel Methods - Support Vector Learning. Cambridge, MA: MIT Press. pp. 185-208.
26. Joachims T (1999) Making Large-Scale SVM Learning Practical. In: Schölkopf B, Burges C, Smola A, editors, Advances in Kernel Methods - Support Vector Learning. Cambridge, MA: MIT Press. pp. 169-184.
27. Schölkopf B, Mika S, Burges CJC, Knirsch P, Müller KR, et al. (1999) Input space vs. feature space in kernel-based methods. IEEE Transactions on Neural Networks 10: 1000-1017.
28. Jenssen R, (2010) Kernel Entropy Component Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 32: 847-860.
29. Cover TM, (1965) Geometrical and Statistical Properties of Systems of Linear Inequalities with Applications in Pattern Recognition. Electronic Computers, IEEE Transactions on EC-14: 326-334.
30. Schölkopf B, Smola A (2002) Learning with Kernels. Cambridge, MA: MIT Press.
31. Rifkin R, Lippert RA, (2007) Value Regularization and Fenchel Duality. J Mach Learn Res 8: 441-479.
32. Chang CC, Lin CJ (2001) LIBSVM: A Library for Support Vector Machines. Available: http://www.csie.ntu.edu.tw/~cjlin/libsvm/. Accessed 2012 Oct 5.
33. Fan RE, Chen PH, Lin CJ, (2005) Working Set Selection Using the Second Order Information for Training SVM. Journal of Machine Learning Research 6: 1889-1918.
34. Sonnenburg S, Rätsch G, Henschel S, Widmer C, Behr J, et al. (2010) The SHOGUN Machine Learning Toolbox. Journal of Machine Learning Research 11 (Jun) pp. 1799-1802.
35. Hsu CW, Lin CJ, (2002) A Comparison of Methods for Multiclass Support Vector Machines. IEEE Transactions on Neural Networks 13: 415-425.
36. Hull JJ, (1994) A Database for Handwritten Text Recognition Research. IEEE Transactions on Pattern Analysis and Machine Intelligence 16: 550-554.
37. Lecun Y, Bottou L, Bengio Y, Haffner P, (1998) Gradient-Based Learning Applied to Document Recognition. Proceedings of the IEEE 86: 2278-2324.
38. Jenssen R, Kloft M, Zien A, Sonnenburg S, Müller KR (2009) A Multi-Class Support Vector Machine based on Scatter Criteria. Technical Report 014-2009, Technische Universit at Berlin. Available: http://www.eecs.tu-berlin.de/fileadmin/f4/TechReports/2009/tr-2009-14.pdf. Accessed 2012 Oct 5.
39. Silverman BW (1986) Density Estimation for Statistics and Data Analysis. London: Chapman and Hall.
40. Hall P, Marron JS, Neeman A, (2005) Geometric Representation of High Dimension Low Sample Size Data. J R Statist Soc B 67: 427-444.
41. Qiao X, Zhang HH, Liu Y, Todd MJ, et al. (2010) Weighted Distance Weighted Discrimination and Its Asymptotic Properties. Journal of the American Statistical Association 105: 401-414.
42. Fei-Fei L, Fergus R, Perona P, (2004) Learning Generative Visual Models from Few Training Examples: an Incremental Bayesian Approach Tested on 101 Object Categories. Computer Vision and Pattern Recognition Workshop 12: 178.
43. Gehler P, Nowozin S (2009) On Feature Combination for Multiclass Object Classification. In: Proceedings of the Twelfth IEEE International Conference on Computer Vision.