Multi-kernel support vector clustering for multi-class classification

International Journal of Innovative Computing, Information and Control

Volumn 6, Issue 5, 2010, Pages 2245-2262

  Yeh, Chi Yuan ^a   Huang, Chi Wei ^a   Lee, Shie Jue ^a  

^a NATIONAL SUN YAT SEN UNIVERSITY   (Taiwan)

Author keywords

Gradient projection; Multi class classification; Multi kernel learning; SMO; Support vector clustering

Indexed keywords

DATA SETS; DISCRIMINANT FUNCTIONS; GRADIENT PROJECTIONS; HYPERPARAMETERS; KERNEL FUNCTION; KERNEL MATRICES; MULTI-CLASS; MULTI-CLASS CLASSIFICATION; MULTI-KERNEL; MULTICLASS CLASSIFICATION PROBLEMS; SEMI-DEFINITE PROGRAMMING; SEQUENTIAL MINIMAL OPTIMIZATION; STATLOG; SUPPORT VECTOR CLUSTERING; TIME AND SPACE; TWO STAGE;

LAGRANGE MULTIPLIERS; MATHEMATICAL PROGRAMMING; VECTORS;

LEARNING ALGORITHMS;

EID: 77952973177     PISSN: 13494198     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (38)

1. C. Cortes and V. Yapnik, Support-vector network. Machine Learning 20, no.3, pp.273-297, 1995.
2. M. Pontil and A. A erri. Support vector machines for 3D object recognition, IEEE Trans, on Pattern Analysis and Machine Intelligence 20, no.6, pp.637-646, 1998. (Pubitemid 128744848)
3. H. Drucker, D. Wu and Y. Yapnik, Support, vector machines for spam categorization, IEEE Trans, on Neural Networks 10, no.5, pp.1048-1054, 1999.
4. G. Guo, S. Z. Li and K. Chan, Face recognition by support vector machines, Proc. of the 4th, IEEE International Conference on Automatic Face and Gesture Recognition, pp.196-201, 2000.
5. K. I. Kim, K. Jung, S. H. Park and H. J. Kim, Support vector machines for texture classification, IEEE Trans, on Pattern Analysis and Machine Intelligence 24, no.11, pp.1542-1550, 2002.
6. J. J. Ward, L. J. McGufiin, B. F. Buxton and D. T. Jones, Secondary structure prediction with support vector machines, Bioinforniatics 19, no.13, pp.1650-1655, 2003.
7. R.-C. Chen and S.-P. Chen, Intrusion detection using a hybrid support vector machine based on entropy and TF-IDF, International Journal of Innovative Computing. Information and, Control 4, no.2, pp.413-424, 2008.
8. O.L. Mangasarian and D. R. Musicant, Robust, linear and support, vector regression, IEEE Trans, on Pattern Analysis and Machine Intelligence 22, no.9, pp.950-955, 2000.
9. M. Kobayashi, Y. Konislii and H. Ishigaki, A lazy learning control method using support vector regression. International Journal of Innovative Computing. Information and Control 3, no.6, pp.1511-1523, 2007.
10. K. S. Ni and T. Q. Nguyen, Image suporrosolution using support vector regression, IEEE Trans. on Image Processing 16, no.6, pp.1596-1610, 2007.
11. P. Zhong and L. Wang, Support vector regression with input data uncertainty. International Journal of Innovative Computing, Information and Control 4, no.9, pp.2325-2332, 2008.
12. A. Ben-Hur, D. Horn, H. T. Siegelmann and V. Yapnik, Support vector clustering. Journal of Machine Learning Research 2, pp.125-137, 2001.
13. D. M. J. Tax and R. P. W. Duin, Support vector domain description. Pattern Recognition Letters 20, no.11-13, pp.1191-1199, 1999.
14. K. R. A Killer, S. Mika, G. Ratsoh, K. Tsuda and B. Scliolkopf, An introduction to kernel-based learning algorithms, IEEE Trans, on Neural Networks 12, no.2, pp.181-201, 2001.
15. L. Bottou, C. Cortes, J. Denker, H. Drucker, I. Guyon, L. D. Jackel, Y. LeCun, U. Miiller, E. Sackinger, P. Simard and V. Yapnik, Comparison of classifier methods: A case study in handwritten digit recognition, Proc. of the International Conference on Pattern Recognition, pp.77-87, 1994.
16. J. Friedman, Another approach to polychotomous classification. Technical Report. Department of Statistics, Stanford University, Stanford, OA, 1996.
17. J. C. Piatt, N. Cristianini and .J. Shawe-Taylor, Large margin DAGs for multiclass classification, Proc. of the Neural Information Processing Systems Conference 12, pp.547-553, 2000.
18. A. Sachs, C. Thiol and F. Sohwonkor, One-class support-vector machines for the classification of bioacoustic time series, ICGST International Journal on Artificial Intelligence and Machine Learning 6, no.4, pp.29-34, 2006.
19. B. Y. Sun and D. S Huang, Support vector clustering for multi-class classification problems, Proc. of the Congress on Evolutionary Computation, pp.1480-1485, 2003.
20. O. Chapelle, Y. Yapnik, O. Bousquet and S. Muklierjee, Choosing multiple parameters for support vector machines. Machine Learning 46, no.1-3, pp.131-159, 2002.
21. K. Duan, S. Keertlii and A. N. Poo, Evaluation of simple performance measures for tuning SYM hyperparameters, Neumconiputing. vol.51, no.4, pp.41-59, 2003.
22. F. Friedriehs and C. Igel, Evolutionary tuning of multiple svm parameters, Neuroconiput/ing. vol.64,no.Complete, pp.107-117, 2005.
23. J. T.-Y. Kwok, The evidence framework applied to support vector machines, IEEE Trans, on Neural Networks 11, no.5, pp.1162-1173, 2000.
24. Q. She, H. Su, L. Dong and J. Chu, Support vector machine with adaptive parameters in image coding. International Journal of Innovative Computing. Information and, Control 4, no.2, pp.359-367, 2008.
25. G. Lanckriot, T. D. Bie, N. Cristianini, M. Jordan and W. Noble, A statistical framework for genomic data fusion, Bioinfornuitics. vol.20, no.16, pp.2626-2635, 2004.
26. G. Lanckriot, N. Cristianini, P. Bartlett, L. E. Ghaoui and YI. I. Jordan, Learning the kernel matrix with semidefinite programming. Journal of Machine Learning Research 5, pp.27-72, 2004.
27. K. Crammer, J. Keshet and Y. Singer, Kernel design using boosting, in Advances in Neural Information Processing Systems, S. Becker, S. Thrun, K. Obermayor (wis.), MIT Press, Cambridge, MA, USA 15, pp.537-544, 2003.
28. K. P. Bennett, M. Momma and M. J. Embreehts, MARK: A boosting algorithm for heterogeneous kernel models, Proc. of the. 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp.24-31, 2002.
29. C. S. Ong, A. J. Smola and R. C. Williamson, Learning the kernel with hyperkemels. Journal of Machine Learning Research 6, pp.1043-1071, 2005.
30. I. W.-H. Tsang and J. T.-Y. Kwok, Efficient hyporkornel learning using second-order cone programming, IEEE Trans, on Neural Networks 17, no.l, pp.48-58, 2006.
31. S. Sonnenburg, G. Räetseh, C. Sehäefer and B. Scliölkopf, Large scale multiple kernel learning. Journal of Machine Learning Research 7, pp.1531-1565, 2006.
32. A. Rakotomamonjy, F. Bach, S. Canu and Y. Grandvalet, More efficiency in multiple kernel learning, Proc. of the 24th International Conference on Machine learning, pp.775-782, 2007.
33. J. C. Piatt, Fast training of support vector machines using sequential minimal optimization, in Advances in Kernel Methods: Support Vector Learning. B. Scliolkopf, C. J. C. Burgos, A. J. Smola (eds.), MIT Press, Cambridge, MA, USA, pp.185-208, 1999.
34. D. J. Newman, S. Hetticli, C. L. Blake and C. J. Merz, UCI Repository of Machine Learning Databases, 1998.
35. D. Michie, D. J. Spiegellialter and C. C. Taylor, Machine Learning. Neural and Statistical Classification, Prentice Hall, Englcwood Cliffs, N.J., 1994.
36. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines, Cambridge University Press, 2000.
37. D. P. Bertsekas, Nonlinear Programming, Second Edition, Athena Scientific, Massachusetts
38. The Math Works, Inc., Statistics Toolbox Computation Visualization Programming for Use with Matlab User's Guide, 1998.