Variant methods of reduced set selection for reduced support vector machines

Journal of Information Science and Engineering

Volumn 26, Issue 1, 2010, Pages 183-196

  Chien, L I Jen ^a   Chang, Chien Chung ^a   Lee, Yuh Jye ^a  

^a NATIONAL TAIWAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Taiwan)

Author keywords

Kernel methods; Kernel width estimation; Nystr m approximation; Reduced set; Sampling methods; Support vector machines

Indexed keywords

CLUSTER CENTROIDS; DATA POINTS; GAUSSIAN KERNELS; KERNEL METHODS; LARGE DATASETS; MODEL COMPLEXITY; NEW APPROACHES; RANDOM SELECTION; REDUCED SUPPORT VECTOR MACHINES; SAMPLING METHOD; SYSTEMATIC SAMPLING; TUNING TIME; VARIANT METHOD;

CLUSTERING ALGORITHMS; COMPUTATIONAL COMPLEXITY; GEARS; IMAGE RETRIEVAL; MULTILAYER NEURAL NETWORKS; VECTORS;

SUPPORT VECTOR MACHINES;

EID: 77249099817     PISSN: 10162364     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (30)

1. A. Asuncion and D. J. Newman, UCI Machine Learning Repository, University of California, School of Information and Computer Science, 2007, http://www.ics.uci. edu/~mlearn/MLRepository.html.
2. C. J. C. Burges, "A tutorial on support vector machines for pattern recognition," Data Mining and Knowledge Discovery, Vol.2, 1998, pp. 121-167. (Pubitemid 128695475)
3. C. C. Chang and Y. J. Lee, "Generating the reduced set by systematic sampling," in Proceedings of the 5th Intelligent Data Engineering and Automated Learning, LNCS 3177, 2004, pp. 720-725.
4. O. Chapelle, V. Vapnik, O. Bousquet, and S. Mukherjee, "Choosing multiple parameters for support vector machines," Machine Learning, Vol.46, 2002, pp. 131-159.
5. L. J. Chien and Y. J. Lee, "Clustering model selection for reduced support vector machines," in Proceedings of the 5th Intelligent Data Engineering and Automated Learning, LNCS 3177, 2004, pp. 714-719. (Pubitemid 39174192)
6. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines, Cambridge University Press, Cambridge, 2000.
7. H. Drucker, C. J. C. Burges, L. Kaufman, A. Smola, and V. Vapnik, "Support vector regression machines," in M. C. Mozer, M. I. Jordan, and T. Petsche, (eds.), Advances in Neural Information Processing Systems, MIT Press, Cambridge, MA, 1997, pp. 155-161,
8. MIT Center for Biological and Computation Learning, CBCL face database (1), 2000, http://cbcl.mit.edu/projects/cbcl/software-datasets/FaceData2.html.
9. C. M. Huang, Y. J. Lee, D. K. J. Lin, and S. Y. Huang, "Model selection for support vector machines via uniform design," A Special Issue on Machine Learning and Robust Data Mining of Computational Statistics and Data Analysis, Vol.52, 2007, pp. 335-346.
10. S. S. Keerthi, O. Chapelle, and D. DeCoste, "Building support vector machines with reduced classifier complexity," The Journal of Machine Learning Research, Vol.7, 2006, pp. 1493-1515. (Pubitemid 44024591)
11. S. S. Keerthi and C. J. Lin, "Asymptotic behaviors of support vector machines with Gaussian kernel," Neural Computation, Vol.15, 2003, pp. 1667-1689.
12. Y. J. Lee, W. F. Hsieh, and C. M. Huang, "ε-SSVR: A smooth vector machine for e-insensitive regression," IEEE Transactions on Knowledge and Data Engineering, Vol.17, 2005, pp. 678-685. (Pubitemid 40750826)
13. Y. J. Lee and S. Y. Huang, "Reduced support vector machines: A statistical theory," IEEE Transactions on Neural Networks, Vol.18, 2007, pp. 1-13. (Pubitemid 46062912)
14. Y. J. Lee and O. L. Mangasarian, "RSVM: reduced support vector machines," in Proceedings of the 1st SIAM International Conference on Data Mining, 2001.
15. Y. J. Lee and O. L. Mangasarian, "SSVM: a smooth support vector machine," Computational Optimization and Applications, Vol.20, 2001, pp. 5-22.
16. A. Lyhyaoui, M. Martinez, I. Mora, M. Vazquez, J. L. Sancho, and A. R. FigueirasVidal, "Sample selection via clustering to construct support vector-like classifier," IEEE Transactions on Neural Networks, Vol.10, 1999, pp. 1474-1481.
17. O. L. Mangasarian, "Generalized support vector machines," in A. Smola, P. Bartlett, B. Schölkopf, and D. Schuurmans, (eds.), Advances in Large Margin Classifiers, MIT Press, Cambridge, MA, 2000, pp. 135-146.
18. O. L. Mangasarian and D. R. Musicant, "Large scale kernel regression via linear programming," Technical Report 99-102, Data Mining Institute, Computer Sciences Department, University of Wisconsin, Madison, Wisconsin, 1999.
19. O. L. Mangasarian and D. R. Musicant, "Robust linear and support vector regression," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.22, 2000, pp. 950-955. (Pubitemid 30969601)
20. T. M. Mitchell, Machine Learning, McGraw-Hill, Boston, 1997.
21. Y. J. Oyang, S. C. Hwang, Y. Y. Ou, C. Y. Chen, and Z. W. Chen, "An novel learning algorithm for data classification with radial basis function networks," in Proceedings of the 9th International Conference on Neural Information Processing, 2001, pp. 18-22.
22. C. E. Rasmussen and Z. Ghahramani, "Occam's razor," in T. K. Leen, T. G. Dietterich, and V. Tresp, (eds.), Advances in Neural Information Processing Systems 13, MIT Press, Cambridge, MA, 2001, pp. 294-300.
23. B. W. Silverman, Density Estimation for Statistics and Data Analysis, Chapmman, Hall, London, 1986.
24. A. Smola and B. Schölkopf, "Sparse greedy matrix approximation for machine learning," in Proceedings of the 17th International Conference on Machine Learning, 2000, pp. 911-918.
25. A. Smola and B. Schölkopf, "A tutorial on support vector regression," Statistics and Computing, Vol.14, 2004, pp. 199-222.
26. C. J. Stone, "An asymptotically optimal window selection rule for kernel density estimates," Annals of Statistics, Vol.12, 1984, pp. 1285-1297.
27. V. N. Vapnik, The Nature of Statistical Learning Theory, Springer, New York, 1995.
28. C. K. I. Williams and M. Seeger, "Using the Nyström method to speed up kernel machines," in T. K. Leen, T. G. Dietterich, and V. Tresp, (eds.), Advances in Neural Information Processing Systems 13, MIT Press, Cambridge, MA, 2001, pp. 682-688.
29. I. H. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations, Morgan Kaufmann, San Francisco, CA, 1999.
30. M. Wu, B. Schölkopf, and G. Bakir, "A direct method for building sparse kernel learning algorithms," Journal of Machine Learning Research, Vol.7, 2006, pp. 603-624.