Kernal Width Selection for SVM Classification: A Meta-Learning Approach

International Journal of Data Warehousing and Mining (IJDWM)

Volumn 1, Issue 4, 2005, Pages 78-97

  Ali, Shawkat ^a   Smith, Kate A ^a  

^a MONASH UNIVERSITY   (Australia)

Author keywords

automatic RBF width selection; Maximum Likelihood; Nelder Mead; RBF kernel; Support Vector Machine

Indexed keywords

EID: 85001609480     PISSN: 15483924     EISSN: 15483932     Source Type: Journal    
DOI: 10.4018/jdwm.2005100104     Document Type: Article

References (36)

1. Ali, S. & Smith, K.A. (2003). Automatic parameter selection for polynomial kernel. In Proceedings of the IEEE International Conference on Information Reuse and Integration, USA (pp. 243–249).
2. Ali, S. & Smith, K.A. (2004a). Laplace kernel with automatic smoothing parameter estimation for support vector machine. Computational Management Science (submitted).
3. Ali, S. & Smith, K.A. (2004b). Automatic kernel selection for support vector machines. Neurocomputing (submitted).
4. Amari, S.-I. & Wu, S. (1999). Improving support vector machine classifiers by modifying kernel functions. Neural Networks, 12, 783–789.
5. Bennett, K.P., Wu, S., & Auslender, L. (1999). On support vector decision trees for database marketing. In Proceedings of the IEEE International Joint Conference on Neural Networks, IJCNN'99 (pp. 904–909).
6. Blake, C. & Merz, C.J. (2002). UCI repository of machine learning databases. Retrieved from http://www.ics.uci.edu /~mlearn/MLRepository.html
7. Boser, B.E., Guyon, I., & Vapnik, V.N. (1992). A training algorithm for optimal margin classifiers. In Proceedings of the Fifth Annual Workshop of Computational Learning Theory, Pittsburgh, Pennsylvania (pp. 144–152).
8. Carlos, S., Pavel, B., & Brazdil, P. (2004). A meta-learning method to select the kernel width in support vector regression. Machine Learning, 54, 195–209.
9. Chapelle, O., Vapnik, V., Bousquet, O., & Mukherjee, S. (2002). Choosing multiple parameters for support vector machines. Machine Learning, 46(1), 131–159.
10. Cortes C. & Vapnik, V. (1995). Support vector networks. Machine Learning, 20, 273–297.
11. Duin, R.P.W. (1996). A note on comparing classifier. Pattern Recognition Letters, 1, 529–536.
12. Evgeniou, T., Pontil, M., & Poggio, T. (2000). Regularization networks and support vector machines. Advances in Computational Mathematics, 13(1), 1–50.
13. Gentle, J.E. (2002). Elements of computational statistics. New York: Springer-Verlag.
14. Gunn, S.R. (1998). Support vector machines for classification and regression. Southampton, UK: University of Southampton.
15. Guyon, I., Weston, J., Barnhill, S., & Vapnik, V. (2002). Gene selection for cancer classification using support vector machines. Machine Learning, 46(1/3), 389–422.
16. Hsu, C.-W., Chang, C.-C., & Lin, C.-J. (2004). A practical guide to support vector classification (technical report). Taiwan. National Taiwan University.
17. Hyun-Chul, K., Shaoning, P., Hong-Mo, J., Daijin, K., & Sung-Yang, B. (2002). Pattern classification using support vector machine ensemble. In Proceedings of the IEEE 16th International Conference on Pattern Recognition (pp. 160–163).
18. Joachims, T. (1998). Text categorization with support vector machines: Learning with many relevant features. In Proceedings of the ECML'98, 10th European Conference on Machine Learning (pp. 137–142).
19. Lagarias, J.C., Reeds, J.A., Wright, M.H., & Wright, P.E. (1998). Convergence properties of the Nelder-Mead simplex method in low dimensions. SIAM Journal of Optimisation, 9, 112–147.
20. Lim, T.-S. (2002). Knowledge discovery central, datasets. Retrieved from http:/ /www.KDCentral.com
21. Mandenhall, W. & Sincich, T. (1995). Statistics for engineering and the sciences (4th ed.). Prentice Hall.
22. Morik, K., Brockhausen, P., & Joachims, T. (1999). Combining statistical learning with a knowledge-based approach: A case study in intensive care monitoring. In Proceedings of the 16th International Conference on Machine Learning (pp. 268–277).
23. Muller, K.-R., Mika, S., Ratsch, G., Tsuda, K., & Scholkopf, B. (2001). An introduction to kernel-based learning algorithms. IEEE Transactions on Neural Networks, 12(2), 181–201.
24. Onoda, T., Murata, H., Ratsch, G., & Muller, K.-R. (2002). Experimental analysis of support vector machines with different kernels based on non-intrusive monitoring data. In Proceedings of the IEEE International Joint Conference on Neural Networks (pp. 2186–2191).
25. Ou, Y.-Y., Chen, C.-Y., Hwang, S.-C., & Oyang, Y.-J. (2003). Expediting model selection for support vector machines based on data reduction. In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics (pp. 786–791).
26. Paab, G., Leopold, E., Larson, M., Kindermann, J., & Eickeler, S. (2002). SVM classification using sequences of phonemes and syllables. In Proceedings of the European Conference on Machine Learning, ECML, Helsinki.
27. Parrado-Hernandez, E., Mora-Jimenez, I., Arenas-Garca, J., Figueiras-Vidal, A.R., & Navia-Vazquez, A. (2003). Growing support vector classifiers with controlled complexity. Pattern Recognition, 36, 1479–1488.
28. Quinlan, R. (1993). C4.5: Programs for machine learning. San Mateo, CA: Morgan Kaufman Publishers.
29. Ross, S.M. (2000). Introduction to probability and statistics for engineers and scientists (2nd ed.). London: Academic Press.
30. Schölkopf, B. (personal communication, 2003).
31. Smith, K.A., Woo, F., Ciesielski, V., & Ibrahim, R. (2001). Modelling the relationship between problem characteristics and data mining algorithm performance using neural networks. In C. Dagli et al. (Eds.), Smart engineering system design: Neural networks, fuzzy logic, evolutionary programming, data mining, and complex systems (pp. 357–362). ASME Press.
32. Smith, K.A., Woo, F., Ciesielski, V., & Ibrahim, R. (2002). Matching data mining algorithm suitability to data characteristics using a self-organising map. In A. Abraham & M. Koppen (Eds.), Hybrid information systems (pp. 169–180). Heidelberg: Physica-Verlag.
33. Tamhane, A.C. & Dunlop, D.D. (2000). Statistics and data analysis. Prentice Hall.
34. Vapnik, V. (1995). The nature of the statistical learning theory. New York: Springer-Verlag.
35. Wan, V. & Renals, S. (2002). Evaluation of kernel methods for speaker verification and identification. In Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP'02, (pp. 669–672).
36. Weston, J. & Watkins, C. (1999). Multi-class support vector machines. In M. Verleysen (Ed.), In Proceedings of the Seventh European Symposium on Artificial Neural Networks, Bruges, Belgium.