Does SVM really scale up to large bag of words feature spaces?

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4723 LNCS, Issue , 2007, Pages 296-307

  Colas, Fabrice ^a   Paclík, Pavel ^b   Kok, Joost N ^a   Brazdil, Pavel ^c  

^a LEIDEN UNIVERSITY   (Netherlands)

^b DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^c UNIVERSITY OF PORTO   (Portugal)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); FEATURE EXTRACTION; PROBLEM SOLVING;

CLASSIFICATION RULES; TRAINING DOCUMENTS;

SUPPORT VECTOR MACHINES;

EID: 38049043377     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-74825-0_27     Document Type: Conference Paper

References (21)

1. [Burges and Crisp, 1999] Burges, C., Crisp, D.: Uniqueness of the svm solution. In: Proceedings of the 12th Conference on Neural Information Processing Systems, MIT Press, Cambridge, MA (1999)
2. [Chang and Lin, 2001] Chang, C.-C., Lin, C.-J.: LIBSVM: a library for support vector machines (2001)
3. [Colas and Brazdil, 2006] Colas, F., Brazdil, P.: On the behavior of svm and some older algorithms in binary text classification tasks. In: Proceedings of TSD2006, Text Speech and Dialogue, pp. 45-52 (2006)
4. [Cristianini and Shawe-Taylor, 2000] Cristianini, N., Shawe-Taylor, J.: An Introduction to Support Vector Machines and other kernel based learning methods. Cambridge University Press, Cambridge (2000)
5. [Daelemans et al., 2003] Daelemans, W., Hoste, V., De Meulder, F., Naudts, B.: Combined optimization of feature selection and algorithm parameter interaction in machine learning of language. In: Lavrač, N., Gamberger, D., Todorovski, L., Blockeel, H. (eds.) ECML 2003. LNCS (LNAI), vol. 2837, Springer, Heidelberg (2003)
6. [Davidov et al., 2004] Davidov, D., Gabrilovich, E., Markovitch, S.: Parameterized generation of labeled datasets for text categorization based on a hierarchical directory. In: Proceedings of the 27th annual international conference on Research and development in information retrieval, pp. 250-257 (2004)
7. [Dumais et al., 1998] Dumais, S., Platt, J., Heckerman, D., Sahami, M.: Inductive learning algorithms and representations for text categorization. In: CIKM '98: Proceedings of the seventh international conference on Information and knowledge management, pp. 148-155. ACM Press, New York, US (1998)
8. [Forman, 2003] Forman, G.: An extensive empirical study of feature selection metrics for text classification. Journal of Machine Learning Research 3, 1289-1305 (2003)
9. [Fürnkranz, 2002] Fürnkranz, J.: Pairwise classification as an ensemble technique. In: Elomaa, T., Mannila, H., Toivonen, H. (eds.) ECML 2002. LNCS (LNAI), vol. 2430, pp. 97-110. Springer, London, UK (2002)
10. [Joachims, 1998] Joachims, T.: Making large-scale support vector machine learning practical. In: Schölkopf, B., Burges, C., Smola, A. (eds.) Advances in Kernel Methods: Support Vector Machines, MIT Press, Cambridge, MA (1998)
11. [Liu et al., 2005] Liu, T.-Y., Yang, Y., Wan, H., Zeng, H.-J., Chen, Z., Ma, W.-Y.: Support vector machines classification with a very large-scale taxonomy. SIGKDD Exploration Newsletter 7(1), 36-43 (2005)
12. [McCallum, 1996] McCallum, A. K.: Bow: A toolkit for statistical language modeling, text retrieval, classification and clustering (1996), http://www.cs.cmu.edu/~mccallum/bow
13. [Mladenic et al., 2004] Mladenic, D., Brank, J., Grobelnik, M., Milic-Frayling, N.: Feature selection using linear classifier weights: interaction with classification models. In: SIGIR '04: Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, pp. 234-241. ACM Press, New York, US (2004)
14. [Rifkin et al., 1999] Rifkin, R., Pontil, M., Verri, A.: A note on support vector machine degeneracy. In: Algorithmic Learning Theory, 10th International Conference, ALT '99, Tokyo, Japan, December 1999, vol. 1720, pp. 252-263. Springer, Heidelberg (1999)
15. [Rousu et al., 2006] Rousu, J., Saunders, C., Szedmak, S., Shawe-Taylor, J.: Learning hierarchical multi-category text classification models. Journal of Machine Learning Research (2006)
16. [Schönhofen and Benczúr, 2006] Schönhofen, P., Benczúr, A.A.: Exploiting extremely rare features in text categorization. In: Fürnkranz, J., Scheffer, T., Spiliopoulou, M. (eds.) ECML 2006. LNCS (LNAI), vol. 4212, pp. 759-766. Springer, Heidelberg (2006)
17. [Strang, 1986] Strang, G.: Introduction to applied mathematics. Wellesley-Cambridge Press (1986)
18. [Vapnik, 1995] Vapnik, V.N.: The Nature of Statistical Theory. Information Science and Statistics. Springer, Heidelberg (1995)
19. [Yang, 2003] Yang, Y.: A scalability analysis of classifiers in text categorization. In: SIGIR-03, 26th ACM International Conference on Research and Development in Information Retrieval, ACM Press, New York, US (2003)
20. [Yang and Liu, 1999] Yang, Y., Liu, X.: A re-examination of text categorization methods. In: SIGIR '99: Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, New York, NY, USA, pp. 42-49. ACM Press, New York (1999)
21. [Zhang and Oles, 2001] Zhang, T., Oles, F.J.: Text categorization based on regularized linear classification methods. Inf. Retr. 4(1), 5-31 (2001)