Training and testing low-degree polynomial data mappings via linear SVM

Journal of Machine Learning Research

Volumn 11, Issue , 2010, Pages 1471-1490

  Chang, Yin Wen ^a   Hsieh, Cho Jui ^a   Chang, Kai Wei ^a   Ringgaard, Michael ^b   Lin, Chih Jen ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^b GOOGLE INC   (United States)

Author keywords

Decomposition methods; Dependency parsing; Kernel functions; Low degree polynomial mapping; Natural language processing; Support vector machines

Indexed keywords

DECOMPOSITION METHODS; DEPENDENCY PARSING; KERNEL FUNCTION; KERNEL FUNCTIONS; LOW-DEGREE POLYNOMIAL MAPPING; NATURAL LANGUAGE PROCESSING;

COMPUTATIONAL LINGUISTICS; MAPPING; NATURAL LANGUAGE PROCESSING SYSTEMS; OPERATIONS RESEARCH; POLYNOMIALS;

SUPPORT VECTOR MACHINES;

EID: 77951969231     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (36)

1. Bernhard E. Boser, Isabelle Guyon, and Vladimir Vapnik. A training algorithm for optimal margin classifiers. In Proceedings of the Fifth Annual Workshop on Computational Learning Theory, pages 144-152. ACM Press, 1992.
2. Leon Bottou. Stochastic gradient descent examples, 2007. http://leon.bottou.org/projects/ sgd.
3. Chih-Chung Chang and Chih-Jen Lin. LIBSVM: a library for support vector machines, 2001. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm.
4. Corina Cortes and Vladimir Vapnik. Support-vector network. Machine Learning, 20:273-297, 1995.
5. Rong-En Fan, Kai-Wei Chang, Cho-Jui Hsieh, Xiang-Rui Wang, and Chih-Jen Lin. LIBLINEAR: A library for large linear classification. Journal of Machine Learning Research, 9:1871-1874, 2008. URL http://www.csie.ntu.edu.tw/-cjlin/ papers/liblinear.pdf.
6. Michael Ferris and Todd Munson. Interior point methods for massive support vector machines. SIAM Journal on Optimization, 13(3):783-804, 2003. (Pubitemid 36971112)
7. E. Michael Gertz and Joshua D. Griffin. Support vector machine classifiers for large data sets. Technical Report ANL/MCS-TM-289, Argonne National Laboratory, 2005.
8. Yoav Goldberg and Michael Elhadad. splitSVM: Fast, space-efficient, non-heuristic, polynomial kernel computation for NLP applications. In Proceedings of the 46st Annual Meeting of the Association of Computational Linguistics (ACL), 2008.
9. Cho-Jui Hsieh, Kai-Wei Chang, Chih-Jen Lin, S. Sathiya Keerthi, and Sellamanickam Sundararajan. A dual coordinate descent method for large-scale linear SVM. In Proceedings of the Twenty Fifth International Conference on Machine Learning (ICML), 2008. URL http : //www. csie. ntu. edu.tw/~cjlin/ papers/cddual.pdf.
10. Chih-Wei Hsu and Chih-Jen Lin. A comparison of methods for multi-class support vector machines. IEEE Transactions on Neural Networks, 13(2):415-425, 2002.
11. Georgiana Ifrim, Gökhan Bakir, and Gerhard Weikum. Fast logistic regression for text categorization with variable-length n-grams. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 354-362, 2008.
12. Hideki Isozaki and Hideto Kazawa. Efficient support vector classifiers for named entity recognition. In Proceedings of COLING, pages 390-396, 2002.
13. Thorsten Joachims. Training linear SVMs in linear time. In Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2006.
14. Thorsten Joachims. Making large-scale SVM learning practical. In Bernhard Schölkopf, Christopher J. C. Burges, and Alexander J. Smola, editors, Advances in Kernel Methods - Support Vector Learning, Cambridge, MA, 1998. MIT Press.
15. Jin Hyuk Jung, Dianne P. O'Leary, and André L. Tits. Adaptive constraint reduction for training support vector machines. Electronic Transactions on Numerical Analysis, 31:156-177, 2008.
16. S. Sathiya Keerthi and Chih-Jen Lin. Asymptotic behaviors of support vector machines with Gaussian kernel. Neural Computation, 15(7): 1667-1689, 2003.
17. S. Sathiya Keerthi, Shirish Krishnaj Shevade, Chiranjib Bhattacharyya, and Karuturi Radha Krishna Murthy. Improvements to Platt's SMO algorithm for SVM classifier design. Neural Computation, 13:637-649, 2001.
18. S. Sathiya Keerthi, Olivier Chapelle, and Dennis DeCoste. Building support vector machines with reduced classifier complexity. Journal of Machine Learning Research, 7:1493-1515, 2006. (Pubitemid 44024591)
19. Taku Kudo and Yuji Matsumoto. Japanese dependency structure analysis based on support vector machines. In Proceedings of the 2000 Joint SIGDAT conference on Empirical methods in natural language processing and very large corpora, 2000.
20. Taku Kudo and Yuji Matsumoto. Fast methods for kernel-based text analysis. In Proceedings of the 41st Annual Meeting of the Association of Computational Linguistics (ACL), 2003.
21. John Langford, Lihong Li, and Tong Zhang. Sparse online learning via truncated gradient. Journal of Machine Learning Research, 10:771-801, 2009.
22. Yuh-Jye Lee and Olvi L. Mangasarian. RSVM: Reduced support vector machines. In Proceedings of the First SIAM International Conference on Data Mining, 2001.
23. Ross A. Lippert and Ryan M. Rifkin. Infinite-a limits for Tikhonov regularization. Journal of Machine Learning Research, 7:855-876, 2006.
24. Olvi L. Mangasarian and David R. Musicant. Successive overrelaxation for support vector machines. IEEE Transactions on Neural Networks, 10(5): 1032-1037, 1999.
25. Mitchell P. Marcus, Beatrice Santorini, and Mary Ann Marcinkiewicz. Building a Large Annotated Corpus of English: The Penn Treebank. Computational Linguistics, 19:313-330, 1993.
26. Ryan McDonald and Joakim Nivre. Characterizing the errors of data-driven dependency parsing models. In Proceedings of the Joint Conferences on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), 2007.
27. Ryan McDonald and Fernando Pereira. Online learning of approximate dependency parsing algorithms. In Proceedings of 11th Conference of the European Chapter of the Association for Computational Linguistics (EACL), pages 81-88, 2006.
28. Yvonne Moh and Joachim M. Buhmann. Kernel expansion for online preference tracking. In Proceedings of The International Society for Music Information Retrieval (ISMIR), pages 167-172, 2008.
29. Joakim Nivre. An efficient algorithm for projective dependency parsing. In Proceedings of the 8th International Workshop on Parsing Technologies (IWPT 03), 2003.
30. Joakim Nivre, Johan Hall, Jens Nilsson, Gülşen Eryiǧit, and Svetoslav Marinov. Labeled pseudoprojective dependency parsing with support vector machines. In Proceedings of the Tenth Conference on Computational Natural Language Learning (CoNLL), pages 221-225, 2006.
31. Joakim Nivre, Johan Hall, Jens Nilsson, Atanas Chanev, Gulsen Eryigit, Sandra Kubler, Svetoslav Marinov, and Erwin Marsi. MaltParser: A language-independent system for data-driven dependency parsing. Natural Language Engineering, 13(2):95-135, 2007.
32. Shai Shalev-Shwartz, Yoram Singer, and Nathan Srebro. Pegasos: primal estimated sub-gradient solver for SVM. In Proceedings of the Twenty Fourth International Conference on Machine Learning (ICML), 2007.
33. Qinfeng Shi, James Petterson, Gideon Dror, John Langford, Alex Smola, and S.V.N. Vishwanathan. Hash kernels for structured data. Journal of Machine Learning Research, 10:2615-2637, 2009.
34. Kilian Weinberger, Anirban Dasgupta, John Langford, Alex Smola, and Josh Attenberg. Feature hashing for large scale multitask learning. In Proceedings of the Twenty Sixth International Conference on Machine Learning (ICML), pages 1113-1120, 2009.
35. Hiroyasu Yamada and Yuji Matsumoto. Statistical dependency analysis with support vector machines. In Proceedings of the 8th International Workshop on Parsing Technologies (IWPT 03), 2003.
36. Guo-Xun Yuan, Kai-Wei Chang, Cho-Jui Hsieh, and Chih-Jen Lin. A comparison of optimization methods and software for large-scale 11-regularized linear classification. 2009. URL http: //www.csie.ntu.edu.tw/~cjlin/papers/11. pdf. Under revision for Journal of Machine Learning Research.