Robust and efficient multiclass SVM models for phrase pattern recognition

Pattern Recognition

Volumn 41, Issue 9, 2008, Pages 2874-2889

  Wu, Yu Chieh ^a   Lee, Yue Shi ^b   Yang, Jie Chi ^a  

^a NATIONAL CENTRAL UNIVERSITY   (Taiwan)

^b MING CHUAN UNIVERSITY   (Taiwan)

Author keywords

Machine learning; Multiclass classification; Natural language processing; Support vector machines

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTATIONAL COMPLEXITY; COST ACCOUNTING; SUPPORT VECTOR MACHINES;

COMPUTATIONAL TIME COMPLEXITY; MULTICLASS CLASSIFICATION;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 44649101311     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2008.02.010     Document Type: Article

References (46)

1. Abney S. Parsing by chunks. Principle-Based Parsing (1991) 257-278
2. M. Surdeanu, S. Harabagiu, J. Williams, P. Aarseth, Using predicate-argument structures for information extraction, in: Proceedings of 41st Annual Meetings of the Association for Computational Linguistics, 2003, pp. 8-15.
3. Park S.B., and Zhang B.T. Co-trained support vector machines for large scale unstructured document classification using unlabeled data and syntactic information. Inf. Process. Manage. 40 (2004) 421-439
4. R. Florian, A. Ittycheriah, H. Jing, T. Zhang, Named entity recognition through classifier combination, in: Proceedings of Conference on Natural Language Learning, 2003, pp. 168-171.
5. P. Koehn, K. Knight, Feature-rich statistical translation of noun phrases, in: Proceedings of 41st Annual Meetings of the Association for Computational Linguistics, 2003, pp. 311-318.
6. Pradhan S., Hacioglu K., Krugler V., Ward W., Martin J.H., and Jurafsky D. Support vector learning for semantic argument classification. Mach. Learn. 60 (2004) 11-39
7. D. Gildea, M. Palmer, The necessity of parsing for predicate argument recognition, in: Proceedings of 40th Annual Meetings of the Association for Computational Linguistics, 2002, pp. 239-246.
8. A. Ratnaparkhi, A Linear observed time statistical parser based on maximum entropy models, in: Proceedings of the Second Conference on Empirical Methods in Natural Language Processing, 1997, pp. 1-10.
9. Tjong Kim Sang E.F. Transforming a chunker to a parser. Computational Linguistics in the Netherlands (2000) 177-188
10. T. Kudoh, Y. Matsumoto, Chunking with support vector machines, in: Proceedings of 2nd Meetings of the North American Chapter and the Association for the Computational Linguistics, 2001, pp. 192-199.
11. Lee Y.S., and Wu Y.C. A robust multilingual portable phrase chunking system. Expert Syst. Appl. 33 3 (2007) 1-26
12. Y.C. Wu, C.H. Chang, Y.S. Lee, A general and multi-lingual phrase chunking model based on masking method, in: Computational Linguistics and Intelligent Text Processing, Lecture Notes in Computer Science (LNCS), vol. 3878, 2006, pp. 144-155.
13. Y.C. Wu, T.K. Fan, Y.S. Lee, S.J. Yen, Extracting named entities using support vector machines, in: Knowledge Discovery in Life Science Literature, Lecture Notes in Bioinformatics (LNBI), vol. 3886, 2006, pp. 91-103.
14. Y.C. Wu, J.C. Yang, Y.S. Lee, S.J. Yen, Efficient and robust phrase chunking using support vector machines, in: Information Retrieval Technology, Lecture Notes in Computer Science (LNCS), vol. 4182, 2006, pp. 350-361.
15. Carreras X., Marquez L., and Castro J. Filtering-ranking perceptron learning for partial parsing. Mach. Learn. 59 (2005) 1-31
16. Zhang T., Damerau F., and Johnson D. Text chunking based on a generalization winnow. J. Mach. Learn. Res. 2 (2002) 615-637
17. Molina A., and Pla F. Shallow parsing using specialized HMMs. J. Mach. Learn. Res. 2 (2002) 595-613
18. Tjong Kim Sang E.F. Memory-based shallow parsing. J. Mach. Learn. Res. 2 (2002) 559-594
19. R.K. Ando, T. Zhang, A high-performance semi-supervised learning method for text chunking, in: Proceedings of 43rd Annual Meetings of the Association for Computational Linguistics, 2005, pp. 1-9.
20. Goh C.L., Asahara M., and Matsumoto Y. Chinese word segmentation by classification of characters. Int. J. Comput. Linguist. Chin. Lang. Process. 10 3 (2005) 381-396
21. Cortes C., and Vapnik V. Support-vector networks. Mach. Learn. 20 3 (1995) 273-297
22. J. Giménez, L. Márquez, Fast and accurate part-of-speech tagging: the SVM approach revisited, in: Proceedings of the International Conference on Recent Advances in Natural Language Processing, 2003, pp. 158-165.
23. Rifkin R., and Klautau A. In defense of One-vs-all classification. J. Mach. Learning Res. 5 (2004) 101-141
24. Kreßel U. Pairwise classification and support vector machines. Advances in kernel methods: support vector learning (1999) 255-268
25. Platt J.C., Cristianini N., and Shawe-Taylor J. Large margin dags for multiclass classification. Adv. Neural Inf. Process. Syst. 12 (2000) 547-553
26. Klautau A., Jevtic N., and Orlitsky A. On nearest-neighbor error-correcting output codes with application to all-pairs multiclass support vector machines. J. Mach. Learn. Res. 4 (2003) 1-15
27. Huang T.K., Weng R.C., and Lin C.J. Generalized bradley-terry models and multi-class probability estimates. J. Mach. Learn. Res. 7 (2006) 85-115
28. F. Takahashi, S. Abe, Decision-tree-based multicalss support vector machines, in: Proceedings of the 9th International Conference on Neural Information Processing, vol. 2, 2002, pp. 1418-1422.
29. W. Sun, J. Chen, A multi-class classifier based on SVM decision tree, In Forum of IEEE Comput. Intell. Soc. Electronic Letter, 2006.
30. V. Vural, J.D. Dy, A hierarchical method for multi-class support vector machines, in: Proceedings of the 21st International Conference on Machine Learning, 2004, pp. 831-838.
31. Cormen T.H., Leiserson C.E., Rivest R.L., and Stein C. Introduction to Algorithms. second ed. (2002), McGraw-Hill Higher Education
32. Crammer K., and Singer Y. On the algorithmic implementation of multiclass kernel-based vector machines. J. Mach. Learn. Res. 2 (2001) 265-292
33. Tsochantaridis T., Joachims T., Hofmann T., and Altun Y. Large margin methods for structured and interdependent output variables. J. Mach. Learn. Res. 6 (2005) 1453-1484
34. L.A. Ramshaw, M.P. Marcus, Text chunking using transformation-based learning, in: Proceedings of the 3rd Workshop on Very Large Corpora, 1995. pp. 82-94.
35. E.F. Tjong Kim Sang, J. Veenstra, Representing text chunks, in: Proceedings of 9th Conference of the European Chapter of the Association for Computational Linguistics, 1999, pp. 173-179.
36. Keerthi S.S., Chapelle O., and DeCoste D. Building support vector machines with reduced classifier complexity. J. Mach. Learn. Res. 7 (2006) 1493-1515
37. T. Joachims, Training linear SVMs in linear time, in: Proceedings of the ACM Conference on Knowledge Discovery and Data Mining, 2006, pp. 217-226.
38. Tsang I.W., Kwok J.T., and Cheung P.M. Core vector machines: fast SVM training on very large data sets. J. Mach. Learn. Res. 6 (2005) 363-392
39. E.F. Tjong Kim Sang, S. Buchholz, Introduction to the CoNLL-2000 shared task: chunking, in: Proceedings of 4th Conference on Natural Language Learning, 2000, pp. 127-132.
40. Brill E. Transformation-based error-driven learning and natural language processing: a case study in part of speech tagging. Comput. Linguist. 21 4 (1995) 543-565
41. T. Joachims, Text categorization with support vector machines: learning with many relevant features, in: Proceedings of 10th European Conference on Machine Learning, 1998, pp. 137-142.
42. Dietterich T.G. Approximate statistical tests for comparing supervised classification learning algorithms. Neural Comput. 10 (1998) 1895-1923
43. H. Li, J.J. Webster, C. Kit, T. Yao, Transductive HMM based Chinese text chunking, in: Proceedings of Natural Language Processing and Knowledge Engineering, 2003, pp. 257-262.
44. Dhillon I.S., Mallela S., and Kumar R. A divisive information-theoretic feature clustering algorithm for text classification. J. Mach. Learn. Res. 3 (2003) 1265-1287
45. E.F. Tjong Kim Sang, F.D. Meulder, Introduction to the CoNLL-2003 shared task: language-independent named entity recognition, in: Proceedings of 7th Conference on Natural Language Learning, 2003, pp. 142-147.
46. S. Buchholz, E. Marsi, A. Dubey, Y. Krymolowski, CoNLL-X shared task on multilingual dependency parsing, in: Proceedings of 10th Conference on Natural Language Learning, 2006, pp. 149-164.