Vietnamese word segmentation with CRFS and SVMs: An investigation

PACLIC 20 - Proceedings of the 20th Pacific Asia Conference on Language, Information and Computation

Volumn , Issue , 2006, Pages 215-222

  Nguyen, Cam Tu ^a   Nguyen, Trung Kien ^a   Phan, Xuan Hieu ^b   Nguyen, Le Minh ^b   Ha, Quang Thuy ^a  

^a VIETNAM NATIONAL UNIVERSITY   (Viet Nam)

^b JAPAN ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

Author keywords

Conditional random fields; Maximum matching; Segmenting and labeling sequence data; Support vector machines; Word segmentation

Indexed keywords

ASIAN LANGUAGES; COMPUTATIONAL COSTS; CONDITIONAL RANDOM FIELD; CONDITIONAL RANDOM FIELDS (CRFS); CORPUS SIZE; LANGUAGE PROCESSING; MAXIMUM MATCHINGS; OVERALL QUALITY; SEQUENCE DATA; SIGNIFICANT IMPACTS; STATISTICAL LEARNING METHODS; SVM MODEL; WORD SEGMENTATION; FIELD VECTORS; RANDOM FIELDS; SEGMENTING AND LABELING SEQUENCE DATUM; SUPPORT VECTORS MACHINE; VIETNAMESE;

COMPUTATIONAL LINGUISTICS; CONTENT BASED RETRIEVAL; IMAGE SEGMENTATION; PATTERN RECOGNITION; RANDOM PROCESSES;

SUPPORT VECTOR MACHINES;

EID: 84863670592     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (12)

1. Ha, L.A.: A method for word segmentation in Vietnamese. Corpus Linguistics, Lancaster, UK (2003)
2. Nguyen, T.V., Tran, H.K., Nguyen, T.T.T., Nguyen, H.: Word segmentation for Vietnamese text categorization: an online corpus approach. Research, Innovation and Vision for the Future, The 4th International Conference on Computer Sciences (2006)
3. th Natural Language Processing Pacific Rim Symposium (2001), 749-756s
4. Lafferty, J., Mccallum, A., Pereira, F.: Conditional Random Fields: probabilistic models for segmenting and labeling sequence data. The 18th International Conference on Machine Learning, Massachusetts, USA (2001), 282-290
5. Liu, D.C., Nocedal, J.: On the limited memory BFGS method for large scale optimization. Mathematical Programming 45 (1989) 503-528.
6. Mai, N.C., Vu, D.N., Hoang, T.P.: Foundations of linguistics and Vietnamese. Education Publisher (1997) 142-152
7. Nguyen, H., Nguyen, H., Vu, T., Tran, N., Hoang, K.: Internet and Genetics Algorithm-based Text Classification for Documents in Vietnamese. Research, Innovation and Vision for the Future, The 3th International Conference on Computer Sciences (2005)
8. Peng, F., Feng, F., McCallum, A: Chinese Segmentation and New Word Detection using Conditional Random Fields. The 20th International Conference on Computational Linguistics (2004).
9. Rabiner: A tutorial on hidden markov models and selected applications in speech recognition. In Proc. the IEEE, 77(2):257-286, 1989.
10. Sha, F., Pereia, F.: Shallow parsing with Conditional Random Fields. Human Language Technology (2003)
11. Vapnik, V.N.: Statistical Learning Theory, Wiley-Interscience
12. Kudo, T., Matsumoto, Y.: Chunking with Support Vector Machines, The Second Meeting of the North American Chapter of the Association for Computational Linguistics (2001)