A comparative study on thai word segmentation approaches

5th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology, ECTI-CON 2008

Volumn 1, Issue , 2008, Pages 125-128

  Haruechaiyasak, Choochart ^a   Kongyoung, Sarawoot ^a   Dailey, Matthew ^b  

^a NATIONAL ELECTRONICS AND COMPUTER TECHNOLOGY CENTER   (Thailand)

^b ASIAN INSTITUTE OF TECHNOLOGY   (Thailand)

Author keywords

Dictionary based; Machine learning algorithms; Morphological analysis; Tokenization; Word segmentation

Indexed keywords

ARTIFICIAL INTELLIGENCE; DECISION MAKING; DECISION THEORY; DECISION TREES; IMAGE SEGMENTATION; INFORMATION TECHNOLOGY; LEARNING ALGORITHMS; ROBOT LEARNING; ROOM AND PILLAR MINING; SUPPORT VECTOR MACHINES; TECHNOLOGY; TELECOMMUNICATION SYSTEMS;

COMPARATIVE STUDIES; CONDITIONAL RANDOM FIELD; DCB APPROACH; DICTIONARY-BASED; INTERNATIONAL CONFERENCES; MACHINE LEARNING ALGORITHMS; MACHINE-LEARNING; MACHINE-LEARNING TECHNIQUES; MAXIMAL MATCHING; MORPHOLOGICAL ANALYSIS; NAIVE BAYES; PRECISION AND RECALL; SUPPORT-VECTOR MACHINE; SVM ALGORITHMS; TOKENIZATION; WORD SEGMENTATION;

LEARNING SYSTEMS;

EID: 52949103647     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ECTICON.2008.4600388     Document Type: Conference Paper

References (17)

1. P. Charoenpornsawat, "Feature-based Thai Word Segmentation," Masters Thesis, Computer Engineering, Chulalongkorn University, 1999.
2. C. Haruechaiyasak et al., "A collaborative framework for collecting Thai unknown words from the web," Proc. of the COLING/ACL on Main Conference Poster Sessions, pp. 345-352, 2006.
3. A. Kawtrakul and C. Thumkanon, "A Statistical Approach to Thai Morphological Analyzer," Proc. of the 5th Workshop on Very Large Corpora, pp. 289-286, 1997.
4. C. S. G. Khoo and T. E. Loh, "Using statistical and contextual information to identify two-and three-character words in Chinese text," J. of the American Society for Information Science and Technology, 53(5):365-377, 2002.
5. C. Kruengkrai and H. Isahara, "A conditional random field framework for thai morphological analysis," Proc. of the Fifth Int. Conf on Language Resources and Evaluation (LREC-2006), 2006.
6. T. Kudo, K. Yamamoto, and Y. Matsumoto, "Applying conditional random fields to Japanese morphological analysis," Proc. of EMNLP, 2004.
7. J. Lafferty, A. McCallum, and F. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data," Proc. of the Eighteenth Int. Conf on Machine Learning (ICML), pp. 282-289, 2001.
8. S. Meknavin, P. Charoenpornsawat, and B. Kijsirikul, "Feature-Based Thai Word Segmentation," Proc. of NLPRS'97, pp. 289-296, 1997.
9. F. Peng, F. Feng, and A. McCallum, "Chinese segmentation and new word detection using conditional random fields," In Proc. of the 20th Int. Conf on Computational Linguistics(COLING). 2004.
10. Yuen Poowarawan, "Dictionary-based Thai Syllable Separation," Proceedings of the Ninth Electronics Engineering Conference, 1986.
11. V. Sornlertlamvanich, "Word Segmentation for Thai in Machine Translation System," Machine Translation, National Electronics and Computer Technology Center, Bangkok.
12. "CRF++, Yet Another CRF Toolkit", Available at: http://crfpp.sourceforge.net
13. "LEXiTRON Thai-English Dictionary", Available at: http://lexitron.nectec.or.th
14. "LIBSVM: A Library for Support Vector Machines", Available at: http://www.csie.ntu.edu.tw/cjlin/libsvm
15. "ORCHID Corpus", Available at: http://links.nectec.or.th/orchid
16. "SWATH: Smart Word Analysis for THai", Available at: http://links.nectec.or.th/download.php
17. "WEKA: Waikato Environment for Knowledge Analysis", Available at: http://www.cs.waikato.ac.nz/ml/weka/