Automatic Korean word spacing using Pegasos algorithm

Information Processing and Management

Volumn 49, Issue 1, 2013, Pages 370-379

  Lee, Changki ^a   Kim, Hyunki ^b  

^a Kangwon National University   (South Korea)

^b Electronics and Telecommunications Research Institute (ETRI)   (South Korea)

Author keywords

Automatic Korean word spacing; Pegasos algorithm; Structural SVMs

Indexed keywords

INDEPENDENCE ASSUMPTION; LOSS OF PERFORMANCE; STRUCTURAL SVMS; WORD-SPACING;

ALGORITHMS;

SUPPORT VECTOR MACHINES;

EID: 84870294503     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2012.05.004     Document Type: Article

References (27)

1. Bottou, L.; & Bousquet, O. (2008). The tradeoffs of large scale learning. In Proceeding of the advances in neural information processing systems.
2. Brants, T. (2000). TnT-a statistical part-of-speech tagger. In Proceedings of the applied natural language processing.
3. Choi, J. (1997). Automatic Korean spacing words correction system with bidirectional longest match strategy. In Proceedings of the Hangul and Korean information processing.
4. Chung, Y.; & Lee, J. (1999). Automatic word-segmentation at line breaks for Korean text processing. In Proceedings of the Korea society for information management 51, 86.
5. C. Goh, M. Asahara, and Y. Matsumoto Chinese word segmentation by classification of characters International Journal of Computational Linguistics and Chinese Language Processing 10 3 2005
6. Jeon, N.; & Park, H. (2000). Automatic Word-spacing of syllable bi-gram information for Korean OCR postprocessing. In Proceedings of the Hangul and Korean information processing.
7. Joachims, T. (2006). Training linear SVMs in linear time. In Proceedings of the ACM conference on knowledge discovery and data mining (KDD).
8. T. Joachims, T. Finley, and C.J. Yu Cutting-plane training of structural SVMs Machine Learning 77 1 2009
9. S. Jung, C. Lee, and G.G. Lee Using utterance and semantic level confidence for interactive spoken dialog clarification Journal of Computing Science and Engineering 2 1 2008
10. S. Kang Eojeol-block bidirectional algorithm for automatic word spacing of hangul sentences Korea Information Science Society 27 4 2000
11. Kang, S.; & Woo, C. (2001). Automatic segmentation of words using syllable bigram statistics. In Proceedings of the natural language processing pacific rim symposium.
12. K. Kim, H. Lee, and S. Lee Three-stage spacing system for Korean in sentence with no word boundaries Korea Information Science Society 25 12 1998
13. Kruengkrai, C. et al. (2009). An error-driven word-character hybrid model for joint Chinese word segmentation and POS tagging. In Proceedings of the ACL.
14. Kurohashi, S.; & Nagao, M. (1998). Japanese morphological analysis system JUMAN version 3.61. Department of Informatics, Kyoto University.
15. C. Lee, and M. Jang A modified fixed-threshold SMO for 1-slack structural SVMs ETRI Journal 32 1 2010
16. C. Lee, S. Lim, and M. Jang Large-margin training of dependency parsers using Pegasos algorithm ETRI Journal 32 3 2010
17. D. Lee, H. Rim, and D. Yook Automatic word spacing using probabilistic models based on character n-grams IEEE Intelligent Systems 22 1 2007
18. I. Milevskiy, and J. Ha A fast algorithm for Korean text extraction and segmentation from subway signboard images utilizing smartphone sensors Journal of Computing Science and Engineering 5 3 2011
19. Nakagawa, T. (2004). Chinese and Japanese word segmentation using word-level and character-level information. In Proceedings of the 20th international conference on computational linguistics.
20. Nakagawa, T.; Uchimoto, K. (2007). A hybrid approach to word segmentation and POS tagging. In Proceedings of the 45th annual meeting of the ACL on interactive poster and demonstration sessions.
21. Peng, F.; Feng, F.; & McCallum, A. (2004). Chinese segmentation and new word detection using conditional random fields. In Proceedings of the COLING.
22. Shalev-Shwartz, S.; Singer, Y.; & Srebro, N. (2007). Pegasos: Primal estimated sub-gradient solver for SVM. In Proceedings of the international conference on machine learning.
23. S. Shalev-Shwartz, Y. Singer, N. Srebro, and A. Cotter Pegasos: Primal estimated sub-gradient solver for SVM Mathematical Programming 127 1 2011 3 30
24. Stolcke, A.; Shriberg, E.; Bates, R.; Ostendorf, M.; Hakkani, D.; Plauche, M.; et al. (1998). Automatic detection of sentence boundaries and disfluencies based on recognized words. In Proceedings of the ICSLP.
25. Tsochantaridis, I.; Hofmann, T.; Joachims, T.; & Altun, Y. (2004). Support vector machine learning for interdependent and structured output spaces. In Proceedings of the international conference on machine learning.
26. Wu, Z. (1999). LDC Chinese segmenter. < http://www.ldc.upenn.edu/ Projects/Chinese/segmenter/mansegment.perl >.
27. N. Xue Chinese word segmentation as character tagging International Journal of Computational Linguistics and Chinese Language Processing 8 1 2003