Using statistical and contextual information to identify two- and three-character words in Chinese text

Journal of the American Society for Information Science and Technology

Volumn 53, Issue 5, 2002, Pages 365-377

  Khoo, Christopher S G ^a   Dai, Yubin ^a   Loh, Teck Ee ^b  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b DATA STORAGE INSTITUTE   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

NATURAL LANGUAGE PROCESSING SYSTEMS; TEXT PROCESSING; THESAURI; WORD PROCESSING;

CONTEXTUAL INFORMATION FORMULAS; MUTUAL INFORMATION FORMULA; WORD SEGMENTATION;

INFORMATION RETRIEVAL SYSTEMS;

EID: 0036501630     PISSN: 15322882     EISSN: None     Source Type: Journal    
DOI: 10.1002/asi.10045     Document Type: Article

References (34)

1. Natural language understanding
2. Cross-language information access to multilingual collections on the internet
3. A study of integrating Chinese word segmentation and part-of-speech tagging
4. A multiple-corpus approach to recognition of proper names in Chinese texts
5. Word association norms, mutual information and lexicography
6. A generalized unification-based LR parser for Chinese
7. Generating and evaluating domain-oriented multiword terms from texts
8. The C-value/NC-value method of automatic recognition for multi-word terms
9. Learning parameters with nested joint probability model
10. A unified approach to statistical language modeling for Chinese
11. Discovering Chinese words from unsegmented text
12. Querying across languages: A dictionary-based approach to multilingual information retrieval
13. Text segmentation for Chinese spell checking
14. On Chinese parsing without using a separate word segmenter
15. The knowledge of Chinese words segmentation
16. Descriptive-unit analysis of sentences: Toward a model natural language processing
17. Modern chinese word frequency electronic dictionary
18. Xin xi chu li yong xian dai han yu fen ci gui fan ji zi dong fen ci fang fa
19. From character to word-An application of information theory
20. Frequency-rank curves and entropy for Chinese characters and words
21. Experiments on the use of bigram mutual information in Chinese natural language processing
22. An application of information theory in Chinese word segmentation
23. Unknown word detection and segmentation of Chinese using statistical and heuristic knowledge
24. Overlapping statistical word indexing: A new indexing method for Japanese text
25. A statistical method for finding word boundaries in Chinese text
26. A stochastic finite-state word-segmentation algorithm for Chinese
27. A compression-based algorithm for Chinese word segmentation
28. Identification of unknown words from a corpus
29. An efficient Chinese word segmentation algorithm for Chinese information processing on the Internet
30. Chinese text segmentation for text retrieval: Achievements and problems
31. ACTS: An automatic chinese text segmentation system for full text retrieval
32. Combination and boundary detection approaches on Chinese indexing
33. Rule-based word identification for mandarin Chinese sentences: A unification approach