N-gram statistics in english and Chinese: Similarities and differences

ICSC 2007 International Conference on Semantic Computing

Volumn , Issue , 2007, Pages 454-460

  Yang, Stewart ^a   Zhu, Hongjun ^a   Apostoli, Ariel ^a   Cao, Pei ^a  

^a GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

IMAGE SEGMENTATION; INFORMATION THEORY; SEMANTICS; STATISTICAL METHODS;

CHINESE CHARACTERS; CHINESE TEXTS; ENGLISH WORD; FREQUENCY DISTRIBUTIONS; HUMAN LANGUAGES; INTERNATIONAL CONFERENCES; N-GRAMS; WEB PAGES;

LINGUISTICS;

EID: 47749141508     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSC.2007.46     Document Type: Conference Paper

References (5)

1. J. Dean and S. Ghemawat. Mapreduce: Simplified data processing on large clusters. Proceedings of OSDI'04: Sixth Symposium on Operating System Design and Implementation, 2004.
2. T. E. Dunning. Accurate methods for the statistics of surprise and coincidence. Computational Linguistics, 19(1):61-74, 1993.
3. A. Franz and B. Milch. Searching the web by voice. Proceedings of the 19th international conference on Computational linguistics, 2:1-5, 2002.
4. D. Lin and P. Pantel. Concept discovery from text.
5. G. K. Zipf. Relative frequency as a determinant of phonetic change. Reprinted from the Harvard Studies in Classical Philiology, XL, 1929.