On the use of words and N-grams for Chinese information retrieval

Proceedings of the 5th international Workshop on Information Retrieval with Asian Languages, IRAL 2000

Volumn , Issue , 2000, Pages 141-148

  Nie, Jian Yun ^a   Gao, Jiangfeng ^b   Zhang, Jian ^b   Zhou, Ming ^b  

^a UNIVERSITÉ DE MONTRÉAL   (Canada)

^b MICROSOFT RESEARCH   (United States)

Author keywords

Chinese; Information retrieval; N gram; Word

Indexed keywords

INFORMATION RETRIEVAL;

BEST CHOICE; CHINESE; CHINESE DOCUMENTS; MATCHING ALGORITHM; N-GRAMS; WORD;

COMPUTATIONAL LINGUISTICS;

EID: 84918846593     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/355214.355235     Document Type: Conference Paper

References (15)

1. Buckley, C. Implementation of the SMART information retrieval system, Technical report, #85-686, Cornell University, 1985.
2. Chen, K.-J. and Kiu, S.-H. Word identification for Mandarin Chinese sentences. 5th International Conference on Computational Linguistics, 1992. pp. 101-107.
3. Harman, D. K. and Voorhees, E. M., Eds. Information Technology: The Fifth Text REtrieval Conference (TREC-5), NIST SP 500-238. Gaithersburg, National Institute of Standards and Technology, 1996.
4. Kwok, K. L. Comparing representations in Chinese information retrieval. Conference on Research and Development in Information Retrieval, ACM-SIGIR, 1997, pp. 34-41.
5. Kwok, K.L. and Grunfeld, L. TREC-5 English and Chinese retrieval experiments using PIRCS, The Fifth Text Retrieval Conference (TREC-5), NIST special publication 500-238, 1997, pp. 133-142.
6. Lee, J. H. Combining multiple evidence from different properties of weighting schemes. Conference on Research and Development in Information Retrieval, ACM-SIGIR, Seattle, 1995, pp. 180-188.
7. Lee, J. H. and Ahn, J. S. Using n-grams for Korean text retrieval. Conference on Research and Development in Information Retrieval, ACM-SIGIR, Zurich, 1996, pp. 216-224.
8. Leong, M.-K. and Zhou, H. Preliminary qualitative analysis of segmented vs. bigram indexing in Chinese, The Sixth Text Retrieval Conference (TREC-6), NIST special publication 500-240, 1998, pp. 551-557.
9. Li, B.-Y., Lien, S., Sun, C.-F. and Sun, M.-S. A maximal matching automatic Chinese word segmentation algorithm using corpus tagging for ambiguity resolution. R.O.C. Computational Linguistics Conference (ROCLING-IV), Taiwan, 1991, pp. 135-146.
10. Nie, J.-Y., Brisebois, M. and Ren, X. On Chinese text retrieval. Conference on Research and Development in Information Retrieval, ACM-SIGIR, Zurich, 1996, pp. 225-233.
11. Nie, J.-Y., Ren, F. Chinese information retrieval: using characters or words? Information Processing and Management, 1999, 35: 443-462.
12. Ogawa, Y. A new character-based indexing organization using frequency data for Japanese documents. Conference on Research and Development in Information Retrieval, ACM-SIGIR, Seattle, 1995, pp. 121-129.
13. Strzalkowski, T., Lin, F. and Perez-CarbaUo, J. Natural language information retrieval TREC-6 report, The Sixth Text Retrieval Conference (TREC- 6), NIST special publication 500-240, 1998, pp. 347-366.
14. Yao, T.-S., Zhang, G.-P. and Wu, Y.-M. A rulebased Chinese automatic segmentation system. Journal of Chinese Information Processing, 1990, 4(1): 37-43.
15. Yeh, C.-L. and Lee, H.-J. Rule-based word identification for Mandarin Chinese sentences - A unification approach. Computer processing of Chinese and Oriental Languages, 1991, 5(2): 97-118.