Overlapping statistical word indexing: A new indexing method for Japanese text

SIGIR Forum (ACM Special Interest Group on Information Retrieval)

Volumn 31, Issue 1 SPEC. ISS., 1997, Pages 226-234

  Ogawa, Yasushi ^a   Matsuda, Toru ^a  

^a RICOH COMPANY LTD   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

CHARACTER RECOGNITION; INDEXING (OF INFORMATION); STATISTICAL METHODS; TRANSLATION (LANGUAGES);

OVERLAPPING STATISTICAL WORD INDEXING;

INFORMATION RETRIEVAL SYSTEMS;

EID: 0030657317     PISSN: 01635840     EISSN: None     Source Type: Journal    
DOI: 10.1145/278459.258576     Document Type: Article

References (27)

1. H. Akama and F. Konishi. Application of frame association to Japanese informatin retrieval. In Proc. of Int. Workshop on Information Retrieval with Oriental Languages, pages 27-34, 1996.
2. T. Akamine and S. Fukushima. Flexible string inversion method for high-speed full text search (in Japanese). In Proc. of Advanced database system symp. '95, pages 35-42. Information Processing Society of Japan, 1996.
3. W.B. Cavnar. Using an n-gram-based document representation with a vector processing retrieval model. In Proc. of 3rd TREC, pages 269-277, 1995.
4. L.F. Chien. Fast and quasi-natural language search for gigabits of Chinese texts. In Proc. of 18th ACM SIGIR Conf., pages 112-121, 1995.
5. W.B. Frakes and R. Basza-Yates. Information Retrieval: Data Structures and Algorithms. Prentice-Hall, New Jersey, 1992.
6. H. Fujii and W. B. Croft. A comparison of indexing techniques for Japanese text retrieval. In Proc. of 16th ACM SIGIR Conf., pages 237-246, 1993.
7. H. Fujii and W. B. Croft. Comparing the retrieval performance of English and Japanese text databases. In Proc. of 2nn Workshop on Very Lage Corpora, pages 87-97, 1994.
8. K. Furuse, K. Asada, and A. Iizawa. Implementation and performance evaluation of compressed bit-sliced signature files. In Proc. of 6th Int. Conf. on Information Systems and Data Management, pages 164-177, 1995.
9. D. Harman, editor. The 4th Text REtrieval Conference (TREC-4). National Institute of Standards and Technology, 1996.
10. K. Kageura. Bigram statistics revisited: A comparative examination of some statistical measures in morphological analysis of Japanese kanji sequences. http://www.dcs.shef.ac.uk/ kyo/llc1.ps, 1996.
11. Y. Kawashimo et al. Development of full text search system Bibliotheca/TS (in Japanese). In Proc. of the 45th Zenkoku Taikai, 3, pages 241-242. Information Processing Society of Japan, 1992.
12. J.H. Lee and J.S. Ahn. Using n-grams for Korean text retrieval. In Proc. of 19th ACM SIGIR Conf., pages 216-224, 1996.
13. K. Matsui et al. Test collection for information retrieval systems from the viewpoint of evaluating system functions. In Proc. of Int. Workshop on Information Retrieval with Oriental Languages, pages 42-47, 1996.
14. J.Y. Nie, M. Brisebois, and X. Ren. On Chinese text retrieval. In Proc. of 19th ACM SIGIR Conf., pages 225-233, 1996.
15. T. Nishino and T. Fujisaki. A stochastic parsing of kanji compound words (in Japanese). Transactions of Information Processing Society of Japan, 29(11):1034-1042, 1988.
16. The National Language Research Institute of Japan. Studies on the vocabulary of modern newspapers (in Japanese). Report 37, 1970.
17. Y. Ogawa. Effective and efficient document ranking without using a large lexicon. In Proc. of 22nd VLDB Conf., pages 192-202, 1996.
18. Y. Ogawa, A. Bessho, and M. Hirose. Simple word strings as compound keywords: An indexing and ranking method for Japanese texts. In Proc. of 16th ACM SIGIR Conf., pages 227-236, 1993.
19. Y. Ogawa and M. Iwasaki. A new character-based indexing method using frequency data for Japanese documents. In Proc. of 18th ACM SIGIR Conf., pages 121-129, 1995.
20. J.M. Ponte and W.B. Croft. USeg: A retargetable word segmentation procedure for information retrieval. Technical Report 96-2, University of Massachusetts, 1996.
21. S.E. Robertson and S. Walker. Some simple effective approximations to the 2-Poisson model for probabilistic weighted retrieval. In Proc. of 17th ACM SIGIR Conf., pages 232-241, 1994.
22. G. Salton and M. J. McGill. Introduction to Modern Information Retrieval. McGraw-Hill, New York, 1983.
23. G. Salton and M. Smith. On the application of syntactic methodologies in automatic text analysis. In Proc. of 12th ACM SIGIR Conf., pages 137-150, 1989.
24. R. Sproat, C Chih, and W. Gale. A stochastic finite-state word-segmentation algorithm for Chinese. In Proc. of 34th ACL Conf., pages 66-73, 1994.
25. M. Suzuki. Japanese sentence segmentation algorithm using character patters based on the statistical investigation (in Japanese). Transactions of Institue of Electronics, Information and Communication Engineers, Japan, J79-D-II(7):1236-1243, 1996.
26. K. Takeda and T. Fujisaki. Automatic decomposition of kanji compound words using stochastic estimation (in Japanese). Transactions of Information Processing Society of Japan, 28(9):952-961, 1987.
27. P. Vines et al. Indexing for Chinese text retrieval. In Proc. of 1st Australian Document Computing Conf., pages 85-89, 1996.