Key word extraction from a document using word co-occurrence statistical information

Transactions of the Japanese Society for Artificial Intelligence

Volumn 17, Issue 3, 2002, Pages 217-223

  Matsuo, Yutaka ^a   Ishizuka, Mitsuru ^a  

^a UNIVERSITY OF TOKYO   (Japan)

Author keywords

2test; Keyword extraction; Word co occurrence

Indexed keywords

KEYWORD EXTRACTION; TECHNICAL PAPERS; WORD CO-OCCURENCE; X2TEST;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; INDEXING (OF INFORMATION); PROBABILITY DISTRIBUTIONS; SET THEORY; STATISTICAL MECHANICS;

INFORMATION RETRIEVAL;

EID: 0012854928     PISSN: 13460714     EISSN: 13468030     Source Type: Journal    
DOI: 10.1527/tjsai.17.217     Document Type: Article

References (24)

1. Japanese only
2. [Church 90] Church, K. W. and Hanks, P.: Word association norms, mutual information, and lexicography, Computational Linguistics, Vol. 16, No. 1, pp. 22-29 (1990).
3. [Dagan 99] Dagan, I., Lee, L., and Pereira, F.: Similarity-Based Models ofWord Cooccurrence Probabilities, Machine Learning, Vol. 34, No. 1-3, pp. 43-69 (1999).
4. [Dunning 93] Dunning, T.: Accurate Methods for the Statistics of Surprise and Coincidence, Computational Linguistics, Vol. 19, No. 1, pp. 61-74 (1993).
5. [Edmundson 69] Edmundson, H.: New Methods in Automatic Abstracting, Journal of ACM, Vol. 16, No. 2, pp. 264-285 (1969).
6. [Even-Zohar 99] Even-Zohar, Y., Roth, D., and Zelenko, D.: Word Prediction and Clustering, in Bar-Dan Symposium on the foundations of artificial intelligence (1999).
7. [Fiirnkranz 98] Fürnkranz, J.: A Study Using N-grams Features for Text Categorization, Technical report, Austrian Research Institute for Artificial Intelligence (1998), OEFAITR-98-30.
8. [Hisamitsu 00] Hisamitsu, T., Niwa, Y., and Tsujii, J.: A Method of Measuring Term Representativeness - Baseline Method Using Co-occuences Distribution -, in Proc. Coling 2000, pp. 320-326 (2000).
9. [Ishizuka 98] Ishizuka, M. and Matsuo, Y.: SL Method for Computing a Near-optimal Solution using Linear and Nonlinear Programming in Cost-based Hypothetical Reasoning, in Proc. 5th Pacific Rim Conference on Artificial Intelligence (PRICAF98), pp. 611-625 (1998).
10. [Kageura 96] Kageura, K. and Umino, B.: Methods of Automatic Term Recognition, Terminology, Vol. 3, No. 2, pp. 259-289 (1996).
11. Japanese only
12. [Luhn 57] Luhn, H. P.: A statistical approach to mechanized encoding and searching of literary information, IBM Journal of Research and Development, Vol. 1, No. 4, pp. 390-317 (1957).
13. Japanese only
14. [Ng 97] Ng, H. T., Goh, W. B., and Low, K. L.: Feature Selection, Perceptron Learning, and a Usability Case Study for Text Categorization, in Proc. ACM SIGIR'97 (1997).
15. [Noreault 77] Noreault, T., McGill, M., and Koll, M. B.: A Performance Evaluation of Similarity Measure, Document Term Weighting Schemes and Representations in a Boolean Environment, Butterworths, London (1977).
16. Japanese only
17. Japanese only
18. [Pereira 93] Pereira, F., Tishby, N., and Lee, L.: Distributional Clustering of English Words, in Proc. 31th Meeting of the Association for Computational Linguistics, pp. 183-190 (1993).
19. [Schutze 95] Schutze, H., Hull, D. A., and Pedersen, J. O.: A comparison of classifiers and document representations for the routing problem, in Proc. ACM SIGIR'95 (1995).
20. [Sparck-Jones 72] Sparck-Jones, K.: A Statistical Interpretation of Term Specificity and Its Application in Retrieval, Journal of Documentation, Vol. 28, No. 5, pp. 111-121 (1972).
21. [Tanaka-Ishii 96] Tanaka-Ishii, K. and Iwasaki, H.: Clustering co-occurrence graph using transitivity, in Proc. 16th International Conference on Computational Linguistics, pp. 680-585 (1996).
22. [Tanaka 96] Tanaka, K. and Iwasaki, H.: Extraction of lexical translations from non-aligned copora, in Proc. 16th International Conference on Computational Linguistics, pp. 580-585 (1996).
23. Japanese only
24. Japanese only