Bigram statistics revisited: A comparative examination of some statistical measures in morphological analysis of Japanese kanji sequences

Journal of Quantitative Linguistics

Volumn 6, Issue 2, 1999, Pages 149-166

  Kageura, Kyo ^a  

^a NATIONAL INSTITUTE OF INFORMATICS   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 34248755141     PISSN: 09296174     EISSN: 17445035     Source Type: Journal    
DOI: 10.1076/jqul.6.2.149.4129     Document Type: Article

References (29)

1. Bindi, R., Calzolari, N., Monachini, M., Pirrelli, V., & Zampolli, A. (1994). Corpora and computational lexica: Integration of different methodologies of lexical knowledge acquisition. Literary and Linguistic Computing, 9, 29-46.
2. Brill, E., Magerman, D., Marcus, M., & Santorini, B. (1990). Deducing linguistic structure from the statistics of large corpora. Proceedings of the DARPA Speech and Natural Language Workshop, 275-281.
3. Church, K.W., Gale, W. A., Hanks, P., & Hindle, D.M. (1990). Using statistics in lexical analysis (AT&T Bell Technical Report). Murray Hill, NJ: AT&T Bell.
4. Church, K.W., & Hanks, P. (1990). Word association norms, mutual information, and lexicography. Computational Linguistics, 16, 22-29.
5. Cohen, J.D. (1995). Highlights: Language- and domain-independent automatic indexing terms for abstracting. Journal of the American Society for Information Science, 46, 162-174.
6. Daille, B., Gaussier, E., & Langé, J-M. (1994). Towards automatic extraction of monolingual and bilingual terminology. Proceedings of COLING'94 (pp. 515-521). Kyoto.
7. Daniel, W.W. (1990). Applied nonparametric statistics (2nd ed). Boston: PWS-KENT.
8. Delcourt, C. (1992). About the statistical analysis of co-occurrences. Computers and the Humanities, 26, 21-29.
9. Delcourt, C. (1994). Some reflections about current practice in lexicometry. In Research in humanities computing 2 (pp. 3-21). Oxford: Clarendon Press.
10. Dunning, T. (1993). Accurate methods for the statistics of surprise and coincidence. Computational Linguistics, 19, 61-74.
11. Fano, R. (1961). Transmissions of information: A statistical theory of communications. Cambridge, MA: MIT Press.
12. Fleiss, J.L. (1991). Statistical methods for rates and proportions. New York: John Wiley.
13. Fienberg, S. E. (1977). The analysis of cross-classified categorical data. Cambridge, MA: MIT Press.
14. Haskel, P.I. (1971). Collocations as a measure of stylistic variety. In R. A. Wisbey (ed.), The computer in literary and linguistic research (pp. 159-168). Cambridge: Cambridge University Press.
15. Herdan, G. (1966). The advanced theory of language as choice and chance. Berlin: Springer Verlag.
16. Hoel, P.G. (1971). Introduction to mathematical statistics (4th ed). New York: John Wiley.
17. Johansson, C. (1996). Good bigrams. Proceedings of COLING'96 (pp. 592-597). Copenhagen.
18. Kageura, K. (1997a). A method for decomposing chinese character sequences using character-based bigram measure. Proceedings of the Third Annual Meeting of the Association for Natural Language Processing (pp. 477-480). Tokyo. [in Japanese]
19. Kageura, K. (1997b). Type-based and token-based learning of kanji morphemes. Third International Conference on Quantitative Linguistics (pp. 146-151). Helsinki.
20. Kilgarriff, A. (1996). Which words are particularly characteristic of a text? A survey of statistical approaches, Language Engineering for Document Analysis and Recognition: Proceedings of the AISB Workshop, Sussex.
21. Magerman, D., & Marcus, M. (1990). Parsing a natural language using mutual information statistics, Proceedings of AAAI 90 (pp. 984-989).
22. Nomura, M., & Ishii, M. (1989). Gakujutu yogo goki hyo. Tokyo: National Language Research Institute. [in Japanese]
23. Reynolds, H.T. (1977). The analysis of cross-classifications. New York: Free Press.
24. Sinclair, J.M. (1991). Corpus, concordance, collocation. Oxford: Oxford University Press.
25. Smadja, F. (1993). Retrieving collocations from text: Xtract, Computational Linguistics, 19, 143-177.
26. Sprent, P. (1993). Applied nonparametric statistical methods (2nd ed). London: Chapman and Hall.
27. Su, K-Y., Wu, M-W., & Chang, J-S. (1994). A corpus-based approach to automatic compound extraction, Proceedings of 32nd ACL (pp. 27-30).
28. Takeda, K. and Fujisaki, T. (1987). Automatic decomposition of kanji compound words using stochastic estimation, Transactions of Information Processing Society of Japan, 28, 952-961. [in Japanese]
29. Yule, G.U. (1944). The statistical study of literary vocabulary. Cambridge: Cambridge University Press.