Algorithm for predicting the relationship between lemmas and corpus size

ETRI Journal

Volumn 22, Issue 2, 2000, Pages 20-31

  Yang, Dan Hee ^a   Gómez, Pascual Cantos ^a   Song, Mansuk ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COMPUTATIONAL LINGUISTICS; CURVE FITTING; ERROR ANALYSIS; PIECEWISE LINEAR TECHNIQUES; REGRESSION ANALYSIS;

PIECEWISE CURVE FITTING ALGORITHMS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 0342521305     PISSN: 12256463     EISSN: None     Source Type: Journal    
DOI: 10.4218/etrij.00.0100.0203     Document Type: Article

References (20)

1. Sang-Sup Lee, "Corpus: the Concept and Implementation," Lexicographic Study, Tap Press, Seoul, Vol. 5, 6, 1995, pp. 7-28.
2. Dan-Hee Yang, and Mansuk Song, "Machine Learning and Corpus Building of the Korean Language," In Proceedings of '98 Spring Conference of the Korea Information Science Society (KISS), Seoul, 1998, pp. 408-410.
3. Dan-Hee Yang, and Mansuk Song, "Representation and Acquisition of the Word Meaning for Picking out Thematic Roles," In International Journal of Computer Processing of Oriental Languages (CPOL), the Oriental Languages Computer Society 1999a), Vol. 12, No. 2, 1999, pp. 161-177.
4. Kenneth W. Church and Robert L. Mercer, "Introduction to the Special Issue on Computational Linguistics Using Large Corpora," Using Large Corpora, edited by Susan Armstrong. The MIT Press, 1994, pp. 1-24.
5. Philip Resnik, Selection and Information: A Class-Based Approach to Lexical Relationships, Ph.D. Dissertation of Department of Computer and Information Science. Pennsylvania University, 1993, pp. 6-33.
6. Dan-Hee Yang and Mansuk Song, "How Much Training Data Is Required to Remove Data Sparseness in Statistical language Learning?," In Pmceedings of the First Workshop on Text, Speech, Dialogue (TSD '98), Bruno, 1998, pp. 141-146.
7. Ralph Weischedel et al. "Coping with Ambiguity and Unknown Words, through Probabilistic Models," Using Large Corpora, edited by Susan Armstrong, The MIT Press, 1994, pp. 323-326.
8. th Australian Joint Conference on Artificial Intelligence, Canberra, 1995.
9. th Conference of the Pacific Association for Computational Linguistics. Brisbane, Australia, 1995.
10. Pieter De Haan, "The Optimum Corpus Sample Size?," In Leitner, Gerhard (eds.): New Directions in English Language Corpora, Methodology Results, Software Development, Mouton de Gruyte, New York, 1992, pp. 3-19.
11. H. S. Heaps, Information Retrieval: Computational and Theoretical Aspects, Academic Press, New York, 1978, pp. 206-208.
12. Young-Mi Jeong "Statistical Characteristics of Korean Vocabulary and Its Application," Lexicographic Study, Tap Press, Seoul, Vol. 5, 6, 1995, pp. 134-163.
13. Aquilino Sánchez and Pascual Cantos, "Predictability of Word Forms (Types) and Lemmas in Linguistic Corpora, A Case Study Based on the Analysis of the CUMBRE Corpus: An 8-Million-Word Corpus of Contemporary Spanish," In International Journal of Corpus Linguistics Vol. 2, No. 2, 1997, pp. 259-280.
14. Chan-Sup Jeong, Sang-Sup Lee and Ki-Sim Nam, et al. "Selection Criteria of Sampling for Frequency Survey in Korean Words." Lexicographic Study, Tap Press, Seoul, Vol. 3, 1990, pp. 7-69.
15. Richard L. Burden and J. Douglas Faires, Numerical Analysis, Brooks/Cole Publishing, California, 1997, pp. 473-483.
16. William Hays, Statistics, Harcourt Brace College Publishers, Florida, 1994, pp. 28-30.
17. M. J. Maron, Numerical Analysis: A Practical Approach, Macmillan Publishing, New York, 1987, pp. 201-248.
18. Young-Chae Kim, "Frequency Survey of Korean Vocabulary," In Journal of Korean Psychological Association, Vol. 5, No. 3, 1986, pp. 217-285.
19. Dan-Hee Yang, Su-Jong Lim and Mansuk Song, "The Estimate of the Corpus Size for Solving Data Sparseness," In Journal of KISS, Vol. 26, No. 4, 1999, pp. 568-583.
20. Aquilino Sánchez and Pascual Cantos, "El ritmo incremental de palabras nuevas en los repertorios de textos. Estudio experimental y comparativo basado en dos corpus lingüísticos equivalentes de cuatro millones de palabras, de las lenguas inglesa y española y en cinco autores de ambas lenguas," Atlantis (Revista de la Asociación Española de Estudios Anglo-Norteamericanos), Vol. 19, No. 1, 1998, pp. 205-223.