Comparing corpora

International Journal of Corpus Linguistics

Volumn 6, Issue 1, 2001, Pages 97-133

  Kilgarriff, Adam ^a  

^a UNIVERSITY OF BRIGHTON   (United Kingdom)

Author keywords

Homogeneity; Similarity; Word frequency

Indexed keywords

EID: 84989382501     PISSN: 13846655     EISSN: 15699811     Source Type: Journal    
DOI: 10.1075/ijcl.6.1.05kil     Document Type: Article

References (39)

1. Biber, D. 1988. Variation across speech and writing. Cambridge: Cambridge University Press.
2. Biber, D. 1990. “Methodological issues regarding corpus-based analyses of linguistic variation.” Literary and Linguistic Computing 5: 257-269.
3. Biber, D. 1993a. “Representativeness in corpus design.” Literary and Linguistic Computing 8: 243-257.
4. Biber, D. 1993b. “Using register-diversified corpora for general language studies.” Computational Linguistics 19(2): 219-242.
5. Biber, D. 1995. Dimensions in Register Variation. Cambridge: Cambridge University Press.
6. Charniak, E. 1993. Statistical Language Learning. Cambridge, Mass, MIT Press.
7. Church, K. and W. Gale. 1995. “Poisson mixtures.” Journal of Natural Language Engineering 1(2): 163-190.
8. Church, K. and P. Hanks. 1989. “Word association norms, mutual information and lexicography.” ACL Proceedings, 27th Annual Meeting, 76-83. Vancouver: ACL.
9. Church, K.W. and R. L. Mercer. 1993. “Introduction to the special issue on computational linguistics using large corpora.” Computational Linguistics 19(1): 1-24.
10. Crowdy, S. 1993. “Spoken corpus design.” Literary and Linguistic Computing 8: 259-265.
11. Daille, B. 1995. Combined approach for terminology extraction: lexical statistics and linguistic filtering. Technical Report 5. Lancaster University: UCREL.
12. Dumais, S., G. Furnas, T. Landauer, S. Deerwester, and R. Harshman. 1988. “Using latent semantic analysis to improve access to textual information.” Proceedings of CHI’88, 281-285. Washington DC: ACM.
13. Dunning, T. 1993. “Accurate methods for the statistics of surprise and coincidence.” Computational Linguistics 19(1): 61-74.
14. Fan, D. P. 1988. Predictions of public opinion from the mass media: computer content analysis and mathematical modeling. New York: Greenwood Press.
15. Francis, W. N. and H. Kučera. 1982. Frequency Analysis of English Usage: lexicon and grammar. Boston: Houghton Mifflin.
16. Hofland, K. and S. Johansson (eds). 1982. Word Frequencies in British and American English. Bergen: The Norwegian Computing Centre for the Humanities.
17. Johansson, S. and K. Hofland (eds). 1989. Frequency Analysis of English vocabulary and grammar, based on the LOB corpus. Oxford: Clarendon.
18. Justeson, J. S. and S. M. Katz. 1995. “Technical terminology: some linguistic properties and an algorithm for identification in text.” Natural Language Engineering 1(1): 9-27.
19. Katz, S. 1996. “Distribution of content words and phrases in text and language modelling.” Natural Language Engineering 2(1): 15-60.
20. Leech, G. and R. Fallon. 1992. “Computer corpora—what do they tell us about culture?” ICAME Journal 16: 29-50.
21. McDonald, C. and B. Weidetke. 1979. Testing marriage climate. Masters thesis. Ames, Iowa: Iowa State University.
22. McTavish, D. G. and E. B. Pirro. 1990. “Contextual content analysis.” Quality and Quantity 24: 245-265.
23. Mosteller, F. and D. L. Wallace. 1964. Applied Bayesian and Classical Inference—The Case of The Federalist Papers. Springer Series in Statistics. London: Springer-Verlag.
24. Owen, F. and R. Jones. 1977. Statistics. Stockport: Polytech Publishers.
25. Pedersen, T. 1996. “Fishing for exactness.” Proceedings of the Conference of South-Central SAS Users Group. Texas: SAS Users Group. Also available from CMP-LG E-Print Archive as #9608010.
26. Rayson, P., G. Leech, and M. Hodges. 1997. “Social differentiation in the use of English vocabulary: some analysis of the conversational component of the British National Corpus.” International Journal of Corpus Linguistics 2(1): 133-152.
27. Robertson, S. E. and K. Sparck Jones. 1994. “Simple, proven approaches to text retrieval.” Technical Report 356. Cambridge: Cambridge University.
28. Rose, T., N. Haddock, and R. Tucker. 1997. “The effects of corpus size and homogeneity on language model quality.” Proceedings of ACL SIGDAT workshop on Very Large Corpora, 178-191. Beijing and Hong Kong: ACL.
29. Rosenfeld, R. 1995. “The CMU Statistical Language Modelling Toolkit and its use in the 1994 ARPA CSR Evaluation.” Proceedings of Spoken Language Technology Workshop. Austin, Texas: Arpa.
30. Roukos, S., 1996. Language Representation, chapter 1.6. National Science Foundation and European Commission, www.cse.ogi/CSLU/HLTsurvey.html.
31. Salton, G. 1989. Automatic Text Processing. London: Addison-Wesley.
32. Berber Sardinha, T. 1996. WordSmith tools. Computers and Texts 12: 19-21.
33. Schütze, H. and J. O. Pederson. 1995. “Information retrieval based on word senses.” Proceedings of ACM Special Interest Group on Information Retrieval, 161-175. Las Vegas: ACM.
34. Scott, M. 1997. “PC analysis of key words—and key key words.” System 25: 233-245.
35. Sekine, S. 1997. “The domain dependence of parsing.” Proceedings of Fifth Conference on Applied Natural Language Processing, 96-102. Washington DC: ACL.
36. Smith, C. P. 1992. Motivation and personality: handbook of thematic content analysis. Cambridge: Cambridge University Press.
37. Stone, P. J., D. C. Dunphy, M. S. Smith, and D. M. Ogilvie. 1966. The General Enquirer: A Computer approach to content analysis. Cambridge, Mass: MIT Press.
38. Ueberla, J. 1997. Towards an improved performance measure for language models. Technical Report DERA/CIS/CIS5/TR97426, DERA. cmp-lg/9711009.
39. Wilson, A. and P. Rayson. 1993. “Automatic Content Analysis of Spoken Discourse.” In: C. Souter and E. Atwell (eds.), Corpus Based Computational Linguistics, 215-216. Amsterdam: Rodopi.