Measuring corpus homogeneity using a range of measures for inter-document distance

Proceedings of the 3rd International Conference on Language Resources and Evaluation, LREC 2002

Volumn , Issue , 2002, Pages 426-431

  Cavaglià, Gabriela ^a  

^a UNIVERSITY OF BRIGHTON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

LINGUISTIC FEATURES; NLP SYSTEMS; QUANTITATIVE APPROACH; TEXT ANALYSIS;

LINGUISTICS;

EID: 85001803505     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. Douglas Biber. 1988. Variation across speech and writing. Cambridge University Press.
2. Douglas Biber. 1993. Using register-diversified corpora for general language studies. Computational Linguistics, 19(2):219-41.
3. Nigel Dewdney, Carol VanEss-Dykema, and Richard MacMillan. 2001. The form is the substance: Classification of genres in text. In Workshop on human language technology and knowledge management, Toulouse, France. ACL 2001.
4. Ted Dunning. 1993. Accurate methods for the statistics of surprise and coincidence. Computational Linguistics, 19(1):61-74.
5. Helka Folch, Serge Heiden, Benoit Habert, Serge Fleury, Gabriel Illouz, Pierre Lafon, Julien Nioche, and Sophie Prevost. 2000. Typtex: Inductive typological text classification by multivariate statical analysis for nlp systems tuning/evaluation. In Second International Conference on Language Resources and Evaluation, pages 141-148, Athens, Greece. Lrec 2000.
6. K. Hofland and S. Johansson. 1982. Word frequencies in British and American English. The Norwegian Computing Centre for the Humanities.
7. Gabriel Illouz, Benoit Habert, Helka Folch, Serge Heiden, Serge Fleury, Pierre Lafon, and Sophie Prevost. 2000. Typtex: Generic features for text profiler. In Content- Based Multimedia Information Access, Paris, France. RIAO'2000.
8. Brett Kessler, Geoffrey Nunberg, and Hinrich Schutze. 1997. Automatic detection of text genre. In Procceedings of the 37th Annual Meeting of the Association for Computational Linguistic and the 8th Conference of the European Chapter of the Association for Computational Linguistic, pages 32-38, Madrid, Spain. ACL'97.
9. Adam Kilgarriff. 2001. Comparing corpora. International Journal of Corpus Linguistics, 6(1):1-37.
10. David Lee. 2001. Genres, registers, text types, domains and styles: Clarifying the concepts and navigating a path through the bnc jungle. Language Learning & Technology, 5(3):37-72. Special Issue on: "Using Corpora in Language Teaching and Learning.
11. Andrew Kachites McCallum. 1996. Bow: A toolkit for statistical language modeling, text retrieval, classification and clustering. http://www.cs.cmu.edu/mccallum/bow.
12. Frank Owen and Ronald Jones. 1977. Statistics. Polytech Publishers, Stockport, UK.
13. Douglas Roland and Daniel Jurafsky. 1998. How verb subcategorization frequencies are affected by corpus choice. In 36th Annual Meeting of the Association for Computational Linguistics, pages 1122-1128, Montreal, Canada.
14. D. Scott, N. Bouayad-Agha, R. Power, S. Schulz, R. Beck, D. Murphy, and R. Lockwood. 2001. Pills: A multilingual authoring system for patient information. In Vision of the Future and Lessons from the past. Proceeding of the 2001 AMIA Annual Symposium, Washington DC.
15. Satoshi Sekine. 1997. The domain dependence of parsing. In Proceedings of the Fifth Conference on Applied Natural Language Processing, Washington D.C., USA. ACL.