Extracting the lowest-frequency words: Pitfalls and possibilities

Computational Linguistics

Volumn 26, Issue 3, 2000, Pages

  Weeber, Marc ^a   Baayen, R Harald ^c   Vos, Rein ^b  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

^b MAASTRICHT UNIVERSITY   (Netherlands)

^c MAX PLANCK INSTITUTE FOR PSYCHOLINGUISTICS   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

INFORMATION USE; PARTICLE SIZE ANALYSIS;

COLLOCATION EXTRACTION; EXTRACTION METHOD; EXTRACTION SYSTEMS; LOG LIKELIHOOD RATIO; MEDICAL INFORMATION; SIGNIFICANCE LEVELS; STATISTICAL BEHAVIOR; WORD ASSOCIATION;

MEDICAL INFORMATION SYSTEMS;

EID: 0012981542     PISSN: 08912017     EISSN: None     Source Type: Journal    
DOI: 10.1162/089120100561719     Document Type: Article

References (11)

1. Agresti, Alan. 1990. Categorical Data Analysis. John Wiley & Sons, New York.
2. Church, Kenneth W. and Patrick Hanks. 1990. Word association norms, mutual information, and lexicography. Computational Linguistics, 16(1):22-29.
3. Clarkson, Douglas B., Yuan-An Fan, and Harry Joe. 1993. A remark on algorithm 643: FEXACT: An algorithm for performing Fisher's exact test in r × c contingency tables. ACM Transactions on Mathematical Software, 19(4):484-488.
4. Dunning, Ted. 1993. Accurate methods for the statistics of surprise and coincidence. Computational Linguistics, 19(1):61-74.
5. Manning, Christopher D. and Hinrich Schütze, 1999. Foundations of Statistical Natural Language Processing, chapter 5, Collocations. The MIT Press, Cambridge, MA.
6. Mehta, Cyrus R. and Nitin R. Patel. 1986. Algorithm 643. FEXACT: A fortran subroutine for Fisher's exact test on unordered r × c contingency tables. ACM Transactions on Mathematical Software, 12(2):154-161.
7. Pedersen, Ted. 1996. Fishing for exactness. In Proceedings of the South-Central SAS Users Group Conference, pages 188-200, Austin, TX.
8. Pedersen, Ted, Mehmet Kayaalp, and Rebecca Bruce. 1996. Significant lexical relationships. In Proceedings of the 13th National Conference on Artificial Intelligence. AAAI Press/The MIT Press, Menlo Park, CA, pages 455-460.
9. Rijsbergen, Cornelis J. van. 1979. Information Retrieval. Second edition. Butterworths, London.
10. Rikken, Floor and Rein Vos. 1995. How adverse drug reactions can play a role in innovative drug research. Pharmacy World and Science, 17(6):195-200.
11. Smadja, Frank. 1993. Retrieving collocations from text: Xtract. Computational Linguistics, 19(1):143-177.