Using sketches to estimate associations

HLT/EMNLP 2005 - Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference

Volumn , Issue , 2005, Pages 708-715

  Li, Ping ^a   Church, Kenneth W ^b  

^a STANFORD UNIVERSITY   (United States)

^b MICROSOFT RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FREQUENCY ESTIMATION; MAXIMUM LIKELIHOOD ESTIMATION; NATURAL LANGUAGE PROCESSING SYSTEMS; SAMPLING; WEBSITES;

COMPUTATIONAL WORK; CONTINGENCY TABLE; DOCUMENT FREQUENCY; MAXIMUM LIKELIHOOD ESTIMATOR; SAMPLING METHOD; SAMPLING RATES; SAMPLING TECHNIQUE; STATISTICAL ACCURACY;

IMPORTANCE SAMPLING;

EID: 35748938363     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1220575.1220664     Document Type: Conference Paper

References (15)

1. S. Brin and L. Page. 1998. The anatomy of a largescale hypertextual web search engine. In Proceedings of the Seventh International World Wide Web Conference, pages 107-117, Brisbane, Australia.
2. A. Broder. 1997. On the resemblance and containment of documents. In Proceedings of the Compression and Complexity of Sequences, pages 21-29, Positano, Italy.
3. M. S. Charikar. 2002. Similarity estimation techniques fromrounding algorithms. In Proceedings of the thiryfourth annual ACM symposium on Theory of computing, pages 380-388, Montreal, Quebec, Canada. (Pubitemid 35009398)
4. K. Church and P. Hanks. 1991. Word association norms, mutual information and lexicography. Computational Linguistics, 16(1):22-29.
5. S. Deerwester, S. T. Dumais, G. W. Furnas, and T. K. Landauer. 1999. Indexing by latent semantic analysis. Journal of the American Society for Information Science, 41(6):391-407.
6. T. Dunning. 1993. Accurate methods for the statistics of surprise and coincidence. Computational Linguistics, 19(1):61-74.
7. H. Garcia-Molina, J. D. Ullman, and J. D. Widom. 2002. Database Systems: the Complete Book. Prentice Hall, New York, NY.
8. A. S. Hornby, editor. 1989. Oxford Advanced Learner's Dictionary. Oxford University Press, Oxford, UK.
9. E. L. Lehmann and G. Casella. 1998. Theory of Point Estimation. Springer, New York, NY, second edition.
10. P. Li and K. W. Church. 2005. Using sketches to estimate two-way and multi-way associations. Technical report, Microsoft Research, Redmond, WA.
11. C. D. Manning and H. Schutze. 1999. Foundations of Statistical Natural Language Processing. The MIT Press, Cambridge, MA.
12. R. C. Moore. 2004. On log-likelihood-ratios and the significance of rare events. In Proceedings of EMNLP 2004, pages 333-340, Barcelona, Spain.
13. D. Ravichandran, P. Pantel, and E. Hovy. 2005. Randomized algorithms and NLP: Using locality sensitive hash function for high speed noun clustering. In Proceedings of ACL, pages 622-629, Ann Arbor.
14. K. Siegrist. 1997. Finite Sampling Models, http://www.ds.unifi.it/VL/ VLEN/urn/index.html. Virtual Laboratories in Probability and Statistics.
15. W. N. Venables and B. D. Ripley. 2002. Modern Applied Statistics with S. Springer-Verlag, New York, NY, fourth edition.