A comparison of criteria for maximum entropy/minimum divergence feature selection

Proceedings of the 3rd Conference on Empirical Methods in Natural Language Processing, EMNLP 1998

Volumn , Issue , 1998, Pages 97-106

  Berger, Adam ^a   Printz, Harry ^b  

^a Carnegie Mellon University   (United States)

^b IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

MODELING LANGUAGES;

BASE MODELS; FEATURES SELECTION; LANGUAGE MODEL; MAXIMUM-ENTROPY; MUTUAL INFORMATIONS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84858966189     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. D. Beeferman, A. Berger, J. Lafferty, "A Model of Lexical Attraction and Repulsion," Proc. of the ACL-EACL'97 Joint Conference, Madrid, Spain.
2. A. Berger, S. Delia Pietra, V. Delia Pietra, "A Maximum Entropy Approach to Natural Language Processing," Computational Linguistics, 22(1): 39-71, March 1996.
3. C. Chelba, et, al., "Structure and Performance of a Dependency Language Model," Proc. of Burospeeck '97, Rhodes, Greece, September 1997.
4. S. Delia Pietra, V. Delia Pietra, J. Gillett, J. Lafferty, H. Prints, L. Ures, "Inference and Estimation of a Long-Range Trigram Model," Second International Colloquium on Grammatical Inference, Alicante, Spain, September 1994.
5. S. Delia Pietra, V. Delia Pietra, and J. Lafferty, Inducing Features of Random Fields, IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(4): 380-393, April 1997.
6. R. Lau, R, Rosenfeld, S. Roukos, "Trigger-Based Language Models: a Maximum Entropy Approach," Proc. of the International Conference on Acoustics, Speech and Signal Processing, pp II: 45-48, Minneapolis, MN, April 1993.
7. D, Magerman, Natural Language Parsing as Statistical Pattern Recognition, Ph.D. Thesis, Department of Computer Science, Stanford University, Palo Alto, CA, February 1994.
8. H. Printz, "Fast Computation of Maximum Entropy/Minimum Divergence Feature Gain," submitted to International Conference on Speech and Language Processing, Sydney, Australia, September 1998
9. P. S. Rao, S. Dharanipragada, S. Roukos, "MDI Adaptation of Language Models Across Corpora," Proc. ofBurospeech '97, pages 1979-1982, Rhodes, Greece, September 1997.
10. A. Ratnaparkhi, J. Reynar, S. Roukos, "A Maximum Entropy Model for Prepositional Phrase Attachment," Proc. of the Human Language Technology Workshop, Plainsboro, NJ, March 1994.
11. R. Rosenfeld, Adaptive Statistical Language Modeling: A Maximum Entropy Approach, Ph.D. Thesis, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, April 1994.