Exponential priors for maximum entropy models

HLT-NAACL 2004 - Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Main Conference

Volumn , Issue , 2004, Pages 305-312

  Goodman, Joshua ^a  

^a NONE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

MAXIMUM ENTROPY METHODS;

COMMON MODELS; ERROR RATE; EXPONENTIAL DISTRIBUTIONS; EXPONENTIALS; GAUSSIAN PRIORS; MAXIMUM ENTROPY MODELS; MODELLING TECHNIQUES; OVERFITTING; SIMPLE LEARNING ALGORITHMS; SMOOTHING TECHNIQUES;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 85117711027     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. M. Banko and E. Brill. 2001. Mitigating the paucity of data problem. In HLT.
2. Adam L. Berger, Stephen A. Della Pietra, and Vincent J. Della Pietra. 1996. A maximum entropy approach to natural language processing. Computational Linguistics, 22(1):39–71.
3. Stanley F. Chen and Joshua Goodman. 1999. An empirical study of smoothing techniques for language modeling. Computer Speech and Language, 13:359–394, October.
4. Stanley Chen and Ronald Rosenfeld. 2000. A survey of smoothing techniques for ME models. IEEE Trans. on Speech and Audio Processing, 8(2):37–50, January.
5. J.N. Darroch and D. Ratcliff. 1972. Generalized iterative scaling for log-linear models. The Annals of Mathematical Statistics, 43:1470–1480.
6. Stephen Della Pietra and Vincent Della Pietra. 1993. Statistical modeling by maximum entropy. Unpublished Manuscript.
7. Stephen Della Pietra, Vincent Della Pietra, and John Lafferty. 1997. Inducing features of random fields. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(4):380–393, April.
8. Mario A. T. Figueiredo, Balaji Krishnapuram, Lawrence Carin, and Alexander J. Hartemink. 2003. Supervised and semi-supervised sparse Bayesian classification.
9. I.J. Good. 1953. The population frequencies of species and the estimation of population parameters. Biometrika, 40(3 and 4):237–264.
10. Joshua Goodman. 2001. Classes for fast maximum entropy training. In ICASSP 2001.
11. Joshua Goodman. 2002. Sequential conditional generalized iterative scaling. In ACL’02.
12. Carl M. Kadie, Christopher Meek, and David Heckerman. 2002. CFW: A collaborative filtering system using posteriors over weights of evidence. In Proceedings of UAI, pages 242–250.
13. S. Khudanpur. 1995. A method of maximum entropy estimation with relaxed constraints. In 1995 Johns Hopkins University Language Modeling Workshop.
14. Reinhard Kneser and Hermann Ney. 1995. Improved backing-off for m-gram language modeling. In ICASSP, volume 1, pages 181–184.
15. Raymond Lau. 1994. Adaptive statistical language modelling. Master’s thesis, MIT.
16. W. Newman. 1997. Extension to the maximum entropy method. IEEE Trans. on Information Theory, IT-23(1):89–93, January.
17. Hermann Ney, Ute Essen, and Reinhard Kneser. 1994. On structuring probabilistic dependences in stochastic language modeling. Computer, Speech, and Language, 8:1–38.
18. Simon Perkins and James Theiler. 2003. Online feature selection using grafting. August.
19. Adwait Ratnaparkhi. 1998. Maximum Entropy Models for Natural Language Ambiguity Resolution. Ph.D. thesis, University of Pennsylvania.
20. J. Reynar and A. Ratnaparkhi. 1997. A maximum entropy approach to identifying sentence boundaries. In ANLP.
21. Ronald Rosenfeld. 1994. Adaptive Statistical Language Modeling: A Maximum Entropy Approach. Ph.D. thesis, Carnegie Mellon University, April.
22. Robert Tibshirani. 1994. Regression shrinkage and selection via the lasso. Technical report.
23. Peter M. Williams. 1995. Bayesian regularization and pruning using a Laplace prior. Neural Computation, 7:117–143.