A Maximum Entropy Approach to Natural Language Processing

Computational Linguistics

Volumn 22, Issue 1, 1996, Pages 39-68

  Berger, Adam L ^a,c,d   Della Pietra, Vincent J ^b,c,e   Della Pietra, Stephen A ^b,c,e  

^a Och Spine at New York Presbyterian Hospitals

^b Renaissance Technologies

^c IBM T J WATSON RESEARCH CENTER   (United States)

^d Columbia University ^*

^e Renaissance Technologies   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0002652285     PISSN: 08912017     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (23)

1. Bahl, L.; Brown, P.; de Souza, P.; and Mercer, R. (1989). A tree-based statistical language model for natural language speech recognition. IEEE Transactions on Acoustics, Speech, and Signal Processing, 37(7).
2. Berger, A.; Brown, P.; Della Pietra, S.; Della Pietra, V.; Gillett, J.; Lafferty, J.; Printz, H.; and Ureš, L. (1994). The Candide System for Machine Translation. In Proceedings, ARPA Conference on Human Language Technology, Plainsborough, New Jersey.
3. Black, E.; Jelinek, F.; Lafferty, J.; Magerman, D.; Mercer, R.; and Roukos, S. (1992). Towards History-based Grammars: Using Richer Models for Probabilistic Parsing. In Proceedings, DARPA Speech and Natural Language Workshop, Arden House, New York.
4. Brown, D. (1959). A Note on Approximations to Discrete Probability Distributions. Information and Control, 2:386-392.
5. Brown, P.; Della Pietra, S.; Della Pietra, V.; and Mercer, R. (1993). The Mathematics of Statistical Machine Translation: Parameter Estimation. Computational Linguistics, 19(2):263-311.
6. Brown, P.; Cocke, J.; Della Pietra, S.; Della Pietra, V.; Jelinek, F.; Lafferty, J.; Mercer, R.; and Roossin, P. (1990). A Statistical Approach to Machine Translation. Computational Linguistics, 16:79-85.
7. Brown, P.; Della Pietra, V.; de Souza, P.; and Mercer, R. (1990). Class-based N-Gram Models of Natural Language. Proceedings, IBM Natural Language ITL, 283-298.
8. Brown, P.; Della Pietra, S.; Della Pietra, V.; and Mercer, R. (1991). A Statistical Approach to Sense Disambiguation in Machine Translation. In Proceedings, DARPA Speech and Natural Language Workshop, 146-151.
9. Cover, T. and Thomas, J. (1991). Elements of Information Theory. John Wiley & Sons.
10. Csiszár, I. (1975). I-Divergence Geometry of Probability Distributions and Minimization Problems, The Annals of Probability, 3(1):146-158.
11. ibid. (1989). A Geometric Interpretation of Darroch and Ratcliff's Generalized Iterative Scaling. The Annals of Statistics, 17(3):1409-1413.
12. Csiszár, L. and Tusnády, G. (1984). Information Geometry and Alternating Minimization Procedures. Statistics & Decisions, Supplemental Issue, no. 1, 205-237.
13. Darroch, J. N. and Ratcliff, D. (1972). Generalized Iterative Scaling for Log-linear Models. Annals of Mathematical Statistics, no. 43, 1470-1480.
14. Della Pietra, S.; Della Pietra, V.; Gillett, J.; Lafferty, J.; Printz, H.; and Ureš, L. (1994). "Inference and Estimation of a Long-range Trigram Model." In Lecture Notes in Artificial Intelligence, 862. Springer-Verlag, 78-92.
15. Della Pietra, S.; Della Pietra, V.; and Lafferty, J. (1995). "Inducing features of random fields" CMU Technical Report CMU-CS-95-144.
16. Dempster, A. P.; Laird, N. M.; and Rubin, D. B. (1977). Maximum Likelihood from Incomplete Data via the EM Algorithm. Journal of the Royal Statistical Society, 39(B):1-38.
17. Guiasu, S. and Shenitzer, A. (1985). The Principle of Maximum Entropy. The Mathematical Intelligencer, 7(1).
18. Jaynes, E. T. (1990) "Notes on Present Status and Future Prospects." In Maximum Entropy and Bayesian Methods, edited by W. T. Grandy and L. H. Schick. Kluwer, 1-13.
19. Jelinek, F. and Mercer, R. L. (1980). Interpolated Estimation of Markov Source Parameters from Sparse Data. In Proceedings, Workshop on Pattern Recognition in Practice, Amsterdam, The Netherlands.
20. Lucassen, J. and Mercer, R. (1984). An Information Theoretic Approach to Automatic Determination of Phonemic Baseforms. In Proceedings, IEEE International Conference on Acoustics, Speech and Signal Processing, San Diego, CA, 42.5.1-42.5.4.
21. Merialdo, B. (1990). Tagging Text with a Probabilistic Model. In Proceedings, IBM Natural Language ITL, Paris, France, 161-172.
22. Nádas, A.; Mercer, R.; Bahl, L.; Bakis, R.; Cohen, P.; Cole, A.; Jelinek, F.; and Lewis, B. (1981). Continuous Speech Recognition with Automatically Selected Acoustic Prototypes Obtained by either Bootstrapping or Clustering. In Proceedings, IEEE International Conference on Acoustics, Speech and Signal Processing, Atlanta, GA, 1153-1155.
23. Sokolnikoff, I. S. and Redheffer, R. M. (1966). Mathematics of Physics and Modern Engineering, Second Edition, McGraw-Hill Book Company.