Evaluation and Extension of Maximum Entropy Models with Inequality Constraints

Proceedings of the 2003 Conference on Empirical Methods in Natural Language Processing, EMNLP 2003

Volumn , Issue , 2003, Pages 137-144

  Kazama, Jun'ichi ^a   Tsujii, Jun'ichi ^a,b  

^a UNIVERSITY OF TOKYO   (Japan)

^b JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ENTROPY; TEXT PROCESSING;

EQUALITY CONSTRAINTS; GAUSSIANS; INEQUALITY CONSTRAINT; MAP ESTIMATION; MAXIMUM ENTROPY MODELS; NATURAL INTEGRATION; TEXT CATEGORIZATION;

CONSTRAINT THEORY;

EID: 9444232930     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1119355.1119373     Document Type: Conference Paper

References (16)

1. S. J. Benson and J. J. Moré. A limited memory variable metric method for bound constraint minimization. Technical Report ANL/MCS-P909-0901, Argonne National Laboratory.
2. S. Benson, L. C. McInnes, J. J. Moré, and J. Sarich. 2002. TAO users manual. Technical Report ANL/MCS-TM-242Revision 1.4, Argonne National Laboratory.
3. A. L. Berger, S. A. Della Pietra, and V. J. Della Pietra. 1996. A maximum entropy approach to natural language processing. Computational Linguistics, 22(1):39–71.
4. A. Borthwick. 1999. A maximum entropy approach to named entity recognition. Ph.D. Thesis. New York University.
5. S. F. Chen and R. Rosenfeld. 2000. A survey of smoothing techniques for ME models. IEEE Trans. on Speech and Audio Processing, 8(1):37–50.
6. J. N. Darroch and D. Ratcliff. 1972. Generalized iterative scaling for log-linear models. The Annals of Mathematical Statistics, 43:1470–1480.
7. W. Hersh, C. Buckley, T.J. Leone, and D. Hickam. 1994. OHSUMED: An interactive retrieval evaluation and new large test collection for research. In Proc. of the 17th Annual ACM SIGIR Conference, pages 192–201.
8. S. Khudanpur. 1995. A method of ME estimation with relaxed constraints. In Johns Hopkins Univ. Language Modeling Workshop, pages 1–17.
9. R. Lau. 1994. Adaptive statistical language modeling. A Master’s Thesis. MIT.
10. R. Malouf. 2002. A comparison of algorithms for maximum entropy parameter estimation. In Proc. of the sixth CoNLL.
11. Y. Miyao and J. Tsujii. 2002. Maximum entropy estimation for feature forests. In Proc. of HLT 2002.
12. W. Newman. 1977. Extension to the ME method. In IEEE Trans. on Information Theory, volume IT-23, pages 89–93.
13. K. Nigam, J. Lafferty, and A. McCallum. 1999. Using maximum entropy for text classification. In IJCAI-99 Workshop on Machine Learning for Information Filtering, pages 61–67.
14. S. Pietra, V. Pietra, and J. Lafferty. 1997. Inducing features of random fields. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(4):380–393.
15. A. Ratnaparkhi. 1996. A maximum entropy model for part-of-speech tagging. In Proc. of the EMNLP, pages 133–142.
16. V. Vapnik. 1995. The Nature of Statistical Learning Theory. Springer Verlag.