Using continuous features in the maximum entropy model

Pattern Recognition Letters

Volumn 30, Issue 14, 2009, Pages 1295-1300

  Yu, Dong ^a   Deng, Li ^a   Acero, Alex ^a  

^a MICROSOFT RESEARCH   (United States)

Author keywords

Continuous feature; Distribution constraint; Maximum entropy model; Maximum entropy principle; Moment constraint; Spline interpolation

Indexed keywords

CONTINUOUS FEATURE; DISTRIBUTION CONSTRAINT; MAXIMUM ENTROPY MODEL; MAXIMUM ENTROPY PRINCIPLE; MOMENT CONSTRAINT; SPLINE INTERPOLATION;

FUNCTIONS; INTERPOLATION; MAXIMUM PRINCIPLE; REGRESSION ANALYSIS; SPLINES; STRUCTURES (BUILT OBJECTS);

ENTROPY;

EID: 68749108327     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2009.06.005     Document Type: Article

References (27)

1. Arndt C., Robinson S., and Tarpc F. Parameter estimation for a computable general equilibrium model: A maximum entropy approach. Econ. Model. 19 3 (2002) 375-398
2. Asuncion, A., Newman, D.J., 2007. UCI Machine Learning Repository Irvine, CA: University of California, School of Information and Computer Science. .
3. Berger A.L., Della Pietra S.A., and Della Pietra V.J. A maximum entropy approach to natural language processing. Comput. Linguist. 22 (1996) 39-71
4. Chen, S.F., Rosenfeld, R., 1999. A gaussian prior for smoothing maximum entropy models. In: Technical Report CMU-CS-99-108, Carnegie Mellon University.
5. Chen S.F., and Rosenfeld R. A survey of smoothing techniques for ME models. IEEE Trans. Speech Audio Process. 8 1 (2000) 37-50
6. Darroch J., and Ratcliff D. Generalized iterative scaling for log-linear models. Ann. Math. Statist. 43 (1972) 1470-1480
7. Deng, L., Li, X., Yu, D., Acero, A., 2005. A hidden trajectory model with bi-directional target-filtering: Cascaded vs. integrated implementation for phonetic recognition, In: Proc. of ICASSP 2005, vol. 1, pp. 337-340.
8. Gong Yi., Han M., Hua W., and Xu W. Maximum entropy model-based baseball highlight detection and classification. Computer Vision and Image Understanding 96 2 (2004) 181-199 Special Issue on Event Detection in Video
9. Goodman, J., 2004. Exponential priors for maximum entropy models. In: Proc. of the HLT-NAACL, pp. 305-311.
10. Gu, Y., McCallum, A., Towsley, D., 2005. Detecting anomalies in network traffic using maximum entropy estimation. In: Proc. of Internet Measurement Conf., pp. 345-350.
11. Guiasu S., and Shenitzer A. The principle of maximum entropy. Math. Intell. 7 1 (1985)
12. Hayes B. A maximum entropy model of phonotactics and phonotactic learning. Linguist. Inq. 39 3 (2008) 379-440
13. Kazama, J., 2004. Improving maximum entropy natural language processing by uncertainty-aware extensions and unsupervised learning. Ph.D. Thesis, University of Tokyo.
14. Kazama J., and Tsujii J. Maximum entropy models with inequality constraints: A case study on text categorization. Mach. Learn. 60 1-3 (2005) 159-194
15. Ma, C., Nguyen, P., Mahajan, M., 2007. Finding speaker identities with a conditional maximum entropy model. In: Proc. of ICASSP 2007, vol. IV, pp. 261-264.
16. Mahajan, M., Gunawardana, A., Acero, A., 2006. Training algorithms for hidden conditional random fields. In: Proc. of ICASSP 2006, vol. I, pp. 273-276.
17. Malouf, R., 2002. A comparison of algorithms for maximum entropy parameter estimation. In: Proc. of CoNLL, vol. 20, pp. 1-7.
18. Nocedal J. Updating quasi-newton matrices with limited storage. Math. Comput. 35 (1980) 773-782
19. Och, F.J., Ney, H., 2002. Discriminative training and maximum entropy models for statistical machine translation. In: Proc. of the 40th Annual Meeting of the ACL, pp. 295-302.
20. Riedmiller, M., Braun, H., 1993. A direct adaptive method for faster back-propagation learning: The RPROP algorithm. In: Proc. of IEEE ICNN, vol. 1, pp. 586-591.
21. Rosenfeld R. A maximum entropy approach to adaptive statistical language modeling. Comput. Speech Lang. 10 (1996) 187-228
22. Yu, D., Mahajan, M., Mau, P., Acero, A., 2005a. Maximum entropy based generic filter for language model adaptation. In: Proc. of ICASSP 2005, vol. I, pp. 597-600.
23. Yu, D., Deng, L. Acero, A., 2005b. Evaluation of a long-contextual-span hidden trajectory model and phonetic recognizer using A* lattice search, In: Proc. of Interspeech 2005, pp. 553-556.
24. Yu D., Deng L., and Acero A. Structured speech modeling. IEEE Trans. Audio, Speech, Lang. Process. 14 5 (2006) 1492-1504
25. Yu, D., Deng, L., Gong, Y., Acero, A., 2008. Discriminative training of variable-parameter hmms for noise robust speech recognition. In: Proc. of Interspeech 2008, vol. I, pp. 285-288.
26. Yu, D., Deng, L., Acero, A., 2009. Hidden conditional random field with distribution constraints for phone classification, In: Proc. of Interspeech 2009.
27. Yu, D., Deng, L., Gong, Y., Acero, A., in press. A novel framework and training algorithm for variable-parameter hidden markov models. IEEE Trans. Audio, Speech, Lang. Process.