Sequence modeling with mixtures of conditional maximum entropy distributions

Proceedings - IEEE International Conference on Data Mining, ICDM

Volumn , Issue , 2003, Pages 251-258

  Pavlov, Dmitry ^a  

^a YAHOO INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 38849167682     PISSN: 15504786     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. A. Berger, S. Della Pietra, and V. Della Pietra. A maximum entropy approach to natural language processing. Computational Linguistics, 22(1):39-72, 1996.
2. E. C. Buehler and L. H. Ungar. Maximum entropy methods for biological sequence modeling. In BIOKDD, pages 60-64, 2001.
3. I. Cadez, D. Heckerman, C. Meek, P. Smyth, and S. White. Visualization of navigation patterns on a web site using model-based clustering. In Knowledge Discovery and Data Mining, pages 280-284, 2000.
4. I. Cadez, P. Smyth, E. Ip, and H. Mannila. Predictive profiles for transaction data using finite mixture models. Technical Report UCI-ICS 01-67, UC Irvine, 2001.
5. S. Chen and R. Rosenfeld. A Gaussian prior for smoothing maximum entropy models. Technical Report CMUCS-99-108, Carnegie Mellon University, 1999.
6. J. N. Darroch and D. Ratcliff. Generalized iterative scaling for log-linear models. Annals of Mathematical Statistics, 43:1470-1480, 1972.
7. S. Della Pietra, V. Della Pietra, and J. Lafferty. Inducing features of random fields. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(4):380-393, April 1997.
8. A. P. Dempster, N. M. Laird, and D. B. Rubin. Maximum likelihood from incomplete data via the em algorithm. Journal of the Royal Statistical Society, B-39:1-38, 1977.
9. J. Goodman. Classes for fast maximum entropy training. In Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, 2001.
10. J. Goodman. Sequential conditional generalized iterative scaling. In Association for Computational Linguistics Annual Meeting, 2002.
11. E. T. Jaynes. Where do we stand on maximum entropy? In The Maximum Entropy Formalism, pages 15-118, Cambridge MA, 1979. MIT Press.
12. F. Jelinek. Statistical Methods for Speech Recognition. Cambridge. MA:MIT Press, 1998.
13. E. Manavoglu, D. Pavlov, and C. L. Giles. Probabilstic user behavior models. In Proceedings of the Third IEEE International Conference on Data Mining (ICDM'03), 2003.
14. H. Mannila, D. Pavlov, and P. Smyth. Predictions with local patterns using cross-entropy. In Proc. of Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 357-361. New York, NY: ACM Press, 1999.
15. A. McCallum. Efficiently inducing features of conditional ramdom fields. In Proceedings of the 19th Conference on Uncertainty in Artficial Intelligence (UAI'03), 2003.
16. G. McLachlan and K. Basford. Mixture Models. Marcel Dekker, New York, 1988.
17. G. McLachlan and T. Krishnan. The EM Algorithm and Extensions. John Wiley and Sons, New York, 1997.
18. D. Pavlov. Sequence modeling with mixtures of conditional maximum entropy distributions. Technical Report NEC Laboratories TR, NEC Laboratories America, 2002.
19. D. Pavlov and D. Pennock. A maximum entropy approach to collaborative filtering in dynamic, sparse, high-dimensional domains. In Proceedings of Neural Information Processing Systems (NIPS-2002), 2002.
20. D. Pavlov, A. Popescul, D. Pennock, and L. Ungar. Mixtures of conditional maximum entropy models. In International Conference on Machine Learning (ICML-2003), 2003.
21. D. Pavlov and P. Smyth. Probabilistic query models for transaction data. In Proceedings of Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 164-173. New York, NY: ACM Press, 2001.
22. A. Ratnaparkhi. A maximum entropy model for part-of-speech tagging. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, pages 133- 142. ACL, 1996.
23. P. Smyth. Clustering sequences with hidden markov models. In M. C. Mozer, M. I. Jordan, and T. Petsche, editors, Advances in Neural Information Processing Systems, volume 9, page 648. The MIT Press, 1997.
24. S. Wang, R. Rosenfeld, Y. Zhao, and D. Shuurmans. The latent maximum entropy principle. In IEEE International Symposium on Information Theory (ISIT), 2002.