Hierarchical distributed representations for statistical language modeling

Advances in Neural Information Processing Systems

Volumn , Issue , 2005, Pages

  Blitzer, John ^a   Weinberger, Kilian Q ^a   Saul, Lawrence K ^a   Pereira, Fernando C N ^a  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; OPTICAL CHARACTER RECOGNITION;

DISTRIBUTED REPRESENTATION; MULTINOMIAL DISTRIBUTIONS; NONLINEAR DIMENSIONALITY REDUCTION; PROBABILISTIC LANGUAGE; STATISTICAL LANGUAGE MODELING; STATISTICAL LANGUAGE MODELS; STATISTICAL REGULARITY; UNSUPERVISED ALGORITHMS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84899027412     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. A. Y. Alfakih, A. Khandani, and H. Wolkowicz. Solving Euclidean distance matrix completion problems via semidefinite programming. Computational Optimization Applications, 12(1- 3):13-30, 1999.
2. Y. Bengio, R. Ducharme, P. Vincent, and C. Janvin. A neural probabilistic language model. Journal of Machine Learning Research, 3:1137-1155, 2003.
3. Y. Bengio, R. Ducharme, P. Vincent, and C. Jauvin. A neural probabilistic language model. In T. K. Leen, T. G. Dietterich, and V. Tresp, editors, Advances in Neural Information Processing Systems, volume 13, Cambridge, MA, 2001. MIT Press.
4. D. B. Borchers. CSDP, a C library for semidefinite programming. Optimization Methods and Software, 11(1):613-623, 1999.
5. P. Brown, S. D. Pietra, V. D. Pietra, and R. Mercer. The mathematics of statistical machine translation: parameter estimation. Computational Linguistics, 19(2):263-311, 1991.
6. P. F. Brown, V. J. D. Pietra, P. V. deSouza, J. C. Lai, and R. L. Mercer. Class-based n-gram models of natural language. Computational Linguistics, 18(4):467-479, 1992.
7. S. Chen and J. Goodman. An empirical study of smoothing techniques for language modeling. In Proceedings of the 34th Annual Meeting of the ACL, pages 310-318, 1996.
8. M. Collins. Three generative, lexicalised models for statistical parsing. In Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics, 1997.
9. J. Ham, D. D. Lee, S. Mika, and B. Scholkopf. A kernel view of the dimensionality reduction of manifolds. In Proceedings of the Twenty First International Conference on Machine Learning (ICML-04), Banff, Canada, 2004.
10. T. Hofmann and J. Puzicha. Statistical models for co-occurrence and histogram data. In Proceedings of the International Conference Pattern Recognition, pages 192-194, 1998.
11. F. Jelinek. Statistical Methods for Speech Recognition. MIT Press, 1997.
12. M. I. Jordan and R. A. Jacobs. Hierarchical mixtures of experts and the EM algorithm. Neural Computation, 6:181-214, 1994.
13. L. K. Saul and F. C. N. Pereira. Aggregate and mixed-order Markov models for statistical language processing. In C. Cardie and R. Weischedel, editors, Proceedings of the Second Conference on Empirical Methods in Natural Language Processing (EMNLP-97), pages 81-89, New Providence, RI, 1997.
14. K. Q.Weinberger, F. Sha, and L. K. Saul. Learning a kernel matrix for nonlinear dimensionality reduction. In Proceedings of the Twenty First International Confernence on Machine Learning (ICML-04), Banff, Canada, 2004.
15. C. Zhai and J. Lafferty. A study of smoothing methods for language models applied to information retrieval. ACM Transactions on Information Systems, 22(2):179-214, 2004.