Training Connectionist Models for the Structured Language Model

Proceedings of the 2003 Conference on Empirical Methods in Natural Language Processing, EMNLP 2003

Volumn , Issue , 2003, Pages 160-167

  Xu, Peng ^a   Emami, Ahmad ^a   Jelinek, Frederick ^a  

^a Johns Hopkins University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

NATURAL LANGUAGE PROCESSING SYSTEMS;

BACKOFFS; CONNECTIONIST MODELS; DATA SPARSENESS PROBLEM; DISTRIBUTED REPRESENTATION; LANGUAGE MODEL; LINEAR GROWTH; MODEL SIZE; MODEL USE; PERFORMANCE; STRUCTURED LANGUAGE;

COMPUTATIONAL LINGUISTICS;

EID: 33645488707     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1119355.1119376     Document Type: Conference Paper

References (14)

1. Yoshua Bengio, Rejean Ducharme, and Pascal Vincent. 2001. A neural probabilistic language model. In Advances in Neural Information Processing Systems.
2. A. L. Berger, S. A. Della Pietra, and V. J. Della Pietra. 1996. A maximum entropy approach to natural language processing. Computational Linguistics, 22(1):39–72, March.
3. Eugene Charniak. 2001. Immediate-head parsing for language models. In Proceedings of the 39th Annual Meeting and 10th Conference of the European Chapter of ACL, pages 116–123, Toulouse, France, July.
4. Ciprian Chelba and Frederick Jelinek. 2000. Structured language modeling. Computer Speech and Language, 14(4):283–332, October.
5. Stanley F. Chen and Joshua Goodman. 1998. An empirical study of smoothing techniques for language modeling. Technical Report TR-10-98, Computer Science Group, Harvard University, Cambridge, Massachusetts.
6. Ahmad Emami, Peng Xu, and Frederick Jelinek. 2003. Using a connectionist model in a syntactical based language model. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Hong Kong, China, April.
7. Joshua Goodman. 2001. A bit of progress in language modeling. Technical Report MSR-TR-2001-72, Machine Learning and Applied Statistics Group, Microsoft Research, Redmond, WA.
8. Simon Haykin. 1999. Neural Networks, A Comprehensive Foundation. Prentice-Hall, Inc., Upper Saddle River, NJ, USA.
9. James Henderson. 2003. Neural network probability estimation for broad coverage parsing. In Proceedings of the 10th Conference of the EACL, pages 131–138. Budapest, Hungary, April.
10. Woosung Kim, Sanjeev Khudanpur, and Jun Wu. 2001. Smoothing issues in the structured language model. In Proc. 7th European Conf. on Speech Communication and Technology, pages 717–720, Aalborg, Denmark, September.
11. Brian Roark. 2001. Robust Probabilistic Predictive Syntactic Processing: Motivations, Models and Applications. Ph.D. thesis, Brown University, Providence, RI.
12. Andreas Stolcke. 2002. Srilm – an extensible language modeling toolkit. In Proc. Intl. Conf. on Spoken Language Processing, pages 901–904, Denver, CO.
13. Dong Hoon Van Uystel, Dirk Van Compernolle, and Patrick Wambacq. 2001. Maximum-likelihood training of the plcg-based language model. In Proceedings of the Automatic Speech Recognition and Understanding Workshop, Madonna di Campiglio, Trento-Italy, December.
14. Peng Xu, Ciprian Chelba, and Frederick Jelinek. 2002. A study on richer syntactic dependencies for structured language modeling. In Proceedings of the 40th Annual Meeting of the ACL, pages 191–198, Philadelphia, Pennsylvania, USA, July.