A discriminative language model with Pseudo-negative samples

ACL 2007 - Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics

Volumn , Issue , 2007, Pages 73-80

  Okanohara, Daisuke ^a   Tsujii, Jun'ichi ^a,b,c  

^a UNIVERSITY OF TOKYO   (Japan)

^b UNIVERSITY OF MANCHESTER   (United Kingdom)

^c NaCTeM (National Center for Text Mining)   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

CLASS MODELS; COMPUTATIONAL COSTS; EXTRACTING FEATURES; LANGUAGE MODEL; LATENT INFORMATION; N-GRAM LANGUAGE MODELS; NEGATIVE EXAMPLES; NONLOCAL INFORMATION; OVERLAPPING FEATURES; PROBABILISTIC LANGUAGE; RE-RANKING; SEMI-MARKOV; TRAINING SAMPLE;

COMPUTATIONAL EFFICIENCY; NATURAL LANGUAGE PROCESSING SYSTEMS;

COMPUTATIONAL LINGUISTICS;

EID: 80053344834     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. Eugene Charniak and Mark Johnson. 2005. Coarse-tofine n-best parsing and maxent discriminative reranking. In Proc. of ACL 05, pages 173-180, June.
2. Stanley F. Chen and Joshua Goodman. 1998. An empirical study of smoothing techniques for language modeling. Technical report, Harvard Computer Science Technical report TR-10-98.
3. Li Cheng, S V N Vishwanathan, Dale Schuurmans, Shaojun Wang, and Terry Caelli. 2006. Implicit online learning with kernels. In NIPS 2006.
4. Koby Crammer, Ofer Dekel, Joseph Keshet, Shai Shalev-Shwartz, and Yoram Singer. 2006. Online passive-aggressive algorithms. Journal of Machine Learning Research.
5. Michael I. Jordan David M. Blei, Andrew Y. Ng. 2003. Latent dirichlet allocation. Journal of Machine Learning Research., 3:993-1022.
6. Ofer Dekel, Shai Shalev-Shwartz, and Yoram Singer. 2005. The forgetron: A kernel-based perceptron on a fixed budget. In Proc. of NIPS.
7. Sabine Deligne and Frédéric BIMBOT. 1995. Language modeling by variable length sequences: Theoretical formulation and evaluation of multigrams. In Proc. ICASSP '95, pages 169-172.
8. Jianfeng Gao, Hao Yu, Wei Yuan, and Peng Xu. 2005. Minimum sample risk methods for language modeling. In Proc. of HLT/EMNLP.
9. Taku Kudo and Yuji Matsumoto. 2003. Fast methods for kernel-based text analysis. In ACL.
10. Sven Martin, Jörg Liermann, and Hermann Ney. 1998. Algorithms for bigram and trigram word clustering. Speech Communicatoin, 24(1):19-37.
11. Yusuke Miyao and Jun'ichi Tsujii. 2005. Probabilistic disambiguation models for wide-coverage hpsg parsing. In Proc. of ACL 2005., pages 83-90, Ann Arbor, Michigan, June.
12. Brian Roark, Murat Saraclar, and Michael Collins. 2007. Discriminative n-gram language modeling. computer speech and language. Computer Speech and Language, 21(2):373-392.
13. Roni Rosenfeld, Stanley F. Chen, and Xiaojin Zhu. 2001. Whole-sentence exponential language models: a vehicle for linguistic-statistical integration. Computers Speech and Language, 15(1).
14. Noah A. Smith and Jason Eisner. 2005. Contrastive estimation: Training log-linear models on unlabeled data. In Proc. of ACL.
15. John S. Taylor and Nello. Cristianini. 2004. Kernel Methods for Pattern Analysis. Cambiridge Univsity Press.
16. Shaojun Wang, Shaomin Wang, Russell Greiner, Dale Schuurmans, and Li Cheng. 2005. Exploiting syntactic, semantic and lexical regularities in language modeling via directed markov random fields. In Proc. of ICML.