Exploring asymmetric clustering for statistical language modeling

Proceedings of the Annual Meeting of the Association for Computational Linguistics

Volumn 2002-July, Issue , 2002, Pages 183-190

  Gao, Jianfeng ^a   Goodman, Joshua T ^b   Cao, Guihong ^c   Li, Hang ^a  

^a MICROSOFT RESEARCH ASIA   (China)

^b MICROSOFT RESEARCH   (United States)

^c TIANJIN UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; MODELING LANGUAGES; NATURAL LANGUAGE PROCESSING SYSTEMS; STOCHASTIC SYSTEMS;

ASYMMETRIC CLUSTERS; CLASSIFIEDS; CLUSTERINGS; CLUSTERS MODEL; FORMAL DEFINITION; N-GRAM MODELING; N-GRAM MODELS; REALISTIC APPLICATIONS; STATISTICAL LANGUAGE MODELLING; STOCHASTIC-MODELING;

STOCHASTIC MODELS;

EID: 44949127588     PISSN: 0736587X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. Bai, S., Li, H., Lin, Z., and Yuan, B. (1998). Building class-based language models with contextual statistics. In ICASSP-98, pp. 173-176.
2. Bellegarda, J. R., Butzberger, J. W., Chow, Y. L., Coccaro, N. B., and Naik, D. (1996). A novel word clustering algorithm based on latent semantic analysis. In ICASSP-96.
3. Brown, P. F., Cocke, J., Della Pietra, S. A., Della Pietra, V. J., Jelinek, F., Lafferty, J. D., Mercer, R. L., and Roossin, P. S. (1990). A statistical approach to machine translation. Computational Linguistics, 16(2), pp. 79-85.
4. Brown, P. F., Della Pietra V. J., de Souza, P. V., Lai, J. C., and Mercer, R. L. (1992). Class-based n-gram models of natural language. Computational Linguistics, 18(4), pp. 467-479.
5. Clarkson, P. R., and Rosenfeld, R. (1997). Statistical language modeling using the CMU-Cambridge toolkit. In Eurospeech 1997, Rhodes, Greece.
6. Gao, J. Goodman, J. and Miao, J. (2001). The use of clustering techniques for language model - application to Asian language. Computational Linguistics and Chinese Language Processing. Vol. 6, No. 1, pp 27-60.
7. Gao, J., Goodman, J., Li, M., and Lee, K. F. (2002). Toward a unified approach to statistical language modeling for Chinese. ACM Transactions on Asian Language Information Processing. Vol. 1, No. 1, pp 3-33.
8. Goodman, J. (2001). A bit of progress in language modeling. In Computer Speech and Language, October 2001, pp 403-434.
9. Goodman, J., and Gao, J. (2000). Language model size reduction by predictive clustering. ICSLP-2000, Beijing.
10. Jelinek, F. (1990). Self-organized language modeling for speech recognition. In Readings in Speech Recognition, A. Waibel and K. F. Lee, eds., Morgan-Kaufmann, San Mateo, CA, pp. 450-506.
11. Katz, S. M. (1987). Estimation of probabilities from sparse data for the language model component of a speech recognizer. IEEE Transactions on Acoustics, Speech and Signal Processing, ASSP-35(3):400-401, March.
12. Kneser, R. and Ney, H. (1993). Improved clustering techniques for class-based statistical language modeling. In Eurospeech, Vol. 2, pp. 973-976, Berlin, Germany.
13. Ney, H., Essen, U., and Kneser, R. (1994). On structuring probabilistic dependences in stochastic language modeling. Computer, Speech, and Language, 8:1-38.
14. stAnnual Meeting of the ACL.
15. Rosenfeld, R. (2000). Two decades of statistical language modeling: where do we go from here. In Proceeding of the IEEE, 88:1270-1278, August.
16. Saul, L., and Pereira, F.C.N. (1997). Aggregate and mixed-order Markov models for statistical language processing. In EMNLP-1997.
17. Stolcke, A. (1998). Entropy-based Pruning of Backoff Language Models. Proc. DARPA News Transcription and Understanding Workshop, 1998, pp. 270-274.
18. Ueberla, J. P. (1996). An extended clustering algorithm for statistical language models. IEEE Transactions on Speech and Audio Processing, 4(4): 313-316.
19. thAnnual meetings of the Association for Computational Linguistics (ACL'01), Toulouse, 6-11 July 2001.
20. Yamamoto, H., and Sagisaka, Y. (1999). Multi-class Composite N-gram based on Connection Direction, In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, May, Phoenix, Arizona.