Algorithms for bigram and trigram word clustering

Speech Communication

Volumn 24, Issue 1, 1998, Pages 19-37

  Martin, Sven ^a   Liermann, Jörg ^a   Ney, Hermann ^a  

^a RWTH AACHEN UNIVERSITY   (Germany)

Author keywords

Statistical clustering; Stochastic language modeling; Wall street journal corpus; Word equivalence classes

Indexed keywords

ALGORITHMS; COMPUTATIONAL COMPLEXITY;

LANGUAGE MODELS; PERPLEXITY; WORD CLUSTERING;

SPEECH RECOGNITION;

EID: 0032049073     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0167-6393(97)00062-9     Document Type: Article

References (19)

1. Bahl, L.R., Jelinek, F., Mercer, R.L., 1983. A maximum likelihood approach to continuous speech recognition. IEEE Trans. Pattern Anal. Machine Intell. 5, 179-190.
2. Bellegarda, J.R., Butzberger, J.W., Chow, Y.-L., Coccaro, N.B., Naik, D., 1996. A novel word clustering algorithm based on latent semantic analysis. In: Proc. 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing, Atlanta, GA, pp. 172-175.
3. Brill, E., 1993. A corpus-based approach to language learning. Ph.D. Thesis, Department of Computer and Information Science, University of Pennsylvania, Philadelphia, PA.
4. Brown, P.F., Della Pietra, V.J., de Souza, P.V., Lai, J.C., Mercer, R.L., 1992. Class based n-gram models of natural language. Computational Linguistics 18 (4), 467-479.
5. Duda, R.O., Hart, P.E., 1973. Pattern Classification and Scene Analysis. J. Wiley and Sons, New York.
6. Jardino, M., Adda, G., 1993. Automatic word classification using simulated annealing. In: Proc. 3rd European Conf. on Speech Communication and Technology, Berlin, pp. 1191-1194.
7. Jardino, M., Adda, G., 1994. Automatic determination of a stochastic bi gram class language model. In: Carrasco, R.C., Oncina, J. (Eds.), Grammatical Inference and Applications, 2nd Internat. Coll., ICGI-94, Alicante, Spain. Lecture Notes in Artificial Intelligence, vol. 862, Springer, Berlin, pp. 57-65.
8. Jardino, M., 1996. Multilingual stochastic n-gram class language models. In: Proc. 1996 IEEE Internat. Conf. on Acoustics, Speech, and Signal Processing, Atlanta, GA, pp. 161-163.
9. Jelinek, F., 1991. Self-organized language modeling for speech Recognition. In: Waibel, A., Lee, K.-F. (Eds.), Readings in Speech Recognition, Morgan Kaufmann, San Mateo, CA, pp. 450-506.
10. Kneser, R., Ney, H., 1993. Improved clustering techniques for class based statistical language modelling. In: Proc. 3rd European Conf. on Speech Communication and Technology, Berlin, pp. 973-976.
11. Lafferty, J.D., Mercer, R.L., 1993. Automatic classification using features of spelling. In: Proc. 9th Ann. Conf. of the University of Waterloo Centre for the new OED and Text Research, Oxford University Press, Oxford, pp. 89-103.
12. Ney, H., Essen, U., Kneser, R., 1994. On structuring probabilistic dependences in stochastic language modelling. Computer Speech and Language 8, 1-38.
13. Ney, H., Essen, U., Kneser, R., 1995. On the estimation of small probabilities by leaving one out. IEEE Trans. Pattern Anal. Machine Intell. 17 (12), 1202-1212.
14. Ney, H., Martin, S.C., Wessel, F., 1997. Statistical language modeling using leaving one-out. In: Young, S., Bloothooft, G. (Eds.), Corpus-Based Methods in Language and Speech Processing. Kluwer Academic Publishers, Dordrecht, The Netherlands, pp. 174-207.
15. Ortmanns, S., Ney, H., Aubert, X., 1997. A word graph algorithm for large vocabulary continuous speech recognition. Computer, Speech and Language 11 (1), 43-72.
16. Paul, D.B., Baker, J.M., 1992. The design for the Wall Street Journal-based CSR corpus. In: Proc. DARPA Speech and Natural Language Workshop, Harriman, NY, pp. 357-362.
17. Rosenfeld, R., 1994. Adaptive statistical language modeling: A maximum entropy approach. Ph.D. Thesis, Tech. Rept. CMU-CS-94-138, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, 114 pages.
18. Takács, L., 1984. Combinatorics. In: Krishnaiah, P.R., Sen, P.K. (Eds.), Nonparametric Methods, Handbook of Statistics, vol. 4. North-Holland, Amsterdam, pp. 123-143.
19. Wessel, F., Ortmanns, S., Ney, H., 1997. Implementation of word based statistical language models. In: Proc. 2nd SQEL Workshop, Plzen (Pilsen), pp. 55-59.