A hybrid language model based on statistics and linguistic rules

International Journal of Pattern Recognition and Artificial Intelligence

Volumn 19, Issue 1, 2005, Pages 109-128

  Wang, Xiaolong ^a   Yeung, Daniel S ^a   Liu, James N K ^a   Luk, Robert ^a   Wang, Xuan ^b  

^a HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

^b HARBIN INSTITUTE OF TECHNOLOGY   (China)

Author keywords

Chinese input; Computational linguistics; Hybrid language model; N gram model

Indexed keywords

COMPUTATIONAL GRAMMARS; FORMAL LANGUAGES; MATHEMATICAL MODELS; OPTICAL CHARACTER RECOGNITION; PROBLEM SOLVING; RECURSIVE FUNCTIONS; SEMANTICS; SPEECH RECOGNITION; STATISTICAL METHODS;

CHINESE INPUT; HYBRID LANGUAGE MODEL; N-GRAM MODEL;

COMPUTATIONAL LINGUISTICS;

EID: 13844281711     PISSN: 02180014     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0218001405003934     Document Type: Article

References (27)

1. L. R. Bahl, P. F. Brown, P. V. deSouza and R. L. Mercer, A tree-based statistical language model for natural language speech recognition, IEEE Trans. Acoust. Speech Sign. Process. 37(1) (1989) 1001-1008.
2. L. R. Bahl, F. Jelinek and R. L. Mercer, A maximum likelihood approach to continuous speech recognition, IEEE Trans. Patt. Anal. Mach. Intell. 5(2) (1983) 179-190.
3. C. Chelba and F. Jelinek, Exploiting syntactic structure for language modeling, ACL 36/Coling 17(1998) 225-231.
4. N. Chomsky, Three models for the description of language, IRE Trans. PGIT 2, (1956) 113-124.
5. P. Clarkson and A. Robinson, Language model adaptation using mixture and an exponentially decaying cathe, in Proc. IEEE ICASSP (1997) 799-802.
6. M. J. Collins, Three generative, lexicalized models for statistical parsing, ACL 35/EACL 8 (1997) 16-23.
7. U. Essen and V. Steinbiss, Co-occurrence smoothing for stochastic language modeling, in Proc. IEEE ICASSP (1992) I161-I164.
8. R. M. Iyer and M. Ostendorf, Modeling long distance dependence in language: topic mixtures versus dynamic cache models, IEEE Trans. Speech Audio Process. 7(1) (1999) 30-39.
9. R. Kneser and J. Peters, Semantic clustering for adaptive language modeling, in Proc. IEEE ICASSP (1997) 779-782.
10. R. Kuhn and R. A. Mori, Cache-based natural language model for speech recognition, IEEE Trans. Patt. Anal. Mach. Intell. 12(6) (1990) 570-583.
11. J. Kupiec, Hidden Markov estimation for unrestricted stochastic context-free grammars, in Proc. IEEE ICASSP (1992) 1177-1180.
12. K. F. Lee, H. W. Hon and R. Reddy, An overview of the sphinx speech recognition system, IEEE Trans. Acoust. Speech Sign. Process. 38(1) (1990) 35-45.
13. L. Lee, et al. Golden mandarin (I)-a real-time Mandarin speech dictation machine for Chinese language with very large vocabulary, IEEE Trans. Speech Audio Process. 1(2) (1993) 158-179.
14. H. Masataki, Y. Sagisaka, K. Hisaaki and T. Kawahara, Task adaptation using MAP estimation in n-gram language modeling, in Proc. IEEE ICASSP (1997) 783-786.
15. T. Niesler and P. Woodland, Modeling word-pair relations in a category-based language model, in Proc. IEEE ICASSP (1997) 795-798.
16. M. Ostendorf, V. V. Digalakis and O. A. Kimball, From HMM's to segment model: a unified view of stochastic modeling for speech recognition, IEEE Trans. Speech Audio Process. 4(5) (1996) 360-378.
17. P. Placeway, R. Schwartz, P. Fung and L. Nguyen, The estimation of powerful language models from small and large corpora, in Proc. IEEE. ICASSP (1993) II33-II36.
18. L. R. Rabiner, A tutorial on hidden Markov models and selected applications in speech recognition, in Proc. IEEE (1989) 257-285.
19. L. R. Rabiner and R. H. Juang, An introduction to hidden Markov models, IEEE ASSP Magazine (1986) 4-16.
20. E. M. Riseman and R. W. Ehrich, Contextual word recognition using binary diagrams, IEEE Trans. Comput. C20(4) (1971) 397-403.
21. M. Simons, H. Ney and S. Martin, Distant bigram language modeling using maximum entropy, in Proc. IEEE ICASSP (1997) 787-790.
22. C. Y. Suen, n-gram statistics for natural language understanding and text processing, IEEE Trans. Patt. Anal. Mach. Intell. 1(2) (1979) 164-172.
23. X. Wang et al. The problem of separating characters into fewest words and its algorithm, Chinese Sci. Bull. 34(2) (1989) 1924-1928.
24. X. Wang et al. Machine learning in pinyin-character translation, Chinese J. Comput. 16(5) (1993) 370-377.
25. X. Wang et al. Speech input by sentence, Chinese J. Comput. 17(2) (1994) 96-103.
26. P. K. Wong and C. Chan, Off-line handwritten Chinese character recognition as a compound Bayes decision problem, IEEE Trans. Patt. Anal. Mach. Intell. 20(9) (1998) 1016-1023.
27. J. Zhao and C. Huang, A quasi-dependency model for structural analysis of Chinese baseNPs, COLING-ACL'98 (1998) 1-7.