IMPROVING N-GRAM MODELING USING DISTANCE-RELATED UNIT ASSOCIATION MAXIMUM ENTROPY LANGUAGE MODELING

6th European Conference on Speech Communication and Technology, EUROSPEECH 1999

Volumn , Issue , 1999, Pages 1611-1614

  Zhang, Shuwu ^a   Singer, Harold ^a   Wu, Dekai ^b   Sagisaka, Yoshinori ^a  

^a ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^b HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

MAXIMUM ENTROPY METHODS; MODELING LANGUAGES; SPEECH COMMUNICATION;

CO-OCCURRENCE; DISTANCE UNITS; FUNCTIONAL APPROXIMATION; HIGH-ORDER; HIGHER-ORDER; LANGUAGE MODEL; MAXIMUM-ENTROPY; N-GRAM MODELING; N-GRAM MODELS; N-GRAMS;

COMPUTATIONAL LINGUISTICS;

EID: 0037519285     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. V.J. Delia Pietra, A.L. Berger, and S.A. Delia Pietra. A maximum entropy approach to natural language processing. Computational Linguistics, 1996.
2. S.D. Pietra, V.D. Pietra, and J. Lafferty. Inducing features of random fields. IEEE Trans. Pattern Analysis And Machine Intelligence, 19:1-13, 1997.
3. R. Rosenfeld. A maximum entropy approach to adaptive statistical language modeling. Computer Speech and Language, pages 187-228, 1996.
4. E. S. Ristad. A maximum entropy modeling toolkit. Technical report, Dept. of Computer Sciences,Princeton University, January 1997.
5. A. Stolcke, C. Chelba, D. Engle, V. Jimenez, L. Mangu, H. Printz, E. Ristad, R. Rosenfeld, and D. Wu. Dependency language modeling. Technical report, Workshop96 Project Report, Johns Hopkins Univ., 1996.
6. R. Lau, R. Rosenfeld, and S. Roukos. Adaptive language modeling using the maximum entropy principle. In Proceedings of the Human Language Technology Workshop, pages 108-113, 1993.
7. A. Ratnaparkhi. A maximum entropy model for part-of-speech tagger. In Proceedings of the Empirical Methods in Natural Language Processing Conference, 1996.
8. J.N. Darroch and D. Ratcliff. Generalized iterative scaling for log-linear models. In The Annals of Mathematical Statistics, pages 1470-1480, 1972.
9. S.Zhang, H.Singer, and Y.Sagisaka. Distance-related unit association maximum entropy language modeling. In The 1999 Spring meeting of the acoustical society of Japan, March,1999.
10. H.Ney, U.Essen, and R.Kneser. On structuring probabilistic dependences in stochastic language modelling. Computer Speech and Language, 8:1-38, 1994.
11. T.Morimoto et.al. Speech and language database for speech translation research. In LCSLP'94, pages 1791-1794, 1994.
12. H. Masataki and Y. Sagisaka. Variable order ngram generation by word-class splitting and consecutive word grouping. In LCASSP'96, pages 188-191, 1996.
13. P.Clarkson and R.Rosenfeld. Statistical language modeling using the CMU-Cambridge toolkit. In Eurospeech'97, pages 2707-2710, 1997.