Association pattern language modeling

IEEE Transactions on Audio, Speech and Language Processing

Volumn 14, Issue 5, 2006, Pages 1719-1728

  Chien, Jen Tzung ^a,b  

^a IEEE   (Taiwan)

^b NATIONAL CHENG KUNG UNIVERSITY   (Taiwan)

Author keywords

Association pattern; Data mining; Language model; Long distance association; Maximum entropy and trigger pairz

Indexed keywords

ASSOCIATION PATTERNS; LANGUAGE MODELS; LONG DISTANCE ASSOCIATIONS; MAXIMUM ENTROPY (ME);

CLASSIFICATION (OF INFORMATION); DATA MINING; FEATURE EXTRACTION; INTERPOLATION; MATHEMATICAL MODELS;

SPEECH RECOGNITION;

EID: 34147179506     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSA.2005.858551     Document Type: Article

References (25)

1. R. Agrawal and R. Srikant, "Fast algorithms for mining association rules," in Proc. Int. Conf. Very Large Data Bases (VLDB), Santiago, Chile, 1994, pp. 487-499.
2. J. R. Bellegarda, "Exploiting latent semantic information in statistical language modeling," Proc. IEEE, vol. 88, no. 8, pp. 1279-1296, Aug. 2000.
3. S. F. Chen and J. Goodman, "An empirical study of smoothing techniques for language modeling," Comput. Speech Lang., vol. 13, pp. 359-394, 1999.
4. J.-T. Chien, "Decision tree state tying using cluster validity criteria," IEEE Trans. Speech Audio Process., vol. 13, no. 2, pp. 182-193, Mar. 2005.
5. J.-T. Chien and S. Furui, "Predictive hidden Markov model selection for speech recognition," IEEE Trans. Speech Audio Process., vol. 13, no. 3, pp. 377-387, May 2005.
6. J.-T. Chien and H.-Y. Chen, "Mining of association patterns for language modeling," in Proc. Int. Conf. Spoken Language Processing (ICSLP), vol. 2, 2004, pp. 1369-1372.
7. J.-T. Chien, M.-S. Wu, and H.-J. Peng, "On latent semantic language modeling and smoothing," in Proc. Int. Conf. Spoken Language Processing (ICSLP), vol. 2, 2004, pp. 1373-1376.
8. C.-H. Chueh, J.-T. Chien, and H. Wang, "A maximum entropy approach for integrating semantic information in statistical language models," in Proc. Int. Symp. Chinese Spoken Language Processing (ISCSLP), 2004, pp. 309-312.
9. J. N. Darroch and D. Ratcliff, "Generalized iterative scaling for log-linear models," Annals of Math. Statist., vol. 43, no. 5, pp. 1470-1480, 1972.
10. X. Huang, F. Alleva, H.-W. Hon, M.-Y. Hwang, K.-F. Lee, and R. Rosenfeld, "The SPHINX-II speech recognition system: An overview," Comput. Speech and Lang., vol. 2, pp. 137-148, 1993.
11. J. D. Holt and S. M. Chung, "Efficient mining of association rules in text databases," in Proc. Int. ACM Conf. Information and Knowledge Management (CIKM), 1999, pp. 234-242.
12. A. Ito, M. Kohda, and M. Ostendorf, "A new metric for stochastic language model evaluation," in Proc. European Conf. Speech Communication and Technology (EUROSPEECH), vol. 4, 1999, pp. 1591-1594.
13. R. M. Iyer and M. Ostendorf, "Modeling long distance dependence in language: Topic mixtures versus dynamic cache models," IEEE Trans. Speech and Audio Process., vol. 7, no. I, pp. 30-39, Jan. 1999.
14. E. T. Jaynes, "Information theory and statistical mechanics," Phys. Rev., vol. 106, no. 4, pp. 620-630, 1957.
15. R. Kuhn and R. de Mori, "A cache-based natural language model for speech recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 6, pp. 570-583, Jun. 1990.
16. M. Mahajan, D. Beeferman, and X. D. Huang, "Improved topic-dependent language modeling using information retrieval techniques," in Proc. IEEE Int. Conf. Acoustic, Speech and Signal Processing (ICASSP), 1999, pp. 541-544.
17. S. Della Pietra, V. Della Pietra, R. L. Mercer, and S. Roukos, "Adaptive language modeling using minimum discrimination estimation," in Proc. IEEE Int. Conf. Acoustic, Speech and Signal Processing (ICASSP), 1992, pp. I-633-I-636.
18. J. M. Ponte and W. B. Croft, "A language modeling approach to information retrieval," in Proc. 21st Ann. Int. ACM SIGIR Conf. Research and Development in Information Retrieval (SIGIR'9S), 1998, pp. 275-281.
19. R. Rosenfeld, "A maximum entropy approach to adaptive statistical language modeling," Comput. Speech Lang., vol. 10, pp. 187-228, 1996.
20. R. Rosenfeld, "Two decades of statistical language modeling: Where do we go from here?" Proc. IEEE, vol. 88, no. 8, pp. 1270-1278, Aug. 2000.
21. M. Simons, H. Ney, and S. C. Martin, "Distant bigram language modeling using maximum entropy," in Proc. IEEE Int. Conf. Acoustic, Speech and Signal Processing (ICASSP), vol. 2, 1997, pp. 787-790.
22. S. Wang, D. Schuurmans, F. Peng, and Y. Zhao, "Semantic n-gram language modeling with the latent maximum entropy principle," in Proc. IEEE Int. Conf. Acoustic, Speech, and Signal Processing (ICASSP), 2003, pp. 376-379.
23. I. H. Witten and T. C. Bell, "The zero-frequency problem: Estimating the probabilities of novel events in adaptive text compression," IEEE Trans. Inform. Theory, vol. 37, no. 4, pp. 1085-1094, Jul. 1991.
24. J. Wu and S. Khudanpur, "Building a topic-dependent maximum entropy model for very large corpora," in Proc. IEEE Int. Conf. Acoustic, Speech and Signal Processing (ICASSP), vol. 1, 2002, pp. 777-780.
25. G. D. Zhou and K. T. Lua, "Interpolation of n-gram and mutual-information based trigger pair language models for Mandarin speech recognition," Comput. Speech and Lang., vol. 13, pp. 125-141, 1999.