Web resources for language modeling in conversational speech recognition

ACM Transactions on Speech and Language Processing

Volumn 5, Issue 1, 2007, Pages

  Bulyko, Ivan ^a   Ostendorf, Mari ^b   Siu, Manhung ^a,c   Ng, Tim ^a,c   Stolcke, Andreas ^d   Çetin, Özgür ^d  

^a BBN TECHNOLOGIES   (United States)

^b UNIVERSITY OF WASHINGTON   (United States)

^c HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

^d INTERNATIONAL COMPUTER SCIENCE INSTITUTE   (United States)

Author keywords

Conversational speech; Language modeling; Web data

Indexed keywords

CONVERSATIONAL SPEECH; LANGUAGE MODELING; WEB DATA;

DATA ACQUISITION; MATHEMATICAL MODELS; NATURAL LANGUAGE PROCESSING SYSTEMS; TEXT PROCESSING; WEB SERVICES;

SPEECH RECOGNITION;

EID: 37849007170     PISSN: 15504875     EISSN: 15504883     Source Type: Journal    
DOI: 10.1145/1322391.1322392     Document Type: Article

References (58)

1. AKBACAK, M., GAO, Y., GU, L., AND KUO, H.-K. 2005. Rapid transition to new spoken dialog domains: Language model training using knowledge from previous domain applications and web text resources. In Proceedings of Interspeech. 1873-1876.
2. BANKO, M. AND BRILL, E. 2003. Mitigating the paucity-of-data problem: Exploring the effect of training corpus size on classifier performance for natural language processing. In Proceedings of the Conference on Human Language Technology. 253-257.
3. BELLEGARDA, J. 1998. Exploiting both local and global constraints for multispan statistical language modeling. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). vol. II, 677-680.
4. BERGER, A. AND MILLER, R. 1998. Just-in-time language modeling. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). vol. II, 705-708.
5. BESSLING, S. AND MEIER, H. 1995. Language model speaker adaptation. In Proceedings of the Eurospeech. 1755-1758.
6. BIBER, D. 1988. Variation Across Speech and Writing. Cambridge University Press.
7. BIBER, D. 1993. Using register-diversified corpora for general language studies. Computat. Linguis. 19, 2, 219-242.
8. BOULIS, C. 2005. Topic learning in text and conversational speech. Ph.D. thesis, University of Washington.
9. BULYKO, I., OSTENDORF, M., AND STOLCKE, A. 2003. Getting more mileage from web text sources for conversational speech language modeling using class-dependent mixtures. In Proceedings of the HLT/NAACL. 7-9.
10. ÇETIN, O. AND STOLCKE, A. 2005. Language modeling in the ICSI-SRI Spring 2005 Meeting speech recognition evaluation system. Tech. rep. tr-05-06, International Computer Science Institute.
11. CHEN, S. AND GOODMAN, J. 1999. An empirical study of smoothing techniques for language modeling. Comput. Speech Lang. 13, 4, 359-394.
12. CIERI, C., MILLER, D., AND WALKER, K. 2003. From Switchboard to Fisher: Telephone collection protocols, their uses and yields. In Proceedings of Eurospeech. 1597-1600.
13. CLARKSON, P. AND ROBINSON, A. 1997. Language model adaptation using mixtures and an exponentially decaying cache. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). vol. II, 799-802.
14. DEMPSTER, A., LAIRD, N., AND RUBIN, D. 1977. Maximum likelihood from incomplete data via the em algorithm. J. Royal Statis. Soc. Series B 39, 1, 1-38.
15. DUH, K. AND KIRCHHOFF, K. 2005. Pos tagging of dialectal Arabic: A minimally supervised approach. In Proceedings of the Association for Computational Linguistics (ACL).
16. EVERMANN, G., CHAN, H., GALES, M., HAIN, T., LIU, X., MRVA, D., WANG, L., AND WOODLAND, P. 2004a. Development of the 2003 CU-HTK conversational telephone speech transcription system. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). vol. 1, 249-252.
17. EVERMANN, G., CHAN, H., GALES, M., JIA, B., LIU, X., MRVA, D., SIM, K., WANG, L., WOODLAND, P., AND YU, K. 2004b. Development of the 2004 CU-HTK English CTS system using more than 2000 hours of data. In Proceedings of the NIST RT-04F Rich Transcription Workshop.
18. GAO, Y., GU, L., AND KUO, H.-K. 2005. Portability challenges in developing interactive dialogue systems. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). vol. V, 1017-1020.
19. GILDEA, D. 2001. Corpus variation and parser performance. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. L. Lee and D. Harman, Eds. 167-202.
20. GODFREY, J., HOLLIMAN, E., AND MCDANIEL, J. 1992. Switchboard: Telephone speech corpus for research and development. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). vol. I, 517-520.
21. GOODMAN, J. 2001. A bit of progress in language modeling. Comput. Speech Lang. 16, 4, 403-434.
22. HAIN, T., BURGET, L., DINES, J., MCCOWAN, I., KARAFAT, M., LINCOLN, M., MOORE, D., GARAU, G., WAN, V., ORDELMAN, R., AND RENALS, S. 2005. The development of the AMI system for the transcription of speech in meetings. In Proceedings of the Joint Workshop on Multimodal Interaction and Related Machine Learning Algorithms.
23. HWANG, M., LEI, X., NG, T., OSTENDORF, M., STOLCKE, A., WANG, W., ZHENG, J., AND GADDE, V. 2004. Porting Decipher from English to Mandarin. In Proceedings of the NIST RT-04F Rich Transcription Workshop.
24. HWANG, M.-Y. ET AL. 1996. Predicting unseen triphones with senones. IEEE Trans. Speech Audio Process. 4. 412-419.
25. IYER, R. AND OSTENDORF, M. 1996. Modeling long range dependencies in languages. In Proceedings of the International Conference on Spoken Language Processing (ICSLP). 236-239.
26. IYER, R. AND OSTENDORF, M. 1997. Transforming out-of-domain estimates to improve in-domain language models. In Proceedings of Eurospeech, vol. 4, 1975-1978.
27. IYER, R. AND OSTENDORF, M. 1999. Relevance weighting for combining multi-domain data for n-gram language modeling. Comput. Speech Lang. 13, 3, 267-282.
28. IYER, R., OSTENDORF, M., AND METEER, M. 1997. Analyzing and predicting language model improvements. In IEEE Workshop on Speech Recognition and Understanding Proceedings. 254-261.
29. KELLER, F. AND LAPATA, M. 2003. Using the web to obtain frequencies for unseen bigrams. Comput. Linguist. 29, 3, 459-484.
30. KILGARRIFF, A. AND GREFENSTETTE, G. 2003. Introduction to the special issue on the web as a corpus. Computat. Linguist. 29, 3, 333-348.
31. KLAKOW, D. 2000. Selecting articles from the language model training corpus. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). vol. III, 1695-1698.
32. LAMEL, L., ADDA, G., BILINSKI, E., AND GAUVAIN, J. L. 2005. Transcribing lectures and seminars. In Proceedings of Interspeech. 1657-1660.
33. LAPATA, M. AND KELLER, F. 2005. Unsupervised web-based models for natural language processing. ACM Trans. Speech Lang. Process. 1, 2, 1-31.
34. LEE, Y-B. AND MYAENG, S. 2002. Text genre classification with genre-revealing and subject-revealing features. In Proceedings of SIGIR. 145-150.
35. LIU, R-H., PICHENY, M., SRINIVASA, P., MANKOWSKI, M., AND CHEN, J. 1996. Speech recognition on Mandarin CallHome: A large-vocabulary conversational and telephone speech corpus. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). vol. I, 157-160.
36. MAHAJAN, M., BEEFERMAN, D., AND HUANG, D. 1999. Improved topic-dependent language modeling using information retrieval techniques. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). vol., I, 541-544.
37. MARTIN, S., LIERMANN, J., AND NEY, H. 1997. Adaptive topic-dependent language modeling using word-based varigrams. In Proceedings of Eurospeech, vol. 3. 3, 1447-1450.
38. MORGAN, N., BARON, D., BHAGAT, S., CARVEY, H., DHILLON, R., EDWARDS, J., GELBART, D., JANIN, A., KRUPSKI, A., PESKIN, B., PFAU, T., SHRIBERG, E., STOLCKE, A., AND WOOTERS, C. 2003. Meetings about meetings: Research at ICSI on speech in multiparty conversations. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). Vol. 4, 740-743.
39. NG, T., OSTENDORF, M., HWANG, M.-Y., SIU, M., BULYKO, I., AND LEI, X. 2005. Web-data augmented language models for Mandarin conversational speech recognition. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). 89-593.
40. RATNAPARKHI, A. 1996. A maximum entropy part-of-speech tagger. In Proceedings of Empirical Methods in Natural Language Processing Conference. 133-141.
41. RIES, K. 1997. A class based approach to domain adaptation and constraint integration for empirical m-gram models. In Proceedings of Eurospeech. 4, 1983-1986.
42. RUDNICKY, A. 1995. Language modeling with limited domain data. In Proceedings of ARPA Spoken Language Technology Workshop. 66-69.
43. SARIKAYA, R., GRAVANO, A., AND GAO, Y. 2005. Rapid language model development using external resources for new spoken dialog domains. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). Vol. I, 573-576.
44. SCHEYTT, P., GEUTNER, P., AND WAIBEL, A. 1998. Serbo-Croatian LVCSR on the dictation and broadcast news domain. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). vol. 2, 897-900.
45. SCHWARM, S., BULYKO, I., AND OSTENDORF, M. 2004. Adaptive language modeling with varied sources to cover new vocabulary items. IEEE Trans. Speech Audio 12, 3, 334-342.
46. SETHY, A., GEORGIOU, P., AND NARAYANAN, S. 2005. Building topic-specific language models from webdata using competitive models. In Proceedings of Interspeech. 1293-1296.
47. SPROAT, R., BLACK, A., CHEN, S., KUMAR, S., OSTENDORF, M., AND RICHARDS, C. 2001. Normalization of non-standard words. Comput. Speech Lang. 15, 3, 287-333.
48. STOLCKE, A. 1998. Entropy-based pruning of backoff language models, In Proceedings of DARPA Broadcast News Transcription and Understanding Workshop. 270-274.
49. STOLCKE, A. 2002. SRILM - an extensible language modeling toolkit. In Proceedings of the International Conference on Spoken Language Processing (ICSLP). 901-904.
50. STOLCKE, A., ANGUERA, X., BOAKYE, K., JANIN, A., MANDAL, A., PESKIN, B., WOOTERS, C., AND ZHENG, J. 2005. Further progress in meeting recognition: The ICSI-SRI spring 2005 speech-to-text evaluation system. In Proceedings of NIST MLMI Meeting Recognition Workshop.
51. STOLCKE, A. ET AL. 2003. Speech-to-text research at SRI-ICSI-UW. NIST RT-03 Workshop.
52. VENKATARAMAN, A. AND WANG, W. 2003. Techniques for effective vocabulary selection. In Proceedings of Eurospeech. 245-248.
53. WANG, W., STOLCKE, A., AND HARPER, M. 2004. The use of a linguistically motivated language model in conversational speech recognition. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). vol. I, 261-264.
54. WOODLAND, P. C. AND YOUNG, S. J. 1993. The HTK tied-state continuous speech recogniser. In Proceedings of Eurospeech, vol. 3, 2207-2210.
55. XU, P. AND MANGU, L. 2005. Using random forest language models in the IBM RT-04 CTS system. In Proceedings of Interspeech. 741-744.
56. YANG, Y. AND PEDERSEN, J. 1997. A comparative study on feature selection in text categorization. In Proceedings of the International Conference on Machine Learning. 412-420.
57. ZHU, Q., STOLCKE, A., CHEN, B., AND MORGAN, N. 2005. Using mlp features in SRI's conversational speech recognition system. In Proceedings of Interspeech. 2141-2144.
58. ZHU, X. AND ROSENFELD, R. 2001. Improving trigram language modeling with the World Wide Web. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP). I:533-536.