A discriminative HMM/N-gram-based retrieval approach for Mandarin spoken documents

ACM Transactions on Asian Language Information Processing

Volumn 3, Issue 2, 2004, Pages 128-145

  Chen, Berlin ^a   Wang, Hsin Min ^b,d   Lee, Lin Shan ^c  

^a NATIONAL TAIWAN NORMAL UNIVERSITY   (Taiwan)

^b ACADEMIA SINICA   (Taiwan)

^c NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^d INSTITUTE OF INFORMATION SCIENCE   (Taiwan)

Author keywords

Hidden Markov models; Mandarin spoken documents; Syllable level Indexing features

Indexed keywords

HIDDEN MARKOV MODELS; MANDARIN SPOKEN DOCUMENTS; STATISTICAL MODELING; SYLLABLE-LEVEL INDEXING FEATURES;

ERROR ANALYSIS; INFORMATION RETRIEVAL; MATHEMATICAL MODELS; PATTERN RECOGNITION; PROBABILITY; PROBLEM SOLVING; SPEECH RECOGNITION; STATISTICAL METHODS;

INDEXING (OF INFORMATION);

EID: 10044234199     PISSN: 15300226     EISSN: None     Source Type: Journal    
DOI: 10.1145/1034780.1034784     Document Type: Article

References (38)

1. ALLAN, J. (ED.), ASLAM, J., BELKIN, N., BUCKLEY, C., CALLAN, J., CROFT, W. B. (ED.), DUMAIS, S., FUHR, N., HARMAN, D., HARPER, D., HIEMSTRA, D., HOFMANN, T., HOVY, E., KRAAIJ, W., LAFFERTY, J., LAVRENKO, V., LEWIS, D., LIDDY, L., MANMATHA, R., MCCALLUM, A., PONTE, J., PRAGER, J., RADEV, D., RESNIK, P., ROBERTSON, S., ROSENFELD, R., ROUKOS, S., SANDERSON, M., SCHWARTZ, R., SINGHAL, A., SMEATON, A., TURTLE, H., VOORHEES, E., WEISCHEDEL, R., Xu, J., AND ZHAI, C. 2003. Challenges in information retrieval and language modeling. SIGIR Forum 37, 1 (2003), 31-47.
2. AMARI, S. I. 1972. Learning patterns andpattern sequences by self-organizing nets of threshold elements. IEEE Trans. on Computer C-12, 11 (1972), 1197-1206.
3. BAEZA-YATES, R. AND RIBEIRO-NETO, B. 1999. Modern Information Retrieval. Addison Wesley, Reading, MA.
4. BELLEGARDA, J. R. 2004. Statistical language model adaptation: Review and perspectives. Speech Communication 42 (2004), 93-108.
5. BERGER, A. AND LAFFERTY, J. 1999. Information retrieval as statistical translation. In Proceedings of the ACM SIGIR Conference on R&D in Information Retrieval. ACM, New York.
6. CHANG, E., SEIDE, F., MENG, H., CHEN, Z., SHI, Y., AND LI, Y. C. 2002. A system for spoken query information retrieval on mobile devices. IEEE Trans. on Speech and Audio Processing 10, 8 (2002), 531-541.
7. CHEN, B., WANG, H. M., AND LEE, L. S. 2001. An HMM/N-gram-based linguistic processing approach for Mandarin spoken document retrieval. In Proceedings of the European Conference on Speech Communication and Technology.
8. CHEN, B., WANG, H. M., AND LEE, L. S. 2002. Discriminating capabilities of syllable-based features and approaches of utilizing them for voice retrieval of speech information in Mandarin Chinese. IEEE Trans. on Speech and Audio Processing 10, 5 (2002), 303-314.
9. CHEN, S. F. AND GOODMAN, J. 1999. An empirical study of smoothing techniques for language modeling. Computer Speech and Language 13 (1999), 359-394.
10. CHOU, W. AND JUANG, B. H. 1992. Adaptive discriminative learning in pattern recognition. Tech. Rep., AT&T Bell Laboratories, 1992.
11. CHOU, W. AND JUANG, B. H. (EDS.) 2003. Pattern Recognition in Speech and Language Processing. CRC Press.
12. CROFT, W. B. AND LAFFERTY, J. (EDS.) 2003. Language Modeling for Information Retrieval. Kluwer, Amsterdam.
13. DEMPSTER, A. P., LAIRD, N. M., AND RUBIN, D. B. 1977. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society B(39), (1977), 1-38.
14. FEDERICO, M. 2000. A system for the retrieval of Italian broadcast news. Speech Communication 32 (2000), 37-47.
15. HARMAN, D. 1995. Overview of the Fourth Text Retrieval Conference (TREC-4). Available at http://trec.nist.gov/pubs/trec4/overview.ps.
16. HOFFMANN, T. 1999. Probabilistic latent semantic indexing. In Proceedings of the ACM SIGIR Conference on R&D in Information Retrieval. ACM, New York.
17. JELINEK, F. 1997. Statistical Methods for Speech Recognition. MIT Press, Cambridge, MA.
18. JOURLIN, P., JOHNSON, S. E., SPARCK JONES, K., AND WOODLAND, P. C. 2000. Spoken document representations for probabilistic retrieval. Speech Communication 32 (2000), 21-36.
19. JUANG, B. H., CHOU, W., AND LEE, C. H. 1997. Minimum classification error rate methods for speech recognition. IEEE Trans. on Speech and Audio Processing 5, 3 (1997), 257-265.
20. LAFFERTY, L. AND ZHAI, C. 2001. Document language models and risk minimization for information retrieval. In Proceedings of the ACM SIGIR Conference on R&D in Information Retrieval. ACM, New York.
21. th European Colloquium on IR Research (ECIR'02).
22. LDC. 2000. Project topic detection and tracking. Linguistic Data Consortium, http://www.ldc.upenn.edu/ Projects/TDT/.
23. LEE, L. S. 1997. Voice dictation of Mandarin Chinese. IEEE Signal Processing Magazine 14, 4 (1997), 63-101.
24. LIU, X. AND CROFT, W. B. 2003. Statistical language modeling for information retrieval. To appear in The Annual Review of Information Science and Technology 39 (2005).
25. MENG, H., Lo W. K., Li, Y. C., AND CHING, P. C. 2000. Multi-scale audio indexing for spoken document retrieval. In Proceedings of the International Conference on Spoken Language Processing.
26. MENG, H., CHEN, B., KHUDANPUR, S., LEVOW, G. A., LO, W. K., OARD, D., SCHONE, P., TANG, K., WANG, H. M., AND WANG, J. 2004. Mandarin-English Information (MEI): Investigating translingual speech retrieval. Computer Speech and Language 18, 2 (2004), 163-179.
27. MILLER, D. R. H., LEEK, T., AND SCHWARTZ, R. 1999. A hidden Markov model information retrieval system. In Proceedings of ACM SIGIR Conference on R&D in Information Retrieval. ACM, New York.
28. NG, G., WILKINSON, R., AND ZOBEL, J. 2000. Experiments in spoken document retrieval using phoneme N-grams. Speech Communication 32 (2000), 61-77.
29. NG, K. 2000. Information fusion for spoken document retrieval. In Proceedings of IEEE International Conference on Acoustic, Speech, Signal Processing.
30. PONTE, J. M. AND CROFT, W. B. 1998. A language modeling approach to information retrieval. In Proceedings of the ACM SIGIR Conference on R&D in Information Retrieval. ACM, New York.
31. RAHIM, M. G., LEE, C. H., AND JUANG, B. H. 1997. Discriminative utterance verification for connected digit recognition. IEEE Trans. on Speech and Audio Processing 5, 3 (1997), 266-277.
32. RENALS, S., ABBERLEY, D., KIRBY, D., AND ROBINSON, T. 2000. Indexing and retrieval of broadcast news. Speech Communication 32 (2000), 5-20.
33. SALTON, G. AND MCGILL, M. J. 1983. Introduction to Modern Information Retrieval. McGraw-Hill, New York.
34. Song, F. and Croft, W. B. 1999. A general language model for information retrieval. In Proceedings of the ACM SIGIR Conference on Information and Knowledge Management. ACM, New York.
35. SRINIVASAN, S. AND PETKOVIC, D. 2000. Phonetic confusion matrix based spoken document retrieval. In Proceedings of the ACM SIGIR Conference on R&D in Information Retrieval. ACM, New York.
36. WANG, H. M. 2000. Experiments in syllable-based retrieval of broadcast news speech in Mandarin Chinese. Speech Communication 32 (2000), 49-60.
37. ZHAI, C. AND LAFFERTY, J. 2001. A study of smoothing methods for language models applied to ad hoc information retrieval. In Proceedings of the ACM SIGIR Conference on R&D in Information Retrieval. ACM, New York.
38. Zhan, P., Wegmann, S., and Gillick, L. 1999. Dragon Systems' 1998 broadcast news transcription system for Mandarin. In Proceedings of the DARPA Broadcast News Workshop.