Semantic inference based on neural probabilistic language modeling for speech indexing

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2013, Pages 8480-8484

  Huang, Chien Lin ^a   Hori, Chiori ^a   Kashioka, Hideki ^a  

^a NATIONAL INSTITUTE OF INFORMATION AND COMMUNICATIONS TECHNOLOGY   (Japan)

Author keywords

language model; neural network; semantic inference; Speech indexing; spoken document retrieval

Indexed keywords

CONTINUOUS SPACES; LANGUAGE MODEL; PROBABILISTIC LANGUAGE; SEMANTIC INDEXING; SEMANTIC INFERENCE; SPEECH INDEXING; SPOKEN DOCUMENT RETRIEVAL; WEIGHTING SCHEME;

COMPUTATIONAL LINGUISTICS; INFORMATION RETRIEVAL; NEURAL NETWORKS; SEMANTICS; SIGNAL PROCESSING; VECTORS;

INDEXING (OF INFORMATION);

EID: 84890449769     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2013.6639320     Document Type: Conference Paper

References (28)

1. M. Lew, N. Sebe, C. Djeraba, and R. Jain, "Content-Based Multimedia Information Retrieval: State of the Art and Challenges," ACM Trans. Multimedia Computing, Communications, and Applications, vol. 2, no. 1, pp. 1-19, 2006.
2. K. Ng, "Subword-based Approaches for Spoken Document Retrieval," Ph.D. dissertation, Mass. Inst. Technol., Cambridge, MA, 2000.
3. P. Yu, K. Chen, C. Ma, and F. Seide, "Vocabulary-Independent Indexing of Spontaneous Speech," IEEE Trans. Speech Audio Processing, vol. 13, no. 5, pp. 635-643. 2005.
4. B. Logan, J.-M. Van Thong, and P. J. Moreno, "Approaches to Reduce the Effects of OOV Queries on Indexed Spoken Audio," IEEE Trans. Multimedia, vol. 7, no. 5, pp. 899-906. 2005.
5. C.-L. Huang and C.-H. Wu, "Spoken Document Retrieval Using Multi-Level Knowledge and Semantic Verification," IEEE Trans. Audio, Speech, and Language Processing, vol. 15, no. 8, pp. 2551-2560, 2007.
6. C. Chelba, T. J. Hazen, and M. Saraçlar, "Retrieval and Browsing of Spoken Content," IEEE Signal Processing Magazine, vol. 24, no. 3, pp. 39-49, 2008.
7. Y.-C. Pan, H.-Y. Lee, and L.-S. Lee, "Interactive Spoken Document Retrieval With Suggested Key Terms Ranked by a Markov Decision Process," IEEE Trans. Audio, Speech, and Language Processing, vol. 20, no. 2, pp. 632-645, 2012.
8. H. Cui, R. Sun, K. Li, M.-Y. Kan, and T.-S. Chua, "Question Answering Passage Retrieval Using Dependency Relations," in Proc. ACM SIGIR Conf., pp. 400-407, 2005.
9. R. Wilkinson and P. Hingston, "Using the Cosine Measure in a Neural Network for Document Retrieval," in Proc. ACM SIGIR Conf., pp. 202-210, 1991.
10. J. Rocchio, "Relevance Feedback in Information Retrieval," in The SMART Retrieval System: Experiments in Automatic Document Processing, pp. 313-323. Prentice-Hall Inc., 1971.
11. C. Buckley and J. Walz, "SMART in TREC 8," in Proc. Eighth Text REtrieval Conf. (TREC-8 "99), NIST Special Publication 500-264, Voorhees and Harman, eds., pp. 577-582, 2000.
12. T. K. Chia, K. C. Sim, H. Li, and H. T. Ng, "A Lattice-Based Approach to Query-by-Example Spoken Document Retrieval," in Proc. ACM SIGIR Conf., pp. 363-370, 2008.
13. C. Zhai and J. Lafferty, "A Study of Smoothing Methods for Language Models Applied to Ad Hoc Information Retrieval," in Proc. ACM SIGIR Conf., pp. 334-342, 2001.
14. J. M. Ponte and W. B. Croft, "A Language Modeling Approach to Information Retrieval," in Proc. ACM SIGIR Conf., pp. 275-281, 1998.
15. S. Kombrink, T. Mikolov, M. Karafiat, and L. Burget, "Recurrent Neural Network based Language Modeling in Meeting Recognition," in Proc. Interspeech, pp. 2877-2880, 2011.
16. Y. Bengio, R. Ducharme, P. Vincent, and C. Jauvin, "A Neural Probabilistic Language Model," in Journal of Machine Learning Research, vol. 3, pp. 1137-1155, 2003.
17. G. Saon and J.-T. Chien, "Large-Vocabulary Continuous Speech Recognition Systems: A Look at Some Recent Advances," IEEE Signal Processing Magazine, vol. 29, no. 6, pp. 18-33, 2012.
18. C.-L. Huang, B. Ma, H. Li, and C.-.H Wu, "Speech Indexing Using Semantic Context Inference," in Proc. Interspeech, pp. 717-720, 2011.
19. D. Song and P. D. Bruza, "Towards Context Sensitive Information Inference," J. Am. Soc. Information Science and Technology, vol. 54, no. 4, pp. 321-334, 2003.
20. T. Mikolov, S. Kombrink, L. Burget, J. ?Cernocky, and S. Khudanpur, "Extensions of Recurrent Neural Network Language Model," in Proc. ICASSP, pp. 5528-5531, 2011.
21. S. Bengio and Y. Bengio, "Taking on the Curse of Dimensionality in Joint Distributions Using Neural Networks," IEEE Trans. Neural Networks, vol. 11, no. 3, pp. 550-557. 2000.
22. A. K. Jain and J. Mao, "Artificial Neural Networks: A Tutorial," IEEE Computer, vol. 29, no. 3, pp. 31-44, 1996.
23. J. L. Elman, "Finding Structure in Time," Cognitive Science, vol. 14, pp. 179-211, 1990.
24. J. B. Pollack, "The Induction of Dynamical Recognizers," Machine Learning, vol. 7, pp. 227-252, 1991.
25. G. Hinton, L. Deng, D. Yu, G. E. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T.N. Sainath, and B. Kingsbury, "Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups," IEEE Signal Processing Magazine, vol. 29, no. 6, pp. 82-97, 2012.
26. S. E. Robertson, S. Walker, S. Jones, M. M. Hancock-Beaulieu, and M. Gatford, "Okapi at TREC-3," in Proc. of the third Text REtrieval Conference (TREC-3), pp. 109-126, 1995.
27. H.-M. Wang, B. Chen, J.-W. Kuo, and S.-S. Cheng, "MATBN: A Mandarin Chinese Broadcast News Corpus," Int. J. Comput. Ling. Chinese Lang. Process., vol. 10, no. 2, pp. 219-236, 2005.
28. G. Salton and M. J. McGill, Introduction to Modern Information Retrieval. New York: McGraw-Hill, 1983.