Model-based unsupervised spoken term detection with spoken queries

IEEE Transactions on Audio, Speech and Language Processing

Volumn 21, Issue 7, 2013, Pages 1330-1342

  Chan, Chun An ^a   Lee, Lin Shan ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

Acoustic segment model; dynamic time warping; unsupervised spoken term detection; zero resource

Indexed keywords

ACOUSTIC SEGMENT MODELS; DYNAMIC TIME WARPING; PRECISION IMPROVEMENT; PSEUDO-RELEVANCE FEEDBACKS; SELF-ORGANIZING MODEL; SPOKEN TERM DETECTION (STD); SPOKEN TERM DETECTIONS; ZERO-RESOURCE;

VITERBI ALGORITHM;

SPEECH RECOGNITION;

EID: 84875677338     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2013.2248714     Document Type: Article

References (48)

1. The Spoken Term Detection (STD) 2006 Evaluation Plan10th ed. NIST [Online]. Available: http://www.nist.gov/speech/tests/std
2. D. R. H. Miller, M. Kleber, C.-L Kao, O. Kimball, T. Colthurst, S. A. Lowe, R. M. Schwartz, and H. Gish, "Rapid and accurate spoken term detection," in Proc. INTERSPEECH, 2007.
3. J. Mamou, B. Ramabhadran, and O. Siohan, "Vocabulary independent spoken term detection," in Proc. ACM-SIGIR, 2007.
4. R. Wallace, R. Vogt, and S. Sridharan, "A phonetic search approach to the 2006 NIST spoken term detection evaluation," in Proc. INTERSPEECH, 2007.
5. M. Terao, T. Koshinaka, S. Ando, R. Isotani, and A. Okumura, "Open-vocabulary spoken-document retrieval based on query expansion using related web documents," in Proc. INTERSPEECH, 2008.
6. W. Shen, C. M. White, and T. J. Hazen, "A comparison of query-by-example methods for spoken term detection," in Proc. INTERSPEECH, 2009.
7. C. Parada, A. Sethy, and B. Ramabhadran, "Query-by-example spoken term detection for OOV terms," in Proc. IEEE Autom. Speech Recogn. Understand. Workshop, 2009.
8. Y.-C. Pan and L.-S. Lee, "Performance analysis for lattice-based speech indexing approaches using word and subword units," IEEE Trans. Audio, Speech, Lang. Process., vol. 18, no. 6, pp. 1562-1574, Aug. 2010.
9. M. Saraclar and R. Sproat, "Lattice-based search for spoken utterance retrieval," in Proc. HLT-NAACL, 2004.
10. L. Boves, R. Carlson, E. W. Hinrichs, D. House, S. Krauwer, L. Lem-nitzer, M. Vainio, and P. Wittenburg, "Resources for speech research: Present and future infrastructure needs," in Proc. INTERSPEECH, 2009.
11. A. Kumar, N. Rajput, D. Chakraborty, S. K. Agarwal, and A. A. Nana-vati, "WWTW: The world wide telecom web," in Proc. 2007 Workshop Netw. Syst. for Develop. Regions, 2007.
12. A. Garcia and H. Gish, "Keyword spotting of arbitrary words using minimal speech resources," in Proc. ICASSP, 2006, pp. 949-952.
13. S. Novotney, R. Schwartz, and J. Ma, "Unsupervised acoustic and language model training with small amounts of labelled data," in Proc. ICASSP, 2009, pp. 4297-4300.
14. F. Metze, N. Rajput, X. Anguera, M. Davel, G. Guillaume, C. v. Heerden, G. V. Mantena, A. Muscariello, K. Prahallad, I. Szöke, and J. Tejedor, "The spoken web search task at MediaEval 2011," in Proc. ICASSP, 2012, pp. 5165-5168.
15. H. Sakoe and S. Chiba, "Dynamic programming algorithm optimization for spoken word recognition," IEEE Trans. Acoust, Speech, Signal Process., vol. ASSP-26, no. 1, pp. 43-49, Feb. 1978. (Pubitemid 8601900)
16. C. Myers, L. Rabiner, and A. Rosenberg, "Performance tradeoffs in dynamic time warping algorithms for isolated word recognition," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-28, no. 6, pp. 623-635, Dec. 1980. (Pubitemid 11475385)
17. A. Higgins and R. Wohlford, "Keyword recognition using template concatenation," in Proc. ICASSP, 1985, pp. 1233-1236. (Pubitemid 16511577)
18. C.-H. Lee, F. K. Soong, and B.-H. Juang, "A segment model based approach to speech recognition," in Proc. ICASSP, 1988, pp. 501-504.
19. C.-Y. Lee and J. R. Glass, "A nonparametric Bayesian approach to acoustic model discovery," in Proc. ACL, 2012, pp. 40-49.
20. A. S. Park and J. R. Glass, "Unsupervised pattern discovery in speech," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 1, pp. 186-197, Jan. 2008.
21. Y. Zhang and J. R. Glass, "Unsupervised spoken keyword spotting via segmental DTW on Gaussian posteriorgrams," in Proc. IEEE Autom. Speech Recogn. Understand. Workshop, 2009, pp. 398-503.
22. M. Huijbregts, M. McLaren, and D. van Leeuwen, "Unsupervised acoustic sub-word unit detection for query-by-example spoken term detection," in Proc. ICASSP, 2011, pp. 4436-4439.
23. H. Wang, C.-C. Leung, T. Lee, B. Ma, and H. Li, "An acoustic segment modeling approach to query-by-example spoken term detection," in Proc. ICASSP, 2012, pp. 5157-5160.
24. M. A. Carlin, S. Thomas, A. Jansen, and H. Hermansky, "Rapid evaluation of speech representations for spoken term discovery," in Proc. INTERSPEECH, 2011.
25. T. J. Hazen, W. Shen, and C. White, "Query-by-example spoken term detection using phonetic posteriorgram templates," in Proc. IEEE Autom. Speech Recognit Understand. Workshop, 2009, pp. 421-426.
26. A. Muscariello, G. Gravier, and F. Bimbot, "Zero-resource audio-only spoken term detection based on a combination of template matching techniques," in Proc. INTERSPEECH, 2011.
27. C.-A. Chan and L.-S. Lee, "Unsupervised spoken-term detection with spoken queries using segment-based dynamic time warping," in Proc. INTERSPEECH, 2010.
28. C.-A. Chan and L.-S. Lee, "Integrating frame-based and segment-based dynamic time warping for unsupervised spoken term detection with spoken queries," in Proc. ICASSP, Prague, Czech Republic, May 2011, pp. 5652-5655.
29. E. Keogh, "Exact indexing of dynamic time warping," in Proc. 28th Int. Conf. Very Large Data Bases, 2002, pp. 406-417.
30. Y. Zhang and J. R. Glass, "A piecewise aggregate approximation lower-bound estimate for posteriorgram-based dynamic time warping," in Proc. INTERSPEECH, 2011.
31. R. Yan, E. Hauptmann, and R. Jin, "Multimedia search with pseudo-relevance feedback," in Proc. Int. Conf. Image and Video Retrieval, 2003.
32. R. Yan, A. G. Hauptmann, and R. Jin, "Negative pseudo-relevance feedback in content-based video retrieval," in Proc. ACM-Multimedia, 2003.
33. S. Yu, D. Cai, J.-R. Wen, and W.-Y. Ma, "Improving pseudo-relevance feedback in web information retrieval using web page segmentation," in Proc. Int. World Wide Web Conf., 2008.
34. J. Reed and C.-H. Lee, "A study on music genre classification based on universal acoustic models," in Proc. ISMIR, 2006, pp. 89-94.
35. H. Li, B. Ma, and C.-H. Lee, "A vector space modeling approach to spoken language identification," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 1, pp. 271-284, Jan. 2007.
36. Y. Tsao, H. Sun, H. Li, and C.-H. Lee, "An acoustic segment model approach to incorporating temporal information into speaker modeling for text-independent speaker recognition," in Proc. ICASSP, 2010, pp. 4422-4425.
37. H. Gish, M.-H. Siu, A. Chan, and W. Belfield, "Unsupervised training of an HMM-based speech recognizer for topic classification," in Proc. INTERSPEECH, 2009, pp. 1935-1938.
38. M.-H. Siu, H. Gish, S. Lowe, and A. Chan, "Unsupervised audio patterns discovery using HMM-based self-organized units," in Proc. INTERSPEECH, 2011, pp. 2333-2336.
39. C.-A. Chan and L.-S. Lee, "Unsupervised hidden Markov modeling of spoken queries for spoken term detection without speech recognition," in Proc. INTERSPEECH, 2011.
40. Y. Qiao, N. Shimomura, and N. Minematsu, "Unsupervised optimal phoneme segmentation: Objectives, algorithm and comparisons," in Proc. ICASSP, 2008, pp. 3989-3992.
41. C. A. Bouman, "Cluster: An unsupervised algorithm for modeling Gaussian mixtures," Apr. 1997 [Online]. Available: http://www.ece. purdue.edu/~bouman
42. M. Ostendorf, V. Digalakis, and O. A. Kimball, "From HMMS to segment models: A unified view of stochastic modeling for speech recognition," IEEE Trans. Speech Audio Process., vol. 4, no. 5, pp. 360-378, Sep. 1995. (Pubitemid 126753024)
43. M.-W. Koo, C.-H. Lee, and B.-H. Juang, "Speech recognition and utterance verification based on a generalized confidence score," IEEE Trans. Speech Audio Process., vol. 9, no. 8, pp. 821-832, Nov. 2001. (Pubitemid 33137934)
44. L. F. Lamela, R. H. Kassel, and S. Seneff, "Speech database development: Design and analysis of the acoustic-phonetic corpus," in Proc. DARPA Speech Recognition Workshop, 1986.
45. A. K. Halberstadt, "Heterogeneous acoustic measurements and multiple classifiers for speech recognition," Ph.D. dissertation, Dept. of Elect. Eng. and Comput. Sci., Mass. Inst. of Technol., Cambridge, MA, USA, 1999.
46. E. M. Voorhees, "Overview of the TREC 2006," in Proc. TREC, 2006.
47. J. G. Fiscus, J. Ajot, J. S. Garofolo, and G. Doddingtion, "Results of the 2006 spoken term detection evaluation," in Proc. INTERSPEECH, 2007.
48. F. Metze, E. Barnard, M. Davel, C. van Heerden, X. Anguera, G. Gravier, and N. Rajput, "The spoken web search task," in Proc. MediaEval 2012 Workshop, 2012.