Unsupervised discovery of linguistic structure including two-level acoustic patterns using three cascaded stages of iterative optimization

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2013, Pages 8081-8085

  Chung, Cheng Tao ^a   Chan, Chun An ^a   Lee, Lin Shan ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

hidden Markov models; iterative optimization; spoken term detection; unsupervised learning; zero resource speech recognition

Indexed keywords

INITIALIZATION STEP; ITERATIVE OPTIMIZATION; LARGE VOCABULARY; LINGUISTIC STRUCTURE; MANUAL ANNOTATION; MODEL PARAMETERS; N-GRAM LANGUAGE MODELS; SPOKEN TERM DETECTIONS;

COMPUTATIONAL LINGUISTICS; HIDDEN MARKOV MODELS; OPTIMIZATION; SIGNAL PROCESSING; SPEECH; SPEECH RECOGNITION; UNSUPERVISED LEARNING;

ITERATIVE DECODING;

EID: 84890479779     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2013.6639239     Document Type: Conference Paper

References (35)

1. A. Jansen and K. Church "Towards Unsupervised Training of Speaker Independent Acoustic Models" in InterSpeech, 2011, pp. 1693-1696.
2. C. Lee and J. Glass, "A Nonparametric Bayesian Approach to Acoustic Model Discovery" in Proc. The Association for Computer Linguistics, 2012, vol. 1, pp. 40-49.
3. H. Gish, M. Siu, A. Chan, and B. Belfield, "Unsupervised training of an HMM-based Speech Recognizer for Topic Classification" in InterSpeech, 2009, pp. 1935-1938.
4. M. Siu, H. Gish, A. Chan, and W. Belfield, "Improved Topic Classification and Keyword Discovery using an HMM-based Speech Recognizer Trained without Supervision" in Inter-Speech, 2010, pp. 2838-2841.
5. M. Huijbregts, M. McLaren, and D. van Leeuwen, "Unsupervised acoustic sub-word unit detection for query-by-example spoken term detection," in ICASSP, 2011, pp. 4436-4439.
6. S. Novotney, R. Schwartz, and J. Ma, "Unsupervised acoustic and language model training with small amounts of labelled data," in ICASSP, 2009, pp. 4297-4300.
7. C. Chan and L. Lee, "Unsupervised Hidden Markov Modeling of Spoken Queries for Spoken Term Detection without Speech Recognition" in InterSpeech, 2011, pp. 2141-2144.
8. O. J. Rasanen, U. K. Laine, T. Altosaar "Computational language acquisition by statistical bottom-up processing," in Inter-Speech, 2008, pp. 1980-1983.
9. O. J. Rasanen, U. K. Laine, T. Altosaar "A noise robust method for pattern discovery in quantized time series: the concept matrix approach," in InterSpeech, 2009, pp. 3035-3038.
10. O. J. Rasanen, U. K. Laine, T. Altosaar, "Self-learning vector quantization for pattern discovery from speech," in InterSpeech, 2009, pp. 852-855.
11. O. J. Rasanen, Fully unsupervised word learning from continuous speech using transitional probabilities of atomic acoustic events in InterSpeech, 2010, pp. 2922-2925.
12. C. Chan, "Unsupervised Spoken Term Detection with Spoken Queries " Ph.D dissertation, National Taiwan University, July, 2012.
13. Y. Qiao, N. Shimomura, and N. Minematsu, "Unsupervised optimal phoneme segmentation: objectives, algorithm and comparisons," in ICASSP, 2008, pp. 3989-3992.
14. C. Chan and L. Lee, "Integrating Frame-based and Segmentbased Dynamic Time Warping for Unsupervised Spoken Term Detection with Spoken Queries" in ICASSP, 2011, pp. 5652-5655.
15. C. Chan, C. Chung, Y. Kuo and L. Lee, "Toward Unsupervised Model-based Spoken Term Detection with Spoken Queries without Annotated Data" in ICASSP, 2013
16. J. Takami and S. Sagayama, "A successive state splitting algorithm for efficient allophone modeling," in ICASSP, 1992, vol. 1, pp. 573-576.
17. H. Singer and M. Ostendorf, "Maximum likelihood successive state splitting," in ICASSP, 1997, vol. 2, pp. 601-604.
18. B. Varadarajan and S. Khudanpur, "Automatically Learning Speaker-independent Acoustic Subword Units," in InterSpeech, 2008.
19. Y.-c. Pan and L.-s. Lee, "Performance analysis for lattice-based speech indexing approaches using word and subword units," IEEE Transactions on Audio, Speech, and Language Processing, vol. 18, no. 6, August 2010, pp. 1562-1574.
20. A. Jansen, K. Church, and H. Hermansky, "Towards Spoken Term Discovery At ScaleWith Zero Resources" in InterSpeech, 2010, pp. 1676-1679.
21. M. Couprie, G. Bertrand, "Topological gray-scale watershed transform," in Proc. of SPIE Vision Geometry V, 1997, vol. 3168, pp. 136-146.
22. T. Ong and H. Chen, "Updateable PAT-Tree Approach to Chinese Key Phrase Extraction using Mutual Information: A Linguistic Foundation for Knowledge Management," in Proc. The Second Asian Digital Library Conference, 1999, pp. 63-84.
23. H. Lee, Y. Li, C. Chung, and L. Lee, "Enhancing Query Expansion for Semantic Retrieval of Spoken Content with Automatically Discovered Acoustic Patterns," in ICASSP, 2013
24. J. Hershey and P. Olsen, "Approximating the Kullback Liebler Divergence between Gaussain Mixture Models" in ICASSP, 2007, vol. 4, pp. 317-320.
25. F. Metze, N. Rajput et al., "The spoken web search task at Mediaeval 2011," in ICASSP, 2012, pp. 5165-5168.
26. H. Wang, C.-C. Leung, T. Lee, B. Ma, and H. Li, "An acoustic segment modeling approach to query-by-example spoken term detection," in ICASSP, 2012, pp. 5157-5160.
27. A. Garcia and H. Gish, "Keyword spotting of arbitrary words using minimal speech resources," in ICASSP, 2006.
28. R. Wallace, R. Vogt, and S. Sridharan, "A phonetic search approach to the 2006 NIST spoken term detection evaluation," in InterSpeech, 2007, pp. 2385-2388.
29. M. Terao, T. Koshinaka, S. Ando, R. Isotani, and A. Okumura, "Open vocabulary spoken-document retrieval based on query expansion using related web documents," in InterSpeech, 2008, pp. 2171-2174.
30. W. Shen, C. M. White, and T. J. Hazen, "A comparison of queryby example methods for spoken term detection," in InterSpeech, 2009, pp. 2143-2146.
31. M. Ostendorf, V. Digalakis, and O. A. Kimball, "From hmms to segment models: A unified view of stochastic modeling for speech recognition," IEEE Transactions on Speech and Audio Processing, vol. 4, pp. 360V-378, 1995.
32. Y. Zhang and J. R. Glass, "A piecewise aggregate approximation lowerbound estimate for posteriorgram-based dynamic time warping," in InterSpeech, 2011, pp. 1909-1912.
33. M.-W. Koo, C.-H. Lee, and B.-H. Juang, "Speech recognition and utterance verification based on a generalized confidence score," IEEE Transactions on Speech and Audio Processing, vol. 9, no. 8, pp. 821V-832, 2001.
34. Y. Tsao, H. Sun, H. Li, and C.-H. Lee, "An acoustic segment model approach to incorporating temporal information into speaker modeling for text-independent speaker recognition," in ICASSP, 2010, pp. 4422-4425.
35. E. Voorhees, "Overview of TREC 2006," in TREC, 2006.