Stochastic pronunciation modeling for out-of-vocabulary spoken term detection

IEEE Transactions on Audio, Speech and Language Processing

Volumn 19, Issue 4, 2011, Pages 688-698

  Wang, Dong ^a   King, Simon ^b   Frankel, Joe ^c  

^a EURECOM   (France)

^b UNIVERSITY OF EDINBURGH   (United Kingdom)

^c Vegware   (United Kingdom)

Author keywords

Letter to sound; out of vocabulary (OOV); pronunciation modeling; speech recognition; spoken term detection (STD)

Indexed keywords

DEGREE OF UNCERTAINTY; FALSE ALARM PROBABILITY; HARD TASK; LETTER-TO-SOUND; OPERATING REGIONS; OUT-OF-VOCABULARY (OOV); PERFORMANCE GAIN; PROBABILISTIC MODELS; PRONUNCIATION MODELING; SEARCH TERMS; SPECIAL PROPERTIES; SPOKEN TERM DETECTION (STD); SUBWORD UNITS;

PROBABILITY DISTRIBUTIONS; STOCHASTIC MODELS; STOCHASTIC SYSTEMS;

SPEECH RECOGNITION;

EID: 79951661301     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2010.2058800     Document Type: Article

References (56)

1. NIST, "The Spoken term detection (STD) 2006 evaluation plan,"10th ed. National Institute of Standards and Technology (NIST). Gaithersburg, MD, Sep. 2006 [Online]. Available: http://www.nist.gov/speech/ tests/std
2. J. Mamou and B. Ramabhadran, "Phonetic query expansion for spoken document retrieval," in Proc. Interspeech'08, Brisbane, Australia, Sep. 2008, pp. 2106-2109.
3. D. Can, E. Cooper, A. Sethy, C. White, B. Ramabhadran, and M. Saraclar, "Effect of pronunciations on OOV queries in spoken term detection," in Proc. ICASSP'09, Taipei, Taiwan, Apr. 2009, pp. 3957-3960.
4. J. G. Fiscus, J. Ajot, J. S. Garofolo, and G. Doddingtion, "Results of the 2006 spoken term detection evaluation," in Proc. Workshop Searching Spontaneous Conversational Speech (SIGIR-SSCS'07), Amsterdam, The Netherlands, Jul. 2007.
5. D. Vergyri, A. Stolcke, R. R. Gadde, and W. Wang, "The SRI 2006 spoken term detection system," in Proc. NIST Spoken Term Detection Workshop (STD 2006), Gaithersburg, MD, Dec. 2006.
6. M. Akbacak, D. Vergyri, and A. Stolcke, "Open-vocabulary spoken term detection using graphone-based hybrid recognition systems," in Proc. ICASSP'08, Las Vegas, NV, Mar. 2008, pp. 5240-5243.
7. D. Vergyri, I. Shafran, A. Stolcke, R. R. Gadde, M. Akbacak, B. Roark, and W. Wang, "The SRI/OGI 2006 spoken term detection system," in Proc. Interspeech'07, Antwerp, Belgium, Aug. 2007, pp. 2393-2396.
8. I. Szöke, M. Fapŝo, M. Karafiát, L. Burget, F. Grézl, P. Schwarz, O. Glembek, P. Matêjka, J. Kopecký, and J. Cernocký, "Spoken term detection system based on combination of LVCSR and phonetic search," in Machine Learning for Multimodal Interaction, ser. Lecture (Pubitemid 351333604)
9. I. Szöke, L. Burget, J. Cêrnocký, and M. Fap̂so, "Sub-word modeling of out of vocabulary words in spoken term detection," in Proc. IEEE Workshop Spoken Lang. Technol. (SLT'08), Goa, India, Dec. 2008, pp. 273-276.
10. S. Meng, P. Yu, J. Liu, and F. Seide, "Fusing multiple systems into a compact lattice index for Chinese spoken term detection," in Proc. ICASSP'08, Las Vegas, NV, Mar. 2008, pp. 4345-4348.
11. K. Thambiratmann and S. Sridharan, "Rapid yet accurate speech indexing using dynamic match lattice spotting," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 1, pp. 346-357, Jan. 2007.
12. F.Wessel, K. Macherey, and R. Schlüter, "Using word probabilities as confidence measures," in Proc. ICASSP'98, Seattle, WA, May 1998, vol. 1, pp. 225-228.
13. D. R. H. Miller, M. Kleber, C. lin Kao, O. Kimball, T. Colthurst, S. A. Lowe, R. M. Schwartz, and H. Gish, "Rapid and accurate spoken term detection," in Proc. Interspeech'07, Antwerp, Belgium, Aug. 2007, pp. 314-317.
14. J. Mamou, B. Ramabhadran, and O. Siohan, "Vocabulary independent spoken term detection," in Proc. ACM-SIGIR'07, Amsterdam, The Netherlands, Jul. 2007, pp. 615-622. (Pubitemid 350165011)
15. I. Szöke, M. Fapŝo, M. Karafiát, L. Burget, F. Grézl, P. Schwarz, O. Glembek, P. Matêjka, S. Kontár, and J. Ĉernocký, "BUT system for NIST STD 2006-English," in Proc. NIST Spoken Term Detection Evaluation Workshop (STD'06), Gaithersburg, MD, Dec. 2006, National Inst. of Standards and Technol..
16. A. Martin, G. Doddington, T. Kamm, M. Ordowski, and M. Przybocki, "The DET curve in assessment of detection task performance," in Proc. Eurospeech'97, Rhodes, Greece, Sep. 1997, vol. 4, pp. 1895-1898.
17. J. R. Rohlicek, W. Russell, S. Roukos, and H. Gish, "Continuous hidden Markov modeling for speaker-independent word spotting," in Proc. ICASSP'89, Glasgow, U.K., May 1989, pp. 627-630. (Pubitemid 20604195)
18. D.Watson, Death Sentence, The Decay of Public Language. Sydney, Australia: Knopf, 2003.
19. B. Logan, P. Moreno, J.-M. V. Thong, and E. Whittaker, "An experimental study of an audio indexing system for the web," in Proc. ICSLP'00, Beijing, China, Oct. 2000, vol. 2, pp. 676-679.
20. J. Mamou, B. Ramabhadran, and O. Siohan, "Vocabulary independent spoken term detection," in Proc. ACM-SIGIR'07, 2007, pp. 615-622. (Pubitemid 350165011)
21. K. Ng, "Subword-based approaches for spoken document retrieval," Ph.D. dissertation, Mass Inst. of Technol., Cambridge, Feb. 2000.
22. K. Audhkhasi and A. Verma, "Keyword search using modified minimum edit distance measure," in Proc. ICASSP'07, Honolulu, HI, Apr. 2007, vol. 4, pp. 929-932.
23. J. Pinto, I. Szöke, S. Prasanna, and H. Her̂manský, "Fast approximate spoken term detection from sequence of phonemes," in Proc. 31st Annu. Int. ACM SIGIR Conf., Singapore, Jul. 2008, pp. 28-33, Assoc. for Computing Machinery.
24. R. Wallace, R. Vogt, and S. Sridharan, "Spoken term detection using fast phonetic decoding," in Proc. ICASSP'09, Taipei, Taiwan, Apr. 2009, pp. 4881-4884.
25. D.Wang, S. King, and J. Frankel, "Stochastic pronunciation modelling for spoken term detection," in Proc. Interspeech'09, Brighton, U.K., Sep. 2009, pp. 2135-2138.
26. D. Wang, S. King, J. Frankel, and P. Bell, "Stochastic pronunciation modelling and soft match for out-of-vocabulary spoken term detection," in Proc. ICASSP'10, Dallas, TX, Mar. 2010, pp. 5294-5297.
27. R. Damper and J. Eastmond, "Pronunciation by analogy: Impact of implementational choices on performance," Lang. Speech, vol. 40, no. 1, pp. 1-23, 1997. (Pubitemid 127459061)
28. A. W. Black, K. Lenzo, and V. Pagel, "Issues in building general letter to sound rules," in Proc. 3rd ESCA Workshop on Speech Synthesis, Jenolan Caves, Australia, 1998, pp. 77-80.
29. W. Daelemans, A. van den Bosch, and J. Zavrel, "Forgetting exceptions is harmful in language learning," Mach. Learn., vol. 34, no. 1-3, pp. 11-41, 1999.
30. P. Taylor, "Hidden Markov models for grapheme to phoneme conversion," in Proc. Interspeech'05, Lisbon, Portugal, Sep. 2005, pp. 1973-1976. (Pubitemid 43908476)
31. M. Bisani and H. Ney, "Joint-sequence models for grapheme-tophoneme conversion," Speech Commun., vol. 50, no. 5, pp. 434-451, May 2008.
32. D. A. James and S. J. Young, "A fast lattice-based approach to vocabulary independent wordspotting," in Proc. ICASSP'94, Yokohama, Japan, Sep. 1994, pp. 377-380.
33. M. Brown, J. T. Foote, G. J. F. Jones, K. Spärck Jones, and S. Young, "Open-vocabulary speech indexing for voice and video mail retrieval," in Proc. ACM Multimedia Conf., Boston, MA, 1996.
34. S. J. Young, M. Brown, J. T. Foote, G. J. F. Jones, and K. Spärck Jones, "Acoustic indexing for multimedia retrieval and browsing," in Proc. ICASSP'97, Munich, Germany, Apr. 1997, vol. 1, pp. 199-202.
35. F. Seide, P. Yu, C.Ma, and E. Chang, "Vocabulary-independent search in spontaneous speech," in Proc. ICASSP'04, Montreal, QC, Canada, May 2004, vol. 1, pp. 253-256.
36. K. Thambiratnam and S. Sridharan, "Dynamic match phone-lattice searches for very fast and accurate unrestricted vocabulary keyword spotting," in Proc. ICASSP'05, Philadelphia, PA, Mar. 2005, vol. 1, pp. 465-468.
37. J. Mamou, Y. Mass, B. Ramabhadran, and B. Sznajder, "Combination of multiple speech transcription methods for vocabulary independent search," in Proc.Workshop Search in Spontaneous Conversational Speech (SIGIR-SSCS'08), Singapore, 2008.
38. U. Chaudhari, H.-K. J. Kuo, and B. Kingsbury, "Discriminative graph training for ultra-fast low-footprint speech indexing," in Proc. Interspeech 2008, Las Vegas, NV, Mar. 2008, pp. 2175-2178.
39. Y. Itoh, T. Otake, K. Iwata, K. Kojima, M. Ishigame, K. Tanaka, and S. wook Lee, "Two-stage vocabulary-free spoken document retrieval-subword identification and re-recognition of the identified sections," in Proc. ICSLP'06, Pittsburgh, PA, Sep. 2006, pp. 1161-1164.
40. K. Iwata, K. Shinoda, and S. Furui, "Robust spoken term detection using combination of phone-based and word-based recognition," in Proc. Interspeech'08, Brisbane, Australia, Sep. 2008, pp. 2195-2198.
41. T. Sloboda and A. Waibel, "Dictionary learning for spontaneous speech recognition," in Proc. ICSLP'96, Philadelphia, PA, Oct. 1996, pp. 2328-2331.
42. N. Cremelie and J.-P. Martens, "In search of better pronunciation models for speech recognition," Speech Commun., vol. 29, no. 2-4, pp. 115-136, 1999. (Pubitemid 30514827)
43. H. Strik and C. Cucchiarini, "Modeling pronunciation variation for ASR: A survey of the literature," Speech Commun., vol. 29, no. 5, pp. 225-246, 1999. (Pubitemid 30514833)
44. Y. R. Oh, J. S. Yoon, and H. K. Kim, "Acoustic model adaptation based on pronunciation variability analysis for non-native speech recognition," Speech Commun., vol. 49, no. 1, pp. 59-70, 2007. (Pubitemid 46026867)
45. T. Hain, "Implicit pronunciation modelling in ASR," in Proc. ISCA Tutorial ResearchWorkshop Pronunciation Modeling Lexical Adaptation for Spoken Lang., Estes Park, CO, 2002.
46. D. Wang, S. King, J. Frankel, and P. Bell, "Term-dependent confidence for out-of-vocabulary term detection," in Proc. Interspeech'09, Brighton, U.K., Sep. 2009, pp. 2139-2142.
47. K. Ng, "Towards robust methods for spoken document retrieval," in Proc. ICSLP'98, Sydney, Australia, Nov. 1998, pp. 939-942.
48. M. Wechsler, E. Munteanu, and P. Schäuble, "New techniques for open-vocabulary spoken document retrieval," in Proc. ACM SIGIR 1998, Melbourne, Australia, Aug. 1998, pp. 20-27.
49. S. Srinivasan and D. Petkovic, "Phonetic confusion matrix based spoken document retrieval," in Proc. 23rd Annual Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval (SIGIR'00), New York, 2000, pp. 81-87.
50. A. Amir, A. Efrat, and S. Srinivasan, "Advances in phonetic word spotting," in Proc. 10th Int. Conf. Inf. Knowl. Manage. (CIKM'01), Atlanta, Georgia, Nov. 2001, pp. 580-582. (Pubitemid 34974692)
51. S. Deligne, F. Yvon, and F. Bimbot, "Variable-length sequence matching for phonetic transcription using joint multigrams," in Proc. Eurospeech'95, Madrid, Spain, Sep. 1995, pp. 2243-2246.
52. S. F. Chen, "Conditional and joint models for grapheme-to-phoneme conversion," in Proc. Eurospeech'03, Geneva, Switzerland, Sep. 2003, pp. 2033-2036.
53. M. Bisani and H. Ney, "Investigations on joint-multigram models for grapheme-to-phoneme conversion," in Proc. ICSLP'02, Denver, CO, Sep. 2002, pp. 105-108.
54. D. Wang, "Out-of-vocabulary spoken term detection," Ph.D. dissertation, Center for Speech Technol. Res., Edinburgh Univ., Edinburgh, U.K., Dec. 2009.
55. T. Hain, L. Burget, J. Dines, G. Garau, M. Karafiat, M. Lincoln, J.Vepa, and V.Wan, "The AMI meeting transcription system: Progress and performance," in Machine Learning for Multimodal Interaction. Berlin/ Heidelberg, Germany: Springer, 2006, vol. 4299/2006, pp. 419-431.
56. R. A. J. Clark, K. Richmond, and S. King, "Multisyn: Open-domain unit selection for the Festival speech synthesis system," Speech Commun., vol. 49, no. 4, pp. 317-330, 2007. (Pubitemid 46517714)