Morpholexical and discriminative language models for Turkish automatic speech recognition

IEEE Transactions on Audio, Speech and Language Processing

Volumn 20, Issue 8, 2012, Pages 2341-2351

  Sak, Haşim ^a   Saraçlar, Murat ^b   Güngör, Tunga ^b  

^a GOOGLE INC   (United States)

^b BOGAZICI UNIVERSITY   (Turkey)

Author keywords

Automatic speech recognition (ASR); disambiguation; discriminative model; morpholexical language model; morphology; reranking

Indexed keywords

AUTOMATIC SPEECH RECOGNITION; DISAMBIGUATION; DISCRIMINATIVE MODELS; LANGUAGE MODEL; RE-RANKING;

ALGORITHMS; COMPUTATIONAL LINGUISTICS; MORPHOLOGY; NATURAL LANGUAGE PROCESSING SYSTEMS; TRANSDUCERS;

SPEECH RECOGNITION;

EID: 84865351796     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2012.2201477     Document Type: Article

References (43)

1. H. Sak, T.Güngör, andM. Saraçlar, "Morphological disambiguation of Turkish text with perceptron algorithm," in Proc. CICLing '07, 2007, vol. LNCS 4394, pp. 107-118. (Pubitemid 350259176)
2. H. Sak, T. Güngör, andM.Saraçlar, "Turkish language resources:Morphological parser, morphological disambiguator and web corpus," in GoTAL 2008. New York: Springer, 2008, vol. 5221, pp. 417-427, ser. LNCS.
3. H. Sak, M. Saraçlar, and T. Güngör, "Integrating morphology into automatic speech recognition," in Proc. ASRU, 2009, pp. 354-358.
4. H. Sak,M. Saraçlar, and T. Güngör, "Morphology- based and sub-word language modeling for Turkish speech recognition," in Proc. ICASSP, 2010, pp. 5402-5405.
5. H. Sak,M. Saraçlar, and T. Güngör, "Discriminative reranking of ASR hypotheses with morpholexical and n-best-list features," in Proc. IEEE Workshop Automatic Speech Recognition and Understanding (ASRU), 2011, pp. 202-207.
6. C. Allauzen,M.Mohri, and B. Roark, "Generalized algorithms for constructing statistical language models," in Proc. ACL, 2003, pp. 40-47.
7. P. Geutner, "Using morphology towards better large-vocabulary speech recognition systems," in Proc. ICASSP, 1995, pp. 445-448.
8. P. Ircing, P.Krbec, J.Hajic, J. Psutka, S. Khudanpur, F. Jelinek, andW. Byrne, "On large vocabulary continuous speech recognition of highly inflectional language-Czech," in Proc. Eurospeech, 2001, pp. 487-490.
9. O.-W. Kwon and J. Park, "Korean large vocabulary continuous speech recognition with morpheme-based recognition units," Speech Commun., vol. 39, no. 3-4, pp. 287-300, 2003. (Pubitemid 35432916)
10. D. Z. Hakkani-Tür, "Statistical language modeling for agglutinative languages," Ph.D. dissertation, Bilkent Univ., Ankara, Turkey, 2000.
11. H. Erdogan, O. Buyuk, and K. Oflazer, "Incorporating language constraints in sub-word based speech recognition," in Proc. ASRU, 2005, pp. 98-103.
12. E. Arisoy, H. Sak, and M. Saraçlar, "Language modeling for automatic Turkish broadcast news transcription," in Proc. Interspeech, 2007, pp. 2381-2384.
13. E. Arisoy, D. Can, S. Parlak, H. Sak, and M. Saraçlar, "Turkish broadcast news transcription and retrieval," IEEE Trans. Audio, Speech, Lang. Process., vol. 17, no. 5, pp. 874-883, Jul. 2009.
14. T. Rotovnik, M. S. Maučec, and Z. Kačič, "Large vocabulary continuous speech recognition of an inflected language using stems and endings," Speech Commun., vol. 49, pp. 437-452, Jun. 2007. (Pubitemid 46891622)
15. T. Hirsimäki, M. Creutz, V. Siivola, M. Kurimo, S. Virpioja, and J. Pylkkönen, "Unlimited vocabulary speech recognition with morph language models applied to Finnish," Comput. Speech Lang., vol. 20, no. 4, pp. 515-541, 2006. (Pubitemid 44142005)
16. P. Mihajlik, T. Fegyó, Z. Tüske, and P. Ircing, "A morpho-graphemic approach for the recognition of spontaneous speech in agglutinative languages-like Hungarian," in Proc. Interspeech, 2007, pp. 1497-1500.
17. E. Arisoy and M. Saraçlar, "Lattice extension and vocabulary adaptation for Turkish LVCSR," IEEE Trans. Audio, Speech, Lang. Process., vol. 17, no. 1, pp. 163-173, Jan. 2009.
18. K. Kirchhoff, D. Vergyri, J. Bilmes, K. Duh, and A. Stolcke, "Morphology-based language modeling for conversational Arabic speech recognition," Comput. Speech Lang., vol. 20, no. 4, pp. 589-608, 2006. (Pubitemid 44142007)
19. R. Sarikaya, M. Afify, Y. Deng, H. Erdogan, and Y. Gao, "Joint morphological-lexical language modeling for processing morphologically rich languages with application to dialectal Arabic," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 7, pp. 1330-1339, Sep. 2008.
20. H. Sak, T. Güngör, and M. Saraçlar, "Resources for Turkish morphological processing," Lang. Resources Eval., vol. 45, no. 2, pp. 249-261, 2011.
21. M. Mohri, "Finite-state transducers in language and speech processing," Comput. Linguist., vol. 23, no. 2, pp. 269-311, 1997.
22. K. Koskenniemi, "A general computational model for word-form recognition and production," in Proc. ACL, 1984, pp. 178-181.
23. K. Oflazer, "Two-level description of Turkish morphology," Literary Linguist. Comput., vol. 9, no. 2, pp. 137-148, 1994.
24. L. Karttunen and K. R. Beesley, "Two-level rule compiler," Xerox Palo Alto Research Center, Palo Alto, CA, Tech. Rep., 1992.
25. C. Allauzen, M. Riley, J. Schalkwyk, W. Skut, and M. Mohri, "OpenFst: A general and efficient weighted finite-state transducer library," in Proc. CIAA '07. New York: Springer, 2007, vol. 4783, pp. 11-23, ser. LNCS.
26. K. Oflazer and S. Inkelas, "The architecture and the implementation of a finite state pronunciation lexicon for Turkish," Comput. Speech Lang., vol. 20, pp. 80-106, Jan. 2006. (Pubitemid 41605386)
27. Freund and Schapire, "Largemargin classification using the perceptron algorithm," Mach. Learn., vol. 37, no. 3, pp. 277-296, 1999.
28. M. Collins and N. Duffy, "New ranking algorithms for parsing and tagging: Kernels over discrete structures, and the voted perceptron," in ACL, 2002, pp. 263-270.
29. M. Collins, "Discriminative training methods for hidden markov models: Theory and experiments with perceptron algorithms," in Proc. EMNLP, 2002, pp. 1-8.
30. M. Creutz and K. Lagus, "Unsupervised discovery of morphemes," in ACL, Stroudsburg, PA, 2002, pp. 21-30, ser. MPL'02.
31. M. Mohri, F. Pereira, and M. Riley, "Weighted finite-state transducers in speech recognition," Comput. Speech Lang., vol. 16, no. 1, pp. 69-88, 2002.
32. M. Mohri and M. Riley, "Integrated context-dependent networks in very large vocabulary speech recognition," in Proc. Eurospeech, 1999, pp. 811-814.
33. C. Allauzen, M. Mohri, M. Riley, and B. Roark, "A generalized construction of integrated speech recognition transducers," in Proc. ICASSP, 2004, pp. 761-764.
34. C. Allauzen, M. Mohri, and B. Roark, "The design principles and algorithms of a weighted grammar library," Int. J. Foundations Comput. Sci., vol. 16, no. 3, pp. 403-421, 2005. (Pubitemid 44099430)
35. L. Shen and A. K. Joshi, "Ranking and reranking with perceptron," Mach. Learn., vol. 60, pp. 73-96, Sep. 2005. (Pubitemid 41218063)
36. B. Roark, M. Saraçlar, and M. Collins, "Discriminative n-gram language modeling," Comput. Speech Lang., vol. 21, no. 2, pp. 373-392, Apr. 2007. (Pubitemid 44709838)
37. E. Arisoy, M. Saraçlar, B. Roark, and I. Shafran, "Discriminative language modeling with linguistic and statistically derived features," IEEE Trans. Audio, Speech, Lang. Process., vol. 20, no. 2, pp. 540-550, Feb. 2012.
38. F. Rosenblatt, "The perceptron: A probabilistic model for information storage and organization in the brain," Psychol. Rev., vol. 65, no. 6, pp. 386-408, 1958.
39. N. Singh-Miller and M. Collins, "Trigger-based language modeling using a loss-sensitive perceptron algorithm," in Proc. ICASSP, 2007, vol. 4, pp. IV-25-IV-28.
40. E. Arisoy, "Statistical and discriminative language modeling for Turkish large vocabulary continuous speech recognition," Ph.D. dissertation, Boǧaziçi Univ., Ankara, Turkey, 2009.
41. A. Stolcke, "SRILM -An extensible language modeling toolkit," in Proc. ICSLP, 2002, vol. 2, pp. 901-904.
42. C. Chelba, T. Brants, W. Neveitt, and P. Xu, "Study on interaction between entropy pruning and Kneser-Ney smoothing," in Proc. Interspeech, 2010, pp. 2242-2245.
43. H. Sak, M. Saraçlar, and T. Güngör, "On-the-fly lattice rescoring for real-time automatic speech recognition," in Proc. Interspeech, 2010, pp. 2450-2453.