Spoken language recognition: From fundamentals to practice

Proceedings of the IEEE

Volumn 101, Issue 5, 2013, Pages 1136-1159

  Li, Haizhou ^a,b   Ma, Bin ^a   Lee, Kong Aik ^a  

^a INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^b UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

Acoustic features; calibration; classifier; fusion; language recognition evaluation (LRE); phonotactic features; spoken language recognition; tokenization; vector space modeling

Indexed keywords

CALIBRATION; CLASSIFIERS; COMPUTATION THEORY; FUSION REACTIONS; SIGNAL PROCESSING; SPEECH RECOGNITION; VECTOR SPACES;

ACOUSTIC FEATURES; LANGUAGE RECOGNITION; PHONOTACTIC FEATURES; SPOKEN LANGUAGE RECOGNITION; TOKENIZATION; VECTOR SPACE MODELS;

MODELING LANGUAGES;

EID: 84876676725     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2012.2237151     Document Type: Article

References (151)

1. E. Ambikairajah, H. Li, L. Wang, B. Yin, and V. Sethu, "Language identification: A tutorial," IEEE Circuits Syst. Mag., vol. 11, no. 2, pp. 82-108, May 2011.
2. M. Ashby and J. Maidment, Introducing Phonetic Science. Cambridge, U.K.: Cambridge Univ. Press, 2005.
3. T. Baldwin and M. Lui, "Language identification: The long and the short of the matter," in Proc. Annu. Conf. North Amer. Chapter ACL Human Lang. Technol., Los Angeles, CA, USA, pp. 229-237.
4. K. M. Berkling and E. Barnard, "Analysis of phoneme-based features for language identification," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Adelaide, Australia, 1994, pp. 289-292.
5. K. M. Berkling and E. Barnard, "Language identification of six languages based on a common set of broad phonemes," in Proc. Int. Conf. Spoken Lang. Process., Yokohama, Japan, 1994, pp. 1891-1894.
6. F. Biadsy, H. Soltauy, L. Manguy, J. Navratily, and J. Hirschberg, "Discriminative phonotactics for dialect recognition using context-dependent phone classifiers," in Proc. IEEE Odyssey: Speaker and Language Recognition Workshop, Brno, Czech Republic, 2010, pp. 263-270.
7. J. Braun and H. Levkowitz, "Automatic language identification with perceptually guided training and recurrent neural networks," in Proc. Int. Conf. Spoken Lang. Process., Sydney, Australia, 1998, pp. 289-292.
8. N. Brummer and D. Leeuwen, "On calibration of language recognition scores," in Proc. IEEE Odyssey: Speaker Lang. Recognit. Workshop, San Juan, Puerto Rico, 2006, DOI: 10.1109/ODYSSEY.2006.248106.
9. N. Brummer and J. Preez, "Application-independent evaluation of speaker detection," Comput. Speech Lang., vol. 20, no. 2, pp. 230-275, 2006.
10. N. Brummer, Focal Multi-ClassVTools for Evaluation, Calibration and Fusion of, and Decision-Making with, Multi-Class Statistical Pattern Recognition Scores, Jun. 2007. [Online]. Available: http://sites.google.com/site/ nikobrummer/.
11. N. Brummer, L. Burget, O. Glembek, V. Hubeika, Z. Jancik, M. Karafiat, P. Matejka, T. Mikolov, O. Plchot, and A. Strasheim, "BUT-AGNITIO system description for NIST language recognition evaluation 2009," in Proc. NIST Lang. Recognit. Eval. Workshop, Baltimore, MD, USA, 2009.
12. N. Brümmer, "Measuring, refining and calibrating speaker and language information extracted from speech," Ph.D. dissertation, Dept. Electr. Electron. Eng., Stellenbosch Univ., Stellenbosch, South Africa, 2010.
13. N. Brümmer, S. Cumani, O. Glembek, M. Karafíat, P. Maťejka, J. Peš́an, O. Plchot, M. Soufifar, E. de Villiers, and ̌ J. Cernocḱy, "Description and analysis of the Brno276 system for LRE2011," in Proc. Odyssey: Speaker Lang. Recognit. Workshop, Singapore, 2012, pp. 216-223.
14. L. Burget, P. Matejka, and J. Cernocky, "Discriminative training techniques for acoustic language identification," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Toulouse, France, 2006, pp. 209-212.
15. W. M. Campbell, J. P. Campbell, D. A. Reynolds, D. A. Jones, and T. R. Leek, "High-level speaker verification with support vector machines," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Montreal, QC, Canada, 2004, pp. 73-76.
16. W. M. Campbell, J. P. Campbell, D. A. Reynolds, E. Singer, and P. A. Torres-Carrasquillo, "Support vector machines for speaker and language recognition," Comput. Speech Lang., vol. 20, no. 2-3, pp. 210-229, 2006.
17. W. Campbell, T. Gleason, J. Navratil, D. Reynolds, W. Shen, E. Singer, and P. Torres-Carrasquillo, "Advanced language recognition using cepstra and phonotactics: MITLL system performance on the NIST 2005 language recognition evaluation," in Proc. IEEE Odyssey: Speaker Lang. Recognit. Workshop, San Juan, Puerto Rico, 2006, DOI: 10.1109/ODYSSEY.2006.248097.
18. W. M. Campbell, D. E. Sturim, and D. A. Reynolds, "Support vector machines using GMM supervectors for speaker verification," IEEE Signal Process. Lett., vol. 13, no. 5, pp. 308-310, May 2006.
19. W. M. Campbell, "A covariance Kernel for SVM language recognition," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Las Vegas, NV, USA, 2008, pp. 4141-4144.
20. W. M. Campbell, D. E. Sturim, P. Torres-Carrasquillo, and D. A. Reynolds, "A comparison of subspace feature-domain methods for language recognition," in Proc. Interspeech Conf., Brisbane, Australia, 2008, pp. 309-312.
21. F. Castaldo, D. Colibro, E. Dalmasso, P. Laface, and C. Vair, "Compensation of nuisance factors for speaker and language recognition," IEEE Trans. Audio Speech Lang. Process., vol. 15, no. 7, pp. 1969-1978, Sep. 2007.
22. W. B. Cavnar and J. M. Trenkle, "N-gram-based text categorization," in Proc. 3rd Annu. Symp. Document Anal. Inf. Retrieval, Las Vegas, NV, USA, 1994, pp. 161-175.
23. C. Chelba, T. Hazen, and M. Saraclar, "Retrieval and browsing of spoken content," IEEE Signal Process. Mag., vol. 25, no. 3, pp. 39-49, May 2008.
24. J. Chu-Carrol and B. Carpenter, "Vector-based natural language call routing," Comput. Linguist., vol. 25, no. 3, pp. 361-388, 1999.
25. C. Cieri, J. P. Campbell, H. Nakasone, D. Miller, and K. Walker, "The mixer corpus of multilingual, multichannel speaker recognition data," in Proc. Int. Conf. Lang. Resources Eval., Lisbon, Portugal, 2004, pp. 24-30.
26. C. Cieri, L. Brandschain, A. Neely, D. Graff, K. Walker, C. Caruso, A. Martin, and C. Greenberg, "The broadcast narrow band speech corpus: A new resource type for large scale language recognition," in Proc. Interspeech Conf., Brighton, U.K., 2009, pp. 2867-2870.
27. D. Cimarusti and R. Ives, "Development of an automatic identification system of spoken languages: Phase I," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Paris, France, 1982, pp. 1661-1663.
28. H. P. Combrinck and E. C. Botha, "Automatic language identification: Performance vs. complexity," in Proc. 8th Annu. South Africa Workshop Pattern Recognit., Grahams Town, South Africa, 1997.
29. B. Comrie, The World's Major Languages. Oxford, U.K.: Oxford Univ. Press, 1990.
30. D. Crystal, The Cambridge Factfinder. Cambridge, U.K.: Cambridge Univ. Press, 1993.
31. S. Cumani and P. Laface, "Analysis of large-scale SVM training algorithms for language and speaker recognition," IEEE Trans. Audio Speech Lang. Process., vol. 20, no. 5, pp. 1585-1596, Jul. 2012.
32. S. Davis and P. Mermelstein, "Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences," IEEE Trans. Acoust. Speech Signal Process., vol. 28, no. 4, pp. 357-366, Aug. 1980.
33. N. Dehak, P. Dumouchel, and P. Kenny, "Modeling prosodic features with joint factor analysis for speaker verification," IEEE Trans. Audio Speech Lang. Process., vol. 15, no. 7, pp. 2095-2103, Sep. 2007.
34. N. Dehak, P. J. Kenny, R. Dehak, P. Dumouchel, and P. Ouellet, "Front-end factor analysis for speaker verification," IEEE Trans. Acoust. Speech Signal Process., vol. 19, no. 4, pp. 788-798, May 2011.
35. N. Dehak, P. Torres-Carrasquillo, D. Reynolds, and R. Dehak, "Language recognition via i-vectors and dimensionality reduction," in Proc. Interspeech Conf., Florence, Italy, 2011, pp. 857-860.
36. A. Dumpster, N. Laird, and D. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. R. Stat. Soc., vol. 39, pp. 1-38, 1977.
37. T. Dunning, "Statistical identification of language," Comput. Res. Lab (CRL), New Mexico State Univ., Las Cruces, NM, USA, Tech. Rep. MCCS-94-273, 1994.
38. J. Foil, "Language identification using noisy speech," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Tokyo, Japan, 1986, pp. 861-864.
39. J. L. Gauvain and C.-H. Lee, "Maximum a posterior estimation for multivariate Gaussian mixture observations of Markov chains," IEEE Trans. Speech Audio Process., vol. 2, no. 2, pp. 291-298, Apr. 1994.
40. J. L. Gauvain, A. Messaoudi, and H. Schwenk, "Language recognition using phone lattices," in Proc. Int. Conf. Spoken Lang. Process., Jeju Island, Korea, 2004, pp. 1283-1286.
41. E. M. Gold, "Language identification in the limit," Inf. Control, vol. 10, no. 5, pp. 447-474, 1967.
42. F. J. Goodman, A. F. Martin, and R. E. Wohlford, "Improved automatic language identification in noisy speech," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Glasgow, Scotland, 1989, vol. 1, pp. 528-531.
43. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning: Data Mining, Inference, and Prediction. New York: Springer-Verlag, 2008.
44. T. J. Hazen and V. W. Zue, "Automatic language identification using a segment-based approach," in Proc. Eurospeech Conf., Berlin, Germany, 1993, pp. 1303-1306.
45. T. J. Hazen and V. W. Zue, "Recent improvements in an approach to segment-based automatic language identification," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Adelaide, Australia, 1994, pp. 1883-1886.
46. T. J. Hazen and V. W. Zue, "Segment-based automatic language identification," J. Acoust. Soc. Amer., vol. 101, no. 4, pp. 2323-2331, 1997.
47. H. Hermansky and N. Morgan, "RASTA processing of speech," IEEE Trans. Speech Audio Process., vol. 2, no. 4, pp. 578-589, Oct. 1994.
48. J. Hieronymus and S. Kadambe, "Spoken language identification using large vocabulary speech recognition," in Proc. Int. Conf. Spoken Lang. Process., Philadelphia, PA, USA, 1996, pp. 1780-1783.
49. G. Hinton, "Products of experts," in Proc. 9th Int. Conf. Artif. Neural Netw., Edinburgh, U.K., 1999, vol. 1, pp. 1-6.
50. G. Hinton, L. Deng, D. Yu, G. Dahl, A. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. Sainath, and B. Kingsbury, "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups," IEEE Signal Process. Mag., vol. 29, no. 6, pp. 82-97, Nov. 2012.
51. A. S. House and E. P. Neuburg, "Toward automatic identification of the language of an utterance. I. Preliminary methodological considerations, " J. Acoust. Soc. Amer., vol. 62, no. 3, pp. 708-713, 1977.
52. X. Huang, A. Acero, and H. W. Hon, Spoken Language Processing: A Guide to Theory, Algorithm, and System Development. Englewood Cliffs, NJ, USA: Prentice-Hall, 2001.
53. M. I. Jordan and R. A. Jacobs, "Hierarchical mixtures of experts and the EM algorithms," Neural Comput., vol. 6, pp. 181-214, 1994.
54. B. H. Juang, W. Chou, and C.-H. Lee, "Minimum classification error rate methods for speech recognition," IEEE Trans. Speech Audio Process., vol. 5, no. 3, pp. 257-265, May 1997.
55. D. Jurafsky and J. H. Martin, Speech and Language Processing. Englewood Cliffs, NJ, USA: Prentice-Hall, 2000.
56. P. Kenny and P. Dumouchel, "Experiments in speaker verification using factor analysis likelihood ratios," in Proc. Odyssey: Speaker Lang. Recognit. Workshop, Toledo, Spain, 2004, pp. 219-226.
57. P. Kenny, G. Boulianne, P. Ouellet, and P. Dumouchel, "Joint factor analysis versus eigenchannels in speaker recognition," IEEE Trans. Audio Speech Lang. Process., vol. 15, no. 4, pp. 1435-1447, May 2007.
58. K. Kirchhoff, "Language characteristics," in Multilingual Speech Processing, T. Schultz and K. Kirchhoff, Eds. Amsterdam, The Netherlands: Elsevier, 2006.
59. J. Kittler, "Combining classifiers: A theoretical framework," Pattern Anal. Appl., no. 1, pp. 18-27, 1988.
60. M. Kockmann, L. Ferrer, L. Burget, and ̌ J. Cernocḱy, "iVector fusion of prosodic and cepstral features for speaker verification," in Proc. Interspeech Conf., Florence, Italy, 2011, pp. 265-268.
61. L. I. Kuncheva, "A theoretical study on six classifier fusion strategies," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 2, pp. 281-286, Feb. 2002.
62. L. F. Lamel and J. L. Gauvain, "Language identification using phone-based acoustic likelihoods," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Adelaide, Australia, 1994, vol. 1, pp. 293-296.
63. T. Lander, R. Cole, B. Oshika, and M. Noel, "The OGI 22 language telephone speech corpus," in Proc. Eurospeech Conf., Madrid, Spain, 1995, pp. 817-820.
64. C.-H. Lee, "Principles of spoken language recognition," in Springer Handbook of Speech Processing and Speech Communication, J. Benesty, M. M. Sondhi, and A. Huang, Eds. New York, NY, USA: Springer-Verlag, 2008.
65. K. A. Lee, C. You, and H. Li, "Spoken language recognition using support vector machines with generative front-end," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Las Vegas, NV, USA, 2008, pp. 4153-4156.
66. K. A. Lee, C. H. You, H. Li, T. Kinnunen, and K. C. Sim, "Using discrete probabilities with Bhattacharyya measure for SVM-based speaker verification," IEEE Trans. Audio Speech Lang. Process., vol. 19, no. 4, pp. 861-870, May 2011.
67. K. A. Lee, C. H. You, V. Hautam̈aki, A. Larcher, and H. Li, "Spoken language recognition in the latent topic simplex," in Proc. Interspeech Conf., Florence, Italy, 2011, pp. 2933-2936.
68. L. Lee and R. C. Rose, "Speaker normalization using efficient frequency warping procedures," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Atlanta, GA, USA, 1996, vol. 1, pp. 353-356.
69. R. G. Leonard and G. R. Doddington, "Automatic language identification," Air Force Rome Air Develop. Cntr., Tech. Rep. RADC-TR-74-200, Aug. 1974.
70. R. G. Leonard and G. R. Doddington, "Automatic language identification," Air Force Rome Air Develop. Cntr., Tech. Rep. RADC-TR-75-264, Oct. 1975.
71. M. P. Lewis, Ed., Ethnologue: Languages of the World, 16 ed. Dallas, TX, USA: SIL International, 2009.
72. H. Li and B. Ma, "A phonotactic language model for spoken language identification," in Proc. Assoc. Comput. Linguist., Ann Arbor, MI, USA, 2005, pp. 515-522.
73. H. Li, B. Ma, and C.-H. Lee, "A vector space modeling approach to spoken language identification," IEEE Trans. Audio Speech Lang. Process., vol. 15, no. 1, pp. 271-284, Jan. 2007.
74. H. Li, B. Ma, K. C. Sim, R. Tong, K. A. Lee, H. Sun, D. Zhu, C. You, M. Dong, and X. Wang, "Institute for Infocomm Research system description for the language recognition evaluation 2007 submission," in Proc. NIST Lang. Recognit. Eval. Workshop, Orlando, FL, USA, 2007.
75. H. Li, B. Ma, and C.-H. Lee, "Vector-based spoken language classification," in Springer Handbook of Speech Processing and Speech Communication, J. Benesty, M. M. Sondhi, and A. Huang, Eds. New York, NY, USA: Springer-Verlag, 2008.
76. H. Li and B. Ma, "TechWare: Speaker and spoken language recognition resources," IEEE Signal Process. Mag., vol. 27, no. 6, pp. 139-142, Nov. 2010.
77. K. P. Li and T. J. Edwards, "Statistical models for automatic language identification," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Denver, CO, USA, 1980, pp. 884-887.
78. X. Li, L. Deng, and J. Bilmes, "Machine learning paradigms for speech recognition: An overview," IEEE Trans. Audio Speech Lang. Process., accepted for publication.
79. B. P. Lim, H. Li, and B. Ma, "Using local and global phonotactic features in Chinese dialect identification," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Philadelphia, PA, USA, 2005, pp. 577-580.
80. S. Lucey and T. Chen, "Improved speaker verification through probabilistic subspace adaptation," in Proc. Eurospeech Conf., Geneva, Switzerland, 2003, pp. 2021-2024.
81. B. Ma, C. Guan, H. Li, and C.-H. Lee, "Multilingual speech recognition with language identification," in Proc. Int. Conf. Spoken Lang. Process., Denver, CO, USA, 2002, pp. 505-508.
82. B. Ma, H. Li, and R. Tong, "Spoken language recognition with ensemble classifiers," IEEE Trans. Audio Speech Lang. Process., vol. 15, no. 7, pp. 2053-2062, Sep. 2007.
83. C. D. Manning, P. Raghavan, and H. Schütze, Introduction to Information Retrieval. Cambridge, U.K.: Cambridge Univ. Press, 2008.
84. A. Martin, G. Doddington, T. Kamm, M. Ordowski, and M. Przybocki, "The DET curve in assessment of detection task performance," in Proc. Eurospeech Conf., Rhodes, Greece, 1997, vol. 4, pp. 1895-1898.
85. A. F. Martin and M. A. Przybocki, "NIST 2003 language recognition evaluation," in Proc. Eurospeech Conf., Geneva, Switzerland, 2003, pp. 1341-1344.
86. A. F. Martin and A. N. Le, "The current state of language recognition: NIST 2005 evaluation results," in Proc. IEEE Odyssey: Speaker Lang. Recognit. Workshop, San Juan, Puerto Rico, 2006, DOI: 10.1109/ODYSSEY. 2006.248104.
87. A. F. Martin and J. S. Garofolo, "NIST speech processing evaluations: LVCSR, speaker recognition, language recognition," in Proc. IEEE Workshop Signal Process. Appl. Public Security Forensics, Washington, DC, USA, 2007, pp. 1-7.
88. A. F. Martin and A. N. Le, "NIST 2007 language recognition evaluation," presented at the Odyssey: Speaker Lang. Recognit. Workshop, Stellenbosch, South Africa, 2008, paper 016.
89. A. F. Martin and C. Greenberg, "The 2009 NIST language recognition evaluation," in Proc. Odyssey: Speaker Lang. Recognit. Workshop, Brno, Czech Republic, 2010, pp. 165-171.
90. P. Matejka, P. Schwarz, J. Cernocky, and P. Chytil, "Phonotactic language identification using high quality phoneme recognition," in Proc. Interspeech Conf., Lisbon, Portugal, 2005, pp. 2237-2240.
91. A. McCree, F. Richardson, E. Singer, and D. Reynolds, "Beyond frame independent: Parametric modeling of time duration in speaker and language recognition," in Proc. Interspeech Conf., Brisbane, Australia, 2008, pp. 767-770.
92. S. Mendoza, L. Gillick, Y. Ito, S. Lowe, and M. Newman, "Automatic language identification using large vocabulary continuous speech recognition," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Atlanta, GA, USA, 1996, vol. 2, pp. 785-788.
93. T. P. Minka, "Algorithms for maximum-likelihood logistic regression," Carnegie Mellon Univ., Pittsburgh, PA, USA, Tech. Rep. 738, 2001.
94. Y. K. Muthusamy, R. Cole, and B. Oshika, "The OGI multi-language telephone speech corpus," in Proc. Int. Conf. Spoken Lang. Process., BanffABCanada, 1992, pp. 895-898.
95. Y. K. Muthusamy, K. M. Berkling, T. Arai, R. A. Cole, and E. Barnard, "A comparison of approaches to automatic language identification using telephone speech," in Proc. Eurospeech Conf., Berlin, Germany, 1993, pp. 1307-1310.
96. Y. K. Muthusamy, N. Jain, and R. A. Cole, "Perceptual benchmarks for automatic language identification," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Adelaide, Australia, 1994, vol. 1, pp. 333-336.
97. Y. K. Muthusamy, E. Barnard, and R. A. Cole, "Reviewing automatic language identification," IEEE Signal Process. Mag., vol. 11, no. 4, pp. 33-41, Oct. 1994.
98. S. Nakagawa, Y. Ueda, and T. Seino, "Speaker-independent, text-independent language identification by HMM," in Proc. Int. Conf. Spoken Lang. Process., Banff, AB, Canada, 1992, pp. 1011-1014.
99. J. Navratil, "Spoken language recognitionVA step toward multilinguality in speech processing," IEEE Trans. Speech Audio Process., vol. 9, no. 6, pp. 678-685, Sep. 2001.
100. R. W. M. Ng, C.-C. Leung, T. Lee, B. Ma, and H. Li, "Prosodic attribute model for spoken language identification," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Dallas, TX, USA, 2010, pp. 5022-5025.
101. R. W. M. Ng, C.-C. Leung, V. Hautam̈aki, T. Lee, B. Ma, and H. Li, "Towards long-range prosodic attribute modeling for language recognition," in Proc. Interspeech Conf., Chiba, Japan, 2010, pp. 1792-1795.
102. NIST Language Recognition Evaluations. [Online]. Available: http://nist.gov/itl/iad/mig/lre.cfm
103. M. Penagarikano, A. Varona, L. J. Rodriguez-Fuentes, and G. Bordel, "Improved modeling of cross-decoder phone co-occurrences in SVM-Based phonotactic language recognition," IEEE Trans. Audio Speech Lang. Process., vol. 19, no. 8, pp. 2348-2363, Nov. 2011.
104. S. Pigeon, P. Druyts, and P. Verlinde, "Applying logistic regression to fusion of the NIST'99 1-speaker submissions," Digital Signal Process., vol. 10, pp. 237-248, 2000.
105. D. Qu and B. Wang, "Discriminative training of GMM for language identification," in Proc. ISCA IEEE Workshop Spontaneous Speech Process. Recognit., Tokyo, Japan, 2003, pp. 67-70.
106. T. F. Quatieri, Discrete-Time Speech Signal Processing: Principles and Practice. Englewood Cliffs, NJ, USA: Prentice-Hall, 2002.
107. L. R. Rabiner, "A tutorial on hidden Markov models and selected publication in speech recognition," Proc. IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1989.
108. F. Ramus and J. Mehler, "Language identification with suprasegmental cues: A study based on speech re-synthesis," J. Acoust. Soc. Amer., vol. 105, no. 1, pp. 512-521, 1999.
109. R. Ramus, M. Nespor, and J. Mehler, "Correlates of linguistic rhythm in the speech signal," Cognition, vol. 73, no. 3, pp. 265-292, 1999.
110. D. A. Reynolds and R. C. Rose, "Robust text-independent speaker identification using Gaussian mixture speaker models," IEEE Trans. Speech Audio Process., vol. 3, no. 1, pp. 72-83, Jan. 1995.
111. D. A. Reynolds, T. F. Quatieri, and R. B. Dunn, "Speaker verification using adapted Gaussian mixture models," Digital Signal Process., vol. 10, pp. 19-41, 2000.
112. F. S. Richardson and W. M. Campbell, "Language recognition with discriminative keyword selection," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Las Vegas, NV, USA, 2008, pp. 4145-4148.
113. G. Salton, The SMART Retrieval System. Englewood Cliffs, NJ, USA: Prentice-Hall, 1971.
114. G. Salton and C. Buckley, "Term-weighting approaches in automatic text retrieval," Inf. Process. Manage., vol. 24, no. 5, pp. 513-523, 1988.
115. T. Schultz, I. Rogina, and A. Waibel, "LVCSR-based language identification," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Atlanta, GA, USA, 1996, vol. 2, pp. 781-784.
116. T. Schultz and A. Waibel, "Language independent and language adaptive," Speech Commun., vol. 35, no. 1-2, pp. 31-51, 2001.
117. T. Schultz, "Globalphone: A multilingual text and speech database developed at Karlsruhe University," in Proc. Interspeech Conf., Denver, CO, USA, 2002, pp. 345-348.
118. W. Shen, W. Campbell, T. Gleason, D. Reynolds, and E. Singer, "Experiments with lattice-based PPRLM language identification," in Proc. IEEE Odyssey: Speaker Lang. Recognit. Workshop, San Juan, Puerto Rico, 2006, DOI: 10.1109/ODYSSEY. 2006.248100.
119. W. Shen and D. A. Reynolds, "Improved GMM-Based language recognition using constrained MLLR transforms," in Proc. Int. Conf. Acoust. Speech Signal Process., Las Vegas, NV, USA, 2008, pp. 4149-4152.
120. K. C. Sim and H. Li, "On acoustic diversification front-end for spoken language identification," IEEE Trans. Audio Speech Lang. Process., vol. 16, no. 5, pp. 1029-1037, Jul. 2008.
121. E. Singer, P. Torres-Carrasquillo, D. Reynolds, A. McCree, F. Richardson, N. Dehak, and D. Sturim, "The MITLL NIST LRE2011 language recognition system," in Proc. Odyssey: Speaker Lang. Recognit. Workshop, Singapore, 2012, pp. 209-215.
122. S. M. Siniscalchi, J. Reed, T. Svendsen, and C.-H. Lee, "Exploring universal attribute characterization of spoken languages for spoken language recognition," in Proc. Interspeech Conf., Brighton, U.K., 2009, pp. 168-171.
123. S. M. Siniscalchi, J. Reed, T. Svendsen, and C.-H. Lee, "Exploiting context-dependency and acoustic resolution of universal speech attribute models in spoken language recognition," in Proc. Interspeech Conf., Chiba, Japan, 2010, pp. 2718-2721.
124. A. Solomonoff, W. M. Campbell, and I. Boardman, "Advances in channel compensation for SVM speaker recognition," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Philadelphia, PA, USA, 2005, pp. 629-632.
125. M. Sugiyama, "Automatic language recognition using acoustic features," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Toronto, ON, Canada, 1991, vol. 2, pp. 813-816.
126. M. E. Tipping and C. M. Bishop, "Mixtures of probabilistic principal component analysis," Neural Comput., vol. 11, no. 2, pp. 443-482, 1999.
127. R. Tong, B. Ma, D. Zhu, H. Li, and E.-S. Chng, "Integrating acoustic, prosodic and phonotactic features for spoken language identification," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Toulouse, France, 2006, pp. 205-208.
128. R. Tong, B. Ma, H. Li, and E. Chng, "A target-oriented phonotactic front-end for spoken language recognition," IEEE Trans. Audio Speech Lang. Process., vol. 17, no. 7, pp. 1335-1347, Sep. 2009.
129. R. Tong, B. Ma, H. Li, and E. Chng, "Target-aware lattice rescoring for dialect recognition," in Proc. Interspeech Conf., Florence, Italy, 2011, pp. 733-736.
130. P. A. Torres-Carrasquillo, D. A. Reynolds, and R. J. Deller, Jr., "Language identification using Gaussian mixture model tokenization," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Orlando, FL, USA, 2002, pp. 757-760.
131. P. Torres-Carrasquillo, E. Singer, M. Kohler, R. Greene, D. Reynolds, and J. Deller, Jr., "Approaches to language identification using Gaussian mixture models and shifted delta cepstral features," in Proc. Int. Conf. Spoken Lang. Process., Denver, CO, USA, 2002, pp. 89-92.
132. P. Torres-Carrasquillo, E. Singer, W. Campbell, T. Gleason, A. McCree, D. Reynolds, F. Richardson, W. Shen, and D. Sturim, "The MITLL NIST LRE 2007 language recognition system," in Proc. Interspeech Conf., Brisbane, Australia, 2008, pp. 719-722.
133. R. C. Tucker, M. J. Carey, and E. S. Paris, "Automatic language identification using sub-words models," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Adelaide, Australia, 1994, pp. 301-304.
134. D. A. van Leeuwen and N. Brummer, "Channel-dependent GMM and multi-class logistic regression models for language recognition," in Proc. IEEE Odyssey: Speaker Lang. Recognit. Workshop, San Juan, Puerto Rico, 2006, DOI: 10.1109/ODYSSEY. 2006.248094.
135. D. A. van Leeuwen and N. Brümmer, "An introduction to application independent evaluation of speaker recognition systems," in Speaker Classification, vol. 4343, R. Müller, Ed. Berlin, Germany: Springer-Verlag, 2007.
136. D. A. van Leeuwen and K. P. Truong, "An open-set detection evaluation methodology applied to language and emotion recognition," in Proc. Interspeech Conf., Antwerp, Belgium, 2007, pp. 338-341.
137. D. A. van Leeuwen, M. Boer, and R. Orr, "A human benchmark for the NIST language recognition evaluation 2005," presented at the Odyssey: Speaker Lang. Recognit. Workshop, Stellenbosch, South Africa, 2008, paper 012.
138. V. Vapnik, The Nature of Statistical Learning Theory. New York, NY, USA: Springer-Verlag, 1995.
139. C. Vair, D. Colibro, F. Castaldo, E. Dalmasso, and P. Laface, "Channel factors compensation in model and feature domain for speaker recognition," in Proc. IEEE Odyssey: Speaker Lang. Recognit. Workshop, San Juan, Puerto Rico, 2006, DOI: 10.1109/ODYSSEY.2006.248117.
140. R. Vogt and S. Sridharan, "Explicit modelling of session variability for speaker verification," Comput. Speech Lang., vol. 22, pp. 17-38, 2008.
141. A. Waibel, P. Geutner, L. M. Tomokiyo, T. Schultz, and M. Woszczyna, "Multilinguality in speech and spoken language systems," Proc. IEEE, vol. 88, no. 8, pp. 1181-1190, Aug. 2000.
142. P. C. Woodland and D. Povey, "Large scale discriminative training of hidden Markov models for speech recognition," Comput. Speech Lang., vol. 16, no. 1, pp. 25-47, 2002.
143. Y. Yan and E. Barnard, "An approach to automatic language identification based on language-dependent phone recognition," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Detroit, MI, USA, 1995, vol. 5, pp. 3511-3514.
144. Y. Yan, E. Barnard, and R. Cole, "Development of an approach to language identification based on phone recognition," Comput. Speech Lang., vol. 10, pp. 37-54, 1996.
145. C. H. You, K. A. Lee, and H. Li, "GMM-SVM kernel with a Bhattacharyya-based distance for speaker recognition," IEEE Trans. Audio Speech Lang. Process., vol. 18, no. 6, pp. 1300-1312, Aug. 2010.
146. C. H. You, H. Li, and K. A. Lee, "A GMM-supervector approach to language recognition with adaptive relevance factor," in Proc. EUSIPCO, Aalborg, Denmark, 2010, pp. 1993-1997.
147. J. Zhao, H. Shu, L. Zhang, X. Wang, Q. Gong, and P. Li, "Cortical competition during language discrimination," NeuroImage, vol. 43, pp. 624-633, 2008.
148. D. Zhu, B. Ma, and H. Li, "Soft margin estimation of Gaussian mixture model parameters for spoken language recognition," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Dallas, TX, USA, 2010, pp. 4990-4993.
149. M. A. Zissman, "Automatic language identification using Gaussian mixture and hidden Markov models," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Minneapolis, MN, USA, 1993, vol. 2, pp. 399-402.
150. M. A. Zissman, "Comparison of four approaches to automatic language identification of telephone speech," IEEE Trans. Speech Audio Process., vol. 4, no. 1, pp. 31-44, Jan. 1996.
151. M. A. Zissman, "Predicting, diagnosing and improving automatic language identification performance," in Proc. Eurospeech Conf., Rhodes, Greece, 1997, pp. 51-54.