Embedded kernel eigenvoice speaker adaptation and its implication to reference speaker weighting

IEEE Transactions on Audio, Speech and Language Processing

Volumn 14, Issue 4, 2006, Pages 1267-1279

  Mak, Brian Kan Wing ^a,b   Hsiao, Roger Wend Huu ^a,b   Ho, Simon Ka Lung ^b   Kwok, James T ^a,b  

^a IEEE   (Hong Kong)

^b HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

Author keywords

Composite kernels; Eigenvoice speaker adaptation; Kernel eigenvoice speaker adaptation; Kernel principal component analysis (PCA); Pre image problem; Reference speaker weighting

Indexed keywords

COMPOSITE KERNELS; EIGENVOICE SPEAKER ADAPTATION; KERNEL EIGENVOICE SPEAKER ADAPTATION; KERNEL PRINCIPAL COMPONENT ANALYSIS (PCA); PRE-IMAGE PROBLEMS; REFERENCE SPEAKER WEIGHTING; REFERENCE SPEAKER WEIGHTING (RSW);

EIGENVALUES AND EIGENFUNCTIONS; EMBEDDED SYSTEMS; PRINCIPAL COMPONENT ANALYSIS; PROBLEM SOLVING;

SPEECH RECOGNITION;

EID: 34047246852     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSA.2005.860836     Document Type: Article

References (35)

1. T. Kosaka, S. Matsunaga, and S. Sagayama, "Speaker-independent speech recognition based on tree-structured speaker clustering," J. Comput. Speech Lang., vol. 10, pp. 55-74, 1996.
2. T. J. Hazen, "A comparison of novel techniques for rapid speaker adaptation," Speech Commun., vol. 31, pp. 15-33, May 2000.
3. J. L. Gauvain and C. H. Lee, "Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains," IEEE Trans. Speech Audio Process., vol. 2, no. 2, pp. 291-298, Apr. 1994.
4. C. J. Leggetter and P. C. Woodland, "Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models," J. Comput. Speech Lang., vol. 9, pp. 171-185, 1995.
5. R. Kuhn, J.-C. Junqua, P. Nguyen, and N. Niedzielski, "Rapid speaker adaptation in eigenvoice space," IEEE Trans. Speech Audio Process., vol. 8, no. 6, pp. 695-707, Nov. 2000.
6. M. Turk and A. Pentland, "Face recognition using eigenfaces," in Proc. Int. Conf. Computer Vision and Pattern Recognition, 1991, pp. 586-591.
7. R. Kuhn, F. Perronnin, P. Nguyen, J. C. Junqua, and L. Rigazio, "Very fast adaptation with a compact context-dependent eigenvoice model," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing, vol. 1, May 2001, pp. 373-376.
8. H. Botterweck, "Very fast adaptation for large vocabulary continuous speech recognition using eigenvoices," in Proc. Int. Conf. Spoken Language Processing, vol. 4, 2000, pp. 354-357.
9. K. T. Chen, W. W. Liau, H. M. Wang, and L. S. Lee, "Fast speaker adaptation using eigenspace-based maximum likelihood linear regression," in Proc. Int. Conf. Spoken Language Processing, vol. 3, 2000, pp. 742-745.
10. N. Wang, S. Lee, F. Seide, and L. S. Lee, "Rapid speaker adaptation using a priori knowledge by eigenspace analysis of MLLR parameters," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Process., 2001, pp. 345-348.
11. D. K. Kim and N. S. Kim, "Bayesian speaker adaptation based on probabilistic principal component analysis," in Proc. Int. Conf. Spoken Language Processing, 2000, pp. 734-737.
12. E. Jon, D. K. Kim, and N. S. Kim, "EMAP-based speaker adaptation with robust correlation estimation," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, 2001, pp. 321-324.
13. H. Botterweck, "Anisotropic MAP defined by eigenvoices for large vocabulary continuous speech recognition," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, vol. 1, 2001, pp. 353-356.
14. P. Nguyen and C. Wellekens, "Maximum likelihood eigenspace and MLLR for speech recognition in noisy environments," in Proc. Eur. Conf. Speech Communication and Technology, 1999, pp. 2519-2522.
15. M. F. J. Gales, "Cluster adaptive training of hidden Markov models," IEEE Trans. Speech Audio Process., vol. 8, no. 4, pp. 417-428, Jul. 2000.
16. V. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
17. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines. Cambridge, U.K.: Cambridge Univ. Press, 2000.
18. B. Schölkopf and A. J. Smola, Learning with Kernels. Cambridge, MA: MIT Press, 2002.
19. B. Schölkopf, A. Smola, and K. R. Müller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Comput., vol. 10, pp. 1299-1319, 1998.
20. A. Ben-Hur, D. Horn, H. T. Siegelmann, and V. Vapnik, "Support vector clustering," J. Mach. Learn. Res., vol. 2, pp. 125-137, 2001.
21. F. R. Bach and M. I. Jordan, "Kernel independent component analysis," J. Mach. Learn. Res., vol. 3, pp. 1-48, 2002.
22. B. Mak, J. T. Kwok, and S. Ho, "Kernel eigenvoice speaker adaptation," IEEE Trans. Speech Audio Process., vol. 13, no. 5, pp. 984-992, Sep. 2005.
23. S. Mika, B. Schölkopf, A. Smola, K. R. Müller, M. Scholz, and G. Rätsch, "Kernel PCA and de-noising in feature spaces," in Advances in Neural Information Processing Systems II, M. S. Kearns, S. A. Solla, and D. A. Cohn, Eds. San Mateo, CA: Morgan Kaufmann, 1998.
24. J. T. Kwok and I. W. Tsang, "The pre-imace problem in kernel methods," IEEE Trans. Neural Netw., vol. 15, no. 6, pp. 1517-1525, Nov. 2004.
25. G. H. Bakir, J. Weston, and B. Schölkopf, "Learning to find pre-images," in Advances in Neural Information Processing Systems 16, S. Thrun, L. Saul, and B. Schölkopf, Eds. Cambridge, MA: MIT Press, 2004.
26. B. Mak, J. T. Kwok, and S. Ho, "A study of various composite kernels for kernel eigenvoice speaker adaptation," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Process., vol. I, Montreal, QC, Canada, May 2004, pp. 325-328.
27. J. T. Kwok, B. Mak, and S. Ho, "Eigenvoice speaker adaptation via composite kernel PCA," in Advances in Neural Information Processing Systems 16, S. Thrun, L. Saul, and B. Schölkopf, Eds. Cambridge, MA: MIT Press, 2004.
28. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. R. Statist. Soc. B, vol. 39, no. 1, pp. 1-38, 1977.
29. B. Mak, S. Ho, and J. T. Kwok, "Speedup of kernel eigenvoice speaker adaptation by embedded kernel PCA," in Proc. Int. Conf. Spoken Language Processing, vol. IV, Jeju Island, South Korea, Oct. 14-18, 2004, pp. 2913-2916.
30. B. Mak and S. Ho, "Various reference speakers determination methods for embedded kernel eigenvoice speaker adaptation," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, vol. 1, Philadelphia, PA, Mar. 18-23, 2005, pp. 981-984.
31. R. G. Leonard, "A database for speaker-independent digit recognition," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, vol. 3, 1984, pp. 4211-4214.
32. D. B. Paul and J. M. Baker, "The design of the wall street journal-based CSR corpus," in Proc. DARPA Speech and Natural Language Workshop, Feb. 1992.
33. N. Parihar and J. Picone. (2002) DSR Front End LVCSR Evaluation. AU/384/02, Aurora Working Group. [Online]. Available: http://www.isip.msstate. edu/projecls/aurora.
34. J. F. Bonnans, J. C. Gilbert, C. Lemaréchal, and C. A. Sagastiádbal, Numerical Optimization: Theoretical and Practical Aspects. Berlin, Germany: Springer-Verlag, 2003.
35. P. Price, W. M. Fisher, J. Bernstein, and D. S. Pallett, "The DARPA 1000-word resource management database for continuous speech recognition," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, vol. 1, 1988, pp. 651-654.