Voice conversion and spoofing attack on speaker verification systems

2013 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA 2013

Volumn , Issue , 2013, Pages

  Wu, Zhizheng ^a   Li, Haizhou ^a,b  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

ANTI-SPOOFING; MARKET ADOPTION; ONLINE COMMERCE; SPEAKER VERIFICATION; SPEAKER VERIFICATION SYSTEM; SPOOFING ATTACKS; USER AUTHENTICATION; VOICE CONVERSION;

AUTHENTICATION; DATA PROCESSING; SPEECH PROCESSING;

SPEECH RECOGNITION;

EID: 84893302435     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/APSIPA.2013.6694344     Document Type: Conference Paper

References (81)

1. Kong Aik Lee, Bin Ma, and Haizhou Li, "Speaker verification makes its debut in smartphone," in IEEE Signal Processing Society Speech and language Technical Committee Newsletter, February 2013.
2. Marcos Faundez-Zanuy, Martin Hagmüller, and Gernot Kubin, "Speaker verification security improvement by means of speech watermarking," Speech communication, vol. 48, no. 12, pp. 1608-1619, 2006. (Pubitemid 44829871)
3. Johan Lindberg, Mats Blomberg, et al., "Vulnerability in speaker verification-a study of technical impostor techniques," in Proc. The European Conference on Speech Communication and Technology, 1999.
4. Jesús Villalba and Eduardo Lleida, "Speaker verification performance degradation against spoofing and tampering attacks," in FALA 10 workshop, 2010.
5. Yee Wah Lau, Michael Wagner, and Dat Tran, "Vulnerability of speaker verification to voice mimicking," in Proc. International Symposium on Intelligent Multimedia, Video and Speech Processing, 2004.
6. Mireia Farrús, Michael Wagner, Jan Anguita, and Javier Hernando, "How vulnerable are prosodic features to professional imitators?," in The Speaker and Language Recognition Workshop (Odyssey 2008), 2008.
7. Rosa González Hautamäki, Tomi Kinnunen, Ville Hautamäki, Timo Leino, and Anne-Maria Laukkanen, "I-vectors meet imitators: on vulnerability of speaker verification systems against voice mimicry," in Proc. Interspeech.
8. Andrew J Hunt and A.W. Black, "Unit selection in a concatenative speech synthesis system using a large speech database," in Proc. ICASSP, 1996.
9. Heiga Zen, Keiichi Tokuda, and A.W. Black, "Statistical parametric speech synthesis," Speech Communication, vol. 51, no. 11, pp. 1039-1064, 2009.
10. Yao Qian, Frank K Soong, and Zhi-Jie Yan, "A unified trajectory tiling approach to high quality speech rendering," IEEE transactions on audio, speech, and language processing, vol. 21, no. 1-2, pp. 280-290, 2013.
11. Takashi Masuko, Takafumi Hitotsumatsu, Keiichi Tokuda, and Takao Kobayashi, "On the security of HMM-based speaker verification systems against imposture using synthetic speech," in Proc. EUROSPEECH, 1999.
12. Takashi Masuko, Keiichi Tokuda, and Takao Kobayashi, "Imposture using synthetic speech against speaker verification based on spectrum and pitch," in Proc. ICSLP, 2000.
13. Takayuki Satoh, Takashi Masuko, Takao Kobayashi, and Keiichi Tokuda, "A robust speaker verification system against imposture using an HMMbased speech synthesis system," in Proc. Eurospeech, 2001.
14. Phillip L De Leon, Michael Pucher, Junichi Yamagishi, Inma Hernaez, and Ibon Saratxaga, "Evaluation of speaker verification security and detection of HMM-based synthetic speech," IEEE Transactions on Audio, Speech, and Language Processing, vol. 20, no. 8, pp. 2280-2290, 2012.
15. Junichi Yamagishi, Takao Kobayashi, Yuji Nakano, Katsumi Ogata, and Juri Isogai, "Analysis of speaker adaptation algorithms for HMM-based speech synthesis and a constrained SMAPLR adaptation algorithm," IEEE Transactions on Audio, Speech, and Language Processing, vol. 17, no. 1, pp. 66-83, 2009.
16. Tomi Kinnunen and Haizhou Li, "An overview of text-independent speaker recognition: from features to supervectors," Speech Communication, vol. 52, no. 1, pp. 12-40, January 2010.
17. Douglas A Reynolds, Thomas F Quatieri, and Robert B Dunn, "Speaker verification using adapted gaussian mixture models," Digital signal processing, vol. 10, no. 1, pp. 19-41, 2000. (Pubitemid 30592166)
18. William M Campbell, Douglas E Sturim, and Douglas A Reynolds, "Support vector machines using GMM supervectors for speaker verification," IEEE Signal Processing Letters, vol. 13, no. 5, pp. 308-311, 2006.
19. Alex Solomonoff, William M Campbell, and Ian Boardman, "Advances in channel compensation for SVM speaker recognition," in Proc. ICASSP.
20. Lukas Burget, Pavel Matejka, Petr Schwarz, Ondrej Glembek, and Jan Cernocky, "Analysis of feature extraction and channel compensation in a GMM speaker recognition system," IEEE Transactions on Audio, Speech, and Language Processing, vol. 15, no. 7, pp. 1979-1986, 2007.
21. Andrew O Hatch, Sachin Kajarekar, and Andreas Stolcke, "Within-class covariance normalization for SVM-based speaker recognition," in Proc. ICSLP, 2006.
22. P. Kenny, "Joint factor analysis of speaker and session variability: theory and algorithms," technical report CRIM-06/08-14, 2006.
23. P. Kenny, G. Boulianne, P. Ouellet, and P. Dumouchel, "Speaker and session variability in GMM-based speaker verification," IEEE Transactions on Audio, Speech and Language Processing, vol. 15, no. 4, pp. 1448-1460, May 2007.
24. Patrick Kenny, "Bayesian speaker verification with heavy tailed priors," in Speaker and Language Recognition Workshop (IEEE Odyssey), 2010.
25. N. Dehak, P.J. Kenny, R. Dehak, P. Dumouchel, and P. Ouellet, "Frontend factor analysis for speaker verification," IEEE Transactions on Audio, Speech and Language Processing, vol. 19, no. 4, pp. 788-798, May 2011.
26. V. Hautamaki, T. Kinnunen, F. Sedlak, Kong Aik Lee, Bin Ma, and Haizhou Li, "Sparse classifier fusion for speaker verification," IEEE Transactions on Audio, Speech, and Language Processing, vol. 21, no. 8, pp. 1622-1631, 2013.
27. Taufiq Hasan, Seyed Omid Sadjadi, Gang Liu, Navid Shokouhi, Hynek Boril, and John HL Hansen, "CRSS systems for 2012 nist speaker recognition evaluation," in Proc. ICASSP, 2013.
28. Mitchell McLaren, Nicolas Scheffer, Martin Graciarena, Luciana Ferrer, and Yun Lei, "Improving speaker identification robustness to highly channel-degraded speech through multiple system fusion," in Proc. ICASSP, 2013.
29. M. Narendranath, H.A. Murthy, S. Rajendran, and B. Yegnanarayana, "Transformation of formants for voice conversion using artificial neural networks," Speech communication, vol. 16, no. 2, pp. 207-216, 1995.
30. Alexander Kain and Michael W Macon, "Spectral voice conversion for text-to-speech synthesis," in Proc. ICASSP, 1998.
31. Yannis Stylianou, Olivier Cappé, and Eric Moulines, "Continuous probabilistic transform for voice conversion," IEEE Transactions on Speech and Audio Processing, vol. 6, no. 2, pp. 131-142, 1998. (Pubitemid 128720639)
32. Tomoki Toda, A.W. Black, and Keiichi Tokuda, "Voice conversion based on maximum-likelihood estimation of spectral parameter trajec tory," IEEE Transactions on Audio, Speech, and Language Processing, vol. 15, no. 8, pp. 2222-2235, 2007.
33. B Gillet and S King, "Transforming F0 contours," in Proc. Eurospeech, 2003.
34. Chung-Hsien Wu, Chi-Chun Hsia, Te-Hsien Liu, and Jhing-Fa Wang, "Voice conversion using duration-embedded bi-HMMs for expressive speech synthesis," IEEE Transactions on Audio, Speech, and Language Processing, vol. 14, no. 4, pp. 1109-1116, 2006. (Pubitemid 46547608)
35. Elina E Helander and Jani Nurminen, "A novel method for prosody prediction in voice conversion," in ICASSP, 2007.
36. Z.-Z. Wu, Tomi Kinnunen, E.S. Chng, and Haizhou Li, "Text- independent F0 transformation with non-parallel data for voice conversion," in Proc. Interspeech, 2010.
37. Damien Lolive, Nelly Barbot, and Olivier Boeffard, "Pitch and duration transformation with non-parallel data," Proc. Speech Prosody, pp. 111-114, 2008.
38. Elina Helander, Jan Schwarz, Jani Nurminen, Hanna Silen, and Moncef Gabbouj, "On the impact of alignment on voice conversion performance," in Proc. Interspeech, 2008.
39. Daniel Erro, Asunción Moreno, and Antonio Bonafonte, "INCA algorithm for training voice conversion systems from nonparallel corpora," IEEE Transactions on Audio, Speech, and Language Processing, vol. 18, no. 5, pp. 944-953, 2010.
40. Hideki Kawahara, Ikuyo Masuda-Katsuse, and Alain de Cheveigné, "Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based F0 extraction: Possible role of a repetitive structure in sounds," Speech communication, vol. 27, no. 3, pp. 187-207, 1999.
41. Yannis Stylianou, "Applying the harmonic plus noise model in concatenative speech synthesis," IEEE Transactions on Speech and Audio Processing, vol. 9, no. 1, pp. 21-29, 2001. (Pubitemid 32130684)
42. Elina Helander, Tuomas Virtanen, Jani Nurminen, and Moncef Gabbouj, "Voice conversion using partial least squares regression," IEEE Transactions on Audio, Speech, and Language Processing, vol. 18, no. 5, pp. 912-921, 2010.
43. Heiga Zen, Yoshihiko Nankaku, and Keiichi Tokuda, "Continuous stochastic feature mapping based on trajectory HMMs," IEEE Transactions on Audio, Speech, and Language Processing, vol. 19, no. 2, pp. 417-430, 2011.
44. Daisuke Saito, Shinji Watanabe, Atsushi Nakamura, and Nobuaki Minematsu, "Statistical voice conversion based on noisy channel model," IEEE Transactions on Audio, Speech, and Language Processing, vol. 20, no. 6, pp. 1784-1794, 2012.
45. Keiichi Tokuda, Takao Kobayashi, Takashi Masuko, and Satoshi Imai, "Mel-generalized cepstral analysis-a unified approach to speech spectral estimation.," in Proc. ICSLP, 1994.
46. Elina Helander, Jani Nurminen, and Moncef Gabbouj, "LSF mapping for voice conversion with very small training sets," in Proc. ICASSP, 2008.
47. Victor Popa, Hanna Silen, Jani Nurminen, and Moncef Gabbouj, "Local linear transformation for voice conversion," in Proc. ICASSP, 2012.
48. Frank Soong and Biing-Hwang Juang, "Line spectrum pair (LSP) and speech data compression," in Proc. ICASSP, 1984.
49. Masanobu Abe, Satoshi Nakamura, Kiyohiro Shikano, and Hisao Kuwabara, "Voice conversion through vector quantization," in Proc. ICASSP, 1988.
50. Levent M Arslan, "Speaker transformation algorithm using segmental codebooks (STASC)," Speech Communication, vol. 28, no. 3, pp. 211-226, 1999.
51. K Shikano, S Nakamura, and M Abe, "Speaker adaptation and voice conversion by codebook mapping," in Proc. IEEE International Sympoisum on Circuits and Systems, 1991.
52. Yining Chen, Min Chu, Eric Chang, Jia Liu, and Runsheng Liu, "Voice conversion with smoothed GMM and MAP adaptation," in Proc. Eurospeech, 2003.
53. Hsin-Te Hwang, Yu Tsao, Hsin-Min Wang, Yih-Ru Wang, and Sin-Horng Chen, "A study of mutual information for GMM-based spectral conversion," in Proc. Interspeech, 2012.
54. Nicholas CV Pilkington, Heiga Zen, and Mark JF Gales, "Gaussian process experts for voice conversion," in Proc. Interspeech, 2011.
55. Zhizheng Wu, Tomi Kinnunen, E.S. Chng, and Haizhou Li, "Mixture of factor analyzers using priors from non-parallel speech for voice conversion," IEEE SIGNAL PROCESSING LETTERS, vol. 19, no. 12, pp. 914-917, 2012.
56. Srinivas Desai, E Veera Raghavendra, B Yegnanarayana, A.W. Black, and Kishore Prahallad, "Voice conversion using artificial neural networks," in Proc. ICASSP, 2009.
57. P Song, YQ Bao, L Zhao, and CR Zou, "Voice conversion using support vector regression," Electronics letters, vol. 47, no. 18, pp. 1045-1046, 2011.
58. Elina Helander, Hanna Silén, Tuomas Virtanen, and Moncef Gabbouj, "Voice conversion using dynamic kernel partial least squares regression," IEEE Transactions on Audio, Speech, and Language Processing, vol. 20, no. 3, pp. 806-817, 2012.
59. Zhizheng Wu, E.S. Chng, and Haizhou Li, "Conditional restricted boltzmann machine for voice conversion," in the first IEEE China Summit and International Conference on Signal and Information Processing (ChinaSIP), 2013.
60. Zhizheng Wu, Tuomas Virtanen, Tomi Kinnunen, E.S. Chng, and Haizhou Li, "Exemplar-based voice conversion using non-negative spectrogram deconvolution," in the 8th ISCA Speech Synthesis Workshop, 2013.
61. David Sundermann and Hermann Ney, "VTLN-based voice conversion," in Proc. The 3rd IEEE International Symposium on Signal Processing and Information Technology, 2003.
62. Daniel Erro, Asunción Moreno, and Antonio Bonafonte, "Voice conversion based on weighted frequency warping," IEEE Transactions on Audio, Speech, and Language Processing, vol. 18, no. 5, pp. 922-931, 2010.
63. Elizabeth Godoy, Olivier Rosec, and Thierry Chonavel, "Voice conversion using dynamic frequency warping with amplitude scaling, for parallel or nonparallel corpora," IEEE Transactions on Audio, Speech, and Language Processing, vol. 20, no. 4, pp. 1313-1323, 2012.
64. Daniel Erro, Eva Navas, and Inma Hernaez, "Parametric voice conversion based on bilinear frequency warping plus amplitude scaling," IEEE Transactions on Audio, Speech, and Language Processing, vol. 21, no. 3, pp. 556-566, 2013.
65. S.H. Mohammadi and Alexander Kain, "Transmutative voice conversion," in Proc. ICASSP, 2013.
66. David Sundermann, Harald Hoge, Antonio Bonafonte, Hermann Ney, Alan Black, and Shri Narayanan, "Text-independent voice conversion based on unit selection," in Proc. ICASSP, 2006.
67. Thierry Dutoit, A Holzapfel, Matthieu Jottrand, Alexis Moinet, Javier Perez, and Y Stylianou, "Towards a voice conversion system based on frame selection," in Proc. ICASSP, 2007.
68. Zhizheng Wu, Tuomas Virtanen, Tomi Kinnunen, E.S. Chng, and Haizhou Li, "Exemplar-based unit selection for voice conversion utilizing temporal information," in Proc. Interspeech, 2013.
69. Zhizheng Wu, Tomi Kinnunen, E.S. Chng, Haizhou Li, and Eliathamby Ambikairajah, "A study on spoofing attack in state-of-the-art speaker verification: the telephone speech case," in Asia-Pacific Signal & Information Processing Association Annual Summit and Conference (APSIPA ASC), 2012, pp. 1-5.
70. Zhizheng Wu, Anthony Larcher, Kong Aik Lee, E.S. Chng, Tomi Kinnunen, and Haizhou Li, "Vulnerability evaluation of speaker verification under voice conversion spoofing: the effect of text constraints," in Proc. Interspeech, 2013.
71. Jean-Francois Bonastre, Driss Matrouf, and Corinne Fredouille, "Artificial impostor voice transformation effects on false acceptance rates," in Proc. Interspeech, 2007.
72. Federico Alegre, Ravichander Vipperla, Nicholas Evans, and Benoit Fauve, "On the vulnerability of automatic speaker recognition to spoofing attacks with artificial signals," in Proc. European Signal Processing Conference (EUSIPCO), 2012.
73. Tomi Kinnunen, Z.-Z. Wu, Kong Aik Lee, Filip Sedlak, E.S. Chng, and Haizhou Li, "Vulnerability of speaker verification systems against voice conversion spoofing attacks: The case of telephone speech," in Proc. ICASSP, 2012.
74. Zvi Kons and Hagai Aronowitz, "Voice transformation-based spoofing of text-dependent speaker verification systems," in Proc. Interspeech, 2013.
75. Hagai Aronowitz, Ron Hoory, Jason Pelecanos, and David Nahamoo, "New developments in voice biometrics for user authentication," in Proc. Interspeech, 2011.
76. Anthony Larcher, Kong-Aik Lee, Bin Ma, and Haizhou Li, "RSR2015: Database for text-dependent speaker verification using multiple passphrases.," in Proc. Interspeech, 2012.
77. Driss Matrouf, J-F Bonastre, and Corinne Fredouille, "Effect of speech transformation on impostor acceptance," in Proc. ICASSP, 2006.
78. Zhizheng Wu, E.S. Chng, and Haizhou Li, "Detecting converted speech and natural speech for anti-spoofing attack in speaker recognition," in Proc. Interspeech, 2012.
79. Federico Alegre, Ravichander Vipperla, Nicholas Evans, et al., "Spoofing countermeasures for the protection of automatic speaker recognition systems against attacks with artificial signals," in Proc. Interspeech, 2012.
80. Zhizheng Wu, Xiong Xiao, E.S. Chng, and Haizhou Li, "Synthetic speech detection using temporal modulation feature," in Proc. ICASSP, 2013.
81. Federico Alegre, Asmaa Amehraye, and Nicholas Evans, "Spoofing countermeasures to protect automatic speker verification from voice conversion," in Proc. ICASSP, 2013.