Anti-spoofing for text-independent speaker verification: An initial database, comparison of countermeasures, and human performance

IEEE/ACM Transactions on Audio Speech and Language Processing

Volumn 24, Issue 4, 2016, Pages 768-783

  Wu, Zhizheng ^a   De Leon, Phillip L ^b   Demiroglu, Cenk ^c   Khodabakhsh, Ali ^c   King, Simon ^a   Ling, Zhen Hua ^d   Saito, Daisuke ^e   Stewart, Bryan ^b   Toda, Tomoki ^f   Wester, Mirjam ^a   Yamagish, Junichi ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

^b Horeshoe Cir Jett Hall   (United States)

^c OZYEGIN UNIVERSITY   (Turkey)

^d UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

^e UNIVERSITY OF TOKYO   (Japan)

^f NAGOYA UNIVERSITY   (Japan)

Author keywords

Anti spoofing; Countermeasure; Security; Speaker verification; Speech synthesis; Spoofing attack; Voice conversion

Indexed keywords

BENCHMARKING; SPEECH PROCESSING; SPEECH SYNTHESIS;

ANTI-SPOOFING; COUNTERMEASURE; SECURITY; SPEAKER VERIFICATION; SPOOFING ATTACKS; VOICE CONVERSION;

SPEECH RECOGNITION;

EID: 84962901047     PISSN: 23299290     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASLP.2016.2526653     Document Type: Article

References (78)

1. Z. Wu et al., "SAS: A speaker verification spoofing database containing diverse attacks, " in Proc. IEEE Int. Conf. Acoust. Speech Signal Process. (ICASSP), 2015.
2. M. Wester, Z. Wu, and J. Yamagishi, "Human vs machine spoofing detection on wideband and narrowband data, " in Proc. Interspeech, 2015.
3. P. Golden, "Voice biometrics-The Asia Pacific experience, " Biom. Technol. Today, vol. 2012, no. 4, pp. 10-11, 2012.
4. M. Khitrov, "Talking passwords: Voice biometrics for data access and security, " Biom. Technol. Today, vol. 2013, no. 2, pp. 9-11, 2013.
5. B. Beranek, "Voice biometrics: Success stories, success factors and what's next, " Biom. Technol. Today, vol. 2013, no. 7, pp. 9-11, 2013.
6. K. A. Lee, B. Ma, and H. Li, "Speaker verification makes its debut in smartphone, " in Proc. IEEE Signal Process. Soc. Speech Lang. Tech. Committee Newsl., Feb. 2013.
7. W. Meng, D. Wong, S. Furnell, and J. Zhou, "Surveying the development of biometric user authentication on mobile phones, " IEEE Commun. Surv. Tuts., vol. 17, no. 3, pp. 1268-1293, 3rd Quart. 2015.
8. Z. Wu, N. Evans, T. Kinnunen, J. Yamagishi, F. Alegre, and H. Li, "Spoofing and countermeasures for speaker verification: A survey, " Speech Commun., vol. 66, pp. 130-153, 2015.
9. Y.W. Lau, M. Wagner, and D. Tran, "Vulnerability of speaker verification to voice mimicking, " in Proc. Int. Symp. Intell. Multimedia, Video Speech Process., 2004.
10. R. G. Hautamäki, T. Kinnunen, V. Hautamäki, T. Leino, and A.- M. Laukkanen, "I-vectors meet imitators: On vulnerability of speaker verification systems against voice mimicry, " in Proc. Interspeech, 2013.
11. R. G. Hautamäki, T. Kinnunen, V. Hautamäki, and A.-M. Laukkanen, "Automatic versus human speaker verification: The case of voice mimicry, " Speech Commun., vol. 72, pp. 13-31, 2015.
12. J. Villalba and E. Lleida, "Preventing replay attacks on speaker verification systems, " in Proc. IEEE Int. Carnahan Conf. Secur. Technol. (ICCST), 2011.
13. Z. Wu, S. Gao, E. S. Chng, and H. Li, "A study on replay attack and anti-spoofing for text-dependent speaker verification, " in Proc. Asia-Pac. Signal Inf. Process. Assoc. Annu. Summit Conf. (APSIPA ASC), 2014.
14. Z. Wu and H. Li, "On the study of replay and voice conversion attacks to text-dependent speaker verification, " Multimedia Tools Appl., 2015, doi:10.1007/s11042-015-3080-9.
15. P. L. De Leon, M. Pucher, and J. Yamagishi, "Evaluation of the vulnerability of speaker verification to synthetic speech, " in Proc. Odyssey: Speaker Lang. Recognit. Workshop, 2010.
16. P. L. De Leon, M. Pucher, J. Yamagishi, I. Hernaez, and I. Saratxaga, "Evaluation of speaker verification security and detection of HMM-based synthetic speech, " IEEE Trans. Audio Speech Lang. Process., vol. 20, no. 8, pp. 2280-2290, Oct. 2012.
17. J.-F. Bonastre, D. Matrouf, and C. Fredouille, "Artificial impostor voice transformation effects on false acceptance rates, " in Proc. Interspeech, 2007.
18. T. Kinnunen, Z.-Z. Wu, K. A. Lee, F. Sedlak, E. S. Chng, and H. Li, "Vulnerability of speaker verification systems against voice conversion spoofing attacks: The case of telephone speech, " in Proc. IEEE Int. Conf. Acoust. Speech Signal Process. (ICASSP), 2012.
19. Z. Wu, T. Kinnunen, E. S. Chng, H. Li, and E. Ambikairajah, "A study on spoofing attack in state-of-the-art speaker verification: The telephone speech case, " in Proc. Asia-Pac. Signal Inf. Process. Assoc. Annu. Summit Conf. (APSIPA ASC), 2012.
20. Z. Kons and H. Aronowitz, "Voice transformation-based spoofing of text dependent speaker verification systems, " in Proc. Interspeech, 2013.
21. Z. Wu and H. Li, "Voice conversion versus speaker verification: An overview, " APSIPA Trans. Signal Inf. Process., vol. 3, p. e17, 2014.
22. T. Masuko, T. Hitotsumatsu, K. Tokuda, and T. Kobayashi, "On the security of HMM-based speaker verification systems against imposture using synthetic speech, " in Proc. Eur. Conf. Speech Commun. Technol. (Eurospeech), 1999.
23. T. Masuko, K. Tokuda, and T. Kobayashi, "Imposture using synthetic speech against speaker verification based on spectrum and pitch, " in Proc. Interspeech, 2000.
24. D. B. Paul and J. M. Baker, "The design for the wall street journal-based CSR corpus, " in Proc. Workshop Speech Nat. Lang., 1992, pp. 357-362.
25. B. L. Pellom and J. H. Hansen, "An experimental study of speaker verification sensitivity to computer voice-altered imposters, " in Proc. IEEE Int. Conf. Acoust. Speech Signal Process. (ICASSP), 1999.
26. P. Perrot, G. Aversano, R. Blouet, M. Charbit, and G. Chollet, "Voice forgery using ALISP: Indexation in a client memory, " in Proc. IEEE Int. Conf. Acoust. Speech Signal Process. (ICASSP), 2005.
27. D. Matrouf, J.-F. Bonastre, and C. Fredouille, "Effect of speech transformation on impostor acceptance, " in Proc. IEEE Int. Conf. Acoust. Speech Signal Process. (ICASSP), 2006.
28. T. Satoh, T. Masuko, T. Kobayashi, and K. Tokuda, "A robust speaker verification system against imposture using an HMM-based speech synthesis system, " in Proc. Eur. Conf. Speech Commun. Technol. (Eurospeech), 2001.
29. P. L. De Leon, B. Stewart, and J. Yamagishi, "Synthetic speech discrimination using pitch pattern statistics derived from image analysis, " in Proc. Interspeech, 2012.
30. R. D. McClanahan, B. Stewart, and P. L. De Leon, "Performance of Ivector speaker verification and the detection of synthetic speech, " in Proc. IEEE Int. Conf. Acoust. Speech Signal Process. (ICASSP), 2014.
31. Z. Wu, X. Xiao, E. S. Chng, and H. Li, "Synthetic speech detection using temporal modulation feature, " in Proc. IEEE Int. Conf. Acoust. Speech Signal Process. (ICASSP), 2013.
32. T. Ahonen, A. Hadid, and M. Pietikainen, "Face description with local binary patterns: Application to face recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 12, pp. 2037-2041, Dec. 2006.
33. F. Alegre, R. Vipperla, A. Amehraye, and N. Evans, "A new speaker verification spoofing countermeasure based on local binary patterns, " in Proc. Interspeech, 2013.
34. F. Alegre, A. Amehraye, and N. Evans, "A one-class classification approach to generalised speaker verification spoofing countermeasures using local binary patterns, " in Proc. Int. Conf. Biom.: Theory Appl. Syst. (BTAS), 2013.
35. Z. Wu, E. S. Chng, and H. Li, "Detecting converted speech and natural speech for anti-spoofing attack in speaker recognition, " in Proc. Interspeech, 2012.
36. J. Sanchez, I. Saratxaga, I. Hernaez, E. Navas, and D. Erro, "A crossvocoder study of speaker independent synthetic speech detection using phase information, " in Proc. Interspeech, 2014.
37. J. Sanchez, I. Saratxaga, I. Hernaez, E. Navas, D. Erro, and T. Raitio, "Toward a universal synthetic speech spoofing detection using phase information, " IEEE Trans. Inf. Forensics Secur., vol. 10, no. 4, pp. 810- 820, Apr. 2015.
38. F. Alegre, A. Amehraye, and N. Evans, "Spoofing countermeasures to protect automatic speaker verification from voice conversion, " in Proc. IEEE Int. Conf. Acoust. Speech Signal Process. (ICASSP), 2013.
39. E. Khoury, T. Kinnunen, A. Sizov, Z. Wu, and S. Marcel, "Introducing I-vectors for joint anti-spoofing and speaker verification, " in Proc. Interspeech, 2014.
40. A. Sizov, E. Khoury, T. Kinnunen, Z. Wu, and S. Marcel, "Joint speaker verification and antispoofing in the I-vector space, " IEEE Trans. Inf. Forensics Secur., vol. 10, no. 4, pp. 821-832, Apr. 2015.
41. Z. Wu, T. Kinnunen, N. Evans, and J. Yamagishi. (2014). ASVspoof 2015: Automatic Speaker Verification Spoofing and Countermeasures Challenge Evaluation Plan [Online]. Available: http://www.zhizheng.org/papers/asvSpoof-eval-plan.pdf.
42. Z. Wu et al., "ASVs poof 2015: The first automatic speaker verification spoofing and countermeasures challenge, " in Proc. Interspeech, 2015.
43. C. S. Greenberg et al., "Human assisted speaker recognition in NIST SRE10." in Proc. Odyssey: Speaker Lang. Recognit. Workshop, 2010.
44. H. Zen, K. Tokuda, and A. W. Black, "Statistical parametric speech synthesis, " Speech Commun., vol. 51, no. 11, pp. 1039-1064, 2009.
45. H. Kawahara, I. Masuda-Katsuse, and A. Cheveigné, "Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based F0 extraction: Possible role of a repetitive structure in sounds, " Speech Commun., vol. 27, pp. 187-207, 1999.
46. J. Yamagishi and O. Watts, "The CSTR/EMIME HTS system for blizzard challenge 2010, " in Proc. Blizzard Challenge, Kyoto, Japan, Sep. 2010.
47. S. Watanabe, A. Nakamura, and B.-H. Juang, "Structural Bayesian linear regression for hidden Markov models, " J. Signal Process. Syst., vol. 74, no. 3, pp. 341-358, 2014.
48. T. Toda and K. Tokuda, "A speech parameter generation algorithm considering global variance for HMM-based speech synthesis, " IEICE Trans. Inf. Syst., vol. E90-D, no. 5, pp. 816-824, May 2007.
49. E. Moulines and F. Charpentier, "Pitch-synchronous waveform processing techniques for text-to-speech synthesis using diphones, " Speech Commun., vol. 9, no. 5-6, pp. 453-468, 1990.
50. T. Fukada, K. Tokuda, T. Kobayashi, and S. Imai, "An adaptive algorithm for Mel-cepstral analysis of speech, " in Proc. IEEE Int. Conf. Acoust. Speech Signal Process. (ICASSP), Mar. 1992, pp. 137-140.
51. J. Yamagishi and S. King, "Simple methods for improving speakersimilarity of HMM-based speech synthesis, " in Proc. IEEE Int. Conf. Acoust. Speech Signal Process. (ICASSP), 2010.
52. M. Schröder and J. Trouvain, "The German text-to-speech synthesis system MARY: A tool for research, development and teaching, " Int. J. Speech Technol., vol. 6, no. 4, pp. 365-377, 2003.
53. K. Tokuda, T. Kobayashi, T. Masuko, and S. Imai, "Mel-generalized cepstral analysis-a unified approach to speech spectral estimation, " in Proc. Int. Conf. Spoken Lang. Process. (ICSLP), 1994.
54. Y. Ohtani, T. Toda, H. Saruwatari, and K. Shikano, "Non-parallel training for many-to-many eigenvoice conversion, " in Proc. IEEE Int. Conf. Acoust. Speech Signal Process. (ICASSP), 2010, pp. 4822-4825.
55. A. Kurematsu, K. Takeda, Y. Sagisaka, H. Katagiri, S. Kuwabara, and K. Shikano, "ATR Japanese speech database as a tool of speech recognition and synthesis, " Speech Commun., vol. 9, pp. 357-363, 1990.
56. D. Saito, N. Minematsu, and K. Hirose, "Effects of speaker adaptive training on tensor-based arbitrary speaker conversion, " in Proc. Interspeech, 2012.
57. T. Toda, A. W. Black, and K. Tokuda, "Voice conversion based on maximum-likelihood estimation of spectral parameter trajectory, " IEEE Trans. Audio Speech Lang. Process., vol. 15, no. 8, pp. 2222-2235, Nov. 2007.
58. Z. Wu, T. Virtanen, T. Kinnunen, E. S. Chng, and H. Li, "Exemplarbased unit selection for voice conversion utilizing temporal information, " in Proc. Interspeech, 2013.
59. T. Toda, T. Muramatsu, and H. Banno, "Implementation of computationally efficient real-time voice conversion, " in Proc. Interspeech, 2012.
60. E. Helander, H. Silén, T. Virtanen, and M. Gabbouj, "Voice conversion using dynamic kernel partial least squares regression, " IEEE Trans. Audio Speech Lang. Process., vol. 20, no. 3, pp. 806-817, 2012.
61. D. A. Reynolds, T. F. Quatieri, and R. B. Dunn, "Speaker verification using adapted Gaussian mixture models, " Digit. Signal Process., vol. 10, no. 1, pp. 19-41, 2000.
62. P. Kenny, G. Boulianne, P. Ouellet, and P. Dumouchel, "Joint factor analysis versus eigenchannels in speaker recognition, " IEEE Trans. Audio Speech Lang. Process., vol. 15, no. 4, pp. 1435-1447, May 2007.
63. P. Li, Y. Fu, U. Mohammed, J. H. Elder, and S. J. Prince, "Probabilistic models for inference about identity, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 1, pp. 144-157, Jan. 2012.
64. G. Gravier, M. Betser, and M. Ben, "AudioSeg: Audio segmentation toolkit, release 1.2, " IRISA, France, Jan. 2010.
65. S. O. Sadjadi, M. Slaney, and L. Heck, "MSR identity toolbox v1. 0: A MATLAB toolbox for speaker recognition research, " in Proc. IEEE Signal Process. Soc. Speech Lang. Tech. Committee Newsl., November 2013.
66. P. Rajan, A. Afanasyev, V. Hautamäki, and T. Kinnunen, "From single to multiple enrollment I-vectors: Practical PLDA scoring variants for speaker verification, " Digit. Signal Process., vol. 31, pp. 93-101, 2014.
67. K. K. Paliwal and L. D. Alsteris, "Usefulness of phase spectrum in human speech perception, " in Proc. Interspeech, 2003.
68. R. M. Hegde et al., "Significance of the modified group delay feature in speech recognition, " IEEE Trans. Audio Speech Lang. Process., vol. 15, no. 1, pp. 190-202, Jan. 2007.
69. P. Rajan, S. H. K. Parthasarathi, and H. A. Murthy, "Robustness of phase based features for speaker recognition, " in Proc. Interspeech, 2009.
70. C.-C. Chang and C.-J. Lin, "LIBSVM: A library for support vector machines, " ACM Trans. Intell. Syst. Technol. (TIST), vol. 2, no. 3, p. 27, 2011.
71. P. Taylor, Text-to-Speech Synthesis. Cambridge, U.K.: Cambridge Univ. Press, 2009.
72. A. Ogihara, H. Unno, and A. Shiozakai, "Discrimination method of synthetic speech using pitch frequency against synthetic speech falsification, " IEICE Trans. Fundam. Electron. Commun. Comput. Sci., vol. 88, no. 1, pp. 280-286, Jan. 2005.
73. N. Brummer et al., "Fusion of heterogeneous speaker recognition systems in the STBU submission for the NIST speaker recognition evaluation 2006, " IEEE Trans. Audio Speech Lang. Process., vol. 15, no. 7, pp. 2072-2084, Sep. 2007.
74. V. Hautamaki, T. Kinnunen, F. Sedlák, K. A. Lee, B. Ma, and H. Li, "Sparse classifier fusion for speaker verification, " IEEE Trans. Audio Speech Lang. Process., vol. 21, no. 8, pp. 1622-1631, Aug. 2013.
75. A. Schmidt-Nielsen and T. H. Crystal, "Speaker verification by human listeners: Experiments comparing human and machine performance using the NIST 1998 speaker evaluation data, " Digit. Signal Process., vol. 10, no. 1, pp. 249-266, 2000.
76. V. Hautamäki, T. Kinnunen, M. Nosratighods, K. A. Lee, B. Ma, and H. Li, "Approaching human listener accuracy with modern speaker verification, " in Proc. Interspeech, 2010.
77. Y. Pantazis, Y. Stylianou, and E. Klabbers, "Discontinuity detection in concatenated speech synthesis based on nonlinear speech analysis, " in Proc. Interspeech, 2005.
78. Z. Wu et al. (2015). Spoofing and Anti-Spoofing (SAS) corpus v1.0 [Online]. Available: http://dx.doi.org/10.7488/ds/252.