Unsupervised methods for speaker diarization: An integrated and iterative approach

IEEE Transactions on Audio, Speech and Language Processing

Volumn 21, Issue 10, 2013, Pages 2015-2028

  Shum, Stephen H ^a   Dehak, Najim ^a   Dehak, Reda ^b   Glass, James R ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b EPITA RESEARCH AND DEVELOPMENT LABORATORY LRDE   (France)

Author keywords

Bayesian nonparametric inference; factor analysis; HDP HMM; i vectors; principal component analysis; speaker clustering; speaker diarization; spectral clustering; variational Bayes

Indexed keywords

HDP-HMM; I-VECTORS; NONPARAMETRIC INFERENCE; SPEAKER CLUSTERING; SPEAKER DIARIZATION; SPECTRAL CLUSTERING; VARIATIONAL BAYES;

FACTOR ANALYSIS; IMAGE SEGMENTATION; MULTIVARIANT ANALYSIS; PRINCIPAL COMPONENT ANALYSIS;

ITERATIVE METHODS;

EID: 84881068970     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2013.2264673     Document Type: Article

References (42)

1. S. Tranter and D. Reynolds, "An overview of automatic speaker diarisation systems," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 5, pp. 1557-1565, Sep. 2006. (Pubitemid 46547580)
2. M. H. Moattar and M. M. Homayounpour, "A review on speaker diarization systems and approaches," Speech Commun., vol. 54, no. 10, pp. 1065-1103, 2012.
3. X. Anguera, S. Bozonnet, N. Evans, C. Fredouille, G. Friedland, and O. Vinyals, "Speaker diarization: A review of recent research," IEEE Trans. Audio, Speech, Lang. Process., vol. 20, no. 2, pp. 356-370, Feb. 2012.
4. D. Reynolds and P. Torres-Carrasquillo, "The MIT Lincoln Laboratory RT-04F diarization systems: Applications to broadcast audio and telephone conversations," in Proc. NIST Rich Transcript. Workshop, 2004.
5. F. Valente, "Variational Bayesian methods for audio indexing," Ph.D. dissertation, Univ. De Nice-Sophia Antipolis - UFR Sciences, Nice, France, Sep. 2005.
6. X. Anguera, C. Wooters, and J. M. Pardo, "Robust speaker diarization for meetings: ICSI RT06's evaluation system," in Proc. ICSLP, 2006.
7. T. H. Nguyen, H. Sun, S. Zhao, S. Z. K. Khine, H. D. Tran, T. L. N. Ma, B. Ma, E. S. Chng, and H. Li, "The IIR-NTU speaker diarization systems for rt 2009," in Proc. RT'09, NIST Rich Transcript.Workshop, 2009.
8. S. Meignier, D. Moraru, C. Fredouille, J.-F. Bonastre, and L. Besacier, "Step-by-step and integrated approaches in broadcast news speaker diarization," Comput. Speech Lang., vol. 20, no. 2, pp. 303-330, Jul. 2006. (Pubitemid 41787540)
9. S. Bozonnet,N.W.D. Evans, and C. Fredouille, "The LIA-EURECOM RT'09 speaker diarization system: Enhancements in speaker modeling and cluster purification," in Proc. ICASSP, 2010, pp. 4958-4961.
10. E. B. Fox, E. B. Sudderth, M. I. Jordan, and A. S. Willsky, "A sticky HDP-HMM with application to speaker diarization," Ann. Appl. Statist., vol. 5, no. 2A, pp. 1020-1056, Jun. 2011.
11. M. Johnson and A.Willsky, "The hierarchical dirichlet process hidden semi-markov model," in Proc. Conf. Uncert. Artif. Intell., 2010.
12. D. Blei andM. Jordan, "Variational inference for dirichlet processmixtures," Bayesian Anal., vol. 1, no. 1, pp. 121-144, 2006.
13. P. Kenny, D. Reynolds, and F. Castaldo, "Diarization of telephone conversations using factor analysis," IEEE J. Sel. Topics Signal Process., vol. 4, no. 6, pp. 1059-1070, Dec. 2010.
14. F. Castaldo, D. Colibro, E. Dalmasso, P. Laface, and C. Vair, "Streambased speaker segmentation using speaker factors and eigenvoices," in Proc. ICASSP, 2008, pp. 4133-4136.
15. S. Shum, N. Dehak, E. Chuangsuwanich, D. Reynolds, and J. Glass, "Exploiting intra-conversation variability for speaker diarization," in Proc. Interspeech, 2011.
16. N. Dehak, P. Kenny, R. Dehak, P. Dumouchel, and P. Ouellet, "Front-end factor analysis for speaker verification," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 4, pp. 788-798, Jul. 2010.
17. S. Shum, N. Dehak, R. Dehak, and J. Glass, "Unsupervised speaker adaptation based on the cosine similarity for text-independent speaker verification," in Proc. IEEE Odyssey, 2010.
18. S. Shum, N. Dehak, and J. Glass, "On the use of spectral and iterative methods for speaker diarization," in Proc. Interspeech, 2012.
19. H. Ning, M. Liu, H. Tang, and T. Huang, "A spectral clustering approach to speaker diarization," in Proc. ICSLP, 2006.
20. S. Shum, "Unsupervised methods for speaker diarization,"M.S. thesis, Mass. Inst. of Technol., Cambridge, MA, USA, Jun. 2011.
21. C. Vaquero, A. Ortega, and E. Lleida, "Intra-session variability compensation and a hypothesis generation and selection strategy for speaker segmentation," in Proc. ICASSP, 2011, pp. 4532-4535.
22. D. Wang, R. Vogt, S. Sridharan, and D. Dean, "Cross likelihood ratio based speaker clustering using eigenvoice models," in Proc. Interspeech, 2011.
23. J. Prazak and J. Silovsky, "Speaker diarization using PLDA-based speaker clustering," in Proc. IDAACS, 2011.
24. M. Rouvier and S. Meignier, "A global optimization framework for speaker diarization," in Proc. IEEE Odyssey, 2012.
25. T. Stafylakis, V. Katsouros, P. Kenny, and P. Dumouchel, "Mean shift algorithm for exponential families with applications to speaker clustering," in Proc. IEEE Odyssey, 2012.
26. P. Kenny, G. Boulianne, and P. Dumouchel, "Eigenvoice modeling with sparse training data," IEEE Trans. Speech Audio Process., vol. 13, no. 3, pp. 345-354, May 2005. (Pubitemid 40666169)
27. P. Kenny, G. Boulianne, P. Ouellet, and P. Dumouchel, "Speaker and session variability in GMM-based speaker verification," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 4, pp. 1448-1460,May 2007.
28. J. Pelecanos and S. Sridharan, "Feature warping for robust speaker verification," in Proc. A Speaker Odyssey, 2001.
29. D. Reynolds, T. Quatieri, and R. Dunn, "Speaker verification using adapted gaussian mixture models," Digital Signal Process., vol. 10, no. 1-3, pp. 19-41, 2000. (Pubitemid 30592166)
30. Diarization Error Rate (DER) Scoring Code. NIST, 2006 [Online]. Available: www.nist.gov/speech/tests/rt/2006-spring/code/md-evalv21. pl
31. C. Bishop, Pattern Recognition and Machine Learning. NewYork, NY, USA: Springer, 2006.
32. M. Beal, "Variational algorithms for approximate Bayesian inference," Ph.D. dissertation, Univ. College London, London, U.K., May 2003.
33. A. Ng, M. Jordan, and Y.Weiss, "On spectral clustering: Analysis and an algorithm," in Proc. NIPS, 2001.
34. J. Ajmera and C. Wooters, "A robust speaker clustering algorithm," in Proc. ASRU, 2003.
35. A. Martin and M. Przybocki, "Speaker recognition in a multi-speaker environment," in Proc. Eurospeech, 2001.
36. E. Khan, J. Bronson, and K. Murphy, Variational Bayesian EM for Gaussian Mixture Models. 2008 [Online]. Available: http://www.cs. ubc.ca/~murphyk/ Software/VBEMGMM/index.html
37. M. J. Johnson, PYHSMM: A Python Library for Bayesian Inference in (HDP-)H(S)MMS. 2010 [Online]. Available: http://mattjj.github.com/ pyhsmm/
38. D. Lin, E. Grimson, and J. Fisher, "Construction of dependent Dirichlet processes based on Poisson processes," in Proc. NIPS, 2010.
39. W. Johnson and J. Lindenstrauss, "Extensions of Lipschitz mappings into a Hilbert space," Contemp. Math., vol. 26, pp. 189-206, 1984.
40. H. Xu, C. Caramanis, and S. Mannor, "Principal component analysis with contaminated data: The high dimensional case," in Proc. COLT, 2010.
41. L. van der Maaten and G. Hinton, "Visualizing data using t-sne," J. Mach. Learn. Res., vol. 9, pp. 2579-2605, Nov. 2008.
42. N. Dehak, Z. N. Karam, D. A. Reynolds, R. Dehak, W. M. Campbell, and J. R. Glass, "A channel-blind system for speaker verification," in Proc. ICASSP, 2011, pp. 4536-4539.