An overview of automatic speaker diarization systems

IEEE Transactions on Audio, Speech and Language Processing

Volumn 14, Issue 5, 2006, Pages 1557-1565

  Tranter, Sue E ^a,b   Reynolds, Douglas A ^a,c  

^a IEEE   (United Kingdom)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^c MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Speaker diarization; Speaker segmentation and clustering

Indexed keywords

INPUT AUDIO CHANNELS; SIGNAL ENERGY; SPEAKER DIARIZATION; SPEAKER SEGMENTATION AND CLUSTERING;

ACOUSTIC NOISE; BROADCASTING; COMMUNICATION CHANNELS (INFORMATION THEORY); INFORMATION ANALYSIS; SPEECH RECOGNITION;

SPEECH PROCESSING;

EID: 34047261805     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2006.878256     Document Type: Review

References (58)

1. D. A. Reynolds and P. Torres-Carrasquillo, "Approaches and applications of audio diarization," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., vol. V, Philadelphia, PA, Mar. 2005, pp. 953-956.
2. J. Saunders, "Real-time discrimination of broadcast speech/music," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., vol. II, Atlanta, GA, May 1996, pp. 993-996.
3. Z. Liu, Y. Wang, and T. Chen, "Audio feature extraction and analysis for scene segmentation and classification," J. VLSI Signal Process. Syst., vol. 20, no. 1-2, pp. 61-79, Oct. 1998.
4. S. E. Johnson and P. C. Woodland, "A method for direct audio search with applications to indexing and retrieval," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., vol. 3, Istanbul, Turkey, Jun. 2000, pp. 1427-1430.
5. Y. Moh, P. Nguyen, and J.-C. Junqua, "Toward domain independent clustering," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., vol. II, China, Apr. 2003, pp. 85-88.
6. X. Anguera, C. Wooters, B. Peskin, and M. Aguiló, "Robust speaker segmentation for meetings: The ICSI-SRI Spring 2005 Diarization System," in Proc. Machine Learning for Multimodal Interaction Workshop (MLMI), Edinburgh, U.K., Jul. 2005, pp. 402-414.
7. Benchmark Tests: Rich Transcription (RT). NIST. [Online]. Available: http://www.nist.gov/speech/tests/rt/
8. Benchmark Tests: Speaker Recognition. NIST. [Online]. Available: http://www.nist.gov/speech/tests/spk/
9. A. Martin and M. Przybocki, "Speaker recognition in a multi-speaker environment," in Proc. Eur. Conf. Speech Commun. Technol., vol. 2, Aalborg, Denmark, Sep. 2001, pp. 787-790.
10. D. Moraru, L. Besacier, and E. Castelli, "Using a-priori information for speaker diarization," in Proc. Odyssey Speaker and Language Recognition Workshop, Toledo, Spain, May 2004, pp. 355-362.
11. C. Wooters, J. Fung, B. Peskin, and X. Anguera, "Toward Robust speaker segmentation: The ICSI-SRI Fall 2004 Diarization System," in Proc. Fall 2004 Rich Transcription Workshop (RT-04), Palisades, NY, Nov. 2004, [Online]. Available: http://www.icsi.berkeley.edu/cgi-bin/pubs/ publication.pl?ID=000100.
12. P. Nguyen, L. Rigazio, Y. Moh, and J. C. Junqua. Rich transcription 2002 site report. Panasonic speech technology laboratory (PSTL). presented at Proc. Rich Transcription Workshop (RT-02). [Online]. Available: http://www.nist.gov/speech/tests/rt/rt2002/presentations/rt02.pdf
13. J.-L. Gauvain, L. Lamel, and G. Adda, "Partitioning and transcription of broadcast news data," in Proc. Int. Conf. Spoken Lang. Process., vol. 4, Sydney, Australia, Dec. 1998, pp. 1335-1338.
14. X. Zhu, C. Barras, S. Meignier, and J.-L. Gauvain, "Combining speaker identification and BIC for speaker diarization," in Proc. Eur. Conf. Speech Commun. Technol., Lisbon, Portugal, Sep. 2005, pp. 2441-2444.
15. D. A. Reynolds and P. Torres-Carrasquillo, "The MIT Lincoln Laboratory RT-04F diarization systems: Applications to broadcast audio and telephone conversations," in Proc. Fall 2004 Rich Transcription Workshop (RT-04), Palisades, NY, Nov. 2004.
16. T. Hain, S. E. Johnson, A. Tuerk, P. C. Woodland, and S. J. Young. Segment generation and clustering in the HTK broadcast news transcription system, presented at Proc. 1998 DARPA Broadcast News Transcription and Understanding Workshop. [Online]. Available: http://mi.eng.cam.ac.uk/ reports/abstracts/hain_darpa98.html
17. R. Sinha, S. E. Tranter, M. J. F. Gales, and P. C. Woodland, "The Cambridge University March 2005 speaker diarization system," in Proc. Eur. Conf. Speech Commun. Technol., Lisbon, Portugal, Sep. 2005, pp. 2437-2440.
18. D. Liu and F. Kubala, "Fast speaker change detection for broadcast news transcription and indexing," in Proc. Eur. Conf. Speech Commun. Technol., vol. III, Budapest, Hungary, Sep. 1999, pp. 1031-1034.
19. S. Meignier, D. Moraru, C. Fredouille, J.-F. Bonastre, and L. Besacier, "Step-by-Step and integrated approaches in broadcast news speaker diarization," Comput. Speech Lang., no. 20, pp. 303-330, Sep. 2005, to be published.
20. S. E. Tranter and D. A. Reynolds, "Speaker diarization for broadcast news," in Proc. Odyssey Speaker and Language Recognition Workshop, Toledo, Spain, Jun. 2004, pp. 337-344.
21. S. E. Tranter, K. Yu, G. Evermann, and P. C. Woodland, "Generating and evaluating segmentations for automatic speech recognition of conversational telephone speech," in Proc. ICASSP, vol. I, Montreal, QC, Canada, May 2004, pp. 753-756.
22. D. Liu and F. Kubala, "A cross-channel modeling approach for automatic segmentation of conversational telephone speech," in Proc. IEEE ASRU Workshop, St. Thomas, U.S. Virgin Islands, Dec. 2003, pp. 333-338.
23. D. A. van Leeuwan, "The TNO speaker diarization system for NIST RT05s meeting data," in Proc. Machine Learning for Multimodal Interaction Workshop (MLMI), Edinburgh, UK, Jul. 2005, pp. 440-449.
24. D. Istrate, C. Fredouille, S. Meignier, L. Besacier, and J.-F. Bonastre, "NIST RT'05 evaluation: Preprocessing techniques and speaker diarization on multiple microphone meetings," in Proc. Machine Learning for Multimodal Interaction Workshop (MLMI), Edinburgh, U.K., Jul. 2005, pp. 428-439.
25. S. Cassidy, "The macquarie speaker diarization system for RT05s," in Proc. NIST Spring Rich Transcription Evaluation Workshop (RT-05s), Edinburgh, UK, Jul. 2005.
26. T. Pfau, D. Ellis, and A. Stolcke, "Multispeaker speech activity detection for the ICSI meeting recorder," in Proc. IEEE ASRU Workshop, Trento, Italy, Dec. 2001, pp. 107-110.
27. J. G. Fiscus, N. Radde, J. S. Garofolo, A. Le, J. Ajot, and C. Laprun, "The rich transcription 2005 spring meeting recogntion evaluation," in Proc. Machine Learning for Multimodal Interaction Workshop (MLMI), Edinburgh, UK, Jul. 2005, pp. 369-389.
28. S. S. Chen and P. S. Gopalakrishnam, "Speaker, environment and channel change detection and clustering via the bayesian information criterion," in Proc. 1998 DARPA Broadcast News Transcription and Understanding Workshop, Lansdowne, VA, 1998, pp. 127-132.
29. B. Zhou and J. Hansen, "Unsupervised audio stream segmentation and clustering via the Bayesian information criterion," in Proc. Int. Conf. Spoken Language Process., vol. 3, Beijing, China, Oct. 2000, pp. 714-717.
30. M. A. Siegler, U. Jain, B. Raj, and R. M. Stem, "Automatic segmentation, classification and clustering of broadcast news," in Proc. DARPA Speech Recognition Workshop, Chantilly, VA, Feb. 1997, pp. 97-99.
31. C. Barras, X. Zhu, S. Meignier, and J.-L. Gauvain, "Improving speaker diarization," in Proc. Fall Rich Transcription Workshop (RT-04), Palisades, NY, Nov. 2004, [Online]. Available: http://www.limsi.fr/ Individu/barras/publis/rt04f_diarization.pdf.
32. A. E. Rosenberg, A. Gorin, Z. Liu, and S. Parthasarathy, "Unsupervised speaker segmentation of telephone conversations," in Proc. Int. Conf. Spoken Language Process., Denver, CO, Sep. 2002, pp. 565-568.
33. S. Meignier, D. Moraru, C. Fredouille, L. Besacier, and J.-F. Bonastre, "Benefits of prior acoustic segmentation for automatic speaker segmentation," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., vol. I, Montreal, QC, Canada, May 2004, pp. 397-400.
34. D. Liu and F. Kubala, "Online speaker clustering," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., vol. I, Hong Kong, China, Apr. 2003, pp. 572-575.
35. D. Moraru, S. Meignier, L. Besacier, J.-F. Bonastre, and I. Magrin-Chagnolleau. The ELISA consortium approaches in speaker segmentation during the NIST 2002 speaker recognition evaluation, presented at Proc. IEEE Int. Conf. Acoust., Speech, Signal Process.. [Online]. Available: http://www.lia.univ-avignon.fr/fich.art/339-moricassp2003.pdf
36. M. Cettolo, "Segmentation, classification and clustering of an Italian corpus," in Proc. Recherche d'Information Assisté par Ordinateur (RIAO), Paris, France, Apr. 2000, [Online]. Available: http://munst.itc.it/people/cettolo/papers/riao00a.ps.gz.
37. J. Ajmera and C. Wooters, "A Robust Speaker Clustering Algorithm," in Proc. IEEE ASRU Workshop, St Thomas, U.S. Virgin Islands, Nov. 2003, pp. 411-416.
38. S. E. Tranter, M. J. F. Gales, R. Sinha, S. Umesh, and P. C. Woodland, "The development of the Cambridge University RT-04 diarization system," in Proc. Fall 2004 Rich Transcription Workshop (RT-04), Palisades, NY, Nov. 2004, [Online]. Available: http://mi.eng.cam.ac.uk/reports/ abstracts/tranter_rt04.html.
39. H. Jin, F. Kubala, and R. Schwartz, "Automatic speaker clustering," in Proc. DARPA Speech Recognition Workshop, Chantilly, VA, Feb. 1997, pp. 108-111.
40. M. Ben, M. Betser, F. Bimbot, and G. Gravier, "Speaker diarization using bottom-up clustering based on a parameter-derived distance between adapted GMMs," in Proc. Int. Conf. Spoken Language Processing, Jeju Island, Korea, Oct. 2004, pp. 2329-2332.
41. S. Meignier, J.-F. Bonastre, C. Fredouille, and T. Merlin, "Evolutive HMM for multispeaker tracking system," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., vol. II, Istanbul, Turkey, Jun. 2000, pp. 1201-1204.
42. S. Meignier, J.-F. Bonastre, and S. Igounet, "E-HMM approach for learning and adapting sound models for speaker indexing," in Proc. Odyssey Speaker and Language Recognition Workshop, Crete, Greece, Jun. 2001, pp. 175-180.
43. D. Reynolds, E. Singer, B. Carlson, J. O'Leary, J. McLaughlin, and M. Zissman, "Blind clustering of speech utterances based on speaker and language characteristics," in Proc. Int. Conf. Spoken Language Process., vol. 7, Sydney, Australia, Dec. 1998, pp. 3193-3196.
44. J. Pelecanos and S. Sridharan, "Feature warping for Robust speaker verification," in Proc. Odyssey Speaker and Language Recognition Workshop, Crete, Greece, Jun. 2001, pp. 213-218.
45. C. Barras and J.-L. Gauvain, "Feature and score normalization for speaker verification of cellular data," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., vol. II, Hong Kong, China, Apr. 2003, pp. 49-52.
46. L. Canseco-Rodriguez, L. Lamel, and J.-L. Gauvain, "Speaker Diarization from Speech Transcripts," in Proc. Int. Conf. Spoken Language Process., Jeju Island, Korea, Oct. 2004, pp. 1272-1275.
47. S. E. Tranter, "Who really spoke when? - Finding speaker turns and identities in audio," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., vol. I, Toulouse, France, May 2006, pp. 1013-1016.
48. M. J. F. Gales, D. Y. Kim, P. C. Woodland, H. Y. Chan, D. Mrva, R. Sinha, and S. E. Tranter, "Progress in the CU-HTK transcription system," IEEE Trans. Audio, Speech, Lang, Process., vol. 14, no. 5, pp. 1511-1523, Sep. 2006.
49. D. Moraru, S. Meignier, C. Fredouille, L. Besacier, and J.-F. Donastre, "The ELISA consortium approaches in speaker segmentation during the NIST 2003 Rich Transcription evaluation," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., vol. 1, Montreal, QC, Canada, May 2004, pp. 373-376.
50. S. E. Tranter, "Two-way cluster voting to improve speaker diarization performance," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., vol. I, Philadelphia, PA, Mar. 2005, pp. 753-756.
51. D. Liu, D. Kiecza, A. Srivastava, and F. Kubala, "Online speaker adaptation and tracking for real-time speech recognition," in Proc. Eur. Conf. Speech Commun. Technol., Lisbon, Portugal, Sep. 2005, pp. 281-284.
52. J. G. Fiscus, J. S. Garofolo, A. Le, A. F. Martin, D. S. Pallett, M. A. Przybocki, and G. Sanders, "Results of the fall 2004 STT and MDE evaluation," in Proc. Fall 2004 Rich Transcription Workshop (RT-04), Palisades, NY, Nov. 2004.
53. Q. Jin, K. Laskowski, T. Schultz, and A. Waibel, "Speaker segmentation and clustering in meetings," in Proc. ICASSP Meeting Recognition Workshop, Montreal, QC, Canada, May 2004, [Online]. Available: http://isl.ira.uka.de/publications/SchultzJin_NIST04.pdf.
54. D. Istrate, N. Scheffler, C. Fredouille, and J.-F. Bonastre, "Broadcast news speaker tracking for ESTER 2005 campaign," in Proc. Eur. Conf. Speech Commun. Technol., Lisbon, Portugal, Sep. 2005, pp. 2445-2448.
55. F. Kubala, S. Colbath, D. Liu, A. Srivastava, and J. Makhoul, "Integrated technologies for indexing spoken language," Commun. ACM, vol. 43, no. 2, pp. 48-56, Feb. 2000.
56. J. H. L. Hansen, R. Huang, B. Z. M. Seadle, J. J. R. Deller, A. R. Gurijala, M. Kurimo, and P. Angkititrakul, "Speechfind: Advances in spoken document retrieval for a national gallery of the spoken word," IEEE Trans. Speech Audio Process., vol. 13, no. 5, pp. 712-730, Sep. 2005.
57. J. F. Bonastre, F. Wils, and S. Meignier, "Alize: A free toolkit for speaker recogntion," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., vol. I, Philadelphia, PA, Mar. 2005, pp. 737-740.
58. D. Reynolds, W. Andrews, J. Campbell, J. Navratil, B. Peskin, A. Adami, Q. Jin, D. Klusacek, J. Abramson, R. Mihaescu, J. Godfrey, D. Jones, and B. Xiang, "The superSID project: Exploiting high-level information for high-accuracy speaker recognition," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., vol. IV, Hong Kong, China, Apr. 2003, pp. 784-787.