A sticky HDP-HMM with application to speaker diarization

Annals of Applied Statistics

Volumn 5, Issue 2 A, 2011, Pages 1020-1056

  Fox, Emily B ^a,b   Sudderth, Erik B ^a,b   Jordan, Michael I ^a,b   Willsky, Alan S ^a,b  

^a BROWN UNIVERSITY   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Bayesian nonparametrics; Hidden markov models; Hierarchical dirichlet processes; Speaker diarization

Indexed keywords

EID: 79952660404     PISSN: 19326157     EISSN: 19417330     Source Type: Journal    
DOI: 10.1214/10-AOAS395     Document Type: Article

References (39)

1. Barras, C., Zhu, X., Meignier, S. and Gauvain, J.-L. (2004). Improving speaker diarization. In Proc. Fall 2004 Rich Transcription Workshop (RT-04), November 2004.
2. Beal, M. J. and Krishnamurthy, P. (2006). Gene expression time course clustering with countably infinite hidden Markov models. In Proc. Conference on Uncertainty in Artificial Intelligence, Cambridge, MA.
3. Beal, M. J., Ghahramani, Z. and Rasmussen, C. E. (2002). The infinite hidden Markov model. In Advances in Neural Information Processing Systems 14 577-584. MIT Press, Cambridge, MA.
4. Blackwell, D. and MacQueen, J. B. (1973). Ferguson distributions via Pólya urn schemes. Ann. Statist. 1 353-355. Mathematical Reviews (MathSciNet): MR362614Digital Object Identifier: doi:10.1214/aos/1176342372Project Euclid: euclid.aos/1176342372
5. Chen, S. S. and Gopalakrishnam, P. S. (1998). Speaker, environment and channel change detection and clustering via the Bayesian information criterion. In Proc. DARPA Broadcast News Transcription and Understanding Workshop 127-132. Morgan Kaufmann, San Francisco, CA.
6. Ferguson, T. S. (1973). A Bayesian analysis of some nonparametric problems. Ann. Statist. 1 209-230. Mathematical Reviews (MathSciNet): MR350949Zentralblatt MATH: 0255.62037Digital Object Identifier: doi:10.1214/aos/1176342360Project Euclid: euclid.aos/1176342360
7. Fox, E. B., Sudderth, E. B., Jordan, M. I. and Willsky, A. S. (2008). An HDP-HMM for systems with state persistence. In Proc. International Conference on Machine Learning, Helsinki, Finland, July 2008.
8. Fox, E. B., Sudderth, E. B., Jordan, M. I. and Willsky, A. S. (2009). Nonparametric Bayesian learning of switching dynamical systems. In Advances in Neural Information Processing Systems 21 457-464.
9. Fox, E. B., Sudderth, E. B., Jordan, M. I. and Willsky, A. S. (2010). Supplement to "A sticky HDP-HMM with application to speaker diarization." DOI: 10.1214/10-AOAS395SUPP.
10. Gales, M. and Young, S. (2007). The Application of hidden Markov models in speech recognition. Foundations and Trends in Signal Processing 1 195-304.
11. Gauvain, J.-L., Lamel, L. and Adda, G. (1998). Partitioning and transcription of broadcast news data. In Proc. International Conference on Spoken Language Processing, Sydney, Australia 1335-1338.
12. Hoffman, M., Cook, P. and Blei, D. (2008). Data-driven recomposition using the hierarchical Dirichlet process hidden Markov model. In Proc. International Computer Music Conference, Belfast, UK.
13. Ishwaran, H. and Zarepour, M. (2000a). Markov chain Monte Carlo in approximate Dirichlet and beta two-parameter process hierarchical models. Biometrika 87 371-390. Mathematical Reviews (MathSciNet): MR1782485Zentralblatt MATH: 0949.62037Digital Object Identifier: doi:10.1093/biomet/87.2.371
14. Ishwaran, H. and Zarepour, M. (2002b). Dirichlet prior sieves in finite normal mixtures. Statist. Sinica 12 941-963. Mathematical Reviews (MathSciNet): MR1929973Zentralblatt MATH: 1002.62028
15. Ishwaran, H. and Zarepour, M. (2002c). Exact and approximate sum-representations for the Dirichlet process. Canad. J. Statist. 30 269-283. Mathematical Reviews (MathSciNet): MR1926065Digital Object Identifier: doi:10.2307/3315951
16. Jain, S. and Neal, R. M. (2004). A split-merge Markov chain Monte Carlo procedure for the dirichlet process mixture model. J. Comput. Graph. Statist. 13 158-182. Mathematical Reviews (MathSciNet): MR2044876Digital Object Identifier: doi:10.1198/1061860043001
17. Jasra, A., Holmes, C. C. and Stephens, D. A. (2005). Markov chain Monte Carlo methods and the label switching problem in Bayesian mixture modeling. Statist. Sci. 20 50-67. Mathematical Reviews (MathSciNet): MR2182987Digital Object Identifier: doi:10.1214/088342305000000016Project Euclid: euclid.ss/1118065042
18. Johnson, M. (2007). Why doesn't EM find good HMM POS-taggers. In Proc. Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, Prague, Czech Republic.
19. Kivinen, J. J., Sudderth, E. B. and Jordan, M. I. (2007). Learning multiscale representations of natural scenes using Dirichlet processes. In Proc. International Conference on Computer Vision, Rio de Janeiro, Brazil 1-8.
20. Kurihara, K., Welling, M. and Teh, Y. W. (2007). Collapsed variational Dirichlet process mixture models. In Proc. International Joint Conferences on Artificial Intelligence, Hyderabad, India.
21. Meignier, S., Bonastre, J.-F., Fredouille, C. and Merlin, T. (2000). Evolutive HMM for multi-speaker tracking system. In Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Istanbul, Turkey, June 2000.
22. Meignier, S., Bonastre, J.-F. and Igounet, S. (2001). E-HMM approach for learning and adapting sound models for speaker indexing. In Proc. Odyssey Speaker Language Recognition Workshop, June 2001.
23. Munkres, J. (1957). Algorithms for the assignment and transportation problems. J. Soc. Industr. Appl. Math. 5 32-38. Mathematical Reviews (MathSciNet): MR93429Digital Object Identifier: doi:10.1137/0105003
24. NIST. Rich transcriptions database. Available at http://www.nist.gov/speech/tests/rt/, 2007.
25. Papaspiliopoulos, O. and Roberts, G. O. (2008). Retrospective Markov chain Monte Carlo methods for Dirichlet process hierarchical models. Biometrika 95 169-186. Mathematical Reviews (MathSciNet): MR2409721Zentralblatt MATH: 05563385Digital Object Identifier: doi:10.1093/biomet/asm086
26. Rabiner, L. R. (1989). A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 77 257-286.
27. Reynolds, D. A. and Torres-Carrasquillo, P. A. (2004). The MIT Lincoln Laboratory RT-04F diarization systems: Applications to broadcast news and telephone conversations. In Proc. Fall 2004 Rich Transcription Workshop (RT-04), November 2004.
28. Robert, C. P. (2007). The Bayesian Choice. Springer, New York.Mathematical Reviews (MathSciNet): MR2723361
29. Rodriguez, A., Dunson, D. B. and Gelfand, A. E. (2008). The nested Dirichlet process. J. Amer. Statist. Assoc. 103 1131-1154. Mathematical Reviews (MathSciNet): MR2528831Zentralblatt MATH: 1205.62062Digital Object Identifier: doi:10.1198/016214508000000553
30. Scott, S. L. (2002). Bayesian methods for hidden Markov models: Recursive computing in the 21st century. J. Amer. Statist. Assoc. 97 337-351. Mathematical Reviews (MathSciNet): MR1963393Zentralblatt MATH: 1073.65503 Digital Object Identifier: doi:10.1198/016214502753479464
31. Sethuraman, J. (1994). A constructive definition of Dirichlet priors. Statist. Sinica 4 639-650. Mathematical Reviews (MathSciNet): MR1309433Zentralblatt MATH: 0823.62007
32. Siegler, M., Jain, U., Raj, B. and Stern, R. M. (1997). Automatic segmentation, classification and clustering of broadcast news audio. In Proc. DARPA Speech Recognition Workshop 97-99. Morgan Kaufmann, San Francisco, CA.
33. Teh, Y. W., Jordan, M. I., Beal, M. J. and Blei, D. M. (2006). Hierarchical Dirichlet processes. J. Amer. Statist. Assoc. 101 1566-1581. Mathematical Reviews (MathSciNet): MR2279480Zentralblatt MATH: 1171.62349Digital Object Identifier: doi:10.1198/016214506000000302
34. Tranter, S. E. and Reynolds, D. A. (2006). An overview of automatic speaker diarization systems. IEEE Trans. Audio, Speech Language Process. 14 1557-1565.
35. Van Gael, J., Saatci, Y., Teh, Y. W. and Ghahramani, Z. (2008). Beam sampling for the infinite hidden Markov model. In Proc. International Conference on Machine Learning, Helsinki, Finland, July 2008.
36. Walker, S. G. (2007). Sampling the Dirichlet mixture model with slices. Commun. Statist. Simul. Comput. 36 45-54. Mathematical Reviews (MathSciNet): MR2370888Zentralblatt MATH: 1113.62058Digital Object Identifier: doi:10.1080/03610910601096262
37. Wooters, C. and Huijbregts, M. (2007). The ICSI RT07s speaker diarization system. Lecture Notes in Computer Science 4625 509-519.
38. Wooters, C., Fung, J., Peskin, B. and Anguera, X. (2004). Towards robust speaker segmentation: The ICSI-SRI Fall 2004 diarization system. In Proc. Fall 2004 Rich Transcription Workshop (RT-04), November 2004.
39. Xing, E. P. and Sohn, K.-A. (2007). Hidden Markov Dirichlet process: Modeling genetic inference in open ancestral space. Bayesian Anal. 2 501-528. Mathematical Reviews (MathSciNet): MR2342173Digital Object Identifier: doi:10.1214/07-BA220