Cambridge university transcription systems for the multi-genre broadcast challenge

2015 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2015 - Proceedings

Volumn , Issue , 2016, Pages 639-646

  Woodland, P C ^a   Liu, X ^a   Qian, Y ^a   Zhang, C ^a   Gales, M J F ^a   Karanasou, P ^a   Lanchantin, P ^a   Wang, L ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

broadcast transcription; deep neural networks; HTK; Kaldi; Speech recognition

Indexed keywords

COMPUTATIONAL LINGUISTICS; RECURRENT NEURAL NETWORKS; TRANSCRIPTION;

ACTIVATION FUNCTIONS; CAMBRIDGE UNIVERSITY; COMBINED SYSTEM; DEEP NEURAL NETWORKS; JOINT DECODING; KALDI; LANGUAGE MODEL; SEGMENTATION SYSTEM;

SPEECH RECOGNITION;

EID: 84964475976     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ASRU.2015.7404856     Document Type: Conference Paper

References (55)

1. http://htk.eng.cam.ac.uk
2. O. Abdel-Hamid, A. Mohamed, H. Jiang, &G. Penn, "Applying convolutional neural networks concepts to hybrid NNHMM model for speech recognition", Proc. ICASSP, Kyoto, 2012
3. T. Anastasakos, J. McDonough, R. Schwartz, &J. Makhoul, "A compact model for speaker adaptive training", Proc. ICSLP, Philadelphia, 1996
4. P. Bell, M.J.F. Gales, T. Hain, J. Kilgour, P. Lanchantin, X. Liu, A. McParland, S. Renals, O. Saz, M.Wester &P.C.Woodland. "The MGB challenge: Evaluating multi-genre broadcast media transcription", Proc. ASRU Workshop, Scottsdale, 2015
5. Y. Bengio, P. Simard, &P. Frasconi, "Learning long-term dependencies with gradient descent is difficult", IEEE Transactions on Neural Networks, vol. 5, pp. 157-166, 1994
6. M. Bisani &H. Ney, "Joint-sequence models for graphemeto-phoneme conversion, Speech Communication, vol. 50, no. 5, 2008
7. D.M. Blei, A. Ng, &M.I. Jordan, "Latent Dirichlet allocation", Journal of Machine Learning Research, vol. 3, pp. 99-1022, 2003
8. H.Y. Chan &P.C.Woodland, "Improving broadcast news transcription by lightly supervised discriminative training", Proc. ICASSP, Montreal, 2004
9. X. Chen, Y. Wang, X. Liu, M.J.F. Gales, &P.C. Woodland, "Efficient GPU-based training of recurrent neural network language models using spliced sentence bunch", Proc. Interspeech, Singapore, 2014
10. X. Chen, T. Tan, X. Liu, P. Lanchantin, M.J.F. Gales &P.C. Woodland, "Recurrent Neural Network Language Model Adaptation for Multi-Genre Broadcast Speech Recognition", Proc. Interspeech, Dresden, 2015
11. G. Evermann &P.C. Woodland, "Posterior probability decoding, confidence estimation and system combination", Proc. Speech Transcription Workshop, College Park, MD, 2000
12. J. Fiscus, "A post-processing system to yield reduced word error rates: recogniser output voting error reduction (ROVER), iProc. ASRU Workshop, Santa Barbara, 1997
13. M.J.F. Gales, "Maximum likelihood linear transformations for HMM-based speech recognition", Computer Speech and Langauge, vol. 12, pp. 75-98, 1997
14. M.J.F. Gales, "Semi-tied covariance matrices for hidden Markov models", IEEE Transactions on Speech and Audio Processing, vol. 7, no. 3, pp. 272-281, 1999
15. M.J.F. Gales, D.Y. Kim, P.C. Woodland, H.Y. Chan, D. Mrva, R. Sinha, &S.E. Tranter, "Progress in the CU-HTK broadcast news transcription system", IEEE Transactions on Audio, Speech, and Language Processing, vol. 14, no. 5, pp. 1513-1525, 2006
16. J.L. Gauvain, L. Lamel, &G. Adda "The LIMSI broadcast news transcription system" Speech communication, vol. 37, no. 1, pp. 89-108, 2002
17. P. Ghahremani, B. BabaAli, D. Povey, K. Riedhammer, J. Trmal, &S. Khudanpur, "A pitch extraction algorithm tuned for automatic speech recognition", Proc. ICASSP, Florence, 2014
18. F. Grezl &P. Fousek, "Optimizing bottle-neck features for LVCSR", Proc. ICASSP, Las Vegas, 2008
19. G.E. Hinton, "A Practical Guide to Training Restricted Boltzmann Machines", Technical Report, UTML TR 2010-003, Department of Computer Science, University of Toronto, 2010
20. P. Karanasou, M.J.F. Gales &P.C. Woodland, "I-vector estimation using informative priors for adaptation of deep neural networks", Proc. Interspeech, Dresden, 2015
21. P. Karanasou, M.J.F. Gales, P. Lanchantin, X. Liu, Y. Qian, L. Wang, P.C. Woodland &C. Zhang, "Speaker diarisation and longitudinal linking in multi-genre broadcast data", Proc. ASRU Workshop, Scottsdale, 2015
22. B. Kingsbury, "Lattice-based optimization of sequence classification criteria for neural-network acoustic modeling, Proc. ICASSP, Taipei, 2009
23. K.M. Knill, M.J.F. Gales, S.P. Rath, P.C. Woodland, C. Zhang, &S.-X. Zhang, "Investigation of multilingual deep neural networks for spoken term detection", Proc. ASRU Workshop, Olomouc, 2013
24. L. Lamel, J.L. Gauvain, &G. Adda, "Lightly supervised and unsupervised acoustic model training", Computer Speech &Language, vol. 16, no. 1, pp. 115-129, 2002
25. P. Lanchantin, M.J.F. Gales, P. Karanasou, X. Liu, Y. Qian, L. Wang, P.C. Woodland &C. Zhang, "The development of the Cambridge University alignment systems for the Multi-Genre Broadcast challenge", Proc. ASRU Workshop, Scottsdale, 2015
26. X. Liu, M.J.F. Gales, &P.C. Woodland, "Automatic complexity control for HLDA systems", Proc. ICASSP, Hong Kong, 2003
27. X. Liu, Y. Wang, X. Chen, M.J.F. Gales, &P.C. Woodland, "Efficient lattice rescoring using recurrent neural network language models", Proc. ICASSP, Florence, 2014
28. X. Liu, F. Flego, L. Wang, C. Zhang, M.J.F. Gales, &P.C. Woodland, "The Cambridge University 2014 BOLT conversational telephone Mandarin Chinese LVCSR system for speech translation", Proc. Interspeech, Dresden, 2015
29. L. Mangu, E. Brill, A. Stolcke, "Finding consensus in speech recognition: word error minimization and other applications of confusion networks", Computer Speech and Language, Vol. 14, No. 4, pp. 373-400, 2000
30. T. Mikolov, M. Karafiat, L. Burget, J. Cernocky, &S. Khudanpur, "Recurrent neural network based language model", Proc. Interspeech, Makuhari, Japan, 2010
31. T. Mikolov, S. Kombrink, L. Burget, J. H. Cernocky, &S. Khudanpur, "Extensions of recurrent neural network language model", Proc. ICASSP, Prague, 2011
32. D. Povey &P.C. Woodland, "Minimum phone error and I-smoothing for improved discriminative training", Proc. ICASSP, Orlando, 2002
33. D. Povey, A. Ghoshal, G. Boulianne, L. Burget, O. Glembek, N. Goel, M.Hannemann, P. Motlíček, Y. Qian, P. Schwarz, J. Silovsky, G. Stemmer, &K. Vesely, "The Kaldi speech recognition toolkit", Proc. ASRU Workshop, Hawaii, 2011
34. K. Richmond, R. Clark &S. Fitt, "Robust LTS rules with the Combilex speech technology lexicon", Proc. Interspeech, Brighton, 2009
35. K. Richmond, R. Clark &S. Fitt, "On generating Combilex pronunciations via morphological analysis", Proc. Interspeech, Makuhari, Japan, 2010
36. H. Sak, A. Senior, &F. Beaufays, "Long short-term memory recurrent neural network architectures for large scale acoustic modeling", Proc. Interspeech, Singapore, 2014
37. T. N. Sainath, B. Kingsbury, A. Mohamed, &B. Ramabhadran, "Learning filter banks within a deep neural network framework", Proc. ASRU Workshop, Olomouc, 2013
38. T.N. Sainath, O. Vinyals, A. Senior, &Hasim Sak, "Convolutional, long short-term memory, fully connected deep neural networks", Proc. ICASSP, Brisbane, 2015
39. F. Seide, G. Li, X. Chen, &D. Yu, "Feature engineering in context-dependent deep neural networks", Proc. ASRU Workshop, Hawaii, 2011
40. Y. Si, Q. Zhang, T. Li, J. Pan, &Y. Yan, "Prefix tree based n-best list re-scoring for recurrent neural network language model used in speech recognition system", Proc. Interspeech, Lyon, 2013
41. R. Sinha, S.E. Tranter, M.J.F. Gales, &P.C. Woodland, "The Cambridge University March 2005 speaker diarisation system", Proc. Interspeech, 2005
42. S.M. Siniscalchi, J.-Y. Li, &C.-H. Lee, "Hermitian polynomial for speaker adaptation of connectionist speech recognition systems", IEEE Transactions on Audio, Speech, and Language Processing, vol. 21, pp. 2152-2161, 2013
43. A. Stolcke, "SRILM an extensible language modeling toolkit", Proc. ICSLP, Denver, 2002
44. P. Swietojanski, A. Ghoshal, &S. Renals, "Revisiting hybrid and GMM-HMM system combination techniques", Proc. ICASSP, Vancouver, 2013
45. P. Swietojanski &S. Renals, "Learning hidden unit contributions for unsupervised speaker adaptation of neural network acoustic models", Proc. IWSLT, Lake Tahoe, 2014
46. P. Swietojanski &S. Renals, "Differentiable pooling for unsupervised speaker adaptation", Proc. ICASSP, Brisbane, 2015
47. K. Veseĺy, M. Karafiát, &F. Grézl, "Convolutive Bottleneck Network Features for LVCSR", Proc. ASRU Workshop, Hawaii, 2011
48. K. Vesely, A. Ghoshal, L. Burget, &D. Povey, "Sequencediscriminative training of deep neural networks", Proc. Interspeech, Lyon, 2013
49. P.C.Woodland, "The development of the HTK broadcast news transcription system: An overview", Speech Communication, vol. 37, no. 1, pp. 47-67, 2002
50. H. Xu, D. Povey, L. Mangu, &J. Zhu, "Minimum Bayes risk decoding and system combination based on a recursion for edit distance", Computer Speech &Language, vol. 25, no. 4, pp. 802-828, 2011
51. S.J. Young, G. Evermann, M.J.F. Gales, T. Hain., D. Kershaw, X. Liu, G. Moore, J.J. Odell, D. Ollason, D. Povey, V. Valtchev, and P.C. Woodland, The HTK book (for HTK version 3.4). Cambridge University Engineering Department, 2006
52. D. Yu &L. Deng, "Fuse deep neural network and Gaussian mixture model systems", Automatic Speech Recognition: A Deep Learning Approach, pp. 177-191. Springer, London, 2015
53. C. Zhang &P.C. Woodland, "A general artificial neural network extension for HTK", Proc. Interspeech, Dresden, 2015
54. C. Zhang &P.C. Woodland, "Parameterised sigmoid and ReLU hidden activation functions for DNN acoustic modelling", Proc. Interspeech, Dresden, 2015
55. Y. Zhao, J.-Y. Li, J. Xue, &Y.-F. Gong, "Investigating online low-footprint speaker adaptation using generalized linear regression and click-through data", Proc. ICASSP, Brisbane, 2015