Arccosine kernels: Acoustic modeling with infinite neural networks

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2011, Pages 5200-5203

  Cheng, Chih Chieh ^a   Kingsbury, Brian ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

hybrid systems; kernel methods; neural networks; speech recognition; support vector machines

Indexed keywords

ACOUSTIC MODELING; GAUSSIAN MIXTURE MODEL; HYBRID SUPPORT; KERNEL METHODS; MARKOV MODEL; MULTI-LAYER NETWORK; NONCONVEX OPTIMIZATION; PHONE RECOGNITION; RADIAL BASIS FUNCTIONS; SINGLE KERNEL; SUPPORT VECTOR;

CONVEX OPTIMIZATION; HYBRID SYSTEMS; MARKOV PROCESSES; NEURAL NETWORKS; OPTIMIZATION; RADIAL BASIS FUNCTION NETWORKS; SIGNAL PROCESSING; SPEECH COMMUNICATION;

SPEECH RECOGNITION;

EID: 80051619257     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2011.5947529     Document Type: Conference Paper

References (19)

1. N. Morgan and H. Bourlard, "An introduction to hybrid HMM/connectionist continuous speech recognition," IEEE Signal Processing Magazine, pp. 25-42, 1995.
2. H. Hermansky, D. P. W. Ellis, and S. Sharma, "Tandem connectionist feature extraction for conventional HMM systems," in Proc. ICASSP, 2000, vol. 3, pp. 1635-1638.
3. A.-R. Mohamed, D. Yu, and L. Deng, "Investigation of full-sequence training of deep belief networks for speech recognition," in Proc. Interspeech, 2010, pp. 2846-2849.
4. Y. Cho and L. K. Saul, "Large margin classification in infinite neural networks," Neural Computation, vol. 22, no. 10, pp. 2678-2697, 2010.
5. E. Andelic, M. Schafföner, M. Katz, S. E. Krüger, and A. Wendemuth, "A hybrid HMM-based speech recognizer using kernel-based discriminants as acoustic models," in Proc. ICPR, 2006, pp. 1158-1161.
6. C.-C. Chang and C.-J. Lin, LIBSVM: a library for support vector machines, 2001, Software available at http://www.csie.ntu.edu.tw/ cjlin/libsvm.
7. J. Platt, "Probabilistic outputs for support vector machines and comparison to regularized likelihood methods," in Advances in Large Margin Classifiers, pp. 61-74. MIT Press, 1999.
8. T.-F. Wu, C.-J. Lin, and R. C. Weng, "Probability estimates for multi-class classification by pairwise coupling," Journal of Machine Learning Research, vol. 5, pp. 975-1005, 2004.
9. L. F. Lamel, R. H. Kassel, and S. Seneff, "Speech database development: design and analysis of the acoustic-phonetic corpus," in Proc. DARPA Speech Recognition Workshop, L. S. Baumann, Ed., 1986, pp. 100-109.
10. K. F. Lee and H. W. Hon, "Speaker-independent phone recognition using hidden Markov models," IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 37, pp. 1641-1648, 1989.
11. T. N. Sainath, B. Ramabhadran, and M. Picheny, "An exploration of large vocabulary tools for small vocabulary phonetic recognition," in Proc. ASRU, 2009, pp. 359-364.
12. A. Ganapathiraju, J. Hamaker, and J. Picone, "Hybrid SVM/HMM architectures for speech recognition," in Proc. ICSLP, 2000.
13. J. Padrell-Sendra, D. Martín-Iglesias, and F. Díaz-de- María, "Support vector machines for continuous speech recognition," in Proc. 14th European Signal Processing Conference (EUSIPCO), 2006, pp. 2-5.
14. B. Kingsbury, "Lattice-based optimization of sequence classification criteria for neural-network acoustic modeling," in Proc. ICASSP, 2009, pp. 3761-3764.
15. D. Povey and P. C. Woodland, "Minimum phone error and I-smoothing for improved discriminative training," in Proc. ICASSP, 2002, vol. I., pp. 105-108.
16. D. Povey, D. Kanevsky, B. Kingsbury, B. Ramabhadran, G. Saon, and K. Visweswariah, "Boosted MMI for model and feature-space discriminative training," in Proc. ICASSP, 2008, vol. II., pp. 4057-4060.
17. F. Sha and L. K. Saul, "Large margin hidden Markov models for automatic speech recognition," in Advances in Neural Information Processing Systems 19, 2007, pp. 1249-1256.
18. I. Heintz, E. Fosler-Lussier, and C. Brew, "Discriminative input stream combination for conditional random field phone recognition," IEEE Transactions on Audio, Speech, and Language Processing, vol. 17, no. 8, pp. 1533-1546, 2009.
19. T. N. Sainath, B. Ramabhadran, M. Picheny, D. Nahamoo, and D. Kanevsky, "Exemplar-based sparse representation features: from TIMIT to LVCSR," IEEE Transactions on Audio, Speech, and Language Processing, 2010, submitted.