Laplace group sensing for acoustic models

IEEE/ACM Transactions on Audio Speech and Language Processing

Volumn 23, Issue 5, 2015, Pages 909-922

  Chien, Jen Tzung ^a  

^a NATIONAL CHIAO TUNG UNIVERSITY   (Taiwan)

Author keywords

acoustic model; basis representation; group sparsity; Laplace distribution; speech recognition

Indexed keywords

LAPLACE TRANSFORMS; MARKOV PROCESSES; PARAMETERIZATION; UNCERTAINTY ANALYSIS;

ACOUSTIC MODEL; AUTOMATIC RELEVANCE DETERMINATION; BASIS REPRESENTATION; GROUP SPARSITIES; LAPLACE APPROXIMATION; LAPLACE DISTRIBUTIONS; NOISY SPEECH RECOGNITION; REGULARIZATION PARAMETERS;

SPEECH RECOGNITION;

EID: 84954409828     PISSN: 23299290     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASLP.2015.2412466     Document Type: Article

References (37)

1. H. Lee, A. Battle, R. Raina, A. Y. Ng, "Efficient sparse coding algorithms," in Adv. Neural Inf. Process. Syst., 2007, pp. 801-808.
2. R. Tibshirani, "Regression shrinkage and selection via the lasso," J. R. Statist. Soc. Ser. B, vol. 58, no. 1, pp. 267-288, 1996.
3. T. N. Sainath, B. Ramabhadran, M. Picheny, D. Nahamoo, D. Kanevsky, "Exemplar-based sparse representation features: From TIMIT to LVCSR," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 8, pp. 2598-2613, Nov. 2011.
4. W. J. Smit and E. Barnard, "Continuous speech recognition with sparse coding," Comput. Speech Lang., vol. 23, pp. 200-219, 2009.
5. R. Jenatton, J. Mairal, G. Obozinski, F. Bach, "Proximal methods for hierarchical sparse coding," J. Mach. Learn. Res., vol. 12, pp. 2297-2334, 2011.
6. J. Li, M. Yuan, C.-H. Lee, "LASSO model adaptation for automatic speech recognition," in Proc. ICML Workshop Learn. Architect., Representat., Optimizat. Speech Visual Inf. Process., 2011.
7. X. Xiao, J. Li, E. S. Chng, H. Li, "Lasso environment model combination for robust speech recognition," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2012, pp. 4305-4308.
8. A. Lefevre, F. Bach, C. Fevotte, "Itakura-Saito nonnegative matrix factorization with group sparsity," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2011, pp. 21-24.
9. D. M. Malioutov, S. R. Sanghavi, A. S. Willsky, "Sequential compressive sensing," IEEE J. Sel. Topics Signal Process., vol. 4, no. 2, pp. 435-444, Apr. 2010.
10. S. Ji, Y. Xue, L. Carin, "Bayesian compressive sensing," IEEE Trans. Signal Process., vol. 56, no. 6, pp. 2346-2356, Jun. 2008.
11. M. E. Tipping, "Sparse bayesian learning and the relevance vector machine," J. Mach. Learn. Res., vol. 1, no. 1, pp. 211-244, 2001.
12. D. Wipf and S. Nagarajan, "Sparse estimation using general likelihoods and non-factorial priors," Adv. Neural Inf. Process. Syst., vol. 22, pp. 2071-2079, 2009.
13. J.-T. Chien and Y.-L. Chang, "Bayesian sparse topic model," J. Signal Process. Syst., vol. 74, no. 3, pp. 375-389, 2014.
14. X. Cui, M. Afify, G. Saon, V. Goel, "Sparse Bayesian factor analysis for stereo-based stochastic mapping," in Proc. Annu. Conf. Int. Speech Commun. Assoc. (INTERSPEECH), 2012, pp. 2646-2649.
15. G. Saon and J.-T. Chien, "Bayesian sensing hidden Markov models," IEEE Trans. Audio, Speech, Lang. Process., vol. 20, no. 1, pp. 43-54, Jan. 2012.
16. D. J. C. MacKay, "Probable networks and plausible predictions-a review of practical Bayesian methods for supervised neural networks," Network: Comput. Neural Syst., vol. 6, no. 3, pp. 469-505, 1995.
17. G. Saon and J.-T. Chien, "Some properties of Bayesian sensing hidden Markov models," in Proc. IEEE Autom. Speech Recogn. Understand. Workshop (ASRU), 2011, pp. 65-70.
18. P. J. Garrigues and B. A. Olshausen, "Group sparse coding with a Laplacian scale mixture prior," in Adv. Neural Inf. Process. Syst., 2010.
19. S. D. Babacan, R. Molina, A. K. Katsaggelos, "Bayesian compressive sensing using Laplace priors," IEEE Trans. Image Process., vol. 19, no. 1, pp. 53-63, Jan. 2010.
20. S. Gao, I. W.-H. Tsang, L.-T. Chia, "Laplacian sparse coding, hypergraph Lplacian sparse coding, applications," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 92-104, Jan. 2013.
21. C. M. Bishop, Pattern Recognition and Machine Learning. New York, NY, USA: Springer Science, 2006.
22. J.-T. Chien and C.-C. Chiang, "Group sparse hidden Markov models for speech recognition," in Proc. Annu. Conf. Int. Speech Commun. Assoc. (INTERSPEECH), 2012, pp. 2646-2649.
23. J.-T. Chien and H.-L. Hsieh, "Bayesian group sparse learning for music source separation," EURASIP J. Audio, Speech, Music Process., 2013, Article 18.
24. A. P. Dempster, N. M. Laird, D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. R. Statist. Soc. Ser. B, vol. 39, no. 1, pp. 1-38, 1977.
25. S. Bengio, F. Pereira, Y. Singer, D. Strelow, "Group sparse coding," Adv. Neural Inf. Process. Syst., pp. 82-89, 2009.
26. H. Lee and S. Choi, "Group nonnegative matrix factorization for EEG classification," in Proc. Int. Conf. Artif. Intell. Statist. (AISTATS), 2009, pp. 320-327.
27. B. M. Marlin, M. Schmidt, K. P. Murphy, "Group sparse priors for covariance estimation," in Proc. Conf. Uncertainty Artif. Intell. (UAI), 2009, pp. 383-392.
28. L. Jacob, G. Obozinski, J.-P. Vert, "Group lasso with overlap and graph lasso," in Proc. Int. Conf. Mach. Learn. (ICML), 2009, pp. 433-440.
29. N. Simon, J. Friedman, T. Hastie, R. Tibshirani, "A sparse-group lasso," J. Comput. Graph. Statist., vol. 22, no. 2, pp. 231-245, 2013.
30. J.-T. Chien and C.-W. Ting, "Factor analyzed subspace modeling and selection," IEEE Trans. Audio, Speech, Lang. Process., vol. 16, no. 1, pp. 239-248, Jan. 2008.
31. T. T. Wu and K. Lange, "Coordinate descent algorithm for lasso penalized regression," Ann. Appl. Statist., vol. 2, no. 1, pp. 224-244, 2008.
32. H. G. Hirsch and D. Pearce, "The AURORA experimental framework for the performance evaluations of speech recognition systems under noisy conditions," in Proc. ISCA ITRW ASR'00, 2000, pp. 181-188.
33. N. Parihar and J. Picone, "Aurora working group: DSR front end lvcsr evaluation au/384/02," Inst. for Signal and Inf. Process., Mississippi State Univ., Tech. Rep., 2002.
34. S. Young, G. Evermann, M. J. F. Gales, T. Hain, D. Kershaw, X. Liu, G. Moore, J. J. Odell, D. Ollason, D. Povey, V. Valchev, P. Woodland, The HTK Book, Version 3.4. Cambridge, U.K.: Cambridge Univ. Eng. Dept., 2006.
35. D. Povey, A. Ghoshal, G. Boulianne, L. Burget, O. Glembek, N. Goel, M. Hannemann, P. Motlicek, Y. Qian, P. Schwarz, J. Silovsky, G. Stemmer, K. Vesely, "The Kaldi speech recognition toolkit," in Proc. IEEE Workshop Autom. Speech Recogn. Understand. (ASRU), 2011.
36. J.-T. Chien and T.-W. Lu, "Tikhonov regularization for deep neural network acoustic modeling," in Proc. IEEE Spoken Lang. Technol. Workshop (SLT), 2014, pp. 147-152.
37. P. O. Hoyer, "Non-negative matrix factorization with sparseness constraints," J. Mach. Learn. Res., vol. 5, pp. 1457-1469, 2004.