Deep unfolding inference for supervised topic model

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2016-May, Issue , 2016, Pages 2279-2283

  Lee, Chao Hsi ^a   Chien, Jen Tzung ^a  

^a NATIONAL CHIAO TUNG UNIVERSITY   (Taiwan)

Author keywords

Deep unfolding; supervised topic model; variational inference

Indexed keywords

EID: 84973327160     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2016.7472083     Document Type: Conference Paper

References (22)

1. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent Dirichlet allocation, " Journal of Machine Learning Research, vol. 3, pp. 993-1022, Mar. 2003.
2. D. Blei, L. Carin, and D. Dunson, "Probabilistic topic models, " IEEE Signal Processing Magazine, vol. 27, no. 6, pp. 55-65, Nov. 2010.
3. J.-T. Chien and C.-H. Chueh, "Topic-based hierarchical segmentation, " IEEE Transactions on Audio, Speech and Language Processing, vol. 20, no. 1, pp. 55-66, 2012.
4. J.-T. Chien and C.-H. Chueh, "Dirichlet class language models for speech recognition, " IEEE Transactions on Audio, Speech and Language Processing, vol. 19, no. 3, pp. 482-495, 2011.
5. J.-T. Chien, "Hierarchical Pitman-Yor-Dirichlet language model, " IEEE/ACM Transactions on Audio, Speech and Language Processing, vol. 23, no. 8, pp. 1259-1272, 2015.
6. Y.-L. Chang and J.-T. Chien, "Latent Dirichlet learning for document summarization, " in Proc. of International Conference on Acoustics, Speech, and Signal Processing, 2009, pp. 1689-1692.
7. J.-T. Chien and M.-S. Wu, "Adaptive Bayesian latent semantic analysis, " IEEE Transactions on Audio, Speech and Language Processing, vol. 16, no. 1, pp. 198-207, Jan 2008.
8. P. Smaragdis, B. Raj, and M. Shashanka, "A probabilistic latent variable model for acoustic modeling, " Advances in Models for Acoustic Processing Workshop (NIPS), 2006.
9. S. Lacoste-Julien, F. Sha, and M. I. Jordan, "DiscLDA: discriminative learning for dimensionality reduction and classification, " in Advances in Neural Information Processing Systems (NIPS), D. Koller, D. Schuurmans, Y. Bengio, and L. Bottou, Eds., 2008, pp. 897-904.
10. C. Wang, D. Blei, and F.-F. Li, "Simultaneous image classification and annotation, " in Proc. of IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 1903-1910.
11. J. Zhu, A. Ahmed, and E. P. Xing, "MedLDA: maximum margin supervised topic models, " Journal of Machine Learning Research, vol. 13, no. 1, pp. 2237-2278, 2012.
12. J. Chen, J. He, Y. Shen, L. Xiao, X. He, J. Gao, X. Song, and L. Deng, "End-to-end learning of latent Dirichlet allocation by mirror-descent back propagation, " arXiv: 1508. 03398, 2015.
13. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm, " Journal of the Royal Statistical Society. Series B (Methodological), vol. 39, no. 1, pp. 1-38, Jan. 1977.
14. M. J. Beal, Variational Algorithms for Approximate Bayesian Inference, Ph. D. Thesis, University of London, 2003.
15. A. Kulesza and F. Pereira, "Structured learning with approximate inference, " in Advances in Neural Information Processing Systems (NIPS), 2007, pp. 785-792.
16. V. Stoyanov, A. Ropson, and J. Eisner, "Empirical risk minimization of graphical model parameters given approximate inference, decoding, and model structure, " in Proc. of International Conference on Artificial Intelligence and Statistics, 2011, pp. 725-733.
17. M. J. Wainwright, "Estimating the "wrong" graphical model: benefits in the computation-limited setting, " Journal of Machine Learning Research, vol. 7, pp. 1829-1859, 2006.
18. J. Lasserre, C. M. Bishop, and T. P. Minka, "Principled hybrids of generative and discriminative models, " in Proc. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), 2006, vol. 1, pp. 87-94.
19. A. Holub and P. Perona, "A discriminative framework for modelling object classes, " in Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2005, vol. 1, pp. 664-671.
20. J. R. Hershey, J. Le Roux, and F. Weninger, "Deep unfolding: model-based inspiration of novel deep architectures, " arXiv: 1409. 2574, 2014.
21. J. D. Mcauliffe and D. M. Blei, "Supervised topic models, " in Advances in Neural Information Processing Systems (NIPS), 2007, pp. 121-128.
22. J. Kivinen and M. K. Warmuth, "Exponentiated gradient versus gradient descent for linear predictors, " Information and Computation, vol. 132, no. 1, pp. 1-63, 1997.