Spectral experts for estimating mixtures of linear regressions

30th International Conference on Machine Learning, ICML 2013

Volumn , Issue PART 3, 2013, Pages 2077-2085

  Chaganty, Arun Tejasvi ^a   Liang, Percy ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CASE BASED REASONING; LEARNING SYSTEMS; LINEAR REGRESSION; MIXTURES; OPTIMIZATION; TENSORS;

COMPUTATIONALLY EFFICIENT; CONSISTENT ESTIMATORS; EMPIRICAL EVALUATIONS; GRADIENT-BASED OPTIMIZATION; LATENT-VARIABLE MODELS; LOCAL OPTIMIZATIONS; RATES OF CONVERGENCE; SYMMETRIC TENSORS;

ESTIMATION;

EID: 84897527676     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Anandkumar, A., Foster, D. P., Hsu, D., Kakade, S. M., and Liu, Y. Two SVDs suffice: Spectral decompositions for probabilistic topic modeling and latent Dirichlet allocation. In Advances in Neural Information Processing Systems (NIPS), Cambridge, MA, 2012a. MIT Press.
2. Anandkumar, A., Hsu, D., and Kakade, S. M. A method of moments for mixture models and hidden Markov models. In Conference on Learning Theory (COLT), 2012b.
3. Anandkumar, Anima, Ge, Rong, Hsu, Daniel, Kakade, Sham M., and Telgarsky, Matus. Tensor decompositions for learning latent variable models. CoRR, abs/1210.7559, 2012c.
4. Balle, B. and Mohri, M. Spectral learning of general weighted automata via constrained matrix completion. In Advances in Neural Information Processing Systems (NIPS), Cambridge, MA, 2012. MIT Press.
5. Balle, B., Quattoni, A., and Carreras, X. A spectral learning algorithm for finite state transducers. In European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2011.
6. Candes, E. J., Strohmer, T., and Voroninski, V. Phaselift: Exact and stable signal recovery from magnitude measurements via convex programming. Technical report, ArXiv, 2011.
7. Cohen, S. B., Stratos, K., Collins, M., Foster, D. P., and Ungar, L. Spectral learning of latent-variable PCFGs. In Association for Computational Linguistics (ACL). Association for Computational Linguistics, 2012.
8. Grant, Michael and Boyd, Stephen. CVX: Matlab software for disciplined convex programming, version 2.0 beta. http://cvxr.com/cvx, September 2012.
9. Hsu, D. and Kakade, S. M. Learning mixtures of spherical gaussians: Moment methods and spectral decompositions. In Innovations in Theoretical Computer Science (ITCS), 2013.
10. Hsu, D., Kakade, S. M., and Zhang, T. A spectral algorithm for learning hidden Markov models. In Conference on Learning Theory (COLT), 2009.
11. Hsu, D., Kakade, S. M., and Liang, P. Identifiability and unmixing of latent parse trees. In Advances in Neural Information Processing Systems (NIPS), Cambridge, MA, 2012. MIT Press.
12. Jacobs, R. A., Jordan, M. I., Nowlan, S. J., and Hinton, G. E. Adaptive mixtures of local experts. Neural Computation, 3:79-87, 1991.
13. Liang, P., Bouchard-Côté, A., Klein, D., and Taskar, B. An end-to-end discriminative approach to machine translation. In International Conference on Computational Linguistics and Association for Computational Linguistics (COLING/ACL), Sydney, Australia, 2006. Association for Computational Linguistics.
14. Negahban, S. and Wainwright, M. J. Estimation of (near) low-rank matrices with noise and high-dimensional scaling. ArXiv e-prints, December 2009.
15. Ohlsson, H., Yang, A., Dong, R., and Sastry, S. CPRL - an extension of compressive sensing to the phase retrieval problem. In Advances in Neural Information Processing Systems (NIPS), Cambridge, MA, 2012. MIT Press.
16. Parikh, A., Song, L., Ishteva, M., Teodoru, G., and Xing, E. A spectral algorithm for latent junction trees. In Uncertainty in Artificial Intelligence (UAI), 2012.
17. Petrov, S. and Klein, D. Discriminative log-linear grammars with latent variables. In Advances in Neural Information Processing Systems (NIPS), Cambridge, MA, 2008. MIT Press.
18. Quattoni, A., Collins, M., and Darrell, T. Conditional random fields for object recognition. In Advances in Neural Information Processing Systems (NIPS), Cambridge, MA, 2004. MIT Press.
19. Song, L., Boots, B., Siddiqi, S., Gordon, G., and Smola, A. Hilbert space embeddings of hidden Markov models. In International Conference on Machine Learning (ICML), Haifa, Israel, 2010. Omnipress.
20. Tomioka, R., Suzuki, T., Hayashi, K., and Kashima, H. Statistical performance of convex tensor decomposition. Advances in Neural Information Processing Systems (NIPS), pp. 137, 2011.
21. Viele, Kert and Tong, Barbara. Modeling with mixtures of linear regressions. Statistics and Computing, 12:315-330, 2002. ISSN 0960-3174. doi:10.1023/A: 1020779827503. URL http://dx.doi.org/10.1023/A%3A1020779827503.
22. Wang, Y. and Mori, G. Max-margin hidden conditional random fields for human action recognition. In Computer Vision and Pattern Recognition (CVPR), 2009.