Learning linear Bayesian networks with latent variables

30th International Conference on Machine Learning, ICML 2013

Volumn , Issue PART 1, 2013, Pages 249-257

  Anandkumar, Animashree ^a   Hsu, Daniel ^b   Javanmard, Adel ^c   Kakade, Sham M ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b MICROSOFT RESEARCH   (United Kingdom)

^c Stanford University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING SYSTEMS;

DIRECTED ACYCLIC GRAPH (DAG); EFFECTIVE DEPTH; EXPANSION PROPERTIES; GRAPHICAL CONSTRAINTS; IDENTIFIABILITY; LATENT VARIABLE; POLYTREES;

BAYESIAN NETWORKS;

EID: 84897557825     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (33)

1. Ali, R. A., Richardson, T., Spirtes, P., and Zhang, J. Towards characterizing Markov equivalence classes for directed acyclic graphs with latent variables. In UAI, 2005.
2. Anandkumar, A. and Valluvan, R. Learning loopy graphical models with latent variables: Efficient methods and guarantees. arXiv:1203.3887, 2012.
3. Anandkumar, A., Chaudhuri, K., Hsu, D., Kakade, S. M., Song, L., and Zhang, T. Spectral methods for learning multivariate latent tree structure. In NIPS, 2011.
4. Anandkumar, A., Foster, D. P., Hsu, D., Kakade, S. M., and Liu, Y.-K. A spectral algorithm for latent Dirichlet allocation. In NIPS, 2012a.
5. Anandkumar, A., Hsu, D., Javanmard, A., and Kakade, S. M. Learning linear bayesian networks with latent variables. arXiv:1209.5350, 2012b.
6. Bach, F. R. and Jordan, M. I. Beyond independent components: trees and clusters. JMLR, 4:1205-1233, 2003.
7. Blei, D. M. and Lafferty, J. D. A correlated topic model of science. Annals of Applied Statistics, pp. 17-35, 2007.
8. Blei, D. M., Ng, A. Y., and Jordan, M. I. Latent Dirichlet allocation. JMLR, 3:993-1022, 2003.
9. Bollen, K. A. Structural Equations with Latent Variables. Wiley, New York, 1989.
10. Bresler, G., Mossel, E., and Sly, A. Reconstruction of Markov random fields from samples: some observations and algorithms. In APPROX, 2008.
11. Chandrasekaran, V., Sanghavi, S., Parrilo, P. A., and Willsky, A. S. Rank-sparsity incoherence for matrix decomposition. SIAM Journal on Optimization, 21(2):572-596, 2011.
12. Chandrasekaran, V., Parrilo, P. A., and Willsky, A. S. Latent variable graphical model selection via convex optimization. Annals of Statistics (to appear), 2012.
13. Chickering, D. M. Optimal structure identification with greedy search. JMLR, 3:507-554, 2003.
14. Choi, M. J., Lim, J. J., Torralba, A., and Willsky, A. S. Exploiting hierarchical context on a large database of object categories. In CVPR, 2010.
15. Chow, C. and Liu, C. Approximating discrete probability distributions with dependence trees. IEEE Tran. on Information Theory, 14(3):462-467, 1968.
16. Durbin, R., Eddy, S., Krogh, A., and Mitchison, G. Biological Sequence Analysis: Probabilistic Models of Proteins and Nucleic Acids. Cambridge University Press, 1998.
17. Erdös, P. L., Székely, L. A., Steel, M. A., and Warnow, T. J. A few logs suffice to build (almost) all trees: Part I. Random Structures and Algorithms, 14:153-184, 1999.
18. Hoyer, P. O., Janzing, D., Mooij, J. M., Peters, J., and Schölkopf, B. Nonlinear causal discovery with additive noise models. In NIPS, 2009.
19. Hsu, D., Kakade, S. M., and Zhang, T. Robust matrix decomposition with sparse corruptions. IEEE Trans. on Inf. Theory, 57(11):7221-7234, 2011.
20. Hyvärinen, A., Karhunen, J., and Oja., E. Independent Component Analysis. Wiley Interscience, 2001.
21. Lauritzen, S. Graphical Models. Oxford University Press, 1996.
22. Li, W. and McCallum, A. Pachinko allocation: DAG-structured mixture models of topic correlations. In ICML, pp. 577-584, 2006.
23. Pearl, J. Probabilistic Reasoning in Intelligent Systems - Networks of Plausible Inference. Morgan Kaufmann, 1988.
24. Peters, J. and Bühlmann, P. Identifiability of Gaussian structural equation models with same error variances. arXiv:1205.2536v1, 2012.
25. Peters, J., Mooij, J., Janzing, D., and Schölkopf, B. Identifiability of causal graphs using functional models. In UAI, 2011.
26. 1-regularized logistic regression. Annals of Statistics, 38(3):1287-1319, 2010.
27. Saunderson, J., Chandrasekaran, V., Parrilo, P. A., and Willsky, A. S. Diagonal and low-rank matrix decompositions, correlation matrices, and ellipsoid fitting. arXiv:1204.1220, 2012.
28. Shimizu, S., Hoyer, P. O., Hyvärisen, A., and Kerminen, A. A linear non-gaussian acyclic model for causal discovery. JMLR, 7:2003-2030, 2006. (Pubitemid 44497456)
29. Silva, R., Scheines, R., Glymour, C., and Spirtes, P. Learning the structure of linear latent variable models. JMLR, 7:191-246, 2006. (Pubitemid 43668126)
30. Spielman, D. A., Wang, H., and Wright, J. Exact recovery of sparsely-used dictionaries. arXiv:1206.5882v1, 2012.
31. Spirtes, P., Glymour, C., and Scheines, R. Causation, Prediction, and Search. MIT press, 2nd edition, 2000.
32. Theis, F. J. Towards a general independent subspace analysis. In NIPS, 2007.
33. Zellner, A. Introduction to Bayesian Inference in Econometrics. New York: John Wiley, 2nd edition, 1971.