Penalized likelihood methods for estimation of sparse high-dimensional directed acyclic graphs

Biometrika

Volumn 97, Issue 3, 2010, Pages 519-538

  Shojaie, Ali ^a   Michailidis, George ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Adaptive lasso; Directed acyclic graph; High dimensional sparse graphs; Lasso; Penalized likelihood estimation; Small n large p asymptotics

Indexed keywords

EID: 77953107844     PISSN: 00063444     EISSN: 14643510     Source Type: Journal    
DOI: 10.1093/biomet/asq038     Document Type: Article

References (27)

1. BANERJEE,O.,ELGHAOUI, L.&D'ASPREMONTALEXANDRE (2008).Model selection through sparse maximum likelihood estimation for multivariate Gaussian or binary data. J. Mach. Learn. Res. 9, 485-516.
2. FRIEDMAN, J.,HASTIE, T., HöFLING, H. & TIBSHIRANI, R. (2007). Pathwise coordinate optimization. Ann. Appl. Statist. 1, 302-332
3. FRIEDMAN, J., HASTIE, T. & TIBSHIRANI, R. (2008). Sparse inverse covariance estimation with the graphical lasso. Biostatistics 9, 432-441
4. HECKERMAN, D., GEIGER, D. & CHICKERING, D. (1995). Learning Bayesian networks: the combination of knowledge and statistical data. Mach. Learn. 20, 197-243.
5. HUANG, J., LIU, N., POURAHMADI, M. & LIU, L. (2006). Covariance matrix selection and estimation via penalised normal likelihood. Biometrika 93, 85-98.
6. HUANG, J.,MA, S. & ZHANG, C. (2008). Adaptive Lasso for sparse high-dimensional regression models. Statist. Sinica 18, 1603-1618
7. KALISCH, M. & BÜHLMANN, P. (2007). Estimating high-dimensional directed acyclic graphs with the PC-algorithm. J. Mach. Learn. Res. 8, 613-636
8. KAO, K.,YANG, Y.,BOSCOLO, R.,SABATTI, C.,ROYCHOWDHURY, V.&LIAO, J. (2004). Transcriptome-based determination of multiple transcription regulator activities in Escherichia coli by using network component analysis. Proc. Nat. Acad. Sci. 101, 641-646
9. KNIGHT, K. & FU, W. (2000). Asymptotics for lasso-type estimators. Ann. Statist. 28, 1356-1378
10. LAM, C. & FAN, J. (2009). Sparsity and rate of convergence in large covariance matrix estimation. Ann. Statist. 37, 4254-4278
11. LAURITZEN, S. (1996). Graphical Models. Oxford: Oxford University Press.
12. LECLERC, R. (2008). Survival of the sparsest: robust gene networks are parsimonious. Molec. Syst. Biol. 4, 1-6.
13. LEVINA, E., ROTHMAN, A. & ZHU, J. (2008). Sparse estimation of large covariance matrices via a nested Lasso penalty. Ann. Appl. Statist. 2, 245-263
14. MARKOWETZ, F. & SPANG, R. (2007). Inferring cellular networks-a review. BMC Bioinformatics 8, S5.
15. MEINSHAUSEN, N. & BÜHLMANN, P. (2006). High-dimensional graphs and variable selection with the Lasso. Ann. Statist. 34, 1436-1462
16. PEARL, J. (2000). Causality: Models, Reasoning, and Inference. Cambridge: Cambridge University Press.
17. R DEVELOPMENT CORE TEAM (2010). R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing. ISBN 3-900051-07-0. URL: http://www.R-project.org.
18. ROBINSON, R. (1977). Counting unlabeled acyclic digraphs. In Combinatorial Mathematics V: Proc. Fifth Australian Conf., R. Melbourne Inst. Technol, Ed. C. H. C. Little, pp. 28-43. Berlin: Springer.
19. ROTHMAN, A., BICKEL, P., LEVINA, E. & ZHU, J. (2008). Sparse permutation invariant covariance estimation. Electron. J. Statist. 2, 494-515.
20. SACHS, K., PEREZ, O., PE'ER, D., LAUFFENBURGER, D. & NOLAN, G. (2003). Causal protein-signaling networks derived from multiparameter single-cell data. Science 308, 504-506
21. SHOJAIE, A. & MICHAILIDIS, G. (2009). Analysis of gene sets based on the underlying regulatory network. J. Comp. Biol. 16, 407-426
22. SHOJAIE, A. & MICHAILIDIS, G. (2010). Network enrichment analysis in complex experiments. Statist. Appl. Genet. Molec. Biol. 9, Article 22.
23. SPIRTES, P., GLYMOUR, C. & SCHEINES, R. (2000). Causation, Prediction, and Search. Cambridge, MA: MIT Press.
24. TSAMARDINOS, I., BROWN, L. & ALIFERIS, C. (2006). The max-min hill-climbing Bayesian network structure learning algorithm. Mach. Learn. 65, 31-78.
25. VAN DER VAART, A. & WELLNER, J. (1996). Weak Convergence and Empirical Processes. New York: Springer.
26. YUAN, M. & LIN, Y. (2007). Model selection and estimation in the Gaussian graphical model. Biometrika 94, 19-36.
27. ZOU, H. (2006). The adaptive lasso and its oracle properties. J. Am. Statist. Assoc. 101, 1418-1429