Sparse estimation of conditional graphical models with application to gene networks

Journal of the American Statistical Association

Volumn 107, Issue 497, 2012, Pages 152-167

  Li, Bing ^a   Chun, Hyonho ^b   Zhao, Hongyu ^c  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

^b PURDUE UNIVERSITY   (United States)

^c YALE UNIVERSITY   (United States)

Author keywords

Conditional random field; Gaussian graphical models; Lasso and adaptive lasso; Oracle property; Reproducing kernel Hilbert space; Sparsistency; Sparsity; von Mises expansion

Indexed keywords

EID: 84862854053     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1080/01621459.2011.644498     Document Type: Article

References (34)

1. Aronszajn, N. (1950), "Theory of Reproducing Kernels," Transactions of the American Mathematical Society, 68, 337-404. [153]
2. Bickel, P. J., and Levina, E. (2008), "Covariance Regularization by Thresholding," The Annals of Statistics, 36, 2577-2604. [152]
3. Bickel, P. J., Ritov, Y., Klaassenn, C. A. J., and Wellner, J. A. (1993), Efficient and Adaptive Estimation for Semiparametric Models. Baltimore, MD: The Johns Hopkins University Press. [156]
4. Breiman, L. (1995), "Better Subset Regression Using the Nonnegative Garrote," Technometrics, 37, 373-384. [155]
5. Broman, K.W., Wu, H., Sen, S., and Churchill, G. A. (2003), "R/qtl: QTLMapping in Experimental Crosses," Bioinformatics, 19, 889-890. [166]
6. Dempster, A. P. (1972), "Covariance Selection," Biometrika, 32, 95-108. [152]
7. Fan, J., and Li, R. (2001), "Variable Selection via Nonconcave Penalized Likelihood and Its Oracle Properties," Journal of American Statistical Association, 96, 1348-1360. [157]
8. Fernholz, L. T. (1983), "VonMises Calculus for Statistical Functionals," Lecture Notes in Statistics, 19, New York: Springer. [156]
9. Friedman, J., Hastie, T., and Tibshirani, R. (2008), "Sparse Inverse Covariance Estimation with the Graphical Lasso," Biostatistics, 9, 432-441. [155,162]
10. Fukumizu, K., Bach, F. R., and Jordan, M. I. (2009), "Kernel Dimension Reduction in Regression," The Annals of Statistics, 4, 1871-1905. [153,154]
11. Genton, M. G. (2001), "Classes of Kernels for Machine Learning: A Statistics Perspective," Journal of Machine Learning Research, 2, 299-312. [164]
12. Geyer, C. J. (1994), "On the Asymptotics of Constrained M-estimation," The Annals of Statistics, 22, 1998-2010. [158,159]
13. Ghazalpour, A., Doss, S., Zhang, B., Wang, S., Plaisier, C., Castellanos, R., Brozell, A., Shadt, E. E., Drake, T. A., Lusis, A. J., and Horvath, S. (2006), "Integrating Genetic and Network Analysis to Characterize Gene Related to Mouse Weight," PLoS Genetics, 2, e130. [165]
14. Guo, J., Levina, E., Michailidis, G., and Zhu, J. (2009), "Joint Estimation of Multiple Graphical Models," unpublished manuscript available at http://www.stat. lsa.umich.edu/gmichail/manuscript-jasa-09.pdf. [152]
15. Henderson, H. V., and Searle, S. R. (1979), "Vec and Vech Operators for Matrices, with Some Uses in Jacobians and Multivariate Statistics," Canadian Journal of Statistics, 7, 65-81. [155]
16. Horn, R. A., and Johnson, C. R. (1985), Matrix Analysis, New York: Cambridge University Press. [154]
17. Knight, K., and Fu, W. (2000), "Asymptotics for Lasso-Type Estimators," The Annals of Statistics, 28, 1356-1378. [157]
18. Lafferty, J., McCallum, A., and Pereira, F. (2001), "Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data," in Proceedings of the Eighteenth International Conference on Machine Learning (ICML 2001), 282-289. [152]
19. Lam, C., and Fan, J. (2009), "Sparsistency and Rates of Convergence in Large Covariance Matrix Estimation," The Annals of Statistics, 37, 4254-4278. [152,157]
20. Lauritzen, S. L. (1996), Graphical Models, Oxford: Clarendon Press. [152,155,157]
21. Meinshausen, N., and Bühlmann, P. (2006), "High-Dimensional Graphs with the Lasso," The Annals of Statistics, 34, 1436-1462. [152]
22. Mises, R. v. (1947), "On theAsymptotic Distribution ofDifferentiable Statistical Functions," The Annals of Mathematical Statistics, 18, 309-348. [155]
23. Neto, E. C., Keller, M. P., Attie, A. D., and Yandell, B. S. (2010), "Causal Graphical Models in Systems Genetics: A Unified Framework for Joint Inference of Causal Network and Genetic Architecture for Correlated Phenotypes," The Annals of Applied Statistics, 4, 320-339. [166]
24. Peng, J., Wang, P., Zhou, N., and Zhu, J. (2009), "Partial Correlation Estimation by Joint Sparse Regression Models," Journal of American Statistical Association, 104, 735-746. [152]
25. Reeds, J. A. (1976), "On the Definition of Von Mises Functionals," Ph.D. dissertation, Harvard University.[156]
26. Ren, J., and Sen, P. K. (1991), "On Hadamard Differentiability of Extended Statistical Functional," Journal of Multivariate Analysis, 39, 30-43. [156]
27. Rothman, A. J., Bickel, P., Levina, E., and Zhu, J. (2008), "Sparse Permutation Invariant Covariance Estimation," Electronic Journal of Statistics, 2, 494-515. [159,160,161]
28. Schwarz, G. E. (1978), "Estimating the Dimension of a Model," The Annals of Statistics, 6, 461-464. [161]
29. Tibshirani, R. (1996), "Regression Shrinkage and Selection via the Lasso," Journal of the Royal Statistical Society, Series B, 58, 267-288. [152,155]
30. Vapnik, N. V. (1998), Statistical Learning Theory, New York: Wiley. [153]
31. Yuan, M., and Lin, Y. (2007), "Model Selection and Estimation in the Gaussian Graphical Model," Biometrika, 94, 19-35. [152,155,157,158,161]
32. Zhao, P., andYu, B. (2006), "On Model Selection Consistency of Lasso," Journal of Machine Learning Research, 7, 2541-2563. [155]
33. Zou, H. (2006), "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, 101, 1418-1429. [152,155]
34. Zou, H., and Li, R. (2008), "One-Step Sparse Estimates in Nonconcave Penalized Likelihood Models" (with discussion), The Annals of Statistics, 36, 1509-1533. [155]