A shrinkage approach to large-scale covariance matrix estimation and implications for functional genomics

Statistical Applications in Genetics and Molecular Biology

Volumn 4, Issue 1, 2005, Pages 1-30

  Schäfer, Juliane ^a   Strimmer, Korbinian ^a  

^a UNIVERSITY OF MUNICH   (Germany)

Author keywords

"small n, large p" problem; Covariance estimation; Gene expression; Genetic network; Graphical Gaussian model (GGM); Shrinkage

Indexed keywords

ARTICLE; BIOINFORMATICS; CORRELATION ANALYSIS; COVARIANCE; DATA ANALYSIS; FUNCTIONAL GENOMICS; MATHEMATICAL ANALYSIS; POPULATION GENETICS; STATISTICAL ANALYSIS;

EID: 27844521293     PISSN: 15446115     EISSN: 15446115     Source Type: Journal    
DOI: 10.2202/1544-6115.1175     Document Type: Article

References (46)

1. Barabási, A.-L. and Z. N. Oltvai (2004). Network biology: understanding the cell's functional organization. Nature Rev. Genetics 5, 101-113.
2. Benjamini, Y. and Y. Hochberg (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. R. Statist. Soc. B 57, 289-300.
3. Boginski, V., S. Butenko, and P. M. Pardalos (2005). Statistical analysis of financial networks. Comp. Stat. Data Anal. 48, 431-443.
4. Butte, A. J., P. Tamayo, D. Slonim, T. R. Golub, and I. S. Kohane (2000). Discovering functional relationships between RNA expression and chemotherapeutic susceptibility using relevance networks. Proc. Natl. Acad. Sci. USA 97, 12182-12186.
5. Cox, D. R. and N. Reid (2004). A note on pseudolikelihood from marginal densities. Biometrika 91, 729-737.
6. Cui, X., J. T. G. Hwang, J. Qiu, N. J. Blades, and G. A. Churchill (2005). Improved statistical tests for differential gene expression by shrinking variance components estimates. Biostatistics 6, 59-75.
7. Daniels, M. J. and R. E. Kass (2001). Shrinkage estimators for covariance matrices. Biometrics 57, 1173-1184.
8. de la Fuente, A., N. Bing, I. Hoeschele, and P. Mendes (2004). Discovery of meaningful associations in genomic data using partial correlation coefficients. Bioinformatics 20, 3565-3574.
9. Dobra, A., C. Hans, B. Jones, J. R. Nevins, G. Yao, and M. West (2004). Sparse graphical models for exploring gene expression data. J. Multiv. Anal. 90, 196-212.
10. Efron, B. (1975). Biased versus unbiased estimation. Adv. Math. 16, 259-277.
11. Efron, B. (1982). Maximum likelihood and decision theory. Ann. Statist. 10, 340-356.
12. Efron, B. (2004). Large-scale simultaneous hypothesis testing: the choice of a null hypothesis. J. Amer. Statist. Assoc. 99, 96-104.
13. Efron, B. (2005a). Correlation and large-scale simultaneous significance testing. Preprint, Dept. of Statistics, Stanford University.
14. Efron, B. (2005b). Local false discovery rates. Preprint, Dept. of Statistics, Stanford University.
15. Efron, B. and C. N. Morris (1975). Data analysis using Stein's estimator and its generalizations. J. Amer. Statist. Assoc. 70, 311-319.
16. Efron, B. and C. N. Morris (1977). Stein's paradox in statistics. Sci. Am. 236, 119-127.
17. Eisen, M. B., P. T. Spellman, P. O. Brown, and D. Botstein (1998). Cluster analysis and display of genome-wide expression patterns. Proc. Natl. Acad. Sci. USA 95, 14863-14868.
18. Friedman, J. H. (1989). Regularized discriminant analysis. J. Amer. Statist. Assoc. 84, 165-175.
19. Greenland, S. (2000). Principles of multilevel modelling. Intl. J. Epidemiol. 29, 158-167.
20. Guo, Y., T. Hastie, and T. Tibshirani (2004). Regularized discriminant analysis and its application in microarray. Preprint, Dept. of Statistics, Stanford University.
21. Hastie, T., R. Tibshirani, and J. Friedman (2001). The Elements of Statistical Learning. New York: Springer.
22. Higham, N. J. (1988). Computing a nearest symmetric positive semidefinite matrix. Linear Algebra Appl. 103, 103-118.
23. Hirschberger, M., Y. Qi, and R. E. Steuer (2004). Randomly generating portfolioselection covariance matrices with specified distributional assumption. Preprint, Terry College of Business, University of Georgia.
24. Hoerl, A. E. and R. W. Kennard (1970a). Ridge regression: applications to nonorthogonal problems. Technometrics 12, 69-82.
25. Hoerl, A. E. and R. W. Kennard (1970b). Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12, 55-67.
26. Hotelling, H. (1953). New light on the correlation coefficient and its transforms. J. R. Statist. Soc. B 15, 193-232.
27. Ledoit, O. and M. Wolf (2003). Improved estimation of the covariance matrix of stock returns with an application to portfolio selection. J. Empir. Finance 10, 603-621.
28. Ledoit, O. and M. Wolf (2004a). Honey, I shrunk the sample covariance matrix. J. Portfolio Management 30, 110-119.
29. Ledoit, O. and M. Wolf (2004b). A well conditioned estimator for large-dimensional covariance matrices. J. Multiv. Anal. 88, 365-411.
30. Leung, P. L. and W. Y. Chan (1998). Estimation of the scale matrix and its eigen-values in the Wishart and the multivariate F distributions. Ann. Inst. Statist. Math. 50, 523-530.
31. Magwene, P. M. and J. Kim (2004). Estimating genomic coexpression networks using first-order conditional independence. Genome Biology 5, R100.
32. Mantegna, R. N. and H. E. Stanley (2000). An Introduction to Econophysics: Correlations and Complexity in Finance. Cambridge, UK: Cambridge University Press.
33. Meinshausen, N. and P. Bühlmann (2005). High dimensional graphs and variable selection with the lasso. Ann. Statist. in press.
34. Morris, C. N. (1983). Parametric empirical Bayes inference: theory and applications. J. Amer. Statist. Assoc. 78, 47-55.
35. Schäfer, J. and K. Strimmer (2005a). An empirical Bayes approach to inferring large-scale gene association networks. Bioinformatics 21, 754-764.
36. Schäfer, J. and K. Strimmer (2005b). Learning large-scale graphical Gaussian models from genomic data. In J. F. F. Mendes, S. N. Dorogovtsev, A. Povolotsky, F. V. Abreu, and J. G. Oliveira (Eds.), Science of Complex Networks: From Biology to the Internet and WWW, Volume 776, AIP Conference Proceedings, Aveiro, PT, August 2004, pp. 263-276. American Institute of Physics.
37. Schmidt-Heck, W., R. Guthke, S. Toepfer, H. Reischer, K. Duerrschmid, and K. Bayer (2004). Reverse engineering of the stress response during expression of a recombinant protein. In Proceedings of the EUNITE symposium, 10-12 June 2004, Aachen, Germany, pp. 407-412. Verlag Mainz.
38. Smyth, G. K. (2004). Linear models and empirical Bayes methods for assessing differential expression in microarray experiments. Statist. Appl. Genet. Mol. Biol. 3, 3.
39. Stein, C. (1956). Inadmissibility of the usual estimator for the mean of a multivariate distribution. In J. Neyman (Ed.), Proc. Third. Berkeley Symp. Math. Statist. Probab., Volume 1, Berkeley, pp. 197-206. Univ. California Press.
40. Storey, J. D. (2002). A direct approach to false discovery rates. J. R. Statist. Soc. B 64, 479-498.
41. Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. J. R. Statist. Soc. B 58, 267-288.
42. Tibshirani, R., T. Hastie, B. Narasimhan, and G. Chi (2002). Diagnosis of multiple cancer type by shrunken centroids of gene expression. Proc. Natl. Acad. Sci. USA 99, 6567-6572.
43. Toh, H. and K. Horimoto (2002). Inference of a genetic network by a combined approach of cluster analysis and graphical Gaussian modeling. Bioinformatics 18, 287-297.
44. Whittaker, J. (1990). Graphical Models in Applied Multivariate Statistics. New York: Wiley.
45. Wille, A., P. Zimmermann, E. Vranová, A. Fürholz, O. Laule, S. Bleuler, L. Hennig, A. Prelíc, P. von Rohr, L. Thiele, E. Zitzler, W. Gruissem, and P. Bühlmann (2004). Sparse graphical Gaussian modeling of the isoprenoid gene network in Arabidopsis thaliana. Genome Biology 5, R92.
46. Zhu, J. and T. Hastie (2004). Classification of gene microarrays by penalized logistic regression. Biostatistics 5, 427-443.