Multiple testing and error control in Gaussian graphical model selection

Statistical Science

Volumn 22, Issue 3, 2007, Pages 430-449

  Drton, Mathias ^a   Perlman, Michael D ^b  

^a UNIVERSITY OF CHICAGO   (United States)

^b UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Acyclic directed graph; Bayesian network; Bidirected graph; Chain graph; Concentration graph; Covariance graph; DAG; Graphical model; Multiple testing; Undirected graph

Indexed keywords

EID: 49449118676     PISSN: 08834237     EISSN: None     Source Type: Journal    
DOI: 10.1214/088342307000000113     Document Type: Review

References (102)

1. AITKIN, M. A. (1969). Some tests for correlation matrices. Biometrika 56 443-446.
2. AITKIN, M. A. (1971). Correction: Some tests for correlation matrices. Biometrika 58 245.
3. ANDERSON, T. W. (2003). An Introduction to Multivariate Statistical Analysis, 3rd ed. Wiley, Hoboken, NJ.
4. ANDERSSON, S. A., MADIGAN, D. and PERLMAN, M. D. (1997). A characterization of Markov equivalence classes for acyclic digraphs. Ann. Statist. 25 505-541.
5. ANDERSSON, S. A., MADIGAN, D. and PERLMAN, M. D. (2001). Alternative Markov properties for chain graphs. Scand. J. Statist. 28 33-85.
6. ANDERSSON, S. A. and PERLMAN, M. D. (1998). Normal linear regression models with recursive graphical Markov structure. J. Multivariate Anal. 66 133-187.
7. ANDERSSON, S. A. and PERLMAN, M. D. (2006). Characterizing Markov equivalence classes for AMP chain graph models. Ann. Statist. 34 939-972.
8. ATAY-KAYIS, A. and MASSAM, H. (2005). A Monte Carlo method for computing the marginal likelihood in nondecomposable Gaussian graphical models. Biometrika 92 317-335.
9. BADSBERG, J. (1992). Model search in contingency tables by CoCo. In Computational Statistics (Y. Dodge and J. Whittaker, eds.) 251-256. Physica, Heidelberg.
10. BANERJEE, M. and RICHARDSON, T. S. (2003). On a dualization of graphical Gaussian models: A correction note. Scand. J. Statist. 30 817-820.
11. BECKER, A., GEIGER, D. and MEEK, C. (2000). Perfect tree-like Markovian distributions. In Proceedings of the 16th Conference on Uncertainty in Artificial Intelligence 19-23. Morgan Kaufmann, San Francisco, CA.
12. BEERENWINKEL, N. and DRTON, M. (2007). A mutagenetic tree hidden Markov model for longitudinal clonal HIV sequence data. Biostatistics 8 53-71.
13. BENJAMINI, Y. and HOCHBERG, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. Roy. Statist. Soc. Ser. B 57 289-300.
14. BENJAMINI, Y. and YEKUTIELI, D. (2001). The control of the false discovery rate in multiple testing under dependency. Ann. Statist. 29 1165-1188.
15. BUTTE, A. J., TAMAYO, P., SLONIM, D., GOLUB, T. R. and KOHANE, I. S. (2000). Discovering functional relationships between RNA expression and chemotherapeutic susceptibility using relevance networks. Proc. Natl. Acad. Sci. USA 97 12182-12186.
16. CAPUTO, A., FORAITA, R., KLASEN, S. and PIGEOT, I. (2003). Undernutrition in Benin-An analysis based on graphical models. Social Science and Medicine 56 1677-1691.
17. CAPUTO, A., HEINICKE, A. and PIGEOT, I. (1999). A graphical chain model derived from a model selection strategy for the sociologists graduates study. Biom. J. 41 217-234.
18. CASTELO, R. and ROVERATO, A. (2006). A robust procedure for Gaussian graphical model search from microarray data with p larger than n. J. Mach. Learn. Res. 7 2621-2650.
19. CHAUDHURI, S., DRTON, M. and RICHARDSON, T. S. (2007). Estimation of a covariance matrix with zeros. Biometrika 94 199-216.
20. CHICKERING, D. M. (2002). Learning equivalence classes of Bayesian-network structures. J. Mach. Learn. Res. 2 445-498.
21. CONSONNI, G. and LEUCARI, V. (2001). Model determination for directed acyclic graphs. The Statistician 50 243-256.
22. COOPER, G. F. and HERSKOVITS, E. (1992). A Bayesian method for the induction of probabilistic networks from data. Machine Learning 9 309-347.
23. COWELL, R. G., DAWID, A. P., LAURITZEN, S. L. and SPIEGELHALTER, D. J. (1999). Probabilistic Networks and Expert Systems. Springer, New York.
24. COX, D. R. and WERMUTH, N. (1993). Linear dependencies represented by chain graphs. Statist. Sci. 8 204-218.
25. COX, D. R. and WERMUTH, N. (1996). Multivariate Dependencies. Chapman and Hall, London.
26. DAHLHAUS, R. (2000). Graphical interaction models for multivariate time series. Metrika 51 157-172.
27. DAHLHAUS, R. and EICHLER, M. (2003). Causality and graphical models in time series analysis. In Highly Structured Stochastic Systems 27 115-144. Oxford Univ. Press.
28. DAWID, A. P. and LAURITZEN, S. L. (1993). Hyper-Markov laws in the statistical analysis of decomposable graphical models. Ann. Statist. 21 1272-1317.
29. DE LA FUENTE, A., BING, N., HOESCHELE, I. and MENDES, P. (2004). Discovery of meaningful associations in genomic data using partial correlation coefficients. Bioinformatics 20 3565-3574.
30. DELLAPORTAS, P., GIUDICI, P. and ROBERTS, G. (2003). Bayesian inference for nondecomposable graphical Gaussian models. Sankhyā 65 43-55.
31. DEMPSTER, A. P. (1972). Covariance selection. Biometrics 28 157-175.
32. DIDELEZ, V. (2007). Graphical models for composable finite Markov processes. Scand. J. Statist. 34 169-185.
33. DIDELEZ, V., PIGEOT, I., DEAN, K. and WISTER, A. (2002). A comparative analysis of graphical interaction and logistic regression modelling: Self-care and coping with a chronic illness in later life. Biom. J. 44 410-432.
34. DOBRA, A., HANS, C., JONES, B., NEVINS, J. R., YAO, G. and WEST, M. (2004). Sparse graphical models for exploring gene expression data. J. Multivariate Anal. 90 196-212.
35. DRTON, M. and EICHLER, M. (2006). Maximum likelihood estimation in Gaussian chain graph models under the alternative Markov property. Scand. J. Statist. 33 247-257.
36. DRTON, M. and PERLMAN, M. D. (2004). Model selection for Gaussian concentration graphs. Biometrika 91 591-602.
37. DRTON, M. and PERLMAN, M. D. (2007). A SINful approach to Gaussian graphical model selection. J. Statist. Plann. Inference. To appear.
38. DUDOIT, S., SHAFFER, J. P. and BOLDRICK, J. C. (2003). Multiple hypothesis testing in microarray experiments. Statist. Sci. 18 71-103.
39. DUDOIT, S., VAN DER LAAN, M. J. and POLLARD, K. S. (2004). Multiple testing. I. Single-step procedures for control of general type I error rates. Stat. Appl. Genet. Mol. Biol. 3 1-71.
40. EDWARDS, D. and HAVRÁNEK, T. (1985). A fast procedure for model search in multidimensional contingency tables. Biometrika 72 339-351.
41. EDWARDS, D. and HAVRÁNEK, T. (1987). A fast model selection procedure for large families of models. J. Amer. Statist. Assoc. 82 205-211.
42. EDWARDS, D. M. (2000). Introduction to Graphical Modelling, 2nd ed. Springer, New York.
43. EFRON, B., TIBSHIRANI, R., STOREY, J. D. and TUSHER, V. (2001). Empirical Bayes analysis of a microarray experiment. J. Amer. Statist. Assoc. 96 1151-1160.
44. EICHLER, M. (2007). Granger-causality and path diagrams for multivariate time series. J. Econometrics 137 334-353.
45. FRIED, R. and DIDELEZ, V. (2003). Decomposability and selection of graphical models for multivariate time series. Biometrika 90 251-267.
46. FRIEDMAN, N. (2004). Inferring cellular networks using probabilistic graphical models. Science 303 799-805.
47. FRYDENBERG, M. (1990). The chain graph Markov property. Scand. J. Statist. 17 333-353.
48. GIUDICI, P. and GREEN, P. J. (1999). Decomposable graphical Gaussian model determination. Biometrika 86 785-801.
49. HECKERMAN, D., GEIGER, D. and CHICKERING, D. M. (1995). Learning Bayesian networks: The combination of knowledge and statistical data. Machine Learning 20 197-243.
50. HOLM, S. (1979). A simple sequentially rejective multiple test procedure. Scand. J. Statist. 6 65-70.
51. JENSEN, F. V. (2001). Bayesian Networks and Decision Graphs. Springer, New York.
52. JOJIC, V., JOJIC, N., MEEK, C., GEIGER, D., SIEPEL, A., HAUSSLER, D. and HECKERMAN, D. (2004). Efficient approximations for learning phylogenetic HMM models from data. Bioinformatics 20 I161-I168.
53. JONES, B., CARVALHO, C., DOBRA, A., HANS, C., CARTER, C. and WEST, M. (2005). Experiments in stochastic computation for high-dimensional graphical models. Statist. Sci. 20 388-400.
54. JORDAN, M. I. (2004). Graphical models. Statist. Sci. 19 140-155.
55. KAUERMANN, G. (1996). On a dualization of graphical Gaussian models. Scand. J. Statist. 23 105-116.
56. KOSTER, J. T. A. (1999). On the validity of the Markov interpretation of path diagrams of Gaussian structural equations systems with correlated errors. Scand. J. Statist. 26 413-431.
57. KREINER, S. (1987). Analysis of multidimensional contingency tables by exact conditional tests: techniques and strategies. Scand. J. Statist. 14 97-112.
58. LAURITZEN, S. L. (1996). Graphical Models. Oxford Univ. Press, New York.
59. LAURITZEN, S. L. (2001). Causal inference from graphical models. In Complex Stochastic Systems (Eindhoven, 1999) 63-107. Chapman and Hall/CRC, Boca Raton, FL.
60. LAURITZEN, S. L. and SHEEHAN, N. A. (2003). Graphical models for genetic analyses. Statist. Sci. 18 489-514.
61. LAURITZEN, S. L. and WERMUTH, N. (1989). Graphical models for associations between variables, some of which are qualitative and some quantitative. Ann. Statist. 17 31-57.
62. LEHMANN, E. L. and ROMANO, J. P. (2005). Generalizations of the familywise error rate. Ann. Statist. 33 1138-1154.
63. LEVITZ, M., PERLMAN, M. D. and MADIGAN, D. (2001). Separation and completeness properties for AMP chain graph Markov models. Ann. Statist. 29 1751-1784.
64. LI, H. and GUI, J. (2006). Gradient directed regularization for sparse Gaussian concentration graphs, with applications to inference of genetic networks. Biostatistics 7 302-317.
65. MADIGAN, D. and RAFTERY, A. E. (1994). Model selection and accounting for model uncertainty in graphical models using Occam's window. J. Amer. Statist. Assoc. 89 1535-1546.
66. MAGWENE, P. M. and KIM, J. (2004). Estimating genomic coexpression networks using first-order conditional independence. Genome Biology 5 R100.
67. MATSUNO, T., TOMINAGA, N., ARIZONO, K., IGUCHI, T. and KOHARA, Y. (2006). Graphical Gaussian modeling for gene association structures based on expression deviation patterns induced by various chemical stimuli. IEICE Transactions on Information and Systems E89-D 1563-1574.
68. MC AULIFFE, J. D., PACHTER, L. and JORDAN, M. I. (2004). Multiple-sequence functional annotation and the generalized hidden Markov phylogeny. Bioinformatics 20 1850-1860.
69. MEINSHAUSEN, N. and BÜHLMANN, P. (2005). Lower bounds for the number of false null hypotheses for multiple testing of associations under general dependence structures. Biometrika 92 893-907.
70. MEINSHAUSEN, N. and BÜHLMANN, P. (2006). High-dimensional graphs and variable selection with the Lasso. Ann. Statist. 34 1436-1462.
71. MOHAMED, W. N., DIAMOND, I. and SMITH, P. F. (1998). The determinants of infant mortality in Malaysia: A graphical chain modelling approach. J. Roy. Statist. Soc. Ser. A 161 349-366.
72. OLKIN, I. and SIOTANI, M. (1976). Asymptotic distribution of functions of a correlation matrix. In Essays in Probability and Statistics 235-251. Shinko Tsusho, Tokyo.
73. PEARL, J. (2000). Causality. Cambridge University Press, Cambridge.
74. PEARL, J. and WERMUTH, N. (1994). When can association graphs admit a causal interpretation? In Selecting Models from Data: Artificial Intelligence and Statistics IV (P. Cheeseman et al., eds.). Lecture Notes in Statist. 89 205-214. Springer, New York.
75. POLLARD, K. S. and VAN DER LAAN, M. J. (2004). Choice of a null distribution in resampling-based multiple testing. J. Statist. Plann. Inference 125 85-100.
76. RICHARDSON, T. S. (2003). Markov properties for acyclic directed mixed graphs. Scand. J. Statist. 30 145-157.
77. RICHARDSON, T. S. and SPIRTES, P. (2002). Ancestral graph Markov models. Ann. Statist. 30 962-1030.
78. ROMANO, J. P. and WOLF, M. (2005). Control of generalized error rates in multiple testing. Working Paper 245, Institute for Empirical Research in Economics, Univ. Zurich. Available at http://www.iew. unizh.ch/wp/iewwp245.pdf.
79. ROVERATO, A. (1996). Partial correlation coefficient comparison in graphical Gaussian models. In COMPSTAT. Proceedings in Computational Statistics, 12th Symposium 429-434. Physica, Heidelberg.
80. ROVERATO, A. (2002). Hyper inverse Wishart distribution for non-decomposable graphs and its application to Bayesian inference for Gaussian graphical models. Scand. J. Statist. 29 391-411.
81. ROVERATO, A. and CONSONNI, G. (2004). Compatible prior distributions for directed acyclic graph models. J. R. Stat. Soc. Ser. B Stat. Methodol. 66 47-61.
82. ROVERATO, A. and WHITTAKER, J. (1998). The Isserlis matrix and its application to non-decomposable graphical Gaussian models. Biometrika 85 711-725.
83. SCHÄFER, J. and STRIMMER, K. (2005). An empirical Bayes approach to inferring large-scale gene association networks. Bioinformatics 21 754-764.
84. SCHWARZ, G. (1978). Estimating the dimension of a model. Ann. Statist. 6 461-464.
85. SIDÁK, Z. (1967). Rectangular confidence regions for the means of multivariate normal distributions. J. Amer. Statist. Assoc. 62 626-633.
86. SMITH, P. (1992). Assessing the power of model selection procedures used when graphical modelling. In Computational Statistics (Y. Dodge and J. Whittaker, eds.) 275-280. Physica, Heidelberg.
87. SPIRTES, P., GLYMOUR, C. and SCHEINES, R. (2000). Causation, Prediction, and Search, 2nd ed. MIT Press, Cambridge, MA.
88. STUDENÝ, M. (2005). Probabilistic Conditional Independence Structures. Springer, London.
89. STUDENÝ, M. and BOUCKAERT, R. R. (1998). On chain graph models for description of conditional independence structures. Ann. Statist. 26 1434-1495.
90. STUDENÝ, M. and ROVERATO, A. (2006). A graphical representation of equivalence classes of AMP chain graphs. J. Mach. Learn. Res. 7 1045-1078.
91. VAN DER LAAN, M. J., DUDOIT, S. and POLLARD, K. S. (2004a). Augmentation procedures for control of the generalized family-wise error rate and tail probabilities for the proportion of false positives. Stat. Appl. Genet. Mol. Biol. 3 1-27.
92. VAN DER LAAN, M. J., DUDOIT, S. and POLLARD, K. S. (2004b). Multiple testing. II. Step-down procedures for control of the family-wise error rate. Stat. Appl. Genet. Mol. Biol. 3 1-35.
93. VAN DER VAART, A. W. (1998). Asymptotic Statistics. Cambridge Univ. Press.
94. WERMUTH, N. (1976). Analogies between multiplicative models in contingency tables and covariance selection. Biometrics 32 95-108.
95. WERMUTH, N. (1980). Linear recursive equations, covariance selection, and path analysis. J. Amer. Statist. Assoc. 75 963-972.
96. WERMUTH, N. and COX, D. R. (2004). Joint response graphs and separation induced by triangular systems. J. R. Stat. Soc. Ser. B Stat. Methodol. 66 687-717.
97. WERMUTH, N., COX, D. R. and MARCHETTI, G. M. (2006). Covariance chains. Bernoulli 12 841-862.
98. WERMUTH, N. and LAURITZEN, S. L. (1990). On substantive research hypotheses, conditional independence graphs and graphical chain models. J. Roy. Statist. Soc. B 52 21-50, 51-72.
99. WESTFALL, P.H. and YOUNG, S. (1993). Resampling-Based Multiple Testing: Examples and Methods for p-Value Adjustment. Wiley, New York.
100. WHITTAKER, J. (1990). Graphical Models in Applied Multivariate Statistics. Wiley, Chichester.
101. WILLE, A. and BÜHLMANN, P. (2006). Low-order conditional independence graphs for inferring genetic networks. Stat. Appl. Genet. Mol. Biol. 5.
102. WILLE, A., ZIMMERMANN, P., VRANOVA, E., FÜRHOLZ, A., LAULE, O., BLEULER, S., HENNIG, L., PRELIC, A., VON ROHR, P., THIELE, L., ZITZLER, E., GRUISSEM, W. and BÜHLMANN, P. (2004). Sparse graphical Gaussian modeling of the isoprenoid gene network in arabidopsis thaliana. Genome Biology 5 R92.