Large-scale inference: Empirical Bayes methods for estimation, testing, and prediction

Large-Scale Inference Empirical Bayes Methods for Estimation, Testing, and Prediction

Volumn , Issue , 2012, Pages 1-263

  Efron, Bradley ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84929731128     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1017/CBO9780511761362     Document Type: Book

References (109)

1. Allison, David B., Gadbury, Gary L., Heo, Moonseong, Fernandez, José R., Lee, Cheol- Koo, Prolla, Tomas A., and Weindruch, Richard. 2002. A mixture model approach for the analysis of microarray gene expression data. Comput. Statist. Data Anal., 39(1), 1-20.
2. Ashley, Euan A., Ferrara, Rossella, King, Jennifer Y., Vailaya, Aditya, Kuchinsky, Allan, He, Xuanmin, Byers, Blake, Gerckens, Ulrich, Oblin, Stefan, Tsalenko, Anya, Soito, Angela, Spin, Joshua M., Tabibiazar, Raymond, Connolly, Andrew J., Simpson, John B., Grube, Eberhard, and Quertermous, Thomas. 2006. Network analysis of human in-stent restenosis. Circulation, 114(24), 2644-2654.
3. Aubert, J., Bar-Hen, A., Daudin, J.J., and Robin, S. 2004. Determination of the differentially expressed genes in microarray experiments using local FDR. BMC Bioinformatics, 5(September).
4. Benjamini, Yoav, and Hochberg, Yosef. 1995. Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. Roy. Statist. Soc. Ser. B, 57(1), 289-300.
5. Benjamini, Yoav, and Yekutieli, Daniel. 2001. The control of the false discovery rate in multiple testing under dependency. Ann. Statist., 29(4), 1165-1188.
6. Benjamini, Yoav, and Yekutieli, Daniel. 2005. False discovery rate-adjusted multiple confidence intervals for selected parameters. J. Amer. Statist. Assoc., 100(469), 7193. With comments and a rejoinder by the authors.
7. Broberg, Per. 2004. A new estimate of the proportion unchanged genes in a microarray experiment. Genome Biology, 5(5), P10.
8. Brown, L.D. 1971. Admissible estimators, recurrent diffusions, and insoluble boundary value problems. Ann. Math. Statist., 42, 855-903.
9. Clarke, Sandy, and Hall, Peter. 2009. Robustness of multiple testing procedures against dependence. Ann. Statist., 37(1), 332-358.
10. Desai, K., Deller, J., and McCormick, J. 2010. The distribution of number of false discoveries for highly correlated null hypotheses. Ann. Appl. Statist. submitted, under review.
11. Donoho, David, and Jin, Jiashun. 2009. Higher criticism thresholding: Optimal feature selection when useful features are rare and weak. Proc. Natl. Acad. Sci. USA, 105, 14790-14795.
12. Dudoit, Sandrine, and van der Laan, Mark J. 2008. Multiple Testing Procedures with Applications to Genomics. Springer Series in Statistics. New York: Springer.
13. Dudoit, Sandrine, Shaffer, Juliet Popper, and Boldrick, Jennifer C. 2003. Multiple hypothesis testing in microarray experiments. Statist. Sci., 18(1), 71-103.
14. Dudoit, Sandrine, van der Laan, Mark J., and Pollard, Katherine S. 2004. Multiple testing. I. Single-step procedures for control of general type I error rates. Stat. Appl. Genet. Mol. Biol., 3, Art. 13, 71 pp. (electronic).
15. Efron, Bradley. 1969. Student's t-test under symmetry conditions. J. Amer. Statist. Assoc., 64, 1278-1302.
16. Efron, Bradley. 1987. Better bootstrap confidence intervals. J. Amer. Statist. Assoc., 82(397), 171-200. With comments and a rejoinder by the author.
17. Efron, Bradley. 1996. Empirical Bayes methods for combining likelihoods. J. Amer. Statist. Assoc., 91(434), 538-565. With discussion and a reply by the author.
18. Efron, Bradley. 2003. Robbins, empirical Bayes and microarrays. Ann. Statist., 31(2), 366-378.
19. Efron, Bradley. 2004. Large-scale simultaneous hypothesis testing: The choice of a null hypothesis. J. Amer. Statist. Assoc., 99(465), 96-104.
20. Efron, Bradley. 2007a. Correlation and large-scale simultaneous significance testing. J. Amer. Statist. Assoc., 102(477), 93-103.
21. Efron, Bradley. 2007b. Size, power and false discovery rates. Ann. Statist., 35(4), 1351-1377.
22. Efron, Bradley. 2008a. Microarrays, empirical Bayes and the two-groups model. Statist. Sci., 23(1), 1-22.
23. Efron, Bradley. 2008b. Simultaneous inference: When should hypothesis testing problems be combined? Ann. Appl. Statist., 2(1), 197-223.
24. Efron, Bradley. 2009a. Are a set of microarrays independent of each other? Ann. Appl. Statist., 3(September), 922-942.
25. Efron, Bradley. 2009b. Empirical Bayes estimates for large-scale prediction problems. J. Amer. Statist. Assoc., 104(September), 1015-1028.
26. Efron, Bradley. 2010. Correlated z-values and the accuracy of large-scale statistical estimates. J. Amer. Statist. Assoc. to appear.
27. Efron, Bradley, and Gous, Alan. 2001. Scales of evidence for model selection: Fisher versus Jeffreys. Pages 208-256 of: Model Selection. IMS Lecture Notes Monogr. Ser., vol. 38. Beachwood, OH: Inst. Math. Statist. With discussion by R. E. Kass, G. S. Datta, and P. Lahiri, and a rejoinder by the authors.
28. Efron, Bradley, and Morris, Carl. 1971. Limiting the risk of Bayes and empirical Bayes estimators. I. The Bayes case. J. Amer. Statist. Assoc., 66, 807-815.
29. Efron, Bradley, and Morris, Carl. 1972. Limiting the risk of Bayes and empirical Bayes estimators. II. The empirical Bayes case. J. Amer. Statist. Assoc., 67, 130-139.
30. Efron, Bradley, and Morris, Carl. 1973. Stein's estimation rule and its competitors - An empirical Bayes approach. J. Amer. Statist. Assoc., 68, 117-130.
31. Efron, Bradley, and Thisted, Ronald. 1976. Estimating the number of unseen species: How many words did Shakespeare know? Biometrika, 63(3), 435-447.
32. Efron, Bradley, and Tibshirani, Robert. 1993. An Introduction to the Bootstrap. Monographs on Statistics and Applied Probability, vol. 57. New York: Chapman and Hall.
33. Efron, Bradley, and Tibshirani, Robert. 1996. Using specially designed exponential families for density estimation. Ann. Statist., 24(6), 2431-2461.
34. Efron, Bradley, and Tibshirani, Robert. 2007. On testing the significance of sets of genes. Ann. Appl. Statist., 1(1), 107-129.
35. Efron, Bradley, Tibshirani, Robert, Storey, John D., and Tusher, Virginia. 2001. Empirical Bayes analysis of a microarray experiment. J. Amer. Statist. Assoc., 96(456), 1151-1160.
36. Ferkingstad, Egil, Frigessi, Arnoldo, Rue, Hâvard, Thorleifsson, Gudmar, and Kong, Augustine. 2008. Unsupervised empirical Bayesian multiple testing with external covariates. Ann. Appl. Statist., 2(2), 714-735.
37. Fisher, R.A. 1935. The Design of Experiments. Edinburgh: Oliver and Boyd.
38. Fisher, R.A., Corbet, A.S., and Williams, C.B. 1943. The relation between the number of species and the number of individuals in a random sample of an animal population. J. Anim. Ecol., 12, 42-58.
39. Genovese, Christopher, and Wasserman, Larry. 2002. Operating characteristics and extensions of the false discovery rate procedure. J. Roy. Statist. Soc. Ser. B, 64(3), 499-517.
40. Genovese, Christopher, and Wasserman, Larry. 2004. A stochastic process approach to false discovery control. Ann. Statist., 32(3), 1035-1061.
41. Genovese, Christopher R., Roeder, Kathryn, and Wasserman, Larry. 2006. False discovery control with p-value weighting. Biometrika, 93(3), 509-524.
42. Golub, T.R., Slonim, D.K., Tamayo, P., Huard, C., Gaasenbeek, M., Mesirov, J.P., Coller, H., Loh, M.L., Downing, J.R., Caligiuri, M.A., Bloomfield, C.D., and Lander, E.S. 1999. Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring. Science, 286(5439), 531-537.
43. Good, I.J. 1953. The population frequencies of species and the estimation of population parameters. Biometrika, 40, 237-264.
44. Good, I.J., and Toulmin, G.H. 1956. The number of new species, and the increase in population coverage, when a sample is increased. Biometrika, 43, 45-63.
45. Gottardo, Raphael, Raftery, Adrian E., Yeung, Ka Yee, and Bumgarner, Roger E. 2006. Bayesian robust inference for differential gene expression in microarrays with multiple samples. Biometrics, 62(1), 10-18, 313.
46. Hall, Peter. 1992. The Bootstrap and Edgeworth Expansion. Springer Series in Statistics. New York: Springer-Verlag.
47. Hastie, Trevor, Tibshirani, Robert, and Friedman, Jerome. 2009. The Elements of Statistical Learning. 2nd edn. Springer Series in Statistics. New York: Springer.
48. Hedenfalk, I., Duggan, D., Chen, Y.D., Radmacher, M., Bittner, M., Simon, R., Meltzer, P., Gusterson, B., Esteller, M., Kallioniemi, O.P., Wilfond, B., Borg, A., Trent, J., Raffeld, M., Yakhini, Z., Ben-Dor, A., Dougherty, E., Kononen, J., Bubendorf, L., Fehrle, W., Pittaluga, S., Gruvberger, S., Loman, N., Johannsoson, O., Olsson, H., and Sauter, G. 2001. Gene-expression profiles in hereditary breast cancer. N. Engl. J. Med., 344(8), 539-548.
49. Heller, G., and Qing, J. 2003. A mixture model approach for finding informative genes in microarray studies. Unpublished.
50. Hochberg, Yosef. 1988. A sharper Bonferroni procedure for multiple tests of significance. Biometrika, 75(4), 800-802.
51. Hoeffding, Wassily. 1952. The large-sample power of tests based on permutations of observations. Ann. Math. Statist., 23, 169-192.
52. Holm, Sture. 1979. A simple sequentially rejective multiple test procedure. Scand. J. Statist., 6(2), 65-70.
53. Hommel, G. 1988. A stagewise rejective multiple test procedure based on a modified Bonferroni test. Biometrika, 75(2), 383-386.
54. James, W., and Stein, Charles. 1961. Estimation with quadratic loss. Pages 361-379 of: Proc. 4th Berkeley Sympos. Math. Statist. and Prob., Vol. I. Berkeley, Calif.: Univ. California Press.
55. Jin, Jiashun, and Cai, T. Tony. 2007. Estimating the null and the proportional of nonnull effects in large-scale multiple comparisons. J. Amer. Statist. Assoc., 102(478), 495-506.
56. Jin, Jiashun, and Cai, T. Tony. 2010. Optimal rates of convergence for estimating the null density and proportion of non-null effects in large-scale multiple testing. Ann. Statist., 38(1), 100-145.
57. Johnson, Norman L., and Kotz, Samuel. 1970. Distributions in Statistics. Continuous Univariate Distributions. 1. Boston, Mass.: Houghton Mifflin Co.
58. Johnstone, Iain M., and Silverman, Bernard W. 2004. Needles and straw in haystacks: Empirical Bayes estimates of possibly sparse sequences. Ann. Statist., 32(4), 1594-1649.
59. Kerr, M.K., Martin, M., and Churchill, G.A. 2000. Analysis of variance for gene expression microarray data. J. Comput. Biology, 7(6), 819-837.
60. Lancaster, H.O. 1958. The structure of bivariate distributions. Ann. Math. Statist., 29, 719-736.
61. Lehmann, Erich L., and Romano, Joseph P. 2005a. Generalizations of the familywise error rate. Ann. Statist., 33(3), 1138-1154.
62. Lehmann, Erich L., and Romano, Joseph P. 2005b. Testing Statistical Hypotheses. 3rd edn. Springer Texts in Statistics. New York: Springer.
63. Lemley, Kevin V., Lafayette, Richard A., Derby, Geraldine, Blouch, Kristina L., Anderson, Linda, Efron, Bradley, and Myers, Bryan D. 2008. Prediction of early progression in recently diagnosed IgA nephropathy. Nephrol. Dialysis Transplant., 23(1), 213-222.
64. Liao, J.G., Lin, Y., Selvanayagam, Z.E., and Shih, W.C.J. 2004. A mixture model for estimating the local false discovery rate in DNA microarray analysis. BMC Bioinformatics, 20(16), 2694-2701.
65. Lindsey, J.K. 1974. Construction and comparison of statistical models. J. Roy. Statist. Soc. Ser. B, 36, 418-425.
66. Marcus, Ruth, Peritz, Eric, and Gabriel, K.R. 1976. On closed testing procedures with special reference to ordered analysis of variance. Biometrika, 63(3), 655-660.
67. McCullagh, P., and Nelder, J.A. 1989. Generalized Linear Models. 2nd edn. Monographs on Statistics and Applied Probability. London: Chapman & Hall.
68. Miller, Jr., Rupert G. 1981. Simultaneous Statistical Inference. 2nd edn. Springer Series in Statistics. New York: Springer-Verlag.
69. Morris, Carl N. 1983. Parametric empirical Bayes inference: Theory and applications. J. Amer. Statist. Assoc., 78(381), 47-65. With discussion.
70. Muralidharan, Omkar. 2009. High dimensional exponential family estimation via empirical Bayes. Unpublished.
71. Muralidharan, Omkar. 2010. An empirical Bayes mixture method for effect size and false discovery rate estimation. Ann. Appl. Statist., 4(1), 422-438.
72. Newton, M.A., Noueiry, A., Sarkar, D., and Ahlquist, P. 2004. Detecting differential gene expression with a semiparametric hierarchical mixture method. Biostatistics, 5(2), 155-176.
73. Olshen, Richard, and Rajaratnam, Bala. 2009. The effect of correlation in false discovery rate estimation. Tech. rept. Stanford University Department of Statistics.
74. Owen, Art B. 2005. Variance of the number of false discoveries. J. Roy. Statist. Soc. Ser. B, 67(3), 411-426.
75. Pan, Wei, Lin, Jizhen, and Le, Chap T. 2003. A mixture model approach to detecting differentially expressed genes with microarray data. Funct. Integr. Genomics, 3(3), 117-124.
76. Pavlidis, Paul, Lewis, Darrin P., and Noble, William Stafford. 2002. Exploring gene expression data with class scores. Pac. Symp. Biocomput., 474-485.
77. Pitman, E.J.G. 1937. Significance Tests Which May be Applied to Samples From Any Populations. Suppl. J. Roy. Statist. Soc., 4(1), 119-130.
78. Pounds, S., and Morris, S.W. 2003. Estimating the occurrence of false positives and false negatives in microarray studies by approximating and partitioning the empirical distribution of p-values. BMC Bioinformatics, 19(10), 1236-1242.
79. Qiu, Xing, Klebanov, Lev, and Yakovlev, Andrei. 2005a. Correlation between gene expression levels and limitations of the empirical Bayes methodology for finding differentially expressed genes. Stat. Appl. Genet. Mol. Biol., 4, Art. 34, 32 pp. (electronic).
80. Qiu, Xing, Brooks, Andrew, Klebanov, Lev, and Yakovlev, Andrei. 2005b. The effects of normalization on the correlation structure of microarray data. BMC Bioinformatics, 6(1), 120.
81. Rahnenführer, Jorg, Domingues, Francisco S., Maydt, Jochen, and Lengauer, Thomas. 2004. Calculating the statistical significance of changes in pathway activity from gene expression data. Stat. Appl. Genet. Mol. Biol., 3, Art. 16, 31 pp. (electronic).
82. Ridgeway, Greg, and MacDonald, John M. 2009. Doubly robust internal benchmarking and false discovery rates for detecting racial bias in police stops. J. Amer. Statist. Assoc., 104(486), 661-668.
83. Robbins, Herbert. 1956. An empirical Bayes approach to statistics. Pages 157-163 of: Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability, 1954-1955, vol. I. Berkeley and Los Angeles: University of California Press.
84. Robbins, Herbert. 1968. Estimating the total probability of the unobserved outcomes of an experiment. Ann. Math. Statist., 39, 256-257.
85. Romano, Joseph P., Shaikh, Azeem M., and Wolf, Michael. 2008. Control of the false discovery rate under dependence using the bootstrap and subsampling. TEST, 17(3), 417-442.
86. Schwartzman, A., and Lin, X. 2009. The effect of correlation in false discovery rate estimation. Biostatistics Working Paper Series number 106. Harvard University.
87. Schwartzman, A., Dougherty, R.F., and Taylor, J.E. 2005. Cross-subject comparison of principal diffusion direction maps. Magn. Reson. Med., 53(6), 1423-1431.
88. Simes, R.J. 1986. An improved Bonferroni procedure for multiple tests of significance. Biometrika, 73(3), 751-754.
89. Singh, Dinesh, Febbo, Phillip G., Ross, Kenneth, Jackson, Donald G., Manola, Judith, Ladd, Christine, Tamayo, Pablo, Renshaw, Andrew A., D’Amico, Anthony V., Richie, Jerome P., Lander, Eric S., Loda, Massimo, Kantoff, Philip W., Golub, Todd R., and Sellers, William R. 2002. Gene expression correlates of clinical prostate cancer behavior. Cancer Cell, 1(2), 203-209.
90. Singh, R.S. 1979. Empirical Bayes estimation in Lebesgue-exponential families with rates near the best possible rate. Ann. Statist., 7(4), 890-902.
91. Smyth, Gordon K. 2004. Linear models and empirical Bayes methods for assessing differential expression in microarray experiments. Stat. Appl. Genet. Mol. Biol., 3, Art. 3, 29 pp. (electronic).
92. Soric, Branko. 1989. Statistical “discoveries” and effect-size estimation. J. Amer. Statist. Assoc., 84(406), 608-610.
93. Spevack, Marvin. 1968. A Complete and Systematic Concordance to the Works of Shakespeare, Vols 1-6. Hildesheim: George Olms.
94. Stein, Charles M. 1956. Inadmissibility of the usual estimator for the mean of a multivariate normal distribution. Pages 197-206 of: Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability, 1954-1955, vol. I. Berkeley and Los Angeles: University of California Press.
95. Stein, Charles M. 1981. Estimation of the mean of a multivariate normal distribution. Ann. Statist., 9(6), 1135-1151.
96. Storey, John D. 2002. A direct approach to false discovery rates. J. Roy. Statist. Soc. Ser. B, 64(3), 479-498.
97. Storey, John D. 2003. The positive false discovery rate: A Bayesian interpretation and the g-value. Ann. Statist., 31(6), 2013-2035.
98. Storey, John D. 2007. The optimal discovery procedure: A new approach to simultaneous significance testing. J. Roy. Statist. Soc. Ser. B, 69(3), 347-368.
99. Storey, John D., Taylor, Jonathan E., and Siegmund, David. 2004. Strong control, conservative point estimation and simultaneous conservative consistency of false discovery rates: A unified approach. J. Roy. Statist. Soc. Ser. B, 66(1), 187-205.
100. Subramanian, A., Tamayo, P., Mootha, V. K., Mukherjee, S., Ebert, B.L., Gillette, M.A., Paulovich, A., Pomeroy, S.L., Golub, T.R., Lander, E.S., and Mesirov, J.P. 2004. Gene set enrichment analysis: A knowledge-based approach for interpreting genome-wide expression profiles. Proc. Natl. Acad. Sci., 102(43), 15545-15550.
101. Thisted, Ronald, and Efron, Bradley. 1987. Did Shakespeare write a newly-discovered poem? Biometrika, 74(3), 445-455.
102. Tibshirani, Robert, and Efron, Brad. 2002. Pre-validation and inference in microarrays. Stat. Appl. Genet. Mol. Biol., 1, Art. 1, 20 pp. (electronic).
103. Tibshirani, Robert, and Hastie, Trevor. 2007. Outlier sums for differential gene expression analysis. Biostatistics, 8(1), 2-8.
104. Tibshirani, Robert, Hastie, Trevor, Narasimhan, Balasubramanian, and Chu, Gilbert. 2002. Diagnosis of multiple cancer types by shrunken centroids of gene expression. Proc. Natl. Acad. Sci. USA, 99(10), 6567-6572.
105. Tibshirani, Ryan, and Tibshirani, Robert. 2009. A bias-correction for the minimum error rate in cross-validation. Ann. Appl. Statist., 822-829.
106. Tomlins, S.A., Rhodes, D.R., Perner, S., Dhanasekaran, S.M., Mehra, R., Sun, X.W., Varambally, S., Cao, X.H., Tchinda, J., Kuefer, R., Lee, C., Montie, J.E., Shah, R.B., Pienta, K.J., Rubin, M.A., and Chinnaiyan, A.M. 2005. Recurrent fusion of TM- PRSS2 and ETS transcription factor genes in prostate cancer. Science, 310(5748), 644-648.
107. van’t Wout, A.B., Lehrman, G.K., Mikheeva, S.A., O’Keefe, G.C., Katze, M.G., Bumgarner, R.E., Geiss, G.K., and Mullins, J.I. 2003. Cellular gene expression upon human immunodeficiency virus type 1 infection of CD4(+)-T-cell lines. J. Virol, 77(2), 1392-1402.
108. Westfall, P.H., and Young, S.S. 1993. Resampling-based Multiple Testing: Examples and Methods for p-Value Adjustment. Wiley Series in Probability and Statistics. New York, NY: Wiley-Interscience.
109. Wu, Baolin. 2007. Cancer outlier differential gene expression detection. Biostatistics, 8(3), 566-575.