Validation of differential gene expression algorithms: Application comparing fold-change estimation to hypothesis testing

BMC Bioinformatics

Volumn 11, Issue , 2010, Pages

  Yanofsky, Corey M ^a   Bickel, David R ^a,b  

^a UNIVERSITY OF OTTAWA   (Canada)

^b UNIVERSITY OF OTTAWA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM PERFORMANCE; CONVENTIONAL MODELING; CROSS-VALIDATION METHODS; DIFFERENTIAL GENE EXPRESSIONS; EMPIRICAL BAYES METHOD; NONPARAMETRIC METHODS; SIGNIFICANCE TESTING; STATISTICAL ALGORITHM;

BAYESIAN NETWORKS; ESTIMATION; FORECASTING; GENES; HIERARCHICAL SYSTEMS; MICROARRAYS; STATISTICAL TESTS;

ALGORITHMS;

ALGORITHM; ARTICLE; DNA MICROARRAY; EVALUATION; GENE EXPRESSION PROFILING; METHODOLOGY; STATISTICAL ANALYSIS; VALIDATION STUDY;

ALGORITHMS; DATA INTERPRETATION, STATISTICAL; GENE EXPRESSION PROFILING; OLIGONUCLEOTIDE ARRAY SEQUENCE ANALYSIS;

EID: 77949495872     PISSN: None     EISSN: 14712105     Source Type: Journal    
DOI: 10.1186/1471-2105-11-63     Document Type: Article

References (48)

1. Allison DB, Cui X, Page GP, Sabripour M. Microarray data analysis: From disarray to consolidation and consensus. Nature Reviews Genetics 2006, 7:55-65. 10.1038/nrg1749, 16369572.
2. Dudoit S, Fridlyand J, Speed TP. Comparison of discrimination methods for the classification of tumors using gene expression data. Journal of the American Statistical Association 2002, 97(457):77-86.
3. Chen J, Laan MJ, Smith MT, Hubbard AE. A comparison of methods to control Type I errors in microarray studies. Statistical Applications in Genetics and Molecular Biology 2007, 6:28.
4. Murie C, Woody O, Lee AY, Nadon R. Comparison of small n statistical tests of differential expression applied to microarrays. BMC bioinformatics 2009, 10:45. 10.1186/1471-2105-10-45, 2674054, 19192265.
5. Kooperberg C, Aragaki A, Strand AD, Olson JM. Significance testing for small microarray experiments. Statistics in medicine 2005, 24(15):2281-2298. 10.1002/sim.2109, 15889452.
6. Qin LX, Kerr KF, . of the Toxicogenomics Research Consortium CM Empirical evaluation of data transformations and ranking statistics for microarray analysis. Nucleic acids research 2004, 32(18):5471-5479. 10.1093/nar/gkh866, 524279, 15479783, of the Toxicogenomics Research Consortium CM.
7. McCall MN, Irizarry RA. Consolidated strategy for the analysis of microarray spike-in data. Nucleic acids research 2008, 36(17):el08.
8. Guo L, Lobenhofer EK, Wang C, Shippy R, Harris SC, Zhang L, Mei N, Chen T, Herman D, Goodsaid FM, Hurban P, Phillips KL, Xu J, Deng X, Sun YA, Tong W, Dragan YP, Shi L. Rat toxicogenomic study reveals analytical consistency across microarray platforms. Nat Biotech 2006, 24(9):1162-1169.
9. Rockett JC, Hellmann GM. Confirming microarray data - Is it really necessary?. Genomics 2004, 83(4):541-549. 10.1016/j.ygeno.2003.09.017, 15028276.
10. Pepe MS, Longton G, Anderson GL, Schummer M. Selecting differentially expressed genes from microarray experiments. Biometrics 2003, 59:133-142. 10.1111/1541-0420.00016, 12762450.
11. Chen JJ, Hsueh HM, Delongchamp RR, Lin CJ, Tsai CA. Reproducibility of microarray data: A further analysis of microarray quality control (MAQC) data. BMC Bioinformatics 2007, 8.
12. Aubert J, Bar-Hen A, Daudin JJ, Robin S. Determination of the differentially expressed genes in microarray experiments using local FDR. BMC Bioinformatics 2004, 5:125. 10.1186/1471-2105-5-125, 520755, 15350197.
13. Aubert J, Bar-Hen A, Daudin JJ, Robin S. Correction: Determination of the differentially expressed genes in microarray experiments using local FDR (BMC Bioinformatics). BMC Bioinformatics 2005, 6:42.
14. Jones LBT, Bean R, McLachlan GJ, Zhu JXI. Mixture models for detecting differentially expressed genes in microarrays. International journal of neural systems 2006, 16(5):353-362. 10.1142/S0129065706000755, 17117496.
15. Liao JG, Lin Y, Selvanayagam ZE, Shih WJ. A mixture model for estimating the local false discovery rate in DNA microarray analysis. Bioinformatics 2004, 20(16):2694-2701. 10.1093/bioinformatics/bth310, 15145810.
16. McLachlan GJ, Bean RW, Jones LBT, Zhu JX. Using mixture models to detect differentially expressed genes. Australian Journal of Experimental Agriculture 2005, 45(7-8):859-866.
17. Pawitan Y. All Likelihood: Statistical Modeling and Inference Using Likelihood 2001, Oxford: Clarendon Press.
18. Ploner A, Calza S, Gusnanto A, Pawitan Y. Multidimensional local false discovery rate for microarray studies. Bioinformatics 2006, 22(5):556-565. 10.1093/bioinformatics/btk013, 16368770.
19. Pounds S, Morris SW. Estimating the occurrence of false positives and false negatives in microarray studies by approximating and partitioning the empirical distribution of p-values. Bioinformatics 2003, 19(10):1236-1242. 10.1093/bioinformatics/btg148, 12835267.
20. Scheid S, Spang R. A stochastic downhill search algorithm for estimating the local false discovery rate. IEEE/ACM Transactions on Computational Biology and Bioinformatics 2004, 1(3):98-108.
21. Scheid S, Spang R. Twilight; a Bioconductor package for estimating the local false discovery rate. Bioinformatics 2005, 21(12):2921-2922. 10.1093/bioinformatics/bti436, 15817688.
22. Efron B, Tibshirani R, Storey JD, Tusher V. Empirical Bayes Analysis of a Microarray Experiment. Am Stat Assoc 2001, 96(456):1151-1160.
23. Genovese C, Wasserman L. Bayesian Statistics 7: Proceedings of the Seventh Valencia International Meeting, June 2-62002, Bayesian and frequentist multiple testing 2003, 145-161. Oxford: Oxford University Press.
24. Bates D, Chambers J, Dalgaard P, Falcon S, Gentleman R, Hornik K, lacus S, Ihaka R, Leisch F, Lumley T, Maechler M, Murdoch D, Murrell P, Plummer M, Ripley B, Sarkar D, Lang DT, Tierney L, Urbanek S. 2009, R: A Language and Environment for Statistical Computing. Vienna, Austria.
25. Smyth GK. Linear models and empirical Bayes methods for assessing differential expression in microarray experiments. Statistical Applications in Genetics and Molecular Biology 2004, 3:Article 3.
26. Efron B. Large-Scale Simultaneous Hypothesis Testing: The Choice of a Null Hypothesis. Journal of the American Statistical Association 2004, 99(465):96-104.
27. Efron B. Size, power and false discovery rates. Annals of Statistics 2007, 35:1351-1377.
28. Bickel DR. HighProbability determines which alternative hypotheses are sufficiently probable: Genomic applications include detection of differential gene expression. arXiv 2004, q-bio/0402049..
29. Bickel DR. Error-rate and decision-theoretic methods of multiple testing: Which genes have high objective probabilities of differential expression?. Statistical Applications in Genetics and Molecular Biology 2004, 3:8.
30. Schwarz G. Estimating the Dimension of a Model. The Annals of Statistics 1978, 6(2):461-464.
31. Efron B, Gous A, Kass RE, Datta GS, Lahiri P. Scales of Evidence for Model Selection: Fisher versus Jeffreys. Lecture Notes-Monograph Series 2001, 38(Model Selection):208-256.
32. Burnham KP, Anderson D. Model Selection and Multi-Model Inference 2002, New York, NY: Springer.
33. Hurvich CM, Tsai CL. Regression and Time Series Model Selection in Small Samples. Biometrika 1989, 76(2):297-307.
34. Bickel DR. Correcting the estimated level of differential expression for gene selection bias: Application to a microarray study. Statistical Applications in Genetics and Molecular Biology 2008, 7:10.
35. Bickel DR, Frhwirth R. On a fast, robust estimator of the mode: comparisons to other robust estimators with applications. Computational Statistics and Data Analysis 2006, 50:3500-3530.
36. Jeffery IB, Higgins DG, Culhane AC. Comparison and evaluation of methods for generating differentially expressed gene lists from microarray data. BMC Bioinformatics 2006, 7:359. 10.1186/1471-2105-7-359, 1544358, 16872483.
37. Montazeri Z, Yanofsky CM, Bickel DR. Shrinkage estimation of gene expression fold change as an alternative to testing hypotheses of equivalent expression. Technical Report, Ottawa Institute of Systems Biology, COBRA Preprint Series, Article 60, available at tinyurl.com/mwhnj2 2009,
38. Ter Braak CJF. A Markov Chain Monte Carlo version of the genetic algorithm Differential Evolution: easy Bayesian computing for real parameter spaces. Statistics and Computing 2006, 16(3):239-249.
39. Alba R, Payton P, Fei Z, McQuinn R, Debbie P, Martin GB, Tanksley SD, Giovannoni JJ. Transcriptome and selected metabolite analyses reveal multiple points of ethylene control during tomato fruit development. Plant Cell 2005, 17(11):2954-2965. 10.1105/tpc.105.036053, 1276022, 16243903.
40. Shi L, Jones WD, Jensen RV, Harris SC, Perkins RG, Goodsaid FM, Guo L, Croner LJ, Boysen C, Fang H, Qian F, Amur S, Bao W, Barbacioru CC, Bertholet V, Cao XM, Chu TM, Collins PJ, Fan XH, Frueh FW, Fuscoe JC, Guo X, Han J, Herman D, Hong H, Kawasaki ES, Li QZ, Luo Y, Ma Y, Mei N, Peterson RL, Puri RK, Shippy R, Su Z, Sun YA, Sun H, Thorn B, Turpaz Y, Wang C, Wang SJ, Warrington JA, Willey JC, Wu J, Xie Q, Zhang L, Zhang L, Zhong S, Wolfinger RD, Tong W. The balance of reproducibility, sensitivity, and specificity of lists of differentially expressed genes in microarray studies. BMC Bioinformatics 2008, 9(SUPPL 9).
41. Chen JJ, Wang SJ, Tsai CA, Lin CJ. Selection of differentially expressed genes in microarray data analysis. Pharmacogenomics Journal 2007, 7(3):212-220. 10.1038/sj.tpj.6500412, 16940966.
42. Bickel DR. Degrees of differential gene expression: Detecting biologically significant expression differences and estimating their magnitudes. Bioinformatics (Oxford, England) 2004, 20:682-688. 10.1093/bioinformatics/btg468, 15033875.
43. Wiel MA, Kim KI. Estimating the false discovery rate using nonparametric deconvolution. Biometrics 2007, 63(3):806-815. 10.1111/j.1541-0420.2006.00736.x, 17825012.
44. Lewin A, Richardson S, Marshall C, Glazier A, Aitman T. Bayesian modeling of differential gene expression. Biometrics 2006, 62:1-9. 10.1111/j.1541-0420.2005.00394.x, 16542224.
45. Bochkina N, Richardson S. Tail posterior probability for inference in pairwise and multiclass gene expression data. Biometrics 2007, 63(4):1117-1125. 10.1111/j.1541-0420.2007.00807.x, 18078482.
46. McCarthy DJ, Smyth GK. Testing significance relative to a fold-change threshold is a TREAT. Bioinformatics 2009, 25(6):765-771. 10.1093/bioinformatics/btp053, 2654802, 19176553.
47. Bickel DR. The strength of statistical evidence for composite hypotheses with an application to multiple comparisons. Technical Report, Ottawa Institute of Systems Biology, COBRA Preprint Series, Article 49, available at tinyurl.com/7yaysp 2008,
48. Gentleman RC, Carey VJ, Bates DM, Bolstad B, Dettling M, Dudoit S, Ellis B, Gautier L, Ge Y, Gentry J, Hornik K, Hothorn T, Huber W, lacus S, Irizarry R, Leisch F, Li C, Maechler M, Rossini AJ, Sawitzki G, Smith C, Smyth G, Tierney L, Yang JYH, Zhang J. Bioconductor: Open software development for computational biology and bioinformatics. Genome Biology 2004, 5:R80. 10.1186/gb-2004-5-10-r80, 545600, 15461798.