Stability and aggregation of ranked gene lists

Briefings in Bioinformatics

Volumn 10, Issue 5, 2009, Pages 556-568

  Boulesteix, Anne Laure ^a   Slawski, Martin ^a,b  

^a UNIVERSITY OF MUNICH   (Germany)

^b SAARLAND UNIVERSITY   (Germany)

Author keywords

Bootstrap; Differential expression; Ranking; Top list; Univariate analysis; Variability

Indexed keywords

COMPUTER PROGRAM; GENE EXPRESSION; GENE STRUCTURE; GENETIC DATABASE; GENETIC STABILITY; LEUKEMIA; MATHEMATICAL COMPUTING; RELIABILITY; REPRODUCIBILITY; REVIEW; STATISTICAL ANALYSIS;

ALGORITHMS; DATABASES, GENETIC; GENE EXPRESSION PROFILING; MODELS, GENETIC; MODELS, STATISTICAL; OLIGONUCLEOTIDE ARRAY SEQUENCE ANALYSIS; SOFTWARE;

EID: 69249085408     PISSN: 14675463     EISSN: 14774054     Source Type: Journal    
DOI: 10.1093/bib/bbp034     Document Type: Review

References (61)

1. Kooperberg C, Aragaki A, Strand AD, et al. Significance testing for small microarray experiments. Stat Med 2005; 24:2281-98.
2. Jeffery IB, Higgins DG, Culhane AC. Comparison and evaluation of methods for generating differentially expressed gene lists from microarray data. BMC Bioinformatics 2006;7:359.
3. Opgen-Rhein R, Strimmer K. Accurate ranking of differentially expressed genes by a distribution-free shrinkage approach. Stat Appl GenetMol Biol 2007;6:9.
4. Mukherjee S, Sykacek P, Roberts SJ, et al. Gene ranking using bootstrapped p-values. ACM SIGKDD Explor Newsl 2003;5:14-20.
5. Aerts S, Lambrechts D, Maity S, et al. Gene priorization through genomic data fusion. Nat Biotechnol 2006;24: 537-44.
6. Dudoit S, Shaffer JP, Boldrick JC. Multiple hypothesis testing in microarray experiments. Stat Sci 2003;18:71-103.
7. Pounds S. Estimation and control of multiple testing error rates for microarray studies. Brief Bioinform 2006;7:25-36.
8. Strimmer K. A unified approach to false discovery rate estimation. BMC Bioinformatics 2008;9:303.
9. Chiaretti S, Li X, Gentleman R, et al. Gene expression profile of adult T-cell acute lymphocytic leukemia identifies distinct subsets of patients with different response to therapy and survival. Blood 2004;103:2771-8.
10. Li X. ALL. Bioconductor R package version 1.4.4:, 2008. http://www.bioconductor.org/packages/release/data/experiment/html/ ALL.html (24 June 2009, date last accessed).
11. Slawski M, Boulesteix AL. Geneselector. Bioconductor, 2008. R package version 2.0.3: http://www.bioconductor.org/packages/devel/bioc/ html/GeneSelector.html (24 June 2009, date last accessed).
12. Tusher VG, Tibshirani R, Chu G. Significance analysis of microarrays applied to the ionizing radiation response. Proc Natl Acad Sci 2001;98:5116-21.
13. Efron B, Tibshirani R, Storey JD, et al. Empirical Bayes analysis of a microarray experiment. J Am Stat Assoc 2001; 96:1151-60.
14. Baldi P, Long AD. A Bayesian framework for the analysis of microarray expression data: Regularized t-test and statistical inferences of gene changes. Bioinformatics 2001;17:509-19.
15. Lönnstedt I, Speed T. Replicated microarray data. Stat Sin 2002;12:31-46.
16. Smyth GK. Linear models and empirical Bayes methods for assessing differential expression in microarray experiments. Stat Appl Genet Mol Biol 2004;3:3.
17. Fox RJ, Dimmic MW. A two sample Bayesian t-test for microarray data. BMC Bioinformatics 2006;7:126.
18. Ioannidis JPA. Why most published research findings are false. PLoS Med 2005;2:e124.
19. Boulesteix A-L, Strobl C. Optimal classifier selection and negative bias in error rate estimation: An empirical study on high-dimensional prediction. Technical Report 58, Department of Statistics, University of Munich, 2009. http://epub.ub.uni-muenchen.de/10606/ (24 June 2009, date last accessed).
20. Davison AC, Hinkley DV. Bootstrap Methods and their Applications. New York: Cambridge University Press, 1997.
21. Politis DN, Romano JP, Wolf M. Subsampling. New York: Springer, 1999.
22. Pepe MS, Longton G, Anderson GL, et al. Selecting differentially expressed genes from microarray experiments. Biometrics 2003;59 133-42.
23. Pavlidis P, Li Q, Noble WS. The effect of replication on gene expression microarray experiments. Bioinformatics 2003;19:1620-7.
24. Xu R, Li X. A comparison of parametric versus permutation methods with applications to general and temporal microarray gene expression data. Bioinformatics 2003;19: 1284-9.
25. Comander J, Natarajan S, Gimbrone MA, et al. Improving the statistical detection of regulated genes from microarray data using intensity-based variance estimation. BMC Genomics 2005;5:17.
26. Allison DB, Cui X, Page GP, Sabripour M. Microarray data analysis: From disarray to consolidation and consensus. Nat Rev Genet 2006;7 55-65.
27. Tang ZQ, Han LY, Lin HH, et al. Derivation of stable microarray cancer-differentiating signatures using consensus scoring of multiple random sampling and gene-ranking consistency evaluation. Cancer Res 2006;67:9996-10003.
28. Qiu X, Xiao Y, Gordon A, et al. Assessing stability of gene selection in microarray data analysis. BMC Bioinformatics 2006; 7:50.
29. Jurman G, Merler S, Barla A, et al. Algebraic stability indicators for ranked lists in molecular profiling. Bioinformatics 2008;24 258-64.
30. Gabrielsson BG, Olofsson LE, Sjögren A, et al. Evaluation of reference genes for studies of gene expression in human adipose tissue. Obes Res 2005;13:649-52.
31. Wilson CS, Davidson GS, Martin SB, et al. Gene expression profiling of adult acute myeloid leukemia identifies novel biologic clusters for risk classification and outcome prediction. Blood 2006;108:685-96.
32. Hong F, Breitling R, McEntee CW, et al. RankProd: A bioconductor package for detecting differentially expressed genes in meta-analysis. Bioinformatics 2006;22: 2825-7.
33. DeConde RP, Hawley S, Falcon S, et al. Combining results of microarray experiments: A rank aggregation approach. Stat Appl Genet Mol Biol 2006;5:15.
34. Zintzaras E, Ioannidis JPA. Meta-analysis for ranked discovery datasets: theoretical framework and empirical demonstration for microarrays. Comput Biol Chem 2008;32: 38-46.
35. Hong F, Breitling R. A comparison of meta-analysis methods for detecting differentially expressed genes in microarray experiments. Bioinformatics 2008;24:374-82.
36. Stolovitzky G. Gene selection in microarray data: The elephant, the blind men and our algorithms. Curr Opin Struct Biol 2003;13 370-6.
37. Zhang M, Zhang L, Zou J, et al. Evaluating reproducibility of differential expression discoveries in microarray studies by considering correlated molecular changes. Bioinformatics 2009;25, doi:10.1093/ bioinformatics/btp295 [Epub ahead of print 5 May 2009].
38. Ein-Dor L, Zuk O, Domany E. Thousands of samples are needed to generate a robust gene list for predicting outcome in cancer. Proc Natl Acad Sci 2006;103:5923-8.
39. Zucknick M, Richardson S, Stronach EA. Comparing the characteristics of gene expression profiles derived by univariate and multivariate classification methods. Stat Appl Genet Mol Biol 2008;8:7.
40. Irizarry RA, Warren D, Spencer F, et al. Multiple-laboratory comparison of microarray platforms. Nat Methods 2005;2: 345-50.
41. Yang X, Bentink S, Scheid S, et al. Similarities of ordered gene lists. J Bioinform Comput Biol 2006;4:693-708.
42. Lottaz C, Yang X, Scheid S, et al. OrderedList - a bioconductor package for detecting similarity in ordered gene lists. Bioinformatics 2006;22:2315-16.
43. Fury W, Batliwalla F, Gregersen PK, et al. Overlapping probabilities of top ranking gene lists, hypergeometric distribution, and stringency of gene selection criterion. In: 28th Annual International Conference of the IEEE. USA: IEEE Engineering in Medicine and Biology Society, 2007, 5531-34.
44. Breitling R, Amtmann A, Herzyk P. Iterative Group Analysis (iGA): A simple tool to enhance sensitivity and facilitate interpretation of microarray experiments. BMC Bioinformatics 2004;5:34.
45. Eden E, Lipson D, Yogev S, Yakhini Z. Discovering motifs in ranked lists of DNA sequences. PLoS Comput Biol 2007;3:e39.
46. Lin S, Ding J. Integration of ranked lists via cross entropy Monte Carlo with applications to mRNA and microRNA studies. Biometrics 2009; 65:9-18.
47. Critchlow DE. Metric Methods for Analyzing Partially Ranked Data. New York: Springer, 1985.
48. Zhang M, Yao C, Guo Z, et al. Apparently low reproducibility of true differential expression discoveries in microarray studies. Bioinformatics 2008;24:2057-63.
49. Mukherjee S, Roberts SJ, van der Laan MJ. Data-adaptive test statistics for microarray data. Bioinformatics 2005;21: Ii108-14.
50. Elo LL, Filen S, Lahesmaa R, et al. Reproducibility-optimized test statistic for ranking genes in microarray studies. IEEE/ACM Trans Comput Biol Bioinform 2008;5: 423-31.
51. Boulesteix A-L, Strobl C, Augustin T, et al. Evaluating microarray-based classifiers: An overview. Cancer Inform 2008;6 77-97.
52. Meinshausen N, Bühlmann P. Stability Selection, 2008. http://arxiv.org/abs/0809.2932 (24 June 2009, date last accessed).
53. Ma S. Empirical study of supervised gene screening. BMC Bioinformatics 2006;7:537.
54. de Borda M. Mémoires sur les élections au scrutin. Histoire de l'Académie Royale des Sciences, 1781.
55. Kutalik Z, Inwald J, Gordon SV, et al. Advanced significance analysis of microarray data based on weighted resampling: A comparative study and application to gene deletions in Mycobacterium bovis. Bioinformatics 2004;20: 357-63.
56. Bickel PJ, Ren JJ. The bootstrap in hypothesis testing. In: State of the Art in Probability and Statistics, Festschrift for Willem R. van Zwet, IMS Lecture Notes Monograph Series, vol. 36. Beachwood, OH, USA: Inst of Mathematical Statistics, 2001, 91-112.
57. Strobl C, Boulesteix AL, Zeileis A, et al. Bias in random forest importance measures: Illustration, sources and a solution. BMC Bioinformatics 2007;8:25.
58. Ein-Dor L, Kela I, Getz G, et al. Outcome signature genes in breast cancer: Is there a unique set? Bioinformatics 2005;21 171-8.
59. Barla A, Jurman G, Riccadonna S, et al. Machine learning methods for predictive proteomics. Brief Bioinform 2008;9: 119-28.
60. Baek S, Tsai CA, Chen JJ. Development of biomarker classifiers from high-dimensional data. Brief Bioinform 2009;doi:10:10.1093/bib/ bbp016 [Epub ahead of print 3 April 2009].
61. Davis CA, Gerick F, Hintermair V, et al. Reliable gene signatures for microarray classication: Assessment of stability and performance. Bioinformatics 2006;22:2356-63.