Performance reproducibility index for classification

Bioinformatics

Volumn 28, Issue 21, 2012, Pages 2824-2833

  Yousefi, Mohammadmahdi R ^a   Dougherty, Edward R ^a,b  

^a Department of Electrical and Computer Engineering   (United States)

^b TRANSLATIONAL GENOMICS RESEARCH INSTITUTE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BIOLOGICAL MARKER;

ALGORITHM; ARTICLE; AUTOMATED PATTERN RECOGNITION; COMPUTER PROGRAM; EPIDEMIOLOGY; FOLLOW UP; GENE EXPRESSION PROFILING; GENETIC MARKER; HUMAN; METHODOLOGY; PERSONALIZED MEDICINE; PROBABILITY; REGRESSION ANALYSIS; REPRODUCIBILITY; SAMPLE SIZE; STATISTICAL MODEL;

ALGORITHMS; BIAS (EPIDEMIOLOGY); BIOLOGICAL MARKERS; FOLLOW-UP STUDIES; GENE EXPRESSION PROFILING; GENETIC MARKERS; HUMANS; INDIVIDUALIZED MEDICINE; MODELS, STATISTICAL; PATTERN RECOGNITION, AUTOMATED; PROBABILITY; REGRESSION ANALYSIS; REPRODUCIBILITY OF RESULTS; SAMPLE SIZE; SOFTWARE;

EID: 84868014796     PISSN: 13674803     EISSN: 14602059     Source Type: Journal    
DOI: 10.1093/bioinformatics/bts509     Document Type: Article

References (37)

1. Boser, B.E. et al. (1992) A training algorithm for optimal margin classifiers. In COLT '92: Proceedings of the Fifth Annual Workshop on Computational Learning Theory. ACM, New York, pp. 144-33.
2. Boulesteix, A.-L. (2010) Over-optimism in bioinformatics research. Bioinformatics, 26, 437-33.
3. Boulesteix, A.-L. and Slawski, M. (2009) Stability and aggregation of ranked gene lists. Brief. Bioinform., 10, 556-33.
4. Braga-Neto, U.M. and Dougherty, E.R. (2004) Is cross-validation valid for small-sample microarray classification? Bioinformatics, 20, 374-33.
5. Braga-Neto, U.M. and Dougherty, E.R. (2010) Exact correlation between actual and estimated errors in discrete classification. Pattern Recognit. Lett., 31, 407-33.
6. Castaldi, P.J. et al. (2011) An empirical assessment of validation practices for molecular classifiers. Brief. Bioinform., 12, 189-33.
7. Chen, X. et al. (2004) Novel endothelial cell markers in hepatocellular carcinoma. Modern Pathol., 17, 1198-33.
8. Cortes, C. and Vapnik, V.N. (1995) Support-vector networks. Mach. Learn., 20, 273-33.
9. Dalton, L.A. and Dougherty, E.R. (2011a) Bayesian minimum mean-square error estimation for classification error-Part I: Definition and the Bayesian MMSE error estimator for discrete classification. IEEE Trans. Signal Process., 59, 115-33.
10. Dalton, L.A. and Dougherty, E.R. (2011b) Application of the Bayesian MMSE error estimator for classification error to gene-expression microarray data. Bioinformatics, 27, 1822-33.
11. Dalton, L.A. and Dougherty, E.R. (2012a) Exact MSE performance of the Bayesian MMSE estimator for classification error-Part II: Consistency and performance analysis. IEEE Trans. Signal Process., 60, 2588-33.
12. Dalton, L.A. and Dougherty, E.R. (2012b) Optimal MSE calibration of error estimators under Bayesian models. Pattern Recognit., 45, 2308-33.
13. Devroye, L. et al. (1996) A Probabilistic Theory of Pattern Recognition. Springer-Verlag, New York.
14. Dougherty, E.R. (2011) Validation of gene regulatory networks: scientific and inferential. Brief. Bioinform., 12, 245-33.
15. Dougherty, E.R. (2012) Prudence, risk, and reproducibility in biomarker discovery. BioEssays, 34, 277-33.
16. Dougherty, E.R. and Bittner, M.L. (2011) Epistemology of the Cell: A Systems Perspective on Biological Knowledge. John Wiley, New York.
17. Dougherty, E.R. et al. (2010) Performance of error estimators for classification. Curr. Bioinform., 5, 53-33.
18. Dougherty, E.R. et al. (2011) The illusion of distribution-free small-sample classification in genomics. Curr. Genomics, 12, 333-33.
19. Fisher, R.A. (1925) Statistical Methods for Research Workers. Oliver and Boyd, Edinburg.
20. Hanczar, B. et al. (2007) Decorrelation of the true and estimated classifier errors in high-dimensional settings. EURASIP J. Bioinform. Syst. Biol., 2007, 12.
21. Hanczar, B. et al. (2010) Small-sample precision of ROC-related estimates. Bioinformatics, 26, 822-33.
22. Hua, J. et al. (2005) Optimal number of features as a function of sample size for various classification rules. Bioinformatics, 21, 1509-33.
23. Hothorn, T. and Leisch, F. (2011) Case studies in reproducibility. Brief. Bioinform., 12, 288-33.
24. Ioannidis, J.P.A. (2005) Why most published research findings are false. PLoS Med, 2, e124.
25. Jelizarow, M. et al. (2010) Over-optimism in bioinformatics: an illustration. Bioinformatics, 26, 1990-33.
26. Li, Q. et al. (2011) Measuring reproducibility of high-throughput experiments. Ann. Appl. Stat., 5, 1752-33.
27. Natsoulis, G. et al. (2005) Classification of a large microarray data set: algorithm comparison and analysis of drug signatures. Genome Res., 15, 724-33.
28. Ray, T. (2011) FDA's Woodcock says personalized drug development entering 'long slog' phase. Pharmacogen. Rep., http://www.genomeweb.com/mdx/fdas- woodcock-says-personalized-drug-development-entering-long-slog-phase (26 October 2011, date last accessed).
29. Sabel, M.S. et al. (2011) Proteomics in melanoma biomarker discovery: great potential, many obstacles. Int. J. Proteom., 2011, 8.
30. Yeoh, E.J. et al. (2002) Classification, subtype discovery, and prediction of outcome in pediatric acute lymphoblastic leukemia by gene expression profiling. Cancer Cell, 1, 133-33.
31. Yousefi, M.R. et al. (2010) Reporting bias when using real data sets to analyze classification performance. Bioinformatics, 26, 68-33.
32. Yousefi, M.R. et al. (2011) Multiple-rule bias in the comparison of classification rules. Bioinformatics, 27, 1675-33.
33. Zhan, F. et al. (2006) The molecular classification of multiple myeloma. Blood, 108, 2020-33.
34. Zhang, M. et al. (2008) Apparently low reproducibility of true differential expression discoveries in microarray studies. Bioinformatics, 24, 2057-33.
35. Zhang, M. et al. (2009) Evaluating reproducibility of differential expression discoveries in microarray studies by considering correlated molecular changes. Bioinformatics, 25, 1662-33.
36. Zollanvari, A. et al. (2010) Joint sampling distribution between actual and estimated classification errors for linear discriminant analysis. IEEE Trans. Inform. Theory, 56, 784-33.
37. Zollanvari, A. et al. (2012) Exact representation of the second-order moments for resubstitution and leave-one-out error estimation for linear discriminant analysis in the univariate heteroskedastic Gaussian model. Pattern Recognit., 45, 908-33.