Classification and error estimation for discrete data

Current Genomics

Volumn 10, Issue 7, 2009, Pages 446-462

  Braga Neto, Ulisses M ^a  

^a Texas AandM University   (United States)

Author keywords

Classification; Coefficient of determination; Discrete histogram rule; Ensemble methods; Error estimation; Genomics; Leave one out; Resubstitution; Sampling distribution

Indexed keywords

ANALYTIC METHOD; ANALYTICAL ERROR; CLASSIFICATION; GENE EXPRESSION; GENE REGULATORY NETWORK; GENOMICS; HISTOGRAM; INFORMATION SCIENCE; MATHEMATICAL COMPUTING; METHODOLOGY; PREDICTION; PREVALENCE; RELIABILITY; REVIEW; SAMPLE SIZE; SIGNAL PROCESSING;

EID: 70450192580     PISSN: 13892029     EISSN: None     Source Type: Journal    
DOI: 10.2174/138920209789208228     Document Type: Review

References (46)

1. Cochran, W.; Hopkins, C. Some classification problems with multivariate qualitative data. Biometrics, 1961, 17, 10-32.
2. Hills, M. Allocation rules and their error rates. J. R. Stat. Soc. Series B Methodol., 1966, 28, 1-31.
3. Hills, M. Discrimination and allocation with discrete data. Appl. Stat., 1967, 16, 237-250.
4. Hughes, G. On the mean accuracy of statistical pattern recognizers. IEEE Trans. Inf. Theory, 1968, IT-14, 55-63.
5. Hughes, G. Number of pattern classifier design samples per class. IEEE Trans. Inf. Theory, 1969, IT-15, 615-618.
6. Glick, N. Sample-based multinomial classification. Biometrics, 1973, 29, 241-256.
7. Goldstein, M.; Dillon, W. Discrete discriminant analysis. New York: Wiley, 1978.
8. Zhou, X.; Wang, X.; Dougherty, E. Binarization of Microarray Data Based on a Mixture Model. Mol. Cancer Ther., 2003, 2, 679-684.
9. Shmulevich, I.; Zhang, W. Binary analysis and optimization-based normalization of gene expression data. Bioinformatics, 2002, 18, 555-565. (Pubitemid 34521045)
10. Dougherty, E.; Kim, S.; Chen, Y. Coefficient of determination in nonlinear signal processing. EURASIP J. Appl. Signal Processing, 2000, 80, 2219-2235. (Pubitemid 30929969)
11. Schmulevich, I.; Dougherty, E.; Kim, S.; Zhang, W. Probabilistic Boolean Networks: a rule-based uncertainty model for gene-regulatory networks. Bioinformatics, 2002, 18, 261-274.
12. Schmulevich, I.; Dougherty, E.; Zhang, W. From Boolean to probabilistic Boolean networks as models of genetic regulatory networks. Proc. IEEE, 2002, 90, 1778-1792. (Pubitemid 43758724)
13. Devroye, L.; Gyorfi, L.; Lugosi, G. A Probabilistic Theory of Pattern Recognition. New York: Springer, 1996.
14. Xu, Q.; Hua, J.; Braga-Neto, U.; Xiong, Z.; Suh, E.; Dougherty, E. Confidence Intervals for the True Classification Error Conditioned on the Estimated Error. Technol. Cancer Res. Treat., 2006, 5, 579-590. (Pubitemid 46068046)
15. Dougherty, E.; Braga-Neto, U. Epistemology of computational biology: mathematical models and experimental prediction as the basis of their validity. J. Biol. Syst., 2006, 14, 65-90. (Pubitemid 43289707)
16. Agresti, A. Categorical Data Analysis. New York: Wiley, 2nd ed.; 2002.
17. Witten, I.; Frank, E. Data Mining. San Diego, CA: Academic Press, 2000.
18. Smith, C. Some examples of discrimination. Ann. Eugen., 1947, 18, 272-282.
19. Lachenbruch, P.; Mickey, M. Estimation of error rates in discriminant analysis. Technometrics, 1968, 10, 1-11.
20. Cover, T. Learning in Pattern Recognition. In Methodologies of Pattern Recognition. Edited by Watanabe, S.; New York, NY: Academic Press, 1969, 111-132.
21. Toussaint, G.; Donaldson, R. Algorithms for Recognizing Contour-Traced Hand-Printed Characters. IEEE Trans. Comput., 1970, 19, 541-546.
22. Stone, M. Cross-Validatory Choice and Assessment of Statistical Predictions. J. R. Stat. Soc. Series B Methodol., 1974, 36, 111-147.
23. Efron, B. Bootstrap Methods: Another Look at the Jacknife. Ann. Stat., 1979, 7, 1-26.
24. Efron, B. Estimating the Error Rate of a Prediction Rule: Improvement on Cross-Validation. J. Am. Stat. Assoc., 1983, 78, 316-331.
25. Efron, B.; Tibshirani, R. Improvements on Cross-Validation: The .632+ Bootstrap Method. J. Am. Stat. Assoc., 1997, 92, 548-560. (Pubitemid 127094695)
26. Braga-Neto, U.; Dougherty, E. Is Cross-Validation Valid for Microarray Classification? Bioinformatics, 2004, 20, 374-380.
27. Braga-Neto, U.; Dougherty, E. Classification. In Genomic Signal Processing and Statistics, EURASIP Book Series on Signal Processing and Communication. Dougherty, E.; Shmulevich, I.; Chen, J.; Wang, Z. J. Eds.; Hindawi Publishing Corporation, 2005.
28. Braga-Neto, U. An Asymptotically-Exact Expression for the Variance of Classification Error for the Discrete Histogram Rule, 2008. GENSIPS'2008 -IEEE International Workshop on Genomic Signal Processing and Statistics, Phoenix, AZ.
29. Braga-Neto, U.; Dougherty, E. Exact performance of error estimators for discrete classifiers. Pattern. Recognit., 2005, 38, 1799-1814. (Pubitemid 41214626)
30. Braga-Neto, U.; Dougherty, E. Exact Correlation between Actual and Estimated Errors in Discrete Classification, 2009, (In Review).
31. Hanczar, B.; Hua, J.; Dougherty, E. Decorrelation of the True and Estimated Classifier Errors in High-Dimensional Settings. EURASIP J. Bioinform. Syst. Biol., 2007, Article ID 38473, 12 pages.
32. Agresti, A. A survey of exact inference for contingency tables. Stat. Sci., 1992, 7, 131-153.
33. Verbeek, A. A survey of algorithms for exact distributions of test statistics in rXc contingency tables with fixed margins. Comput. Stat. Data Anal., 1985, 3, 159-185.
34. Klotz, J. The Wilcoxon, Ties, and the Computer. J. Am. Stat. Assoc., 1966, 61, 772-787.
35. Hirji, K.; Mehta, C.; Patel, N. Computing Distributions for Exact Logistic Regression. J. Am. Stat. Assoc., 1987, 82, 1110-1117.
36. Hua, J.; Xiong, Z.; Lowey, J.; Suh, E.; Dougherty, E. Optimal number of features as a function of sample size for various classification rules. Bioinformatics, 2005, 21, 1509-1515. (Pubitemid 40552752)
37. Abend, K.; T.J. Harley, J.; Chandrasekaran, B.; T.J. Harley, J.; Hughes, G. Comments "On the mean accuracy of statistical pattern recognizers". IEEE Trans. Inf. Theory, 1969, IT-15, 420-423.
38. Braga-Neto, U.; Dougherty, E. Performance of Ensemble Methods in Discrete Classification, 2009, (In Review).
39. Xu, L.; Krzyzak, A.; Suen, C. Methods for combining multiple classifiers and their applications in handwritten character recognition. IEEE Trans. Syst. Man Cybern., 1992, 22, 418-435.
40. Breiman, L. Bagging Predictors. Mach. Learn., 1996, 24, 123-140.
41. Quenouille, M. Approximate tests of correlation in time series. J. R. Stat. Soc. Series B Methodol., 1949, 11, 68-84.
42. Glick, N. Sample-Based classification procedures derived from density estimators. J. Am. Stat. Assoc., 1972, 67, 116-122.
43. Feller, W. An Introduction to Probability Theory and Its Applications. New York, NY: Wiley, 1968, Vol. 1.
44. Kim, S.; Dougherty, E.; Chen, Y.; Sivakumar, K.; Meltzer, P.; Trent, J.; Bittner, M. Multivariate measurement of gene expression relationships. Genomics, 2000, 67, 201-209. (Pubitemid 30614588)
45. Martins, D.; Braga-Neto, U.; Hashimoto, R.; Bittner, M.; Dougherty, E. Intrinsically Multivariate Predictive Genes. IEEE J. Select. Topics Signal Processing, 2008, 2, 424-439.
46. Dougherty, E.; Brun, M.; Trent, J.; Bittner, M. A Conditioning-Based model of contextual regulation. IEEE/ACM Trans. Comput. Biol. Bioinform., 2008, 6, 310-320.