Moments and root-mean-square error of the Bayesian MMSE estimator of classification error in the Gaussian model

Pattern Recognition

Volumn 47, Issue 6, 2014, Pages 2178-2192

  Zollanvari, Amin ^a,b   Dougherty, Edward R ^a,c  

^a Texas AandM University   (United States)

^b TEXAS A AND M UNIVERSITY   (United States)

^c TRANSLATIONAL GENOMICS RESEARCH INSTITUTE   (United States)

Author keywords

Bayesian minimum mean square error estimator; Double asymptotics; Kolmogorov asymptotics; Linear discriminant analysis; Performance metrics; RMS

Indexed keywords

EID: 84894366246     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2013.11.022     Document Type: Article

References (35)

1. M. Hills Allocation rules and their error rates J. R. Stat. Soc. Ser. B (Methodological) 28 1966 1 31
2. D. Foley Considerations of sample and feature size IEEE Trans. Inf. Theory IT18 1972 618 626
3. M.J. Sorum Estimating the conditional probability of misclassification Technometrics 13 1971 333 343
4. G.J. McLachlan An asymptotic expansion of the expectation of the estimated error rate in discriminant analysis Aust. J. Stat. 15 1973 210 214
5. M. Moran On the expectation of errors of allocation associated with a linear discriminant function Biometrika 62 1975 141 148
6. V.B. Berikov A priori estimates of recognition quality for discrete features Pattern Recognit. Image Anal. 12 2002 235 242
7. V.B. Berikov, and A.G. Litvinenko The influence of prior knowledge on the expected performance of a classifier Pattern Recognit. Lett. 24 2003 2537 2548
8. U. Braga-Neto, and E.R. Dougherty Exact performance measures and distributions of error estimators for discrete classifiers Pattern Recognit. 38 2005 1799 1814
9. N. Glick Additive estimators for probabilities of correct classification Pattern Recognit. 10 1978 211 222
10. K. Fukunaga, and R.R. Hayes Estimation of classifier performance IEEE Trans. Pattern Anal. Mach. Intell. 11 1989 1087 1101
11. S. Raudys Statistical and Neural Classifiers, An Integrated Approach to Design 2001 Springer-Verlag London
12. A. Zollanvari, U.M. Braga-Neto, and E.R. Dougherty On the sampling distribution of resubstitution and leave-one-out error estimators for linear classifiers Pattern Recognit. 42 2009 2705 2723
13. U.M. Braga-Neto, and E.R. Dougherty Exact correlation between actual and estimated errors in discrete classification Pattern Recognit. Lett. 31 2010 407 413
14. A. Zollanvari, U.M. Braga-Neto, and E.R. Dougherty Exact representation of the second-order moments for resubstitution and leave-one-out error estimation for linear discriminant analysis in the univariate heteroskedastic gaussian model Pattern Recognit. 45 2012 908 917
15. A. Zollanvari, U.M. Braga-Neto, and E.R. Dougherty Joint sampling distribution between actual and estimated classification errors for linear discriminant analysis IEEE Trans. Inf. Theory 56 2010 784 804
16. A. Zollanvari, U.M. Braga-Neto, and E.R. Dougherty Analytic study of performance of error estimators for linear discriminant analysis IEEE Trans. Signal Process. 59 2011 4238 4255
17. F. Wyman, D. Young, and D. Turner A comparison of asymptotic error rate expansions for the sample linear discriminant function Pattern Recognit. 23 1990 775 783
18. V. Pikelis Comparison of methods of computing the expected classification errors Autom. Remote Control 5 1976 59 63
19. S. Raudys On the amount of a priori information in designing the classification algorithm Tech. Cybern. 4 1972 168 174 In Russian
20. A. Deev Representation of statistics of discriminant analysis and asymptotic expansion when space dimensions are comparable with sample size Dokl. Akad. Nauk SSSR 195 1970 759 762 (in Russian)
21. Y. Fujikoshi Error bounds for asymptotic approximations of the linear discriminant function when the sample size and dimensionality are large J. Multivar. Anal. 73 2000 1 17
22. V. Serdobolskii Multivariate Statistical Analysis A High-Dimensional Approach 2000 Springer
23. P.J. Bickel, and E. Levina Some theory for Fisher's linear discriminant function, 'naive bayes', and some alternatives when there are many more variables than observations Bernoulli 10 2004 989 1010
24. S. Raudys, and D.M. Young Results in statistical discriminant analysis a review of the former soviet union literature J. Multivar. Anal. 89 2004 1 35
25. E. Dougherty, C. Sima, J. Hua, B. Hanczar, and U. Braga-Neto Performance of error estimators for classification Curr. Bioinforma. 5 2010 53 67
26. E.R. Dougherty, A. Zollanvari, and U.M. Braga-Neto The illusion of distribution-free small-sample classification in genomics Curr. Genomics 12 2011 333 341
27. L. Dalton, and E.R. Dougherty Bayesian minimum mean-square error estimation for classification error-Part I definition and the Bayesian MMSE error estimator for discrete classification IEEE Trans. Signal Process. 59 2011 115 129
28. L. Dalton, and E.R. Dougherty Bayesian minimum mean-square error estimation for classification error - Part II linear classification of Gaussian models IEEE Trans. Signal Process. 59 2011 130 144
29. L. Dalton, and E.R. Dougherty Exact sample conditioned MSE performance of the Bayesian MMSE estimator for classification error - Part I Representation IEEE Trans. Signal Process. 60 2012 2575 2587
30. L. Dalton, and E.R. Dougherty Exact sample conditioned MSE performance of the Bayesian MMSE estimator for classification error - Part II Consistency and performance analysis IEEE Trans. Signal Process. 60 2012 2588 2603
31. T. Anderson Classification by multivariate analysis Psychometrika 16 1951 31 50
32. S. John Errors in discrimination Ann. Math. Stat. 32 1961 1125 1144
33. L. Devroye, L. Gyorfi, and G. Lugosi A Probabilistic Theory of Pattern Recognition 1996 Springer New York
34. R. Kan From moments of sum to moments of product J. Multivar. Anal. 99 2008 542 554
35. Y. Bao, and A. Ullah Expectation of quadratic forms in normal and nonnormal variables with econometric applications J. Stat. Plan. Inference 140 2010 1193 1205