Expected classification error of the Fisher linear classifier with pseudo-inverse covariance matrix

Pattern Recognition Letters

Volumn 19, Issue 5-6, 1998, Pages 385-392

  Raudys, Sarunas ^a   Duin, Robert P W ^b  

^a VILNIUS UNIVERSITY   (Lithuania)

^b DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

Dimensionality; Fisher linear discriminant; Generalization error; Pseudo inversion; Sample size; Scissors effect; Statistical classification

Indexed keywords

EIGENVALUES AND EIGENFUNCTIONS; ERROR ANALYSIS; MATRIX ALGEBRA; STATISTICAL METHODS;

FISHER LINEAR CLASSIFIER; PSEUDO INVERSE COVARIANCE MATRIX; SCISSORS EFFECT;

FEATURE EXTRACTION;

EID: 0032042805     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0167-8655(98)00016-6     Document Type: Article

References (21)

1. Amari S., Fujita N., Shinomoto S. Four types of learning curves. Neural Comput. 4:1992;605-618.
2. Anderson, T.W., 1958. An Introduction to Multivariate Statistical Analysis. Willey, New York.
3. Deev A.D. Representation of statistics of discriminant analysis and asymptotic expansions in dimensionalities comparable with sample size. Rep. Ac. Sci. USSR. 195(4):1970;756-762. (in Russian).
4. Deev, A.D., 1972. Asymptotic expansions for distributions of statistics W, M, W* in discriminant analysis. Statistical Methods of Classification, vol. 31. Moscow University Press, Moscow, pp. 6-57 (in Russian).
5. Di Pillo P.J. Biased discriminant analysis: evaluation of the optimum probability of misclassification. Commun. Stat. Theor. Meth. A. 8(14):1979;1447-1457.
6. Duin, R.P.W., 1978. On Accuracy of Statistical Pattern Recognizers, Duch Efficiency Bureau, Pijnacker.
7. Duin, R.P.W., 1995. Small sample size generalization. In: Borgefors, G. (Ed.), SCIA'95, Proc. 9th Scandinavian Conf. on Image Analysis, vol. 2. Uppsala, June 6-9, 1995, pp. 957-964.
8. Fukunaga, K., 1990. Introduction to Statistical Pattern Recognition. Academic Press, New York.
9. Gupta A.K. On the equivalence of two classification rules. Biometrical J. 19(5):1977;365-367.
10. Jain, A., Chandrasekaran, B., 1982. Dimensionality and sample size considerations in pattern recognition practice. Handbook of Statistics, vol. 2. North-Holland, Amsterdam, pp. 835-855.
11. Kanal L., Chandrasekaran B. On dimensionality and sample size in statistical pattern classification. Pattern Recognition. 3:1971;238-255.
12. Malinovskij, L.G., 1979. Hypotheses on Subspaces in the Problem of Discriminant Analysis of Normal Populations. Nauka, Moscow, pp. 195-206 (in Russian).
13. McLachlan, G.J., 1992. Discriminant Analysis and Statistical Pattern Recognition. Wiley, New York.
14. Raudys, S., 1970. On the problems of sample size in pattern recognition. Proc. 2nd All-Union Conf. Statist. Methods in Control Theory, vol. 2. Nauka, Moscow, pp. 64-67 (in Russian).
15. Raudys, S., 1972. On the amount of a priori information in designing the classification algorithm. Proc. Acad. of Sciences of the USSR, Technical. Cybernetics, vol. 10. Nauka, Moscow, No. 4, pp. 168-174 (in Russian).
16. Raudys, S., 1998. Evolution and generalization of a single neurone. Part I. SLP as seven statistical classifiers. Neural Networks, in press.
17. Raudys, S., Jain, A.K., 1991. Small sample size effects in statistical pattern recognition: Recommendations for practitioners. IEEE Trans. Pattern Analysis Machine Intelligence 13, pp. 252-264.
18. Raudys, S., Skurichina, M., 1994. Small sample properties of ridge estimate of the covariance matrix in statistical and neural net classification. In: New Trends in Probability and Statistics, Multivariate Statistics and Matrices in Statistics, Proc. 5th Tartu Conf., vol. 3. Tartu-Puhajarve, Estonia, 23-28 May 1994, pp. 237-245.
19. Schürmann, J., 1977. Polynomklassifikatoren für Zeichenerkennung, R. Oldenbourg Verlag, Munich.
20. Skurichina, M., Duin, R., 1996. Stabilizing classifiers for very small sample sizes, Proc. 13th Int. Conf. on Pattern Recognition, Vienna, August 25-29, 1996, vol. 2, track B: Pattern Recognition and Signal Analysis. IEEE Computer Society Press, Los Alamitos, 1996, pp. 891-896.
21. Wyman F., Young D., Turner D. A comparison of asymptotic error rate expansions for the sample linear discriminant function. Pattern Recognition. 23:1990;775-783.