Scaled rotation regularization

Pattern Recognition

Volumn 33, Issue 12, 2000, Pages 1989-1998

  Raudys, Šarunas ^a,b,c  

^a VILNIUS UNIVERSITY   (Lithuania)

^b CENTER FOR PHYSICAL SCIENCES AND TECHNOLOGY   (Lithuania)

^c INSTITUTE OF ELECTRONICS AND COMPUTER SCIENCE   (Latvia)

Author keywords

Dimensionality; Generalization; Learning set size; Regularized discriminant analysis; Scaled rotation; Single layer perceptron

Indexed keywords

LINEARIZATION; MATRIX ALGEBRA; NEURAL NETWORKS; OPTIMIZATION;

REGULARIZED DISCRIMINANT ANALYSIS; SINGLE-LAYER PERCEPTRONS;

PATTERN RECOGNITION SYSTEMS;

EID: 0034561585     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0031-3203(99)00183-1     Document Type: Article

References (22)

1. S. Raudys, Methods to overcome dimensionality problems in statistical pattern recognition, A review paper, Zavodskaya Laboratorya (USSR J.) N.3 (1991) 45, 49-55 (in Russian).
2. A.E. Hoerl, R.W. Kennard, Ridge regression: biased estimation for orthogonal problems, Technometrics 12 (1970) 55-67.
3. P.J. Di Pillo, Biased discriminant analysis: evaluation of the optimum probability of misclassification, Commun. Statist. - Theory Methods A 8 (14) (1979) 1447-1457.
4. S. Geisser, Posterior odds for multivariate normal classifications, J. Roy. Statist. Soc. Ser. B 21 (1) (1964) 69-76.
5. D. Keehn, A note on learning for Gaussian properties, IEEE Trans. Inform. Theory IT- 11 (1965) 126-131.
6. S. Raudys, M. Skurichina, Small sample properties of ridge estimate of the covariance matrix in statistical and neural net classification, in: New Trends in Probability and Statistics, Multivariate Statistics and Matrices in Statistics, Proceedings of the fifth Tartu Conference, Tartu - Puhajarve, Estonia, 23-28 May Vol. 3, VSP/TEV. Vilnius, 1994, pp. 237-245.
7. S. Raudys, Linear classifiers in perceptron design, ICPR13, Proceedings of 13th International Conference on Pattern Recognition, Vienna, Austria, August 25-29, Vol. 4, Track D: Parallel and Connectionist Systems, IEEE Computer Society Press, Los Alamitos, 1996, pp. 763-767.
8. S. Raudys, Evolution and generalization of a single neurone. Part I, SLP as seven statistical classifiers, Neural Networks 11 (2) (1998) 283-296.
9. W. James, C. Stein, Estimation with quadratic loss, in: J. Neyman (Ed.), Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, Vol. 1, 1961, pp. 361-379.
10. J. Schurmann, Polynomklassifikatoren fur Zeichenerkennung, R.Oldenbourg Verlag, Munchen and Wien, 1977.
11. L.G. Malinovskij, Hypotheses on Subspaces in the Problem of Discriminant Analysis of Normal Populations, Nauka, Moscow, 1979, pp. 195-206 (in Russian).
12. R.P.W. Duin, Small sample size generalization, Proceedings of 9th Scandinavian Conference on Image Analysis, June 6-9, Uppsala, Sweden, 1995.
13. S. Raudys, R.P.W. Duin, On expected classification error of the Fisher classifier with pseudo-inverse covariance matrix, Pattern Recognition Lett. 19 (1998) 385-392.
14. S. Raudys, On determining training sample size of a linear classificator, Computing Systems 28 (1967) 79-87 (1967, in Russian).
15. S. Raudys, On the amount of a priori information in designing the classification algorithm, Proc. Acad. Sci. USSR, Engng. Cybernet. 14 (1972) 168-174 (in Russian).
16. S. Raudys, A.K. Jain, Small sample size effects in statistical pattern recognition: recommendations for practitioners, IEEE Trans. Pattern Anal. Mach. Intell. PAMI-13 (1991) 252-264.
17. S. Raudys, Evolution and generalization of a single neurone. II. Complexity of statistical classifiers and sample size considerations, Neural Networks 11 (2) (1998) 297-313.
18. J. Pinheiro, U. Bates, Unconstrained parameterizations for variance-covariance matrices, Statist. Comput. 6 (1995) 289-296.
19. L. Thompson, A personal communication (1999).
20. J.M. Friedman, Regularized discriminant analysis, J. Amer. Statist. Assoc. 84 (1989) 165-175.
21. Y. Le Cun, I. Kanter, S. Solla, Eigenvalues of covariance matrices: application to neural-network learning, Phys. Rev. Lett. 66 (18) (1991) 2396-2399.
22. G.J. McLachlan, Discriminant Analysis and Statistical Pattern Recognition, Wiley, New York, 1992.