Regularisation of linear classifiers by adding redundant features

Pattern Analysis and Applications

Volumn 2, Issue 1, 1999, Pages 44-52

  Skurichina, Marina ^a   Duin, Robert P W ^a  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

Critical sample size; Generalisation error; Noise injection; Peaking behaviour; Pseudo Fisher Linear Discriminant; Regularisation; Ridge estimate

Indexed keywords

EID: 0033463508     PISSN: 14337541     EISSN: None     Source Type: Journal    
DOI: 10.1007/s100440050013     Document Type: Article

References (14)

1. Fukunaga K. Introduction to Statistical Pattern Recognition. Academic Press, 1990, pp 400-407
2. Duin RPW. Small sample size generalization. Proceedings of 9th Scandinavian Conference on Image Analysis, vol 2, Uppsala, Sweden, 1995, pp 957-964
3. Skurichina M, Duin RPW. Stabilizing classifiers for very small sample sizes. Proceedings of ICPR, Vienna, Austria, 1996, pp 891-896
4. Skurichina M, Duin RPW. Bagging for linear classifiers. Pattern Recognition 1998;31(7):909-930
5. Raudys S, Skurichina M, Cibas T, Gallinari P. Optimal regularization of neural networks and ridge estimates of the covariance matrix in statistical classification. Pattern Recognition and Image Analysis: Advances in Mathematical Theory and Applications (Int Journal of Russian Academy of Sciences) 1995;5(4):633-650
6. Cortes C, Vapnik V. Support-vector networks. Machine Learning 1995;20(3):273-297
7. Skurichina M, Duin RPW. Regularization by adding redundant features. Advances in Pattern Recognition. Proceedings of Joint International Workshops SSPR'98 and SPR'98, Sydney, Australia, 1998, pp 564-572
8. Netten H, Young IT, Prins M, van Vliet LJ, Tanke HJ, Vrolijk J, Sloos W. Automation of fluorescent dot counting in cell nuclei. Proceedings of the 12th Int. Conference on Pattern Recognition, Vol 1, Jerusalem, 1994, pp 84-87
9. Hoekstra A, Netten H, de Ridder D. A neural network applied to spot counting. Proceedings of ACSI'96, the Second Annual Conference of the Advanced School for Computing and Imaging, Lommel, Belgium, 1996, pp 224-229
10. Fisher RA. The use of multiple measurements in taxonomic problems. Annals of Eugenics 1936;7(2):179-188
11. Fisher RA. The precision of discriminant functions. Annals of Eugenics 1940;10(4)
12. Rao R. On some problems arising of discrimination with multiple characters. Sankya 1949;9:343-365
13. Raudys Š, Pikelis V. On dimensionality, sample size, classification error and complexity of classification algorithm in pattern recognition. IEEE Transaction on Pattern Analysis and Machine Intelligence 1980;2(3):242-252
14. Raudys S, Duin RPW. On expected classification error of the Fisher linear classifier with pseudo-inverse covariance matrix. Pattern Recognition Letters 1998;19(5-6):385-392