K-nearest neighbors directed noise injection in multilayer perceptron training

IEEE Transactions on Neural Networks

Volumn 11, Issue 2, 2000, Pages 504-511

  Skurichina, M ^a   Raudys, S ^b   Duin, R P W ^a  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^b VILNIUS UNIVERSITY   (Lithuania)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL COMPLEXITY; LEARNING SYSTEMS;

NOISE INJECTION; PARZEN WINDOW CLASSIFIER;

MULTILAYER NEURAL NETWORKS;

EID: 0033751484     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.839019     Document Type: Article

References (28)

1. A. K. Jain and B. Chandrasekaran, "Dimensionality and sample size considerations in pattern recognition practice," in Handbook of Statistics, P. R. Krishnaiah and L. N. Kanal, Eds. Amsterdam: North-Holland, 1987, vol. 2, pp. 835-855.
2. S. Raudys and A. K. Jain, "Small sample size effects in statistical pattern recognition: Recommendations for practitioners," IEEE Trans. Pattern Anal. Machine Intell., vol. 13, pp. 252-264, 1991.
3. K. Matsuoka, "Noise injection into inputs in back-propagation learning," IEEE Trans. Syst., Man, Cybern., vol. 22, pp. 436-440, 1992.
4. Š. Raudys, M. Skurichina, T. Cibas, and P. Gallinari, "Optimal regularization of neural networks and ridge estimates of the covariance matrix in statistical classification," Pattern Recognition Image Anal.: Advances Math. Theory Applicat. (Int. J. Russian Academy Sci.), vol. 5, no. 4, pp. 633-650, 1995.
5. R. P. W. Duin, "Nearest neighbor interpolation for error estimation and classifier optimization," in Proc. 8th Scandinavian Conf. Image Anal.. Tromso, Norway, 1993, pp. 5-6.
6. M. Skurichina and R. P. W. Duin, "Bagging for linear classifiers," Pattern Recognition, vol. 31, no. 7, pp. 909-930, 1998.
7. H. Sakagushi, "Stochastic dynamics and learning rules in layered neural networks,"Progress Theoretical Phys., vol. 83, no. 4, pp. 693-700, Apr. 1990.
8. K. Fukunaga, Introduction to Statistical Pattern Recognition. San Diego, CA: Academic, 1990.
9. C. M. Bishop, Neural Networks for Pattern Recognition. Oxford, U.K.: Clarendon, 1995.
10. R. P. W. Duin, "On the accuracy of statistical pattern recognizers," Ph.D. dissertation, Delft Univ. Technol., 1978.
11. Š. Raudys, "On determining the training sample size of linear classifier," Comput. Syst., vol. 28, pp. 79-87, 1967.
12. _, "On the problems of sample size in pattern recognition," in Proc. 2nd All-Union Conf. Statist. Methods Contr. Theory. Moscow, Russia, 1970, pp. 64-67.
13. _, "On the effectiveness of Parzen window classifier," in Informatica. Vilnius, Lithuania: MII, 1991, vol. 2, pp. 434-454.
14. _, "On the shape of pattern error function, initializations and intrinsic dimensionality in ANN classifier design," Informatica, vol. 3, no. 3-4, pp. 360-383, 1993.
15. S. Raudys and M. Skurichina, "Small sample properties of ridge estimate of the covariance matrix in statistical and neural-net classification," in New Trends Probability Statist. 3: Multivariate Statist. Matrices Statistics, Proc. 5th Tartu Conf., Tartu-Puhajarve, Estonia, May 1994, pp. 237-245.
16. M. Rozenblatt, "Remarks on some nonparametric estimates of a density function," Ann. Math. Statist., vol. 27, pp. 832-837, 1956.
17. N. G. Zagoruiko, V. N. Elkina, and V. S. Temirkaev, "ZET - An algorithm of filling gaps in experimental data tables," Comput. Syst., vol. 67, pp. 3-28, 1976.
18. L. N. Kanal and B. Chandrasekaran, "On dimensionality and sample size in statistical pattern classification," in Proc. NEC, vol. 24, 1971, pp. 2-7.
19. B. Efron and R. Tibshirani, An Introduction to the Bootstrap. New York: Chapman and Hall, 1993.
20. A. E. Hoerl and R. W. Kennard, "Ridge-regression: Biased estimation of nonorthogonal problems," Technometrics, vol. 12, pp. 55-67, 1970.
21. D. Plaut, S. Nowlan, and G. Hinton, "Experiments on learning by back-propagation," Carnegie Mellon University, Pittsburgh, PA, Tech. Rep. CMU-CS-86-126, 1986.
22. R. A. Fisher, "The use of multiple measurements in taxonomic problems," Ann. Eugenics, pt. II, vol. 7, pp. 179-188, 1936.
23. E. Parzen, "On estimation of a probability density function and mode," Ann. Math. Statist., vol. 33, pp. 1065-1076, 1962.
24. J. H. Friedman, "Regularized discriminant analysis," J. Amer. Statist. Assoc. (JASA), vol. 84, pp. 165-175, 1989.
25. J. Sjoberg and L. Ljung, "Overtraining, regularization and searching for a minimum in neural networks," Dept. Elect. Eng., Linkoping Univ., Sweden, Tech. Rep., 1991.
26. C. M. Bishop, "Training with noise is equivalent to Tikhonov regularization," Neural Comput., vol. 7, no. 1, pp. 108-116, 1995.
27. T. K. Leen, "From data distributions to regularization in invariant learning," Neural Comput., vol. 7, no. 5, pp. 974-981, 1995.
28. Y. Grandvalet, S. Canu, and S. Boucheron, "Noise injection: Theoretical prospects," Neural Comput., vol. 9, no. 5, pp. 1093-1108, 1997.