Variants of unsupervised kernel regression: General cost functions

Neurocomputing

Volumn 70, Issue 7-9, 2007, Pages 1289-1303

  Klanke, Stefan ^a   Ritter, Helge ^a  

^a BIELEFELD UNIVERSITY   (Germany)

Author keywords

lunate Insensitive loss; Huber's loss; Nonlinear dimension reduction; Robust manifold learning

Indexed keywords

AUTOMATA THEORY; COST FUNCTIONS; OPTIMIZATION; REGRESSION ANALYSIS;

HUBER LOSS; NONLINEAR DIMENSION REDUCTION; RUBOST MANIFOLD LEARNING; UNSUPERVISED KERNEL REGRESSION;

UNSUPERVISED LEARNING;

ALGORITHM; ANALYTICAL ERROR; ARTICLE; AUTOMATION; COMPUTER PROGRAM; CONTROLLED STUDY; K NEAREST NEIGHBOR; KERNEL METHOD; LINEAR SYSTEM; MATHEMATICAL COMPUTING; NONLINEAR SYSTEM; NORMAL DISTRIBUTION; PRIORITY JOURNAL; PROCESS OPTIMIZATION; REGRESSION ANALYSIS; SIGNAL NOISE RATIO; VALIDATION STUDY;

EID: 33847421841     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2006.11.015     Document Type: Article

References (26)

1. Belkin M., and Niyogi P. Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput. 15 6 (2003) 1373-1396
2. Bishop C.M., Svensen M., and Williams C.K.I. GTM: the generative topographic mapping. Neural Comput. 10 1 (1998) 215-234
3. Clark R.M. Non-parametric estimation of a smooth regression function. J. R. Statist. Soc. Ser. B (Methodological) 39 1 (1977) 107-113
4. Demartines P., and Herault J. Curvilinear component analysis: a self-organizing neural network for nonlinear mapping of data sets. IEEE Trans. Neural Networks 8 1 (1997) 148-154
5. Donoho D.L., and Grimes C. Hessian eigenmaps: locally linear embedding techniques for high dimensional data. Proc. Natl. Acad. Sci. 100 10 (2003) 5591-5596
6. Fyfe C., and MacDonald D. Epsilon-insensitive Hebbian learning. Neurocomputing 47 (2002) 35-57
7. Härdle W. Applied Nonparametric Regression (1990), Cambridge University Press, Cambridge
8. Härdle W., and Marron J.S. Optimal bandwidth selection in nonparametric regression function estimation. Ann. Statist. 13 4 (1985) 1465-1481
9. Huber P.J. Robust Statistics (1981), Wiley, New York
10. Klanke S., and Ritter H. A leave-K-out cross-validation scheme for unsupervised kernel regression. In: Kollias S., Stafylopatis A., Duch W., and Oja E. (Eds). Artificial Neural Networks-ICANN 2006, Lecture Notes in Computer Science vol. 4132 (2006), Springer, Berlin 427-436
11. Kohonen T. Self-Organizing Maps (1995), Springer, Berlin
12. Kramer M.A. Nonlinear principal component analysis using autoassociative neural networks. AIChE 37 (1991) 233-243
13. Lee J., Lendasse A., Donckers N., and Verleysen M. A robust non-linear projection method. Proceedings of the European Symposium on Artificial Neural Networks (2000), Bruges, Belgium 13-20
14. Meinicke P., Klanke S., Memisevic R., and Ritter H. Principal surfaces from unsupervised kernel regression. IEEE Trans. Pattern Anal. Mach. Intell. 27 9 (2005) 1379-1391
15. Nadaraya E.A. On estimating regression. Theory Probab. Appl. 10 (1964) 186-190
16. Rao S.S. Optimization: Theory and Applications (1978), Wiley Eastern Ltd., New Delhi
17. M. Riedmiller, H. Braun, A direct adaptive method for faster backpropagation learning: the RPROP algorithm, in: Proceedings of the IEEE International Conference on Neural Networks, 1993, pp. 586-591.
18. Roweis S.T., and Saul L.K. Nonlinear dimensionality reduction by locally linear embedding. Science 290 (2000) 2323-2326
19. Sammon Jr. J.W. A non-linear mapping for data structure analysis. IEEE Trans. Comput. 18 (1969) 401-409
20. Schölkopf B., and Smola A.J. Learning with Kernels (2002), MIT Press, Cambridge, MA
21. Smola A., Schölkopf B., and Müller K. General cost functions for support vector regression. In: Downs T., Frean M., and Müller M. (Eds). Proceedings of the ninth Australian Conference on Neural Networks. Brisbane, Australia (1998) 79-83
22. Smola A.J., Mika S., Schölkopf B., and Williamson R.C. Regularized principal manifolds. J. Mach. Learn. Res. 1 (2001) 179-209
23. Tenenbaum J.B., deSilva V., and Langford J.C. A global geometric framework for nonlinear dimensionality reduction. Science 290 (2000) 2319-2323
24. Vapnik V. Statistical Learning Theory (1998), Wiley, New York
25. Watson G.S. Smooth regression analysis. Sankhya Ser. A 26 (1964) 359-372
26. Weinberger K.Q., and Saul L.K. Unsupervised learning of image manifolds by semidefinite programming. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition CVPR-04, vol. 2. Washington, DC (2004) 988-995