Adaptive regularization of neural networks using conjugate gradient

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2, Issue , 1998, Pages 1201-1204

  Goutte, Cyril ^a   Larsen, Jan ^a  

^a TECHNICAL UNIVERSITY OF DENMARK   (Denmark)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE REGULARIZATION; COMPUTATIONAL COSTS; GENERALIZATION ABILITY; GRADIENT DESCENT; NUMERICAL EXPERIMENTS; REGULARIZATION PARAMETERS; REGULARIZATION SCHEMES; VALIDATION ERRORS;

CONJUGATE GRADIENT METHOD; FEEDFORWARD NEURAL NETWORKS; SIGNAL PROCESSING;

ITERATIVE METHODS;

EID: 84872508028     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.1998.675486     Document Type: Conference Paper

References (16)

1. L.N. Andersen, J. Larsen, L.K. Hansen &M Hintz-Madsen: "Adaptive Regularization of Neural Classifiers," in J. Principe et al. (eds.) Proc. IEEE Workshop on Neural Networks for Signal Processing VII, Piscataway, New Jersey: IEEE, pp. 2433, 1997.
2. CM. Bishop: Neural Networks for Pattern Recognition, Oxford, UK: Oxford University Press, 1995.
3. J.E. Dennis k R.B. Schnabel: Numerical Meth-ods for Unconstrained Optimization and Nonlinear Equations, Englewood Cliffs, New Jersey: Prentice-Hall, 1983.
4. J.H. Friedman: "Multivariate Adaptive Regression Splines," The Annals of Statistics, vol. 19, no. 1, pp. 1-141, 1991.
5. S. Geman, E. Bienenstock k R. Doursat: "Neural Networks and the Bias/Variance Dilemma," Neural Computation, vol. 4, pp. 1-58, 1992.
6. K. Hornik: "Approximation Capabilities of Multilayer Feedforward Networks," Neural Networks, vol. 4, pp. 251-257, 1991.
7. P.J. Huber: Robust Statistics, New York, New York: John Wiley k Sons, 1981.
8. M. Kearns: "A Bound on the Error of Cross Validation Using the Approximation and Estimation Rates, with Consequences for the Training-Test Split," Neural Computation, vol. 9, no. 5, pp. 1143-1161, 1997.
9. J. Larsen k L.K. Hansen: "Empirical Generalization Assessment of Neural Network Models," in F. Girosi et al. (eds.), Proc. IEEE Workshop on Neural Networks for Signal Processing V, Piscataway, New Jersey: IEEE, 1995, pp. 30-39.
10. J. Larsen, L.K. Hansen, C. Svarer k M. Ohlsson: "Design and Regularization of Neural Networks: The Optimal Use of a Validation Set," in S. Usui et al. (eds.), Proc. IEEE Workshop on Neural Networks for Signal Processing VI, Piscataway, New Jersey: IEEE, 1996, pp. 62-71.
11. J. Larsen, C. Svarer, L.N. Andersen &L.K. Hansen: "Adaptive Regularization in Neural Network Modeling," appears in G.B. Orr et al. (eds.) "The Book of Tricks", Germany: Springer-Verlag, 1997. Available by ftp://eivind.mm.dtu.dk/ dist/1997/larsen.bot.ps.Z.
12. R.M. Neal: Bayesian Learning for Neural Networks, New York: Springer Verlag, 1996.
13. W.H. Press, S.A. Teukolsky, W.T. Vetterling, k B.P. Flannery: Numerical Recipes in C, The Art of Scientific Computing, Cambridge, Massachusetts: Cambridge University Press, 2nd Edition, 1992.
14. Carl E. Rasmussen: Evaluation of Gaussian Processes and Other Methods for Non-Linear Regression, Ph.D. Thesis, Dept. of Computer Science, Univ. of Toronto, 1996. Available by: ftp:// ftp.cs.toronto.edu/pub/carl/thesis.ps.gz.
15. G.A.F. Seber k C.J. Wild: Nonlinear Regression, New York, New York: John Wiley k Sons, 1989.
16. M.P. Wand &M.C. Jones: Kernel Smoothing, New York, New York: Chapman k Hall, 1995.