Finding optimal model parameters by deterministic and annealed focused grid search

Neurocomputing

Volumn 72, Issue 13-15, 2009, Pages 2824-2832

  Jiménez, Álvaro Barbero ^a   Lázaro, Jorge López ^a   Dorronsoro, José R ^a  

^a UNIVERSIDAD AUTÓNOMA DE MADRID   (Spain)

Author keywords

Annealing; CMA ES; Evolutive algorithms; Grid search; Optimal parameters

Indexed keywords

ANNEALING; COVARIANCE MATRIX; EVOLUTIONARY ALGORITHMS; PARAMETER ESTIMATION;

COVARIANCE MATRIX ADAPTATION EVOLUTION STRATEGIES; ENGINEERING APPLICATIONS; EVOLUTIVE ALGORITHMS; GRID SEARCH; OPTIMAL PARAMETER; PARAMETER SEARCH SPACE; RANDOM ALGORITHMS; UNIFORM DESIGN;

OPTIMIZATION;

ALGORITHM; ARTICLE; CLASSIFICATION; COVARIANCE; MATHEMATICAL ANALYSIS; MATHEMATICAL COMPUTING; PRIORITY JOURNAL; PROCESS OPTIMIZATION; STANDARDIZATION; STATISTICAL MODEL; STATISTICAL PARAMETERS; SUPPORT VECTOR MACHINE;

EID: 77955516396     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2008.09.024     Document Type: Article

References (22)

1. R. Duda, P. Hart, D. Stork, Pattern Classification, Wiley, New York, 2000.
2. V. Vapnik, The Nature of Statistical Learning Theory, Springer, New York, 1995.
3. B. Schölkopf, A.J. Smola, Learning with Kernels: Support Vector Machines, Regularization, Optimization and Beyond, Machine Learning, MIT Press, Cambridge, MA, 2002.
4. S.S. Keerthi, Efficient tuning of SVM hyperparameters using radius/margin bound and iterative algorithms, IEEE Transactions on Neural Networks 13 (5) (2002)1225-1229.
5. D.C. Montgomery, Design and Analysis of Experiments, Wiley, New York, 1976.
6. C.-W Hsu, Ch.-Ch. Chang, Ch.-J. Lin, A practical guide to support vector classification 〈www.csie.ntu.edu.tw/~cjlin/libsvmtools〉.
7. C. Staelin, Parameter selection for support vector machines, Technical Report HPL-2002-354, HP Laboratories, Israel, 2000.
8. C. Harpham, C.W. Dawson, M.R. Brown, A review of genetic algorithms applied to training radial basis function networks, Neural Computing & Applications 13 (3) (2004) 193-201.
9. L.E. Kuo, S.S. Melsheimer, Using genetic algorithms to estimate the optimum width parameter in radial basis function networks, in: Proceedings of the American Control Conference, Baltimore, MD, June 1994.
10. T. Howley, M.G. Madden, The genetic kernel support vector machine: description and evaluation, Artificial Intelligence Review 24 (3-4) (2005) 379-395.
11. CM. Huang, Y.J. Lee, D. Lin, S.Y Huang, Model selection for support vector machines via uniform design, Computational Statistics and Data Analysis 52 (1)(2007)335-346.
12. N. Hansen, A. Ostermeier, Completely derandomized self-adaptation in evolution strategies, Evolutionary Computation 9 (2) (2001) 159-195.
13. A. Auger, N. Hansen, Performance evaluation of an advanced local search evolutionary algorithm, in: Proceedings of the 2005 IEEE Congress on Evolutionary Computation, September 2005, pp. 1777-1884.
14. B.F. Mitchell, V.F. Dem'yanov, V.N. Malozemov, Finding the point of a polyhedron closest to the origin, SIAM Journal on Control 12 (1974) 19-26.
15. F. Friedrichs, C. Igel, Evolutionary tuning of multiple SVM parameters, Neurocomputing 64 (2005) 107-117.
16. N. Hansen, The CMA evolution strategy: source code 〈http://www.bionik.tu-berlin.de/user/niko/cmaes_inmatlab.html〉.
17. K.T. Fang, D.K.J. Lin, Uniform experimental designs and their applications in industry, Handbook of Statistics 22 (2003) 131-170.
18. The Uniform Design Association of China, Uniform design tables 〈http://www.math.hkbu.edu.hk/UniformDesign/〉.
19. N. Hansen, The CMA evolution strategy: a tutorial 〈http://www.bionik.tu-berlin.de/user/niko/cmatutorial.pdf〉.
20. S. Kirkpatrick, CD. Gelatt Jr., M.P. Vecchi, Optimization by simulated annealing, Science 4598 (1983) 671-680.
21. G. Ratsch, Benchmark repository 〈http://ida.first.fraunhofer.de/projects/bench/benchmarks.htm〉.
22. S.S. Keerthi, S.K. Shevade, C Bhattacharyya, K.R.K. Murthy, A fast iterative nearest point algorithm for support vector machine classifier design, IEEE Transactions on Neural Networks 11 (1) (2000) 124-136.