Nonlinear regression model generation using hyperparameter optimization

Computers and Mathematics with Applications

Volumn 60, Issue 4, 2010, Pages 981-988

  Strijov, Vadim ^a   Weber, Gerhard Wilhelm ^b  

^a DORODNICYN COMPUTING CENTER   (Russian Federation)

^b MIDDLE EAST TECHNICAL UNIVERSITY   (Turkey)

Author keywords

Coherent Bayesian inference; Hyperparameters; Model generation; Model selection; Regression

Indexed keywords

AUTOMATIC CONSTRUCTION; BAYESIAN INFERENCE; ESTIMATE MODEL; HYPER-PARAMETER; HYPERPARAMETERS; INDUCTIVE MODELS; MODEL GENERATION; MODEL PARAMETERS; MODEL SELECTION; NONLINEAR REGRESSION MODELS; REGRESSION MODEL; SMOOTH FUNCTIONS;

BAYESIAN NETWORKS; DISTRIBUTION FUNCTIONS; INFERENCE ENGINES;

REGRESSION ANALYSIS;

EID: 77955426712     PISSN: 08981221     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.camwa.2010.03.021     Document Type: Conference Paper

References (23)

1. H.R. Madala, and A.G. Ivakhnenko Inductive Learning Algorithms for Complex Systems Modeling 1994 CRC Press
2. J.A. Mueler, and F. Lemke Sel-Organising Data Mining: An Intelligent Approach to Extract Knowledge from Data 1999 Dresden
3. J.R. Koza Genetic Programming IV: Routine Human-Competitive Machine Intelligence 2005 Springer
4. I. Zelinka, L. Nolle, and Z. Oplatkova Analytic programming symbolic regression by means of arbitrary evolutionary algorithms Journal of Simulation 6 2004 258 265
5. E. Vladislavleva, Model-based problem solving through symbolic regression via Pareto genetic programming, Tilburg University, Tilburg, the Netherlands, 2008.
6. E. Vladislavleva, G. Smith, and D. Hertog Order of nonlinearity as a complexity measure for models generated by symbolic regression via pareto genetic programming IEEE Transactions on Evolutionary Computation 13 2009 333 349
7. Y. LeCun, J. Denker, S. Solla, R.E. Howard, and L.D. Jackel Optimal brain damage D.S. Touretzky, Advances in Neural Information Processing Systems II 1990 Morgan Kauffman San Mateo, CA
8. B. Hassibi, and D.G. Stork Second order derivatives for network pruning: Optimal brain surgeon S.J. Hanson, J.D. Cowan, C.L. Giles, Advances in Neural Information Processing Systems vol. 5 1993 Morgan Kaufmann San Mateo, CA 164 171
9. C. Bishop Pattern Recognition and Machine Learning 2006 Springer
10. I. Ulusoy, and C.M. Bishop Generative versus discriminative methods for object recognition Computer Vision and Pattern Recognition, IEEE Computer Society Conference 2 2005 258 265
11. C.M. Bishop, and M.E. Tipping Bayesian regression and classification J. Suykens, G. Horvath, Advances in Learning Theory: Methods, Models and Applications NATO Science Series III: Computer and Systems Sciences vol. 190 2000 IOS Press 267 285
12. C. Bishop Neural Networks and Machine Learning 1997 Springer
13. D.J.C. Mackay Comparison of approximate methods for handling hyperparameters Neural Computation 11 2003 1035 1068
14. D. MacKay Information Theory, Inference, and Learning Algorithms 2003 Cambridge University Press
15. D.J. MacKay Bayesian interpolation Neural Computation 4 1991 415 447
16. D.J. MacKay, Choice of basis for Laplace approximation, Technical Report, Machine Learning, 1998.
17. Y.T. Nabney Netlab: Algorithms for Pattern Recognition 2004 Springer
18. V. Strijov The search for a parametric regression model in an inductive-generated set Journal of Computational Technologies 2007 93 102
19. V. Strijov, Methods of the inductive generation for regression models, Computing Center of the Russian Academy of Sciences, Moscow, 2008.
20. V. Strijov, and R. Sologub The inductive generation of the volatility simile models Journal of Computational Technologies 2009
21. K. Levenberg A method for the solution of certain non-linear probelms in least squares Quart. Appl. Math. 2 1944 164 168
22. J. Hull Options, Futures, and other Derivative Securities 1993 Prentice Hall, Inc.
23. F. Black, and M. Scholes The pricing of options and corporate liabilities Journal of Political Economy 1973 636 659