Implementing linear models in genetic programming

IEEE Transactions on Evolutionary Computation

Volumn 8, Issue 6, 2004, Pages 542-566

  Yeun, Yun Seog ^a   Ruy, Won Sun ^a   Yang, Young Soon ^b   Kim, Nam Joon ^a  

^a Daejin University   (South Korea)

^b Seoul National University   (South Korea)

Author keywords

Directional derivative based smoothing (DDBS); Genetic programming (GP); Linear model; Minimum description length (MDL) principle; Polynomial; Symbolic processing

Indexed keywords

APPROXIMATION THEORY; FUNCTIONS; GENETIC ALGORITHMS; LINEAR PROGRAMMING; POLYNOMIALS; REGRESSION ANALYSIS; TREES (MATHEMATICS);

DIRECTIONAL DERIVATIVE BASED SMOOTHING (DDBS); GENETIC PROGRAMMING; LINEAR MODEL; MINIMUM DESCRIPTION LENGTH (MDL) PRINCIPLE; SYMBOLIC PROCESSING;

MATHEMATICAL MODELS;

EID: 11844300360     PISSN: 1089778X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TEVC.2004.836818     Document Type: Article

References (36)

1. J. R. Koza, Genetic Programming: On the Programming of Computers by Means of Natural Selection. Cambridge, MA: MIT Press, 1992.
2. K. C. Sharman, A. I. Esparcia-Alcazar, and Y. Li, "Evolving signal processing algorithms by generic programming," in Proc. 1st IEE /IEEE Int. Conf. GA Eng. Syst.: Innovations and Appl., Sheffield, Sept. 1995, pp. 473-480.
3. G. J. Gray, Y. Li, D. J. Murray-Smith, and K. C. Sharman, " Structural system identification using genetic programming and a block diagram oriented simulation tool" Electron. Lett., vol. 32, pp. 1422-1424, 1996.
4. K. D. Bettenhausen, P. Marenbach, S. Freyer, H. Rettenmaier, and U. Nieken, "Self-organizing structured modeling of a biotechnological fedbatch fermentation by means of genetic programming," in Proc. IEE Conf. GALESIA, 414, Sheffield, U.K., 1995, pp. 481-486.
5. B. McKay, M. J. Willis, H. G. Hiden, G. A. Montague, and G. W. Barton, "Identification of industrial processes using genetic programming," in Proc. Identification Engineering Systems, vol. 1, Swansea, U.K., 1996, pp. 510-519.
6. T. Weinbrenner, "Genetic programming techniques applied to measurement data," Diploma dissertation, Dept. Electron. Elec. Eng., Center Syst. Control, Univ. Glasgow, Glasgow, U.K., 1997.
7. N. Y. Nikolaev and H. Iba, "Regularization approach to inductive genetic programming," IEEE Trans. Evol. Comput., vol. 5, pp. 359-376, Aug. 2001.
8. H. Iba, T. Sato, and H. deGaris, "System identification approach to genetic programming," in Proc. 1st IEEE Conf. Evolutionary Computation, vol. 1, 1994, pp. 401-406.
9. H. Iba and N. Nikolaev, "Inductive genetic programming of polynomial learning networks," in Proc. 1st IEEE Symp. Combination Evolutionary Computation Neural Networks, 2000, pp. 158-167.
10. Y. S. Yeun, J. C. Suh, and Y. S. Yang, "Function approximation by superimposing genetic programming trees: With application to engineering problems," Inform. Sci., vol. 122, no. 2-4, 2000.
11. Y. S. Yeun, K. H. Lee, and Y. S. Yang, "Function approximations by coupling neural networks and genetic programming trees with oblique design trees," Artif. Intell. Eng., vol. 13, no. 3, pp. 223-239, 1999.
12. K. H. Lee, Y. S. Yeun, W. S. Ruy, and Y. S. Yang. Polynomial genetic programming for response surface modeling, presented at Proc. 4th Int. Workshop Frontiers Evolutionary Algorithms (FEA2002), In conjunction with 6th Joint Conf. Information Sciences. [Online]. Available: http://dept.daejin.ac.kr/~yeonyun
13. V. V. Toropov and L. F. Alvarez, "Approximation model building for design optimization using genetic programming methodology," in Proc. 7th AIAA/USAF/NASA/ISSMO Symp. Multidisciplinary Analysis Optimization St. Louis, MO, 1998, pp. 490-498.
14. V. V. Toropov and L. F. Alvarez, "Application of genetic programming and response surface methodology to optimization and inverse problems," in Proc. Int. Symp. Inverse Problems Engineering Mechanics (ISIP'98) Nagono City, Japan, 1998, pp. 551-560.
15. J. Rissanen, "Fisher information and stochastic complexity," IEEE Trans. Inform. Theory, vol. 42, pp. 40-47, Jan. 1996.
16. A. Barron, J. Rissanen, and B. Yu, "The minimum description length principle in coding and modeling," IEEE Trans. Inform. Theory, vol. 44, pp. 2743-2760, Oct. 1998.
17. P. Grünwald, "The minimum description length principle and reasoning under uncertainty," Ph.D. dissertation, ILLC dissertation series DS 1998-03, CWI, The Netherlands, 1998. [Online]. Available: http://www.cwi.nl/~pdg/thesispage.html.
18. [Online]. Available: http://garage.cps.msu.edu/software/ softwareindex.html
19. A. D. Lanterman, "Schwarz, Wallace, and Rissanen: Intertwining themes in theories of model order estimation," Int. Statist. Rev., vol. 69, no. 2, pp. 185-212, 2001.
20. H. Iba, H. deGaris, and T. Sato, "Genetic programming using a minimum description length principle," in Advances in Genetic Programming K. Kinnear, Jr., Ed. Cambridge, MA: MIT Press, 1994, pp. 265-284.
21. H. Akaike, "A new look at the statistical model identification," IEEE Trans. Automat. Contr., vol. AC-16, pp. 716-723, Dec. 1974.
22. G. Schwarz, "Estimating the dimension of a model," Ann. Statist. vol. 6, no. 2, pp. 461-464, 1978.
23. J. Rissanen, "Modeling by shortest data description," Automata, vol. 14, pp. 465-471, 1978.
24. M. H. Hansen and Y. Bin, "Model selection and the principle of minimum description length," J. Amer. Statist. Assoc., vol. 96, no. 454, pp. 746-774, 2001. [Online]. Available: http:/ /cm.bell-labs.com/cm/ms/who/cocteau/papers.
25. T. C. M. Lee, "An introduction to coding theory and the two-part minimum description length principle," Int. Statist. Rev., vol. 69, no. 2, pp. 169-183, 2001. [Online]. Available: http:// www.stat.colostate.edu/~tlee/PSfiles/mdltut.ps.gz.
26. Y. M. Shtarkov, "Universal sequential coding of single messages," Probl. Inform. Transm., vol. 23, no. 3, pp. 3-17, 1987.
27. V. Balasubramanian, "Statistical inference, Occam's Razor and statistical mechanics on the space of probability distributions," Neural Comput., vol. 9, no. 2, Feb. 1997. [Online]. Available: http://dept.physics.upenn.edu/~vbalasub/inference.html.
28. I. J. Myung, V. Balasubramanian, and M. A. Pitt, "Counting probability distributions: Differential geometry and model selection," in Proc. National Academy Science, vol. 97, 2000, pp. 11 170-11 175. [Online]. Available: http:/ /dept.physics.upenn.edu/~vbalasub/inference.html.
29. R. Hooke and T. A. Jeeves, "Direct search solution of numerical and statistical problems," J. ACM, vol. 8, pp. 212-229, Apr. 1961.
30. H. H. Rosenbrock, "An automatic method for finding the greatest or least value of a function" Comput. J., vol. 3, pp. 175-184, 1960.
31. P. Lancaster and K. Salkauskas, Curve and Surface Fitting. New York: Academic Press, 1986.
32. [Online]. Available: http://www.salford-systems.com
33. [Online]. Available: http://www.neurosolutions.com
34. K. Y. Lee, B. H. Cho, J. W. Huh, and G. H. Jung, "Development of the hydraulic control system for automatic transmission using proportional solenoid valve," (in Korean), Inst. Precision Machinery Design, Seoul Nat. Univ., Seoul, Korea, Tech. Rep., 1997.
35. S. M. Han, "Study on the development of case-adaptation algorithm for midship section design," Ph.D. dissertation (in Korean), Dept. Naval Archit. Ocean Eng., Seoul Nat. Univ., Seoul, Korea, 2002.
36. C. B. Barber, D. P. Dobkin, and H. T. Huhdanpaa, "The Quickhull algorithm for convex hulls," ACM Trans. Math. Softw., vol. 22, no. 4, pp. 469-483, 1996.