Infinite kernel learning via infinite and semi-infinite programming

Optimization Methods and Software

Volumn 25, Issue 6, 2010, Pages 937-970

  Ozogur Akyuz S ^a   Weber, G W ^b,c  

^a BAHCESEHIR UNIVERSITY   (Turkey)

^b MIDDLE EAST TECHNICAL UNIVERSITY   (Turkey)

^c UNIVERSITY OF SIEGEN   (Germany)

Author keywords

continuous optimization; data mining; infinite programming; machine learning; numerical methods; semi infinite optimization; support vector machines

Indexed keywords

BILEVEL OPTIMIZATION PROBLEMS; CONTINUOUS OPTIMIZATION; CONVEX COMBINATIONS; DENSITY FUNCTIONS; HETEROGENEOUS DATA; INFINITE NUMBERS; INFINITE PROGRAMMING; INTEGRAL CONSTRAINTS; KERNEL LEARNING; LEARNING PROBLEM; MACHINE-LEARNING; MULTIPLE KERNEL LEARNING; NOVEL METHODS; PARAMETRIZATIONS; PROBABILITY MEASURES; REDUCTION METHOD; REGULARITY CONDITION; RESEARCH CHALLENGES; SEMI INFINITE PROGRAMMING; SEMI-INFINITE OPTIMIZATION;

DATA MINING; NUMBER THEORY; OPTIMIZATION; SUPPORT VECTOR MACHINES;

NUMERICAL METHODS;

EID: 77955580870     PISSN: 10556788     EISSN: 10294937     Source Type: Journal    
DOI: 10.1080/10556780903483349     Document Type: Conference Paper

References (46)

1. E.J. Anderson and P. Nash, Linear Programming in Infinite-Dimensional Spaces, John Wiley and Sons Ltd, NewYork, 1987.
2. T.M. Apostol, Mathematical Analysis: A Modern Approach to Advanced Calculus, AddisonWesley, 1974.
3. A. Argyriou, R. Hauser, C.A. Micchelli, and M. Pontil, A DC-programming algorithm for kernel selection, 23rd International Conference on Machine Learning, Pittsburgh, PA, 2006.
4. A. Aster, B. Borchers, and C. Thurber, Parameter Estimation and Inverse Problems, Elsevier Academic Press, Burlington, MA, 2004.
5. F.R. Bach and G.R.G. Lanckriet, Multiple kernel learning, conic duality, and the smo algorithm, International Conference on Machine Learning, Banff, Canada, 2004.
6. C.-C. Chang and C.-J. Lin, LIBSVM: A library for support vector machines, 2001; software available at http://www.csie.ntu.edu.tw/cjlin/libsvm.
7. C.-T. Chen, Linear System Theory and Design, Oxford University Press, NewYork, 1999.
8. W. Chen, C. Ma, and L. Ma, Mining the customer credit using hybrid support vector machine technique, Expert Syst. Appl. (36)(2009), pp. 7611-7616.
9. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods, Cambridge University Press, Cambridge, UK, 2000.
10. R.M. Dudley, Real Analysis and Probability, Cambridge University Press, Cambridge, UK, 1989.
11. M.A. Goberna and M.A. Lopez, Linear Semi-Infinite Optimization, JohnWiley and Sons Ltd, NewYork, 1998.
12. R.S. Hamilton, The inverse function theorem of Nash and Moser, Bull. Amer. Math. Soc. (M.S.) 7(1) (1982), pp. 99-132.
13. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning - Data Mining, Inference and Prediction, Springer Series in Statistics, Springer, NewYork, 2001.
14. R. Hettich and H.Th. Jongen, Semi-infinite programming: Conditions of optimality and applications, in Optimization Techniques 2, J. Stoer, ed., Lecture notes in Control and Information Science, Springer, Berlin, Heidelberg, NewYork, 1978, pp. 1-11.
15. R. Hettich and O.Kortanek, Semi-infinite programming: Theory, methods and applications, SIAM Rev. 35(3) (1993), pp. 380-429.
16. R. Hettich and P. Zencke, Numerische Methoden der Approximation und semi-infiniten Optimierung, Teubner, Stuttgart, 1982.
17. E. Kropat, G.W.Weber, and B.Akteke-Öztürk, Eco-finance networks under uncertainty, EngOpt 2008 - International Conference on Engineering Optimization, Rio de Janeiro, Brazil, 1-5 June 2008.
18. G.R.G. Lanckriet, N. Cristianini, L.E. Ghaoui, P. Bartlett, and M.I. Jordan, Learning the kernel matrix with semidefinite programming, J. Mach. Learn. Res. 5 (2004), pp. 27-72.
19. W. Linde, Probability in Banach Spaces - Stable and Infinitely Divisible Distributions, John Wiley and Sons, Chichester, NY, 1983.
20. J.M. Ortega, Numerical Analysis: A second course, Academic Press, SIAM, NewYork, 1977.
21. J.M. Ortega andW.C. Reinboldt, Iterative Solution of Nonlinear Equations with Multiple Variables, Academic Press, NewYork, 1970.
22. S. Özöǧür-Akyüz, A mathematical contribution of statistical learning and continuous optimization using infinite and semi-infinite programming to computational statistics, Ph.D. Thesis, Middle East Technical University, Institute of Applied Mathematics, Turkey, 2009.
23. S. Özöǧür, J. Shawe-Taylor, G.-W.Weber, and Z.B. Ögel, Pattern analysis for the prediction of eukoryatic pro-peptide cleavage sites, Discrete Appl. Math. 157 (2009), pp. 2388-2394.
24. S. Özöǧür-Akyüz, Z. Hussain and J. Shawe-Taylor, Prediction with the SVM using test point margins, in Annals of Information Systems 8: Data Mining, Stahlbock, R., Crone, S.V., and Lessmann, S., eds., Springer, Hamburg, 2010, pp. 147-158.
25. K.R. Parthasarathy, Probability Measures on Metric Spaces, AMS Chelsea Publishing, Providence, RI, 2005.
26. A. Rakotomamonjy, F. Bach, S. Canu, and Y. Grandvalet, More efficiency in multiple kernel learning, 24th International Conference on Machine Learning, Corvallis, 2007.
27. B. Schölkopf and A.J. Smola. Learning with Kernels, MIT Press, MA, USA, 2002.
28. J. Shawe-Taylor, Review of Anthony, Martin; Bartlett, Peter L., Neural Network Learning: Theoretical Foundations, Cambridge University Press, Cambridge, UK, 2001.
29. J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis, Cambridge University Press, Cambridge, UK, 2004.
30. A.N. Shiryaev, Probability, Springer Verlag, NewYork, 1995.
31. E.M. Silvia., Riemann-stieltjes integration, Technical report, UC Davis, One Shields Avenue, Davis, 1999.
32. S. Sonnenburg, G. Raetsch, C. Schafer, and B. Schöelkopf, Large scale multiple kernel learning, J. Mach. Learn. Res. 7 (2006), pp. 1531-1565.
33. G. Still, Semi-infinite programming: An introduction, preliminary version, Technical Report, 2004.
34. A. Takeda and T. Kanamori, A robust approach based on conditional value-at-risk measure to statistical learning problems, Eur. J. Oper. Res. 198 (2009), pp. 287-296.
35. P. Taylan and G.-W.Weber, New approaches to regression in financial mathematics by additive models, J. Comput. Technol. 12(2) (2007), pp. 3-22.
36. P. Taylan, G.-W. Weber, and A. Beck, New approaches to regression by generalized additive models and continuous optimization for modern applications in finance, science and techology, Optimization 56 (5)&(6) (2007), pp. 675-698.
37. P. Taylan, G.-W. Weber, and F. Yerlikaya, Continuous optimization applied in MARS for modern application in finance, science and technology, Continuous Optimization and Knowledge Based Technologies, 20th EURO Mini conference, Lithuania, 2008, pp. 317-322.
38. V.N. Vapnik, Statistical Learning Theory, JohnWiley and Sons, 1998.
39. R.S. Varga, Matrix Iterative Analysis, Springer, 2000.
40. Z. Wan, S.Y. Wu and K.L. Teo, Some properties on quadratic infinite programs of integral type, Appl. Math. Lett. 20 (2007), pp. 676-680.
41. G.-W.Weber, Charakterisierung struktureller Stabilität in der nichtlinearen Optimierung, inAachener Beitraege zur Mathematik 5, H.H. Bock, H.Th. Jongen andW. Plesken, eds., Augustinus publishing house (now: Mainz Publishing House), Aachen, 1992.
42. G.-W. Weber, Minimization of a max-type function: Characterization of structural stability, in Parametric Optimization and Related Topics III, J. Guddat, H.Th. Jongen, B. Kummer, and F. Nozicka, eds., Peter Lang publishing house, Frankfurt a.m., Bern, 1993, pp. 519-538.
43. G.W.Weber, Generalized Semi-Infinite Optimization and Related Topics, Research and Exposition in Mathematics, Vol.29, Heldermann Verlag, Germany, 2003.
44. G.-W. Weber, P. Taylan, S. Özöǧür, and B. Akteke-Öztürk, Statistical learning and optimization methods in data mining, in Recent Advances in Statistics, H.O.Ayhan and I. Batmaz, eds., Turkish Statistical Institute Press, Ankara, 2007, pp. 181-195.
45. W.W.E. Wetterling, Definitheitsbedingungen für relative Extrema bei Optimierungs und Approximationsaufgaben, Numer. Math. 12 (1970), pp. 122-136.
46. F. Yerlikaya, G.-W. Weber, P. Taylan, I. Batmaz, and G. Köksal, MARS Algoritmasinda Tikhonov Düzenlemesi ve çok Amaçli Optimizasyon Kullanimi, Proceedings of Operational Research and Industrial Engineering Annual Conference (YA/EM'08) Galatasaray University, Istanbul, Turkey, 30 June-2 July 2008 (on a CD).