Fast regularized kernel function approximation

IEEE Region 10 Annual International Conference, Proceedings/TENCON

Volumn , Issue , 2008, Pages

  Ghorai, Santanu ^a   Mukherjee, Anirban ^a   Dutta, Pranab K ^a  

^a INDIAN INSTITUTE OF TECHNOLOGY   (India)

Author keywords

Function approximation; Kernel method; Reduced kernel; Regression analysis; Support vector regression

Indexed keywords

COMPUTATIONAL RESULTS; FUNCTION APPROXIMATION; KERNEL FUNCTIONS; KERNEL METHOD; LARGE DATABASE; OBJECTIVE FUNCTIONS; PREDICTION ERRORS; QUADRATIC FUNCTIONS; QUADRATIC PROGRAMMING PROBLEMS; REAL-WORLD DATUM; REDUCED KERNEL; REGRESSION FUNCTIONS; SUPPORT VECTOR REGRESSION; SYSTEM OF LINEAR EQUATIONS; TRAINING TIME;

MATLAB;

REGRESSION ANALYSIS;

EID: 63049117950     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/TENCON.2008.4766523     Document Type: Conference Paper

References (35)

1. V. N. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
2. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines. Cambridge, Mass.: Cam. Univ. Press, 2000.
3. A. Smola, P. L. Bartlett, B. Scḧolkopf, and J. Schurmann (editors), Advances in Large Margin Classifiers. MIT Press, Cam., MA, 2000.
4. C. J. C. Burges, A tutorial on support vector machines for pattern recognition, Data Mining and Knowledge Discov., 2(2):121-167, 1998.
5. J. A. K. Suykens and J. Vandewalle., "Least squares support vector machine classifiers," in Neural Processing Letters, 9(3):293:300, 1999.
6. H. Drucker, C. J. C. Burges, L. Kaufman, A. Smola, and V. Vapnik, "Support vector regression machines," in Advances in N.I.P.S. 9, M. C. Mozer, M. I. Jordan, and T. Petsche, Eds. Cambridge, MA: MIT Press, 1997, pp. 155-161.
7. V. Vapnik, S. Golowich, and A. J. Smola, "Support vector method for function approximation, regression estimation, and signal processing," in NIPS. Camb., MA: MIT Press, 1997, vol. 9.
8. A. J. Smola and B. Schölkopf, "A tutorial on support vector regression", Royal Holloway College, London, U.K., Neuro COLT Tech. Rep. TR-1998-030, 1998.
9. O.L. Mangasarian and D.R. Musicant, "Robust Linear and Support Vector Regression," IEEE Trans. on PAMI, vol. 22, no. 9, pp. 950-955, 2000, ftp://ftp.cs. wisc. edu/ pub/ dmi/tech-reports/99-09.ps.
10. C. C. Chuang, S. F. Su, J. T. Jeng and C. C. Hsiao, "Robust Support Vector Regression Networks for Function Approximation With Outliers," IEEE Trans. N. Nets., vol. 13, no. 6, pp. 1322- 1330, 2002.
11. O.L. Mangasarian and D.R. Musicant, "Large Scale Kernel Regression via Linear Programming," in Machine Learning, vol. 46, pp. 255-269, 2002, ftp://ftp.cs.wisc.edu/pub/dmi/tech-reports/ 99-02.ps.
12. D.R. Musicant and A. Feinberg, "Active Set Support Vector Regression," IEEE Trans. N. Nets., vol. 15, no. 2, pp. 268-275, 2004.
13. Y.-J. Lee, W.-F. Hsieh, and C.-M. Huang, "ε-SSVR: A smooth support vector machine for ε-insensitive regression," IEEE Trans. Knowl. Data Eng., vol. 17, no. 5, pp. 678-685, May 2005.
14. Y. B. Dibike, S.Velickov, and D. Solomatine, "Support vector machines: Review and applications in civil engineering," in AI Methods in Civil Engineering Applications, pp. 45-58, 2000.
15. A. Demiriz, K. Bennett, C. Breneman, and M. Embrechts, "Support vector machine regression in chemometrics," Comput. Sci. Stat., 2001.
16. R. Collobert and S. Bengio, "SVMTorch: Support vector machines for large-scale regression problems," in J. M. Learn. Res. [Online], vol (1), pp. 143-160. Feb., 2001. Available: http://www.jmlr.org.
17. J. Shawe-Taylor, N. Cristianini, Kernel Methods for Pattern Analysis, Cambridge Univ. Press, Camb., 2004.
18. A. Smola and B. Schölkopf, "Sparse greedy matrix approximation for machine learning," in Proc. 17th Int. Conf. Mach. Learn., San Francisco, CA, 2000, pp. 911-918.
19. P. Drineas and M. W. Mahoney, "On the Nyström method for approximating a Gram matrix for improved kernel-based learning," J. M. Learn. Res, vol. 6, pp. 2153-2175, 2005.
20. Y.-J. Lee and O. L. Mangasarian, "RSVM: Reduced Support Vector Machines," Proc. First SIAM Int'l Conf. Data Mining, Apr.2001, ftp://ftp.cs.wisc.edu/pub/dmi/tech-reports/00-07.ps.
21. G. Fung and O. L. Mangasarian, "Proximal Support Vector Machine Classifiers," 7th Int'l Proc. Knowledge Discovery and Data Mining, pp.77-86, 2001, ftp://ftp.cs.wisc.edu/pub/dmi/tech-reports/01-02.ps.
22. O. L. Mangasarian and E.W. Wild, "Multisurface Proximal Support Vector Classification via Generalized Eigenvalues," IEEE Trans. on PAMI, vol. 28, no. 1, pp. 69-74, Jan. 2006.
23. Jayadeva, R. Khemchandani, and S. Chandra, "Twin Support Vector Machines for Pattern Classification", IEEE Trans. on PAMI, vol. 29, no. 5, pp. 905-910, May. 2007.
24. K.-M. Lin and C.-J. Lin, "A Study on Reduced Support Vector Machines," IEEE Trans. N. Nets., vol. 14, no. 6, pp. 1449- 1459, 2003.
25. S.Y. Huang and Y.J. Lee, "Reduced Support Vector Machines: A Statistical Theory," IEEE Trans. N. Nets., vol. 18, no. 1, pp. 1-13, 2007.
26. M. Wu, B. Schölkopf, and G. Bakir, "A direct method for building sparse kernel learning algorithms," J. M. Learn. Res, vol. 7, pp. 603-624, 2006.
27. MATLAB, User's Guide, The MathWorks, Inc., 1994-2001, http://www.mathworks.com
28. C.-C. Chang and C.-J. Lin, LIBSVM: A Library for SVM, 2001, software available at http://www.csie.ntu. edu.tw /∼cjlin /libsvm.
29. T. Joachims, SVMlight, 2002, http://svmlight.joachims.org.
30. S. R. Gunn, MATLAB SVM Toolbox, 1998. [Online]. Available: http://www.isis.ecs.soton.ac.uk/resources/svminfo/download.php.
31. M. Stone, "Cross-validatory choice and assessment of statistical predictions," J. of the R. Statistical Society, vol. 36, pp. 111-147, 1974.
32. Laser time series data set -A. http://www-psych.stanford.edu/ ∼andreas/ Time-Series/SantaFe.html.
33. Y. Engel, S. Mannor and R. Meir, "The Kernel Recursive Least-Squares Algorithm," IEEE Trans. on Signal Processing. Vol. 52, no. 8, pp-2275-2286, Aug. 2004
34. C.L. Blake and C.J. Merz, "UCI Repository for Machine Learning Databases," Dept. of Inform. and Comp. Sc., Univ. of California, Irvine, http://www.ics.uci.edu/∼mlearn/MLRepository. html, 1998.
35. DELVE, Data for Evaluating Learning in Valid Experiments, Comp-Activ Dataset, http://www.cs.toronto.edu/∼delve/data/comp-activ/desc.html, 2005.