Using domain-specific knowledge in generalization error bounds for support vector machine learning

Decision Support Systems

Volumn 46, Issue 2, 2009, Pages 481-491

  Eryarsoy, Enes ^a   Koehler, Gary J ^b   Aytug, Haldun ^b  

^a SABANCI UNIVERSITY   (Turkey)

^b UNIVERSITY OF FLORIDA   (United States)

Author keywords

Ellipsoid method; Error bounds; Fat shattering dimension; Prior knowledge; Support vector machines

Indexed keywords

CONTROL THEORY; GEARS; IMAGE RETRIEVAL; LEARNING SYSTEMS; MULTILAYER NEURAL NETWORKS; NUMERICAL ANALYSIS; VECTORS;

CONVEX POLYTOPE; DO-MAINS; DOMAIN KNOWLEDGES; ELLIPSOID METHOD; ERROR BOUNDS; FAT-SHATTERING DIMENSION; GENERAL FRAMEWORKS; GENERALIZATION ERROR BOUNDS; INPUT SPACES; LINEAR CONSTRAINTS; PRIOR KNOWLEDGE; SPECIFIC KNOWLEDGES; UPPER AND LOWER BOUNDS; UPPER BOUNDS;

SUPPORT VECTOR MACHINES;

EID: 57849101999     PISSN: 01679236     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.dss.2008.09.001     Document Type: Article

References (40)

1. Alon N., Ben-David S., Cesa-Bianchi N., and Haussler D. Scale-sensitive dimensions, uniform convergence, and learnability. Journal of the ACM 44 4 (1997) 615-631
2. Avis D., and Devroye L. Estimating the number of vertices of a polyhedron. Information Processing Letters 73 137-143 (2001) 137
3. Barzilay O., and Brailovsky V.L. On domain knowledge and feature selection using a support vector machine. Pattern Recognition Letters 20 (1999) 475-484
4. Bennett J.C., and Campbel C. Support vector machines: hype or hallelujah. SIGKDD Explorations 2 2 (2000) 1-13
5. Bland R.G., Goldfarb D., and Todd M.J. The ellipsoid method: a survey. Operations Research 29 6 (1981) 1039-1091
6. Cecchini M. Timely Discovery of Financial Events using Publicly Available Company Information. Phd Dissertation, University of Florida (2005)
7. Chau M., and Chen H. A machine learning approach to web page filtering using content and structure analysis. Decision Support Systems 44 2 (2008) 482-494
8. Cristianini N., and Shawe-Taylor J. An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods (2000), Cambridge University Press, Cambridge, UK
9. Cristianini N., Shawe-Taylor J., and Lodhi H. Latent semantic kernels. Journal of Intelligent Information Systems 18 2/3 (2002) 127-152
10. Fung G., Mangasarian O., and Shavlik J. Knowledge-based Nonlinear Kernel Classifiers. Data Mining Institute, Computer Sciences Department (2003), University of Wisconsin, Madison, Wisconsin. ftp://ftp.cs.wisc.edu/pub/dmi/tech-reports/03-02.ps Technical Report 03-02, Retrieved Sept 11, 2005, from ftp://ftp.cs.wisc.edu/pub/dmi/tech-reports/03-02.ps
11. Fung G., Mangasarian O., and Shavlik J. Knowledge-based Support Vector Machine Classifiers. Data Mining Institute, Computer Sciences Department (2001), University of Wisconsin, Madison, Wisconsin. ftp://ftp.cs.wisc.edu/pub/dmi/tech-reports/01-09.pdf Technical Report 01-09 Retrieved Sept 11, 2007 from ftp://ftp.cs.wisc.edu/pub/dmi/tech-reports/01-09.pdf
12. Grötschel M., Lovazs L., and Schrijver A. Geometric Algorithms and Combinatorial Optimization. Algorithms and Combinatorics: Study and Research Texts vol. 2 (1988), Springer-Verlag, Berlin
13. Hristev R.M. The ANN Book (1998). ftp://math.chtf.stuba.sk/pub/vlado/NN_books_texts/Hritsev_The_ANN_Book.p df Retrieved September 11, 2007 from ftp://math.chtf.stuba.sk/pub/vlado/NN_books_texts/Hritsev_The_ANN_Book.p df
14. Huang Z., Chen H., Hsu C., Chen W., and Wu S. Credit rating analysis with support vector machines and neural networks: a market comparative study. Decision Support Systems 37 4 (2004) 543-558
15. Hush D., and Scovel C. Fat-Shattering of Affine Functions (2003) Los Alamos National Laboratory Technical Report LA-UR-03-0937
16. Iudin D.B., and Nemirovskii A.S. Informational complexity and efficient methods for solving complex extremal problems. Translated in Matekon: Translations of Russian and East European Mathematical Economics vol. 13 (1976) 25-45
17. Joachims T. Text categorization with support vector machines: learning with many relevant features. Proceedings of the European Conference on Machine Learning (ECML), Springer (1998)
18. Joachims T., Cristianini N., and Shawe-Taylor J. Composite kernels for hypertext categorisation. Proceedings of the International Conference on Machine Learning (ICML) (2001)
19. Khachiyan L.G. A polynomial algorithm for linear programming. Soviet Mathematics Doklady 20 (1979) 191-194
20. Kumar P., and Yi{dotless}ldi{dotless}ri{dotless}m A.E. Minimum volume enclosing ellipsoids and core sets. Journal of Optimization Theory and Applications 126 1 (2005) 1-21
21. Le Q.V., Smola A.J., and Gartner T. Simpler knowledge-based support vector machines. Proceedings of the 23rd International Conference on Machine Learning, Pittsburgh, PA (2006)
22. Martens, D., Bruynseels, L., Baesens, B., Willekens, M., & Vanthienen, J., (in press). Predicting Going Concern Opinion with Data Mining. Decision Support Systems
23. McMullen P. The maximum number of faces of a convex polytope. Mathematika XVII (1970) 179-184
24. Niyogi P., Poggio T., and Girosi F. Incorporating prior information in machine learning by creating virtual examples. IEEE Proceedings on Intelligent Signal Processing 86 (1998) 2196-2209
25. Rimon E., and Boyd S.P. Efficient Distance Computation Using the Best Ellipsoid Fit. Technical Report, Stanford University (1992)
26. Rimon E., and Boyd S.P. Obstacle collision detection using best ellipsoid fit. Journal of Intelligent and Robotic Systems 18 (1997) 105-126
27. Schölkopf B., Simard P., Smola A., and Vapnik V. Prior knowledge in support vector kernels. In: Jordan M., Kearns M., and Solla S. (Eds). Advances in Neural Information Processing Systems 10, Cambridge, MA (1998) 640-646
28. Shawe-Taylor J., Bartlett P.L., Williamson R.C., and Anthony M. Structural risk minimization over data-dependent hierarchies. IEEE Transactions on Information Theory 44 (1998) 1926-1940
29. Shor N.Z. Convergence rate of the gradient descent method with dilatation of the space. translated in Cybernetics 6 2 (1970) 102-108
30. Song D., Lau R.Y.K., Bruza P.D., Wong K., and Chen D. An intelligent information agent for document title classification and filtering in document-intensive domains. Decision Support Systems 44 1 (2007) 251-265
31. Valiant L.G. A theory of the learnable. Communications of the ACM 27 (1984) 1134-1142
32. Van Gestel T., Baesens B., Van Dijcke P., Garcia J., Suykens J.A.K., and Vanthienen J. A process model to develop an internal rating system: sovereign credit ratings. Decision Support Systems 42 2 (2006) 1131-1151
33. Vapnik N.V. Statistical Learning Theory (1998), John Wiley & Sons, Toronto, CA
34. Vapnik N.V. Estimation Dependences Based on Empirical Data (1982), Springer-Verlag, NY
35. Vapnik N.V., and Chervonenkis A.Y. On the uniform convergence of relative frequencies of events to their probabilities. Theory of Probability and Its Applications 16 2 (1971) 264-280
36. Wagacha P.W. Induction of Decision Trees (2003), University of Nairobi
37. Wolpert D.H. The existence of a priori distinctions between learning algorithms. Neural Computation 8 7 (1996) 1391-1420
38. Wolpert D.H. The lack of a priori distinctions between learning algorithms. Neural Computation 8 7 (1996) 1341-1390
39. Wolpert D.H. The supervised learning no-free-lunch theorems. Proceedings of the 6th Online World Conference on Soft Computing in Industrial Applications (2001)
40. Wolpert D.H., and Macready W.G. No free lunch theorems for search. Technical Report (1995), Santa Fe Institute SFI-TR-95-02-010