Learning using privileged information: SV M+ and weighted SVM

Neural Networks

Volumn 53, Issue , 2014, Pages 95-108

  Lapin, Maksim ^a   Hein, Matthias ^b   Schiele, Bernt ^a  

^a MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

^b SAARLAND UNIVERSITY   (Germany)

Author keywords

Importance weighting; Prior knowledge; Privileged information; SV M+; SVM; Weighted SVM

Indexed keywords

IMPORTANCE WEIGHTING; PRIOR KNOWLEDGE; PRIVILEGED INFORMATION; SV M; WEIGHTED SVM;

ARTIFICIAL INTELLIGENCE; COGNITIVE SYSTEMS;

INFORMATION USE;

ARTICLE; HUMAN; INFORMATION PROCESSING; INFORMATION SYSTEM; LEARNING; LEARNING ALGORITHM; MATHEMATICAL MODEL; PRIORITY JOURNAL; PRIVILEGED INFORMATION; SUPPORT VECTOR MACHINE; WEIGHTED SUPPORT VECTOR MACHINE; ALGORITHM;

ALGORITHMS; HUMANS; SUPPORT VECTOR MACHINES;

EID: 84896724050     PISSN: 08936080     EISSN: 18792782     Source Type: Journal    
DOI: 10.1016/j.neunet.2014.02.002     Document Type: Article

References (38)

1. Bennett K.P., Mangasarian O.L. Robust linear programming discrimination of two linearly inseparable sets. Optimization Methods & Software 1992, 1(1):23-34.
2. Beygelzimer, A., Dasgupta, S., & Langford, J. (2009). Importance weighted active learning. In ICML (pp. 49-56).
3. Borwein J., Lewis A. Convex analysis and nonlinear optimization: theory and examples 2000, Springer-Verlag.
4. Boyd S., Vandenberghe L. Convex optimization 2004, Cambridge University Press.
5. Burges, C.J.C., & Crisp, D.J. (1999). Uniqueness of the SVM solution. In NIPS (pp. 223-229).
6. Chang C.-C., Lin C.-J. LIBSVM: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology 2011, 2:27:1-27:27. Software available at: http://www.csie.ntu.edu.tw/cjlin/libsvm.
7. Chapelle O. Training a support vector machine in the primal. Neural Computation 2007, 19(5):1155-1178.
8. Semi-supervised learning 2006, MIT Press, Cambridge, MA. O. Chapelle, B. Schölkopf, A. Zien (Eds.).
9. Chapelle O., Vapnik V., Bousquet O., Mukherjee S. Choosing multiple parameters for support vector machines. Machine Learning 2002, 46(1-3):131-159.
10. Chen, J., Liu, X., & Lyu, S. (2012). Boosting with side information. In ACCV (pp. 5-9).
11. Cortes, C., Mansour, Y., & Mohri, M. (2010). Learning bounds for importance weighting. In NIPS (pp. 442-450).
12. Dredze, M., Crammer, K., & Pereira, F. (2008). Confidence-weighted linear classification. In ICML (pp. 264-271).
13. Elkan, C. (2001). The foundations of cost-sensitive learning. In IJCAI (pp. 973-978).
14. Elter M., Schulz-Wendtland R., Wittenberg T. The prediction of breast cancer biopsy outcomes using two CAD approaches that both emphasize an intelligible decision process. Medical Physics 2007, 34(11):4164-4172.
15. Feyereisl J., Aickelin U. Privileged information for data clustering. Information Sciences 2012, 194:4-23.
16. Fouad, S., Tino, P., Raychaudhury, S., & Schneider, P. (2012). Learning using privileged information in prototype based models. In ICANN (pp. 322-329).
17. Frank, A., & Asuncion, A. (2010). UCI machine learning repository. http://archive.ics.uci.edu/ml.
18. Heckman J.J. Sample selection bias as a specification error. Econometrica: Journal of the Econometric Society 1979, 153-161.
19. Lauer F., Bloch G. Incorporating prior knowledge in support vector machines for classification: a review. Neurocomputing 2008, 71(7-9):1578-1594.
20. Liang L., Cai F., Cherkassky V. Predictive learning with structured (grouped) data. Neural Networks 2009, 22(5-6):766-773.
21. Liang, L., & Cherkassky, V. (2008). Connection between SVM+ and multi-task learning. In IJCNN (pp. 2048-2054).
22. Lin C.-F., Wang S.-D. Fuzzy support vector machines. IEEE Transactions on Neural Networks 2002, 13(2):464-471.
23. Margineantu, D.D. (2002). Class probability estimation and cost-sensitive classification decisions. In ECML (pp. 270-281).
24. Nocedal J., Wright S. Numerical optimization 2006, Springer. 2nd ed.
25. Pechyony, D., & Vapnik, V. (2010). On the theory of learnining with privileged information. In NIPS (pp. 1894-1902).
26. Pechyony D., Vapnik V. Fast optimization algorithms for solving SVM+. Statistical learning and data science 2011, Chapman & Hall.
27. Schölkopf, B., Herbrich, R., & Smola, A. (2001). A generalized representer theorem. In COLT (pp. 416-426).
28. Schölkopf, B., Simard, P.Y., Smola, A.J., & Vapnik, V.N. (1998). Prior knowledge in support vector kernels. In NIPS (pp. 640-646).
29. Schölkopf B., Smola A. Learning with kernels: support vector machines, regularization, optimization and beyond 2002, University Press Group Limited.
30. Shimodaira H. Improving predictive inference under covariate shift by weighting the log-likelihood function. Journal of Statistical Planning and Inference 2000, 90(2):227-244.
31. Sugiyama M., Müller K.-R. Input-dependent estimation of generalization error under covariate shift. Statistics & Decisions 2005, 23(4):249-279.
32. Vapnik V. Empirical inference science afterword of 2006 2006, Springer.
33. Vapnik V., Vashist A. A new learning paradigm: learning using privileged information. Neural Networks 2009, 22(5-6):544-557.
34. Vapnik, V., Vashist, A., & Pavlovitch, N. (2009). Learning using hidden information (Learning with teacher). In IJCNN (pp. 3188-3195).
35. Wolf, L., & Levy, N. (2013). The SVM-minus similarity score for video face recognition. In CVPR (pp. 3523-3530).
36. Wu, X., & Srihari, R. (2004). Incorporating prior knowledge with weighted margin support vector machines. In SIGKDD (pp. 326-333).
37. Yang, X., Song, Q., & Cao, A. (2005). Weighted support vector machine for data classification. In IJCNN (pp. 859-864).
38. Zadrozny, B., Langford, J., & Abe, N. (2003). Cost-sensitive learning by cost-proportionate example weighting. In ICDM (pp. 435-448).