Perceptron and SVM learning with generalized cost models

Intelligent Data Analysis

Volumn 8, Issue 5, 2004, Pages 439-455

  Geibel, Peter ^a   Brefeld, Ulf ^b   Wysotzki, Fritz ^a  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

^b HUMBOLDT UNIVERSITY   (Germany)

Author keywords

costs; machine learning; perceptron; SVM

Indexed keywords

COSTS; LEARNING SYSTEMS; MACHINE LEARNING; NEURAL NETWORKS; PROBABILITY DISTRIBUTIONS; SUPPORT VECTOR MACHINES;

ARBITRARY COSTS; COST-SENSITIVE; GENERALIZED COST; MULTI-MODAL; PERCEPTRON LEARNING RULES;

LEARNING ALGORITHMS;

EID: 56449118713     PISSN: 1088467X     EISSN: 15714128     Source Type: Journal    
DOI: 10.3233/ida-2004-8502     Document Type: Article

References (23)

1. P.K. Chan and S.J. Stolfo, Toward scalable learning with non-uniform class and cost distributions: A case study in credit card fraud detection, in Knowledge Discovery and Data Mining (Proc. KDD98), 1998, pp. 164-168
2. F.H. Clarke, Optimization and Nonsmooth Analysis, Canadian Math. Soc. Series of Monographs and Advanced Texts, John Wiley & Sons, 1983.
3. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines (and Other Kernel-Based Learning Methods), Cambridge University Press, 2000.
4. L. Devroye, L. Gÿorfi and L. Gabor, A Probabilistic Theory of Pattern Recognition, Springer-Verlag, 1996.
5. R.O. Duda and P.E. Hart, Pattern Classification and Scene Analysis, John Wiley & Sons, New York, 1973.
6. C. Elkan, The foundations of Cost-Sensitive learning, in: Proceedings of the seventeenth International Conference on Artificial Intelligence (IJCAI-01), B. Nebel, ed., San Francisco, CA, Morgan Kaufmann Publishers, Inc., August 4-10, 2001, pp. 973-978.
7. P. Geibel and F. Wysotzki, Using costs varying from object to object to construct linear and piecewise linear classifiers, Technical Report 2002-5, TU Berlin, Fak. IV (WWW http://ki.cs.tu-berlin.de/?geibel/publications.html), 2002.
8. S. Hettich and S.D. Bay, The UCI KDD archive, University of California, Irvine, http://kdd.ics.uci-edu/.
9. R. Klinkenberg and S. R̈uping, Concept drift and the importance of examples, in: Text Mining-Theoretical Aspects and Applications, J. Franke, G. Nakhaeizadeh and I. Renz, eds, Springer, 2003.
10. M. Kukar and I. Kononenko, Cost-sensitive learning with neural networks, in: Proceedings of the 13th European Conference on Artificial Intelligence (ECAI-98), H. Prade, ed., Chichester, John Wiley & Sons, 1998, pp. 445-449.
11. A. Lenarcik and Z. Piasta, Rough classifiers sensitive to costs varying from object to object, in: Proceedings of the 1st International Conference on Rough Sets and Current Trends in Computing (RSCTC-98), (Vol. 1424 of LNAI), L. Polkowski and A. Skowron, editors, Berlin, Springer, June 22-26 1998, pp. 222-230.
12. Y. Lin, Support vector machines and the bayes rule in classification, Data Mining and Knowledge Discovery 6(3) (2002), 259-275.
13. Y. Lin, Y. Lee and G. Wahba, Support vector machines for classification in nonstandard situations, Machine Learning 46(1-3) (2002), 191-202.
14. D.D. Margineantu and T.G. Dietterich, Bootstrap methods for the cost-sensitive evaluation of classifiers, in Proc. 17th International Conf. on Machine Learning, Morgan Kaufmann, San Francisco, CA, 2000, pp. 583-590.
15. D. Michie, D.H. Spiegelhalter and C.C. Taylor, Machine Learning, Neural and Statistical Classification, Series in Artificial Intelligence, Ellis Horwood, 1994.
16. A. Nedic and D.P. Bertsekas, Incremental subgradient methods for nondifferentiable optimization, SIAM Journal on Optimization, 2001, pp. 109-13.
17. B. Schulmeister and F. Wysotzki, Dipol-a hybrid piecewise linear classifier, in: Machine Learning and Statistics: The Interface, R. Nakeiazadeh and C.C. Taylor, eds, Wiley, 1997, pp. 133-151.
18. S. Unger and F. Wysotzki, Lernf̈ahige Klassifizierungssysteme (Classifier Systems that are able to Learn), Akademie-Verlag, Berlin, 1981.
19. V.N. Vapnik, The Nature of Statistical Learning Theory, Springer, New York, 1995.
20. F. Wysotzki, W. M̈uller and B. Schulmeister, Automatic construction of decision trees and neural nets for classification using statistical considerations, in: Learning, Networks and Statistics, G. DellaRiccia, H.-J. Lenz and R. Kruse, eds, number 382 in CISM Courses and Lectures, Springer, 1997.
21. J. Yang, R. Parekh and V. Honavar, Comparison of performance of variants of single-layer perceptron algorithms on non-separable data, Neural, Parallel and Scientific Computation 8 (2000), 415-438.
22. B. Zadrozny and C. Elkan, Learning and making decisions when costs and probabilities are both unknown, in: Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-01), F. Provost and R. Srikant, eds, New York, August 26-29 2001, pp. 204-214.
23. B. Zadrozny, J. Langford and N. Abe, Cost-sensitive learning by cost-proportionate example weighting, in Proceedings of the 2003 IEEE International Conference on Data Mining, 2003, to appear.