Learning perceptrons and piecewise linear classifiers sensitive to example dependent costs

Applied Intelligence

Volumn 21, Issue 1, 2004, Pages 45-56

  Geibel, Peter ^a   Wysotzki, Fritz ^a  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

Author keywords

Classification; Costs; Learning; Neural networks; Perceptron; Risk

Indexed keywords

ALGORITHMS; COSTS; LEARNING SYSTEMS; MATRIX ALGEBRA; RADIAL BASIS FUNCTION NETWORKS; RISKS; VECTORS;

COST MATRIX; LEARNING PERCEPTRONS; LINEAR CLASSIFIERS; PERCEPTRON ALGORITHMS;

NEURAL NETWORKS;

EID: 3543125887     PISSN: 0924669X     EISSN: None     Source Type: Journal    
DOI: 10.1023/B:APIN.0000027766.72235.bc     Document Type: Article

References (24)

1. L. Saitta (Ed.), Machine Learning - A Technological Roadmap, University of Amsterdam, ISBN: 90-5470-096-3, 2000.
2. R.O. Duda and P.E. Hart, Pattern Classification and Scene Analysis, John Wiley & Sons: New York, 1973.
3. C.M. Bishop, Neural Networks Pattern Recognition, Oxford University Press: Oxford, 1995.
4. D. Michie, D.H. Spiegelhalter, and C.C. Taylor, Machine Learning, Neural and Statistical Classification, Series in Artificial Intelligence, Ellis Horwood, 1994.
5. D.D. Margineantu and T.G. Dietterich, "Bootstrap methods for the cost-sensitive evaluation of classifiers," in Proc. 17th International Conf. on Machine Learning, Morgan Kaufmann: San Francisco, CA, 2000, pp. 583-590.
6. C. Elkan, "The foundations of cost-sensitive learning," in Proceedings of the Seventeenth International Conference on Artificial Intelligence (IJCAI-01), edited by B. Nebel, Morgan Kaufmann Publishers, Inc.: San Francisco, CA, 2001, pp. 973-978.
7. L.C. Thomas, "A survey of credit and behavioural scoring: Forecasting financial risk of lending to consumers," International Journal of Forecasting, vol. 16, pp. 149-172, 2000.
8. B. Schulmeister and F. Wysotzki, "DIPOL - A hybrid piecewise linear classifier," in Machine Learning and Statistics: The Interface, edited by R. Nakeiazadeh and C.C. Taylor, Wiley, 1997, pp. 133-151.
9. F. Wysotzki, W. Müller, and B. Schulmeister, "Automatic construction of decision trees and neural nets for classification using statistical considerations," in Learning, Networks and Statistics, edited by G. DellaRiccia, H.-J. Len, and R. Kruse, No. 382 in CISM Courses and Lectures. Springer, 1997.
10. A. Lenarcik and Z. Piasta, "Rough classifiers sensitive to costs varying from object to object," in Proceedings of the 1st International Conference on Rough Sets and Current Trends in Computing (RSCTC-98), edited by L. Polkowski and A. Skowron, vol. 1424 of LNAI. Springer: Berlin, pp. 222-230, 1998.
11. S. Unger and F. Wysotzki, Lernfähige Klassifizierungssysteme (Classifier Systems that are able to Learn), Akademie-Verlag: Berlin, 1981.
12. J. Yang, R. Parekh, and V. Honavar, "Comparison of performance of variants of single-layer perceptron algorithms on non-separable data," Neural, Parallel and Scientific Computation, vol. 8, pp. 415-438, 2000.
13. Y. Freund and R.E. Schapire, "Large margin classification using the perceptron algorithm," in COLT: Proceedings of the Workshop on Computational Learning Theory, Morgan Kaufmann Publishers, ACM Press: New York, 1998, pp. 209-217.
14. F.H. Clarke, Optimization and Nonsmooth Analysis, Canadian Math. Soc. Series of Monographs and Advanced Texts, John Wiley & Sons, 1983.
15. A. Nedic and D. Bertsekas, "Incremental subgradient methods for nondifferentiable optimization," SIAM Journal on Optimisation, pp. 109-138, 2001.
16. M. Hasenjaeger and H. Ritter, "Perceptron learning revisited: The sonar targets problem," Neural Processing Letters, vol. 10, no. 1, pp. 17-24, 1999.
17. V.N. Vapnik, The Nature of Statistical Learning Theory, Springer: New York, 1995.
18. C.J.C. Burges, "A tutorial on support vector machines for pattern recognition," Knowledge Discovery and Data Mining, vol. 2, no. 2, 1998.
19. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines (and Other Kernel-Based Learning Methods), Cambridge University Press, 2000, pp. 955-974.
20. S. Knerr, L. Personnaz, and G. Dreyfus, "Handwritten digit recognition by neural networks with single-layer training," IEEE Transactions on Neural Networks, vol. 3, no. 6, pp. 962-968, 1992.
21. D. Price, S. Knerr, L. Personnaz, and G. Dreyfus, "Pairwise neural network classifiers with probabilistic outputs," in Advances in Neural Information Processing Systems, edited by G. Tesauro, D. Touretzky, and T. Leen, vol. 7. The MIT Press, 1995, pp. 1109-1116.
22. P. Geibel and F. Wysotzki, "Using costs varying from object to object to construct linear and piecewise linear classifiers," Technical Report 2002-5, TU Berlin, Fak. IV (WWW http://ki.cs.tuberlin.de/~geibel/ publications.html), 2002.
23. R.I. Damper, S.R. Gunn, and M.O. Gore, "Extracting phonetic knowledge from learning systems: Perceptrons, support vector machines and linear discriminants," Applied Intelligence, vol. 12, pp. 43-62, 2000.
24. B.-J. Falkowski, "Risk analysis using perceptrons and quadratic programming," in Computational Intelligence, edited by B. Reusch, Springer Verlag, 1999, vol. 1625.