General solution and learning method for binary classification with performance constraints

Pattern Recognition Letters

Volumn 29, Issue 10, 2008, Pages 1455-1465

  Bounsiar, Abdenour ^a   Beauseroy, Pierre ^a   Grall Maës, Edith ^a  

^a UNIVERSITÉ DE TECHNOLOGIE DE TROYES   (France)

Author keywords

Chow's rule; Classification with rejection option; Kernel methods; Neyman Pearson criterion; Performance constraints; Statistical hypothesis testing

Indexed keywords

LEARNING SYSTEMS; PROBABILITY; PROBLEM SOLVING; STATISTICAL TESTS;

KERNEL METHODS; NEYMAN-PEARSON CRITERION; PERFORMANCE CONSTRAINTS; REJECTION OPTIONS; STATISTICAL HYPOTHESIS TESTING;

CLASSIFICATION (OF INFORMATION);

EID: 44449152922     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2008.02.025     Document Type: Article

References (39)

1. Bach, F.R., Heckerman, D., Horvitz, E., 2005. On the path to an ideal ROC curve: Considering cost asymmetry in learning classifiers. In: Proc. 10th Internat. AISTATS Workshop.
2. Bayes T. An essay towards solving a problem in the doctrine of chances. Phil. Trans. Roy. Soc. 53 (1763) 370-418
3. Berger J.O. Statistical Decision Theory and Bayesian Analysis. second ed. (1985), Springer-Verlag, New York
4. Bounsiar, A., Beauseroy, P., Grall, E., 2005a. A straightforward SVM approach for classification with constraints. In: Proc. EUSIPCO'05 Conf., Antalya, Turkey.
5. Bounsiar, A., Grall, E., Beauseroy, P., 2005b. Using SVM for binary classification with type I error constraint. In: Proc. IEEE ICSIT'05 Conf., Algiers, Algeria, pp. 494-499.
6. Bounsiar, A., Grall, E., Beauseroy, P., 2006a. Fast training and efficient linear learning machine. In: Proc. IEEE Conf. ICASSP'06, Toulouse, France.
7. Bounsiar A., Grall E., and Beauseroy P. A kernel based rejection method for supervised classification. Internat. J. Comput. Intell. 3 4 (2006) 312-321
8. Burges C. A tutorial on support vector machines for pattern recognition. DMKD J. 2 2 (1998) 121-167
9. Chang C.-C., and Lin C.-J. Training nu-support vector classifiers: Theory and algorithms. Neural Comput. 13 (2001) 2119-2147
10. Chew, H.G., Bogner, R.E., Lim, C.C., 2001. Dual nu-support vector machines with error rate and training size biasing. In: Proc. IEEE ICASSP Conf., Salt Lake City, USA.
11. Chow C.K. An optimum character recognition system using decision functions. IEEE Trans. Electron. Comput. EC-6 (1957) 247-254
12. Chow C.K. On optimum error and reject trade-off. IEEE Trans. Informat. Theory 16 (1970) 41-46
13. Cortes C., and Vapnik V. Support vector networks. Mach. Learn. 20 (1995) 1-25
14. Davenport, M.A., 2005. The 2ν-SVM: A cost-sensitive extension of the ν-SVM. Tech. Rep. TREE 0504, Rice University, Dept. of Elec. and Comp. Engineering.
15. Davenport, M., Baraniuk, R., Scott, C., 2006. Controlling false alarms with support vector machines. In: Proc. IEEE ICASSP Conf., Toulouse, France, pp. V589-V592.
16. Domingos, P., 1999. Metacost: A general method for making classifiers cost-sensitive. In: Proc. KDD-99.
17. Fisher R.A. Statistical Methods for Research Workers (1925), Oliver & Boyd, Edinburgh
18. Fukunaga K. Introduction to Statistical Pattern Recognition. second ed. (1990), Academic Press, New York
19. Fumera, G., Roli, F., 2002. Support vector machines with embedded rejection option. In: Lee, S., Verri, A. (Eds), Pattern Recognition With Support Vector Machines, Lecture Notes in Computer Science, 2388, pp. 68-82.
20. Grall, E., Beauseroy, P., Bounsiar, A., 2006. Multilabel classification rule with performance constraints. In: Proc. IEEE ICASSP Conf., Toulouse, France.
21. Grall, E., Beauseroy, P., Bounsiar, A., 2006. Quality assessment of a supervised multilabel classification rule with performance constraints. In: EUSIPCO'06 Conf., Florence, Italy.
22. Ha T. The optimum class-selective rejection rule. Trans. Pattern Anal. Mach. Intell. 19 6 (1997) 608-615
23. Hastie T., and Tibshirani R. Classification by pairwise coupling. In: Jordan M.I., Karens M.J., and Solla S.A. (Eds). Advances in Neural Information Processing Systems vol. 10 (1998), MIT Press, Cambridge, MA 507-513
24. Kwok J. Moderating the outputs of support vector machine classifiers. IEEE Trans.-N.N. 10 5 (1999) 1018-1031
25. Lehmann E.L. The Fisher, Neyman-Pearson theories of testing hypotheses: One theory or two?. J. Amer. Statist. Assoc. 88 424 (1993) 1242-1249
26. Madevska-Bogdanova, A., Nikolic, D., 2000. A new approach of modifying SVM outputs. In: Proc. IEEE IJCNN'00 Internat. Conf., pp. 395-398.
27. Mukherjee S., Tamayo P., Slonim D., Verri A., Golub T., Mesirov J., and Poggio T. Support vector machine classification of microarray data. AI Memo (1999) 1677
28. Neyman J., and Pearson E. On the use and interpretation of certain test criteria for purposes of statistical inference. Biometrica 20A (1928) 263-294
29. Neyman J., and Pearson E. On the problem of the most efficient tests of statistical hypothesis. Philos. Trans. Roy. Soc. A231 9 (1933) 289-337
30. Neyman J., and Pearson E. The testing of statistical hypotheses in relation to probabilities a priori. Proc. Cambridge Philos. Soc. 29 (1933) 492-510
31. Parzen E. On estimation of a probability density function and mode. Ann. Math. Statist. 33 (1962) 1065-1076
32. Platt, J., 1999. Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In: Smola, A.J., Bartlet, P.L., Schölkopf, B., Schurmans, D. (Eds.), Advances in Large Margin Classifiers, pp. 61-74.
33. Provost, P., Fawcett, T., 1997. Analysis and visualization of classifier performance: Comparison under imprecise class and cost distribution. In: KDD-97, pp. 43-48.
34. Schölkopf B., Smola A.J., Williamson R., and Bartlett P. New support vector algorithms. Neural Comput. 12 5 (2000) 1207-1245
35. Scott C. Performance measures for Neyman-Pearson classification. IEEE Trans. Informat. Theory 53 8 (2007) 2852-2863
36. Tortorella F. Reducing the classification cost of support vector classifiers through an ROC-based reject rule. Pattern Anal. Appl. 7 (2004) 128-143
37. Turney P.D. Cost-sensitive classification: Empirical evaluation of a hybrid genetic decision tree induction algorithm. J. AI Res. 2 (1995) 369-409
38. Vapnik V. The Nature of Statistical Learning Theory (1995), Springer-Verlag
39. Vapnik V.N. Statistical Learning Theory (1998), John Wiley & Sons, New York