A simple methodology for soft cost-sensitive classification

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2012, Pages 141-149

  Jan, Te Kang ^a   Wang, Da Wei ^a   Lin, Chi Hung ^b   Lin, Hsuan Tien ^c  

^a INSTITUTE OF INFORMATION SCIENCE   (Taiwan)

^b NATIONAL YANG MING UNIVERSITY   (Taiwan)

^c NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

classification; cost sensitive learning; multicriteria optimization; regularization

Indexed keywords

CLASSIFICATION ERRORS; COST-SENSITIVE CLASSIFICATION; COST-SENSITIVE LEARNING; ERROR RATE; MULTICRITERIA OPTIMIZATION; REAL WORLD DATA; REGULARIZATION; TEST COST; TEST ERRORS;

ALGORITHMS; CLASSIFICATION (OF INFORMATION); COSTS; OPTIMIZATION; VIRTUAL REALITY;

DATA MINING;

EID: 84866034580     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2339530.2339555     Document Type: Conference Paper

References (40)

1. N. Abe, B. Zadrozny, and J. Langford. An iterative method for multi-class cost-sensitive learning. In Proc. SIGKDD, pages 3-11, 2004.
2. Y. S. Abu-Mostafa, M. Magdon-Ismail, and H.-T. Lin. Learning from Data: A Short Course. AMLBook, 2012.
3. S. D. Bay. UCI KDD archive. Department of Information and Computer Sciences, University of California, Irvine, 2000. Downloaded from http://kdd.ics.uci.edu/.
4. A. Bernstein, F. Provost, and S. Hill. Toward intelligent assistance for a data mining process: An ontology-based approach for cost-sensitive classification. IEEE TKDE, 17(4):503-518, 2005.
5. A. Beygelzimer, V. Daniand, T. Hayes, J. Langford, and B. Zadrozny. Error limiting reductions between classification tasks. In Proc. ICML, pages 49-56, 2005.
6. A. Beygelzimer, J. Langford, and P. Ravikumar. Multiclass classification with filter trees. Downloaded from http://hunch.net/~jl, 2007.
7. A. Campion and P. Kambhampati. Surface enhanced Raman scattering. Chem. Soc. Rev., 27(4):241-250, 1998.
8. C.-C. Chang and C.-J. Lin. LIBSVM: A library for support vector machines. ACM TIST, 2:27:1-27:27, 2011. Software available at http://www.csie.ntu.edu.tw/ ~cjlin/libsvm.
9. D. Corne, N. Jerram, J. Knowles, and M. Oates. PESA-II: Region-based selection in evolutionary multiobjective optimization. In Proc. GECCO, 2001.
10. I. Das and J. E. Dennis. A closer look at drawbacks of minimizing weighted sums of objectives for Pareto set generation in multicriteria optimization problems. Struct. Multidiscip. Opti., 14(1):63-69, 1996.
11. K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE TEC, 6(2):182-197, 2002.
12. P. Domingos. MetaCost: A general method for making classifiers cost-sensitive. In Proc. SIGKDD, pages 155-164, 1999.
13. C. Elkan. The foundations of cost-sensitive learning. In Proc. IJCAI, pages 973-978, 2001.
14. W. Fan, W. Lee, S. Stolfo, and M. Miller. A multiple model cost-sensitive approach for intrusion detection. In Proc. ECML, pages 142-154, 2000.
15. A. Freitas. Building cost-sensitive decision trees for medical applications. AI Comm., 24(3):285-287, 2011.
16. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. Witten. The WEKA data mining software: an update. SIGKDD Explor. Newsl., 11(1):10-18, 2009.
17. J. Han, M. Kamber, and J. Pei. Data mining: concepts and techniques. Morgan Kaufmann, 2011.
18. S. Hettich, C. L. Blake, and C. J. Merz. UCI repository of machine learning databases, 1998.
19. C. Hillermeier. Nonlinear multiobjective optimization. Birkhauser, 2001.
20. J. Horn, N. Nafpliotis, and D. Goldberg. A niched Pareto genetic algorithm for multiobjective optimization. In Proc. IEEE WCCI, pages 82-87, 1994.
21. C.-W. Hsu and C.-J. Lin. A comparison of methods for multi-class support vector machines. IEEE TNN, 13(2):415-425, 2002.
22. J. J. Hull. A database for handwritten text recognition research. IEEE TPAMI, 16(5):550-554, 1994.
23. T.-K. Jan. A comparison of methods for cost-sensitive support vector machines. Master's thesis, National Taiwan University, 2010.
24. T.-K. Jan, H.-T. Lin, H.-P. Chen, T.-C. Chern, C.-Y. Huang, C.-Y. Huang, C.-W. Chung, Y.-J. Li, Y.-C. Chuang, L.-L. Li, Y.-J. Chan, J.-K. Wang, Y.-L. Wang, C.-H. Lin, and D.-W. Wang. Cost-sensitive classification on pathogen species of bacterial meningitis by surface enhanced Raman scattering. In Proc. IEEE BIBM, pages 406-409, 2011.
25. J. Langford and A. Beygelzimer. Sensitive error correcting output codes. In Proc. COLT, pages 158-172, 2005.
26. W. Lee, W. Fan, M. Miller, S. Stolfo, and E. Zadok. Toward cost-sensitive modeling for intrusion detection and response. JCS, 10(1/2):5-22, 2002.
27. H.-T. Lin. A simple cost-sensitive multiclass classification algorithm using one-versus-one comparisons. Downloaded from http://www.csie.ntu.edu.tw/ ~htlin/paper/doc/csovo.pdf, 2010.
28. H.-T. Lin and L. Li. Support vector machinery for infinite ensemble learning. JMLR, 9(2):285-312, 2008.
29. D. D. Margineantu. Methods for cost-sensitive learning. PhD thesis, Oregon State University, 2001.
30. S. Rosset. Value weighted analysis: Building prediction models for data with observation. Downloaded from http://www.tau.ac.il/~saharon/, 2002.
31. K. Schleifer. Classification of bacteria and archaea: past, present and future. Syst. Appl. Microbiol., 32(8):533-542, 2009.
32. D. Sculley. Combined regression and ranking. In Proc. SIGKDD, pages 979-988, 2010.
33. Y. Sun, M. Kamel, A. Wong, and Y. Wang. Cost-sensitive boosting for classification of imbalanced data. PR, 40(12):3358-3378, 2007.
34. M. Tan. Cost-sensitive learning of classification knowledge and its applications in robotics. ML, 13(1):7-33, 1993.
35. H.-H. Tu. Regression approaches for multi-class cost-sensitive classification. Master's thesis, National Taiwan University, 2009.
36. H.-H. Tu and H.-T. Lin. One-sided support vector regression for multiclass cost-sensitive classification. In Proc. ICML, pages 1095-1102, 2010.
37. V. N. Vapnik. Statistical Learning Theory. Wiley, 1998.
38. L. Zadeh. Optimality and non-scalar-valued performance criteria. IEEE TAC, 8(1):59-60, 1963.
39. B. Zadrozny, J. Langford, and N. Abe. Cost-sensitive learning by cost-proportionate example weighting. In Proc. ICDM, pages 435-442, 2003.
40. Z.-H. Zhou and X.-Y. Liu. On multi-class cost-sensitive learning. In Proc. AAAI, pages 567-572, 2006.