A discretization method based on maximizing the area under receiver operating characteristic curve

International Journal of Pattern Recognition and Artificial Intelligence

Volumn 27, Issue 1, 2013, Pages

  Kurtcephe, Murat ^a,b   Güvenir, H Altay ^a  

^a BILKENT UNIVERSITY   (Turkey)

^b CASE WESTERN RESERVE UNIVERSITY   (United States)

Author keywords

area under ROC curve; Data mining; discretization

Indexed keywords

AREA UNDER ROC CURVE (AUC); DISCRETIZATION METHOD; DISCRETIZATIONS; MULTI-CLASS CLASSIFICATION; REAL-WORLD DATASETS; RECEIVER OPERATING CHARACTERISTIC CURVES; RECEIVER OPERATING CHARACTERISTICS CURVES (ROC); SUPERVISED DISCRETIZATION;

DATA MINING; LEARNING ALGORITHMS; LEARNING SYSTEMS; VOLUME MEASUREMENT;

DISCRETE EVENT SIMULATION;

EID: 84874804088     PISSN: 02180014     EISSN: None     Source Type: Journal    
DOI: 10.1142/S021800141350002X     Document Type: Article

References (39)

1. A. An and N. Cercone, Discretization of continuous attributes for learning classication rules, in Proc. Third Pacic-Asia Conf. Knowledge Discovery and Data Mining, Beijing, China (1999), pp. 509-514.
2. A. Asuncion and D. J. Newman, UCI Machine Learning Repository, University of California, School of Information and Computer Science, Irvine, CA (2007), http://www.ics. uci.edu/-mlearn/MLRepository.html.
3. A. P. Bradley, The use of the area under the ROC curve in the evaluation of machine learning algorithms, Pattern Recogn. 30(7) (1997) 1145-1159.
4. J. Catlett, On changing continuous attributes into ordered discrete attributes, in Proc. Fifth European Working Session on Learning (Springer-Verlag, Berlin, 1991), pp. 164-177.
5. J. Cerquides and R. L. Mantaras, Proposal and empirical comparison of a parallelizable distance-based discretization method, KDD97: Third Int. Conf. Knowledge Discovery and Data Mining (1997), pp. 139-142.
6. C. C. Chan, C. Batur and A. Srinivasan, Determination of quantization intervals in rule based model for dynamic systems, in Proc. IEEE Conf. Systems, Man, and Cybernetics, Charlottesvile, Virginia (1991), pp. 1719-1723.
7. J. Dougherty, R. Kohavi and M. Sahami, Supervised and unsupervised discretization of continuous features, in Proceedings of the Twelfth International Conference on Machine Learning, eds. A. Prieditis and S. Russell (Morgan Kaufmann, San Francisco, CA, 1995), pp. 194-202.
8. T. Fawcett, An introduction to ROC analysis, Pattern Recogn. Lett. 27 (2006) 861-874.
9. U. Fayyad and K. Irani, On the handling of continuous-valued attributes in decision tree generation, Mach. Learn. 8 (1992) 87-102.
10. S. Garcia, J. Luengo, J. Saez, V. Lopez and F. Herrera, A survey of discretization techniques: Taxonomy and empirical analysis in supervised learning, IEEE Trans. Knowl. Data Eng., in press, doi: 10.1109/TKDE.2012.35.
11. D. M. Green and J. A. Swets, Signal Detection Theory and Psychophysics (Wiley, New York, 1966).
12. M. Hall et al., The WEKA data mining software: An update, SIGKDD Explorations 11(1) (2009) 10-18.
13. D. J. Hand and R. J. Till, A simple generalization of the area under the ROC curve to multiple class classication problems, Mach. Learn. 45(2) (2001) 171-186.
14. J. A. Hanley and B. J. McNeil, The meaning and use of the area under a receiver operating characteristic (ROC) curve, Radiology 143 (1982) 29-36.
15. K. M. Ho and P. D. Scott, Zeta: A global method for discretization of continuous variables, KDD97: 3rd Int. Conf. Knowledge Discovery and Data Mining, Newport Beach, CA (1997), pp. 191-194.
16. R. C. Holte, Very simple classication rules perform well on most commonly used datasets, Mach. Learn. 11 (1993) 63-90.
17. R. Kerber, Chimerge: Discretization of numeric attributes, in Proc. AAAI-92, Ninth National Conf. Articial Intelligence (AAAI Press/The MIT Press, 1992), pp. 123-128.
18. W. J. Krzanowski and D. J. Hand, ROC Curves for Continuous Data (CRC Press, Taylor & Francis Group, 2009).
19. C. X. Ling, J. Huang and H. Zhang, AUC: A statistically consistent and more discriminating measure than accuracy, in Proc. Eighteenth Int. Joint Conf. Articial Intelligence (IJCAI) (2003), pp. 329-341.
20. H. Liu and R. Setiono, Chi2: Feature selection and discretization of numeric attributes, in Proc. Seventh IEEE Int. Conf. Tools with Articial Intelligence, Herndon, Virginia (1995), pp. 388-391.
21. H. Liu, F. Hussain, C. L. Tan and M. Dash, Discretization: An enabling technique, Data Min. Knowl. Discov. 6(4) (2002) 393-423.
22. M. S. Pepe, The Statistical Evaluation of Medical Tests for Classication and Prediction (Oxford, New York, 2003).
23. D. F. Preperata and M. Shamos, Computational Geometry. An Introduction (Springer-Verlag, Berlin, 1985).
24. F. Provost and P. Domingos, Well-trained PETs: Improving probability estimation trees, CeDER Working Paper #IS-00-04, Stern School of Business, New York University, NY 10012 (2001).
25. F. Provost and T. Fawcett, Analysis and visualization of classier performance: Comparison under imprecise class and cost distributions, in Proc. Third Intl. Conf. on Knowledge Discovery and Data Mining (KDD-97) (AAAI Press, Menlo Park, CA, 1997), pp. 43-48.
26. F. Provost and T. Fawcett, Robust classication for imprecise environments, Mach. Learn. 42(3) (2001) 203-231.
27. F. Provost, T. Fawcett and R. Kohavi, The case against accuracy estimation for comparing induction algorithms, in Proc. Fifteenth Int. Conf. Machine Learning (Morgan Kaufmann, 1998), pp. 445-453.
28. J. R. Quinlan, Induction of decision trees, Mach. Learn. 1 (1986) 81-106.
29. J. R. Quinlan, C4.5: Programs for Machine Learning (Morgan Kaufmann, San Mateo, CA, 1993).
30. J. R. Quinlan, Improved use of continuous attributes in C4.5, Journal of Articial Intelligence and Research 4 (1996) 77-90.
31. K. A. Spackman, Signal detection theory: Valuable tools for evaluating inductive learning, in Proc. Sixth Int. Workshop on Machine Learning (Morgan Kaufmann, San Mateo, CA, 1989), pp. 160-163.
32. T. Van de Merckt, Decision trees in numerical attribute spaces, in IJCAI Proceedings of the 13th International Joint Conference on Articial Intelligence, Vol. 2 (1993), pp. 1016-1021.
33. D. Ventura and T. R. Martinez, An empirical comparison of discretization methods, in Proc. 10th Int. Symp. Computer and Information Sciences (ISCIS) (1995), pp. 443-450.
34. K. Wang and B. Liu, Concurrent discretization of multiple attributes, Pacic Rim Int. Conf. AI (1998), pp. 250-259.
35. G. Webb, J. Boughton and Z. Wang, Not so Naive Bayes: Aggregating one-dependence estimators, J. Mach. Learn. 58(1) (2005) 5-24.
36. T. T. Wong, A hybrid discretization method for naïve Bayesian classiers, Pattern Recogn. 45(6) (2012) 2321-2325.
37. Y. Yang and G. Webb, Discretization for naive-Bayes learning: Managing discretization bias and variance, Mach. Learn. 74(1) (2009) 39-74.
38. A. Zimek, Hierarchical classication using ensembles of nested dichotomies, Master's thesis, TU/LMU Munich (2005).
39. M. H. Zweig and G. Campbell, Receiver-operating characteristic (ROC) plots: A fundamental evaluation tool in clinical medicine, Clin. Chem. 39(8) (1993) 561-577.