Naive Bayes for optimal ranking

Journal of Experimental and Theoretical Artificial Intelligence

Volumn 20, Issue 2, 2008, Pages 79-93

  Zhang, Harry ^a   Su, Jiang ^a  

^a UNIVERSITY OF NEW BRUNSWICK   (Canada)

Author keywords

AUC; Classification; Naive Bayes; Ranking; ROC curve

Indexed keywords

ELECTRIC NETWORK ANALYSIS; ESTIMATION; EXPERIMENTS; LEARNING ALGORITHMS; LEARNING SYSTEMS; PROBABILITY; RISK ASSESSMENT; TANNING; TREES (MATHEMATICS);

BAYESIAN CLASSIFIERS; CLASSIFICATION ACCURACIES; DECISION TREE (DT); EMPIRICAL EVIDENCES; EXPERIMENTAL RESULTS; GENERAL (CO); NAIVE BAYES (NB); OPTIMALITY; PROBABILITY ESTIMATIONS; RECEIVER OPERATING CHARACTERISTIC (ROC); SUFFICIENT CONDITIONS;

CLASSIFICATION (OF INFORMATION);

EID: 45849149280     PISSN: 0952813X     EISSN: 13623079     Source Type: Journal    
DOI: 10.1080/09528130701476391     Document Type: Article

References (27)

1. P.N. Bennett, "Assessing the calibration of naive Bayes' posterior estimates", Tech. Report No. CMU-CS00-155, School of Computer Science, Carnegie Mellen University, 2000.
2. A.P. Bradley, "The use of the area under the ROC curve in the evaluation of machine learning algorithms", Pattern Recogn., 30, pp. 1145-1159, 1997.
3. P. Domingos and M. Pazzani, "Beyond independence: conditions for the optimality of the simple Bayesian classifier", Mach. Learn., 29, pp. 103-130, 1997.
4. R.O. Duda and P.E. Hart, Pattern Classification and Scene Analysis, New York: Wiley-Interscience, 1973.
5. C. Ferri, P.A. Flach and J. Hernandez-Orallo, "Learning decision trees using the area under the ROC curve", in Proceedings of the 19th International Conference on Machine Learning, San Fransisco, CA: Morgan Kaufmann, 2002, pp. 139-146.
6. E. Frank, L. Trigg and G. Holmes, I.H. Witten, "Naive Bayes for regression", Mach. Learn., 41, pp. 5-15, 2001.
7. J. Friedman, "On bias, variance, 0/1-loss, and the curse of dimensionality", Data Min. Know. Discov., 1, pp. 55-77, 1995.
8. N. Friedman, D. Greiger and M. Goldszmidt, "Bayesian network classifiers", Mach. Learn., 29, pp. 103-130, 1997.
9. D.J. Hand and R.J. Till, "A simple generalisation of the area under the ROC curve for multiple class classification problems", Mach. Learn., 45, pp. 171-186, 2001.
10. L. Jiang, H. Zhang, Z. Cai and J. Su, "Learning tree augmented naive Bayes for ranking", in Proceedings of the 10th International Conference on Database Systems for Advanced Applications, Berlin Springer-Verlag, 2005, pp. 688-698.
11. I. Kononenko, "Comparison of inductive and naive Bayesian learning approaches to automatic knowledge acquisition", Current Trends in Knowledge Acquisition, Amsterdam: IOS Press, 1990.
12. P. Langley, W. Iba and K. Thomas, "An analysis of Bayesian classifiers", in Proceedings of the Tenth National Conference of Artificial Intelligence, Cambridge, MA: AAAI Press, pp. 223-228, 1992.
13. P. Langley and S. Sage, "Induction of selective Bayesian classifiers", in Proceedings of Uncertainty in Artificial Intelligence 1994, San Fransisco, CA: Morgan Kaufmann, 1994.
14. C.X. Ling, J. Huang and H. Zhang, "AUC: a statistically consistent and more discriminating measure than accuracy", in Proceedings of the International Joint Conference on Artificial Intelligence IJCAI03, San Farnsisco, CA: Morgan Kaufmann, 2003, pp. 329-341.
15. C.X. Ling and R. J. Yan, "Decision tree with better ranking", in Proceedings of the 20th International Conference on Machine Learning, San Fransisco, CA: Morgan Kaufmann, 2003, pp. 480-487.
16. C. Merz, P. Murphy and D. Aha, UCI repository of machine learning databases. Dept of ICS, University of California, Irvine, 1997, Available online at: http://www.ics.uci.edu/mlearn/ MLRepository.html
17. A. Niculescu and R. Caruana, "Predicting good probabilities with supervised learning", in Proceedings of the 22nd International Conference on Machine Learning, Boston, MA: ACM Press, 2005, pp. 625-632.
18. M. Pazzani, P. Merz, C. Murphy, P. Ali, K. Hume and T. Brunk, "Reducing misclassification costs", in Proceedings of the 11th International Conference on Machine Learning, San Francisco, CA: Morgan Kaufmann, 1994, pp. 217-225.
19. J. Platt, "Probabilistic outputs for support vector machines and comparison to regularized likelihood methods", Advances in Large Margin Classifiers, A. Sela, P. Bartlett, B. Schölkopf and D. Schurmans, Eds., Cambridge, MA: MIT Press, 1999, pp. 61-74.
20. F. Provost and P. Domingos, "Tree induction for probability-based ranking", Mach. Learn., 52, pp. 199-215, 2003.
21. F. Provost and T. Fawcett, "Analysis and visualization of classifier performance: comparison under imprecise class and cost distribution", in Proceedings of the Third International Conference on Knowledge Discovery and Data Mining, Cambridge, MA: AAAI Press, pp. 43-48, 1997.
22. F. Provost, T. Fawcett and R. Kohavi, "The case against accuracy estimation for comparing induction algorithms", in Proceedings of the Fifteenth International Conference on Machine Learning, San Francisco, CA: Morgan Kaufmann, 1998, 445-453.
23. J.R. Quinlan, C4.5: Programs for Machine Learning. San Mateo: Morgan Kaufmann, CA, 1993.
24. J. Swets, "Measuring the accuracy of diagnostic systems", Science, 240, pp. 1285-1293, 1988.
25. I.H. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques with Java Implementation, San Francisco, CA: Morgan , 2000.
26. B. Zadrozny and C. Elkan, "Obtaining calibrated probability estimates from decision trees and naive Bayesian classifiers", in Proceedings of the 18th International Conference on Machine Learning, San Francisco, CA: Morgan Kaufmann, 2001, pp. 609-616.
27. B. Zadrozny and C. Elkan, "Transforming classifier scores into accurate multiclass probability estimates", in Proceedings of the Eighth International Conference on Knowledge Discovery and Data Mining, Boston, MA: ACM Press, 2002, pp. 694-699.