Raising the baseline for high-precision text classifiers

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2007, Pages 400-409

  Kolcz, Aleksander ^a   Yih, Wen Tau ^b  

^a MICROSOFT   (United States)

^b MICROSOFT RESEARCH   (United States)

Author keywords

Email spam detection; High precision text classification; Low false positive rates; Naive bayes

Indexed keywords

BAYESIAN NETWORKS; CONSTRAINT THEORY; DATA MINING; TEXT PROCESSING;

EMAIL SPAM DETECTION; HIGH PRECISION TEXT CLASSIFICATION; LOW FALSE POSITIVE RATES; NAIVE BAYES;

CLASSIFICATION (OF INFORMATION);

EID: 36849020505     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1281192.1281237     Document Type: Conference Paper

References (36)

1. P. Bennett. Assessing the calibration of naive Bayes' posterior estimates. Technical Report CMU-CS-00-155, School of Computer Science, Carnegie Mellon University, 2000.
2. L. Chen, J. Huang, and Z. Gong. An anti-noise text categorization method based on support vector machines. In Proceedings of AWIC 2005, pages 272-278, 20025.
3. G. Cormack. The TREC 2006 spam filter evaluation track. Virus Bulletin, (1), 2007.
4. G. Cormack and A. Bratko. Batch and online spam filter comparison. In Proceedings of the 3rd Conference on Email and Anti-Spam (CEAS-2006), 2006.
5. G. Cormack and T. Lynam. TREC 2005 spam track overview. In Proceedings of TREC 2005 - the Fourteenth Text REtrieval Conference, 2005.
6. F. Debole and F. Sebastiani. Supervised term weighting for automated text categorization. In Proceedings of the 2003 ACM symposium on Applied Computing, pages 784-788, 2003.
7. P. Domingos and M. Pazzani. On the optimality of the simple Bayesian classifier under zero-one loss. Machine Learning, 29(2-3):103-130, 1997.
8. H. Drucker, D. Wu, and V. Vapnik. Support Vector Machines for Spam Categorization. IEEE Transactions on Neural Networks, 10(5):1048-1054, 1999.
9. L. Edda and J. Kindermann. Text categorization with support vector machines. how to represent texts in input space? Machine Learning, 46:423-444, 2002.
10. C. Elkan. The foundations of cost-sensitive learning. In IJCAI, pages 973-978, 2001.
11. N. Friedman, D. Geiger, and M. Goldszmidt. Bayesian network classifiers. Machine Learning, 29:131-163, 1997.
12. T. Gartner and P. Flach. WBCsvm : Weighted Bayesian classification based on support vector machines. In Proceedings of the Eighteenth International Conference on Machine Learning, 2001.
13. C. Genest and J. Zidek. Combining probability distributions: A critique and an annotated bibliography. Statistical Science, 1986.
14. J. Goodman. Sequential conditional generalized iterative scaling. In Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, pages 9-16, 2001.
15. P. Graham. A plan for spam http://www.paulgraham.com/spam.html, 2002.
16. G. Hinton. Products of experts. In Proceedings of the Ninth International Conference on Artificial Neural Networks (ICANN99), pages 1-6, 1999.
17. S. Hong, J. Hosking, and T. Natarajan. Ensemble modeling through multiplicative adjustment of class probability. In Proceedings of the 2002 IEEE International Conference on Data Mining (ICDM 2002), pages 621-624, 2002.
18. A. Juan and H. Ney. Reversing and smoothing the multinomial naive Bayes text classifier. In Proceedings of the 2nd Int. Workshop on Pattern Recognition in Information Systems (PRIS 2002), pages 200-212, 2002.
19. S. Kim, K. Han, H. Rim, and S. Myaeng. Some effective techniques for naive Bayes text classification. IEEE Transactions on Knowledge and Data Engineering, 18(11), 2006.
20. A. Kołcz. Local sparsity control for naive Bayes with extreme misclassification costs. In Proceedings of the Eleventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2005.
21. A. Kolcz and J. Alspector. SVM-based filtering of e-mail spam with content-specific misclassification costs. In Proceedings of the Workshop on Text Mining (TextDM'2001), 2001.
22. M. Lee and E. Corlett. Sequential sampling models of human text classification. Cognitive Science, 27(2):159-1193, 2003.
23. D. D. Lewis. Naive (Bayes) at forty: the independence assumption in information retrieval. In Proceedings of the 10th European Conference on Machine Learning, pages 4-15, 1998.
24. A. K. McCallum and K. Nigam. A comparison of event models for Naive Bayes text classification. In AAAI-98 Workshop on Learning for Text Categorization, 1998.
25. V. Metsis, I. Androutsopoulos, and G. Paliouras. Spam filtering with Naive Bayes - which Naive Bayes? In Proceedings of the 3rd Conference on Email and Anti-Spam (CEAS-2006), 2006.
26. D. Mladenic, J. Brank, M. Grobelnik, and N. Milic-Frayling. Feature selection using linear classifier weights: Interaction with classification models. In Proceedings of the 27th Annual International ACM SIGIR Conference (SIGIR2004), 2004.
27. D. Mladenic and M. Grobelnik. Feature selection for unbalanced class distribution and Naive Bayes. In Proceedings of ICML 1999, 1999.
28. R. Raina, Y. Shen, A. Ng, and A. McCallum. Classification with hybrid generative/discriminative models. In Proceedings of NIPS 16, 2004.
29. J. Rennie, L. Shih, J. Teevan, and D. Karger. Tackling the poor assumptions of Naive Bayes text classifiers. In Proceedings of the Twentieth International Conference on Machine Learning, 2003.
30. G. Robinson. A statistical approach to the spam problem. Linux Journal, (107), 2003.
31. M. Sauban and B. Pfahringer. Text categorisation using document profiling. In Proceedings of PKDD 2003, pages 411-422, 2003.
32. K. Schneider. Techniques for improving the performance of naive Bayes for text classification. In Proceedings of CICLing 2005, pages 682-693, 2005.
33. P. Soucy and G. Mineau. Beyond TFIDF weighting for text categorization in the vector space model. In Proceedings of the Proceedings of the 19th International Joint Conference on Artificial Intelligence (IJCAI2005), pages 1130-1135, 2005.
34. H. Wu, T. Phang, B. Liu, and X. Li. A refinement approach to handling model misfit in text categorization. In Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, 2002.
35. W. Yih, J. Goodman, and G. Hulten. Learning at low false positive rates. In Proceedings of the 3rd Conference on Email and Anti-Spam (CEAS-2006), 2006.
36. Z. Zheng and K. T. G.I. Webb. Lazy Bayesian rules: A lazy semi-naive Bayesian learning technique competitive to boosting decision trees. In Proceedings of the Sixteenth International Conference on Machine Learning, pages 493-502, 1999.