Single-pass online learning: Performance, voting schemes and online feature selection

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn 2006, Issue , 2006, Pages 548-553

  Carvalho, Vitor R ^a   Cohen, William W ^a  

^a Carnegie Mellon University ^*  (United States)

Author keywords

Averaging; Online Learning; Single pass; Voting; Winnow

Indexed keywords

DATA STREAMS; DESIGN INFERENCES; ON-LINE LEARNERS; ONLINE LEARNING;

ADAPTIVE ALGORITHMS; DATA MINING; DATA RECORDING; DATA STORAGE EQUIPMENT; KNOWLEDGE ENGINEERING; ONLINE SYSTEMS; PROBLEM SOLVING;

LEARNING SYSTEMS;

EID: 33749569454     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. E. Airoldi, W. W. Cohen, and S. E. Fienberg. Bayesian methods for frequent terms in text: Models of contagion and the delta square statistic. In Proc. CSNA & INTERFACE Annual Meetings, 2005.
2. E. M. Airoldi and B. Malin. Data mining challenges for electronic safety: The case of fraudulent intent detection in e-mails. In Workshop on Privacy and Security Aspects of Data Mining. IEEE Computer Society, 2004.
3. R. Bekkerman, A. McCallum, and G. Huang. Categorization of email into folders: Benchmark experiments on enron and sri corpora. Technical Report CIIR Technical Report IR-418, CIIR, University of Massachusetts, Amherst, 2004.
4. A. Blum. Empirical support for WINNOW and weighted majority algorithms: results on a calendar scheduling domain. In ICML, 1995.
5. V. R. Carvalho and W. W. Cohen. Learning to extract signature and reply lines from email. In Proceedings of the Conference on Email and Anti-Spam, 2004.
6. V. R. Carvalho and W. W. Cohen. Notes on single-pass online learning algorithms. Technical Report CMU-LTI-06-002, Carnegie Mellon University, Language Technologies Institute, 2006. Available from http://www.cs.cmu.edu/ ~vitor.
7. C.-C. Chang and C.-J. Lin. LIBSVM: a library for support vector machines, 2001. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm.
8. W. Cohen, E. Minkov, and A. Tomasic. Learning to understand web site update requests. In IJCAI, 2005.
9. W. W. Cohen, V. R. Carvalho, and T. M. Mitchell. Learning to classify email into "speech acts". In EMNLP, 2004.
10. K. Crammer, O. Dekel, S. Shalev-Shwartz, and Y. Singer. Online passive-aggressive algorithms. In NIPS, 2003.
11. I. Dagan, Y. Karov, and D. Roth. Mistake-driven learning in text categorization. In EMNLP, 1997.
12. G. Forman. An extensive empirical study of feature selection metrics for text classification. Journal of Machine Learning Research, 3:1289-1305, 2003.
13. Y. Freund, Y. Mansour, and R. E. Schapire. Why averaging classifiers can protect against overfitting. In AISTATS, 2001.
14. Y. Freund and R. E. Schapire. Large margin classification using the perception algorithm. Machine Learning, 37(3):277-296, 1999.
15. D. D. Lewis and M. Ringuette. A comparison of two learning algorithms for text categorization. In Proceedings of SDAIR-94, 3rd Annual Symposium on Document Analysis and Information Retrieval, pages 81-93, Las Vegas, US, 1994.
16. Y. Li and P. M. Long. The relaxed online maximum margin algorithm. In Machine Learning, volume 46, pages 361-387, 2002.
17. N. Littlestone. Learning quickly when irrelevant attributes abound: A new linear-threshold algorithm. Machine Learning, 2(4), 1988.
18. T. Mitchell. Machine Learning. Mcgraw-Hill, 1997.
19. B. Pang, L. Lee, and S. Vaithyanathan. Thumbs up? Sentiment classification using machine learning techniques. In EMNLP, 2002.
20. F. Rosenblatt. The perceptron: A probabilistic model for information storage and organization in the brain. In Psychological Review, volume 4, pages 386-407, 1958.
21. Y. Yang and J. O. Pedersen. A comparative study on feature selection in text categorization. In ICML, 1997.