Semi-supervised approach to handle sudden concept drift in Enron data

Control and Cybernetics

Volumn 40, Issue 3, 2011, Pages 667-695

  Kmieciak, Miłosz R ^a   Stefanowski, Jerzy ^a  

^a POZNAN UNIVERSITY OF TECHNOLOGY   (Poland)

Author keywords

Concept drift; Email foldering; Enron data; Incremental learning of classifiers

Indexed keywords

EID: 84859261446     PISSN: 03248569     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (39)

1. BAENA-GARCIA, M., CAMPO-AVILA, J., FIDALGO, R.., BIFET, A., GAVALDA, R.. and MORALES-BUENO, R.. (2006) Early drift detection method. In: ECML PKDD 2006 Workshop on Knowledge Discovery from Data Streams, 77-86. eprints.pascal- network.org/archive/00002509/01/EDDM.pdf
2. BAEZA-YATES, R.A. and RIBEIRO-NETO, B. (1999) Modern Information Retrieval. Addison-Wesley Longman Publishing Co., Inc., Boston.
3. BEKKERMAN, R.., MCCALLUM, A. and HUANG, G. (2004) Automatic categorization of email into folders: Benchmark experiments on Enron and SRI corpora. Technical Report IR-418, Center of Intelligent Information Retrieval, UMass Amherst.
4. BIFET, A. and KIRKBY, R. (2009) Data stream mining: A practical approach, moa manual. Technical report, The University of Waikato.
5. BIFET, A., KIRKBY, R., HOLMES, G., GAVALDA, R. and PFAHRINGER, B. (2009) New ensemble methods for evolving data streams. In: 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 139-148.
6. BISHOP, C.M. (2007) Pattern Recognition and Machine Leaning. Springer, Berlin.
7. BRZEZINSKI, D. and STEFANOWSKI, J. (2011) Accuracy updated ensemble for data streams with concept drift. In: Proceeding of the HAIS 2011 Conference. LNAI 6679, Springer, 155-163.
8. CLARK, J., KOPRINSKA, I. and POON, J. (2003) Linger - a smart personal assistant for e-mail classification. In: O. Kaynak et al., eds., ICANN/ ICONIP 2003 Proc. of the 13th Intern. Conf. on Artificial Neural Networks. LNCS 2714, Springer, 274-277.
9. DECKERT, M. (2011) Batch weighted ensemble for mining data streams with concept drift. In: M. Kryszkiewicz et al., eds., Proc. IMIS 2011. LNAI 6804, Springer, 290-299.
10. DOMINGOS, P. and HULTEN, G. (2000) Mining high-speed data streams. In: KDD '00: Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, New York, 71-80.
11. FAN, W., HUANG, Y., WANG, H. and Yu, P.S. (2004) Active mining of data streams. In: Proceedings of the 2004 SIAM International Conference on Data Mining. SIAM, 457-416, www.siam.org/ proceedings/datamining/ 2004/dm04.php
12. GAMA, J. (2010) Knowledge Discovery from Data Streams. CRC Press, Boca Raton.
13. GAMA, J. and GABER, M.M. (2007) Learning From Data Streams: Processing Techniques in Sensor Networks. Springer, Berlin.
14. GAMA, J., MEDAS, P., CASTILLO, G. and RODRIGUES, P. (2004) Learning with drift detection. In: SBIA Brazilian Symposium on Artificial Intelligence. Springer Verlag, 286-295.
15. HAN, J. and KAMBER, M. (2006) Data Mining: Concepts and Techniques. Morgan Kaufmann, San Francisco.
16. HUANG, S. (2008) An active learning method for mining time-changing data streams. In: Proceedings of the 2008 Int. Symposium on Intelligent Information Technology Application, IITA '08. IEEE Computer Society, Washington, 548-552.
17. HULTEN, G., SPENCER, L. and DOMINGOS, P. (2001) Mining time-changing data streams. In: KDD '01: Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, New York, 97-106.
18. KIFER, D., BEN-DAVID, S. and GEHRKE, J. (2004) Detecting change in data streams. In: VLDB '04: Proceedings of the Thirtieth international conference on Very large data bases. VLDB Endowment, 180-191.
19. KLIMT, B. and YANG, Y. (2004) The Enron corpus: A new dataset for email classification research. In: J.-F. Boulicaut et al., eds., Proceedings of the ECML 2004 Conference. LNCS 3201, Springer, 217-226.
20. KLINKENBERG, R. and RENZ, I. (1998) Adaptive information filtering: Learning in the presence of concept drifts. In: Workshop Notes of the ICML/ AAAI-98 Workshop Learning for Text Categorization. AAAI Press, 33-40.
21. KLOSGEN, W. and ZYTKOW, J.M. (2002) Handbook of Data Mining and Knowledge Discovery. Oxford Press, Oxford.
22. KMIECIAK, M.R. (2009) Learning Multiple Classifiers from Text Streams. Master's thesis, Poznan University of Technology, Poznań, Poland.
23. KUBAT, M. (1989) Floating approximation intime-varying knowledge bases. Pattern Recognition Letters 10 (4), 223-227.
24. KUNCHEVA, L.I. (2004) Classifier ensembles for changing environments. In: Proc. of the 5th Workshop on Multiple Classifier Systems. LNCS 3077, Springer, 1-15.
25. LEWIS, D.D. (1995) A sequential algorithm for training text classifiers: corrigendum and additional data. SIGIR Forum 29 (2), 13-19.
26. MASUD, M., GAO, J., KHAN, L., HAN, J. and THURAISINGHAM, B. (2008) A practical approach to classify evolving data streams: Training with limited amount of labeled data. In: Proc. ICDM '08. Eighth IEEE International Conference on Data Mining. IEEE Press, 929-934.
27. MASUD, M., GAO, J., KHAN, L., HAN, J. and THURAISINGHAM, B. (2009) Integrating novel class detection with classification for concept-drifting data streams. In: Proc. ECML PKDD '09. Volume II. Springer-Verlag, 79-94.
28. MITCHELL, T. (1997) Machine Learning. McGraw-Hill Education (ISE Editions), New York.
29. NISHIDA, K. (2008) Learning and Detecting Concept Drift. Ph.D. thesis, Graduate School of Information Science and Technology, Hokkaido University.
30. QUINLAN, J.R. (1993) C4-5: Programs for Machine Learning. Morgan Kaufmann, San Francisco.
31. SCHLIMMER, J. and GRANGER, R. (1986) Incremental learning from noisy data. Machine Learning 1 (3), 317-354.
32. SEBASTIANI, F. (2002) Machine learning inautomated text categorization. ACM Computing Surveys 34 (1), 1-47.
33. STEFANOWSKI, J. and ZIENKOWICZ, M. (2006) Classification of Polish email messages: Experiments with various data representations. In: F. Esposito et al., eds., Foundations of Intelligent Systems. 16th International Symposium ISMIS 2006. Proceedings. LNAI 4203, Springer, 723-728.
34. SZOPKA, B. (2007) Machine Learning and Text Processing Methods for Classification of Emails (in Polish). Master's thesis, Poznan University of Technology, Poznan, Poland (supervisor J. Stefanowski).
35. TSYMBAL, A. (2004) The problem of concept drift: definitions and related works. Technical report, Dept. of Computer Science, Trinity College Dublin.
36. WIDMER, G. and KUBAT, M. (1996) Learning inthe presence of concept drift and hidden contexts. Machine Learning 23(1), 69-101.
37. WOOLAM, C., MASUD, M. and KHAN, L. (2009) Lacking labels in the stream: Classifying evolving stream data with few labels. In: Proceedings of the ISMIS 2009 Conference. Springer Verlag, 552-562.
38. YANG, Y. and Liu, X. (1999) A re-examination of text categorization methods. In: Proc. of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, New York, 42-49.
39. ZLIOBAITE, I. (2009) Learning under concept drift: an overview. Technical report, Faculty of Mathematics and Informatics, Vilnius University.