PCA document reconstruction for email classification

Computational Statistics and Data Analysis

Volumn 56, Issue 3, 2012, Pages 741-751

  Gomez, Juan Carlos ^a   Moens, Marie Francine ^a  

^a UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Class representation; Email filtering; Feature extraction; PCA

Indexed keywords

CLASS REPRESENTATION; DATA SETS; DOCUMENT RECONSTRUCTION; EMAIL CLASSIFICATION; EMAIL FILTERING; PCA; PHISHING; PRINCIPAL COMPONENTS; RECONSTRUCTION ERROR; TEXT CONTENT;

ELECTRONIC MAIL; EXPERIMENTS; FEATURE EXTRACTION; INFORMATION RETRIEVAL SYSTEMS; TEXT PROCESSING;

PRINCIPAL COMPONENT ANALYSIS;

EID: 80455160063     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2011.09.023     Document Type: Article

References (48)

1. S. Abu-Nimeh, D. Nappa, X. Wang, and S. Nair A comparison of machine learning techniques for phishing detection Proceedings of the Anti-Phishing Working Groups 2nd Annual eCrime Researchers Summit: eCrime 2007 2007 ACM New York 60 69
2. T.W. Anderson An Introduction to Multivariate Statistical Analysis 3rd ed. 2003 Wiley New Jersey
3. I. Androutsopoulos, J. Koutsias, K.V. Chandrinos, G. Paliouras, and C.D. Spyropoulos An evaluation of nave Bayesian anti-spam filtering Proceedings of the 11th European Conference on Machine Learning: ECML 2009, Workshop on Machine Learning in the New Information Age 2000 Springer-Verlag Berlin 9 17
4. P. Barman, N. Iqbal, and S.Y. Lee Non-negative matrix factorization based text mining: feature extraction and classification Proceedings of the 13th International Conference ICONIP 2006 2006 Springer-Verlag Berlin 703 712 (Pubitemid 44699780)
5. M.W. Berry, N. Gillis, and F. Glineaur Document classification using nonnegative matrix factorization and underapproximation Proceedings of the IEEE International Symposium on Circuits and Systems 2009 2009 IEEE Taipei 2782 2785
6. I. Bíró, J. Szabó, and A.A. Benczr Latent Dirichlet allocation in web spam filtering Proceedings of the 4th International Workshop on Adversarial Information Retrieval on the Web: AIRWeb 2008 2008 ACM New York 29 32
7. D.M. Blei, A.Y. Ng, M.I. Jordan, and J. Lafferty Latent Dirichlet allocation Journal of Machine Learning Research 3 2003 993 1022
8. A. Bratko, G. Cormack, B. Filipic, T. Lynam, and B. Zupan Spam filtering using statistical data compression models Journal of Machine Learning Research 7 2006 2673 2698 (Pubitemid 46011492)
9. J.D. Brutlag, and C. Meek Challenges of the email domain for text classification Proceedings of the 17th International Conference on Machine Learning: ICML 2000 2000 Morgan Kaufmann San Francisco
10. X. Carreras, L. Márquez, and J.G. Salgado Boosting trees for anti-spam email filtering Proceedings of the 4th International Conference on Recent Advances in Natural Language Processing: RANLP 2001 2001 John Benjamins 58 64
11. Cormack, G.V.; 2007. Spam track overview. In: Proceedings of the 16th Text REtrieval Conference: TREC-2007. National Institute of Standards and Technology (NIST).
12. S. Deerwester, S.T. Dumais, G.W. Furnas, T.K. Landauer, and R. Harshman Indexing by latent semantic analysis Journal of the American Society for Information Science 41 1990 391 407
13. H. Drucker, D. Wu, and V.N. Vapnik Support vector machines for spam categorization IEEE Transactions on Neural Networks 10 5 1999 1048 1054
14. T. Fawcett In vivo spam filtering: a challenge problem for data mining SIGKDD Explorations 5 2 2003 203 231
15. I. Fette, N. Sadeh, and A. Tomasic Learning to detect phishing emails Proceedings of the 16th International World Wide Web Conference: WWW 2007 2007 ACM New York 649 656 (Pubitemid 47582294)
16. R.A. Fisher The use of multiple measurements in taxonomic problems Annals of Eugenics 7 1936 179 188
17. Gansterer, W.N.; Ilger, M.; Lechner, P.; Neumayer, R.; Strauss, J.; 2005. Anti-spam methods state of the art. Tech. rep.
18. W.N. Gansterer, A.G.K. Janecek, and R. Neumayer Spam filtering based on latent semantic indexing Survey of Text Mining II: Clustering, Classification, and Retrieval 2007 Springer-Verlag London 165 183
19. W.N. Gansterer, and D. Pölz E-mail classification for phishing defense Proceedings of the 31st European Conference on Information Retrieval: ECIR 2009 2009 Springer-Verlag Toulouse 449 460
20. K.R. Gee Using latent semantic indexing to filter spam Proceedings of the 2003 ACM Symposium on Applied Computing, Data Minning Track 2003 ACM New York 460 464
21. J.C. Gomez, and M.-F. Moens Using biased discriminant analysis for email filtering Proceedings of the 14th International Conference KES 2010 2010 Springer-Verlag Berlin 566 575
22. Gomez, J.C.; Moens, M.-F.; 2011. Highly discriminative statistical features for email classification. Knowledge and Information Systems, in press (doi:10.1007/s10115-011-0403-7).
23. J. Goodman, D. Heckerman, and R. Rounthwaite Stopping spam Scientific American 292 4 2005 42 88
24. T.S. Guzella, and W.M. Caminhas A review of machine learning approaches to spam filtering Expert Systems with Applications 36 2009 10206 10222
25. Hartley, R.; Schaffalitzky, F.; 2004. PowerFactorization: 3d reconstruction with missing or uncertain data. In: Proceedings of the Australia-Japan Advanced Workshop on Computer Vision: AJAW 2003.
26. H. Hoffmann Kernel PCA for novelty detection Pattern Recognition 40 2007 863 874 (Pubitemid 44667761)
27. T. Hofmann Probabilistic latent semantic indexing Proceedings of the 22nd Annual International ACM SIGIR 1999 ACM New York 50 57
28. H. Hotelling Analysis of a complex of statistical variables into principal components Journal of Educational Psychology 24 7 1933 498 520
29. Ishii, N.; Murai, T.; Yamada, T.; Bao, Y.; Suzuki, S.; 2006. Text classification: combining grouping, LSA and kNN vs support vector machine. In: Knowledge-Based Intelligent Information and Engineering Systems, Lecture Notes in Computer Science, vol. 4252, pp. 393400. (Pubitemid 44700277)
30. A.G.K. Janecek, and W.N. Gansterer Utilizing Nonnegative Matrix Factorization for Email Classification Problems 2010 John Wiley & Sons Chichester
31. I.T. Jolliffe Principal Component Analysis 1986 Springer New York
32. I. Kanaris, K. Kanaris, I. Houvardas, and E. Stamatatos Words vs. character n-grams for anti-spam filtering International Journal on Artificial Intelligence Tools 16 6 2007 1047 1067 (Pubitemid 350281097)
33. H. Kim, P. Howland, and H. Park Dimension reduction in text classification with support vector machines Journal of Machine Learning Research 6 2005 37 53
34. L. Malagón-Borja, and O. Fuentes Object detection using image reconstruction with PCA Image and Vision Computing 27 12 2009 2 9
35. H.B. Mann, and D.R. Whitney On a test of whether one of two random variables is stochastically larger than the other Annals of Mathematical Statistics 18 1 1947 50 60
36. C.B. Moler, and G.W. Stewart An algorithm for generalized matrix eigenvalue problems SIAM: Journal of Numerical Analysis 10 2 1973 241 256
37. T. Morita, and T. Kanade A sequential factorization method for recovering shape and motion from image streams IEEE Transactions on Pattern Analysis and Machine Intelligence 19 8 1997 858 867 (Pubitemid 127762277)
38. K. Pearson On lines and planes of closest fit to systems of points in space Philosophical Magazine 2 6 1901 559 572
39. J.C. Platt Fast Training of Support Vector Machines Using Sequential Minimal Optimization 1998 MIT Press Cambridge, MA 185208
40. Pu, Q.; Yang, G.-W.; 2006. Short-text classification based on ICA and LSA. In: Advances in Neural Networks, vol. 3972, Lecture Notes in Computer Science. pp. 265270. (Pubitemid 44045910)
41. G. Robinson A statistical approach to the spam problem Linux Journal 2003 107 2003 58 64
42. D. Sculley, and G.M. Wachman Relaxed online SVMs for spam filtering Proceedings of the 30th Annual International ACM SIGIR Conference 2007 ACM New York 9 17
43. C. Silva, and B. Ribeiro Knowledge extraction with non-negative matrix factorization for text classification Proceedings of the 10th International Conference IDEAL 2009 2009 Springer-Verlag Berlin 300 308
44. K. Torkkola Linear discriminant analysis in document classification Proceedings of the 2001 IEEE ICDM Workshop on Text Mining 2001 IEEE Los Alamitos
45. R. Vidal, R. Tron, and R. Hartley Multiframe motion segmentation with missing data using PowerFactorization and GPCA International Journal of Computer Vision 79 1 2008 85 105 (Pubitemid 351578661)
46. I.H. Witten, and E. Frank Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations 2000 Morgan Kaufmann San Francisco, California
47. Y. Xia, and K.-F. Wong Binarization approaches to email categorization Proceedings of the 23rd Annual ACM symposium on Applied Computing: SAC 2008 2006 ACM New York 474 481
48. B. Yu, and Z.-B. Xu A comparative study for content-based dynamic spam classification using four machine learning algorithms Knowledge-Based Systems 21 4 2008 355