Spam email classification using an adaptive ontology

Journal of Software

Volumn 2, Issue 3, 2007, Pages 43-55

  Youn, Seongwook ^a   McLeod, Dennis ^a  

^a University of Southern California   (United States)

Author keywords

Data mining; Feature extraction; Ontology; Spam filter; Text classification

Indexed keywords

CLASSIFICATION (OF INFORMATION); DATA MINING; ELECTRONIC MAIL; FEATURE EXTRACTION; FILTRATION; INFORMATION FILTERING; ONTOLOGY; SEMANTICS; TEXT PROCESSING;

EMAIL FILTERING; SPAM EMAILS; SPAM FILTER; SPAM FILTERING; SPAMMERS; TEXT CLASSIFICATION; UNSOLICITED BULK E-MAIL;

ELECTRONIC MAIL FILTERS;

EID: 72949106170     PISSN: 1796217X     EISSN: None     Source Type: Journal    
DOI: 10.4304/jsw.2.3.43-55     Document Type: Article

References (69)

1. Adibi, J., and Shen, W. Data Mining Techniques and Applications in Medicine Tutorial, 1999.
2. Agichtein, E., and Luis Gravano, L. Querying Text Databases for Efficient Information Extraction. proceedings of the 19th IEEE International Conference on Data Engineering (ICDE03), Bangalore, India, 2003.
3. Albrecht, K., Burri, N., and Wattenhofer, R. Spamato -An Extendable Spam Filter System. Proceedings of 4th Conference on Email and Anti-Spam (CEAS05), Mountain View, CA 2005
4. Allemang, D., Polikoff, I., and Hodgson, R. Enterprise Architecture Reference Modeling in OWL/RDF. Proceedings of 4th International Semantic Web Conference (ISWC05), Galway, Ireland, 844-857, 2005.
5. Aery, M., and Chakravarthy, S. eMailSift: Email Classification Based on Structure and Content. Proceedings of The 5th IEEE International Conference on Data Mining (ICDM05), Clearwater Beach, FL, 18-25. 2005
6. Androutsopoulos, I., Paliouras, G., Karkaletsis, V., Sakkis, G., Spyropoulos, C., and Stamatopoulos, P. Learning to Filter Spam E-Mail: A Comparison of a Naive Bayesian and a Memory-Based Approach. The Computing Research Repository (CoRR), cs.CL/0009009, 2000.
7. Ankolekar, A., Seo, Y., and Sycara, K. Investigating semantic knowledge for text learning. Workshop on Semantic Web of 26th Annual International ACM SIGIR Conference, Toronto, Canada, 2003.
8. Berland, M, and Charniak, E. Finding Parts in Very Large Corpora. Proceedings of the 37 th Annual Meeting of the Association for Computational Linguistics (ACL99), College Park, MD, 1999.
9. Bishr, Y., Pundt, H., and Ruther, C. Design of a Semantic Mapper Based on a Case Study from Transportation. Proceedings of 2nd International Conference of Inter-operating Geographic Information Systems(INTEROP99), Zurich, Switzerland, 203-215, 1999.
10. Carabaloo S. Automatic construction of a hypernym-labeled noun hierarchy from text. Proceedings of the Association for Computational Linguistics (ACL99), College Park, MD, 20-26, 1999.
11. Cederberg, S., and Widdows, D. Using LSA and Noun Coordination Information to Improve the Precision and Recall of Automatic Hyponymy Extraction. Proceedings of Conference on Computational Natural Language Learning (CoNLL-2003), Edmunton, Canada, 118, 2003.
12. Chhabra, S., Yerazunis, W., and Siefkes, C. Spam Filtering using a Markov Random Field Model with Variable Weighting Schemas. Proceedings of 4th IEEE International Conference on Data Mining (ICDM04), Brighton, UK, 347-350, 2004
13. Ciaramita, M. and Johnson, M. Supersense Tagging of Unknown Nouns in WordNet. Proceedings of Conference on Empirical Methods in Natural Language Processing (EMNLP 2003), Sapporo, Japan, 2003.
14. Cohen, W. Learning rules that classify e-mail. Proceedings of the AAAI Spring Symposium on Machine Learning in Information Access, Palo Alto, CA, 1996.
15. Cui, B., Mondal, A., Shen, J., Cong, G., and Tan, K. On Effective E-mail Classification via Neural Networks. Proceedings of the 16th International Conference on Database and Expert Systems Applications (DEXA05), Copenhagen, Denmark, 85-94, 2005.
16. Crawford, E., Koprinska, I., and Patrick, J. Phrases and Feature Selection in E-Mail Classification. Proceedings of the 9th Australasian Document Computing Symposium (ADCS04), Melbourne, Australia, 59-62, 2004.
17. Diao, Y., Lu, H., and Wu, D. A comparative study of classification based personal e-mail filtering. Proceedings of the 4th Pacific-Asia Conference of Knowledge Discovery and Data Mining (PAKDD00), Kyoto, Japan, 2000.
18. Etzioni, O., Cafarella, M., Downey, D., Popescu, A., Shaked, T., Soderland, S., Weld, D., and Yates, A. Unsu-pervised Named-Entity Extraction from the Web: An Experimental Study. Proceedings of International Conference on Artificial Intelligence (ICAI05), Las Vegas, NV, 2005.
19. Etzioni, O., Cafarella, M., Downey, D., Popescu, A., Shaked, T., Soderland, S., Weld, D., and Yates, A. Methods for Domain-Indepedent Information Extraction from the Web: An Experimental Comparison. Proceddings of 9th National Conference on on Artificial Intelligence (AAAI04), San Jose, CA, 2004.
20. Etzioni, O., Cafarella, M., Downey, D., Kok, S., Popescu, A., Shaked, T., Soderland, S., Weld, D., and Yates, A. Web-scale Information Extraction in KnowItAll. Proceddings of 13th International World Wide Web Conference (WWW04), New York, NY, 2004.
21. Faure, D., and Nedellec, C. A corpus-based conceptual clustering method for verb frames and ontology acquisition. Proceedings of LREC Workshop on adapting lexical and corpus resources to sublanguages and applications, Granada, Spain, 1998.
22. Fawcett T. in vivo spam filtering: A challenge problem for data mining. Proceedings of the 9th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining Explorations. vol.5 no.2 (KDD03), Washington, DC, 2003.
23. Fayyad, U., Piatetsky-Shapiro, G., Smyth, P., and Uthu-rusamy, R. Advances in Knowledge Discovery and Data Mining. M.I.T. Press, 1996.
24. Ferris Research. Spam Control: Problems & Opportunities, 2003.
25. Fetterly, D., Manasse, M., and Najork, M. Spam, damn spam, and statistics. In Proceedings of the Seventh International Workshop on the Web and Databases (WebDB), Paris, France, 2004.
26. Fleischman, M., Hovy, E., and Echihabi, A. Offline Strategies for Online Question Answering: Answering Questions Before They Are Asked. Proceedings of the 41 st Meeting of the Association for Computational Linguistics (ACL03). Sapporo, Japan, 2003
27. Gee, K. Using latent semantic indexing to filter spam. Proceedings of the 18th ACM Symposium on Applied Computing, Data Mining Track (SAC03), Melbourne, FL, 2003.
28. Girju, R., Badulescu, A., and Moldovan, D. Learning Semantic Constraints for the Automatic Discovery of Part-Whole Relations. Proceedings of Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, Edmonton, Canada, 2003.
29. Gruber T. What is an Ontology? http://www-ksl.stanford.edu/kst/what-is-an-ontology.html.
30. Gunther, O. Environment information systems. Springer, 1998
31. Hearst M. What is Text Mining? http://www.sims.berkeley.edu/hearst/textmining.html, 2003.
32. Hearst, M. Automatic Acquisition of Hyponyms from Large Text Corpora. Proceedings of the 14th International Conference on Computational Linguistics (COLING92), Nantes, France. 1992.
33. Henzinger, M., Motwani, R., and Silverstein, C. Challenges in web search engines. Proceedings of the 25th Annual International ACM SIGIR Conference SIGIR Forum, Tampere, Finland, 36(2), 2002.
34. Hotho, A., Staab, S., and Stumme, G. Ontologies Improve Text Document Clustering. Proceedings of 3rd IEEE International Conference on Data Mining (ICDM03), Melbourne, FL, 541-544, 2003.
35. International Data Group. Worldwide email usage 2002 -2006: Know what's coming your way, 2002.
36. Kietz, J., Maedche, A., and Volz, R. A method for semiautomatic ontology acquisition from a corporate intranet. Workshop on Ontologies and Text of 12th International Conference on Knowledge Engineering and Knowledge Management (EKAW00) Workshop on Ontologies and Text, Juan-les-Pins, France, 2000.
37. Kiritchenko, S., and Matwin, S. Email classification with co-training. Proceedings of workshop of the Center for Advanced Studies on Collaborative Research (CASCON01), Ontario, Canada, 2001.
38. Kiritchenko, S., Matwin, S., and Abu-Hakima, S. Email Classification with Temporal Features. Proceedings of the International Intelligent Information Systems (IIS04), Zakopane, Poland, 523-533, 2004.
39. Li, L., and Tan, C. Improving OCR Text Categorization Accuracy with Electronic Abstracts. Proceedings of 2nd International Conference on Document Image Analysis for Libraries (DIAL06), Lyon, France, 82-87, 2006.
40. Liu, R. Dynamic Category Profiling for Text Filtering and Classification. Proceedings of The 10th Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD06), Singapore, 255-264, 2006.
41. Machine Learning Lab. in Information and Computer Science, University of California at Irvine. http://www.ics.uci.edu/ mlearn/MLSummary.html
42. Maedche, A., and Staab, S. Ontology learning for the semantic web. IEEE Intelligent Systems 16(2): 72-79, 2001.
43. Mann, G. Fine-Grained Proper Noun Ontologies for Question Answering Proceedings of SemaNet: Building and Using Semantic Networks, Taipei, Taiwan, 2002.
44. Mavroeidis, D., Tsatsaronis, G., Vazirgiannis, M., Theobald, M., and Weikum, G.Word Sense Disambiguation for Exploiting Hierarchical Thesauri in Text Classification. Proceedings of the 9th European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD05), Porto, Portugal, 181-192, 2005.
45. Meyer, T., and Whateley, B. SpamBayes: Effective open-source, Bayesian based, email classification system. Proceedings of the 1st Conference of Email and Anti-Spam (CEAS04), Mountain View, CA, 2004.
46. Moldovan, D., and Girju, R. Knowledge Discovery from Text. Tutorial of the 41 st Meeting of the Association for Computational Linguistics (ACL03). Sapporo, Japan, 2003
47. Monostori, L., Vancza, J., and Ali, M. Ontology integration tasks in Business-to-Business E-Commerce. Proceedings of the 14th International Conference on Industrial and Engineering Applications of Artificial Intelligence and Expert Systems (IEA/AIE01), Budapest, Hungary, 2003.
48. Navigli, R., Velardi, P., and Gangemi, A. Ontology learnig and its application to automated terminology translation. IEEE Intelligent Systems 18(1): 22-31, 2003.
49. Osterwalder, A., Parent, C., and Pigneur, Y. Setting up an Ontology of Business Models. Proceedings of 16th International Conference on Advanced Information Systems Engineering (CAiSE03) Workshops (3), Riga, Latvia, 319-324, 2004.
50. Pantel, P., and Lin, D. Discovering Word Senses from Text. Proceedings of 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (SIGKDD02), Edmonton, Canada, 613-619, 2002.
51. Pantel, P., and Ravichandran, D. Automatically Labelling Semantic Classes. Proceedings of Human Language Technology conference North American chapter of the Association for Computational Linguistics annual meeting (NAACL/HLT04), Boston, MA, 2004.
52. Pasca, M. Finding Instance Names and Alternate Glosses on theWeb: Word-Net Reloaded. Proceedings of 6th International Conference of Computational Linguistics and Intelligent Text Processing (CICLing05), 280-292, Mexico City, Mexico, 2005.
53. Pasca, M. Acquisition of categorized named entities for web search. Proceedings of the 13th ACM Conference on Information and Knowledge Management (CIKM-04), Washington, D.C, 2004.
54. Pasca A. The classification of search engine spam. http://www.ebrandmanagement.com/whitepapers/spam-classification/.
55. Pu, C., Webb, S., Kolesnikov, O., Wenke, L., and Lipton, R. Towards the integration of diverse spam filtering techniques. Proceedings of the IEEE International Conference on Granular Computing (GrC06), Atlanta, GA, 17-20, 2006
56. Pundt, H., and Bishr, Y. Domain ontologies for data sharing: An example from environmental monitoring using field GIS. Computer & Geosciences, 28, 98-102, 1999
57. Raghavan, P. The Changing Face of Web Search. Proceedings of 10th Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD06), Singapore, 2006.
58. Robert von Behren, J., Czerwinski, S., Joseph, A., Brewer, E., and Kubiatowicz, J. NinjaMail: The Design of a High-Performance Clustered, Distributed E-Mail System. Proceedings of Workshop of the 29th International Conference on Parallel Processing (ICPP00), Toronto, Canada, 2000.
59. Sahami, M., Mittal, V., Baluja, S., and Rowley, H. The happy searcher: Challenges in web information retrieval. In Trends in Artificial Intelligence, 8th Pacific Rim International Conference on Articicial Intelligence (PRICAI), GuiLin, China, 2004.
60. Sahami, M., Dumais, S., Heckerman, D., and Horvitz, E. A Bayesian Approach to Filtering Junk E-Mail. Proceedings of the AAAI Workshop on Learning for Text Categorization, Madison, WI, 1998.
61. Shankar, S., and Karypis, G. Weight adjustment schemes for a centroid based classifier. Computer Science Technical Report TR00-035, 2000.
62. Snow, R., Jurafsky, D., and Ng, A. Learning syntactic patterns for automatic hypernym discovery. Proceedings of Neural Information Processing, Vancouver, Canada, 2004.
63. Taghva, K., Borsack, J., Coombs, J., Condit, A., Lumos, S., and Nartker, T. Ontology-based Classification of Email. Proceedings of the International Symposium on Information Technology (ITCC03), Las Vegas, NV, 194-198, 2003.
64. Waterson, A., and Preece, A. Verifying ontological commitment in knowledge-based systems. Knowledge-Based Systems. 12(1-2): 45-54, 1999.
65. Yang, J., Chalasani, V., and Park, S. Intelligent Email Categorization Based on Textual Information and Metadata. IEICE TRANS. INF. & SYST., VOL. E82, NO.1 JANUARY 1999
66. Yang Y., and Pedersen, J. A Comparative Study on Feature Selection in Text Categorization. Proceedings of the Fourteenth International Conference on Machine Learning (ICML97), Nashville, TN, 412-420, 1997.
67. Youn, S., and McLeod, D. Ontology Development Tools for Ontology-Based Knowledge Management. Encyclopedia of E-Commerce, E-Government and Mobile Commerce, Idea Group Inc., 2006.
68. Youn, S., and McLeod, D. A Comparative Study for Email Classification. Proceedings of International Joint Conferences on Computer, Information, System Sciences, and Engineering (CISSE06), Bridgeport, CT, December, 2006
69. Youn, S., and McLeod, D. Efficient Spam Email Filtering using an Adaptive Ontology. Proceedings of 4th International Conference on Information Technology: New Generations (ITNG07), Las Vegas, NV, April, 2007.