Cloud-based malware detection for evolving data streams

ACM Transactions on Management Information Systems

Volumn 2, Issue 3, 2011, Pages

  Masud, Mohammad M ^a   Al Khateeb, Tahseen M ^a   Hamlen, Kevin W ^a   Gao, Jing ^b   Khan, Latifur ^a   Han, Jiawei ^b   Thuraisingham, Bhavani ^a  

^a UNIVERSITY OF TEXAS AT DALLAS   (United States)

^b University of Illinois at Urbana Champaign   (United States)

Author keywords

Data mining; Data streams; Malicious executable; Malware detection; N gram analysis

Indexed keywords

CLASSIFICATION ERRORS; COMPUTING ARCHITECTURE; DATA CHUNKS; DATA STREAM; EMPIRICAL EVIDENCE; ENSEMBLE CLASSIFIERS; ENSEMBLE TECHNIQUES; FEATURE EXTRACTION AND SELECTION; FEATURE EXTRACTION TECHNIQUES; FEATURE SETS; MALICIOUS EXECUTABLE; MALICIOUS EXECUTABLES; MALWARE DETECTION; MAP-REDUCE; MULTI-PASS; N-GRAM ANALYSIS; STREAM CLASSIFICATION; SYNTHETIC DATA; TEXT STREAMS;

COMPUTER VIRUSES; DATA COMMUNICATION SYSTEMS; FEATURE EXTRACTION; INTRUSION DETECTION; LEARNING ALGORITHMS;

DATA MINING;

EID: 84860563303     PISSN: 2158656X     EISSN: 21586578     Source Type: Journal    
DOI: 10.1145/2019618.2019622     Document Type: Article

References (41)

1. Aggarwal C. C. Han J.,Wang J. And Yu P. S. 2006. A Framework For On-Demand Classification Of Evolving Data Streams. Ieee Trans. Knowl. Data Engin. 18, 5, 577-589.
2. Aha D. W. Kibler D. And Albert M. K. 1991. Instance-Based Learning Algorithms. Mach. Learn. 6, 37-66. (Pubitemid 21727227)
3. Apache. 2010. Hadoop. Hadoop.Apache.Org.
4. Barford P. And Yegneswaran V. 2006. An Inside Look At Botnets. In Malware Detection Advances In Information Security M. Christodorescu S. Jha D. Maughan D. Song And C. Wang Eds. Springer, 171-192.
5. Bifet A. Holmes G. Pfahringer B. Kirkby R. And Gavald A R. 2009. New Ensemble Methods For Evolving Data Streams. In Proceedings Of The 15Th Acm International Conference On Knowledge Discovery And Data Mining (Kdd). 139-148.
6. Boser B. E. Guyon I. M. And Vapnik V. N. 1992. A Training Algorithm For Optimal Margin Classifiers. In Proceedings Of The 5Th Acm Workshop On Computational Learning Theory. 144-152.
7. Chen S. Wang H. Zhou S. And Yu P. S. 2008. Stop Chasing Trends: Discovering High Order Models In Evolving Data. In Proceedings Of The 24Th Ieee International Conference On Data Engineering (Icde). 923-932.
8. Cohen W. W. 1996. Learning Rules That Classify E-Mail. In Proceedings Of The Aaai Spring Symposium On Machine Learning In Information Access. 18-25.
9. Computer Economics Inc. 2007. Malware Report: The Economic Impact Of Viruses Spyware Adware Botnets And Other Malicious Code. http://Www. Computereconomics.Com/Article.Cfm?Id=1225.
10. Crandall J. R. Su Z.,Wu S. F. And Chong F. T. 2005. On Deriving Unknown Vulnerabilities From Zero-Day Polymorphic And Metamorphic Worm Exploits. In Proceedings Of The 12Th Acm Conference On Computer And Communications Security (Ccs'05). 235-248. (Pubitemid 44022007)
11. Dean J. And Ghemawat S. 2008. Mapreduce: Simplified Data Processing On Large Clusters. Comm. Acm 51, 1, 107-113.
12. Domingos P. And Hulten G. 2000. Mining High-Speed Data Streams. In Proceedings Of The 6Th Acm International Conference On Knowledge Discovery And Data Mining (Kdd). 71-80.
13. Fan W. 2004. Systematic Data Selection To Mine Concept-Drifting Data Streams. In Proceedings Of The 10Th Acm International Conference On Knowledge Discvoery And Data Mining (Kdd). 128-137. (Pubitemid 40114923)
14. Freund Y. And Schapire R. E. 1996. Experiments With A New Boosting Algorithm. In Proceedings Of The 13Th International Conference On Machine Learning. 148-156.
15. Gao J. Fan W. And Han J. 2007. On Appropriate Assumptions To Mine Data Streams: Analysis And Practice. In Proceedings Of The 7Th Ieee International Conference On Data Mining (Icdm). 143-152.
16. Grizzard J. B. Sharma V.,Nunnery C.,Kang B. B. And Dagon D. 2007. Peer-To-Peer Botnets: Overview And Case Study. In Proceedings Of The 1St Workshop On Hot Topics In Understanding Botnets (Hotbots). 1-8.
17. Hall M. Frank E. Holmes G. Pfahringer B. Reutemann P. And Witten I. H. 2009. The Weka Data Mining Software: An Update. Acm Sigkdd Explor. 11, 1, 10-18.
18. Hamlen K. W.,Mohan V.,Masud M. M. Khan L. And Thuraisingham. B. M. 2009. Exploiting An Antivirus Interface. Comput. Stand. Interfaces 31, 6, 1182-1189.
19. Hashemi S. Yang Y.,Mirzamomen Z. And Kangavari M. R. 2009. Adapted One-Versus-All Decision Trees For Data Stream Classification. Ieee Trans. Knowl. Data Engin. 21, 5, 624-637.
20. Hulten G. Spencer L. And Domingos P. 2001. Mining Time-Changing Data Streams. In Proceedings Of The 7Th Acm International Conference On Knowledge Discovery And Data Mining (Kdd). 97-106.
21. Kolter J. And Maloof M. A. 2004. Learning To Detect Malicious Executables In The Wild. In Proceedings Of The 10Th Acm International Conference On Knowledge Discovery And Data Mining (Kdd). 470-478. (Pubitemid 40114957)
22. Kolter J. Z. And Maloof M. A. 2005. Using Additive Expert Ensembles To Cope With Concept Drift. In Proceedings Of The 22Nd International Conference On Machine Learning (Icml). 449-456. (Pubitemid 43183365)
23. Lemos R. 2006. Bot Software Looks To Improve Peerage. Securityfocus. Www.Securityfocus.Com/News/11390.
24. Li Z. Sanghi M. Chen Y. Kao M.-Y. And Chavez B. 2006. Hamsa: Fast Signature Generation For Zero-Day Polymorphic Worms With Provable Attack Resilience. In Proceedings Of The Ieee Symposium On Security And Privacy (S&P). 32-47.
25. Masud M. M.,Gao J.,Khan L.,Han J. And Thuraisingham B. 2008A. Mining Concept-Drifting Data Stream To Detect Peer To Peer Botnet Traffic. Tech. Rep. Utdcs-05-08 Theuniversity Of Texas At Dallas Richardson Texas. Www.Utdallas.Edu/Mmm058000/Reports/Utdcs-05-08.Pdf.
26. Masud M. M. Gao J. Khan L. Han J. And Thuraisingham B. M. 2009. A Multi-Partition Multi-Chunk Ensemble Technique To Classify Concept-Drifting Data Streams. In Proceedings Of The 13Th Pacific-Asia Conference On Advances In Knowledge Discovery And Data Mining (Pakdd). 363-375.
27. Masud M. M.,Khan L. And Thuraisingham. B. 2008B. A Scalable Multi-Level Feature Extraction Technique To Detect Malicious Executables. Inf. Syst. Frontiers 10, 1, 33-45. (Pubitemid 351303936)
28. Michie D. Spiegelhalter D. J. And Taylor C. C. Eds. 1994. Machine Learning Neural And Statistical Classification. Ellis Horwood Series In Artificial Intelligence. Morgan Kaufmann, 50-83.
29. Newsome J. Karp B. And Song D. 2005. Polygraph: Automatically Generating Signatures For Polymorphic Worms. In Proceedings Of The Ieee Symposium On Security And Privacy (S&P). 226-241. (Pubitemid 41543658)
30. Quinlan J. R. 2003. C4.5: Programs For Machine Learning 5Th Ed. Morgan Kaufmann San Francisco Ca.
31. Rish I.,Grabarnik G. Cecchi G. A. Pereira F. And Gordon G. J. 2008. Closed-Form Supervised Dimensionality Reduction With Generalized Linear Models. In Proceedings Of The 25Th Acm International Conference On Machine Learning (Icml). 832-839.
32. Sajama And Orlitsky A. 2005. Supervised Dimensionality Reduction Using Mixture Models. In Proceedings Of The 22Nd Acm International Conference On Machine Learning (Icml). 768-775.
33. Scholz M. And Klinkenberg R. 2005. An Ensemble Classifier For Drifting Concepts. In Proceedings Of The 2Nd International Workshop On Knowledge Discovery In Data Streams (Iwkdds). 53-64.
34. Schultz M. G. Eskin E. Zadok E. And Stolfo S. J. 2001. Data Mining Methods For Detection Of New Malicious Executables. In Proceedings Of The Ieee Symposium On Security And Privacy (S&P). 38-49. (Pubitemid 32882625)
35. Stewart J. 2003. Sinit P2P Trojan Analysis. Www.Secureworks.Com/Research/ Threats/Sinit.
36. Tumer K. And Ghosh J. 1996. Error Correlation And Error Reduction In Ensemble Classifiers. Connect. Sci. 8, 3, 385-404.
37. Vx Heavens 2010. Vx Heavens. Vx.Netlux.Org.
38. Wang H.,Fan,W.,Yu P. S. Andhan J. 2003. Mining Concept-Drifting Data Streams Using Ensemble Classifiers. In Proceedings Of The 9Th Acminternational Conference On Knowledgediscovery Anddatamining (Kdd). 226-235.
39. Yang Y. Wu X. And Zhu X. 2005. Combining Proactive And Reactive Predictions For Data Streams. In Proceedings Of The 11Th Acm International Conference On Knowledge Discovery And Datamining (Kdd). 710-715. (Pubitemid 43218344)
40. Zhang P. Zhu X. And Guo L. 2009. Mining Data Streams With Labeled And Unlabeled Training Examples. In Proceedings Of The 9Th Ieee International Conference On Data Mining (Icdm). 627-636.
41. Zhao W.,Ma H. And He Q. 2009. Parallel K-Means Clustering Based On Mapreduce. In Proceedings Of The 1St International Conference On Cloud Computing (Cloudcom). 674-679.