Security evaluation of pattern classifiers under attack

IEEE Transactions on Knowledge and Data Engineering

Volumn 26, Issue 4, 2014, Pages 984-996

  Biggio, Battista ^a   Fumera, Giorgio ^a   Roli, Fabio ^a  

^a UNIVERSITY OF CAGLIARI   (Italy)

Author keywords

Adversarial classification; Pattern classification; Performance evaluation; Robustness evaluation; Security evaluation

Indexed keywords

BIOMETRICS; INTRUSION DETECTION; PATTERN RECOGNITION; PATTERN RECOGNITION SYSTEMS;

ADVERSARIAL CLASSIFICATIONS; ADVERSARIAL ENVIRONMENTS; BIOMETRIC AUTHENTICATION; NETWORK INTRUSION DETECTION; PERFORMANCE DEGRADATION; PERFORMANCE EVALUATION; ROBUSTNESS EVALUATION; SECURITY EVALUATION;

DESIGN;

EID: 84992268362     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2013.57     Document Type: Article

References (54)

1. R. N. Rodrigues, L. L. Ling, and V. Govindaraju, "Robustness of Multimodal Biometric Fusion Methods against Spoof Attacks," J. Visual Languages and Computing, vol. 20, no. 3, pp. 169-179, 2009.
2. P. Johnson, B. Tan, and S. Schuckers, "Multimodal Fusion Vulnerability to Non-Zero Effort (Spoof) Imposters," Proc. IEEE Int'l Workshop Information Forensics and Security, pp. 1-5, 2010.
3. P. Fogla, M. Sharif, R. Perdisci, O. Kolesnikov, and W. Lee, "Polymorphic Blending Attacks," Proc. 15th Conf. USENIX Security Symp., 2006.
4. G. L. Wittel and S. F. Wu, "On Attacking Statistical Spam Filters," Proc. First Conf. Email and Anti-Spam, 2004.
5. D. Lowd and C. Meek, "Good Word Attacks on Statistical Spam Filters," Proc. Second Conf. Email and Anti-Spam, 2005.
6. A. Kolcz and C. H. Teo, "Feature Weighting for Improved Classifier Robustness," Proc. Sixth Conf. Email and Anti-Spam, 2009.
7. D. B. Skillicorn, "Adversarial Knowledge Discovery," IEEE Intelligent Systems, vol. 24, no. 6, Nov. /Dec. 2009.
8. D. Fetterly, "Adversarial Information Retrieval: The Manipulation of Web Content," ACM Computing Rev., 2007.
9. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification. Wiley-Interscience Publication, 2000.
10. N. Dalvi, P. Domingos, Mausam, S. Sanghai, and D. Verma, "Adversarial Classification," Proc. 10th ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining, pp. 99-108, 2004. (Pubitemid 40114920)
11. M. Barreno, B. Nelson, R. Sears, A. D. Joseph, and J. D. Tygar, "Can Machine Learning be Secure" Proc. ACM Symp. Information, Computer and Comm. Security (ASIACCS), pp. 16-25, 2006. (Pubitemid 46644722)
12. A. A. C-ardenas and J. S. Baras, "Evaluation of Classifiers: Practical Considerations for Security Applications," Proc. AAAI Workshop Evaluation Methods for Machine Learning, 2006.
13. P. Laskov and R. Lippmann, "Machine Learning in Adversarial Environments," Machine Learning, vol. 81, pp. 115-119, 2010.
14. L. Huang, A. D. Joseph, B. Nelson, B. Rubinstein, and J. D. Tygar, "Adversarial Machine Learning," Proc. Fourth ACM Workshop Artificial Intelligence and Security, pp. 43-57, 2011.
15. M. Barreno, B. Nelson, A. Joseph, and J. Tygar, "The Security of Machine Learning," Machine Learning, vol. 81, pp. 121-148, 2010.
16. D. Lowd and C. Meek, "Adversarial Learning," Proc. 11th ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining, pp. 641-647, 2005. (Pubitemid 43218333)
17. P. Laskov and M. Kloft, "A Framework for Quantitative Security Analysis of Machine Learning," Proc. Second ACM Workshop Security and Artificial Intelligence, pp. 1-4, 2009.
18. NIPS Workshop Machine Learning in Adversarial Environments for Computer Security, http://mls-nips07. first. fraunhofer. de/, 2007.
19. Dagstuhl Perspectives Workshop Mach. Learning Methods for Computer Sec., http://www. dagstuhl. de/12371/, 2012.
20. A. M. Narasimhamurthy and L. I. Kuncheva, "A Framework for Generating Data to Simulate Changing Environments," Proc. 25th Conf. Proc. the 25th IASTED Int'l Multi-Conf.: Artificial Intelligence and Applications, pp. 415-420, 2007.
21. S. Rizzi, "What-If Analysis," Encyclopedia of Database Systems, pp. 3525-3529, Springer, 2009.
22. J. Newsome, B. Karp, and D. Song, "Paragraph: Thwarting Signature Learning by Training Maliciously," Proc. Ninth Int'l Conf. Recent Advances in Intrusion Detection, pp. 81-105, 2006. (Pubitemid 44617848)
23. A. Globerson and S. T. Roweis, "Nightmare at Test Time: Robust Learning by Feature Deletion," Proc. 23rd Int'l Conf. Machine Learning, pp. 353-360, 2006.
24. R. Perdisci, G. Gu, and W. Lee, "Using an Ensemble of One-Class SVM Classifiers to Harden Payload-Based Anomaly Detection Systems," Proc. Int'l Conf. Data Mining, pp. 488-498, 2006. (Pubitemid 47485828)
25. S. P. Chung and A. K. Mok, "Advanced Allergy attacks: Does a Corpus Really Help," Proc. 10th Int'l Conf. Recent Advances in Intrusion Detection (RAID '07), pp. 236-255, 2007.
26. Z. Jorgensen, Y. Zhou, and M. Inge, "A Multiple Instance Learning Strategy for Combating Good Word Attacks on Spam Filters," J. Machine Learning Research, vol. 9, pp. 1115-1146, 2008.
27. G. F. Cretu, A. Stavrou, M. E. Locasto, S. J. Stolfo, and A. D. Keromytis, "Casting out Demons: Sanitizing Training Data for Anomaly Sensors," Proc. IEEE Symp. Security and Privacy, pp. 81-95, 2008.
28. B. Nelson, M. Barreno, F. J. Chi, A. D. Joseph, B. I. P. Rubinstein, U. Saini, C. Sutton, J. D. Tygar, and K. Xia, "Exploiting Machine Learning to Subvert Your Spam Filter," Proc. First Workshop Large-Scale Exploits and Emergent Threats, pp. 1-9, 2008.
29. B. I. Rubinstein, B. Nelson, L. Huang, A. D. Joseph, S.-h. Lau, S. Rao, N. Taft, and J. D. Tygar, "Antidote: Understanding and Defending against Poisoning of Anomaly Detectors," Proc. Ninth ACM SIGCOMM Internet Measurement Conf. (IMC '09), pp. 1-14, 2009.
30. M. Kloft and P. Laskov, "Online Anomaly Detection under Adversarial Impact," Proc. 13th Int'l Conf. Artificial Intelligence and Statistics, pp. 405-412, 2010.
31. O. Dekel, O. Shamir, and L. Xiao, "Learning to Classify with Missing and Corrupted Features," Machine Learning, vol. 81, pp. 149-178, 2010.
32. B. Biggio, G. Fumera, and F. Roli, "Design of Robust Classifiers for Adversarial Environments," Proc. IEEE Int'l Conf. Systems, Man, and Cybernetics, pp. 977-982, 2011.
33. B. Biggio, G. Fumera, and F. Roli, "Multiple Classifier Systems for Robust Classifier Design in Adversarial Environments," Int'l J. Machine Learning and Cybernetics, vol. 1, no. 1, pp. 27-41, 2010.
34. B. Biggio, I. Corona, G. Fumera, G. Giacinto, and F. Roli, "Bagging Classifiers for Fighting Poisoning Attacks in Adversarial Environments," Proc. 10th Int'l Workshop Multiple Classifier Systems, pp. 350-359, 2011.
35. B. Biggio, G. Fumera, F. Roli, and and L. Didaci, "Poisoning Adaptive Biometric Systems," Proc. Joint IAPR Int'l Conf. Structural, Syntactic, and Statistical Pattern Recognition, pp. 417-425, 2012.
36. B. Biggio, B. Nelson, and P. Laskov, "Poisoning Attacks against Support Vector Machines," Proc. 29th Int'l Conf. Machine Learning, 2012.
37. M. Kearns and M. Li, "Learning in the Presence of Malicious Errors," SIAM J. Computing, vol. 22, no. 4, pp. 807-837, 1993. (Pubitemid 23677152)
38. A. A. C-ardenas, J. S. Baras, and K. Seamon, "A Framework for the Evaluation of Intrusion Detection Systems," Proc. IEEE Symp. Security and Privacy, pp. 63-77, 2006. (Pubitemid 44753712)
39. B. Biggio, G. Fumera, and F. Roli, "Multiple Classifier Systems for Adversarial Classification Tasks," Proc. Eighth Int'l Workshop Multiple Classifier Systems, pp. 132-141, 2009.
40. M. Br?uckner, C. Kanzow, and T. Scheffer, "Static Prediction Games for Adversarial Learning Problems," J. Machine Learning Research, vol. 13, pp. 2617-2654, 2012.
41. A. Adler, "Vulnerabilities in Biometric Encryption Systems," Proc. Fifth Int'l Conf. Audio-and Video-Based Biometric Person Authentication, pp. 1100-1109, 2005. (Pubitemid 41423129)
42. B. Efron and R. J. Tibshirani, An Introduction to the Bootstrap. Chapman & Hall, 1993.
43. H. Drucker, D. Wu, and V. N. Vapnik, "Support Vector Machines for Spam Categorization," IEEE Trans. Neural Networks, vol. 10, no. 5, pp. 1048-1054, Sept. 1999.
44. F. Sebastiani, "Machine Learning in Automated Text Categorization," ACM Computing Surveys, vol. 34, pp. 1-47, 2002.
45. C.-C. Chang, C.-J. Lin, "LibSVM: A Library for Support Vector Machines," http://www. csie. ntu. edu. tw/~cjlin/libsvm/, 2001.
46. K. Nandakumar, Y. Chen, S. C. Dass, and A. Jain, "Likelihood Ratio-Based Biometric Score Fusion," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 2, pp. 342-347, Feb. 2008.
47. B. Biggio, Z. Akhtar, G. Fumera, G. Marcialis, and F. Roli, "Robustness of Multi-Modal Biometric Verification Systems under Realistic Spoofing Attacks," Proc. Int'l Joint Conf. Biometrics, pp. 1-6, 2011.
48. B. Biggio, Z. Akhtar, G. Fumera, G. L. Marcialis, and F. Roli, "Security Evaluation of Biometric Authentication Systems under Real Spoofing Attacks," IET Biometrics, vol. 1, no. 1, pp. 11-24, 2012.
49. K. Wang and S. J. Stolfo, "Anomalous Payload-Based Network Intrusion Detection," Proc. Seventh Symp. Recent Advances in Intrusion Detection (RAID), pp. 203-222, 2004. (Pubitemid 39741895)
50. B. Sch?olkopf, A. J. Smola, R. C. Williamson, and P. L. Bartlett, "New Support Vector Algorithms," Neural Computation, vol. 12, no. 5, pp. 1207-1245, 2000.
51. K. Ingham and H. Inoue, "Comparing Anomaly Detection Techniques for http," Proc. 10th Int'l Conf. Recent Advances in Intrusion Detection, pp. 42-62, 2007.
52. D. Sculley, G. Wachman, and C. E. Brodley, "Spam Filtering Using Inexact String Matching in Explicit Feature Space with on-Line Linear Classifiers," Proc. 15th Text Retrieval Conf., 2006.
53. Encyclopedia of Biometrics, S. Z. Li, and A. K. Jain, eds., Springer US, 2009.
54. B. Biggio, G. Fumera, and F. Roli, "Adversarial Pattern Classification Using Multiple Classifiers and Randomisation," Proc. Joint IAPR Int'l Workshop Structural, Syntactic, and Statistical Pattern Recognition, pp. 500-509, 2008.