2013/04/05 by Battista Biggio, Giorgio Fumera, Fabio Roli · 6 citations
Computer Science · #Advanced Malware Detection Techniques #Adversarial machine learning #Adversarial system #Artificial intelligence #Biometrics #Classifier (UML) #Computer science #Computer security #Data mining #Exploit #Intrusion detection system #Machine learning #Network Security and Intrusion Detection #Spam and Phishing Detection #cs.CR #cs.LG
paper · pdf · doi:10.1109/tkde.2013.57
published as IEEE Transactions on Knowledge and Data Engineering, 26(4):984-996, April 2014
openalex publication_date 2013/04/05 · arxiv created 2017/09/02 · arxiv updated 2017/09/05 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/05
Pattern classification systems are commonly used in adversarial applications, like biometric authentication, network intrusion detection, and spam filtering, in which data can be purposely manipulated by humans to undermine their operation. As this adversarial scenario is not taken into account by classical design methods, pattern classification systems may exhibit vulnerabilities, whose exploitation may severely affect their performance, and consequently limit their practical utility. Extending pattern classification theory and design methods to adversarial settings is thus a novel and very relevant research direction, which has not yet been pursued in a systematic way. In this paper, we address one of the main open issues: evaluating at design phase the security of pattern classifiers, namely, the performance degradation under potential attacks they may incur during operation. We propose a framework for empirical evaluation of classifier security that formalizes and generalizes the main ideas proposed in the literature, and give examples of its use in three real applications. Reported results show that security evaluation can provide a more complete understanding of the classifier's behavior in adversarial environments, and lead to better design choices.