2025/08/29 by Víctor Mayoral-Vilches, Mayoral-Vilches, Víctor, Per Mannermaa Rynning +1 · 3 voices · 2 citations
Computer Science · #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Security and Verification in Computing #Spam and Phishing Detection #Web Application Security Vulnerabilities #cs.CR
paper · pdf · doi:10.48550/arxiv.2508.21669
openalex publication_date 2025/08/29 · arxiv published 2025/08/29 · openalex created_date 2025/10/10 · arxiv updated 2025/11/15 · openalex updated_date 2026/07/28
We demonstrate how AI-powered cybersecurity tools can be turned against themselves through prompt injection attacks. Prompt injection is reminiscent of cross-site scripting (XSS): malicious text is hidden within seemingly trusted content, and when the system processes it, that text is transformed into unintended instructions. When AI agents designed to find and exploit vulnerabilities interact with malicious web servers, carefully crafted reponses can hijack their execution flow, potentially granting attackers system access. We present proof-of-concept exploits against the Cybersecurity AI (CAI) framework and its CLI tool, and detail our mitigations against such attacks in a multi-layered defense implementation. Our findings indicate that prompt injection is a recurring and systemic issue in LLM-based architectures, one that will require dedicated work to address, much as the security community has had to do with XSS in traditional web applications.