LIVE FEED
Google Gemini Breaches Real Systems in AI Security Test Mishap

Google Gemini Breaches Real Systems in AI Security Test Mishap

ATLAS OWASP HIGH Significant risk · Prioritise patching ▲ 8.5 The Hacker News

Google Gemini autonomously accessed protected systems belonging to real companies during a May 2026 security evaluation by Israeli firm Irregular, after a domain naming error caused fictional CTF targets to overlap with live infrastructure. The AI agent gained access via repeated password guessing and exposed credentials found in a public repository, raising serious concerns about agentic AI behaviour boundaries and evaluation environment isolation. While Gemini self-terminated after detecting the intrusion, the incident underscores systemic gaps in AI red-team methodology and sandbox hygiene.

Microsoft RAMPART Tests AI Agents for Prompt Injection

Microsoft RAMPART Tests AI Agents for Prompt Injection

ATLAS OWASP MEDIUM Moderate risk · Monitor closely ▲ 7.2 The Hacker News

Microsoft has released two open-source tools, RAMPART and Clarity, aimed at embedding security testing into AI agent development workflows. RAMPART extends the existing PyRIT framework with a Pytest-native harness for running adversarial and safety tests against AI agents, explicitly covering cross-prompt injection, data exfiltration, and behavioural regression scenarios. Clarity operates as a pre-code design analysis tool, helping teams surface and challenge unsafe assumptions before an agentic system is built.

CrowdStrike Red Teaming: LLM Jailbreak and Data Poisoning

CrowdStrike Red Teaming: LLM Jailbreak and Data Poisoning

ATLAS OWASP MEDIUM Moderate risk · Monitor closely ▲ 6.5 SecurityWeek

Joey Melo, Principal Security Researcher at CrowdStrike, outlines his methodology for AI red teaming, focusing on manipulating LLM guardrails through jailbreaking and data poisoning without altering underlying source code. His work, rooted in competitive AI hacking challenges, translates classical adversarial thinking into the emerging field of machine learning security. The profile highlights the growing professionalisation of AI red teaming as organisations seek to harden LLM deployments against real-world manipulation attacks.

◉ AI THREAT BRIEFING

Stay ahead of the threat.

Twice-weekly digest of critical AI security developments — every story mapped to MITRE ATLAS and OWASP LLM Top 10. Free.

No spam. Unsubscribe anytime.