LIVE FEED
Anthropic Claude Opus 4.6 Reveals Persistent Jailbreak Gaps in API

Anthropic Claude Opus 4.6 Reveals Persistent Jailbreak Gaps in API

FIRST LOOK ATLAS OWASP MEDIUM Moderate risk · Monitor closely ▲ 5.5 TechCrunch AI

TechCrunch testing and an independent researcher have demonstrated that Anthropic's Claude Opus 4.6, Opus 3, and Haiku 4.5 models — all still available via the Anthropic API, Azure Foundry, and Amazon Bedrock — can be reliably coaxed into generating sexually explicit content through a multi-turn social engineering technique, despite Anthropic's universal usage policies prohibiting such output. The findings provide defenders and AI governance teams with a concrete, reproducible case study of how gradual escalation and social-manipulation jailbreaks bypass content safeguards in production-available models, closing a documentation gap around legacy model risk in multi-cloud deployments. Residual gaps remain around model deprecation policy, version-pinned API consumer risk, and the absence of runtime content enforcement independent of the model itself.

Google Gemini Abused for Phishing-as-a-Service

Google Gemini Abused for Phishing-as-a-Service

ATLAS OWASP HIGH Significant risk · Prioritise patching ▲ 7.2 Schneier on Security

A Chinese cybercriminal group called Outsider Enterprise exploited Google's Gemini AI to mass-produce phishing pages impersonating Google, YouTube, and government agencies like E-ZPass, offering nearly 300 scam templates via Telegram. Google has filed suit and coordinated with major US carriers to block the resulting smishing campaigns. The case highlights how generative AI lowers the technical barrier for large-scale phishing operations and stress-tests provider-side content controls.

Llama Guard 4 Jailbreak Detection Vulnerable to Prompt Injection

Llama Guard 4 Jailbreak Detection Vulnerable to Prompt Injection

ATLAS OWASP LOW Limited impact · Standard review ▲ 7.2 Hugging Face Blog

Meta has released Llama Guard 4, a 12B multimodal safety classifier designed to detect and filter unsafe content in both image and text inputs/outputs for production LLM deployments. The model addresses jailbreak attempts and harmful content generation across 14 hazard categories defined by the MLCommons taxonomy. Alongside it, two lightweight Llama Prompt Guard 2 classifiers (86M and 22M parameters) target prompt injection and prompt attack detection.

◉ AI THREAT BRIEFING

Stay ahead of the threat.

Twice-weekly digest of critical AI security developments — every story mapped to MITRE ATLAS and OWASP LLM Top 10. Free.

No spam. Unsubscribe anytime.