LIVE FEED
HIGH AI Guardrails Fail Multilingual Jailbreak Tests in Europe // FIRST LOOK AI Agent Security Shifts From Visibility to Enforcement Controls // HIGH Hermes AI Agent Automates Post-Exploitation Attack on Thai Finance Ministry // FIRST LOOK Google Gemma Tech Brings 28.9M LLM to ESP32 Microcontrollers // HIGH AI Coding Agents Exploited via Hallucinated Package Names // FIRST LOOK AWS Adds Bedrock Guardrails Best Practices for Code Generation // FIRST LOOK Anthropic Brings Voice Mode to Claude Opus and Sonnet Models // FIRST LOOK Anthropic and OpenAI Open Vetted Cyber Programs for Offensive Researchers // HIGH Threat Actor Trim Weaponises AI Jailbreaks for Offensive Ops // HIGH Fake Claude App via Bing Ads Delivers SectopRAT Malware //
CONTENT-MODERATION

Content-Moderation

2 reports
All LLM Security Agentic AI Industry News Research Supply Chain Prompt Injection First Look: Security Regulatory Adversarial ML Jailbreaks Model Theft Data Poisoning AI Security Tools Security Operations
Google Gemini Abused for Phishing-as-a-Service

Google Gemini Abused for Phishing-as-a-Service

ATLAS OWASP HIGH Significant risk · Prioritise patching ▲ 7.2 Schneier on Security

A Chinese cybercriminal group called Outsider Enterprise exploited Google's Gemini AI to mass-produce phishing pages impersonating Google, YouTube, and government agencies like E-ZPass, offering nearly 300 scam templates via Telegram. Google has filed suit and coordinated with major US carriers to block the resulting smishing campaigns. The case highlights how generative AI lowers the technical barrier for large-scale phishing operations and stress-tests provider-side content controls.

Llama Guard 4 Jailbreak Detection Vulnerable to Prompt Injection

Llama Guard 4 Jailbreak Detection Vulnerable to Prompt Injection

ATLAS OWASP LOW Limited impact · Standard review ▲ 7.2 Hugging Face Blog

Meta has released Llama Guard 4, a 12B multimodal safety classifier designed to detect and filter unsafe content in both image and text inputs/outputs for production LLM deployments. The model addresses jailbreak attempts and harmful content generation across 14 hazard categories defined by the MLCommons taxonomy. Alongside it, two lightweight Llama Prompt Guard 2 classifiers (86M and 22M parameters) target prompt injection and prompt attack detection.

◉ AI THREAT BRIEFING

Stay ahead of the threat.

Twice-weekly digest of critical AI security developments — every story mapped to MITRE ATLAS and OWASP LLM Top 10. Free.

No spam. Unsubscribe anytime.