LIVE FEED
FIRST LOOK AWS Adds Bedrock Guardrails Best Practices for Code Generation // FIRST LOOK Anthropic Brings Voice Mode to Claude Opus and Sonnet Models // FIRST LOOK Anthropic and OpenAI Open Vetted Cyber Programs for Offensive Researchers // HIGH Threat Actor Trim Weaponises AI Jailbreaks for Offensive Ops // HIGH Fake Claude App via Bing Ads Delivers SectopRAT Malware // HIGH Dolphin X RAT Uses AI Profiler to Rank and Score Victims // CRITICAL CVE-2026-46331: Claude Cowork VM Sandbox Escape on macOS // CRITICAL AgentForger Flaw Lets Attackers Plant Invisible AI Agents in Orgs // FIRST LOOK Agentic AI Disrupts Confidential Computing Security Boundaries // CRITICAL OpenAI GPT-5.6 Escapes Sandbox, Attacks Hugging Face to Cheat Benchmark //
OPEN-WEIGHT-MODELS

Open-Weight-Models

3 reports
All LLM Security Agentic AI Industry News Research Supply Chain Prompt Injection First Look: Security Regulatory Jailbreaks Adversarial ML Model Theft Data Poisoning AI Security Tools Security Operations
AWS Brings NVIDIA Nemotron and OpenAI GPT to GovCloud

AWS Brings NVIDIA Nemotron and OpenAI GPT to GovCloud

FIRST LOOK ATLAS OWASP HIGH Significant risk · Prioritise patching ▲ 6.8 AWS Machine Learning Blog

AWS has expanded Amazon Bedrock in GovCloud (US) to include NVIDIA Nemotron and OpenAI's open-weight GPT OSS models, enabling U.S. government agencies and defense contractors to run frontier LLMs within FedRAMP High and DoD SRG compliance boundaries. This expansion introduces large, capable open-weight models into sensitive government mission workflows — including intelligence analysis, security log review, and contract automation — dramatically increasing the consequence of a successful prompt injection or jailbreak. Defenders must account for the elevated impact of model compromise in classified-adjacent environments, supply chain trust assumptions around open-weight model weights, and the risk of agentic workflows operating with privileged data access under reduced human oversight.

Anthropic CEO: Open-Source AI Models Pose Systemic Safety Risk

Anthropic CEO: Open-Source AI Models Pose Systemic Safety Risk

FIRST LOOK ATLAS OWASP HIGH Significant risk · Prioritise patching ▲ 6.2 Meta AI (via HN)

Anthropic CEO Dario Amodei testified to lawmakers that open-source AI models present a systemic safety risk because once released, developers lose the ability to monitor misuse, revoke access, or patch safety guardrails. For defenders, this formalises a long-standing asymmetry: closed-source safety controls (rate-limiting, usage monitoring, kill-switches) become irrelevant once capable weights are publicly distributed. Security teams building on or competing against open-weight models must now treat every downloaded model artifact as a potentially unpatched, unmonitored endpoint that can be fine-tuned to remove safety constraints entirely.

AI Worm Autonomously Generates Exploits at Runtime

AI Worm Autonomously Generates Exploits at Runtime

ATLAS OWASP CRITICAL Active exploitation · Immediate action required ▲ 9.2 The Hacker News

University of Toronto researchers demonstrated a proof-of-concept AI worm that leverages a locally hosted open-weight LLM to autonomously reason through network targets, generate novel exploit chains at runtime, and self-replicate — achieving 62% network penetration across a 33-host testbed with no human intervention. Unlike traditional worms with fixed payloads, this system bypasses conventional patch-based defences by dynamically adapting attack logic to whatever vulnerabilities it discovers. The use of offline open-weight models eliminates dependency on commercial AI APIs, making it resilient to rate-limiting or platform-level safety controls.

◉ AI THREAT BRIEFING

Stay ahead of the threat.

Twice-weekly digest of critical AI security developments — every story mapped to MITRE ATLAS and OWASP LLM Top 10. Free.

No spam. Unsubscribe anytime.