LIVE FEED
FIRST LOOK Check Point Launches Dangerous Deviation Detection for AI Agents // HIGH CERT-In: AI Agents Breached Indian Orgs via Exposed Credentials // FIRST LOOK AWS Launches Trust in Depth Controls for Autonomous AI Agents // FIRST LOOK Anthropic Opens Employee-Level Access to METR Safety Researchers // FIRST LOOK Apate Launches AI Agents That Infiltrate Scam Networks for Intelligence // HIGH OpenAI Engineer Used Chatbot to Plan Covert Bug Planting // HIGH OpenAI Engineer Arrested for Planting Hidden Spy Device // FIRST LOOK Laplace Intelligence Launches AI Red-Teaming for Robots and AVs // FIRST LOOK AWS Launches AgentCore Payments with Anchor Browser for AI Agents // MEDIUM OpenAI Lean Proof Mistranslation Exposes AI Verification Risk //
OPEN-WEIGHT-MODELS

Open-Weight-Models

4 reports
All LLM Security Agentic AI Industry News Research First Look: Security Supply Chain Prompt Injection Regulatory Adversarial ML Jailbreaks Model Theft Data Poisoning Deep Signal Intelligence Report Monthly Review AI Governance AI Security AI Security Tools Identity & Access Management Security Operations
Base Labs and Hugging Face Launch Open-Weight AI Safety Standard

Base Labs and Hugging Face Launch Open-Weight AI Safety Standard

FIRST LOOK ATLAS OWASP MEDIUM Moderate risk · Monitor closely ▲ 7.2 TechCrunch AI

Base Labs, Hugging Face, and Goodfire AI have announced a partnership to build safety evaluation and monitoring infrastructure natively into open-weight AI models, framing it as an industry standard rather than a post-deployment patch. This directly addresses the growing abliteration problem — where safety guardrails are stripped from open-weight models — by pushing interpretability and controls into the training and serving pipeline itself. Key technical details and adoption timelines remain undisclosed, leaving the practical maturity of the standard an open question for security teams.

AWS Brings NVIDIA Nemotron and OpenAI GPT to GovCloud

AWS Brings NVIDIA Nemotron and OpenAI GPT to GovCloud

FIRST LOOK ATLAS OWASP HIGH Significant risk · Prioritise patching ▲ 6.8 AWS Machine Learning Blog

AWS has expanded Amazon Bedrock in GovCloud (US) to include NVIDIA Nemotron and OpenAI's open-weight GPT OSS models, enabling U.S. government agencies and defense contractors to run frontier LLMs within FedRAMP High and DoD SRG compliance boundaries. This expansion introduces large, capable open-weight models into sensitive government mission workflows — including intelligence analysis, security log review, and contract automation — dramatically increasing the consequence of a successful prompt injection or jailbreak. Defenders must account for the elevated impact of model compromise in classified-adjacent environments, supply chain trust assumptions around open-weight model weights, and the risk of agentic workflows operating with privileged data access under reduced human oversight.

Anthropic CEO: Open-Source AI Models Pose Systemic Safety Risk

Anthropic CEO: Open-Source AI Models Pose Systemic Safety Risk

FIRST LOOK ATLAS OWASP HIGH Significant risk · Prioritise patching ▲ 6.2 Meta AI (via HN)

Anthropic CEO Dario Amodei testified to lawmakers that open-source AI models present a systemic safety risk because once released, developers lose the ability to monitor misuse, revoke access, or patch safety guardrails. For defenders, this formalises a long-standing asymmetry: closed-source safety controls (rate-limiting, usage monitoring, kill-switches) become irrelevant once capable weights are publicly distributed. Security teams building on or competing against open-weight models must now treat every downloaded model artifact as a potentially unpatched, unmonitored endpoint that can be fine-tuned to remove safety constraints entirely.

AI Worm Autonomously Generates Exploits at Runtime

AI Worm Autonomously Generates Exploits at Runtime

ATLAS OWASP CRITICAL Active exploitation · Immediate action required ▲ 9.2 The Hacker News

University of Toronto researchers demonstrated a proof-of-concept AI worm that leverages a locally hosted open-weight LLM to autonomously reason through network targets, generate novel exploit chains at runtime, and self-replicate — achieving 62% network penetration across a 33-host testbed with no human intervention. Unlike traditional worms with fixed payloads, this system bypasses conventional patch-based defences by dynamically adapting attack logic to whatever vulnerabilities it discovers. The use of offline open-weight models eliminates dependency on commercial AI APIs, making it resilient to rate-limiting or platform-level safety controls.

◉ AI THREAT BRIEFING

Stay ahead of the threat.

Twice-weekly digest of critical AI security developments — every story mapped to MITRE ATLAS and OWASP LLM Top 10. Free.

No spam. Unsubscribe anytime.