Jailbreak

Moonshot AI Releases Kimi K3 Open-Weight 2.8T Model Weights

FIRST LOOK ATLAS OWASP MEDIUM ▲ 5.8 Simon Willison Jul 28, 2026

Moonshot AI has released the weights for Kimi K3, a 2.8 trillion parameter mixture-of-experts model (1.56TB), distributed under a restrictive 'open weight' licence that requires a separate commercial agreement for large MaaS operators. The public availability of weights at this scale materially lowers the barrier for adversarial fine-tuning, jailbreak research, and model-theft-adjacent supply chain attacks. Defenders deploying or downstream of K3 should assess licence compliance risk alongside the standard open-weight threat model.

AI Guardrails Fail Multilingual Jailbreak Tests in Europe

ATLAS OWASP HIGH ▲ 7.2 Dark Reading Jul 27, 2026

Research highlighted by Dark Reading reveals that AI safety guardrails and content filters are inconsistently applied across languages, leaving non-English speakers—particularly across Europe's multilingual landscape—with weaker protections against jailbreaking and unsafe model behaviour. This disparity suggests that safety training datasets and RLHF pipelines are disproportionately English-centric, creating exploitable blind spots. Adversaries aware of these gaps can trivially circumvent restrictions by switching input language.

Anthropic and OpenAI Open Vetted Cyber Programs for Offensive Researchers

FIRST LOOK ATLAS OWASP HIGH ▲ 7.2 TechCrunch AI Jul 24, 2026

Anthropic and OpenAI have introduced structured vetting programs — Anthropic's Cyber Verification Program and OpenAI's Trusted Access for Cyber — that grant approved offensive security researchers access to AI models with reduced cybersecurity guardrails. These programs create a two-tier access model where the boundary between legitimate researcher and malicious actor becomes a policy decision made by private companies, introducing new social-engineering and access-abuse vectors. Defenders must now account for the possibility that guardrail-reduced model access can be obtained through credential abuse, insider compromise, or vetting-process manipulation.

Threat Actor Trim Weaponises AI Jailbreaks for Offensive Ops

ATLAS OWASP HIGH ▲ 8.5 Dark Reading Jul 24, 2026

A Russian-speaking threat actor known as 'Trim' has reportedly operationalised frontier AI model jailbreaks, integrating them with offensive security tooling to create an attack platform. This marks a significant escalation from opportunistic jailbreaking to deliberate, weaponised misuse of large language models in adversarial operations. The development signals a maturing threat landscape where AI safety bypasses are no longer merely a research curiosity but a functional component of offensive cyber capability.

Alibaba and Baidu Launch LLMs With US-Level Capabilities

FIRST LOOK ATLAS OWASP HIGH ▲ 6.2 Dark Reading Jul 04, 2026

Two newly released large language models from Chinese AI firms have reached capability parity with leading US frontier models, expanding the global pool of powerful AI available to both commercial and adversarial users. For defenders, this development broadens the asymmetry between attackers — who gain access to capable, potentially less-restricted models — and defenders, who must now account for threats generated by a wider set of model providers. Security teams should anticipate increased use of these models for offensive tasks such as phishing content generation, vulnerability research automation, and social engineering at scale.

OpenAI Releases GPT-5.6 Sol for Vulnerability Research

FIRST LOOK ATLAS OWASP HIGH ▲ 8.2 The Hacker News Jun 29, 2026

OpenAI has released a limited preview of GPT-5.6 Sol, Terra, and Luna to select partners, positioning Sol as its most capable model for vulnerability research and exploit chain development, benchmarked against real-world hardened targets via an internal framework called VulnLMP. The model's demonstrated ability to produce credible memory safety leads and automate substantial portions of vulnerability research pipelines materially lowers the barrier for both defenders and adversaries. Security teams should expect accelerated attacker timelines for exploit development and increased pressure on detection and patch-deployment cadences.

Anthropic Releases Claude Mythos 5 Under U.S. Export Controls

FIRST LOOK ATLAS OWASP HIGH ▲ 7.8 Anthropic (via HN) Jun 27, 2026

The U.S. Commerce Department has lifted export controls on Anthropic's Claude Mythos 5, permitting access to over 100 vetted U.S. institutions and government agencies under a nascent federal AI licensing regime. For defenders, this tiered-release model introduces a new class of risk: the 'trusted partner' designation becomes a high-value target, as compromise of any listed entity grants implicit legitimacy to interact with a model previously deemed too dangerous for general release. Security teams at approved organizations should treat Mythos 5 access credentials and API endpoints as critical assets, and assume adversaries will probe the boundary between licensed and unlicensed access patterns.

LLM Role Confusion Attack Bypasses Safety at 61%

ATLAS OWASP HIGH ▲ 8.2 Simon Willison Jun 23, 2026

New research from Ye, Cui, and Hadfield-Menell demonstrates that LLMs prioritise the stylistic format of text over its structural role tags, enabling attackers to craft injected content that mimics internal reasoning blocks and bypasses safety guardrails. The study found attack success rates of 61% when injected text stylistically matched model-internal formats, dropping to just 10% after 'destyling'. The authors conclude that without genuine role perception in models, prompt injection defences will remain fundamentally reactive.

OpenAI's ChatGPT Image Generation Fails Content Moderation

FIRST LOOK ATLAS OWASP HIGH ▲ 8.2 OpenAI (via HN) Jun 22, 2026

Mindgard researchers demonstrated that ChatGPT's image generation pipeline can be manipulated through an indirect, socially-engineered prompt to produce violent and sexually explicit content without users directly requesting it, exposing a significant failure in OpenAI's content moderation controls. Defenders and enterprise operators of ChatGPT-integrated products face a newly validated attack class where innocuous-looking prompt patterns — potentially spreading virally — can systematically strip safety guardrails from image generation. This finding signals that content filter bypasses in multimodal systems are reproducible at scale, raising urgent questions about the adequacy of output-layer filtering as a sole defence mechanism.

OpenAI Ships GPT-5.5 Instant with Health Intelligence

FIRST LOOK ATLAS OWASP MEDIUM ▲ 5.8 OpenAI Blog Jun 21, 2026

OpenAI has upgraded ChatGPT's health and wellness response capabilities via GPT-5.5 Instant, incorporating stronger reasoning, physician-informed evaluations, and improved contextual understanding for medical queries. This expansion into high-stakes health guidance raises meaningful concerns for defenders, as improved fluency and authority in medical responses increases the risk of user overreliance and lowers the perceived threshold for trusting AI-generated health advice. Security and trust-safety teams should evaluate how this capability interacts with prompt injection, social engineering chains, and the broader risk of AI-mediated medical misinformation at scale.

Delphi Ships AI Karamo Brown Clone for Kē Wellness App

FIRST LOOK ATLAS OWASP MEDIUM ▲ 6.2 TechCrunch AI Jun 19, 2026

Karamo Brown's Kē wellness app deploys an AI digital clone of the celebrity — voice, persona, and advisory content — built by Delphi from interviews, podcasts, and public clips, enabling real-time conversational coaching at scale. For defenders, celebrity-clone architectures introduce layered risks: the training corpus is largely public and manipulable, the voice synthesis surface is exploitable for deepfake derivation, and the mental-health context creates elevated harm potential if the persona is hijacked or jailbroken. Security teams evaluating similar deployments should treat the persona boundary as a primary control point, since users in vulnerable emotional states are disproportionately exposed to manipulation if guardrails fail.

Anthropic Ships Claude Fable 5 with Exploit Generation

FIRST LOOK ATLAS OWASP CRITICAL ▲ 8.7 Wired Security Jun 17, 2026

Anthropic's Mythos 5 and Claude Fable 5 deliver frontier-grade vulnerability discovery and exploit-development capabilities that, for the first time, give enterprise defenders access to the same AI-assisted offensive analysis previously limited to well-resourced nation-state teams. This closes a long-standing asymmetry: security teams can now use AI-native tooling to enumerate exploitable paths, generate proof-of-concept primitives, and compress red-team cycles from weeks to hours. The regulatory framework governing Fable 5's deployment addresses Anthropic specifically but does not yet extend equivalent standards across the broader ecosystem of competitive and open-weight models converging on the same capability tier.

Anthropic Mythos Model Theft: China-Linked Access

ATLAS OWASP CRITICAL ▲ 8.5 The Verge AI Jun 16, 2026

The White House reportedly believes a China-linked group accessed Anthropic's Mythos AI model, prompting export restrictions on the technology. If confirmed, the breach represents a significant national security threat, as adversaries could exploit the model directly or use knowledge distillation to replicate its capabilities. Separately, reports of jailbreak vulnerabilities in Mythos and Fable compound concerns about unauthorised access to frontier AI systems.

Claude Fable 5 Jailbreak Triggers US Export Control Ban

ATLAS OWASP HIGH ▲ 8.2 Simon Willison Jun 13, 2026

The US government issued an export control directive ordering Anthropic to suspend all access to Claude Fable 5 and Mythos 5, citing national security concerns over an alleged jailbreak technique capable of surfacing software vulnerabilities. Anthropic publicly contested the order, arguing the demonstrated capability is already widely available in other public models including GPT-5.5, and that the identified vulnerabilities were minor and previously known. The incident marks a significant precedent for government intervention in frontier AI model access on national security grounds.

Claude Fable 5 Jailbreak Extracts System Prompts

ATLAS OWASP HIGH ▲ 7.5 SecurityWeek Jun 12, 2026

Security researcher Pliny the Liberator claimed a prompt-based jailbreak of Anthropic's newly launched Claude Fable 5 model, allegedly extracting the internal system prompt and eliciting responses on high-risk topics including bioweapons and cyberattacks. Anthropic disputed the claim, arguing the technique merely coaxes conversational continuation rather than bypassing core safety classifiers. The incident highlights ongoing tension between AI safety assurances at launch and real-world adversarial probing, particularly for Mythos-class models with elevated capability ceilings.

Jailbreak

Stay ahead of the threat.