Industry News

173 reports

All LLM Security Agentic AI Industry News Research Supply Chain Prompt Injection First Look: Security Regulatory Jailbreaks Adversarial ML Data Poisoning Model Theft AI Security Tools Security Operations

Brex CrabTrap: LLM Proxy Blocks Agentic AI Prompt Injection

ATLAS OWASP MEDIUM ▲ 7.2 HN AI Security Apr 22, 2026

Brex has open-sourced CrabTrap, an HTTP proxy that uses an LLM-as-a-judge architecture to intercept, evaluate, and block or allow requests made by AI agents in real time against configurable policies. The tool targets a critical gap in agentic AI deployments — the lack of runtime guardrails for autonomous agent actions — and represents a practical defensive control against excessive agency and prompt injection exploitation. Its production-oriented design positions it as a notable contribution to the emerging agentic AI security toolchain.

Firefox: 271 Vulnerabilities Found via AI-Assisted Discovery

ATLAS OWASP MEDIUM ▲ 7.2 Simon Willison Apr 22, 2026

Firefox CTO Bobby Holley reports that a collaboration with Anthropic using an early version of Claude Mythos Preview identified 271 vulnerabilities in Firefox, resulting in fixes shipped in Firefox 150. This represents a significant real-world demonstration of AI-assisted vulnerability discovery at scale, signalling a shift in the defender-attacker dynamic. The findings suggest LLMs are becoming operationally viable tools for large-scale code security auditing.

Claude System Prompts Exposed via Git-Based Extraction

ATLAS OWASP MEDIUM ▲ 6.2 Simon Willison Apr 22, 2026

Simon Willison has created a git-based tool to track the evolution of Anthropic's publicly published Claude system prompts across model versions, enabling structured diff analysis of prompt changes over time. While the underlying prompts are intentionally public, the tooling lowers the barrier for adversarial reconnaissance — making it easier for threat actors to identify shifts in safety constraints, refusal heuristics, or behavioral guardrails between model releases. This kind of systematic prompt archaeology directly supports meta-prompt extraction and jailbreak development workflows.

GoModel AI Gateway Supply Chain Compromise

ATLAS OWASP MEDIUM ▲ 6.2 HN AI Security Apr 21, 2026

GoModel is an open-source AI gateway written in Go that provides a unified OpenAI-compatible API across multiple LLM providers including OpenAI, Anthropic, Gemini, Groq, xAI, and Ollama. As an infrastructure layer sitting between applications and AI backends, it introduces a significant supply chain and API security surface that warrants scrutiny. The project advertises built-in guardrails and observability, which are positive security signals, but open-source gateway projects centralising multi-provider API key management represent a meaningful attack vector if misconfigured or compromised.

Prompt Injection Risk: Claude 4.7 Agentic Tool Expansion

ATLAS OWASP MEDIUM ▲ 6.2 HN AI Security Apr 20, 2026

Anthropic's published system prompt diff between Claude Opus 4.6 and 4.7 reveals significant expansions in agentic tool access, autonomous browsing capabilities, and child safety guardrails — changes with direct security implications for prompt injection and excessive agency risks. The new `tool_search` mechanism and acting-before-asking posture increase the attack surface for adversarial inputs targeting agentic Claude deployments. Transparency in publishing these changes is notable, but the expanded autonomous capabilities warrant scrutiny from defenders.

Vercel Breach: Context.ai OAuth Token Hijack Exposes Credentials

ATLAS OWASP HIGH ▲ 7.5 The Hacker News Apr 20, 2026

Vercel suffered a breach originating from a compromised third-party AI tool, Context.ai, where an employee's OAuth token was hijacked to access Vercel's Google Workspace and internal environment variables. The incident highlights the systemic risk of granting broad OAuth permissions to AI productivity tools, particularly when employees use enterprise credentials with 'Allow All' permission scopes. ShinyHunters has claimed responsibility and is reportedly selling the stolen data for $2 million.

Autonomous Exploit Generation: Claude Mythos Risk

ATLAS OWASP HIGH ▲ 8.5 Schneier on Security Apr 20, 2026

Bruce Schneier analyses Anthropic's Claude Mythos Preview and Project Glasswing, a controlled deployment programme aimed at finding and patching software vulnerabilities before the model is publicly released due to its advanced cyberattack capabilities. The piece highlights a growing offensive AI capability gap, noting that newer LLMs can autonomously chain memory corruption bugs and operationalise exploits without human orchestration, while observing that defenders currently retain a marginal advantage because vulnerability discovery is easier than exploitation. Schneier warns that this advantage is narrowing rapidly and that the industry must prepare for a world of commoditised zero-day exploits.

AI-Powered Adversarial Attacks Spark Artemis Defense

ATLAS OWASP MEDIUM ▲ 6.2 SecurityWeek Apr 20, 2026

Artemis, a cybersecurity startup focused on AI-powered threat defence, has emerged from stealth with $70 million in funding, positioning itself to counter AI-driven attacks across applications, users, endpoints, and cloud workloads. The emergence signals growing investor confidence in purpose-built AI security platforms designed to address the escalating threat landscape of adversarial AI. While details on specific technical capabilities remain sparse, the company's broad scope suggests coverage of multiple attack surfaces increasingly targeted by AI-enabled threat actors.

Axios npm Library Compromised in Supply Chain Attack

ATLAS OWASP HIGH ▲ 7.2 The Hacker News Apr 20, 2026

A North Korean threat group (UNC1069) compromised the popular npm Axios library via a supply chain attack, injecting a backdoor (WAVESHAPER.V2) into two poisoned versions that were inadvertently downloaded by OpenAI's macOS app-signing GitHub Actions workflow. Although OpenAI found no evidence of certificate exfiltration or user data compromise, the incident exposed the signing credentials for ChatGPT Desktop, Codex, Codex CLI, and Atlas, prompting certificate revocation and mandatory app updates by May 8, 2026. The attack highlights the acute risk of software supply chain compromises against AI product delivery pipelines.

Legacy Vulnerabilities Amplified by AI at Enterprise Scale

ATLAS OWASP HIGH ▲ 6.5 Dark Reading Apr 18, 2026

The article argues that AI's primary security risk lies not in introducing entirely new vulnerability classes, but in dramatically amplifying the impact and exploitability of well-established ones. This framing has significant implications for defenders, suggesting that legacy vulnerability management practices must be re-evaluated through an AI-augmented threat lens. The convergence of classic weaknesses with AI capabilities raises the baseline risk profile for organisations deploying or adjacent to AI systems.

Cursor AI Prompt Injection Chains to Shell Access

ATLAS OWASP CRITICAL ▲ 8.5 SecurityWeek Apr 18, 2026

A chained vulnerability in Cursor AI—a widely-used AI-powered code editor—allowed attackers to combine indirect prompt injection with a sandbox escape and the application's built-in remote tunnel feature to achieve arbitrary shell access on developer machines. The attack chain is particularly significant because it weaponises Cursor's own legitimate remote-access infrastructure, meaning malicious commands could blend into normal developer workflows. Developers using Cursor's AI features against untrusted code or repositories are at elevated risk of full host compromise.

GPT-5.4-Cyber Expansion Raises LLM Jailbreak Dual-Use Risks

ATLAS OWASP MEDIUM ▲ 6.5 SecurityWeek Apr 17, 2026

OpenAI has expanded access to GPT-5.4-Cyber, a fine-tuned model designed for defensive cybersecurity applications, following Anthropic's reveal of its Mythos cybersecurity model. While framed as a defensive tool for legitimate security practitioners, the widened access to a capability-enhanced cybersecurity LLM raises dual-use concerns around potential misuse for offensive operations. The competitive dynamic between major AI labs in the security-focused model space signals a broader industry trend that warrants careful access control and policy scrutiny.

CrowdStrike OpenAI LLM Integration Raises Prompt Injection Risks

ATLAS OWASP MEDIUM ▲ 6.2 CrowdStrike Blog Apr 17, 2026

CrowdStrike has announced a partnership with OpenAI's Threat Actor Collaboration (TAC) programme, positioning frontier AI models as defensive tools within the cybersecurity operations space. The collaboration signals a broader industry push to deploy advanced LLMs in security contexts, raising important considerations around agentic AI risk, model trust boundaries, and the dual-use nature of frontier AI capabilities. While framed as a defensive initiative, the integration of powerful AI into SOC workflows introduces new attack surfaces including prompt injection against agentic pipelines and potential for sensitive data leakage through LLM interfaces.

Agentic AI Excessive Agency Bypasses Security Testing

ATLAS OWASP MEDIUM ▲ 6.5 The Hacker News Apr 16, 2026

The article examines the architectural tension between fully agentic AI systems and deterministic validation frameworks in security testing contexts, arguing that unconstrained AI autonomy introduces repeatability and auditability risks. It highlights how probabilistic AI behaviour — while valuable for exploration — undermines the measurable, consistent outcomes required for enterprise security validation programs. The piece reflects a broader industry debate about governing AI agency in high-stakes operational environments.

AI Agent Prompt Injection and Data Leakage Threats Rise

ATLAS OWASP MEDIUM ▲ 6.5 SecurityWeek Apr 16, 2026

Capsule Security, an Israeli startup, has emerged from stealth with $7 million in seed funding focused on runtime security for AI agents, continuously monitoring their behaviour to detect and prevent unsafe or malicious actions. This positions the company within the rapidly growing agentic AI security space, where autonomous agents executing actions on behalf of users represent a significant and underexplored attack surface. The funding signals growing investor recognition of the risks posed by unmonitored AI agent behaviour, including prompt injection, excessive agency, and unintended tool use.

Industry News

Stay ahead of the threat.