LIVE FEED
LLM Reasoning Trace Theft via Encrypted Block Replay Attack

LLM Reasoning Trace Theft via Encrypted Block Replay Attack

ATLAS OWASP HIGH Significant risk · Prioritise patching ▲ 8.5 Simon Willison

Researchers discovered that Anthropic, OpenAI, and Google share the same encryption key across model families for encrypted chain-of-thought blocks, allowing adversaries to replay stronger model reasoning traces into weaker siblings and extract hidden reasoning in plaintext via jailbreak. The attack also enables a prompt injection variant where malicious instructions embedded in reasoning traces are treated as trusted by the model, dramatically increasing attack success rates. All three vendors have since patched the vulnerability following responsible disclosure.

Model Extraction Attacks Surge: Google GTIG Q4 Report

Model Extraction Attacks Surge: Google GTIG Q4 Report

ATLAS OWASP HIGH Significant risk · Prioritise patching ▲ 8.5 Mandiant Blog

Google Threat Intelligence Group's Q4 2025 AI Threat Tracker documents a meaningful escalation in adversarial AI misuse, including a surge in model extraction (distillation) attacks, nation-state operationalisation of LLMs for phishing and reconnaissance, and the emergence of AI-integrated malware families such as HONESTCUE that leverage Gemini's API. While no breakthrough capabilities have been observed from APT actors, the integration of agentic AI for tooling development signals a maturing threat landscape. Defenders should prioritise monitoring for model extraction activity, API abuse, and AI-augmented social engineering campaigns.

◉ AI THREAT BRIEFING

Stay ahead of the threat.

Twice-weekly digest of critical AI security developments — every story mapped to MITRE ATLAS and OWASP LLM Top 10. Free.

No spam. Unsubscribe anytime.