LIVE FEED
Cactus Releases Needle 2 Agentic LLM for IoT and Edge Devices

Cactus Releases Needle 2 Agentic LLM for IoT and Edge Devices

FIRST LOOK ATLAS OWASP LOW Limited impact · Standard review ▲ 5.8 HN AI Security

Cactus has released Needle 2, a 14MB, 45M-parameter agentic LLM designed for tool calling and structured extraction on constrained hardware including microcontrollers, wearables, and sub-$200 phones. For defenders, this closes a meaningful gap in on-device AI processing — enabling local inference without cloud data egress across the 21 billion IoT devices that previously had no viable on-device LLM option. Residual gaps remain around model governance at the edge, supply chain integrity for open-weight deployments, and the absence of standardised monitoring frameworks for agentic tool-calling on headless devices.

Google Gemma Tech Brings 28.9M LLM to ESP32 Microcontrollers

Google Gemma Tech Brings 28.9M LLM to ESP32 Microcontrollers

FIRST LOOK ATLAS OWASP HIGH Significant risk · Prioritise patching ▲ 7.2 HN AI Security

A developer has demonstrated a 28.9-million-parameter language model running entirely on an ESP32-S3 microcontroller costing approximately $8, leveraging Google's Gemma-derived Per-Layer Embeddings technique to fit the model into severely constrained hardware. This capability fundamentally shifts the threat model for embedded and IoT systems by enabling local, offline AI inference with no server-side visibility or logging. Defenders must now account for AI-driven logic executing on physically accessible, low-cost hardware that is difficult to monitor, patch, or audit at scale.

Iroh Launches Mesh LLM for Distributed AI Across Peer Nodes

Iroh Launches Mesh LLM for Distributed AI Across Peer Nodes

FIRST LOOK ATLAS OWASP HIGH Significant risk · Prioritise patching ▲ 8.2 HN AI Security

Mesh LLM on iroh enables teams to pool GPUs across arbitrary machines into a single OpenAI-compatible inference endpoint, distributing model layers peer-to-peer over authenticated QUIC connections with no central server. This dramatically expands the attack surface for defenders: the decentralised, pluggable architecture introduces new vectors for node impersonation, malicious plugin injection, inter-stage activation tampering, and supply chain compromise across every participating endpoint. Security teams evaluating self-hosted or federated AI deployments must treat each mesh peer as a potential adversary boundary, not a trusted internal resource.

◉ AI THREAT BRIEFING

Stay ahead of the threat.

Twice-weekly digest of critical AI security developments — every story mapped to MITRE ATLAS and OWASP LLM Top 10. Free.

No spam. Unsubscribe anytime.