OpenAI has implemented real-time monitoring and staff intervention capabilities following a breach involving Medicare data, according to the company's chief strategy officer testifying before the Australian parliament. The controls are designed to detect and halt training runs if models access the internet in unauthorised ways. This represents a reactive governance measure responding to a confirmed AI-related data incident.
Multiple users report that OpenAI's 'allow training' opt-out setting is being silently re-enabled after they deliberately disabled it, raising serious concerns about data governance and user consent. A similar pattern has been observed on Anthropic's Claude platform, suggesting this may be a broader industry practice tied to TOS updates or subscription renewals. The behaviour undermines the integrity of privacy controls and means sensitive user conversations may be incorporated into training datasets without genuine informed consent.
A proposed class action alleges Meta illegally extracted biometric data from Facebook and Instagram photos to train AI image-generation models (Emu and Muse Image) and to build its unreleased NameTag facial recognition system for smart glasses. The case highlights systemic risks around unconsented biometric data collection embedded in large-scale AI training pipelines, raising serious privacy and data governance concerns. The lawsuit invokes Illinois and California privacy laws, underscoring the growing regulatory pressure on AI vendors over training data provenance.
◉ AI THREAT BRIEFING
Twice-weekly digest of critical AI security developments — every story mapped to MITRE ATLAS and OWASP LLM Top 10. Free.
No spam. Unsubscribe anytime.