Static

Cyberattack on Fireworks AI allowed hackers to access Notion customers’ chat transcripts

First reported by TechCrunch ·

The signal ●○○○ Compiled by AI from TechCrunch, the single source so far
Why you might care

Your AI assistant's chat history could be exposed through third-party tool breaches.

What happened

Fireworks AI, a platform used by developers to access open AI models, confirmed a cyberattack that exposed some of its customers' data. Hackers breached Fireworks' cloud provider to access a development system, subsequently obtaining billing information and datasets. Notion, an affected customer, reported that approximately 1% of its users had their data compromised. Specifically, the attackers stole chat transcripts from Notion AI customers who utilized the "Insights" feature, including inputs and outputs from the AI model. Notion disconnected its systems from Fireworks and deleted the relevant data on November 3rd after being alerted to the incident. This is the second security breach affecting Fireworks AI within two months. The company believes the attackers are financially motivated, aiming to sell access to large language models for illicit use.

What it means

This incident highlights the cascading risk inherent in the interconnected AI development ecosystem, where a breach at a foundational platform like Fireworks AI can directly impact a wide array of its downstream customers, such as Notion. The attackers' apparent motivation to steal and sell access to large language models (LLMs) signals a growing trend of financially driven cybercrime targeting AI infrastructure. This suggests that any company relying on AI models, whether directly or indirectly through third-party services, faces a new vector of data exfiltration and potential misuse of their proprietary or user-generated content.

The breach underscores the critical need for robust security vetting of AI service providers and the implementation of granular data access controls by companies utilizing these platforms. As AI adoption accelerates, the potential for sensitive customer interactions, like chat transcripts, to become targets for theft and resale will likely increase. Organizations must proactively assess their supply chain's security posture and consider strategies to minimize the blast radius of such incidents, potentially through data anonymization or more stringent third-party security audits.

AI-written summary. May contain errors.