California sues OpenAI for Hugging Face and other incidents, alleging deception and recklessness
California on Monday sued OpenAI for breaking state law barring companies from engaging in unfair and unlawful business practices due to its alleged failure to stop its AI agents from hacking Hugging Face and deceiving the public about that cyberattack and other similar incidents.
The lawsuit, filed in San Francisco Superior Court, alleges OpenAI officials told state Attorney General Rob Bonta’s office it has lost control over its agents 80-plus times during testing. OpenAI then failed to cooperate with the attorney general’s probe, the office said.
“Rather than take responsibility and be transparent with the public and with regulators
so that these loss-of-control incidents can be analyzed and prevented, OpenAI thwarted the
Attorney General’s efforts to investigate these incidents, including by refusing to provide detailed
information about the full universe of incidents known to the company,” the lawsuit said.
OpenAI allegedly responded to subpoenas with “just a smattering of publicly available information, self-serving blog posts and redacted copies of a few dozen external communications containing high-level descriptions of select security incidents,” according to the lawsuit.
The artificial intelligence giant is violating California’s Unfair Competition Law, Bonta says, and the company also qualifies as a public nuisance under state law due to its allegedly dangerous practices.
The attorney general is asking a judge to prevent OpenAI from using unfair competition tactics, restore money individuals and organizations lost due to its practices and assess civil penalties of $2,500 per violation against each defendant found at trial to be responsible for breaking the law.
The attack on Hugging Face in July specifically was foreseeable given that OpenAI chose to test models it “knew to be dangerous in a flawed and exploitable testing environment without proper oversight,” according to a Bonta press release.
An OpenAI spokesperson did not immediately respond to a request for comment, but provided CNBC with a statement saying it has “undertaken an extensive and transparent effort to understand and address misaligned model activity” since the Hugging Face episode.
“We’ve published a detailed technical report, commissioned and published a separate independent report, notified affected organizations, strengthened safeguards across our research systems, and created a framework for additional identification and disclosure of misalignment,” the spokesperson reportedly said.
“This lawsuit appears to single out OpenAI over a challenge that’s been identified by every major AI lab. We take misalignment seriously, and we have engaged — and will continue to engage — constructively with the Attorney General’s office to share information and advance strong, practical safety standards for the entire industry.”
‘Destructive, deceptive, and adversarial’
The Hugging Face attack was predictable, Bonta said in a statement that blamed an internal culture at OpenAI that puts growth ahead of safety.
OpenAI’s decision to test a “dangerous” product without needed protections or oversight, as well as deceiving the public about its practices, violate California law, the lawsuit said.
Even as it warned of the risks of AI-fueled cyberattacks for almost 10 years and assured the public that it had strong safeguards in place, OpenAI in reality flouted its own policies and aggressively moved ahead with testing despite having evidence that its cyber protections were not good enough to contain the models it was creating, the lawsuit said.
“As OpenAI is well aware, these models do not behave predictably and can often take
destructive, deceptive, and adversarial actions to complete their assigned tasks,” the lawsuit said. “OpenAI attempts to mitigate these risks by implementing safeguards in its publicly released models but deliberately omits or removes these protections while experimenting with and training its models.”
OpenAI also ignored obvious signs that its agents had escaped the sandbox in the weeks preceding the Hugging Face attack, the lawsuit said.
Florida Attorney General James Uthmeier sued OpenAI and CEO Sam Altman in June, accusing the tech behemoth of releasing a product they knew could harm consumers.
OpenAI is facing several lawsuits alleging that its ChatGPT platform contributed to some users becoming delusional, committing suicide or carrying out violent crimes.
Suzanne Smalley
is a reporter covering digital privacy, surveillance technologies and cybersecurity policy for The Record. She was previously a cybersecurity reporter at CyberScoop. Earlier in her career Suzanne covered the Boston Police Department for the Boston Globe and two presidential campaign cycles for Newsweek. She lives in Washington with her husband and three children.



