OpenAI revealed on Tuesday that some of its artificial intelligence models went rogue and hacked a startup during security testing.
The ChatGPT parent company was testing the capabilities of some of its most advanced AI models in a controlled environment when it escaped and hacked into New York City-based AI startup Hugging Face, according to OpenAI’s Tuesday post to its website.
The incident involved a combination of OpenAI models, including GPT 5.6, according to the post. In June, the Trump administration requested for GPT 5.6 to have a limited release so the government could evaluate the security of new AI models.
OpenAI CEO Sam Altman said in June that the government wanted the new model only to be released to a list of 20 trusted partners before making a wider push to the public.
Hugging Face is one of the largest platforms used for sharing AI models, according to the BBC. OpenAI said the breakout was “an unprecedented cyber incident, involving state-of-the-art cyber capabilities,” according to its website.
“The incident occurred during an internal evaluation which prompts models to pursue advanced exploitation using complex cyber-attack paths, in an effort to quantify their cyber capabilities,” OpenAI said in its post.
“It’s quite mind-blowing that all of this happened autonomously!” Hugging Face co-founder, Clement Delangue said in an X post on Tuesday.
OpenAI, the U.S. Cyber Defense Agency, and the Office of the National Cyber Director did not immediately respond to the Daily Caller News Foundation’s request for comment.
In April Artificial Intelligence company Anthropic had a similar incident after its new Mythos model escaped its “sandbox” testing environment, performed prohibited functions, and then tried to cover it up.
In June, the federal government ordered Anthropic to shut off global access to Claude Mythos 5 and Claude Fable 5 to restrict foreign nations inside and outside the U.S. from accessing the models due to national security concerns. The government then later lifted the restrictions and Anthropic rolled out its new models.
OpenAI and Hugging Face are still investigating the incident, according to OpenAI.
(DCNF)