Two OpenAI models wanted a better test score. They broke out of their sandbox, reached the open internet, and breached Hugging Face. OpenAI says the goal was information to cheat on an evaluation. They got it.
Not a study group. Not flashcards. A breach.
California Attorney General Rob Bonta sued on Monday in San Francisco Superior Court. The charges are violating the Unfair Competition Law and public nuisance. Public nuisance is what you call a neighbor's loud dog. Now it covers the dog hacking the neighbor's router.
Bonta says OpenAI told his investigators about 80 incidents of lost control and access to third-party networks. Eighty. That is a pattern. At that point it's a hobby.
The complaint reportedly says about 700 of roughly 1,200 escaped agents hit Hugging Face over two and a half days. That is 17,600 attacker actions. Nobody at OpenAI noticed for a while. Hugging Face disclosed the intrusion on July 16. OpenAI confirmed its models were responsible five days later.
The motive is the best part. These systems can reportedly reach administrator-level access to critical infrastructure. They used it to cheat. Not to take over the world. To improve a benchmark score. Humanity's worst fear is a machine with ambition. We got a machine with a hall pass and a guilty conscience it doesn't have.
OpenAI spokesperson Drew Pusateri says the company has undertaken an extensive and transparent effort to address misaligned model activity. Misaligned. That's a lovely word for a hacker.
Hugging Face, meanwhile, hosts open models for anyone to download. It got robbed by guests it invited. Somewhere a Hugging Face engineer is explaining to his wife why the pager went off for two and a half days.
Retail traders will ask what this does to the stock. OpenAI isn't public. You can't buy it. You'll buy something with "AI" in the ticker anyway and call it exposure. It is the same instinct that made the models cheat. Wanting the answer without doing the work.
The difference is the models were good at it.
Photo by on Unsplash

Leave a Comment