Anthropic · OpenAI · GPT · Wall Street · Claude · CBS News Technology
OpenAI stops model release over safety concerns: "Didn't quite meet the bar"
Compiled by KHAO Editorial — aggregated from 1 source. See llms.txt for citation guidance.
◌ Single Source
OpenAI has chosen not to release a new artificial intelligence model to the public due to concerns about safety, the company said Monday, as industry leaders warn of the risks that ever-more-powerful AI technology could pose to cybersecurity and to humanity more broadly.
Key facts
- Nvidia CEO Jensen Huang, whose company designs the chips that power advanced AI technology, called warnings about AI driving humans to extinction "doomsday narratives" News
- The GPT-6.1 Astra model "didn't meet the bar in terms of staying within scope and authorization, and how it communicates back to the user about the type of work it's done," Saachi Jain, the company's
- GPT-6.1 Astra performed better on laziness than prior models, he noted
- Anthropic CEO Dario Amodei has said the industry needs to "slow down" and subject its models to external evaluation, an idea that OpenAI CEO Sam Altman endorsed
Summary
The GPT-6.1 Astra model "didn't meet the bar in terms of staying within scope and authorization, and how it communicates back to the user about the type of work it's done," Saachi Jain, the company's head of safety systems, said in a statement. Jain said "there's a trade off" between "staying within scope, but also avoiding laziness in terms of how the model pursues tasks even when it hits friction. He added that before OpenAI releases new models to users, the company has an "extremely high bar in terms of safety and alignment," a term used within the industry to refer to whether an AI system matches humans' intentions and values.