Dario Amodei · Sam Altman · Anthropic · OpenAI · Elon Musk · xAI · The Atlantic Technology
AI Companies’ New Plan to Keep Themselves From Destroying Everything
Compiled by KHAO Editorial — aggregated from 2 sources. See llms.txt for citation guidance.
◎ Multiple-sources
Dario Amodei, Sam Altman, and Elon Musk don’t agree on much.
Key facts
- METR, a 43-person organization based in Berkeley, has partnered with the leading AI labs to measure model misalignment since 2023
- The AI space is not that large,” Jacob Steinhardt, a Berkeley computer-science professor and the CEO of Transluce, a San Francisco–based AI-evaluation nonprofit, told me
- Give me a break,” posted House Majority Leader Steve Scalise, quoting a New York Post cover describing METR employees as “The Woke Wizards of A.the reporter
- Trump’s accelerationism—informed by his rapport with ballroom sponsor and NVIDIA CEO Jensen Huang—likely dooms federal AI-safety regulation for now
Summary
Both Amodei and Altman made express commitments to integrating such evaluations inside their companies. Yet the details of such a system for regulating AI remain vague. An unknown number of outside evaluators would be assigned desks to sit at, computers to use, and NDAs to sign. As for these experts, it seems likely that they’ll come from small nonprofits, as well as large firms. On-site evaluation has precedent in other high-risk industries such as aviation and banking. Yet Amodei’s proposal is still far from a comprehensive AI-auditing regime. That doesn’t add up to true independent oversight, and at least some METR employees seem to agree.